2024-09-17T00:46:59.791 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T00:46:59.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T00:46:59.917 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7907987' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 599 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 33/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2dkZ4sO/7r+ldXtcLii7GZqjyExTEBByLRIHuiYYUfw7yzRoc5ejtcwNtnp2TmWNkRVPEsuQQNkA6if5E+fdc= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPsoJRnIRaikazu/8wzz5N0ehmfqU+3xYXEfR5pa6bdSzO5hbY6ASEc0NV79oieuzROFsNnOZFfFtd1NgyI+fgA= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_21:08:04 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-17T00:46:59.917 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa; will attempt to use it 2024-09-17T00:46:59.918 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks 2024-09-17T00:46:59.918 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T00:46:59.919 INFO:teuthology.task.internal:Checking packages... 2024-09-17T00:46:59.940 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T00:46:59.940 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:46:59.940 INFO:teuthology.packaging:ref: None 2024-09-17T00:46:59.941 INFO:teuthology.packaging:tag: None 2024-09-17T00:46:59.941 INFO:teuthology.packaging:branch: squid 2024-09-17T00:46:59.941 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:46:59.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T00:47:00.175 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-17T00:47:00.177 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T00:47:00.183 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T00:47:00.184 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T00:47:00.197 INFO:teuthology.task.internal:Saving configuration 2024-09-17T00:47:00.219 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T00:47:00.226 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T00:47:00.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 00:41:42.080474', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2dkZ4sO/7r+ldXtcLii7GZqjyExTEBByLRIHuiYYUfw7yzRoc5ejtcwNtnp2TmWNkRVPEsuQQNkA6if5E+fdc='} 2024-09-17T00:47:00.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 00:41:42.082425', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPsoJRnIRaikazu/8wzz5N0ehmfqU+3xYXEfR5pa6bdSzO5hbY6ASEc0NV79oieuzROFsNnOZFfFtd1NgyI+fgA='} 2024-09-17T00:47:00.277 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T00:47:00.283 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T00:47:00.283 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-17T00:47:00.283 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T00:47:00.356 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb3044fbac0>, signals=[15]) 2024-09-17T00:47:00.356 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T00:47:00.362 INFO:teuthology.task.internal:Opening connections... 2024-09-17T00:47:00.362 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T00:47:00.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:47:00.443 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-09-17T00:47:00.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:47:00.523 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T00:47:00.529 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-17T00:47:00.549 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-17T00:47:00.549 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-17T00:47:00.607 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-17T00:47:00.608 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T00:47:00.608 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-17T00:47:00.608 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T00:47:00.608 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T00:47:00.608 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T00:47:00.609 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-17T00:47:00.629 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-09-17T00:47:00.648 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-09-17T00:47:00.648 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-09-17T00:47:00.707 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T00:47:00.708 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T00:47:00.708 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-09-17T00:47:00.729 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T00:47:00.739 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T00:47:00.744 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T00:47:00.745 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-17T00:47:00.747 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-09-17T00:47:00.764 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T00:47:00.794 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T00:47:00.794 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-17T00:47:00.805 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-09-17T00:47:00.903 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T00:47:00.956 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T00:47:00.972 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T00:47:00.973 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T00:47:00.973 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T00:47:00.974 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T00:47:00.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:47:00.991 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-17T00:47:00.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:47:00.992 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-17T00:47:01.049 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-503.el9.x86_64 2024-09-17T00:47:01.050 INFO:teuthology.task.kernel:Running kernel on smithi143: 5.14.0-503.el9.x86_64 2024-09-17T00:47:01.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum install -y kernel 2024-09-17T00:47:01.051 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-17T00:47:01.052 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-17T00:47:01.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-17T00:47:04.488 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-17T00:47:04.621 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-17T00:47:06.889 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-17T00:47:09.830 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-17T00:47:13.559 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-17T00:47:14.031 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-17T00:47:15.091 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-17T00:47:15.856 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-17T00:47:16.647 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-17T00:47:17.552 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-17T00:47:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-17T00:47:22.959 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T00:47:24.027 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T00:47:24.027 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T00:47:24.116 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:47:24.125 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-17T00:47:24.126 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:47:24.127 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-17T00:47:24.127 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-17T00:47:24.127 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:47:24.314 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 533 kB/s | 36 kB 00:00 2024-09-17T00:47:24.772 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-17T00:47:24.857 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T00:47:24.857 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T00:47:24.939 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:47:24.951 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:47:24.951 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout:Install 4 Packages 2024-09-17T00:47:24.952 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:47:24.953 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 79 M 2024-09-17T00:47:24.953 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 126 M 2024-09-17T00:47:24.953 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:47:25.179 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.184 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.184 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.257 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.263 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.269 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.327 INFO:teuthology.orchestra.run.smithi143.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 190 kB/s | 36 kB 00:00 2024-09-17T00:47:25.348 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.370 INFO:teuthology.orchestra.run.smithi143.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:47:25.431 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-17T00:47:25.765 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-17T00:47:25.765 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:47:25.765 INFO:teuthology.orchestra.run.smithi103.stdout:Total 48 MB/s | 79 MB 00:01 2024-09-17T00:47:26.443 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:47:26.834 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:47:26.834 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:47:27.635 INFO:teuthology.orchestra.run.smithi143.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-09-17T00:47:27.821 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:47:27.821 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:47:28.269 INFO:teuthology.orchestra.run.smithi143.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-17T00:47:28.919 INFO:teuthology.orchestra.run.smithi143.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 8.0 MB/s | 29 MB 00:03 2024-09-17T00:47:28.922 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:47:28.922 INFO:teuthology.orchestra.run.smithi143.stdout:Total 20 MB/s | 79 MB 00:03 2024-09-17T00:47:29.606 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:47:29.958 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:47:29.958 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:47:30.258 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:47:30.909 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:47:30.940 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:47:30.940 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:47:31.015 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:47:33.350 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:47:33.775 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:47:33.908 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:47:34.043 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:47:34.123 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:47:36.893 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:47:37.032 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:47:38.775 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:47:38.884 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:47:41.864 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:47:41.907 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:47:43.750 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:47:46.747 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:22.232 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:22.273 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:22.625 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:22.625 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:48:22.625 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:48:22.625 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:48:23.479 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:48:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:48:23.822 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:48:23.909 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:48:23.909 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:48:23.909 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T00:48:23.909 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T00:48:23.910 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T00:48:23.910 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T00:48:23.910 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T00:48:23.910 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:48:23.969 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:48:23.969 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:48:23.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-17T00:48:24.008 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-17T00:48:24.008 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-17T00:48:24.008 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-17T00:48:24.008 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T00:48:24.009 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:48:24.010 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T00:48:24.011 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T00:48:24.011 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-508.el9.x86_64 2024-09-17T00:48:24.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T00:48:24.683 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-17T00:48:25.223 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:25.263 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:25.625 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:25.626 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:48:25.626 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:48:25.626 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:48:26.005 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T00:48:26.041 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-17T00:48:26.043 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-17T00:48:26.059 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.YINMm2hLoe 2024-09-17T00:48:26.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YINMm2hLoe 2024-09-17T00:48:26.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.YINMm2hLoe 2024-09-17T00:48:26.262 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.YINMm2hLoe is 6KB 2024-09-17T00:48:26.312 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.YINMm2hLoe 2024-09-17T00:48:26.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T00:48:26.395 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T00:48:26.395 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T00:48:26.395 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T00:48:26.396 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T00:48:26.397 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:48:26.504 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:48:26.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-17T00:48:26.855 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:48:26.944 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:48:26.944 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:48:26.944 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T00:48:26.944 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T00:48:26.944 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T00:48:26.945 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T00:48:26.945 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi143.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T00:48:26.945 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:48:27.004 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:48:27.004 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:48:27.004 DEBUG:teuthology.orchestra.run.smithi143:> sudo rpm -qi grub2-tools 2024-09-17T00:48:27.036 INFO:teuthology.orchestra.run.smithi143.stdout:Name : grub2-tools 2024-09-17T00:48:27.036 INFO:teuthology.orchestra.run.smithi143.stdout:Epoch : 1 2024-09-17T00:48:27.036 INFO:teuthology.orchestra.run.smithi143.stdout:Version : 2.06 2024-09-17T00:48:27.036 INFO:teuthology.orchestra.run.smithi143.stdout:Release : 82.el9 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: x86_64 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Group : Unspecified 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Size : 8274670 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:License : GPLv3+ 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Packager : builder@centos.org 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:Vendor : CentOS 2024-09-17T00:48:27.037 INFO:teuthology.orchestra.run.smithi143.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:Summary : Support tools for GRUB. 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:Description : 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:hardware devices. 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:48:27.038 INFO:teuthology.orchestra.run.smithi143.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T00:48:27.039 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T00:48:27.039 INFO:teuthology.task.kernel:Updating grub on smithi143 to boot 5.14.0-508.el9.x86_64 2024-09-17T00:48:27.039 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T00:48:27.683 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-09-17T00:48:29.065 INFO:teuthology.orchestra.run.smithi143.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T00:48:29.085 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-09-17T00:48:29.089 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-09-17T00:48:29.105 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.1L38mRSdlt 2024-09-17T00:48:29.105 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1L38mRSdlt 2024-09-17T00:48:29.183 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.1L38mRSdlt 2024-09-17T00:48:29.323 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.1L38mRSdlt is 6KB 2024-09-17T00:48:29.372 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.1L38mRSdlt 2024-09-17T00:48:29.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T00:48:29.449 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T00:48:29.450 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T00:48:29.450 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T00:48:29.450 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T00:48:29.451 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T00:48:29.604 DEBUG:teuthology.orchestra.run.smithi143:> sudo shutdown -r now 2024-09-17T00:48:56.573 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T00:48:56.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:48:56.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:48:59.609 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T00:48:59.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-17T00:48:59.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:49:15.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-17T00:49:18.145 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-09-17T00:49:24.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:49:24.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:49:27.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-17T00:49:27.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-17T00:49:27.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:49:39.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:49:39.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:49:42.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-17T00:49:57.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:49:57.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:50:27.179 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T00:50:29.176 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-17T00:50:29.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:50:29.500 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T00:50:29.500 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-17T00:50:29.515 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-508.el9.x86_64 2024-09-17T00:50:29.515 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T00:50:29.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T00:50:29.515 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T00:50:30.516 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T00:50:30.516 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T00:50:30.585 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-17T00:50:30.610 DEBUG:teuthology.parallel:result is None 2024-09-17T00:50:39.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-17T00:50:39.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:50:39.614 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-17T00:50:39.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-17T00:50:39.953 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T00:50:39.953 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-17T00:50:39.969 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-508.el9.x86_64 2024-09-17T00:50:39.969 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T00:50:39.969 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T00:50:39.969 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T00:50:40.970 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T00:50:40.971 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T00:50:41.058 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2024-09-17T00:50:41.078 DEBUG:teuthology.parallel:result is None 2024-09-17T00:50:41.078 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T00:50:41.089 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T00:50:41.089 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T00:50:41.092 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T00:50:41.110 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T00:50:41.160 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T00:50:41.216 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T00:50:41.217 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T00:50:41.219 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T00:50:41.254 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T00:50:41.264 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T00:50:41.264 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T00:50:41.291 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T00:50:41.319 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:50:41.323 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:50:41.330 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:50:41.334 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:50:41.336 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T00:50:41.346 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T00:50:41.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T00:50:41.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T00:50:41.404 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T00:50:41.414 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T00:50:41.414 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T00:50:41.442 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T00:50:41.461 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:50:41.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:50:41.597 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:50:41.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:50:41.720 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:50:41.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T00:50:41.784 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:50:41.825 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:50:41.878 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:50:41.960 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:50:42.005 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:50:42.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T00:50:42.072 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-17T00:50:42.074 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-09-17T00:50:42.128 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T00:50:42.180 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T00:50:42.537 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T00:50:42.545 INFO:teuthology.task.internal:Starting timer... 2024-09-17T00:50:42.545 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T00:50:42.590 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T00:50:42.644 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-17T00:50:42.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-17T00:50:42.689 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-17T00:50:42.691 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-09-17T00:50:42.753 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-09-17T00:50:42.755 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T00:50:42.755 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-17T00:50:42.778 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-17T00:50:42.779 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-09-17T00:50:42.812 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-09-17T00:50:42.812 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi143.front.sepia.ceph.com': 'permissive'} 2024-09-17T00:50:42.813 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T00:50:42.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:50:42.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T00:50:42.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:50:42.880 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T00:50:42.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-17T00:50:42.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-09-17T00:50:42.950 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T00:50:42.962 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T00:50:42.975 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T00:50:42.977 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T00:54:28.174 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2024-09-17T00:54:28.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:54:28.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:54:28.254 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-17T00:54:28.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-17T00:54:28.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-17T00:54:28.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:54:28.414 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-17T00:54:28.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-17T00:54:28.502 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T00:54:28.512 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T00:54:28.512 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T00:54:28.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T00:54:28.515 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T00:54:28.515 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T00:54:28.542 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T00:54:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T00:54:28.572 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T00:54:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-17T00:54:28.587 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T00:54:28.592 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-17T00:54:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T00:54:28.612 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-09-17T00:54:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T00:54:28.624 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-09-17T00:54:28.638 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T00:54:28.653 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T00:54:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-17T00:54:28.677 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T00:54:28.677 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-17T00:54:28.677 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.677 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.677 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.677 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.706 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-17T00:54:28.710 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T00:54:28.710 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-17T00:54:28.710 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.710 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.710 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.710 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:54:28.711 INFO:teuthology.run_tasks:Running task install... 2024-09-17T00:54:28.718 DEBUG:teuthology.task.install:project ceph 2024-09-17T00:54:28.718 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-17T00:54:28.718 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T00:54:28.718 INFO:teuthology.task.install:Using flavor: default 2024-09-17T00:54:28.723 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T00:54:28.723 INFO:teuthology.task.install:extra packages: [] 2024-09-17T00:54:28.724 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-17T00:54:28.724 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:54:28.724 INFO:teuthology.packaging:ref: None 2024-09-17T00:54:28.724 INFO:teuthology.packaging:tag: None 2024-09-17T00:54:28.724 INFO:teuthology.packaging:branch: reef 2024-09-17T00:54:28.725 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:54:28.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-17T00:54:28.727 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-17T00:54:28.727 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:54:28.727 INFO:teuthology.packaging:ref: None 2024-09-17T00:54:28.727 INFO:teuthology.packaging:tag: None 2024-09-17T00:54:28.727 INFO:teuthology.packaging:branch: reef 2024-09-17T00:54:28.727 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:54:28.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-17T00:54:29.014 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/ 2024-09-17T00:54:29.015 INFO:teuthology.task.install.rpm:Package version is 18.2.4-855.g19e2a2be 2024-09-17T00:54:29.019 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/ 2024-09-17T00:54:29.020 INFO:teuthology.task.install.rpm:Package version is 18.2.4-855.g19e2a2be 2024-09-17T00:54:29.126 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T00:54:29.126 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:54:29.126 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T00:54:29.129 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T00:54:29.129 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:54:29.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T00:54:29.153 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T00:54:29.153 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:54:29.153 INFO:teuthology.packaging:ref: None 2024-09-17T00:54:29.153 INFO:teuthology.packaging:tag: None 2024-09-17T00:54:29.153 INFO:teuthology.packaging:branch: reef 2024-09-17T00:54:29.153 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:54:29.153 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T00:54:29.156 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T00:54:29.156 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:54:29.156 INFO:teuthology.packaging:ref: None 2024-09-17T00:54:29.156 INFO:teuthology.packaging:tag: None 2024-09-17T00:54:29.156 INFO:teuthology.packaging:branch: reef 2024-09-17T00:54:29.156 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:54:29.156 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T00:54:29.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T00:54:29.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T00:54:29.294 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T00:54:29.296 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T00:54:29.357 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-09-17T00:54:29.359 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-09-17T00:54:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-17T00:54:29.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-17T00:54:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-17T00:54:29.593 INFO:teuthology.orchestra.run.smithi143.stdout:45 files removed 2024-09-17T00:54:29.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw 2024-09-17T00:54:29.624 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw 2024-09-17T00:54:30.209 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 258 kB/s | 77 kB 00:00 2024-09-17T00:54:30.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 241 kB/s | 77 kB 00:00 2024-09-17T00:54:30.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-17T00:54:30.517 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-09-17T00:54:30.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-17T00:54:30.818 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 7.1 kB/s | 1.9 kB 00:00 2024-09-17T00:54:31.518 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-17T00:54:33.486 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-17T00:54:33.505 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-17T00:54:37.684 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-17T00:54:37.981 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-17T00:54:39.888 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-17T00:54:40.953 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-17T00:54:42.252 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-17T00:54:43.884 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-17T00:54:45.075 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-17T00:54:46.374 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-17T00:54:48.582 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:54:48.595 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 7.7 M 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.3 M 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 5.1 M 2024-09-17T00:54:48.596 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 18 M 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 25 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 712 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 477 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T00:54:48.597 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.5 M 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 45 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 129 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 162 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 321 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 300 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 99 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T00:54:48.598 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout:Install 28 Packages 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 2 Packages 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 53 M 2024-09-17T00:54:48.599 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:54:50.517 INFO:teuthology.orchestra.run.smithi143.stdout:(1/30): ceph-common-18.2.4-855.g19e2a2be.el9.x8 11 MB/s | 18 MB 00:01 2024-09-17T00:54:50.587 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-17T00:54:50.608 INFO:teuthology.orchestra.run.smithi143.stdout:(2/30): ceph-base-18.2.4-855.g19e2a2be.el9.x86_ 3.0 MB/s | 5.1 MB 00:01 2024-09-17T00:54:50.625 INFO:teuthology.orchestra.run.smithi143.stdout:(3/30): ceph-selinux-18.2.4-855.g19e2a2be.el9.x 233 kB/s | 25 kB 00:00 2024-09-17T00:54:50.737 INFO:teuthology.orchestra.run.smithi143.stdout:(4/30): libcephfs2-18.2.4-855.g19e2a2be.el9.x86 5.6 MB/s | 712 kB 00:00 2024-09-17T00:54:50.767 INFO:teuthology.orchestra.run.smithi143.stdout:(5/30): libradosstriper1-18.2.4-855.g19e2a2be.e 3.3 MB/s | 477 kB 00:00 2024-09-17T00:54:50.876 INFO:teuthology.orchestra.run.smithi143.stdout:(6/30): python3-ceph-argparse-18.2.4-855.g19e2a 415 kB/s | 45 kB 00:00 2024-09-17T00:54:50.985 INFO:teuthology.orchestra.run.smithi143.stdout:(7/30): ceph-radosgw-18.2.4-855.g19e2a2be.el9.x 3.7 MB/s | 7.7 MB 00:02 2024-09-17T00:54:51.010 INFO:teuthology.orchestra.run.smithi143.stdout:(8/30): python3-ceph-common-18.2.4-855.g19e2a2b 968 kB/s | 129 kB 00:00 2024-09-17T00:54:51.069 INFO:teuthology.orchestra.run.smithi143.stdout:(9/30): librgw2-18.2.4-855.g19e2a2be.el9.x86_64 13 MB/s | 4.5 MB 00:00 2024-09-17T00:54:51.094 INFO:teuthology.orchestra.run.smithi143.stdout:(10/30): python3-cephfs-18.2.4-855.g19e2a2be.el 1.5 MB/s | 162 kB 00:00 2024-09-17T00:54:51.128 INFO:teuthology.orchestra.run.smithi143.stdout:(11/30): python3-rados-18.2.4-855.g19e2a2be.el9 2.7 MB/s | 321 kB 00:00 2024-09-17T00:54:51.153 INFO:teuthology.orchestra.run.smithi143.stdout:(12/30): python3-rgw-18.2.4-855.g19e2a2be.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-17T00:54:51.178 INFO:teuthology.orchestra.run.smithi143.stdout:(13/30): python3-rbd-18.2.4-855.g19e2a2be.el9.x 2.7 MB/s | 300 kB 00:00 2024-09-17T00:54:51.279 INFO:teuthology.orchestra.run.smithi143.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 711 kB/s | 107 kB 00:00 2024-09-17T00:54:51.304 INFO:teuthology.orchestra.run.smithi143.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-17T00:54:51.329 INFO:teuthology.orchestra.run.smithi143.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 911 kB/s | 160 kB 00:00 2024-09-17T00:54:51.379 INFO:teuthology.orchestra.run.smithi143.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-17T00:54:51.421 INFO:teuthology.orchestra.run.smithi143.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-17T00:54:51.447 INFO:teuthology.orchestra.run.smithi143.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-17T00:54:51.489 INFO:teuthology.orchestra.run.smithi143.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-17T00:54:51.514 INFO:teuthology.orchestra.run.smithi143.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-17T00:54:51.539 INFO:teuthology.orchestra.run.smithi143.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T00:54:51.564 INFO:teuthology.orchestra.run.smithi143.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-17T00:54:51.590 INFO:teuthology.orchestra.run.smithi143.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T00:54:51.623 INFO:teuthology.orchestra.run.smithi143.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-17T00:54:51.665 INFO:teuthology.orchestra.run.smithi143.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-17T00:54:51.724 INFO:teuthology.orchestra.run.smithi143.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T00:54:51.816 INFO:teuthology.orchestra.run.smithi143.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-17T00:54:51.883 INFO:teuthology.orchestra.run.smithi143.stdout:(29/30): librados2-18.2.4-855.g19e2a2be.el9.x86 15 MB/s | 3.3 MB 00:00 2024-09-17T00:54:51.999 INFO:teuthology.orchestra.run.smithi143.stdout:(30/30): librbd1-18.2.4-855.g19e2a2be.el9.x86_6 11 MB/s | 3.0 MB 00:00 2024-09-17T00:54:52.005 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:54:52.005 INFO:teuthology.orchestra.run.smithi143.stdout:Total 16 MB/s | 53 MB 00:03 2024-09-17T00:54:52.078 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:54:52.113 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:54:52.114 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:54:52.742 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:54:52.742 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:54:52.821 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 7.7 M 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.3 M 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-17T00:54:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 5.1 M 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 18 M 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 25 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 712 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T00:54:52.835 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 477 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.5 M 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 45 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 129 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 162 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 321 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 300 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 99 k 2024-09-17T00:54:52.836 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout:Install 28 Packages 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:54:52.837 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 53 M 2024-09-17T00:54:52.838 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:54:53.472 INFO:teuthology.orchestra.run.smithi103.stdout:(1/30): ceph-base-18.2.4-855.g19e2a2be.el9.x86_ 9.2 MB/s | 5.1 MB 00:00 2024-09-17T00:54:53.514 INFO:teuthology.orchestra.run.smithi103.stdout:(2/30): ceph-selinux-18.2.4-855.g19e2a2be.el9.x 605 kB/s | 25 kB 00:00 2024-09-17T00:54:53.622 INFO:teuthology.orchestra.run.smithi103.stdout:(3/30): ceph-radosgw-18.2.4-855.g19e2a2be.el9.x 11 MB/s | 7.7 MB 00:00 2024-09-17T00:54:53.656 INFO:teuthology.orchestra.run.smithi103.stdout:(4/30): libcephfs2-18.2.4-855.g19e2a2be.el9.x86 4.9 MB/s | 712 kB 00:00 2024-09-17T00:54:53.690 INFO:teuthology.orchestra.run.smithi103.stdout:(5/30): libradosstriper1-18.2.4-855.g19e2a2be.e 7.0 MB/s | 477 kB 00:00 2024-09-17T00:54:53.740 INFO:teuthology.orchestra.run.smithi103.stdout:(6/30): python3-ceph-argparse-18.2.4-855.g19e2a 905 kB/s | 45 kB 00:00 2024-09-17T00:54:53.807 INFO:teuthology.orchestra.run.smithi103.stdout:(7/30): python3-ceph-common-18.2.4-855.g19e2a2b 1.9 MB/s | 129 kB 00:00 2024-09-17T00:54:53.874 INFO:teuthology.orchestra.run.smithi103.stdout:(8/30): librgw2-18.2.4-855.g19e2a2be.el9.x86_64 21 MB/s | 4.5 MB 00:00 2024-09-17T00:54:53.899 INFO:teuthology.orchestra.run.smithi103.stdout:(9/30): python3-cephfs-18.2.4-855.g19e2a2be.el9 1.7 MB/s | 162 kB 00:00 2024-09-17T00:54:53.933 INFO:teuthology.orchestra.run.smithi103.stdout:(10/30): python3-rados-18.2.4-855.g19e2a2be.el9 5.3 MB/s | 321 kB 00:00 2024-09-17T00:54:53.967 INFO:teuthology.orchestra.run.smithi103.stdout:(11/30): python3-rbd-18.2.4-855.g19e2a2be.el9.x 4.4 MB/s | 300 kB 00:00 2024-09-17T00:54:53.992 INFO:teuthology.orchestra.run.smithi103.stdout:(12/30): python3-rgw-18.2.4-855.g19e2a2be.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-17T00:54:54.168 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:54:54.175 INFO:teuthology.orchestra.run.smithi103.stdout:(13/30): ceph-common-18.2.4-855.g19e2a2be.el9.x 15 MB/s | 18 MB 00:01 2024-09-17T00:54:54.259 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-17T00:54:54.288 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-17T00:54:54.293 INFO:teuthology.orchestra.run.smithi103.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-09-17T00:54:54.318 INFO:teuthology.orchestra.run.smithi103.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2024-09-17T00:54:54.343 INFO:teuthology.orchestra.run.smithi103.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 456 kB/s | 160 kB 00:00 2024-09-17T00:54:54.355 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-17T00:54:54.427 INFO:teuthology.orchestra.run.smithi103.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 506 kB/s | 42 kB 00:00 2024-09-17T00:54:54.452 INFO:teuthology.orchestra.run.smithi103.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-17T00:54:54.494 INFO:teuthology.orchestra.run.smithi103.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-17T00:54:54.536 INFO:teuthology.orchestra.run.smithi103.stdout:(20/30): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-17T00:54:54.603 INFO:teuthology.orchestra.run.smithi103.stdout:(21/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2024-09-17T00:54:54.637 INFO:teuthology.orchestra.run.smithi103.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-17T00:54:54.662 INFO:teuthology.orchestra.run.smithi103.stdout:(23/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-17T00:54:54.687 INFO:teuthology.orchestra.run.smithi103.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T00:54:54.721 INFO:teuthology.orchestra.run.smithi103.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T00:54:54.727 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-17T00:54:54.771 INFO:teuthology.orchestra.run.smithi103.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-17T00:54:54.787 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-17T00:54:54.830 INFO:teuthology.orchestra.run.smithi103.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-17T00:54:54.887 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-17T00:54:54.914 INFO:teuthology.orchestra.run.smithi103.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-17T00:54:54.972 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-17T00:54:54.997 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-17T00:54:55.047 INFO:teuthology.orchestra.run.smithi103.stdout:(29/30): librados2-18.2.4-855.g19e2a2be.el9.x86 12 MB/s | 3.3 MB 00:00 2024-09-17T00:54:55.060 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-17T00:54:55.088 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-17T00:54:55.122 INFO:teuthology.orchestra.run.smithi103.stdout:(30/30): librbd1-18.2.4-855.g19e2a2be.el9.x86_6 10 MB/s | 3.0 MB 00:00 2024-09-17T00:54:55.128 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:54:55.128 INFO:teuthology.orchestra.run.smithi103.stdout:Total 23 MB/s | 53 MB 00:02 2024-09-17T00:54:55.131 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 9/32 2024-09-17T00:54:55.201 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:54:55.205 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-17T00:54:55.237 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:54:55.237 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:54:55.241 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-17T00:54:55.307 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-17T00:54:55.421 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-17T00:54:55.457 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-17T00:54:55.497 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-17T00:54:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-17T00:54:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-17T00:54:55.610 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-17T00:54:55.647 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-17T00:54:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:54:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:54:55.944 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-17T00:54:55.980 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-17T00:54:56.079 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-17T00:54:56.110 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 21/32 2024-09-17T00:54:56.154 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-17T00:54:56.562 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-17T00:54:56.591 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-17T00:54:56.729 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-17T00:54:56.806 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 25/32 2024-09-17T00:54:56.836 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 26/32 2024-09-17T00:54:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:54:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-17T00:54:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-17T00:54:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-17T00:54:57.840 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-17T00:54:57.897 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-17T00:54:57.985 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-17T00:54:58.079 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-17T00:54:58.112 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-17T00:54:58.192 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-17T00:54:58.229 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-17T00:54:58.272 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 9/32 2024-09-17T00:54:58.339 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-17T00:54:58.364 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-17T00:54:58.414 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-17T00:54:58.522 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-17T00:54:58.556 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-17T00:54:58.621 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-17T00:54:58.654 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-17T00:54:58.681 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-17T00:54:58.718 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-17T00:54:58.750 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-17T00:54:58.944 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-17T00:54:58.982 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-17T00:54:59.061 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-17T00:54:59.104 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-17T00:54:59.178 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-17T00:54:59.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 21/32 2024-09-17T00:54:59.246 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-17T00:54:59.515 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-17T00:54:59.561 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-17T00:54:59.651 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-17T00:54:59.654 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-17T00:54:59.654 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T00:54:59.654 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T00:54:59.654 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:54:59.682 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-17T00:54:59.687 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-17T00:54:59.745 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-17T00:54:59.814 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 25/32 2024-09-17T00:54:59.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 26/32 2024-09-17T00:55:01.984 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-17T00:55:02.015 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-17T00:55:02.548 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-17T00:55:02.586 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-17T00:55:02.681 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-17T00:55:02.681 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T00:55:02.681 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T00:55:02.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:02.721 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-17T00:55:09.701 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-17T00:55:09.701 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-09-17T00:55:09.701 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-09-17T00:55:09.701 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-09-17T00:55:09.701 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-09-17T00:55:09.701 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-09-17T00:55:09.702 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-09-17T00:55:09.702 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-09-17T00:55:09.702 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:10.484 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-17T00:55:10.509 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-17T00:55:10.509 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:10.509 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T00:55:10.509 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:55:10.509 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:55:10.509 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:10.511 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T00:55:10.612 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T00:55:10.612 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 1/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 3/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 4/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-17T00:55:11.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 8/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 9/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 12/32 2024-09-17T00:55:11.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 13/32 2024-09-17T00:55:11.677 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-17T00:55:11.677 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-17T00:55:11.677 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-17T00:55:11.677 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-17T00:55:11.677 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-17T00:55:11.677 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-17T00:55:11.678 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 31/32 2024-09-17T00:55:12.704 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T00:55:12.704 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:12.704 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-09-17T00:55:12.704 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.704 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.704 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T00:55:12.705 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:12.706 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T00:55:12.707 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T00:55:12.707 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:12.707 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-17T00:55:12.777 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:13.073 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-test 2024-09-17T00:55:13.561 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-17T00:55:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-17T00:55:13.587 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:13.587 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T00:55:13.587 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:55:13.587 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:55:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T00:55:13.660 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:13.672 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T00:55:13.672 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T00:55:13.793 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:13.793 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:13.793 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:55:13.793 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:13.793 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:55:13.793 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 40 M 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 166 k 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout:Install 4 Packages 2024-09-17T00:55:13.794 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:13.795 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 40 M 2024-09-17T00:55:13.795 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 164 M 2024-09-17T00:55:13.795 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:55:14.052 INFO:teuthology.orchestra.run.smithi143.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-17T00:55:14.094 INFO:teuthology.orchestra.run.smithi143.stdout:(2/4): libcephsqlite-18.2.4-855.g19e2a2be.el9.x 657 kB/s | 166 kB 00:00 2024-09-17T00:55:14.119 INFO:teuthology.orchestra.run.smithi143.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 1/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 3/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 4/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-17T00:55:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 8/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 9/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 12/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 13/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-17T00:55:14.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-17T00:55:14.830 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 31/32 2024-09-17T00:55:15.569 INFO:teuthology.orchestra.run.smithi143.stdout:(4/4): ceph-test-18.2.4-855.g19e2a2be.el9.x86_6 23 MB/s | 40 MB 00:01 2024-09-17T00:55:15.571 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:15.572 INFO:teuthology.orchestra.run.smithi143.stdout:Total 23 MB/s | 40 MB 00:01 2024-09-17T00:55:15.599 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:55:15.619 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:55:15.619 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:55:15.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T00:55:15.695 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T00:55:15.696 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:15.952 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:55:15.952 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:55:16.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-test 2024-09-17T00:55:16.426 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:55:16.503 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T00:55:16.544 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T00:55:16.579 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-17T00:55:16.646 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 40 M 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 166 k 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:55:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-17T00:55:16.786 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 40 M 2024-09-17T00:55:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 164 M 2024-09-17T00:55:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:55:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): libcephsqlite-18.2.4-855.g19e2a2be.el9.x 765 kB/s | 166 kB 00:00 2024-09-17T00:55:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-17T00:55:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 424 kB/s | 64 kB 00:00 2024-09-17T00:55:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): ceph-test-18.2.4-855.g19e2a2be.el9.x86_6 31 MB/s | 40 MB 00:01 2024-09-17T00:55:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:Total 28 MB/s | 40 MB 00:01 2024-09-17T00:55:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:55:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:55:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:55:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:55:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:55:19.080 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:55:19.166 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T00:55:19.206 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T00:55:19.233 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-17T00:55:20.260 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-17T00:55:20.335 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-17T00:55:22.250 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-17T00:55:22.251 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 1/4 2024-09-17T00:55:22.251 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2/4 2024-09-17T00:55:22.251 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:22.541 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:22.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph 2024-09-17T00:55:22.936 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-17T00:55:23.023 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-17T00:55:23.431 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:23.566 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:23.568 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:23.568 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:55:23.568 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:23.568 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:55:23.568 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 6.5 k 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 2.1 M 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 1.5 M 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 246 k 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.7 M 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 17 M 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T00:55:23.569 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T00:55:23.570 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T00:55:23.571 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T00:55:23.572 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T00:55:23.572 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T00:55:23.572 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T00:55:23.572 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T00:55:23.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:23.573 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:55:23.573 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:23.573 INFO:teuthology.orchestra.run.smithi143.stdout:Install 33 Packages 2024-09-17T00:55:23.573 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:23.573 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 29 M 2024-09-17T00:55:23.574 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 104 M 2024-09-17T00:55:23.574 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:55:24.063 INFO:teuthology.orchestra.run.smithi143.stdout:(1/33): ceph-18.2.4-855.g19e2a2be.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2024-09-17T00:55:24.263 INFO:teuthology.orchestra.run.smithi143.stdout:(2/33): ceph-mds-18.2.4-855.g19e2a2be.el9.x86_6 6.3 MB/s | 2.1 MB 00:00 2024-09-17T00:55:24.305 INFO:teuthology.orchestra.run.smithi143.stdout:(3/33): ceph-mgr-18.2.4-855.g19e2a2be.el9.x86_6 3.9 MB/s | 1.5 MB 00:00 2024-09-17T00:55:24.397 INFO:teuthology.orchestra.run.smithi143.stdout:(4/33): ceph-mgr-modules-core-18.2.4-855.g19e2a 2.6 MB/s | 246 kB 00:00 2024-09-17T00:55:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-17T00:55:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 1/4 2024-09-17T00:55:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2/4 2024-09-17T00:55:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T00:55:24.989 INFO:teuthology.orchestra.run.smithi143.stdout:(5/33): ceph-osd-18.2.4-855.g19e2a2be.el9.x86_6 23 MB/s | 17 MB 00:00 2024-09-17T00:55:25.064 INFO:teuthology.orchestra.run.smithi143.stdout:(6/33): ceph-mon-18.2.4-855.g19e2a2be.el9.x86_6 4.7 MB/s | 4.7 MB 00:01 2024-09-17T00:55:25.089 INFO:teuthology.orchestra.run.smithi143.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 366 kB/s | 253 kB 00:00 2024-09-17T00:55:25.181 INFO:teuthology.orchestra.run.smithi143.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-17T00:55:25.307 INFO:teuthology.orchestra.run.smithi143.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.0 MB/s | 125 kB 00:00 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:25.313 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:25.415 INFO:teuthology.orchestra.run.smithi143.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-09-17T00:55:25.557 INFO:teuthology.orchestra.run.smithi143.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 289 kB/s | 135 kB 00:00 2024-09-17T00:55:25.583 INFO:teuthology.orchestra.run.smithi143.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-17T00:55:25.633 INFO:teuthology.orchestra.run.smithi143.stdout:(13/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T00:55:25.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph 2024-09-17T00:55:25.658 INFO:teuthology.orchestra.run.smithi143.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 345 kB/s | 35 kB 00:00 2024-09-17T00:55:25.684 INFO:teuthology.orchestra.run.smithi143.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 825 kB/s | 42 kB 00:00 2024-09-17T00:55:25.734 INFO:teuthology.orchestra.run.smithi143.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 577 kB/s | 43 kB 00:00 2024-09-17T00:55:25.768 INFO:teuthology.orchestra.run.smithi143.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-17T00:55:25.793 INFO:teuthology.orchestra.run.smithi143.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-17T00:55:25.810 INFO:teuthology.orchestra.run.smithi143.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 254 kB/s | 11 kB 00:00 2024-09-17T00:55:25.827 INFO:teuthology.orchestra.run.smithi143.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 531 kB/s | 18 kB 00:00 2024-09-17T00:55:25.844 INFO:teuthology.orchestra.run.smithi143.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 694 kB/s | 23 kB 00:00 2024-09-17T00:55:25.861 INFO:teuthology.orchestra.run.smithi143.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 577 kB/s | 19 kB 00:00 2024-09-17T00:55:25.878 INFO:teuthology.orchestra.run.smithi143.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 587 kB/s | 20 kB 00:00 2024-09-17T00:55:25.894 INFO:teuthology.orchestra.run.smithi143.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-17T00:55:25.920 INFO:teuthology.orchestra.run.smithi143.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-17T00:55:25.954 INFO:teuthology.orchestra.run.smithi143.stdout:(26/33): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-17T00:55:25.979 INFO:teuthology.orchestra.run.smithi143.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-09-17T00:55:26.012 INFO:teuthology.orchestra.run.smithi143.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.3 MB/s | 36 kB 00:00 2024-09-17T00:55:26.038 INFO:teuthology.orchestra.run.smithi143.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-17T00:55:26.063 INFO:teuthology.orchestra.run.smithi143.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 825 kB/s | 90 kB 00:00 2024-09-17T00:55:26.088 INFO:teuthology.orchestra.run.smithi143.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.1 MB/s | 230 kB 00:00 2024-09-17T00:55:26.114 INFO:teuthology.orchestra.run.smithi143.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-17T00:55:26.139 INFO:teuthology.orchestra.run.smithi143.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T00:55:26.143 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:26.143 INFO:teuthology.orchestra.run.smithi143.stdout:Total 11 MB/s | 29 MB 00:02 2024-09-17T00:55:26.217 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:26.263 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:55:26.301 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:55:26.301 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:55:26.382 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:26.382 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 6.5 k 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 2.1 M 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 1.5 M 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 246 k 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.7 M 2024-09-17T00:55:26.383 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 17 M 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T00:55:26.384 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T00:55:26.385 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout:Install 33 Packages 2024-09-17T00:55:26.386 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:26.387 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 29 M 2024-09-17T00:55:26.387 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 104 M 2024-09-17T00:55:26.387 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:55:26.711 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:55:26.711 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:55:26.860 INFO:teuthology.orchestra.run.smithi103.stdout:(1/33): ceph-18.2.4-855.g19e2a2be.el9.x86_64.rp 54 kB/s | 6.5 kB 00:00 2024-09-17T00:55:27.060 INFO:teuthology.orchestra.run.smithi103.stdout:(2/33): ceph-mgr-18.2.4-855.g19e2a2be.el9.x86_6 4.5 MB/s | 1.5 MB 00:00 2024-09-17T00:55:27.102 INFO:teuthology.orchestra.run.smithi103.stdout:(3/33): ceph-mds-18.2.4-855.g19e2a2be.el9.x86_6 5.8 MB/s | 2.1 MB 00:00 2024-09-17T00:55:27.169 INFO:teuthology.orchestra.run.smithi103.stdout:(4/33): ceph-mgr-modules-core-18.2.4-855.g19e2a 3.6 MB/s | 246 kB 00:00 2024-09-17T00:55:27.345 INFO:teuthology.orchestra.run.smithi103.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-17T00:55:27.419 INFO:teuthology.orchestra.run.smithi103.stdout:(6/33): ceph-mon-18.2.4-855.g19e2a2be.el9.x86_6 8.4 MB/s | 4.7 MB 00:00 2024-09-17T00:55:27.495 INFO:teuthology.orchestra.run.smithi103.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 8.2 MB/s | 1.2 MB 00:00 2024-09-17T00:55:27.670 INFO:teuthology.orchestra.run.smithi103.stdout:(8/33): ceph-osd-18.2.4-855.g19e2a2be.el9.x86_6 27 MB/s | 17 MB 00:00 2024-09-17T00:55:27.695 INFO:teuthology.orchestra.run.smithi103.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 386 kB/s | 106 kB 00:00 2024-09-17T00:55:27.721 INFO:teuthology.orchestra.run.smithi103.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 599 kB/s | 135 kB 00:00 2024-09-17T00:55:27.821 INFO:teuthology.orchestra.run.smithi103.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 831 kB/s | 125 kB 00:00 2024-09-17T00:55:27.846 INFO:teuthology.orchestra.run.smithi103.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.4 MB/s | 215 kB 00:00 2024-09-17T00:55:27.952 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:55:28.021 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-17T00:55:28.052 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-17T00:55:28.085 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-17T00:55:28.163 INFO:teuthology.orchestra.run.smithi103.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 102 kB/s | 35 kB 00:00 2024-09-17T00:55:28.178 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-17T00:55:28.256 INFO:teuthology.orchestra.run.smithi103.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 125 kB/s | 51 kB 00:00 2024-09-17T00:55:28.256 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-17T00:55:28.289 INFO:teuthology.orchestra.run.smithi103.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-09-17T00:55:28.297 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-17T00:55:28.322 INFO:teuthology.orchestra.run.smithi103.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-09-17T00:55:28.332 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-17T00:55:28.356 INFO:teuthology.orchestra.run.smithi103.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2024-09-17T00:55:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-17T00:55:28.373 INFO:teuthology.orchestra.run.smithi103.stdout:(18/33): python3-toml-0.10.2-6.el9.noarch.rpm 199 kB/s | 42 kB 00:00 2024-09-17T00:55:28.397 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-17T00:55:28.398 INFO:teuthology.orchestra.run.smithi103.stdout:(19/33): python3-mako-1.1.4-6.el9.noarch.rpm 254 kB/s | 172 kB 00:00 2024-09-17T00:55:28.430 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-17T00:55:28.432 INFO:teuthology.orchestra.run.smithi103.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2024-09-17T00:55:28.457 INFO:teuthology.orchestra.run.smithi103.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 453 kB/s | 23 kB 00:00 2024-09-17T00:55:28.471 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-17T00:55:28.491 INFO:teuthology.orchestra.run.smithi103.stdout:(22/33): python3-jaraco-classes-3.2.1-5.el9.noa 150 kB/s | 18 kB 00:00 2024-09-17T00:55:28.514 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-17T00:55:28.520 INFO:teuthology.orchestra.run.smithi103.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 357 kB/s | 20 kB 00:00 2024-09-17T00:55:28.545 INFO:teuthology.orchestra.run.smithi103.stdout:(24/33): python3-jaraco-functools-3.5.0-2.el9.n 175 kB/s | 19 kB 00:00 2024-09-17T00:55:28.549 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-17T00:55:28.571 INFO:teuthology.orchestra.run.smithi103.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 598 kB/s | 46 kB 00:00 2024-09-17T00:55:28.586 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-17T00:55:28.596 INFO:teuthology.orchestra.run.smithi103.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-17T00:55:28.621 INFO:teuthology.orchestra.run.smithi103.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-17T00:55:28.646 INFO:teuthology.orchestra.run.smithi103.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-17T00:55:28.672 INFO:teuthology.orchestra.run.smithi103.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-17T00:55:28.673 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-17T00:55:28.697 INFO:teuthology.orchestra.run.smithi103.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-17T00:55:28.722 INFO:teuthology.orchestra.run.smithi103.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-17T00:55:28.748 INFO:teuthology.orchestra.run.smithi103.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-17T00:55:28.773 INFO:teuthology.orchestra.run.smithi103.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T00:55:28.777 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:28.777 INFO:teuthology.orchestra.run.smithi103.stdout:Total 12 MB/s | 29 MB 00:02 2024-09-17T00:55:28.845 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-17T00:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:55:28.921 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-17T00:55:28.939 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:55:28.939 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:55:28.982 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-17T00:55:29.020 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-17T00:55:29.078 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-17T00:55:29.133 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-17T00:55:29.322 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-17T00:55:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:55:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:55:29.374 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-17T00:55:29.453 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-17T00:55:29.537 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-17T00:55:29.577 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-17T00:55:29.692 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-17T00:55:29.845 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 28/33 2024-09-17T00:55:29.871 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-17T00:55:29.898 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-17T00:55:29.899 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:29.899 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T00:55:29.899 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:55:29.899 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:55:29.899 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:55:30.651 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-17T00:55:30.683 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-17T00:55:30.717 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-17T00:55:30.809 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-17T00:55:30.887 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-17T00:55:30.927 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-17T00:55:30.963 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-17T00:55:30.993 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-17T00:55:31.027 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-17T00:55:31.060 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-17T00:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-17T00:55:31.144 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-17T00:55:31.179 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-17T00:55:31.217 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-17T00:55:31.290 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-17T00:55:31.314 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-17T00:55:31.341 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-17T00:55:31.341 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:31.341 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T00:55:31.341 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:55:31.341 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:55:31.342 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:31.437 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-17T00:55:31.517 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-17T00:55:31.570 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-17T00:55:31.608 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-17T00:55:31.658 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-17T00:55:31.713 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-17T00:55:31.798 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-17T00:55:31.822 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-17T00:55:31.822 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:31.822 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T00:55:31.822 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:55:31.822 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:55:31.822 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:31.900 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-17T00:55:31.970 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-17T00:55:32.023 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-17T00:55:32.047 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-17T00:55:32.047 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:32.047 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T00:55:32.048 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:55:32.048 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:55:32.048 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:32.049 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-17T00:55:32.112 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-17T00:55:32.147 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-17T00:55:32.186 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-17T00:55:32.303 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-17T00:55:32.466 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 28/33 2024-09-17T00:55:32.488 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-17T00:55:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-17T00:55:32.514 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:32.514 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T00:55:32.514 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:55:32.514 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:55:32.514 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 1/33 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2/33 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 3/33 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 4/33 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 5/33 2024-09-17T00:55:33.907 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 6/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-17T00:55:33.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-17T00:55:33.909 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-17T00:55:33.909 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-17T00:55:33.909 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-17T00:55:33.909 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-17T00:55:33.909 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-17T00:55:33.909 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-17T00:55:33.910 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-17T00:55:33.998 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-17T00:55:34.027 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-17T00:55:34.027 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:34.028 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T00:55:34.028 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:55:34.028 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:55:34.028 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:34.474 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-17T00:55:34.498 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-17T00:55:34.498 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:34.498 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T00:55:34.498 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:55:34.498 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:55:34.498 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-17T00:55:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-17T00:55:34.732 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:34.732 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T00:55:34.732 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:55:34.732 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:55:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-17T00:55:34.828 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-17T00:55:34.828 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:34.828 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T00:55:34.829 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T00:55:34.830 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:34.831 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:35.232 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-base 2024-09-17T00:55:35.817 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:35.905 INFO:teuthology.orchestra.run.smithi143.stdout:Package ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:55:35.946 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:35.947 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:55:35.947 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:36.028 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install cephadm 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 1/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 3/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 4/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 5/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 6/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-17T00:55:36.551 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-17T00:55:36.552 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-17T00:55:36.553 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-17T00:55:36.553 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-17T00:55:36.553 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-17T00:55:36.553 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-17T00:55:36.553 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-17T00:55:36.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-17T00:55:36.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-17T00:55:36.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-17T00:55:36.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-17T00:55:36.554 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-17T00:55:36.602 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:36.733 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:36.733 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 226 k 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 226 k 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 217 k 2024-09-17T00:55:36.734 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:55:36.976 INFO:teuthology.orchestra.run.smithi143.stdout:cephadm-18.2.4-855.g19e2a2be.el9.noarch.rpm 936 kB/s | 226 kB 00:00 2024-09-17T00:55:36.977 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:36.977 INFO:teuthology.orchestra.run.smithi143.stdout:Total 930 kB/s | 226 kB 00:00 2024-09-17T00:55:36.977 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:55:36.982 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:55:36.982 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:55:36.985 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:55:36.985 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:55:37.053 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:55:37.473 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:37.545 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T00:55:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T00:55:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T00:55:37.647 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:37.648 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:37.890 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:38.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base 2024-09-17T00:55:38.151 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:38.151 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:38.151 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:55:38.151 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:38.151 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:38.151 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:38.399 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T00:55:38.613 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:38.702 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:55:38.743 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:38.744 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:55:38.744 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:38.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install cephadm 2024-09-17T00:55:38.995 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:39.132 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:39.132 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:39.132 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-17T00:55:39.132 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:39.132 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 143 k 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:39.133 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 143 k 2024-09-17T00:55:39.134 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 395 k 2024-09-17T00:55:39.134 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:55:39.366 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-immutable-object-cache-18.2.4-855.g19e2a2b 614 kB/s | 143 kB 00:00 2024-09-17T00:55:39.367 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:39.367 INFO:teuthology.orchestra.run.smithi143.stdout:Total 610 kB/s | 143 kB 00:00 2024-09-17T00:55:39.367 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:55:39.374 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:55:39.374 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:55:39.384 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:39.431 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:55:39.431 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:55:39.516 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 226 k 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 226 k 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 217 k 2024-09-17T00:55:39.517 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:55:39.583 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:55:39.642 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-17T00:55:39.667 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-17T00:55:39.667 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:39.667 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T00:55:39.667 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:39.758 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm-18.2.4-855.g19e2a2be.el9.noarch.rpm 939 kB/s | 226 kB 00:00 2024-09-17T00:55:39.759 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:39.759 INFO:teuthology.orchestra.run.smithi103.stdout:Total 934 kB/s | 226 kB 00:00 2024-09-17T00:55:39.759 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:55:39.764 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:55:39.764 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:55:39.767 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:55:39.767 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:55:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:55:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:40.370 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:40.575 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-17T00:55:40.575 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:40.575 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:55:40.576 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:40.576 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:40.576 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:40.718 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:40.795 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr 2024-09-17T00:55:40.975 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-17T00:55:40.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:40.976 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:55:40.976 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:40.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:40.976 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:41.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T00:55:41.390 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:41.481 INFO:teuthology.orchestra.run.smithi143.stdout:Package ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:55:41.524 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:41.524 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:55:41.525 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:41.607 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T00:55:41.770 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:41.903 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:41.904 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-17T00:55:41.904 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 143 k 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 143 k 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 395 k 2024-09-17T00:55:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:55:42.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-immutable-object-cache-18.2.4-855.g19e2a2b 707 kB/s | 143 kB 00:00 2024-09-17T00:55:42.108 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:42.108 INFO:teuthology.orchestra.run.smithi103.stdout:Total 701 kB/s | 143 kB 00:00 2024-09-17T00:55:42.108 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:55:42.116 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:55:42.116 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:55:42.174 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:55:42.175 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:55:42.193 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:42.325 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:55:42.327 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:42.327 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:55:42.327 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:42.328 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:55:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 3.5 M 2024-09-17T00:55:42.328 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:55:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 24 k 2024-09-17T00:55:42.328 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 16 k 2024-09-17T00:55:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T00:55:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T00:55:42.329 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:42.329 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:55:42.329 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:55:42.329 INFO:teuthology.orchestra.run.smithi143.stdout:Install 5 Packages 2024-09-17T00:55:42.330 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:42.330 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 3.8 M 2024-09-17T00:55:42.330 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 87 M 2024-09-17T00:55:42.330 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:55:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-17T00:55:42.417 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-17T00:55:42.417 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:55:42.417 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T00:55:42.417 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:42.646 INFO:teuthology.orchestra.run.smithi143.stdout:(1/5): ceph-grafana-dashboards-18.2.4-855.g19e2 153 kB/s | 24 kB 00:00 2024-09-17T00:55:42.688 INFO:teuthology.orchestra.run.smithi143.stdout:(2/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 741 kB/s | 31 kB 00:00 2024-09-17T00:55:42.722 INFO:teuthology.orchestra.run.smithi143.stdout:(3/5): ceph-prometheus-alerts-18.2.4-855.g19e2a 70 kB/s | 16 kB 00:00 2024-09-17T00:55:42.747 INFO:teuthology.orchestra.run.smithi143.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-17T00:55:42.897 INFO:teuthology.orchestra.run.smithi143.stdout:(5/5): ceph-mgr-dashboard-18.2.4-855.g19e2a2be. 8.6 MB/s | 3.5 MB 00:00 2024-09-17T00:55:42.901 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:42.901 INFO:teuthology.orchestra.run.smithi143.stdout:Total 6.6 MB/s | 3.8 MB 00:00 2024-09-17T00:55:42.901 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:55:42.908 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:55:42.908 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:55:42.999 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:55:42.999 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:55:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:55:43.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-17T00:55:43.320 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:43.320 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:55:43.320 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:55:43.320 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:43.320 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:43.337 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-17T00:55:43.377 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-17T00:55:43.406 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-17T00:55:43.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr 2024-09-17T00:55:44.113 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:44.205 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:55:44.248 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:44.249 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:55:44.249 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:44.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T00:55:44.465 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 4/5 2024-09-17T00:55:44.501 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-17T00:55:44.901 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:45.035 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 3.5 M 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 24 k 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 16 k 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T00:55:45.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout:Install 5 Packages 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 3.8 M 2024-09-17T00:55:45.037 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 87 M 2024-09-17T00:55:45.038 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:55:45.246 INFO:teuthology.orchestra.run.smithi103.stdout:(1/5): ceph-grafana-dashboards-18.2.4-855.g19e2 166 kB/s | 24 kB 00:00 2024-09-17T00:55:45.271 INFO:teuthology.orchestra.run.smithi103.stdout:(2/5): ceph-prometheus-alerts-18.2.4-855.g19e2a 96 kB/s | 16 kB 00:00 2024-09-17T00:55:45.313 INFO:teuthology.orchestra.run.smithi103.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 461 kB/s | 31 kB 00:00 2024-09-17T00:55:45.355 INFO:teuthology.orchestra.run.smithi103.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-17T00:55:45.522 INFO:teuthology.orchestra.run.smithi103.stdout:(5/5): ceph-mgr-dashboard-18.2.4-855.g19e2a2be. 8.3 MB/s | 3.5 MB 00:00 2024-09-17T00:55:45.525 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:45.526 INFO:teuthology.orchestra.run.smithi103.stdout:Total 7.8 MB/s | 3.8 MB 00:00 2024-09-17T00:55:45.526 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:55:45.533 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:55:45.533 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:55:45.618 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:55:45.618 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:55:45.645 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-17T00:55:45.646 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 1/5 2024-09-17T00:55:45.646 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2/5 2024-09-17T00:55:45.646 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-17T00:55:45.646 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-17T00:55:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:45.922 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T00:55:45.923 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T00:55:45.923 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:45.923 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:55:45.969 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-17T00:55:46.001 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-17T00:55:46.030 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-17T00:55:46.160 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T00:55:46.734 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:55:46.866 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout:====================================================================================== 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout:====================================================================================== 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 7.4 M 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T00:55:46.867 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout:====================================================================================== 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout:Install 12 Packages 2024-09-17T00:55:46.868 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:55:46.869 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 38 M 2024-09-17T00:55:46.869 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 212 M 2024-09-17T00:55:46.869 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:55:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 4/5 2024-09-17T00:55:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-17T00:55:47.313 INFO:teuthology.orchestra.run.smithi143.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-17T00:55:47.364 INFO:teuthology.orchestra.run.smithi143.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.6 MB/s | 801 kB 00:00 2024-09-17T00:55:47.597 INFO:teuthology.orchestra.run.smithi143.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 115 kB/s | 33 kB 00:00 2024-09-17T00:55:47.689 INFO:teuthology.orchestra.run.smithi143.stdout:(4/12): ceph-mgr-diskprediction-local-18.2.4-85 15 MB/s | 7.4 MB 00:00 2024-09-17T00:55:47.714 INFO:teuthology.orchestra.run.smithi143.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-17T00:55:47.973 INFO:teuthology.orchestra.run.smithi143.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 136 kB/s | 38 kB 00:00 2024-09-17T00:55:48.305 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-17T00:55:48.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 1/5 2024-09-17T00:55:48.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2/5 2024-09-17T00:55:48.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-17T00:55:48.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-17T00:55:48.348 INFO:teuthology.orchestra.run.smithi143.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-17T00:55:48.499 INFO:teuthology.orchestra.run.smithi143.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-09-17T00:55:48.576 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:48.577 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:55:48.624 INFO:teuthology.orchestra.run.smithi143.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-17T00:55:48.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T00:55:49.373 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:55:49.504 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:55:49.505 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 7.4 M 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T00:55:49.506 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout:Install 12 Packages 2024-09-17T00:55:49.507 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:55:49.508 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 38 M 2024-09-17T00:55:49.508 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 212 M 2024-09-17T00:55:49.508 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:55:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-09-17T00:55:49.797 INFO:teuthology.orchestra.run.smithi103.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-17T00:55:49.855 INFO:teuthology.orchestra.run.smithi103.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-17T00:55:50.091 INFO:teuthology.orchestra.run.smithi143.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.1 MB/s | 4.9 MB 00:02 2024-09-17T00:55:50.139 INFO:teuthology.orchestra.run.smithi103.stdout:(3/12): ceph-mgr-diskprediction-local-18.2.4-85 16 MB/s | 7.4 MB 00:00 2024-09-17T00:55:50.164 INFO:teuthology.orchestra.run.smithi103.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 89 kB/s | 33 kB 00:00 2024-09-17T00:55:50.364 INFO:teuthology.orchestra.run.smithi103.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 192 kB/s | 38 kB 00:00 2024-09-17T00:55:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 64 kB/s | 18 kB 00:00 2024-09-17T00:55:50.882 INFO:teuthology.orchestra.run.smithi103.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 534 kB/s | 245 kB 00:00 2024-09-17T00:55:50.966 INFO:teuthology.orchestra.run.smithi103.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-09-17T00:55:51.091 INFO:teuthology.orchestra.run.smithi103.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-17T00:55:51.416 INFO:teuthology.orchestra.run.smithi103.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.7 MB/s | 4.9 MB 00:01 2024-09-17T00:55:53.308 INFO:teuthology.orchestra.run.smithi103.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.1 MB/s | 5.1 MB 00:02 2024-09-17T00:55:55.216 INFO:teuthology.orchestra.run.smithi103.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-17T00:55:55.217 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:55.217 INFO:teuthology.orchestra.run.smithi103.stdout:Total 6.7 MB/s | 38 MB 00:05 2024-09-17T00:55:55.573 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:55:55.598 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:55:55.599 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:55:56.118 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:55:56.118 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:55:56.124 INFO:teuthology.orchestra.run.smithi143.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-17T00:55:56.125 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:55:56.125 INFO:teuthology.orchestra.run.smithi143.stdout:Total 4.1 MB/s | 38 MB 00:09 2024-09-17T00:55:56.478 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:55:56.504 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:55:56.504 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:55:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:55:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T00:55:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:55:57.028 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:55:57.029 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:55:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:55:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T00:55:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T00:55:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T00:55:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T00:55:57.807 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:55:57.896 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T00:55:57.952 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:55:58.046 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:55:58.094 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T00:55:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T00:55:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T00:55:58.284 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T00:55:58.322 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T00:55:58.408 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T00:55:59.064 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T00:55:59.177 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T00:55:59.473 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:56:00.434 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:56:00.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T00:56:00.541 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-17T00:56:01.475 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T00:56:01.514 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-17T00:56:03.180 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-17T00:56:03.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 1/12 2024-09-17T00:56:03.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:56:03.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T00:56:03.620 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T00:56:03.620 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:04.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-rook 2024-09-17T00:56:04.096 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-17T00:56:04.096 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 1/12 2024-09-17T00:56:04.096 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:56:04.096 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:56:04.096 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T00:56:04.096 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T00:56:04.097 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T00:56:04.097 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T00:56:04.097 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T00:56:04.097 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T00:56:04.097 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:56:04.097 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T00:56:04.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T00:56:04.504 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T00:56:04.505 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T00:56:04.506 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:04.506 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:04.619 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:14 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:04.759 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 49 k 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T00:56:04.761 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout:Install 13 Packages 2024-09-17T00:56:04.762 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:04.763 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 2.2 M 2024-09-17T00:56:04.763 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 26 M 2024-09-17T00:56:04.763 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:04.877 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-rook 2024-09-17T00:56:05.473 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:19 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:05.560 INFO:teuthology.orchestra.run.smithi103.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 184 kB/s | 19 kB 00:00 2024-09-17T00:56:05.577 INFO:teuthology.orchestra.run.smithi103.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 212 kB/s | 26 kB 00:00 2024-09-17T00:56:05.606 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:05.607 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:05.607 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:56:05.607 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:05.607 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 49 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T00:56:05.608 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout:Install 13 Packages 2024-09-17T00:56:05.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:05.610 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 2.2 M 2024-09-17T00:56:05.610 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 26 M 2024-09-17T00:56:05.610 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:05.652 INFO:teuthology.orchestra.run.smithi103.stdout:(3/13): ceph-mgr-rook-18.2.4-855.g19e2a2be.el9. 251 kB/s | 49 kB 00:00 2024-09-17T00:56:05.695 INFO:teuthology.orchestra.run.smithi103.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-17T00:56:05.720 INFO:teuthology.orchestra.run.smithi103.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-17T00:56:05.745 INFO:teuthology.orchestra.run.smithi103.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T00:56:05.787 INFO:teuthology.orchestra.run.smithi103.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-17T00:56:05.812 INFO:teuthology.orchestra.run.smithi103.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 210 kB/s | 14 kB 00:00 2024-09-17T00:56:05.837 INFO:teuthology.orchestra.run.smithi103.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-17T00:56:05.863 INFO:teuthology.orchestra.run.smithi103.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-17T00:56:05.897 INFO:teuthology.orchestra.run.smithi103.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.3 MB/s | 90 kB 00:00 2024-09-17T00:56:05.922 INFO:teuthology.orchestra.run.smithi103.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 702 kB/s | 59 kB 00:00 2024-09-17T00:56:05.964 INFO:teuthology.orchestra.run.smithi103.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-17T00:56:05.967 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:05.967 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-09-17T00:56:06.030 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:06.041 INFO:teuthology.orchestra.run.smithi143.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 199 kB/s | 19 kB 00:00 2024-09-17T00:56:06.046 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:06.046 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:06.066 INFO:teuthology.orchestra.run.smithi143.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 211 kB/s | 26 kB 00:00 2024-09-17T00:56:06.125 INFO:teuthology.orchestra.run.smithi143.stdout:(3/13): ceph-mgr-rook-18.2.4-855.g19e2a2be.el9. 273 kB/s | 49 kB 00:00 2024-09-17T00:56:06.137 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:06.138 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:06.158 INFO:teuthology.orchestra.run.smithi143.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-17T00:56:06.193 INFO:teuthology.orchestra.run.smithi143.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-17T00:56:06.218 INFO:teuthology.orchestra.run.smithi143.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 909 kB/s | 54 kB 00:00 2024-09-17T00:56:06.243 INFO:teuthology.orchestra.run.smithi143.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 637 kB/s | 32 kB 00:00 2024-09-17T00:56:06.289 INFO:teuthology.orchestra.run.smithi143.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 203 kB/s | 14 kB 00:00 2024-09-17T00:56:06.310 INFO:teuthology.orchestra.run.smithi143.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-17T00:56:06.344 INFO:teuthology.orchestra.run.smithi143.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.2 MB/s | 220 kB 00:00 2024-09-17T00:56:06.378 INFO:teuthology.orchestra.run.smithi143.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2024-09-17T00:56:06.403 INFO:teuthology.orchestra.run.smithi143.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2024-09-17T00:56:06.437 INFO:teuthology.orchestra.run.smithi143.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.9 MB/s | 1.0 MB 00:00 2024-09-17T00:56:06.440 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:06.440 INFO:teuthology.orchestra.run.smithi143.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-17T00:56:06.503 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:06.518 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:06.518 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:06.605 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:06.607 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:06.644 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:06.824 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T00:56:06.890 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T00:56:06.946 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T00:56:06.991 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T00:56:07.033 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T00:56:07.104 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:07.135 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T00:56:07.264 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T00:56:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T00:56:07.318 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T00:56:07.330 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T00:56:07.394 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T00:56:07.439 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T00:56:07.480 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T00:56:07.582 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T00:56:07.683 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T00:56:07.732 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T00:56:08.030 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T00:56:08.091 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T00:56:08.125 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T00:56:08.174 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T00:56:08.203 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-17T00:56:08.444 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T00:56:08.505 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T00:56:08.538 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T00:56:08.587 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T00:56:08.642 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-17T00:56:08.968 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-17T00:56:08.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 1/13 2024-09-17T00:56:08.968 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T00:56:08.969 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T00:56:09.331 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:09.332 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:09.474 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-17T00:56:09.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 1/13 2024-09-17T00:56:09.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T00:56:09.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T00:56:09.474 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T00:56:09.475 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T00:56:09.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T00:56:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T00:56:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:09.803 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:56:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T00:56:09.803 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:09.804 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:10.068 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T00:56:10.175 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:20 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:10.307 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:10.307 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:10.307 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:56:10.307 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:10.307 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 139 k 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout:Install 6 Packages 2024-09-17T00:56:10.308 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:10.309 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 7.0 M 2024-09-17T00:56:10.309 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 33 M 2024-09-17T00:56:10.309 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:10.650 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:10.718 INFO:teuthology.orchestra.run.smithi103.stdout:(1/6): ceph-mgr-cephadm-18.2.4-855.g19e2a2be.el 671 kB/s | 139 kB 00:00 2024-09-17T00:56:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-17T00:56:10.782 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 139 k 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T00:56:10.783 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout:Install 6 Packages 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 7.0 M 2024-09-17T00:56:10.784 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 33 M 2024-09-17T00:56:10.785 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:10.794 INFO:teuthology.orchestra.run.smithi103.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-17T00:56:10.828 INFO:teuthology.orchestra.run.smithi103.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-17T00:56:11.403 INFO:teuthology.orchestra.run.smithi103.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 278 kB/s | 248 kB 00:00 2024-09-17T00:56:11.565 INFO:teuthology.orchestra.run.smithi143.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-17T00:56:11.590 INFO:teuthology.orchestra.run.smithi143.stdout:(2/6): ceph-mgr-cephadm-18.2.4-855.g19e2a2be.el 576 kB/s | 139 kB 00:00 2024-09-17T00:56:11.632 INFO:teuthology.orchestra.run.smithi143.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2024-09-17T00:56:11.657 INFO:teuthology.orchestra.run.smithi143.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-17T00:56:11.691 INFO:teuthology.orchestra.run.smithi143.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-17T00:56:11.841 INFO:teuthology.orchestra.run.smithi143.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-17T00:56:11.844 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:11.844 INFO:teuthology.orchestra.run.smithi143.stdout:Total 6.6 MB/s | 7.0 MB 00:01 2024-09-17T00:56:11.914 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:11.925 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:11.925 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:12.024 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:12.025 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:12.331 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:12.489 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T00:56:12.543 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T00:56:12.803 INFO:teuthology.orchestra.run.smithi103.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-09-17T00:56:12.805 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:12.806 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.8 MB/s | 7.0 MB 00:02 2024-09-17T00:56:12.879 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:12.891 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:12.891 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:12.992 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:12.993 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:13.067 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T00:56:13.154 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T00:56:13.217 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T00:56:13.247 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-17T00:56:13.297 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:13.467 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T00:56:13.521 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T00:56:14.041 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T00:56:14.047 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-17T00:56:14.047 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/6 2024-09-17T00:56:14.047 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T00:56:14.047 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T00:56:14.047 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T00:56:14.047 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T00:56:14.124 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T00:56:14.186 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T00:56:14.218 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-17T00:56:14.310 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:14.311 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:14.574 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-fuse 2024-09-17T00:56:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-17T00:56:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/6 2024-09-17T00:56:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T00:56:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T00:56:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T00:56:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T00:56:15.163 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:15.279 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T00:56:15.279 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:15.279 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:15.280 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:15.297 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 852 k 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:15.298 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:15.299 INFO:teuthology.orchestra.run.smithi143.stdout:Install 2 Packages 2024-09-17T00:56:15.299 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:15.299 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 932 k 2024-09-17T00:56:15.299 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 2.7 M 2024-09-17T00:56:15.299 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:15.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-fuse 2024-09-17T00:56:15.619 INFO:teuthology.orchestra.run.smithi143.stdout:(1/2): ceph-fuse-18.2.4-855.g19e2a2be.el9.x86_6 2.9 MB/s | 852 kB 00:00 2024-09-17T00:56:15.802 INFO:teuthology.orchestra.run.smithi143.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 168 kB/s | 80 kB 00:00 2024-09-17T00:56:15.803 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:15.803 INFO:teuthology.orchestra.run.smithi143.stdout:Total 1.8 MB/s | 932 kB 00:00 2024-09-17T00:56:15.815 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:15.837 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:15.837 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:15.917 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:15.917 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:16.111 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:26 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:16.242 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T00:56:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-17T00:56:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 852 k 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-09-17T00:56:16.256 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 932 k 2024-09-17T00:56:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 2.7 M 2024-09-17T00:56:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:16.309 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-17T00:56:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): ceph-fuse-18.2.4-855.g19e2a2be.el9.x86_6 2.9 MB/s | 852 kB 00:00 2024-09-17T00:56:16.949 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-17T00:56:16.949 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/2 2024-09-17T00:56:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 177 kB/s | 80 kB 00:00 2024-09-17T00:56:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.3 MB/s | 932 kB 00:00 2024-09-17T00:56:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:17.078 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:17.217 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T00:56:17.217 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:17.217 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:17.217 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T00:56:17.217 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:17.218 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:17.269 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:17.396 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T00:56:17.462 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-17T00:56:17.556 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install librados-devel 2024-09-17T00:56:18.122 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-17T00:56:18.123 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/2 2024-09-17T00:56:18.144 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:18.282 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:18.283 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:18.283 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-17T00:56:18.283 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 126 k 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 126 k 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 456 k 2024-09-17T00:56:18.284 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:18.406 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T00:56:18.406 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:18.406 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T00:56:18.406 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:18.508 INFO:teuthology.orchestra.run.smithi143.stdout:librados-devel-18.2.4-855.g19e2a2be.el9.x86_64. 567 kB/s | 126 kB 00:00 2024-09-17T00:56:18.509 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:18.509 INFO:teuthology.orchestra.run.smithi143.stdout:Total 562 kB/s | 126 kB 00:00 2024-09-17T00:56:18.509 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:18.514 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:18.514 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:18.577 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:18.578 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:18.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados-devel 2024-09-17T00:56:18.727 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:18.814 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:19.279 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 126 k 2024-09-17T00:56:19.406 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 126 k 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 456 k 2024-09-17T00:56:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:19.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:19.524 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:19.525 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:19.525 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:19.525 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:19.525 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:librados-devel-18.2.4-855.g19e2a2be.el9.x86_64. 619 kB/s | 126 kB 00:00 2024-09-17T00:56:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:Total 614 kB/s | 126 kB 00:00 2024-09-17T00:56:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:19.750 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install libcephfs2 2024-09-17T00:56:19.853 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:19.959 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:20.346 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:20.436 INFO:teuthology.orchestra.run.smithi143.stdout:Package libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:20.480 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:20.481 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:20.481 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:20.577 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install libcephfs-devel 2024-09-17T00:56:20.672 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:20.672 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:20.672 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:20.672 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:20.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs2 2024-09-17T00:56:21.155 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:21.286 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:21.286 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 31 k 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 31 k 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 139 k 2024-09-17T00:56:21.287 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:21.446 INFO:teuthology.orchestra.run.smithi143.stdout:libcephfs-devel-18.2.4-855.g19e2a2be.el9.x86_64 196 kB/s | 31 kB 00:00 2024-09-17T00:56:21.446 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:21.447 INFO:teuthology.orchestra.run.smithi143.stdout:Total 194 kB/s | 31 kB 00:00 2024-09-17T00:56:21.447 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:21.450 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:21.464 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:21.557 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:Package libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:21.659 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:21.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs-devel 2024-09-17T00:56:22.022 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:22.258 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:22.258 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:22.258 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:22.258 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:22.258 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:22.259 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 31 k 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 31 k 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 139 k 2024-09-17T00:56:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:22.460 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install librados2 2024-09-17T00:56:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:libcephfs-devel-18.2.4-855.g19e2a2be.el9.x86_64 217 kB/s | 31 kB 00:00 2024-09-17T00:56:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:Total 215 kB/s | 31 kB 00:00 2024-09-17T00:56:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:22.676 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:22.779 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:23.044 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:23.134 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:23.142 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:23.177 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:23.178 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:23.178 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:23.258 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install librbd1 2024-09-17T00:56:23.377 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:23.377 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:23.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados2 2024-09-17T00:56:23.845 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:23.937 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:23.979 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:23.980 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:23.981 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:24.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-rados 2024-09-17T00:56:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:24.252 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:24.294 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:24.295 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:24.295 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:24.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librbd1 2024-09-17T00:56:24.643 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:24.733 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:24.776 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:24.777 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:24.777 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:24.860 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-rgw 2024-09-17T00:56:24.956 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:25.044 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:25.087 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:25.088 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:25.088 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:25.158 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rados 2024-09-17T00:56:25.442 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:25.531 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:25.573 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:25.574 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:25.575 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:25.648 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-cephfs 2024-09-17T00:56:25.737 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:25.825 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:25.868 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:25.869 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:25.869 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:25.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rgw 2024-09-17T00:56:26.232 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:40 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:26.321 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:26.363 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:26.364 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:26.364 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:26.440 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-rbd 2024-09-17T00:56:26.518 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:26.607 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:26.649 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:26.650 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:26.650 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:26.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-cephfs 2024-09-17T00:56:27.025 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:27.114 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:27.158 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:27.159 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-17T00:56:27.159 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:27.243 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install rbd-fuse 2024-09-17T00:56:27.314 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:27.405 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:27.447 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:27.448 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:27.448 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:27.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rbd 2024-09-17T00:56:27.822 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:27.954 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 87 k 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:27.955 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:56:27.956 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:27.956 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 87 k 2024-09-17T00:56:27.956 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 227 k 2024-09-17T00:56:27.956 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:28.106 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:28.166 INFO:teuthology.orchestra.run.smithi143.stdout:rbd-fuse-18.2.4-855.g19e2a2be.el9.x86_64.rpm 412 kB/s | 87 kB 00:00 2024-09-17T00:56:28.166 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:28.166 INFO:teuthology.orchestra.run.smithi143.stdout:Total 409 kB/s | 87 kB 00:00 2024-09-17T00:56:28.166 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:28.173 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:28.173 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:28.194 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-17T00:56:28.235 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:28.236 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:28.237 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:28.238 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-17T00:56:28.238 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:28.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-fuse 2024-09-17T00:56:28.380 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:28.487 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:28.866 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:28.895 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:29.026 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 87 k 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:29.027 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:56:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:29.028 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 87 k 2024-09-17T00:56:29.028 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 227 k 2024-09-17T00:56:29.028 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:29.114 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:29.115 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:29.115 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:29.115 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:29.115 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:29.115 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:29.220 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-fuse-18.2.4-855.g19e2a2be.el9.x86_64.rpm 451 kB/s | 87 kB 00:00 2024-09-17T00:56:29.221 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:29.221 INFO:teuthology.orchestra.run.smithi103.stdout:Total 448 kB/s | 87 kB 00:00 2024-09-17T00:56:29.221 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:29.228 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:29.228 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:29.291 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:29.291 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:29.392 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install rbd-mirror 2024-09-17T00:56:29.464 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:29.559 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:29.941 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:29.987 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:30.126 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 3.0 M 2024-09-17T00:56:30.127 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 12 M 2024-09-17T00:56:30.128 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:30.195 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:30.196 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:30.196 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:30.196 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:30.196 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:30.196 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:30.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-mirror 2024-09-17T00:56:30.529 INFO:teuthology.orchestra.run.smithi143.stdout:rbd-mirror-18.2.4-855.g19e2a2be.el9.x86_64.rpm 7.4 MB/s | 3.0 MB 00:00 2024-09-17T00:56:30.530 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:30.530 INFO:teuthology.orchestra.run.smithi143.stdout:Total 7.4 MB/s | 3.0 MB 00:00 2024-09-17T00:56:30.530 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:30.539 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:30.539 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:30.618 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:30.619 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:31.034 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:31.049 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:31.104 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:31.128 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:31.128 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:56:31.129 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T00:56:31.129 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:56:31.129 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:56:31.129 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:31.180 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:31.181 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:31.182 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:31.182 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:56:31.182 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:31.182 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 3.0 M 2024-09-17T00:56:31.182 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 12 M 2024-09-17T00:56:31.182 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:31.499 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-mirror-18.2.4-855.g19e2a2be.el9.x86_64.rpm 9.4 MB/s | 3.0 MB 00:00 2024-09-17T00:56:31.500 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:31.500 INFO:teuthology.orchestra.run.smithi103.stdout:Total 9.4 MB/s | 3.0 MB 00:00 2024-09-17T00:56:31.501 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:31.509 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:31.510 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:31.591 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:31.591 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:32.012 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:32.100 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:56:32.100 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T00:56:32.100 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:56:32.100 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:56:32.100 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:32.207 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:32.207 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:32.207 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:32.207 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:32.208 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:32.208 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:32.508 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install rbd-nbd 2024-09-17T00:56:33.101 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 12:54:46 AM UTC. 2024-09-17T00:56:33.241 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-17T00:56:33.241 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:33.241 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-09-17T00:56:33.241 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 172 k 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 172 k 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 494 k 2024-09-17T00:56:33.242 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-17T00:56:33.260 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:33.260 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:33.261 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:33.261 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:33.261 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:33.261 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:33.461 INFO:teuthology.orchestra.run.smithi143.stdout:rbd-nbd-18.2.4-855.g19e2a2be.el9.x86_64.rpm 797 kB/s | 172 kB 00:00 2024-09-17T00:56:33.462 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:33.462 INFO:teuthology.orchestra.run.smithi143.stdout:Total 789 kB/s | 172 kB 00:00 2024-09-17T00:56:33.462 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-17T00:56:33.469 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-17T00:56:33.469 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-17T00:56:33.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-nbd 2024-09-17T00:56:33.534 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-17T00:56:33.535 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-17T00:56:33.692 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-17T00:56:33.800 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:34.114 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 12:54:50 AM UTC. 2024-09-17T00:56:34.253 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-17T00:56:34.253 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:34.253 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-17T00:56:34.253 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 172 k 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 172 k 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 494 k 2024-09-17T00:56:34.254 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-17T00:56:34.282 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:34.463 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-nbd-18.2.4-855.g19e2a2be.el9.x86_64.rpm 825 kB/s | 172 kB 00:00 2024-09-17T00:56:34.464 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:56:34.464 INFO:teuthology.orchestra.run.smithi103.stdout:Total 818 kB/s | 172 kB 00:00 2024-09-17T00:56:34.464 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-17T00:56:34.472 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-17T00:56:34.472 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-17T00:56:34.539 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-17T00:56:34.539 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-17T00:56:34.551 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:34.551 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:34.551 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-17T00:56:34.552 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:34.552 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:56:34.552 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-17T00:56:34.693 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-17T00:56:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:34.815 DEBUG:teuthology.parallel:result is None 2024-09-17T00:56:35.235 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:35.498 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-17T00:56:35.498 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:35.498 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-17T00:56:35.498 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-17T00:56:35.498 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:56:35.498 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-17T00:56:35.734 DEBUG:teuthology.parallel:result is None 2024-09-17T00:56:35.734 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:56:35.735 INFO:teuthology.packaging:ref: None 2024-09-17T00:56:35.735 INFO:teuthology.packaging:tag: None 2024-09-17T00:56:35.735 INFO:teuthology.packaging:branch: reef 2024-09-17T00:56:35.735 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:56:35.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-17T00:56:35.990 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T00:56:36.012 INFO:teuthology.orchestra.run.smithi103.stdout:18.2.4-855.g19e2a2be.el9 2024-09-17T00:56:36.013 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855.g19e2a2be.el9 2024-09-17T00:56:36.013 INFO:teuthology.task.install:The correct ceph version 18.2.4-855.g19e2a2be is installed. 2024-09-17T00:56:36.014 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:56:36.015 INFO:teuthology.packaging:ref: None 2024-09-17T00:56:36.015 INFO:teuthology.packaging:tag: None 2024-09-17T00:56:36.015 INFO:teuthology.packaging:branch: reef 2024-09-17T00:56:36.015 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:56:36.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-17T00:56:36.275 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T00:56:36.301 INFO:teuthology.orchestra.run.smithi143.stdout:18.2.4-855.g19e2a2be.el9 2024-09-17T00:56:36.301 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855.g19e2a2be.el9 2024-09-17T00:56:36.301 INFO:teuthology.task.install:The correct ceph version 18.2.4-855.g19e2a2be is installed. 2024-09-17T00:56:36.303 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T00:56:36.303 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:56:36.304 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T00:56:36.339 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:56:36.339 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T00:56:36.372 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T00:56:36.372 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:56:36.372 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T00:56:36.403 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T00:56:36.469 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:56:36.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T00:56:36.498 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T00:56:36.565 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T00:56:36.566 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:56:36.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T00:56:36.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T00:56:36.655 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:56:36.656 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T00:56:36.684 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T00:56:36.753 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T00:56:36.753 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:56:36.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T00:56:36.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T00:56:36.843 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:56:36.843 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T00:56:36.870 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T00:56:36.938 INFO:teuthology.run_tasks:Running task print... 2024-09-17T00:56:36.946 INFO:teuthology.task.print:**** done install task... 2024-09-17T00:56:36.946 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T00:56:37.098 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T00:56:37.098 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-17T00:56:37.099 INFO:tasks.cephadm:Cluster fsid is b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:56:37.099 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T00:56:37.099 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-17T00:56:37.099 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi103': '172.21.15.103', 'mon.smithi143': '172.21.15.143'} 2024-09-17T00:56:37.099 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T00:56:37.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-09-17T00:56:37.125 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname $(hostname -s) 2024-09-17T00:56:37.155 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-17T00:56:37.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:56:37.303 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56092/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-330-gc2ddf972', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-330.gc2ddf972'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-16 16:11:17.578068', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-17T00:56:37.603 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-17T00:56:37.604 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-17T00:56:37.604 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-17T00:56:37.605 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T00:56:38.102 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 00:56 /home/ubuntu/cephtest/cephadm 2024-09-17T00:56:38.102 DEBUG:teuthology.orchestra.run.smithi143:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T00:56:38.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 00:56 /home/ubuntu/cephtest/cephadm 2024-09-17T00:56:38.605 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T00:56:38.626 DEBUG:teuthology.orchestra.run.smithi143:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T00:56:38.657 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-17T00:56:38.657 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-17T00:56:38.669 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-17T00:56:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-17T00:56:40.331 INFO:teuthology.orchestra.run.smithi143.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-17T00:57:26.914 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-17T00:57:26.915 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T00:57:26.915 INFO:teuthology.orchestra.run.smithi143.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T00:57:26.915 INFO:teuthology.orchestra.run.smithi143.stdout: "repo_digests": [ 2024-09-17T00:57:26.915 INFO:teuthology.orchestra.run.smithi143.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T00:57:26.915 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-17T00:57:26.915 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-17T00:57:28.369 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T00:57:28.369 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T00:57:28.369 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T00:57:28.369 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-09-17T00:57:28.369 INFO:teuthology.orchestra.run.smithi103.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T00:57:28.370 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-17T00:57:28.370 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T00:57:28.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-09-17T00:57:28.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph 2024-09-17T00:57:28.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-09-17T00:57:28.489 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /etc/ceph 2024-09-17T00:57:28.533 INFO:tasks.cephadm:Writing seed config... 2024-09-17T00:57:28.534 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-17T00:57:28.535 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-17T00:57:28.536 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T00:57:28.537 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T00:57:28.538 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T00:57:28.538 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T00:57:28.538 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T00:57:28.538 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-17T00:57:28.538 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-17T00:57:28.538 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-17T00:57:28.539 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:57:28.539 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T00:57:28.554 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b107b510-748f-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-17T00:57:28.554 DEBUG:teuthology.orchestra.run.smithi103:mon.smithi103> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service 2024-09-17T00:57:28.597 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T00:57:28.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid b107b510-748f-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.103 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:57:28.752 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:57:28.752 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'b107b510-748f-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.103', '--skip-admin-label'] 2024-09-17T00:57:28.776 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-17T00:57:28.776 INFO:teuthology.orchestra.run.smithi103.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T00:57:28.777 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying podman|docker is present... 2024-09-17T00:57:28.804 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-17T00:57:28.804 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying lvm2 is present... 2024-09-17T00:57:28.804 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying time synchronization is in place... 2024-09-17T00:57:28.814 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T00:57:28.814 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T00:57:28.821 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T00:57:28.821 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-17T00:57:28.828 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-09-17T00:57:28.835 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-09-17T00:57:28.835 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-09-17T00:57:28.835 INFO:teuthology.orchestra.run.smithi103.stdout:Repeating the final host check... 2024-09-17T00:57:28.857 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-17T00:57:28.857 INFO:teuthology.orchestra.run.smithi103.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T00:57:28.857 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl is present 2024-09-17T00:57:28.858 INFO:teuthology.orchestra.run.smithi103.stdout:lvcreate is present 2024-09-17T00:57:28.864 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T00:57:28.864 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T00:57:28.870 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T00:57:28.870 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-17T00:57:28.876 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Host looks OK 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Cluster fsid: b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Acquiring lock 139975991702864 on /run/cephadm/b107b510-748f-11ef-bceb-c7b262605968.lock 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Lock 139975991702864 acquired on /run/cephadm/b107b510-748f-11ef-bceb-c7b262605968.lock 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 3300 ... 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 6789 ... 2024-09-17T00:57:28.884 INFO:teuthology.orchestra.run.smithi103.stdout:Base mon IP(s) is [172.21.15.103:3300, 172.21.15.103:6789], mon addrv is [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-17T00:57:28.887 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.103 metric 100 2024-09-17T00:57:28.887 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.103 metric 100 2024-09-17T00:57:28.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T00:57:28.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-17T00:57:28.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-09-17T00:57:28.893 INFO:teuthology.orchestra.run.smithi103.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T00:57:28.894 INFO:teuthology.orchestra.run.smithi103.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T00:57:28.894 INFO:teuthology.orchestra.run.smithi103.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-17T00:57:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-17T00:57:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-17T00:57:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T00:57:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:d8a707c21dc06a64315160cb2d8e524fa91943a344731b2a930ee3a716bebbdd 2024-09-17T00:57:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-17T00:57:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying config sha256:980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-17T00:57:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T00:57:30.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph: stdout ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-17T00:57:30.219 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph version: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-17T00:57:30.219 INFO:teuthology.orchestra.run.smithi103.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T00:57:31.431 INFO:teuthology.orchestra.run.smithi103.stdout:stat: stdout 167 167 2024-09-17T00:57:31.431 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial keys... 2024-09-17T00:57:32.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQD70+hmslYvKhAAKw962hDU+WUZiVH3zAZUHQ== 2024-09-17T00:57:33.217 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQD80+hmKjmSJRAAIFnQfNK2k9jAp21i28IlCw== 2024-09-17T00:57:34.307 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQD90+hm4bnuIRAAAj9lAzORQklBlNz5nol35A== 2024-09-17T00:57:34.308 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial monmap... 2024-09-17T00:57:35.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T00:57:35.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-17T00:57:35.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:35.163 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T00:57:35.163 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool for smithi103 [v2:172.21.15.103:3300,v1:172.21.15.103:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T00:57:35.164 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = pacific 2024-09-17T00:57:35.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: set fsid to b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:35.164 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T00:57:35.164 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:57:35.164 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mon... 2024-09-17T00:57:35.968 INFO:teuthology.orchestra.run.smithi103.stdout:create mon.smithi103 on 2024-09-17T00:57:36.180 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-17T00:57:36.318 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T00:57:36.507 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b107b510-748f-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-b107b510-748f-11ef-bceb-c7b262605968.target. 2024-09-17T00:57:36.508 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b107b510-748f-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-b107b510-748f-11ef-bceb-c7b262605968.target. 2024-09-17T00:57:36.707 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103 2024-09-17T00:57:36.708 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service: Unit ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service not loaded. 2024-09-17T00:57:36.867 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b107b510-748f-11ef-bceb-c7b262605968.target.wants/ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service → /etc/systemd/system/ceph-b107b510-748f-11ef-bceb-c7b262605968@.service. 2024-09-17T00:57:37.362 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:37 smithi103 ceph-mon[27789]: mon.smithi103 is new leader, mons smithi103 in quorum (ranks 0) 2024-09-17T00:57:37.375 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:57:37.375 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-17T00:57:37.382 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:57:37.382 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-17T00:57:37.382 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-17T00:57:37.382 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T00:57:37.382 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon to start... 2024-09-17T00:57:37.383 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon... 2024-09-17T00:57:37.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:37 smithi103 bash[27770]: 211800b56ce1dd902a593da1864be32782c761b808c479d2fe7a9bd96c997476 2024-09-17T00:57:37.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:37 smithi103 systemd[1]: Started Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout id: b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout services: 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi103 (age 0.548943s) 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T00:57:38.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout data: 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.801+0000 7f866cccf640 1 Processor -- start 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.801+0000 7f866cccf640 1 -- start start 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.802+0000 7f866cccf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f86681048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.802+0000 7f866cccf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668104eb0 con 0x7f86681044e0 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.802+0000 7f866659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f86681048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:38.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.802+0000 7f866659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f86681048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48084/0 (socket says 172.21.15.103:48084) 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.802+0000 7f866659c640 1 -- 172.21.15.103:0/2462631970 learned_addr learned my addr 172.21.15.103:0/2462631970 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.802+0000 7f866659c640 1 -- 172.21.15.103:0/2462631970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86681056e0 con 0x7f86681044e0 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.804+0000 7f866659c640 1 --2- 172.21.15.103:0/2462631970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f86681048e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8658009e80 tx=0x7f865802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3685b1d22cde8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.804+0000 7f866559a640 1 -- 172.21.15.103:0/2462631970 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8658031400 con 0x7f86681044e0 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.804+0000 7f866559a640 1 -- 172.21.15.103:0/2462631970 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865802d050 con 0x7f86681044e0 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.804+0000 7f866559a640 1 -- 172.21.15.103:0/2462631970 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86580316d0 con 0x7f86681044e0 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 -- 172.21.15.103:0/2462631970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 msgr2=0x7f86681048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 --2- 172.21.15.103:0/2462631970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f86681048e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8658009e80 tx=0x7f865802a7a0 comp rx=0 tx=0).stop 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 -- 172.21.15.103:0/2462631970 shutdown_connections 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 --2- 172.21.15.103:0/2462631970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f86681048e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 -- 172.21.15.103:0/2462631970 >> 172.21.15.103:0/2462631970 conn(0x7f86680ffc50 msgr2=0x7f86681020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:38.387 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 -- 172.21.15.103:0/2462631970 shutdown_connections 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.805+0000 7f866cccf640 1 -- 172.21.15.103:0/2462631970 wait complete. 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866cccf640 1 Processor -- start 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866cccf640 1 -- start start 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866cccf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f8668198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866cccf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668199020 con 0x7f86681044e0 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f8668198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f8668198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48098/0 (socket says 172.21.15.103:48098) 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.806+0000 7f866659c640 1 -- 172.21.15.103:0/3448874779 learned_addr learned my addr 172.21.15.103:0/3448874779 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f866659c640 1 -- 172.21.15.103:0/3448874779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009b30 con 0x7f86681044e0 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f866659c640 1 --2- 172.21.15.103:0/3448874779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f8668198ae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f865802acc0 tx=0x7f8658004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865803b7d0 con 0x7f86681044e0 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865803b930 con 0x7f86681044e0 2024-09-17T00:57:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865803bc30 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8668199220 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86681996c0 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8658038040 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.807+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f865803a3d0 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.808+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668105a50 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.810+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f865804b060 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.867+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f866819bfa0 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f86577fe640 1 -- 172.21.15.103:0/3448874779 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f8658053070 con 0x7f86681044e0 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 msgr2=0x7f8668198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 --2- 172.21.15.103:0/3448874779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f8668198ae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f865802acc0 tx=0x7f8658004a40 comp rx=0 tx=0).stop 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 shutdown_connections 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 --2- 172.21.15.103:0/3448874779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86681044e0 0x7f8668198ae0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:38.389 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 >> 172.21.15.103:0/3448874779 conn(0x7f86680ffc50 msgr2=0x7f86680798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:38.390 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 shutdown_connections 2024-09-17T00:57:38.390 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:37.868+0000 7f866cccf640 1 -- 172.21.15.103:0/3448874779 wait complete. 2024-09-17T00:57:38.390 INFO:teuthology.orchestra.run.smithi103.stdout:mon is available 2024-09-17T00:57:38.390 INFO:teuthology.orchestra.run.smithi103.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T00:57:38.589 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:38 smithi103 ceph-mon[27789]: mon.smithi103 is new leader, mons smithi103 in quorum (ranks 0) 2024-09-17T00:57:38.589 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:38 smithi103 ceph-mon[27789]: monmap e1: 1 mons at {smithi103=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T00:57:38.589 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:38 smithi103 ceph-mon[27789]: fsmap 2024-09-17T00:57:38.589 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:38 smithi103 ceph-mon[27789]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T00:57:38.589 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:38 smithi103 ceph-mon[27789]: mgrmap e1: no daemons active 2024-09-17T00:57:38.589 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:38 smithi103 ceph-mon[27789]: from='client.? 172.21.15.103:0/3448874779' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T00:57:39.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:39.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T00:57:39.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.782+0000 7ff1c0105640 1 Processor -- start 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.782+0000 7ff1c0105640 1 -- start start 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.782+0000 7ff1c0105640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8103ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.782+0000 7ff1c0105640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81042b0 con 0x7ff1b81038e0 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.782+0000 7ff1bdea1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8103ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.783+0000 7ff1bdea1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8103ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48108/0 (socket says 172.21.15.103:48108) 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.783+0000 7ff1bdea1640 1 -- 172.21.15.103:0/1861570810 learned_addr learned my addr 172.21.15.103:0/1861570810 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.783+0000 7ff1bdea1640 1 -- 172.21.15.103:0/1861570810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b81043f0 con 0x7ff1b81038e0 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.783+0000 7ff1bdea1640 1 --2- 172.21.15.103:0/1861570810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8103ce0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009820 tx=0x7ff1b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566e13c3cff061e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1bce9f640 1 -- 172.21.15.103:0/1861570810 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b402ad40 con 0x7ff1b81038e0 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1bce9f640 1 -- 172.21.15.103:0/1861570810 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4032440 con 0x7ff1b81038e0 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1bce9f640 1 -- 172.21.15.103:0/1861570810 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b402aea0 con 0x7ff1b81038e0 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 -- 172.21.15.103:0/1861570810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 msgr2=0x7ff1b8103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 --2- 172.21.15.103:0/1861570810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8103ce0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009820 tx=0x7ff1b402a270 comp rx=0 tx=0).stop 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 -- 172.21.15.103:0/1861570810 shutdown_connections 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 --2- 172.21.15.103:0/1861570810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8103ce0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 -- 172.21.15.103:0/1861570810 >> 172.21.15.103:0/1861570810 conn(0x7ff1b80ff3f0 msgr2=0x7ff1b8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 -- 172.21.15.103:0/1861570810 shutdown_connections 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.784+0000 7ff1c0105640 1 -- 172.21.15.103:0/1861570810 wait complete. 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1c0105640 1 Processor -- start 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1c0105640 1 -- start start 2024-09-17T00:57:39.420 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1c0105640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1c0105640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8199050 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1bdea1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1bdea1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48112/0 (socket says 172.21.15.103:48112) 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1bdea1640 1 -- 172.21.15.103:0/2515575714 learned_addr learned my addr 172.21.15.103:0/2515575714 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.785+0000 7ff1bdea1640 1 -- 172.21.15.103:0/2515575714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40094d0 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1bdea1640 1 --2- 172.21.15.103:0/2515575714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8198b10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40090b0 tx=0x7ff1b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b40308d0 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4030a30 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8199250 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b4030d30 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b8199750 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff1b4039040 con 0x7ff1b81038e0 2024-09-17T00:57:39.421 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.786+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff1b403b880 con 0x7ff1b81038e0 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.787+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b8106a80 con 0x7ff1b81038e0 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.789+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff1b4037070 con 0x7ff1b81038e0 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.844+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff1b819bfd0 con 0x7ff1b81038e0 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.848+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff1b4046d00 con 0x7ff1b81038e0 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.848+0000 7ff1aeffd640 1 -- 172.21.15.103:0/2515575714 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7ff1b4054d80 con 0x7ff1b81038e0 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.849+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 msgr2=0x7ff1b8198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.849+0000 7ff1c0105640 1 --2- 172.21.15.103:0/2515575714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8198b10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40090b0 tx=0x7ff1b40046c0 comp rx=0 tx=0).stop 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.849+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 shutdown_connections 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.849+0000 7ff1c0105640 1 --2- 172.21.15.103:0/2515575714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1b81038e0 0x7ff1b8198b10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.849+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 >> 172.21.15.103:0/2515575714 conn(0x7ff1b80ff3f0 msgr2=0x7ff1b818d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.850+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 shutdown_connections 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:38.850+0000 7ff1c0105640 1 -- 172.21.15.103:0/2515575714 wait complete. 2024-09-17T00:57:39.422 INFO:teuthology.orchestra.run.smithi103.stdout:Generating new minimal ceph.conf... 2024-09-17T00:57:39.642 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:39 smithi103 ceph-mon[27789]: from='client.? 172.21.15.103:0/2515575714' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T00:57:39.642 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:39 smithi103 ceph-mon[27789]: from='client.? 172.21.15.103:0/2515575714' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T00:57:40.422 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.816+0000 7f71bdf50640 1 Processor -- start 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.816+0000 7f71bdf50640 1 -- start start 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.816+0000 7f71bdf50640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.816+0000 7f71bdf50640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8104290 con 0x7f71b81038c0 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.816+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.817+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48114/0 (socket says 172.21.15.103:48114) 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.817+0000 7f71b77fe640 1 -- 172.21.15.103:0/1660792179 learned_addr learned my addr 172.21.15.103:0/1660792179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.817+0000 7f71b77fe640 1 -- 172.21.15.103:0/1660792179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b81043d0 con 0x7f71b81038c0 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.817+0000 7f71b77fe640 1 --2- 172.21.15.103:0/1660792179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8103cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009820 tx=0x7f71a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91ea6fb52521457 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71b67fc640 1 -- 172.21.15.103:0/1660792179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a802ad40 con 0x7f71b81038c0 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71b67fc640 1 -- 172.21.15.103:0/1660792179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f71a80328c0 con 0x7f71b81038c0 2024-09-17T00:57:40.423 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71b67fc640 1 -- 172.21.15.103:0/1660792179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a80307f0 con 0x7f71b81038c0 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 -- 172.21.15.103:0/1660792179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 msgr2=0x7f71b8103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 --2- 172.21.15.103:0/1660792179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8103cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009820 tx=0x7f71a802a270 comp rx=0 tx=0).stop 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 -- 172.21.15.103:0/1660792179 shutdown_connections 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 --2- 172.21.15.103:0/1660792179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8103cc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 -- 172.21.15.103:0/1660792179 >> 172.21.15.103:0/1660792179 conn(0x7f71b80ff410 msgr2=0x7f71b8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 -- 172.21.15.103:0/1660792179 shutdown_connections 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.818+0000 7f71bdf50640 1 -- 172.21.15.103:0/1660792179 wait complete. 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71bdf50640 1 Processor -- start 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71bdf50640 1 -- start start 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71bdf50640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8106120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71bdf50640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8106660 con 0x7f71b81038c0 2024-09-17T00:57:40.424 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8106120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8106120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48118/0 (socket says 172.21.15.103:48118) 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.819+0000 7f71b77fe640 1 -- 172.21.15.103:0/4200978552 learned_addr learned my addr 172.21.15.103:0/4200978552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b77fe640 1 -- 172.21.15.103:0/4200978552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80094d0 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b77fe640 1 --2- 172.21.15.103:0/4200978552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8106120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f71a8030d30 tx=0x7f71a8030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a8032c40 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f71a8032da0 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b8104850 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a803c570 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8104c70 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f71a803cae0 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.820+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f71a8047e00 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.821+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b8103cc0 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.823+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f71a8037070 con 0x7f71b81038c0 2024-09-17T00:57:40.425 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.879+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f71b8104eb0 con 0x7f71b81038c0 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.879+0000 7f71b4ff9640 1 -- 172.21.15.103:0/4200978552 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f71a803da90 con 0x7f71b81038c0 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 msgr2=0x7f71b8106120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 --2- 172.21.15.103:0/4200978552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8106120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f71a8030d30 tx=0x7f71a8030d60 comp rx=0 tx=0).stop 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 shutdown_connections 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 --2- 172.21.15.103:0/4200978552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71b81038c0 0x7f71b8106120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 >> 172.21.15.103:0/4200978552 conn(0x7f71b80ff410 msgr2=0x7f71b80fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 shutdown_connections 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:39.880+0000 7f71bdf50640 1 -- 172.21.15.103:0/4200978552 wait complete. 2024-09-17T00:57:40.426 INFO:teuthology.orchestra.run.smithi103.stdout:Restarting the monitor... 2024-09-17T00:57:40.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:40 smithi103 ceph-mon[27789]: from='client.? 172.21.15.103:0/4200978552' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:40.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:40 smithi103 systemd[1]: Stopping Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T00:57:40.993 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:40 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[27785]: 2024-09-17T00:57:40.686+0000 7fa9326d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi103 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T00:57:40.994 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:40 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[27785]: 2024-09-17T00:57:40.686+0000 7fa9326d8640 -1 mon.smithi103@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T00:57:40.994 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:40 smithi103 podman[28031]: 2024-09-17 00:57:40.759409605 +0000 UTC m=+0.173962212 container died 211800b56ce1dd902a593da1864be32782c761b808c479d2fe7a9bd96c997476 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T00:57:41.286 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 podman[28031]: 2024-09-17 00:57:41.087432217 +0000 UTC m=+0.501984822 container cleanup 211800b56ce1dd902a593da1864be32782c761b808c479d2fe7a9bd96c997476 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T00:57:41.286 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 bash[28031]: ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103 2024-09-17T00:57:41.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 podman[28043]: 2024-09-17 00:57:41.288255344 +0000 UTC m=+0.529065188 container remove 211800b56ce1dd902a593da1864be32782c761b808c479d2fe7a9bd96c997476 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T00:57:41.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service: Deactivated successfully. 2024-09-17T00:57:41.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 systemd[1]: Stopped Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T00:57:41.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 systemd[1]: Starting Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 podman[28137]: 2024-09-17 00:57:41.61484717 +0000 UTC m=+0.016105105 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph:reef 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 podman[28137]: 2024-09-17 00:57:41.714376061 +0000 UTC m=+0.115633991 container create afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 podman[28137]: 2024-09-17 00:57:41.916582606 +0000 UTC m=+0.317840542 container init afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 podman[28137]: 2024-09-17 00:57:41.919563556 +0000 UTC m=+0.320821489 container start afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b) 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 2 2024-09-17T00:57:41.998 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: pidfile_write: ignore empty --pid-file 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: load: jerasure load: lrc 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: RocksDB version: 7.9.2 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Git sha 0 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: DB SUMMARY 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: DB Session ID: M6844SNGUAJRXECALGUO 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: CURRENT file: CURRENT 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi103/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi103/store.db: 000009.log size: 99015 ; 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.error_if_exists: 0 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.create_if_missing: 0 2024-09-17T00:57:41.999 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.paranoid_checks: 1 2024-09-17T00:57:42.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T00:57:42.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T00:57:42.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T00:57:42.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.env: 0x55c5286d5bc0 2024-09-17T00:57:42.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T00:57:42.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.info_log: 0x55c52929adc0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.statistics: (nil) 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.use_fsync: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_log_file_size: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.allow_fallocate: 1 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.use_direct_reads: 0 2024-09-17T00:57:42.002 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.db_log_dir: 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.wal_dir: 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.write_buffer_manager: 0x55c5292a8320 2024-09-17T00:57:42.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.unordered_write: 0 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.row_cache: None 2024-09-17T00:57:42.004 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.wal_filter: None 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.two_write_queues: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.wal_compression: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.atomic_flush: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.log_readahead_size: 0 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T00:57:42.005 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_background_jobs: 2 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_background_compactions: -1 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_subcompactions: 1 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T00:57:42.006 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_open_files: -1 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_background_flushes: -1 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Compression algorithms supported: 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kZSTD supported: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kXpressCompression supported: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kBZip2Compression supported: 0 2024-09-17T00:57:42.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kLZ4Compression supported: 1 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kZlibCompression supported: 1 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: kSnappyCompression supported: 1 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi103/store.db/MANIFEST-000010 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.merge_operator: 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_filter: None 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T00:57:42.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c52929aa20) 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_type: 0 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_block_index_type: 0 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_shortening: 1 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: checksum: 4 2024-09-17T00:57:42.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: no_block_cache: 0 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache: 0x55c52928f1f0 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_options: 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: capacity : 536870912 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: num_shard_bits : 4 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: strict_capacity_limit : 0 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_compressed: (nil) 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: persistent_cache: (nil) 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_size: 4096 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_size_deviation: 10 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_restart_interval: 16 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_block_restart_interval: 1 2024-09-17T00:57:42.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: metadata_block_size: 4096 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: partition_filters: 0 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: use_delta_encoding: 1 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: filter_policy: bloomfilter 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: whole_key_filtering: 1 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: verify_compression: 0 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: format_version: 5 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: enable_index_compression: 1 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_align: 0 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_auto_readahead_size: 262144 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: prepopulate_block_cache: 0 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: initial_auto_readahead_size: 8192 2024-09-17T00:57:42.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression: NoCompression 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.num_levels: 7 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T00:57:42.012 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T00:57:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T00:57:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T00:57:42.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.inplace_update_support: 0 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T00:57:42.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.bloom_locality: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.max_successive_merges: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.ttl: 2592000 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.enable_blob_files: false 2024-09-17T00:57:42.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.min_blob_size: 0 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi103/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1f3af57d-92f6-4dd2-9c4d-5193c8d1668a 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534661945463, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T00:57:42.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534661946450, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94287, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92267, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84775, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726534661, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1f3af57d-92f6-4dd2-9c4d-5193c8d1668a", "db_session_id": "M6844SNGUAJRXECALGUO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534661946555, "job": 1, "event": "recovery_finished"} 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi103/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c5292bae00 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: DB pointer 0x55c5293b0000 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** DB Stats ** 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:57:42.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: L0 2/0 93.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Sum 2/0 93.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T00:57:42.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative compaction: 0.00 GB write, 29.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval compaction: 0.00 GB write, 29.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:57:42.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Block cache BinnedLRUCache@0x55c52928f1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: starting mon.smithi103 rank 0 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi103 fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???) e1 preinit fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).mds e1 new map 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).mds e1 print_map 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: e1 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:57:42.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: legacy client fscid: -1 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: No filesystems configured 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 ceph-mon[28156]: mon.smithi103@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:41 smithi103 bash[28137]: afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e 2024-09-17T00:57:42.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:42 smithi103 systemd[1]: Started Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T00:57:42.024 INFO:teuthology.orchestra.run.smithi103.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T00:57:42.292 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:42 smithi103 ceph-mon[28156]: mon.smithi103 is new leader, mons smithi103 in quorum (ranks 0) 2024-09-17T00:57:42.292 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:42 smithi103 ceph-mon[28156]: monmap e1: 1 mons at {smithi103=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T00:57:42.292 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:42 smithi103 ceph-mon[28156]: fsmap 2024-09-17T00:57:42.292 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:42 smithi103 ceph-mon[28156]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T00:57:42.292 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:42 smithi103 ceph-mon[28156]: mgrmap e1: no daemons active 2024-09-17T00:57:43.011 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.374+0000 7f5d26c2a640 1 Processor -- start 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.374+0000 7f5d26c2a640 1 -- start start 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.374+0000 7f5d26c2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d201059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.374+0000 7f5d26c2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20105f90 con 0x7f5d201055c0 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.375+0000 7f5d249c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d201059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.375+0000 7f5d249c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d201059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48532/0 (socket says 172.21.15.103:48532) 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.375+0000 7f5d249c6640 1 -- 172.21.15.103:0/4255581360 learned_addr learned my addr 172.21.15.103:0/4255581360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.375+0000 7f5d249c6640 1 -- 172.21.15.103:0/4255581360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d201067c0 con 0x7f5d201055c0 2024-09-17T00:57:43.012 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.377+0000 7f5d249c6640 1 --2- 172.21.15.103:0/4255581360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d201059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009820 tx=0x7f5d1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed12e461328f956 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.377+0000 7f5d1f7fe640 1 -- 172.21.15.103:0/4255581360 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d1402ad40 con 0x7f5d201055c0 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.377+0000 7f5d1f7fe640 1 -- 172.21.15.103:0/4255581360 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5d140328c0 con 0x7f5d201055c0 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.377+0000 7f5d1f7fe640 1 -- 172.21.15.103:0/4255581360 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d140307f0 con 0x7f5d201055c0 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.377+0000 7f5d26c2a640 1 -- 172.21.15.103:0/4255581360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 msgr2=0x7f5d201059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.377+0000 7f5d26c2a640 1 --2- 172.21.15.103:0/4255581360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d201059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009820 tx=0x7f5d1402a270 comp rx=0 tx=0).stop 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 -- 172.21.15.103:0/4255581360 shutdown_connections 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 --2- 172.21.15.103:0/4255581360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d201059c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 -- 172.21.15.103:0/4255581360 >> 172.21.15.103:0/4255581360 conn(0x7f5d20100d30 msgr2=0x7f5d20103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 -- 172.21.15.103:0/4255581360 shutdown_connections 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 -- 172.21.15.103:0/4255581360 wait complete. 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 Processor -- start 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 -- start start 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d20199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d26c2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20199840 con 0x7f5d201055c0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d249c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d20199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d249c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d20199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48542/0 (socket says 172.21.15.103:48542) 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.378+0000 7f5d249c6640 1 -- 172.21.15.103:0/3495150762 learned_addr learned my addr 172.21.15.103:0/3495150762 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d249c6640 1 -- 172.21.15.103:0/3495150762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140094d0 con 0x7f5d201055c0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d249c6640 1 --2- 172.21.15.103:0/3495150762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d20199300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d14030d30 tx=0x7f5d14030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d14032c40 con 0x7f5d201055c0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5d14032da0 con 0x7f5d201055c0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d20199a40 con 0x7f5d201055c0 2024-09-17T00:57:43.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d1403c570 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d20199e60 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5d1403cae0 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.379+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5d14047e00 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.380+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d201059c0 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.382+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5d14037070 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.439+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f5d201099f0 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.444+0000 7f5d1dffb640 1 -- 172.21.15.103:0/3495150762 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5d1403da90 con 0x7f5d201055c0 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 msgr2=0x7f5d20199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 --2- 172.21.15.103:0/3495150762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d20199300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d14030d30 tx=0x7f5d14030d60 comp rx=0 tx=0).stop 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 shutdown_connections 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 --2- 172.21.15.103:0/3495150762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d201055c0 0x7f5d20199300 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:43.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 >> 172.21.15.103:0/3495150762 conn(0x7f5d20100d30 msgr2=0x7f5d201018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:43.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 shutdown_connections 2024-09-17T00:57:43.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:42.445+0000 7f5d26c2a640 1 -- 172.21.15.103:0/3495150762 wait complete. 2024-09-17T00:57:43.016 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T00:57:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:57:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mgr... 2024-09-17T00:57:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T00:57:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T00:57:43.030 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-17T00:57:43.268 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b107b510-748f-11ef-bceb-c7b262605968@mgr.smithi103.efjaur 2024-09-17T00:57:43.268 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b107b510-748f-11ef-bceb-c7b262605968@mgr.smithi103.efjaur.service: Unit ceph-b107b510-748f-11ef-bceb-c7b262605968@mgr.smithi103.efjaur.service not loaded. 2024-09-17T00:57:43.410 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b107b510-748f-11ef-bceb-c7b262605968.target.wants/ceph-b107b510-748f-11ef-bceb-c7b262605968@mgr.smithi103.efjaur.service → /etc/systemd/system/ceph-b107b510-748f-11ef-bceb-c7b262605968@.service. 2024-09-17T00:57:43.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:43 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3495150762' entity='client.admin' 2024-09-17T00:57:43.991 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:57:43.991 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-17T00:57:43.999 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:57:43.999 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-17T00:57:43.999 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-17T00:57:43.999 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T00:57:44.010 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:57:44.010 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-17T00:57:44.018 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:57:44.018 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-17T00:57:44.018 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-17T00:57:44.019 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-17T00:57:44.019 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr to start... 2024-09-17T00:57:44.019 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr... 2024-09-17T00:57:44.577 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:44 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2916646896' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:57:45.170 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:45.170 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "b107b510-748f-11ef-bceb-c7b262605968", 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "smithi103" 2024-09-17T00:57:45.171 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T00:57:45.172 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T00:57:45.180 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.181 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T00:57:37.320763+0000", 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:57:45.182 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.398+0000 7f7003a4e640 1 Processor -- start 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.398+0000 7f7003a4e640 1 -- start start 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.399+0000 7f7003a4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.399+0000 7f7003a4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc079e60 con 0x7f6ffc106090 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.399+0000 7f70017ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.399+0000 7f70017ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48572/0 (socket says 172.21.15.103:48572) 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.399+0000 7f70017ea640 1 -- 172.21.15.103:0/1246349475 learned_addr learned my addr 172.21.15.103:0/1246349475 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.399+0000 7f70017ea640 1 -- 172.21.15.103:0/1246349475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc1089c0 con 0x7f6ffc106090 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.400+0000 7f70017ea640 1 --2- 172.21.15.103:0/1246349475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc108480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009820 tx=0x7f6fec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf93e7b89057782e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.400+0000 7f6ff3fff640 1 -- 172.21.15.103:0/1246349475 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fec02ad40 con 0x7f6ffc106090 2024-09-17T00:57:45.183 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.400+0000 7f6ff3fff640 1 -- 172.21.15.103:0/1246349475 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6fec0328c0 con 0x7f6ffc106090 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.400+0000 7f6ff3fff640 1 -- 172.21.15.103:0/1246349475 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fec0307f0 con 0x7f6ffc106090 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 -- 172.21.15.103:0/1246349475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 msgr2=0x7f6ffc108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 --2- 172.21.15.103:0/1246349475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc108480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009820 tx=0x7f6fec02a270 comp rx=0 tx=0).stop 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 -- 172.21.15.103:0/1246349475 shutdown_connections 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 --2- 172.21.15.103:0/1246349475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc108480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 -- 172.21.15.103:0/1246349475 >> 172.21.15.103:0/1246349475 conn(0x7f6ffc0ffc50 msgr2=0x7f6ffc1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 -- 172.21.15.103:0/1246349475 shutdown_connections 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.401+0000 7f7003a4e640 1 -- 172.21.15.103:0/1246349475 wait complete. 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f7003a4e640 1 Processor -- start 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f7003a4e640 1 -- start start 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f7003a4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f7003a4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc199800 con 0x7f6ffc106090 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f70017ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f70017ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48580/0 (socket says 172.21.15.103:48580) 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.402+0000 7f70017ea640 1 -- 172.21.15.103:0/2916646896 learned_addr learned my addr 172.21.15.103:0/2916646896 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f70017ea640 1 -- 172.21.15.103:0/2916646896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0094d0 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f70017ea640 1 --2- 172.21.15.103:0/2916646896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc1992c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009940 tx=0x7f6fec032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fec041070 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6fec030cc0 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc199a00 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc199e20 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fec03c620 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6fec03cb20 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.403+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6fec046dc0 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.404+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe0005280 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.406+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6fec037070 con 0x7f6ffc106090 2024-09-17T00:57:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.466+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6fe0005800 con 0x7f6ffc106090 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.466+0000 7f6ff27fc640 1 -- 172.21.15.103:0/2916646896 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f6fec030e30 con 0x7f6ffc106090 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.467+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 msgr2=0x7f6ffc1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.467+0000 7f7003a4e640 1 --2- 172.21.15.103:0/2916646896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc1992c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009940 tx=0x7f6fec032c60 comp rx=0 tx=0).stop 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.467+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 shutdown_connections 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.467+0000 7f7003a4e640 1 --2- 172.21.15.103:0/2916646896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ffc106090 0x7f6ffc1992c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.467+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 >> 172.21.15.103:0/2916646896 conn(0x7f6ffc0ffc50 msgr2=0x7f6ffc100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.467+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 shutdown_connections 2024-09-17T00:57:45.186 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:44.468+0000 7f7003a4e640 1 -- 172.21.15.103:0/2916646896 wait complete. 2024-09-17T00:57:45.187 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (1/15)... 2024-09-17T00:57:47.868 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:47 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2835884621' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:57:48.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:48.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:57:48.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "b107b510-748f-11ef-bceb-c7b262605968", 2024-09-17T00:57:48.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T00:57:48.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T00:57:48.234 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "smithi103" 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:48.235 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T00:57:48.236 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.237 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T00:57:37.320763+0000", 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:57:48.238 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.599+0000 7f913afa6640 1 Processor -- start 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.599+0000 7f913afa6640 1 -- start start 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.599+0000 7f913afa6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f9134104950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.599+0000 7f913afa6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9134104f20 con 0x7f9134104550 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.600+0000 7f9138d42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f9134104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.600+0000 7f9138d42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f9134104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48596/0 (socket says 172.21.15.103:48596) 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.600+0000 7f9138d42640 1 -- 172.21.15.103:0/989886872 learned_addr learned my addr 172.21.15.103:0/989886872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.600+0000 7f9138d42640 1 -- 172.21.15.103:0/989886872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134105700 con 0x7f9134104550 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.601+0000 7f9138d42640 1 --2- 172.21.15.103:0/989886872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f9134104950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9128009820 tx=0x7f912802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c8ad1b8a9875e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.601+0000 7f91337fe640 1 -- 172.21.15.103:0/989886872 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f912802ad40 con 0x7f9134104550 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.601+0000 7f91337fe640 1 -- 172.21.15.103:0/989886872 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f91280328c0 con 0x7f9134104550 2024-09-17T00:57:48.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.601+0000 7f91337fe640 1 -- 172.21.15.103:0/989886872 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91280307f0 con 0x7f9134104550 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.601+0000 7f913afa6640 1 -- 172.21.15.103:0/989886872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 msgr2=0x7f9134104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.601+0000 7f913afa6640 1 --2- 172.21.15.103:0/989886872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f9134104950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9128009820 tx=0x7f912802a270 comp rx=0 tx=0).stop 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 -- 172.21.15.103:0/989886872 shutdown_connections 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 --2- 172.21.15.103:0/989886872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f9134104950 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 -- 172.21.15.103:0/989886872 >> 172.21.15.103:0/989886872 conn(0x7f91340ffd00 msgr2=0x7f9134102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 -- 172.21.15.103:0/989886872 shutdown_connections 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 -- 172.21.15.103:0/989886872 wait complete. 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 Processor -- start 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 -- start start 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f91341991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f913afa6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9134199730 con 0x7f9134104550 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.602+0000 7f9138d42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f91341991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9138d42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f91341991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48610/0 (socket says 172.21.15.103:48610) 2024-09-17T00:57:48.240 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9138d42640 1 -- 172.21.15.103:0/2835884621 learned_addr learned my addr 172.21.15.103:0/2835884621 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9138d42640 1 -- 172.21.15.103:0/2835884621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280094d0 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9138d42640 1 --2- 172.21.15.103:0/2835884621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f91341991f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9128030d30 tx=0x7f9128030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9128032c40 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9134199930 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f9128032da0 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f912803c6a0 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.603+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9134199d50 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.604+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f912803cc10 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.604+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f91280463c0 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.604+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9134104950 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.606+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9128037070 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.666+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f91341933e0 con 0x7f9134104550 2024-09-17T00:57:48.241 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.667+0000 7f9131ffb640 1 -- 172.21.15.103:0/2835884621 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f912803da90 con 0x7f9134104550 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 msgr2=0x7f91341991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 --2- 172.21.15.103:0/2835884621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f91341991f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9128030d30 tx=0x7f9128030d60 comp rx=0 tx=0).stop 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 shutdown_connections 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 --2- 172.21.15.103:0/2835884621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9134104550 0x7f91341991f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 >> 172.21.15.103:0/2835884621 conn(0x7f91340ffd00 msgr2=0x7f9134100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 shutdown_connections 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:47.668+0000 7f913afa6640 1 -- 172.21.15.103:0/2835884621 wait complete. 2024-09-17T00:57:48.242 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (2/15)... 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: Activating manager daemon smithi103.efjaur 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: mgrmap e2: smithi103.efjaur(active, starting, since 0.00331537s) 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T00:57:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T00:57:48.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: Manager daemon smithi103.efjaur is now available 2024-09-17T00:57:48.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:48.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:48.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' 2024-09-17T00:57:48.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' 2024-09-17T00:57:48.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:48 smithi103 ceph-mon[28156]: from='mgr.14100 172.21.15.103:0/3469253577' entity='mgr.smithi103.efjaur' 2024-09-17T00:57:50.883 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:50 smithi103 ceph-mon[28156]: mgrmap e3: smithi103.efjaur(active, since 1.00726s) 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "b107b510-748f-11ef-bceb-c7b262605968", 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "smithi103" 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T00:57:51.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T00:57:51.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:57:51.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T00:57:37.320763+0000", 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.649+0000 7fd5bbfa5640 1 Processor -- start 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.649+0000 7fd5bbfa5640 1 -- start start 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.650+0000 7fd5bbfa5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b41059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.650+0000 7fd5bbfa5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4105f90 con 0x7fd5b41055c0 2024-09-17T00:57:51.381 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.650+0000 7fd5b9d41640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b41059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.650+0000 7fd5b9d41640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b41059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48692/0 (socket says 172.21.15.103:48692) 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.650+0000 7fd5b9d41640 1 -- 172.21.15.103:0/453370624 learned_addr learned my addr 172.21.15.103:0/453370624 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.650+0000 7fd5b9d41640 1 -- 172.21.15.103:0/453370624 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b41067c0 con 0x7fd5b41055c0 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.651+0000 7fd5b9d41640 1 --2- 172.21.15.103:0/453370624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b41059c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009820 tx=0x7fd5b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485ff24284b55f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.651+0000 7fd5b8d3f640 1 -- 172.21.15.103:0/453370624 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5b002ad40 con 0x7fd5b41055c0 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.651+0000 7fd5b8d3f640 1 -- 172.21.15.103:0/453370624 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd5b00328c0 con 0x7fd5b41055c0 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.651+0000 7fd5b8d3f640 1 -- 172.21.15.103:0/453370624 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5b00307f0 con 0x7fd5b41055c0 2024-09-17T00:57:51.382 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/453370624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 msgr2=0x7fd5b41059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 --2- 172.21.15.103:0/453370624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b41059c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009820 tx=0x7fd5b002a270 comp rx=0 tx=0).stop 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/453370624 shutdown_connections 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 --2- 172.21.15.103:0/453370624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b41059c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/453370624 >> 172.21.15.103:0/453370624 conn(0x7fd5b4100d30 msgr2=0x7fd5b4103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/453370624 shutdown_connections 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/453370624 wait complete. 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 Processor -- start 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.652+0000 7fd5bbfa5640 1 -- start start 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5bbfa5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5bbfa5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4199850 con 0x7fd5b41055c0 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5b9d41640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5b9d41640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b4199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48704/0 (socket says 172.21.15.103:48704) 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5b9d41640 1 -- 172.21.15.103:0/1381383146 learned_addr learned my addr 172.21.15.103:0/1381383146 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5b9d41640 1 -- 172.21.15.103:0/1381383146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00094d0 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5b9d41640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b4199310 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0030d30 tx=0x7fd5b0030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5b0032c40 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd5b0032da0 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b4199a50 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5b003c570 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.653+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4199e70 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.655+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b41059c0 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.657+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fd5b003da90 con 0x7fd5b41055c0 2024-09-17T00:57:51.384 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.657+0000 7fd5aaffd640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7fd5a0038650 0x7fd5a003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.657+0000 7fd5b9540640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7fd5a0038650 0x7fd5a003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.658+0000 7fd5b9540640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7fd5a0038650 0x7fd5a003ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098c0 tx=0x7fd5a4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.658+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd5b003cb60 con 0x7fd5b41055c0 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.663+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd5b003c7e0 con 0x7fd5b41055c0 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.883+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd5b419c7d0 con 0x7fd5b41055c0 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.884+0000 7fd5aaffd640 1 -- 172.21.15.103:0/1381383146 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1245 (secure 0 0 0) 0x7fd5b0045360 con 0x7fd5b41055c0 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7fd5a0038650 msgr2=0x7fd5a003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7fd5a0038650 0x7fd5a003ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098c0 tx=0x7fd5a4006db0 comp rx=0 tx=0).stop 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 msgr2=0x7fd5b4199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b4199310 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0030d30 tx=0x7fd5b0030d60 comp rx=0 tx=0).stop 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 shutdown_connections 2024-09-17T00:57:51.385 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7fd5a0038650 0x7fd5a003ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:51.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 --2- 172.21.15.103:0/1381383146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5b41055c0 0x7fd5b4199310 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:51.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 >> 172.21.15.103:0/1381383146 conn(0x7fd5b4100d30 msgr2=0x7fd5b4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:51.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 shutdown_connections 2024-09-17T00:57:51.386 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:50.887+0000 7fd5bbfa5640 1 -- 172.21.15.103:0/1381383146 wait complete. 2024-09-17T00:57:51.386 INFO:teuthology.orchestra.run.smithi103.stdout:mgr is available 2024-09-17T00:57:51.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:51 smithi103 ceph-mon[28156]: mgrmap e4: smithi103.efjaur(active, since 2s) 2024-09-17T00:57:51.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:51 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1381383146' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:52.554 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.851+0000 7f6796321640 1 Processor -- start 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.851+0000 7f6796321640 1 -- start start 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.851+0000 7f6796321640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f67901059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.851+0000 7f6796321640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790105f90 con 0x7f67901055c0 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.851+0000 7f678ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f67901059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:52.555 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.852+0000 7f678ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f67901059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48718/0 (socket says 172.21.15.103:48718) 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.852+0000 7f678ffff640 1 -- 172.21.15.103:0/2461303554 learned_addr learned my addr 172.21.15.103:0/2461303554 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.852+0000 7f678ffff640 1 -- 172.21.15.103:0/2461303554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67901067c0 con 0x7f67901055c0 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.852+0000 7f678ffff640 1 --2- 172.21.15.103:0/2461303554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f67901059c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6780009820 tx=0x7f678002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81143771a8396b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f678effd640 1 -- 172.21.15.103:0/2461303554 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f678002ad40 con 0x7f67901055c0 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f678effd640 1 -- 172.21.15.103:0/2461303554 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f67800328c0 con 0x7f67901055c0 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f678effd640 1 -- 172.21.15.103:0/2461303554 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67800307f0 con 0x7f67901055c0 2024-09-17T00:57:52.556 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 -- 172.21.15.103:0/2461303554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 msgr2=0x7f67901059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:52.557 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 --2- 172.21.15.103:0/2461303554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f67901059c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6780009820 tx=0x7f678002a270 comp rx=0 tx=0).stop 2024-09-17T00:57:52.557 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 -- 172.21.15.103:0/2461303554 shutdown_connections 2024-09-17T00:57:52.557 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 --2- 172.21.15.103:0/2461303554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f67901059c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:52.557 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 -- 172.21.15.103:0/2461303554 >> 172.21.15.103:0/2461303554 conn(0x7f6790100d30 msgr2=0x7f6790103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:52.557 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 -- 172.21.15.103:0/2461303554 shutdown_connections 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.853+0000 7f6796321640 1 -- 172.21.15.103:0/2461303554 wait complete. 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f6796321640 1 Processor -- start 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f6796321640 1 -- start start 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f6796321640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f6790199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f6796321640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790199850 con 0x7f67901055c0 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f678ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f6790199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f678ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f6790199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48730/0 (socket says 172.21.15.103:48730) 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.854+0000 7f678ffff640 1 -- 172.21.15.103:0/2923747145 learned_addr learned my addr 172.21.15.103:0/2923747145 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f678ffff640 1 -- 172.21.15.103:0/2923747145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800094d0 con 0x7f67901055c0 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f678ffff640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f6790199310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67800303a0 tx=0x7f6780032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6780030cc0 con 0x7f67901055c0 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6780030e20 con 0x7f67901055c0 2024-09-17T00:57:52.558 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6790199a50 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f678003c620 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.855+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6790199e70 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.856+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f678003c860 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.856+0000 7f678d7fa640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f6778038600 0x7f677803aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.856+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f678006bb30 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.856+0000 7f678f7fe640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f6778038600 0x7f677803aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.856+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67901059c0 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.857+0000 7f678f7fe640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f6778038600 0x7f677803aac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f67840098c0 tx=0x7f6784006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:51.861+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f678003b520 con 0x7f67901055c0 2024-09-17T00:57:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.021+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f679019c7d0 con 0x7f67901055c0 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.022+0000 7f678d7fa640 1 -- 172.21.15.103:0/2923747145 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f6780056020 con 0x7f67901055c0 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f6778038600 msgr2=0x7f677803aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f6778038600 0x7f677803aac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f67840098c0 tx=0x7f6784006db0 comp rx=0 tx=0).stop 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 msgr2=0x7f6790199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f6790199310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67800303a0 tx=0x7f6780032c60 comp rx=0 tx=0).stop 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 shutdown_connections 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f6778038600 0x7f677803aac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 --2- 172.21.15.103:0/2923747145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67901055c0 0x7f6790199310 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 >> 172.21.15.103:0/2923747145 conn(0x7f6790100d30 msgr2=0x7f6790101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 shutdown_connections 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:52.024+0000 7f6796321640 1 -- 172.21.15.103:0/2923747145 wait complete. 2024-09-17T00:57:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling cephadm module... 2024-09-17T00:57:52.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:52 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2923747145' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T00:57:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:55 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2912665370' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T00:57:57.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:56 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2912665370' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T00:57:57.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:57:56 smithi103 ceph-mon[28156]: mgrmap e5: smithi103.efjaur(active, since 7s) 2024-09-17T00:58:00.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: Active manager daemon smithi103.efjaur restarted 2024-09-17T00:58:00.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: Activating manager daemon smithi103.efjaur 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: mgrmap e6: smithi103.efjaur(active, starting, since 0.00334407s) 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: Manager daemon smithi103.efjaur is now available 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:00.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:00.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:00.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:00.932 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:00 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:01 smithi103 ceph-mon[28156]: Found migration_current of "None". Setting to last migration. 2024-09-17T00:58:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:01 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:01 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:01 smithi103 ceph-mon[28156]: mgrmap e7: smithi103.efjaur(active, since 1.0052s) 2024-09-17T00:58:02.269 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.587+0000 7f114b52c640 1 Processor -- start 2024-09-17T00:58:02.269 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.587+0000 7f114b52c640 1 -- start start 2024-09-17T00:58:02.269 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.588+0000 7f114b52c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f1144108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.588+0000 7f114b52c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144079ea0 con 0x7f1144106050 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.588+0000 7f11492c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f1144108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.588+0000 7f11492c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f1144108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41012/0 (socket says 172.21.15.103:41012) 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.588+0000 7f11492c8640 1 -- 172.21.15.103:0/797691008 learned_addr learned my addr 172.21.15.103:0/797691008 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.588+0000 7f11492c8640 1 -- 172.21.15.103:0/797691008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144108980 con 0x7f1144106050 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.589+0000 7f11492c8640 1 --2- 172.21.15.103:0/797691008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f1144108440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f113c009820 tx=0x7f113c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01e2fcc1b329aef server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.589+0000 7f1143fff640 1 -- 172.21.15.103:0/797691008 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f113c02ad40 con 0x7f1144106050 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.589+0000 7f1143fff640 1 -- 172.21.15.103:0/797691008 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f113c0328c0 con 0x7f1144106050 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.589+0000 7f1143fff640 1 -- 172.21.15.103:0/797691008 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f113c0307f0 con 0x7f1144106050 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 -- 172.21.15.103:0/797691008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 msgr2=0x7f1144108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 --2- 172.21.15.103:0/797691008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f1144108440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f113c009820 tx=0x7f113c02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 -- 172.21.15.103:0/797691008 shutdown_connections 2024-09-17T00:58:02.270 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 --2- 172.21.15.103:0/797691008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f1144108440 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 -- 172.21.15.103:0/797691008 >> 172.21.15.103:0/797691008 conn(0x7f11440ffc50 msgr2=0x7f11441020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 -- 172.21.15.103:0/797691008 shutdown_connections 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 -- 172.21.15.103:0/797691008 wait complete. 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 Processor -- start 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.590+0000 7f114b52c640 1 -- start start 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f114b52c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f11441058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f114b52c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144105e10 con 0x7f1144106050 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11492c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f11441058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11492c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f11441058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41024/0 (socket says 172.21.15.103:41024) 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11492c8640 1 -- 172.21.15.103:0/2912665370 learned_addr learned my addr 172.21.15.103:0/2912665370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11492c8640 1 -- 172.21.15.103:0/2912665370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0094d0 con 0x7f1144106050 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11492c8640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f11441058d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f113c030d30 tx=0x7f113c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:02.271 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f113c032c40 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f113c032da0 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1144104000 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f113c03c660 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.591+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1144104420 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.592+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f113c03c8d0 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.592+0000 7f11427fc640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f112c038600 0x7f112c03aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.592+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1144109700 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.592+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f113c06b780 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.593+0000 7f1148ac7640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f112c038600 0x7f112c03aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.593+0000 7f1148ac7640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f112c038600 0x7f112c03aac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11380098c0 tx=0x7f1138006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.597+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f113c0313a0 con 0x7f1144106050 2024-09-17T00:58:02.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.805+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f11441098f0 con 0x7f1144106050 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.858+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f113c042cc0 con 0x7f1144106050 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.858+0000 7f11427fc640 1 -- 172.21.15.103:0/2912665370 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f113c03db00 con 0x7f1144106050 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f112c038600 msgr2=0x7f112c03aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f112c038600 0x7f112c03aac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11380098c0 tx=0x7f1138006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 msgr2=0x7f11441058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f11441058d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f113c030d30 tx=0x7f113c030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 shutdown_connections 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:6800/2182127784,v1:172.21.15.103:6801/2182127784] conn(0x7f112c038600 0x7f112c03aac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 --2- 172.21.15.103:0/2912665370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1144106050 0x7f11441058d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 >> 172.21.15.103:0/2912665370 conn(0x7f11440ffc50 msgr2=0x7f11441007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 shutdown_connections 2024-09-17T00:58:02.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:57:55.861+0000 7f114b52c640 1 -- 172.21.15.103:0/2912665370 wait complete. 2024-09-17T00:58:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:02 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:03 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:01] ENGINE Bus STARTING 2024-09-17T00:58:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:03 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:02] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T00:58:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:03 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:02] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T00:58:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:03 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:02] ENGINE Bus STARTED 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:03 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:02] ENGINE Error in HTTPServer.serve 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T00:58:03.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-17T00:58:03.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T00:58:03.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-17T00:58:03.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T00:58:03.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-17T00:58:03.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T00:58:03.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:03 smithi103 ceph-mon[28156]: mgrmap e8: smithi103.efjaur(active, since 2s) 2024-09-17T00:58:05.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:05 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2426055886' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 8, 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "smithi103.efjaur", 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.387+0000 7fce2df49640 1 Processor -- start 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.388+0000 7fce2df49640 1 -- start start 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.388+0000 7fce2df49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce281048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:06.221 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.388+0000 7fce2df49640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28104eb0 con 0x7fce281044e0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.388+0000 7fce277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce281048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.388+0000 7fce277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce281048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36408/0 (socket says 172.21.15.103:36408) 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.388+0000 7fce277fe640 1 -- 172.21.15.103:0/868712625 learned_addr learned my addr 172.21.15.103:0/868712625 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.389+0000 7fce277fe640 1 -- 172.21.15.103:0/868712625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce281056e0 con 0x7fce281044e0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.389+0000 7fce277fe640 1 --2- 172.21.15.103:0/868712625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce281048e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fce18009820 tx=0x7fce1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562dcd1c59343ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.389+0000 7fce26ffd640 1 -- 172.21.15.103:0/868712625 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce1802ad40 con 0x7fce281044e0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.389+0000 7fce26ffd640 1 -- 172.21.15.103:0/868712625 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fce180328c0 con 0x7fce281044e0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce26ffd640 1 -- 172.21.15.103:0/868712625 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce180307f0 con 0x7fce281044e0 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 -- 172.21.15.103:0/868712625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 msgr2=0x7fce281048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 --2- 172.21.15.103:0/868712625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce281048e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fce18009820 tx=0x7fce1802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 -- 172.21.15.103:0/868712625 shutdown_connections 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 --2- 172.21.15.103:0/868712625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce281048e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.222 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 -- 172.21.15.103:0/868712625 >> 172.21.15.103:0/868712625 conn(0x7fce280ffc50 msgr2=0x7fce281020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 -- 172.21.15.103:0/868712625 shutdown_connections 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.390+0000 7fce2df49640 1 -- 172.21.15.103:0/868712625 wait complete. 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce2df49640 1 Processor -- start 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce2df49640 1 -- start start 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce2df49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce2810a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce2df49640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2810a8e0 con 0x7fce281044e0 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce2810a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce2810a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36420/0 (socket says 172.21.15.103:36420) 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.391+0000 7fce277fe640 1 -- 172.21.15.103:0/2426055886 learned_addr learned my addr 172.21.15.103:0/2426055886 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce277fe640 1 -- 172.21.15.103:0/2426055886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180094d0 con 0x7fce281044e0 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce277fe640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce2810a3a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce18030d30 tx=0x7fce18030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce18032c40 con 0x7fce281044e0 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fce18032da0 con 0x7fce281044e0 2024-09-17T00:58:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce28108ad0 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce1803c570 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.392+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce28108ef0 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.393+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fce1803c830 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.393+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce281099b0 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.393+0000 7fce257fa640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fce14038650 0x7fce1403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.393+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fce1806bb10 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.393+0000 7fce1effd640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fce14038650 0x7fce1403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.394+0000 7fce1effd640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fce14038650 0x7fce1403ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce100098c0 tx=0x7fce10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.398+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fce1803bd10 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.604+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fce281099b0 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.605+0000 7fce257fa640 1 -- 172.21.15.103:0/2426055886 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v8) v1 ==== 56+0+103 (secure 0 0 0) 0x7fce1803bb30 con 0x7fce281044e0 2024-09-17T00:58:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fce14038650 msgr2=0x7fce1403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fce14038650 0x7fce1403ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce100098c0 tx=0x7fce10006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 msgr2=0x7fce2810a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce2810a3a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce18030d30 tx=0x7fce18030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 shutdown_connections 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fce14038650 0x7fce1403ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 --2- 172.21.15.103:0/2426055886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce281044e0 0x7fce2810a3a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 >> 172.21.15.103:0/2426055886 conn(0x7fce280ffc50 msgr2=0x7fce281003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 shutdown_connections 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:05.607+0000 7fce2df49640 1 -- 172.21.15.103:0/2426055886 wait complete. 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-09-17T00:58:06.225 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 8... 2024-09-17T00:58:07.303 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:06 smithi103 ceph-mon[28156]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T00:58:07.303 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:06 smithi103 ceph-mon[28156]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T00:58:07.311 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:58:07.311 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-17T00:58:07.311 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T00:58:07.311 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:58:07.311 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f09375f6640 1 Processor -- start 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f09375f6640 1 -- start start 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f09375f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f09301042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f09375f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0930079e00 con 0x7f0930103ee0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f0935392640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f09301042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f0935392640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f09301042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36432/0 (socket says 172.21.15.103:36432) 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.601+0000 7f0935392640 1 -- 172.21.15.103:0/3258366999 learned_addr learned my addr 172.21.15.103:0/3258366999 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.602+0000 7f0935392640 1 -- 172.21.15.103:0/3258366999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930079f40 con 0x7f0930103ee0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.602+0000 7f0935392640 1 --2- 172.21.15.103:0/3258366999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f09301042e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f092c009820 tx=0x7f092c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fc19a11200367f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.602+0000 7f0927fff640 1 -- 172.21.15.103:0/3258366999 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092c02ad40 con 0x7f0930103ee0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.602+0000 7f0927fff640 1 -- 172.21.15.103:0/3258366999 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f092c0328c0 con 0x7f0930103ee0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.602+0000 7f0927fff640 1 -- 172.21.15.103:0/3258366999 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092c0307f0 con 0x7f0930103ee0 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 -- 172.21.15.103:0/3258366999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 msgr2=0x7f09301042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:07.312 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 --2- 172.21.15.103:0/3258366999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f09301042e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f092c009820 tx=0x7f092c02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 -- 172.21.15.103:0/3258366999 shutdown_connections 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 --2- 172.21.15.103:0/3258366999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f09301042e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 -- 172.21.15.103:0/3258366999 >> 172.21.15.103:0/3258366999 conn(0x7f09300ffc50 msgr2=0x7f09301020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 -- 172.21.15.103:0/3258366999 shutdown_connections 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.603+0000 7f09375f6640 1 -- 172.21.15.103:0/3258366999 wait complete. 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09375f6640 1 Processor -- start 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09375f6640 1 -- start start 2024-09-17T00:58:07.313 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09375f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f093019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09375f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093019b9d0 con 0x7f0930103ee0 2024-09-17T00:58:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f0935392640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f093019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f0935392640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f093019b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36436/0 (socket says 172.21.15.103:36436) 2024-09-17T00:58:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f0935392640 1 -- 172.21.15.103:0/2005553541 learned_addr learned my addr 172.21.15.103:0/2005553541 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f0935392640 1 -- 172.21.15.103:0/2005553541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0094d0 con 0x7f0930103ee0 2024-09-17T00:58:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f0935392640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f093019b490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f092c009940 tx=0x7f092c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:07.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092c041070 con 0x7f0930103ee0 2024-09-17T00:58:07.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f092c030cc0 con 0x7f0930103ee0 2024-09-17T00:58:07.315 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093019bbd0 con 0x7f0930103ee0 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.604+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092c03c620 con 0x7f0930103ee0 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.605+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093019bff0 con 0x7f0930103ee0 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.605+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f092c03c780 con 0x7f0930103ee0 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.605+0000 7f09267fc640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f091c0386a0 0x7f091c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.605+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f091c03b270 con 0x7f091c0386a0 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.606+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f092c06b750 con 0x7f0930103ee0 2024-09-17T00:58:07.316 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.606+0000 7f0934b91640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f091c0386a0 0x7f091c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.606+0000 7f0934b91640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f091c0386a0 0x7f091c03ab60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09200098c0 tx=0x7f0920006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.606+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f091c03b270 con 0x7f091c0386a0 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.611+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0930105d60 con 0x7f091c0386a0 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09267fc640 1 -- 172.21.15.103:0/2005553541 <== mgr.14118 v2:172.21.15.103:6800/1190379096 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0930105d60 con 0x7f091c0386a0 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f091c0386a0 msgr2=0x7f091c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f091c0386a0 0x7f091c03ab60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09200098c0 tx=0x7f0920006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 msgr2=0x7f093019b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f093019b490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f092c009940 tx=0x7f092c032c60 comp rx=0 tx=0).stop 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 shutdown_connections 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f091c0386a0 0x7f091c03ab60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 --2- 172.21.15.103:0/2005553541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0930103ee0 0x7f093019b490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 >> 172.21.15.103:0/2005553541 conn(0x7f09300ffc50 msgr2=0x7f093018fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:07.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 shutdown_connections 2024-09-17T00:58:07.318 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:06.612+0000 7f09375f6640 1 -- 172.21.15.103:0/2005553541 wait complete. 2024-09-17T00:58:07.318 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 8 is available 2024-09-17T00:58:07.318 INFO:teuthology.orchestra.run.smithi103.stdout:Setting orchestrator backend to cephadm... 2024-09-17T00:58:08.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.670+0000 7f37c2bf0640 1 Processor -- start 2024-09-17T00:58:08.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.670+0000 7f37c2bf0640 1 -- start start 2024-09-17T00:58:08.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.671+0000 7f37c2bf0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:08.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.671+0000 7f37c2bf0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1064a0 con 0x7f37bc105ad0 2024-09-17T00:58:08.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.671+0000 7f37c098c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:08.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.671+0000 7f37c098c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36452/0 (socket says 172.21.15.103:36452) 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.671+0000 7f37c098c640 1 -- 172.21.15.103:0/1383127889 learned_addr learned my addr 172.21.15.103:0/1383127889 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.671+0000 7f37c098c640 1 -- 172.21.15.103:0/1383127889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc1065e0 con 0x7f37bc105ad0 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c098c640 1 --2- 172.21.15.103:0/1383127889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc105ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009820 tx=0x7f37b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac679888d92c7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37bb7fe640 1 -- 172.21.15.103:0/1383127889 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37b002ad40 con 0x7f37bc105ad0 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37bb7fe640 1 -- 172.21.15.103:0/1383127889 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f37b00328c0 con 0x7f37bc105ad0 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37bb7fe640 1 -- 172.21.15.103:0/1383127889 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37b00307f0 con 0x7f37bc105ad0 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c2bf0640 1 -- 172.21.15.103:0/1383127889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 msgr2=0x7f37bc105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c2bf0640 1 --2- 172.21.15.103:0/1383127889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc105ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009820 tx=0x7f37b002a270 comp rx=0 tx=0).stop 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c2bf0640 1 -- 172.21.15.103:0/1383127889 shutdown_connections 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c2bf0640 1 --2- 172.21.15.103:0/1383127889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc105ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c2bf0640 1 -- 172.21.15.103:0/1383127889 >> 172.21.15.103:0/1383127889 conn(0x7f37bc0ff420 msgr2=0x7f37bc101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.672+0000 7f37c2bf0640 1 -- 172.21.15.103:0/1383127889 shutdown_connections 2024-09-17T00:58:08.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c2bf0640 1 -- 172.21.15.103:0/1383127889 wait complete. 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c2bf0640 1 Processor -- start 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c2bf0640 1 -- start start 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c2bf0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc1040f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c2bf0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc104630 con 0x7f37bc105ad0 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c098c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc1040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c098c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc1040f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36456/0 (socket says 172.21.15.103:36456) 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.673+0000 7f37c098c640 1 -- 172.21.15.103:0/4161748555 learned_addr learned my addr 172.21.15.103:0/4161748555 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37c098c640 1 -- 172.21.15.103:0/4161748555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00094d0 con 0x7f37bc105ad0 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37c098c640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc1040f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f37b0030d30 tx=0x7f37b0030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37b0032c40 con 0x7f37bc105ad0 2024-09-17T00:58:08.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f37b0032da0 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc19c030 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37b003c420 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.674+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc19c450 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.675+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f37b003d480 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.675+0000 7f37b9ffb640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f37ac038650 0x7f37ac03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.675+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc1053b0 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.675+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f37b006b8a0 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.675+0000 7f37bbfff640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f37ac038650 0x7f37ac03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.676+0000 7f37bbfff640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f37ac038650 0x7f37ac03ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098c0 tx=0x7f37a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.680+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37b003c6e0 con 0x7f37bc105ad0 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.855+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f37bc1006f0 con 0x7f37ac038650 2024-09-17T00:58:08.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.863+0000 7f37b9ffb640 1 -- 172.21.15.103:0/4161748555 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f37bc1006f0 con 0x7f37ac038650 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f37ac038650 msgr2=0x7f37ac03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f37ac038650 0x7f37ac03ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098c0 tx=0x7f37a8006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 msgr2=0x7f37bc1040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc1040f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f37b0030d30 tx=0x7f37b0030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 shutdown_connections 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f37ac038650 0x7f37ac03ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 --2- 172.21.15.103:0/4161748555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37bc105ad0 0x7f37bc1040f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 >> 172.21.15.103:0/4161748555 conn(0x7f37bc0ff420 msgr2=0x7f37bc0fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 shutdown_connections 2024-09-17T00:58:08.346 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:07.865+0000 7f37c2bf0640 1 -- 172.21.15.103:0/4161748555 wait complete. 2024-09-17T00:58:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:08 smithi103 ceph-mon[28156]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:08 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:08 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:09.518 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T00:58:09.518 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.764+0000 7fda13667640 1 Processor -- start 2024-09-17T00:58:09.518 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda13667640 1 -- start start 2024-09-17T00:58:09.518 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda13667640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:09.519 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda13667640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c105f90 con 0x7fda0c1055c0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda11403640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda11403640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36464/0 (socket says 172.21.15.103:36464) 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda11403640 1 -- 172.21.15.103:0/2591125624 learned_addr learned my addr 172.21.15.103:0/2591125624 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.765+0000 7fda11403640 1 -- 172.21.15.103:0/2591125624 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c1067c0 con 0x7fda0c1055c0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.766+0000 7fda11403640 1 --2- 172.21.15.103:0/2591125624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c1059c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda08009820 tx=0x7fda0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7594e3a32dc5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.766+0000 7fda03fff640 1 -- 172.21.15.103:0/2591125624 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0802ad40 con 0x7fda0c1055c0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.766+0000 7fda03fff640 1 -- 172.21.15.103:0/2591125624 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fda080328c0 con 0x7fda0c1055c0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.766+0000 7fda03fff640 1 -- 172.21.15.103:0/2591125624 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda080307f0 con 0x7fda0c1055c0 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 -- 172.21.15.103:0/2591125624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 msgr2=0x7fda0c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 --2- 172.21.15.103:0/2591125624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c1059c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda08009820 tx=0x7fda0802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 -- 172.21.15.103:0/2591125624 shutdown_connections 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 --2- 172.21.15.103:0/2591125624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c1059c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 -- 172.21.15.103:0/2591125624 >> 172.21.15.103:0/2591125624 conn(0x7fda0c100d30 msgr2=0x7fda0c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 -- 172.21.15.103:0/2591125624 shutdown_connections 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.767+0000 7fda13667640 1 -- 172.21.15.103:0/2591125624 wait complete. 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda13667640 1 Processor -- start 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda13667640 1 -- start start 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda13667640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda13667640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c199850 con 0x7fda0c1055c0 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda11403640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda11403640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36480/0 (socket says 172.21.15.103:36480) 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda11403640 1 -- 172.21.15.103:0/4134945287 learned_addr learned my addr 172.21.15.103:0/4134945287 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:09.521 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda11403640 1 -- 172.21.15.103:0/4134945287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080094d0 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda11403640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c199310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda08030d30 tx=0x7fda08030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda08032c40 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fda08032da0 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.768+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c199a50 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.769+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0803c570 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.769+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c199e70 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.769+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fda0803da90 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.769+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c1099f0 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.770+0000 7fda027fc640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fd9f80386a0 0x7fd9f803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.770+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fda0806b9e0 con 0x7fda0c1055c0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.770+0000 7fda10c02640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fd9f80386a0 0x7fd9f803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.770+0000 7fda10c02640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fd9f80386a0 0x7fd9f803ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0098c0 tx=0x7fd9fc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:09.522 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.774+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda08031790 con 0x7fda0c1055c0 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.939+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fda0c102030 con 0x7fd9f80386a0 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.939+0000 7fda027fc640 1 -- 172.21.15.103:0/4134945287 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fda0c102030 con 0x7fd9f80386a0 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fd9f80386a0 msgr2=0x7fd9f803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fd9f80386a0 0x7fd9f803ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0098c0 tx=0x7fd9fc006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 msgr2=0x7fda0c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c199310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda08030d30 tx=0x7fda08030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 shutdown_connections 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fd9f80386a0 0x7fd9f803ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.941+0000 7fda13667640 1 --2- 172.21.15.103:0/4134945287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0c1055c0 0x7fda0c199310 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.942+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 >> 172.21.15.103:0/4134945287 conn(0x7fda0c100d30 msgr2=0x7fda0c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.942+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 shutdown_connections 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:08.942+0000 7fda13667640 1 -- 172.21.15.103:0/4134945287 wait complete. 2024-09-17T00:58:09.523 INFO:teuthology.orchestra.run.smithi103.stdout:Generating ssh key... 2024-09-17T00:58:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:09 smithi103 ceph-mon[28156]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:10.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.937+0000 7f8733586640 1 Processor -- start 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8733586640 1 -- start start 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8733586640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8733586640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c105f90 con 0x7f872c1055c0 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8731322640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8731322640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36482/0 (socket says 172.21.15.103:36482) 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8731322640 1 -- 172.21.15.103:0/3353641677 learned_addr learned my addr 172.21.15.103:0/3353641677 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.938+0000 7f8731322640 1 -- 172.21.15.103:0/3353641677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c1067c0 con 0x7f872c1055c0 2024-09-17T00:58:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.939+0000 7f8731322640 1 --2- 172.21.15.103:0/3353641677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c1059c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8724009820 tx=0x7f872402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ac68767b4d8ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.939+0000 7f872bfff640 1 -- 172.21.15.103:0/3353641677 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f872402ad40 con 0x7f872c1055c0 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.939+0000 7f872bfff640 1 -- 172.21.15.103:0/3353641677 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f87240328c0 con 0x7f872c1055c0 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.939+0000 7f872bfff640 1 -- 172.21.15.103:0/3353641677 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87240307f0 con 0x7f872c1055c0 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 -- 172.21.15.103:0/3353641677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 msgr2=0x7f872c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 --2- 172.21.15.103:0/3353641677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c1059c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8724009820 tx=0x7f872402a270 comp rx=0 tx=0).stop 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 -- 172.21.15.103:0/3353641677 shutdown_connections 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 --2- 172.21.15.103:0/3353641677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c1059c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 -- 172.21.15.103:0/3353641677 >> 172.21.15.103:0/3353641677 conn(0x7f872c100d30 msgr2=0x7f872c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 -- 172.21.15.103:0/3353641677 shutdown_connections 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 -- 172.21.15.103:0/3353641677 wait complete. 2024-09-17T00:58:10.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.940+0000 7f8733586640 1 Processor -- start 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8733586640 1 -- start start 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8733586640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8733586640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c199850 con 0x7f872c1055c0 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8731322640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8731322640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36494/0 (socket says 172.21.15.103:36494) 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8731322640 1 -- 172.21.15.103:0/1070331139 learned_addr learned my addr 172.21.15.103:0/1070331139 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8731322640 1 -- 172.21.15.103:0/1070331139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240094d0 con 0x7f872c1055c0 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8731322640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c199310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87240303a0 tx=0x7f8724032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8724030cc0 con 0x7f872c1055c0 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f8724030e20 con 0x7f872c1055c0 2024-09-17T00:58:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c199a50 con 0x7f872c1055c0 2024-09-17T00:58:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.941+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f872403c620 con 0x7f872c1055c0 2024-09-17T00:58:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.942+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c199e70 con 0x7f872c1055c0 2024-09-17T00:58:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.942+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f872403c850 con 0x7f872c1055c0 2024-09-17T00:58:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.942+0000 7f872a7fc640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f87140386a0 0x7f871403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.942+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f872406b9c0 con 0x7f872c1055c0 2024-09-17T00:58:10.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.943+0000 7f8730b21640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f87140386a0 0x7f871403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.943+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c1059c0 con 0x7f872c1055c0 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.943+0000 7f8730b21640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f87140386a0 0x7f871403ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f872000ad30 tx=0x7f87200093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:09.947+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f872403bda0 con 0x7f872c1055c0 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.110+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f872c102030 con 0x7f87140386a0 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.188+0000 7f872a7fc640 1 -- 172.21.15.103:0/1070331139 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f872c102030 con 0x7f87140386a0 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f87140386a0 msgr2=0x7f871403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f87140386a0 0x7f871403ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f872000ad30 tx=0x7f87200093f0 comp rx=0 tx=0).stop 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 msgr2=0x7f872c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c199310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87240303a0 tx=0x7f8724032c60 comp rx=0 tx=0).stop 2024-09-17T00:58:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 shutdown_connections 2024-09-17T00:58:10.771 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f87140386a0 0x7f871403ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:10.771 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 --2- 172.21.15.103:0/1070331139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c1055c0 0x7f872c199310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:10.771 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 >> 172.21.15.103:0/1070331139 conn(0x7f872c100d30 msgr2=0x7f872c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:10.771 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 shutdown_connections 2024-09-17T00:58:10.771 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:10.190+0000 7f8733586640 1 -- 172.21.15.103:0/1070331139 wait complete. 2024-09-17T00:58:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:11 smithi103 ceph-mon[28156]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:11 smithi103 ceph-mon[28156]: Generating ssh key... 2024-09-17T00:58:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:11 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:11 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoVGTpePbwleqO6oc1CGU3OKL7Ts01MOCeNWVr+/sTnGATm+QC0xTvg3mSpp3asYaZwIK/Q+v7dHBJWZWsA+u0iT4rizX6ijUJReddWa57UKYfb5TVSRc3dpzboEKbY1krrB83vzPrKjDlyIb6R+G2CpIc1fJEUbeoLzTnTwf8TxIGvZ14pmLavLS3a6Drga8pduJXdjXBGh69hsoCWA+yP7Yv8JBZGdHtcVHOnaxFOMAWPuw3RwHQjsfafQ2JG37rPEsiPww+6Rwz2wmuiAs5v0DPRBJpPnLml+EZV14YkWfCrbgCu3Ej+S0HbrwyYwj7QVWDkF5vsbK0EC4RKznRj2RdK5fBd1YFWZ2pmSKH1+BGd36BniTHb10tV08bMJcD0XiP8muLgXS241rlIY8fbtCZD6vNyDek2+XmTVCoPEBH65Jk8YwdHiL6yY5Er2Phqc+04faD/0Ejm0HnMrKYHUhqS3SxCpmDbfuJSmyF8vcJk1FjTa6Eff73N/DHdTk= ceph-b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52aaadb640 1 Processor -- start 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52aaadb640 1 -- start start 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52aaadb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52aaadb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a407a8a0 con 0x7f52a407be70 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52a8877640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52a8877640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36508/0 (socket says 172.21.15.103:36508) 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52a8877640 1 -- 172.21.15.103:0/1447871705 learned_addr learned my addr 172.21.15.103:0/1447871705 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.086+0000 7f52a8877640 1 -- 172.21.15.103:0/1447871705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a407a9e0 con 0x7f52a407be70 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.087+0000 7f52a8877640 1 --2- 172.21.15.103:0/1447871705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a407a2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5298009820 tx=0x7f529802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803f896c15b24c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.087+0000 7f52a37fe640 1 -- 172.21.15.103:0/1447871705 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f529802ad40 con 0x7f52a407be70 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.087+0000 7f52a37fe640 1 -- 172.21.15.103:0/1447871705 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f52980328c0 con 0x7f52a407be70 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.087+0000 7f52a37fe640 1 -- 172.21.15.103:0/1447871705 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52980307f0 con 0x7f52a407be70 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 -- 172.21.15.103:0/1447871705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 msgr2=0x7f52a407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 --2- 172.21.15.103:0/1447871705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a407a2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5298009820 tx=0x7f529802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 -- 172.21.15.103:0/1447871705 shutdown_connections 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 --2- 172.21.15.103:0/1447871705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a407a2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 -- 172.21.15.103:0/1447871705 >> 172.21.15.103:0/1447871705 conn(0x7f52a4100d80 msgr2=0x7f52a41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:11.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 -- 172.21.15.103:0/1447871705 shutdown_connections 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 -- 172.21.15.103:0/1447871705 wait complete. 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.088+0000 7f52aaadb640 1 Processor -- start 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52aaadb640 1 -- start start 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52aaadb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52aaadb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a419ba20 con 0x7f52a407be70 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a8877640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a8877640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36522/0 (socket says 172.21.15.103:36522) 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a8877640 1 -- 172.21.15.103:0/4051831648 learned_addr learned my addr 172.21.15.103:0/4051831648 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a8877640 1 -- 172.21.15.103:0/4051831648 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980094d0 con 0x7f52a407be70 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a8877640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a419b4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5298030d30 tx=0x7f5298030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5298032c40 con 0x7f52a407be70 2024-09-17T00:58:11.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5298032da0 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f529803c660 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.089+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a419bc20 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.090+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a419c040 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.090+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f529803db00 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.090+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a410b940 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.090+0000 7f52a1ffb640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f52940386a0 0x7f529403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.091+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f529806b790 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.091+0000 7f52a3fff640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f52940386a0 0x7f529403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.091+0000 7f52a3fff640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f52940386a0 0x7f529403ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f52900098c0 tx=0x7f5290006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.095+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f529803cb40 con 0x7f52a407be70 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.255+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f52a4102040 con 0x7f52940386a0 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.256+0000 7f52a1ffb640 1 -- 172.21.15.103:0/4051831648 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f52a4102040 con 0x7f52940386a0 2024-09-17T00:58:11.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f52940386a0 msgr2=0x7f529403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f52940386a0 0x7f529403ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f52900098c0 tx=0x7f5290006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 msgr2=0x7f52a419b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a419b4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5298030d30 tx=0x7f5298030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 shutdown_connections 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f52940386a0 0x7f529403ab60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 --2- 172.21.15.103:0/4051831648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52a407be70 0x7f52a419b4e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 >> 172.21.15.103:0/4051831648 conn(0x7f52a4100d80 msgr2=0x7f52a4101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 shutdown_connections 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:11.258+0000 7f52aaadb640 1 -- 172.21.15.103:0/4051831648 wait complete. 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T00:58:11.801 INFO:teuthology.orchestra.run.smithi103.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T00:58:11.802 INFO:teuthology.orchestra.run.smithi103.stdout:Adding host smithi103... 2024-09-17T00:58:12.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:12 smithi103 ceph-mon[28156]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:13 smithi103 ceph-mon[28156]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:14.458 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:14 smithi103 ceph-mon[28156]: Deploying cephadm binary to smithi103 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Added host 'smithi103' with addr '172.21.15.103' 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba79a5640 1 Processor -- start 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba79a5640 1 -- start start 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba79a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba007a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba79a5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba007a7f0 con 0x7f6ba007be50 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba5741640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba007a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:15.580 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba5741640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba007a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36526/0 (socket says 172.21.15.103:36526) 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba5741640 1 -- 172.21.15.103:0/1516190454 learned_addr learned my addr 172.21.15.103:0/1516190454 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.164+0000 7f6ba5741640 1 -- 172.21.15.103:0/1516190454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba007a930 con 0x7f6ba007be50 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.165+0000 7f6ba5741640 1 --2- 172.21.15.103:0/1516190454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba007a2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009820 tx=0x7f6b9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d20825a0e1df45 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.165+0000 7f6b97fff640 1 -- 172.21.15.103:0/1516190454 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b9c02ad40 con 0x7f6ba007be50 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.165+0000 7f6b97fff640 1 -- 172.21.15.103:0/1516190454 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6b9c0328c0 con 0x7f6ba007be50 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.165+0000 7f6b97fff640 1 -- 172.21.15.103:0/1516190454 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b9c0307f0 con 0x7f6ba007be50 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1516190454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 msgr2=0x7f6ba007a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 --2- 172.21.15.103:0/1516190454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba007a2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009820 tx=0x7f6b9c02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1516190454 shutdown_connections 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 --2- 172.21.15.103:0/1516190454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba007a2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1516190454 >> 172.21.15.103:0/1516190454 conn(0x7f6ba0100d30 msgr2=0x7f6ba0103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1516190454 shutdown_connections 2024-09-17T00:58:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.166+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1516190454 wait complete. 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba79a5640 1 Processor -- start 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba79a5640 1 -- start start 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba79a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba79a5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba019ba10 con 0x7f6ba007be50 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba5741640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba5741640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba019b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36530/0 (socket says 172.21.15.103:36530) 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba5741640 1 -- 172.21.15.103:0/1986914572 learned_addr learned my addr 172.21.15.103:0/1986914572 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba5741640 1 -- 172.21.15.103:0/1986914572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0094d0 con 0x7f6ba007be50 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6ba5741640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba019b4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c030d30 tx=0x7f6b9c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.167+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b9c032c40 con 0x7f6ba007be50 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.168+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6b9c032da0 con 0x7f6ba007be50 2024-09-17T00:58:15.582 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.168+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba019bc10 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.168+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b9c03c660 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.168+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba019c030 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.168+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f6b9c03d480 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.168+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba010b900 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.169+0000 7f6b967fc640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6b8c038650 0x7f6b8c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.169+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6b9c06b7a0 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.169+0000 7f6ba4f40640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6b8c038650 0x7f6b8c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.169+0000 7f6ba4f40640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6b8c038650 0x7f6b8c03ab10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b900098c0 tx=0x7f6b90006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.173+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6b9c03c8d0 con 0x7f6ba007be50 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:12.339+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ba0102040 con 0x7f6b8c038650 2024-09-17T00:58:15.583 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.970+0000 7f6b967fc640 1 -- 172.21.15.103:0/1986914572 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6ba0102040 con 0x7f6b8c038650 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6b8c038650 msgr2=0x7f6b8c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6b8c038650 0x7f6b8c03ab10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b900098c0 tx=0x7f6b90006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 msgr2=0x7f6ba019b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba019b4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c030d30 tx=0x7f6b9c030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 shutdown_connections 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6b8c038650 0x7f6b8c03ab10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 --2- 172.21.15.103:0/1986914572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ba007be50 0x7f6ba019b4d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 >> 172.21.15.103:0/1986914572 conn(0x7f6ba0100d30 msgr2=0x7f6ba0101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 shutdown_connections 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:14.973+0000 7f6ba79a5640 1 -- 172.21.15.103:0/1986914572 wait complete. 2024-09-17T00:58:15.584 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying mon service with default placement... 2024-09-17T00:58:16.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:15 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:16.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:15 smithi103 ceph-mon[28156]: Added host smithi103 2024-09-17T00:58:16.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:15 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.955+0000 7f699caa7640 1 Processor -- start 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.955+0000 7f699caa7640 1 -- start start 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.956+0000 7f699caa7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f69981059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.956+0000 7f699caa7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6998105f90 con 0x7f69981055c0 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.956+0000 7f699659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f69981059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:16.764 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.956+0000 7f699659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f69981059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38142/0 (socket says 172.21.15.103:38142) 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.956+0000 7f699659c640 1 -- 172.21.15.103:0/1973197949 learned_addr learned my addr 172.21.15.103:0/1973197949 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.956+0000 7f699659c640 1 -- 172.21.15.103:0/1973197949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69981067c0 con 0x7f69981055c0 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.957+0000 7f699659c640 1 --2- 172.21.15.103:0/1973197949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f69981059c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6988009820 tx=0x7f698802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77383f453ea49d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.957+0000 7f699559a640 1 -- 172.21.15.103:0/1973197949 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f698802ad40 con 0x7f69981055c0 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.957+0000 7f699559a640 1 -- 172.21.15.103:0/1973197949 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f69880328c0 con 0x7f69981055c0 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.957+0000 7f699559a640 1 -- 172.21.15.103:0/1973197949 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69880307f0 con 0x7f69981055c0 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 -- 172.21.15.103:0/1973197949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 msgr2=0x7f69981059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 --2- 172.21.15.103:0/1973197949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f69981059c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6988009820 tx=0x7f698802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 -- 172.21.15.103:0/1973197949 shutdown_connections 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 --2- 172.21.15.103:0/1973197949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f69981059c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 -- 172.21.15.103:0/1973197949 >> 172.21.15.103:0/1973197949 conn(0x7f6998100d30 msgr2=0x7f6998103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:16.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 -- 172.21.15.103:0/1973197949 shutdown_connections 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 -- 172.21.15.103:0/1973197949 wait complete. 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.958+0000 7f699caa7640 1 Processor -- start 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699caa7640 1 -- start start 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699caa7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f699807bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699caa7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699807c0a0 con 0x7f69981055c0 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f699807bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f699807bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38148/0 (socket says 172.21.15.103:38148) 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699659c640 1 -- 172.21.15.103:0/923953189 learned_addr learned my addr 172.21.15.103:0/923953189 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699659c640 1 -- 172.21.15.103:0/923953189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69880094d0 con 0x7f69981055c0 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699659c640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f699807bb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6988030d30 tx=0x7f6988030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6988032c40 con 0x7f69981055c0 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6988032da0 con 0x7f69981055c0 2024-09-17T00:58:16.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699807a290 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f698803c570 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.959+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699807a6b0 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.960+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f698803d480 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.960+0000 7f69877fe640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6980038650 0x7f698003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.960+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69981059c0 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.960+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f698806b9b0 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.961+0000 7f6995d9b640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6980038650 0x7f698003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.961+0000 7f6995d9b640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6980038650 0x7f698003ab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f698c0098c0 tx=0x7f698c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:15.965+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f69880313a0 con 0x7f69981055c0 2024-09-17T00:58:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.141+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f699807ad40 con 0x7f6980038650 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.146+0000 7f69877fe640 1 -- 172.21.15.103:0/923953189 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f699807ad40 con 0x7f6980038650 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6980038650 msgr2=0x7f698003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6980038650 0x7f698003ab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f698c0098c0 tx=0x7f698c006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 msgr2=0x7f699807bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f699807bb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6988030d30 tx=0x7f6988030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 shutdown_connections 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f6980038650 0x7f698003ab10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 --2- 172.21.15.103:0/923953189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69981055c0 0x7f699807bb60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 >> 172.21.15.103:0/923953189 conn(0x7f6998100d30 msgr2=0x7f6998101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 shutdown_connections 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:16.148+0000 7f699caa7640 1 -- 172.21.15.103:0/923953189 wait complete. 2024-09-17T00:58:16.768 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying mgr service with default placement... 2024-09-17T00:58:17.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:17 smithi103 ceph-mon[28156]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:17.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:17 smithi103 ceph-mon[28156]: Saving service mon spec with placement count:5 2024-09-17T00:58:17.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:17 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.132+0000 7f2527bf4640 1 Processor -- start 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2527bf4640 1 -- start start 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2527bf4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520108500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2527bf4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520079de0 con 0x7f2520106110 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2525990640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2525990640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520108500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38162/0 (socket says 172.21.15.103:38162) 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2525990640 1 -- 172.21.15.103:0/2285427512 learned_addr learned my addr 172.21.15.103:0/2285427512 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.133+0000 7f2525990640 1 -- 172.21.15.103:0/2285427512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520079f20 con 0x7f2520106110 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.134+0000 7f2525990640 1 --2- 172.21.15.103:0/2285427512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520108500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2514009820 tx=0x7f251402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3f36b3ed46aaee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.134+0000 7f252498e640 1 -- 172.21.15.103:0/2285427512 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f251402ad40 con 0x7f2520106110 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.134+0000 7f252498e640 1 -- 172.21.15.103:0/2285427512 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f25140328c0 con 0x7f2520106110 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.134+0000 7f252498e640 1 -- 172.21.15.103:0/2285427512 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25140307f0 con 0x7f2520106110 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 -- 172.21.15.103:0/2285427512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 msgr2=0x7f2520108500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 --2- 172.21.15.103:0/2285427512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520108500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2514009820 tx=0x7f251402a270 comp rx=0 tx=0).stop 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 -- 172.21.15.103:0/2285427512 shutdown_connections 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 --2- 172.21.15.103:0/2285427512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520108500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 -- 172.21.15.103:0/2285427512 >> 172.21.15.103:0/2285427512 conn(0x7f25200ffc50 msgr2=0x7f25201020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 -- 172.21.15.103:0/2285427512 shutdown_connections 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.135+0000 7f2527bf4640 1 -- 172.21.15.103:0/2285427512 wait complete. 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2527bf4640 1 Processor -- start 2024-09-17T00:58:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2527bf4640 1 -- start start 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2527bf4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520105990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2527bf4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520105ed0 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2525990640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2525990640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520105990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38176/0 (socket says 172.21.15.103:38176) 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2525990640 1 -- 172.21.15.103:0/3039260375 learned_addr learned my addr 172.21.15.103:0/3039260375 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2525990640 1 -- 172.21.15.103:0/3039260375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140094d0 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.136+0000 7f2525990640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520105990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2514030d30 tx=0x7f2514030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.137+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2514032c40 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.137+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25201040c0 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.137+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2514032da0 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.137+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f251403c660 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.137+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25201044e0 con 0x7f2520106110 2024-09-17T00:58:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.137+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f251403c8d0 con 0x7f2520106110 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.138+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25201064f0 con 0x7f2520106110 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.138+0000 7f2512ffd640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f250c038650 0x7f250c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.138+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f251406b960 con 0x7f2520106110 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.138+0000 7f252518f640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f250c038650 0x7f250c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.138+0000 7f252518f640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f250c038650 0x7f250c03ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098c0 tx=0x7f251c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.142+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f25140313a0 con 0x7f2520106110 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.321+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f2520104b70 con 0x7f250c038650 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.327+0000 7f2512ffd640 1 -- 172.21.15.103:0/3039260375 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2520104b70 con 0x7f250c038650 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f250c038650 msgr2=0x7f250c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f250c038650 0x7f250c03ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098c0 tx=0x7f251c006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 msgr2=0x7f2520105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520105990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2514030d30 tx=0x7f2514030d60 comp rx=0 tx=0).stop 2024-09-17T00:58:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 shutdown_connections 2024-09-17T00:58:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f250c038650 0x7f250c03ab10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 --2- 172.21.15.103:0/3039260375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2520106110 0x7f2520105990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 >> 172.21.15.103:0/3039260375 conn(0x7f25200ffc50 msgr2=0x7f2520100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 shutdown_connections 2024-09-17T00:58:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:17.329+0000 7f2527bf4640 1 -- 172.21.15.103:0/3039260375 wait complete. 2024-09-17T00:58:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying crash service with default placement... 2024-09-17T00:58:18.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:18 smithi103 ceph-mon[28156]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:18.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:18 smithi103 ceph-mon[28156]: Saving service mgr spec with placement count:2 2024-09-17T00:58:18.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:18 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:19.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:19 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:19.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:19 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:19.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:19 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99eb00f640 1 Processor -- start 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99eb00f640 1 -- start start 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99eb00f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e41048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99eb00f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4104eb0 con 0x7f99e41044e0 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99e8dab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e41048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99e8dab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e41048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38182/0 (socket says 172.21.15.103:38182) 2024-09-17T00:58:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.876+0000 7f99e8dab640 1 -- 172.21.15.103:0/3513020503 learned_addr learned my addr 172.21.15.103:0/3513020503 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.877+0000 7f99e8dab640 1 -- 172.21.15.103:0/3513020503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e41056e0 con 0x7f99e41044e0 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.877+0000 7f99e8dab640 1 --2- 172.21.15.103:0/3513020503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e41048e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009820 tx=0x7f99d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa054b46db0fd31d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.877+0000 7f99e37fe640 1 -- 172.21.15.103:0/3513020503 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99d802ad40 con 0x7f99e41044e0 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.877+0000 7f99e37fe640 1 -- 172.21.15.103:0/3513020503 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99d8032900 con 0x7f99e41044e0 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.877+0000 7f99e37fe640 1 -- 172.21.15.103:0/3513020503 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99d8030860 con 0x7f99e41044e0 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 -- 172.21.15.103:0/3513020503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 msgr2=0x7f99e41048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 --2- 172.21.15.103:0/3513020503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e41048e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009820 tx=0x7f99d802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 -- 172.21.15.103:0/3513020503 shutdown_connections 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 --2- 172.21.15.103:0/3513020503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e41048e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 -- 172.21.15.103:0/3513020503 >> 172.21.15.103:0/3513020503 conn(0x7f99e40ffc50 msgr2=0x7f99e41020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 -- 172.21.15.103:0/3513020503 shutdown_connections 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.878+0000 7f99eb00f640 1 -- 172.21.15.103:0/3513020503 wait complete. 2024-09-17T00:58:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.879+0000 7f99eb00f640 1 Processor -- start 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.879+0000 7f99eb00f640 1 -- start start 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.879+0000 7f99eb00f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.879+0000 7f99eb00f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41998c0 con 0x7f99e41044e0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e8dab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e8dab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e4199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38188/0 (socket says 172.21.15.103:38188) 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e8dab640 1 -- 172.21.15.103:0/3492342011 learned_addr learned my addr 172.21.15.103:0/3492342011 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e8dab640 1 -- 172.21.15.103:0/3492342011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80094d0 con 0x7f99e41044e0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e8dab640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e4199380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009940 tx=0x7f99d8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99d8032c80 con 0x7f99e41044e0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e4199ac0 con 0x7f99e41044e0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99d8032de0 con 0x7f99e41044e0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99d803a720 con 0x7f99e41044e0 2024-09-17T00:58:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.880+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e4199f60 con 0x7f99e41044e0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.881+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f99d803a950 con 0x7f99e41044e0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.881+0000 7f99e1ffb640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f99d4038650 0x7f99d403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.881+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f99d806b920 con 0x7f99e41044e0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.882+0000 7f99e3fff640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f99d4038650 0x7f99d403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.882+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e41048e0 con 0x7f99e41044e0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.882+0000 7f99e3fff640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f99d4038650 0x7f99d403ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f99d00098c0 tx=0x7f99d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:18.886+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f99d8039b20 con 0x7f99e41044e0 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.095+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e402c4f0 con 0x7f99d4038650 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.102+0000 7f99e1ffb640 1 -- 172.21.15.103:0/3492342011 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f99e402c4f0 con 0x7f99d4038650 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f99d4038650 msgr2=0x7f99d403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f99d4038650 0x7f99d403ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f99d00098c0 tx=0x7f99d0006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 msgr2=0x7f99e4199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e4199380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009940 tx=0x7f99d8032670 comp rx=0 tx=0).stop 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 shutdown_connections 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f99d4038650 0x7f99d403ab10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 --2- 172.21.15.103:0/3492342011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e41044e0 0x7f99e4199380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 >> 172.21.15.103:0/3492342011 conn(0x7f99e40ffc50 msgr2=0x7f99e4100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 shutdown_connections 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:19.104+0000 7f99eb00f640 1 -- 172.21.15.103:0/3492342011 wait complete. 2024-09-17T00:58:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying ceph-exporter service with default placement... 2024-09-17T00:58:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:20 smithi103 ceph-mon[28156]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:20 smithi103 ceph-mon[28156]: Saving service crash spec with placement * 2024-09-17T00:58:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:20 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:20 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.657+0000 7fb5818e6640 1 Processor -- start 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb5818e6640 1 -- start start 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb5818e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c1084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb5818e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c079e20 con 0x7fb57c1060b0 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb57affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c1084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb57affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c1084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38204/0 (socket says 172.21.15.103:38204) 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb57affd640 1 -- 172.21.15.103:0/1755971635 learned_addr learned my addr 172.21.15.103:0/1755971635 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.658+0000 7fb57affd640 1 -- 172.21.15.103:0/1755971635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c1089e0 con 0x7fb57c1060b0 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb57affd640 1 --2- 172.21.15.103:0/1755971635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c1084a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb574009820 tx=0x7fb57402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96764c728753167a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb579ffb640 1 -- 172.21.15.103:0/1755971635 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57402ad40 con 0x7fb57c1060b0 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb579ffb640 1 -- 172.21.15.103:0/1755971635 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb574032900 con 0x7fb57c1060b0 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb579ffb640 1 -- 172.21.15.103:0/1755971635 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb574030860 con 0x7fb57c1060b0 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb5818e6640 1 -- 172.21.15.103:0/1755971635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 msgr2=0x7fb57c1084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb5818e6640 1 --2- 172.21.15.103:0/1755971635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c1084a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb574009820 tx=0x7fb57402a270 comp rx=0 tx=0).stop 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb5818e6640 1 -- 172.21.15.103:0/1755971635 shutdown_connections 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb5818e6640 1 --2- 172.21.15.103:0/1755971635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c1084a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb5818e6640 1 -- 172.21.15.103:0/1755971635 >> 172.21.15.103:0/1755971635 conn(0x7fb57c0ffc30 msgr2=0x7fb57c102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.659+0000 7fb5818e6640 1 -- 172.21.15.103:0/1755971635 shutdown_connections 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.660+0000 7fb5818e6640 1 -- 172.21.15.103:0/1755971635 wait complete. 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.660+0000 7fb5818e6640 1 Processor -- start 2024-09-17T00:58:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.660+0000 7fb5818e6640 1 -- start start 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.660+0000 7fb5818e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.660+0000 7fb5818e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1998d0 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb57affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb57affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38220/0 (socket says 172.21.15.103:38220) 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb57affd640 1 -- 172.21.15.103:0/1493434124 learned_addr learned my addr 172.21.15.103:0/1493434124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb57affd640 1 -- 172.21.15.103:0/1493434124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740094d0 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb57affd640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c199390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb574032670 tx=0x7fb5740326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb574032c80 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb574032de0 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c199ad0 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57403a720 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.661+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c199f70 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.662+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fb57403a950 con 0x7fb57c1060b0 2024-09-17T00:58:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.662+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c109790 con 0x7fb57c1060b0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.662+0000 7fb5808e4640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fb5640386a0 0x7fb56403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.662+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb57406b8b0 con 0x7fb57c1060b0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.662+0000 7fb57a7fc640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fb5640386a0 0x7fb56403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.663+0000 7fb57a7fc640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fb5640386a0 0x7fb56403ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb57000ad30 tx=0x7fb5700093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.667+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb574039d30 con 0x7fb57c1060b0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.862+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb57c100f20 con 0x7fb5640386a0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.869+0000 7fb5808e4640 1 -- 172.21.15.103:0/1493434124 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb57c100f20 con 0x7fb5640386a0 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fb5640386a0 msgr2=0x7fb56403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fb5640386a0 0x7fb56403ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb57000ad30 tx=0x7fb5700093f0 comp rx=0 tx=0).stop 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 msgr2=0x7fb57c199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c199390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb574032670 tx=0x7fb5740326a0 comp rx=0 tx=0).stop 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 shutdown_connections 2024-09-17T00:58:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fb5640386a0 0x7fb56403ab60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.871+0000 7fb5818e6640 1 --2- 172.21.15.103:0/1493434124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb57c1060b0 0x7fb57c199390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.872+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 >> 172.21.15.103:0/1493434124 conn(0x7fb57c0ffc30 msgr2=0x7fb57c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.872+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 shutdown_connections 2024-09-17T00:58:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:20.872+0000 7fb5818e6640 1 -- 172.21.15.103:0/1493434124 wait complete. 2024-09-17T00:58:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying prometheus service with default placement... 2024-09-17T00:58:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:21 smithi103 ceph-mon[28156]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:21 smithi103 ceph-mon[28156]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:21 smithi103 ceph-mon[28156]: Saving service ceph-exporter spec with placement * 2024-09-17T00:58:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:21 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-17T00:58:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.749+0000 7f9a8ac09640 1 Processor -- start 2024-09-17T00:58:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a8ac09640 1 -- start start 2024-09-17T00:58:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a8ac09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a841059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a8ac09640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84105fa0 con 0x7f9a841055d0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a889a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a841059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a889a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a841059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38228/0 (socket says 172.21.15.103:38228) 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a889a5640 1 -- 172.21.15.103:0/1111841838 learned_addr learned my addr 172.21.15.103:0/1111841838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.750+0000 7f9a889a5640 1 -- 172.21.15.103:0/1111841838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a841067d0 con 0x7f9a841055d0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.751+0000 7f9a889a5640 1 --2- 172.21.15.103:0/1111841838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a841059d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009820 tx=0x7f9a7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc2270f201cf994 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.751+0000 7f9a837fe640 1 -- 172.21.15.103:0/1111841838 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a7802ad40 con 0x7f9a841055d0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.751+0000 7f9a837fe640 1 -- 172.21.15.103:0/1111841838 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a78032900 con 0x7f9a841055d0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.751+0000 7f9a837fe640 1 -- 172.21.15.103:0/1111841838 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a78030860 con 0x7f9a841055d0 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- 172.21.15.103:0/1111841838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 msgr2=0x7f9a841059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 --2- 172.21.15.103:0/1111841838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a841059d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009820 tx=0x7f9a7802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- 172.21.15.103:0/1111841838 shutdown_connections 2024-09-17T00:58:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 --2- 172.21.15.103:0/1111841838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a841059d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- 172.21.15.103:0/1111841838 >> 172.21.15.103:0/1111841838 conn(0x7f9a84100d80 msgr2=0x7f9a841031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- 172.21.15.103:0/1111841838 shutdown_connections 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- 172.21.15.103:0/1111841838 wait complete. 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 Processor -- start 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- start start 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a8407bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.752+0000 7f9a8ac09640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8407c0a0 con 0x7f9a841055d0 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a889a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a8407bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a889a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a8407bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38238/0 (socket says 172.21.15.103:38238) 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a889a5640 1 -- 172.21.15.103:0/4020576611 learned_addr learned my addr 172.21.15.103:0/4020576611 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a889a5640 1 -- 172.21.15.103:0/4020576611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780094d0 con 0x7f9a841055d0 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a889a5640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a8407bb60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009940 tx=0x7f9a78032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a78032c80 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a78032de0 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a7803a720 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8407a290 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.753+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8407a730 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.754+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f9a7803cc30 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.754+0000 7f9a81ffb640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9a74038650 0x7f9a7403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.754+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9a7806b900 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.754+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a84109a00 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.754+0000 7f9a83fff640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9a74038650 0x7f9a7403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.755+0000 7f9a83fff640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9a74038650 0x7f9a7403ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a700098c0 tx=0x7f9a70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.759+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9a78043310 con 0x7f9a841055d0 2024-09-17T00:58:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.935+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a8407ae20 con 0x7f9a74038650 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.940+0000 7f9a81ffb640 1 -- 172.21.15.103:0/4020576611 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9a8407ae20 con 0x7f9a74038650 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9a74038650 msgr2=0x7f9a7403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9a74038650 0x7f9a7403ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a700098c0 tx=0x7f9a70006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 msgr2=0x7f9a8407bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a8407bb60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009940 tx=0x7f9a78032670 comp rx=0 tx=0).stop 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 shutdown_connections 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9a74038650 0x7f9a7403ab10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 --2- 172.21.15.103:0/4020576611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a841055d0 0x7f9a8407bb60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 >> 172.21.15.103:0/4020576611 conn(0x7f9a84100d80 msgr2=0x7f9a84101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 shutdown_connections 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:21.942+0000 7f9a8ac09640 1 -- 172.21.15.103:0/4020576611 wait complete. 2024-09-17T00:58:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying grafana service with default placement... 2024-09-17T00:58:23.148 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:22 smithi103 ceph-mon[28156]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:23.148 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:22 smithi103 ceph-mon[28156]: Saving service prometheus spec with placement count:1 2024-09-17T00:58:23.148 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:22 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:23.148 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:22 smithi103 ceph-mon[28156]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:24.531 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-17T00:58:24.531 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.425+0000 7feb3c772640 1 Processor -- start 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.425+0000 7feb3c772640 1 -- start start 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.426+0000 7feb3c772640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.426+0000 7feb3c772640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34079ea0 con 0x7feb34106050 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.426+0000 7feb3a50e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.426+0000 7feb3a50e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58226/0 (socket says 172.21.15.103:58226) 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.426+0000 7feb3a50e640 1 -- 172.21.15.103:0/4221957438 learned_addr learned my addr 172.21.15.103:0/4221957438 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.426+0000 7feb3a50e640 1 -- 172.21.15.103:0/4221957438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34108980 con 0x7feb34106050 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.427+0000 7feb3a50e640 1 --2- 172.21.15.103:0/4221957438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34108440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb24009e80 tx=0x7feb2402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5181450eb5fc42 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.427+0000 7feb3950c640 1 -- 172.21.15.103:0/4221957438 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb24031400 con 0x7feb34106050 2024-09-17T00:58:24.532 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.427+0000 7feb3950c640 1 -- 172.21.15.103:0/4221957438 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb2402d050 con 0x7feb34106050 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.427+0000 7feb3950c640 1 -- 172.21.15.103:0/4221957438 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb24007930 con 0x7feb34106050 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.427+0000 7feb3c772640 1 -- 172.21.15.103:0/4221957438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 msgr2=0x7feb34108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.427+0000 7feb3c772640 1 --2- 172.21.15.103:0/4221957438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34108440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb24009e80 tx=0x7feb2402a7a0 comp rx=0 tx=0).stop 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 -- 172.21.15.103:0/4221957438 shutdown_connections 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 --2- 172.21.15.103:0/4221957438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34108440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 -- 172.21.15.103:0/4221957438 >> 172.21.15.103:0/4221957438 conn(0x7feb340ffc50 msgr2=0x7feb341020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 -- 172.21.15.103:0/4221957438 shutdown_connections 2024-09-17T00:58:24.533 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 -- 172.21.15.103:0/4221957438 wait complete. 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 Processor -- start 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 -- start start 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.428+0000 7feb3c772640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb341998c0 con 0x7feb34106050 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3a50e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3a50e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58240/0 (socket says 172.21.15.103:58240) 2024-09-17T00:58:24.534 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3a50e640 1 -- 172.21.15.103:0/2553066961 learned_addr learned my addr 172.21.15.103:0/2553066961 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3a50e640 1 -- 172.21.15.103:0/2553066961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009b30 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3a50e640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34199380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb24009680 tx=0x7feb24031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2403a400 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb34199ac0 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb2403aa20 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb24039b60 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.429+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb34199f60 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.430+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7feb24038040 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.430+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb34109790 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.431+0000 7feb337fe640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7feb1c038650 0x7feb1c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.431+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feb2406b7c0 con 0x7feb34106050 2024-09-17T00:58:24.535 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.431+0000 7feb39d0d640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7feb1c038650 0x7feb1c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.431+0000 7feb39d0d640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7feb1c038650 0x7feb1c03ab10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb280098c0 tx=0x7feb28006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.435+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb24043780 con 0x7feb34106050 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.615+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7feb34101000 con 0x7feb1c038650 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.620+0000 7feb337fe640 1 -- 172.21.15.103:0/2553066961 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7feb34101000 con 0x7feb1c038650 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7feb1c038650 msgr2=0x7feb1c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7feb1c038650 0x7feb1c03ab10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb280098c0 tx=0x7feb28006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 msgr2=0x7feb34199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:24.536 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34199380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb24009680 tx=0x7feb24031a10 comp rx=0 tx=0).stop 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 shutdown_connections 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7feb1c038650 0x7feb1c03ab10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 --2- 172.21.15.103:0/2553066961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb34106050 0x7feb34199380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 >> 172.21.15.103:0/2553066961 conn(0x7feb340ffc50 msgr2=0x7feb341008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 shutdown_connections 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:23.622+0000 7feb3c772640 1 -- 172.21.15.103:0/2553066961 wait complete. 2024-09-17T00:58:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying node-exporter service with default placement... 2024-09-17T00:58:24.893 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:24 smithi103 ceph-mon[28156]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:24.893 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:24 smithi103 ceph-mon[28156]: Saving service grafana spec with placement count:1 2024-09-17T00:58:24.893 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:24 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:25.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:25 smithi103 ceph-mon[28156]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:25.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:25 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:25.704 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-17T00:58:25.704 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bdfece640 1 Processor -- start 2024-09-17T00:58:25.704 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bdfece640 1 -- start start 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bdfece640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd8108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bdfece640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8079ea0 con 0x7f1bd8106050 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bddc6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd8108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bddc6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd8108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58244/0 (socket says 172.21.15.103:58244) 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.895+0000 7f1bddc6a640 1 -- 172.21.15.103:0/3713532566 learned_addr learned my addr 172.21.15.103:0/3713532566 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.896+0000 7f1bddc6a640 1 -- 172.21.15.103:0/3713532566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8108980 con 0x7f1bd8106050 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.896+0000 7f1bddc6a640 1 --2- 172.21.15.103:0/3713532566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd8108440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009820 tx=0x7f1bc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc3b31e9f4014c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.896+0000 7f1bdcc68640 1 -- 172.21.15.103:0/3713532566 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bc802ad40 con 0x7f1bd8106050 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdcc68640 1 -- 172.21.15.103:0/3713532566 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1bc8032900 con 0x7f1bd8106050 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdcc68640 1 -- 172.21.15.103:0/3713532566 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bc8030860 con 0x7f1bd8106050 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 -- 172.21.15.103:0/3713532566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 msgr2=0x7f1bd8108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 --2- 172.21.15.103:0/3713532566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd8108440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009820 tx=0x7f1bc802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:25.705 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 -- 172.21.15.103:0/3713532566 shutdown_connections 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 --2- 172.21.15.103:0/3713532566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd8108440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 -- 172.21.15.103:0/3713532566 >> 172.21.15.103:0/3713532566 conn(0x7f1bd80ffc50 msgr2=0x7f1bd81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 -- 172.21.15.103:0/3713532566 shutdown_connections 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.897+0000 7f1bdfece640 1 -- 172.21.15.103:0/3713532566 wait complete. 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bdfece640 1 Processor -- start 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bdfece640 1 -- start start 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bdfece640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bdfece640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8199830 con 0x7f1bd8106050 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bddc6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bddc6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd81992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58250/0 (socket says 172.21.15.103:58250) 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bddc6a640 1 -- 172.21.15.103:0/935667182 learned_addr learned my addr 172.21.15.103:0/935667182 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.898+0000 7f1bddc6a640 1 -- 172.21.15.103:0/935667182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80094d0 con 0x7f1bd8106050 2024-09-17T00:58:25.706 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.899+0000 7f1bddc6a640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd81992f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097f0 tx=0x7f1bc8030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.899+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bc8040070 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.899+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1bc8032dd0 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.899+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bc803a790 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.899+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd8199a30 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.899+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd8199ed0 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.900+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f1bc803a8f0 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.900+0000 7f1bd6ffd640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f1bc00386a0 0x7f1bc003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.900+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8109790 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.900+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1bc806b680 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.900+0000 7f1bdd469640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f1bc00386a0 0x7f1bc003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.900+0000 7f1bdd469640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f1bc00386a0 0x7f1bc003ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00ad30 tx=0x7f1bcc0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:24.904+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1bc802fea0 con 0x7f1bd8106050 2024-09-17T00:58:25.707 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.078+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd8100f40 con 0x7f1bc00386a0 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.083+0000 7f1bd6ffd640 1 -- 172.21.15.103:0/935667182 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1bd8100f40 con 0x7f1bc00386a0 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f1bc00386a0 msgr2=0x7f1bc003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f1bc00386a0 0x7f1bc003ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00ad30 tx=0x7f1bcc0093f0 comp rx=0 tx=0).stop 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 msgr2=0x7f1bd81992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd81992f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097f0 tx=0x7f1bc8030d50 comp rx=0 tx=0).stop 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 shutdown_connections 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f1bc00386a0 0x7f1bc003ab60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 --2- 172.21.15.103:0/935667182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd8106050 0x7f1bd81992f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 >> 172.21.15.103:0/935667182 conn(0x7f1bd80ffc50 msgr2=0x7f1bd8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 shutdown_connections 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:25.085+0000 7f1bdfece640 1 -- 172.21.15.103:0/935667182 wait complete. 2024-09-17T00:58:25.708 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying alertmanager service with default placement... 2024-09-17T00:58:26.794 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-17T00:58:26.794 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.070+0000 7f60f4a2d640 1 Processor -- start 2024-09-17T00:58:26.794 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.070+0000 7f60f4a2d640 1 -- start start 2024-09-17T00:58:26.794 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.070+0000 7f60f4a2d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f01048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:26.794 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.070+0000 7f60f4a2d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f0104ea0 con 0x7f60f01044d0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.071+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f01048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.071+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f01048d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58260/0 (socket says 172.21.15.103:58260) 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.071+0000 7f60ee59c640 1 -- 172.21.15.103:0/3665103854 learned_addr learned my addr 172.21.15.103:0/3665103854 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.071+0000 7f60ee59c640 1 -- 172.21.15.103:0/3665103854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f01056d0 con 0x7f60f01044d0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60ee59c640 1 --2- 172.21.15.103:0/3665103854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f01048d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009e80 tx=0x7f60e002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800e0465b04f84bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60ed59a640 1 -- 172.21.15.103:0/3665103854 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60e0031400 con 0x7f60f01044d0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60ed59a640 1 -- 172.21.15.103:0/3665103854 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60e002d050 con 0x7f60f01044d0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60ed59a640 1 -- 172.21.15.103:0/3665103854 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60e0007930 con 0x7f60f01044d0 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 -- 172.21.15.103:0/3665103854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 msgr2=0x7f60f01048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 --2- 172.21.15.103:0/3665103854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f01048d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009e80 tx=0x7f60e002a7a0 comp rx=0 tx=0).stop 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 -- 172.21.15.103:0/3665103854 shutdown_connections 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 --2- 172.21.15.103:0/3665103854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f01048d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 -- 172.21.15.103:0/3665103854 >> 172.21.15.103:0/3665103854 conn(0x7f60f00ffcc0 msgr2=0x7f60f01020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 -- 172.21.15.103:0/3665103854 shutdown_connections 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.072+0000 7f60f4a2d640 1 -- 172.21.15.103:0/3665103854 wait complete. 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60f4a2d640 1 Processor -- start 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60f4a2d640 1 -- start start 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60f4a2d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f018f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60f4a2d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f018fc40 con 0x7f60f01044d0 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f018f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f018f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58272/0 (socket says 172.21.15.103:58272) 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.073+0000 7f60ee59c640 1 -- 172.21.15.103:0/2460690248 learned_addr learned my addr 172.21.15.103:0/2460690248 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60ee59c640 1 -- 172.21.15.103:0/2460690248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009b30 con 0x7f60f01044d0 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60ee59c640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f018f700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009fa0 tx=0x7f60e0031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60e003a400 con 0x7f60f01044d0 2024-09-17T00:58:26.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60e003aa20 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f018de30 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60e0039b90 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.074+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f018e2d0 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.075+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f60e0038040 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.075+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f0104950 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.075+0000 7f60e77fe640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f60dc038650 0x7f60dc03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.075+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f60e006b780 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.075+0000 7f60edd9b640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f60dc038650 0x7f60dc03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.076+0000 7f60edd9b640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f60dc038650 0x7f60dc03ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60d80098c0 tx=0x7f60d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.080+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f60e0044770 con 0x7f60f01044d0 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.250+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f60f0193290 con 0x7f60dc038650 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.254+0000 7f60e77fe640 1 -- 172.21.15.103:0/2460690248 <== mgr.14118 v2:172.21.15.103:6800/1190379096 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f60f0193290 con 0x7f60dc038650 2024-09-17T00:58:26.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f60dc038650 msgr2=0x7f60dc03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f60dc038650 0x7f60dc03ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60d80098c0 tx=0x7f60d8006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 msgr2=0x7f60f018f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f018f700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009fa0 tx=0x7f60e0031a10 comp rx=0 tx=0).stop 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 shutdown_connections 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f60dc038650 0x7f60dc03ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 --2- 172.21.15.103:0/2460690248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f01044d0 0x7f60f018f700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 >> 172.21.15.103:0/2460690248 conn(0x7f60f00ffcc0 msgr2=0x7f60f0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 shutdown_connections 2024-09-17T00:58:26.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:26.256+0000 7f60f4a2d640 1 -- 172.21.15.103:0/2460690248 wait complete. 2024-09-17T00:58:26.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:26 smithi103 ceph-mon[28156]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:26.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:26 smithi103 ceph-mon[28156]: Saving service node-exporter spec with placement * 2024-09-17T00:58:26.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:26 smithi103 ceph-mon[28156]: from='mgr.14118 172.21.15.103:0/567408256' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:27.885 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:27 smithi103 ceph-mon[28156]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:27.885 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:27 smithi103 ceph-mon[28156]: Saving service alertmanager spec with placement count:1 2024-09-17T00:58:27.885 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:27 smithi103 ceph-mon[28156]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:27.885 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:27 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1717041838' entity='client.admin' 2024-09-17T00:58:27.892 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.172+0000 7fcbf2160640 1 Processor -- start 2024-09-17T00:58:27.892 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.172+0000 7fcbf2160640 1 -- start start 2024-09-17T00:58:27.892 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.173+0000 7fcbf2160640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.173+0000 7fcbf2160640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec079ea0 con 0x7fcbec106050 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.173+0000 7fcbeb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.173+0000 7fcbeb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58288/0 (socket says 172.21.15.103:58288) 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.173+0000 7fcbeb7fe640 1 -- 172.21.15.103:0/303463439 learned_addr learned my addr 172.21.15.103:0/303463439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.173+0000 7fcbeb7fe640 1 -- 172.21.15.103:0/303463439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec108980 con 0x7fcbec106050 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbeb7fe640 1 --2- 172.21.15.103:0/303463439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec108440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009820 tx=0x7fcbdc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265db95d8cf3182e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbea7fc640 1 -- 172.21.15.103:0/303463439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbdc02ad40 con 0x7fcbec106050 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbea7fc640 1 -- 172.21.15.103:0/303463439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbdc032900 con 0x7fcbec106050 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbea7fc640 1 -- 172.21.15.103:0/303463439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbdc030860 con 0x7fcbec106050 2024-09-17T00:58:27.893 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbf2160640 1 -- 172.21.15.103:0/303463439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 msgr2=0x7fcbec108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbf2160640 1 --2- 172.21.15.103:0/303463439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec108440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009820 tx=0x7fcbdc02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.174+0000 7fcbf2160640 1 -- 172.21.15.103:0/303463439 shutdown_connections 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 --2- 172.21.15.103:0/303463439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec108440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 -- 172.21.15.103:0/303463439 >> 172.21.15.103:0/303463439 conn(0x7fcbec0ffc50 msgr2=0x7fcbec1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 -- 172.21.15.103:0/303463439 shutdown_connections 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 -- 172.21.15.103:0/303463439 wait complete. 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 Processor -- start 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 -- start start 2024-09-17T00:58:27.894 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec1058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.175+0000 7fcbf2160640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec105e10 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbeb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec1058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbeb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec1058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58296/0 (socket says 172.21.15.103:58296) 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbeb7fe640 1 -- 172.21.15.103:0/1717041838 learned_addr learned my addr 172.21.15.103:0/1717041838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbeb7fe640 1 -- 172.21.15.103:0/1717041838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0094d0 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbeb7fe640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec1058d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc032670 tx=0x7fcbdc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbdc032c80 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbdc032de0 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec104000 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbdc03a720 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.176+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec1044a0 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.177+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fcbdc03a9a0 con 0x7fcbec106050 2024-09-17T00:58:27.895 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.177+0000 7fcbe8ff9640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fcbd8038650 0x7fcbd803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.177+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcbdc06b970 con 0x7fcbec106050 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.177+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec106430 con 0x7fcbec106050 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.177+0000 7fcbeaffd640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fcbd8038650 0x7fcbd803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.178+0000 7fcbeaffd640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fcbd8038650 0x7fcbd803ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40098c0 tx=0x7fcbd4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.182+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcbdc039d10 con 0x7fcbec106050 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.345+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fcbec109790 con 0x7fcbec106050 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.348+0000 7fcbe8ff9640 1 -- 172.21.15.103:0/1717041838 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fcbdc044e90 con 0x7fcbec106050 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fcbd8038650 msgr2=0x7fcbd803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fcbd8038650 0x7fcbd803ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40098c0 tx=0x7fcbd4006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 msgr2=0x7fcbec1058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec1058d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc032670 tx=0x7fcbdc0326a0 comp rx=0 tx=0).stop 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 shutdown_connections 2024-09-17T00:58:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fcbd8038650 0x7fcbd803ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:27.897 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 --2- 172.21.15.103:0/1717041838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbec106050 0x7fcbec1058d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:27.897 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 >> 172.21.15.103:0/1717041838 conn(0x7fcbec0ffc50 msgr2=0x7fcbec1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:27.897 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 shutdown_connections 2024-09-17T00:58:27.897 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:27.351+0000 7fcbf2160640 1 -- 172.21.15.103:0/1717041838 wait complete. 2024-09-17T00:58:29.086 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.295+0000 7f7b636a2640 1 Processor -- start 2024-09-17T00:58:29.093 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.295+0000 7f7b636a2640 1 -- start start 2024-09-17T00:58:29.093 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.296+0000 7f7b636a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c1042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:29.093 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.296+0000 7f7b636a2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c079e00 con 0x7f7b5c103ee0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.296+0000 7f7b6143e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c1042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.296+0000 7f7b6143e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c1042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58304/0 (socket says 172.21.15.103:58304) 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.296+0000 7f7b6143e640 1 -- 172.21.15.103:0/1680414069 learned_addr learned my addr 172.21.15.103:0/1680414069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.296+0000 7f7b6143e640 1 -- 172.21.15.103:0/1680414069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c079f40 con 0x7f7b5c103ee0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.297+0000 7f7b6143e640 1 --2- 172.21.15.103:0/1680414069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c1042e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009820 tx=0x7f7b4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09f66d7dfb7a8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.297+0000 7f7b53fff640 1 -- 172.21.15.103:0/1680414069 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b4c02ad40 con 0x7f7b5c103ee0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.297+0000 7f7b53fff640 1 -- 172.21.15.103:0/1680414069 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b4c032900 con 0x7f7b5c103ee0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.297+0000 7f7b53fff640 1 -- 172.21.15.103:0/1680414069 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b4c030860 con 0x7f7b5c103ee0 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.297+0000 7f7b636a2640 1 -- 172.21.15.103:0/1680414069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 msgr2=0x7f7b5c1042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.297+0000 7f7b636a2640 1 --2- 172.21.15.103:0/1680414069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c1042e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009820 tx=0x7f7b4c02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.298+0000 7f7b636a2640 1 -- 172.21.15.103:0/1680414069 shutdown_connections 2024-09-17T00:58:29.094 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.298+0000 7f7b636a2640 1 --2- 172.21.15.103:0/1680414069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c1042e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.298+0000 7f7b636a2640 1 -- 172.21.15.103:0/1680414069 >> 172.21.15.103:0/1680414069 conn(0x7f7b5c0ffc50 msgr2=0x7f7b5c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.298+0000 7f7b636a2640 1 -- 172.21.15.103:0/1680414069 shutdown_connections 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.298+0000 7f7b636a2640 1 -- 172.21.15.103:0/1680414069 wait complete. 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.298+0000 7f7b636a2640 1 Processor -- start 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b636a2640 1 -- start start 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b636a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b636a2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c19ba00 con 0x7f7b5c103ee0 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b6143e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b6143e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c19b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58320/0 (socket says 172.21.15.103:58320) 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b6143e640 1 -- 172.21.15.103:0/3685411061 learned_addr learned my addr 172.21.15.103:0/3685411061 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b6143e640 1 -- 172.21.15.103:0/3685411061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0094d0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.095 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b6143e640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c19b4c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0097f0 tx=0x7f7b4c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.299+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b4c040070 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.300+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b4c032dd0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.300+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c19bc00 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.300+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b4c03a790 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.300+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c19c0a0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.300+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f7b4c03a8f0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.301+0000 7f7b527fc640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f7b480386a0 0x7f7b4803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.301+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7b4c06b6a0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.301+0000 7f7b60c3d640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f7b480386a0 0x7f7b4803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.301+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c105da0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.301+0000 7f7b60c3d640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f7b480386a0 0x7f7b4803ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b580098c0 tx=0x7f7b58006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.306+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7b4c039b90 con 0x7f7b5c103ee0 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.472+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f7b5c19e980 con 0x7f7b5c103ee0 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.477+0000 7f7b527fc640 1 -- 172.21.15.103:0/3685411061 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7b4c031ed0 con 0x7f7b5c103ee0 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f7b480386a0 msgr2=0x7f7b4803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f7b480386a0 0x7f7b4803ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b580098c0 tx=0x7f7b58006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 msgr2=0x7f7b5c19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c19b4c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0097f0 tx=0x7f7b4c030d50 comp rx=0 tx=0).stop 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 shutdown_connections 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f7b480386a0 0x7f7b4803ab60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 --2- 172.21.15.103:0/3685411061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b5c103ee0 0x7f7b5c19b4c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 >> 172.21.15.103:0/3685411061 conn(0x7f7b5c0ffc50 msgr2=0x7f7b5c18fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 shutdown_connections 2024-09-17T00:58:29.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:28.479+0000 7f7b636a2640 1 -- 172.21.15.103:0/3685411061 wait complete. 2024-09-17T00:58:29.098 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling the dashboard module... 2024-09-17T00:58:29.675 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:29 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3685411061' entity='client.admin' 2024-09-17T00:58:29.675 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:29 smithi103 ceph-mon[28156]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:30.841 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:30 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3596288068' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.463+0000 7f9e97a2a640 1 Processor -- start 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.463+0000 7f9e97a2a640 1 -- start start 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.464+0000 7f9e97a2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e901048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.464+0000 7f9e97a2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90104e80 con 0x7f9e901044b0 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.464+0000 7f9e957c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e901048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.464+0000 7f9e957c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e901048b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58332/0 (socket says 172.21.15.103:58332) 2024-09-17T00:58:31.150 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.464+0000 7f9e957c6640 1 -- 172.21.15.103:0/721049987 learned_addr learned my addr 172.21.15.103:0/721049987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.464+0000 7f9e957c6640 1 -- 172.21.15.103:0/721049987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e901056b0 con 0x7f9e901044b0 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e957c6640 1 --2- 172.21.15.103:0/721049987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e901048b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009820 tx=0x7f9e8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4551c728e28e98e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e8ffff640 1 -- 172.21.15.103:0/721049987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e8802ad40 con 0x7f9e901044b0 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e8ffff640 1 -- 172.21.15.103:0/721049987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e88032900 con 0x7f9e901044b0 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e8ffff640 1 -- 172.21.15.103:0/721049987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e88030860 con 0x7f9e901044b0 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e97a2a640 1 -- 172.21.15.103:0/721049987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 msgr2=0x7f9e901048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e97a2a640 1 --2- 172.21.15.103:0/721049987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e901048b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009820 tx=0x7f9e8802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e97a2a640 1 -- 172.21.15.103:0/721049987 shutdown_connections 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e97a2a640 1 --2- 172.21.15.103:0/721049987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e901048b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.465+0000 7f9e97a2a640 1 -- 172.21.15.103:0/721049987 >> 172.21.15.103:0/721049987 conn(0x7f9e900ffc00 msgr2=0x7f9e90102080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.466+0000 7f9e97a2a640 1 -- 172.21.15.103:0/721049987 shutdown_connections 2024-09-17T00:58:31.151 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.466+0000 7f9e97a2a640 1 -- 172.21.15.103:0/721049987 wait complete. 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.466+0000 7f9e97a2a640 1 Processor -- start 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.466+0000 7f9e97a2a640 1 -- start start 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e97a2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e90079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e97a2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90079f80 con 0x7f9e901044b0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e957c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e90079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e957c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e90079a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58342/0 (socket says 172.21.15.103:58342) 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e957c6640 1 -- 172.21.15.103:0/3596288068 learned_addr learned my addr 172.21.15.103:0/3596288068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e957c6640 1 -- 172.21.15.103:0/3596288068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e880094d0 con 0x7f9e901044b0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e957c6640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e90079a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009940 tx=0x7f9e88032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e88032c80 con 0x7f9e901044b0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e90199e80 con 0x7f9e901044b0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e88032de0 con 0x7f9e901044b0 2024-09-17T00:58:31.152 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e8803a5d0 con 0x7f9e901044b0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.467+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9019e740 con 0x7f9e901044b0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.468+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f9e8803a800 con 0x7f9e901044b0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.468+0000 7f9e8e7fc640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9e78038650 0x7f9e7803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.468+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9e8806b7b0 con 0x7f9e901044b0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.468+0000 7f9e94fc5640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9e78038650 0x7f9e7803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.468+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e901088e0 con 0x7f9e901044b0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.469+0000 7f9e94fc5640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9e78038650 0x7f9e7803ab10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400ad30 tx=0x7f9e840093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.473+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9e88043310 con 0x7f9e901044b0 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:29.677+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f9e90108ad0 con 0x7f9e901044b0 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.482+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f9e8803cc30 con 0x7f9e901044b0 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.483+0000 7f9e8e7fc640 1 -- 172.21.15.103:0/3596288068 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f9e880313a0 con 0x7f9e901044b0 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9e78038650 msgr2=0x7f9e7803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9e78038650 0x7f9e7803ab10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400ad30 tx=0x7f9e840093f0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 msgr2=0x7f9e90079a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e90079a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009940 tx=0x7f9e88032670 comp rx=0 tx=0).stop 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 shutdown_connections 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f9e78038650 0x7f9e7803ab10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 --2- 172.21.15.103:0/3596288068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e901044b0 0x7f9e90079a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 >> 172.21.15.103:0/3596288068 conn(0x7f9e900ffc00 msgr2=0x7f9e90100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 shutdown_connections 2024-09-17T00:58:31.154 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:30.487+0000 7f9e97a2a640 1 -- 172.21.15.103:0/3596288068 wait complete. 2024-09-17T00:58:31.753 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:31 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3596288068' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T00:58:31.753 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:31 smithi103 ceph-mon[28156]: mgrmap e9: smithi103.efjaur(active, since 29s) 2024-09-17T00:58:32.357 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:58:32.357 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T00:58:32.357 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "smithi103.efjaur", 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.549+0000 7fadad916640 1 Processor -- start 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.549+0000 7fadad916640 1 -- start start 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.549+0000 7fadad916640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada81059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.549+0000 7fadad916640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada8105f90 con 0x7fada81055c0 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.550+0000 7fada6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada81059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.550+0000 7fada6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada81059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58354/0 (socket says 172.21.15.103:58354) 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.550+0000 7fada6ffd640 1 -- 172.21.15.103:0/3184768184 learned_addr learned my addr 172.21.15.103:0/3184768184 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.550+0000 7fada6ffd640 1 -- 172.21.15.103:0/3184768184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada81067c0 con 0x7fada81055c0 2024-09-17T00:58:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.551+0000 7fada6ffd640 1 --2- 172.21.15.103:0/3184768184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada81059c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad98009820 tx=0x7fad9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16706ad6832afe2c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.551+0000 7fada67fc640 1 -- 172.21.15.103:0/3184768184 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad9802ad40 con 0x7fada81055c0 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.551+0000 7fada67fc640 1 -- 172.21.15.103:0/3184768184 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad98032900 con 0x7fada81055c0 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.551+0000 7fada67fc640 1 -- 172.21.15.103:0/3184768184 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad98030860 con 0x7fada81055c0 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- 172.21.15.103:0/3184768184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 msgr2=0x7fada81059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 --2- 172.21.15.103:0/3184768184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada81059c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad98009820 tx=0x7fad9802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- 172.21.15.103:0/3184768184 shutdown_connections 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 --2- 172.21.15.103:0/3184768184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada81059c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- 172.21.15.103:0/3184768184 >> 172.21.15.103:0/3184768184 conn(0x7fada8100d30 msgr2=0x7fada8103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- 172.21.15.103:0/3184768184 shutdown_connections 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- 172.21.15.103:0/3184768184 wait complete. 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 Processor -- start 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- start start 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.552+0000 7fadad916640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada8199860 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fada6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fada6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58366/0 (socket says 172.21.15.103:58366) 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fada6ffd640 1 -- 172.21.15.103:0/3994703247 learned_addr learned my addr 172.21.15.103:0/3994703247 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fada6ffd640 1 -- 172.21.15.103:0/3994703247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980094d0 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fada6ffd640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada8199320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad98009940 tx=0x7fad98032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad98032c80 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada8199a60 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad98032de0 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad9803a720 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.553+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada8199f00 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.554+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fad9803c400 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.554+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada81099f0 con 0x7fada81055c0 2024-09-17T00:58:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.554+0000 7fadac914640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 0x7fad9403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.554+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad9806ba40 con 0x7fada81055c0 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.554+0000 7fad9ffff640 1 -- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 msgr2=0x7fad9403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1190379096 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.554+0000 7fad9ffff640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 0x7fad9403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.559+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad98043310 con 0x7fada81055c0 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.755+0000 7fad9ffff640 1 -- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 msgr2=0x7fad9403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1190379096 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.755+0000 7fad9ffff640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 0x7fad9403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.774+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fada819c840 con 0x7fada81055c0 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.774+0000 7fadac914640 1 -- 172.21.15.103:0/3994703247 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fad98043310 con 0x7fada81055c0 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 msgr2=0x7fad9403ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 0x7fad9403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 msgr2=0x7fada8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada8199320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad98009940 tx=0x7fad98032670 comp rx=0 tx=0).stop 2024-09-17T00:58:32.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 shutdown_connections 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7fad940386a0 0x7fad9403ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 --2- 172.21.15.103:0/3994703247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada81055c0 0x7fada8199320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 >> 172.21.15.103:0/3994703247 conn(0x7fada8100d30 msgr2=0x7fada81018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 shutdown_connections 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:31.776+0000 7fadad916640 1 -- 172.21.15.103:0/3994703247 wait complete. 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-09-17T00:58:32.362 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 9... 2024-09-17T00:58:32.659 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:32 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3994703247' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T00:58:35.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: Active manager daemon smithi103.efjaur restarted 2024-09-17T00:58:35.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: Activating manager daemon smithi103.efjaur 2024-09-17T00:58:35.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T00:58:35.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: mgrmap e10: smithi103.efjaur(active, starting, since 0.00577697s) 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: Manager daemon smithi103.efjaur is now available 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:35.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:35 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:37.043 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:58:37.043 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T00:58:37.043 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T00:58:37.043 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:58:37.043 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3ebdf640 1 Processor -- start 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3ebdf640 1 -- start start 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3ebdf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e38108520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3ebdf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38079dc0 con 0x7f4e38106130 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3c97b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e38108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3c97b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e38108520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56482/0 (socket says 172.21.15.103:56482) 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3c97b640 1 -- 172.21.15.103:0/3344411501 learned_addr learned my addr 172.21.15.103:0/3344411501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.807+0000 7f4e3c97b640 1 -- 172.21.15.103:0/3344411501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e38079f00 con 0x7f4e38106130 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.808+0000 7f4e3c97b640 1 --2- 172.21.15.103:0/3344411501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e38108520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009820 tx=0x7f4e2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1a67e418cfc942 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.808+0000 7f4e377fe640 1 -- 172.21.15.103:0/3344411501 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e2c02ad40 con 0x7f4e38106130 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.808+0000 7f4e377fe640 1 -- 172.21.15.103:0/3344411501 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e2c032900 con 0x7f4e38106130 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.808+0000 7f4e377fe640 1 -- 172.21.15.103:0/3344411501 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e2c030860 con 0x7f4e38106130 2024-09-17T00:58:37.044 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/3344411501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 msgr2=0x7f4e38108520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/3344411501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e38108520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009820 tx=0x7f4e2c02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/3344411501 shutdown_connections 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/3344411501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e38108520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/3344411501 >> 172.21.15.103:0/3344411501 conn(0x7f4e380ffc50 msgr2=0x7f4e381020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/3344411501 shutdown_connections 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.809+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/3344411501 wait complete. 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3ebdf640 1 Processor -- start 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3ebdf640 1 -- start start 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3ebdf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e381992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:37.045 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3ebdf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38199830 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3c97b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e381992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3c97b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e381992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56486/0 (socket says 172.21.15.103:56486) 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3c97b640 1 -- 172.21.15.103:0/1023581836 learned_addr learned my addr 172.21.15.103:0/1023581836 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.810+0000 7f4e3c97b640 1 -- 172.21.15.103:0/1023581836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0094d0 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.811+0000 7f4e3c97b640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e381992f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c032670 tx=0x7f4e2c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.811+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e2c032c80 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.811+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e2c032de0 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.811+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e2c03a720 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.811+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e38199a30 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.811+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e38199ed0 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.812+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f4e2c03c400 con 0x7f4e38106130 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.812+0000 7f4e35ffb640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:37.046 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.812+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4e2c06b9f0 con 0x7f4e38106130 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.812+0000 7f4e37fff640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 msgr2=0x7f4e2803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1190379096 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.812+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 --> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e381097a0 con 0x7f4e280386a0 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:32.812+0000 7f4e37fff640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:33.012+0000 7f4e37fff640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 msgr2=0x7f4e2803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1190379096 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:33.012+0000 7f4e37fff640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:33.413+0000 7f4e37fff640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 msgr2=0x7f4e2803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1190379096 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:33.413+0000 7f4e37fff640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:34.214+0000 7f4e37fff640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 msgr2=0x7f4e2803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/1190379096 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:34.214+0000 7f4e37fff640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:35.286+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f4e2c03cc30 con 0x7f4e38106130 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:35.286+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 msgr2=0x7f4e2803ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:35.286+0000 7f4e35ffb640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:37.047 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.285+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f4e2c041b90 con 0x7f4e38106130 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.285+0000 7f4e35ffb640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4e2803bfb0 0x7f4e2803e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.285+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e381097a0 con 0x7f4e2803bfb0 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.285+0000 7f4e37fff640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4e2803bfb0 0x7f4e2803e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.286+0000 7f4e37fff640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4e2803bfb0 0x7f4e2803e3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e24003980 tx=0x7f4e24006e10 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.287+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f4e381097a0 con 0x7f4e2803bfb0 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.296+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f4e38109910 con 0x7f4e2803bfb0 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.296+0000 7f4e35ffb640 1 -- 172.21.15.103:0/1023581836 <== mgr.14162 v2:172.21.15.103:6800/3684168093 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f4e38109910 con 0x7f4e2803bfb0 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4e2803bfb0 msgr2=0x7f4e2803e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4e2803bfb0 0x7f4e2803e3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e24003980 tx=0x7f4e24006e10 comp rx=0 tx=0).stop 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 msgr2=0x7f4e381992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e381992f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c032670 tx=0x7f4e2c0326a0 comp rx=0 tx=0).stop 2024-09-17T00:58:37.048 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 shutdown_connections 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4e2803bfb0 0x7f4e2803e3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:6800/1190379096,v1:172.21.15.103:6801/1190379096] conn(0x7f4e280386a0 0x7f4e2803ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 --2- 172.21.15.103:0/1023581836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e38106130 0x7f4e381992f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 >> 172.21.15.103:0/1023581836 conn(0x7f4e380ffc50 msgr2=0x7f4e38100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 shutdown_connections 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:36.297+0000 7f4e3ebdf640 1 -- 172.21.15.103:0/1023581836 wait complete. 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 9 is available 2024-09-17T00:58:37.049 INFO:teuthology.orchestra.run.smithi103.stdout:Generating a dashboard self-signed certificate... 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:37 smithi103 ceph-mon[28156]: mgrmap e11: smithi103.efjaur(active, since 1.00564s) 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:37 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:36] ENGINE Bus STARTING 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:37 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:36] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:37 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:36] ENGINE Error in HTTPServer.serve 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T00:58:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T00:58:37.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-17T00:58:37.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T00:58:37.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:37 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:38.407 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:38 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:36] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T00:58:38.407 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:38 smithi103 ceph-mon[28156]: [17/Sep/2024:00:58:36] ENGINE Bus STARTED 2024-09-17T00:58:38.407 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:38 smithi103 ceph-mon[28156]: mgrmap e12: smithi103.efjaur(active, since 2s) 2024-09-17T00:58:38.407 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:38 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:38.407 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:38 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:38.407 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:38 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.439+0000 7f106978f640 1 Processor -- start 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.439+0000 7f106978f640 1 -- start start 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.439+0000 7f106978f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f10641059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.439+0000 7f106978f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064105fa0 con 0x7f10641055d0 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.440+0000 7f1062ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f10641059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.440+0000 7f1062ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f10641059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56572/0 (socket says 172.21.15.103:56572) 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.440+0000 7f1062ffd640 1 -- 172.21.15.103:0/700861951 learned_addr learned my addr 172.21.15.103:0/700861951 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.440+0000 7f1062ffd640 1 -- 172.21.15.103:0/700861951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10641067d0 con 0x7f10641055d0 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f1062ffd640 1 --2- 172.21.15.103:0/700861951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f10641059d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1054009820 tx=0x7f105402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22feb26072e756f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:38.414 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f1061ffb640 1 -- 172.21.15.103:0/700861951 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f105402ad40 con 0x7f10641055d0 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f1061ffb640 1 -- 172.21.15.103:0/700861951 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1054032900 con 0x7f10641055d0 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f1061ffb640 1 -- 172.21.15.103:0/700861951 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1054030860 con 0x7f10641055d0 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 -- 172.21.15.103:0/700861951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 msgr2=0x7f10641059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 --2- 172.21.15.103:0/700861951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f10641059d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1054009820 tx=0x7f105402a270 comp rx=0 tx=0).stop 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 -- 172.21.15.103:0/700861951 shutdown_connections 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 --2- 172.21.15.103:0/700861951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f10641059d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 -- 172.21.15.103:0/700861951 >> 172.21.15.103:0/700861951 conn(0x7f1064100d80 msgr2=0x7f10641031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 -- 172.21.15.103:0/700861951 shutdown_connections 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.441+0000 7f106978f640 1 -- 172.21.15.103:0/700861951 wait complete. 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f106978f640 1 Processor -- start 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f106978f640 1 -- start start 2024-09-17T00:58:38.415 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f106978f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f1064199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f106978f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064199850 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f1062ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f1064199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f1062ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f1064199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56588/0 (socket says 172.21.15.103:56588) 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.442+0000 7f1062ffd640 1 -- 172.21.15.103:0/3696077227 learned_addr learned my addr 172.21.15.103:0/3696077227 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f1062ffd640 1 -- 172.21.15.103:0/3696077227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540094d0 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f1062ffd640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f1064199310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1054009940 tx=0x7f1054032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1054032c80 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1054032de0 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1064199a50 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f105403a720 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.443+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1064199ef0 con 0x7f10641055d0 2024-09-17T00:58:38.416 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.444+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f105403a950 con 0x7f10641055d0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.444+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1064109b50 con 0x7f10641055d0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.444+0000 7f104bfff640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f104c038580 0x7f104c03aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.444+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f105406b9a0 con 0x7f10641055d0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.444+0000 7f10627fc640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f104c038580 0x7f104c03aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.445+0000 7f10627fc640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f104c038580 0x7f104c03aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10580098c0 tx=0x7f1058006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.449+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f10540396d0 con 0x7f10641055d0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.602+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f105403cc30 con 0x7f10641055d0 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.623+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f1064101fa0 con 0x7f104c038580 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.680+0000 7f104bfff640 1 -- 172.21.15.103:0/3696077227 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f1064101fa0 con 0x7f104c038580 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f104c038580 msgr2=0x7f104c03aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f104c038580 0x7f104c03aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10580098c0 tx=0x7f1058006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 msgr2=0x7f1064199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:38.417 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f1064199310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1054009940 tx=0x7f1054032670 comp rx=0 tx=0).stop 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 shutdown_connections 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f104c038580 0x7f104c03aa40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 --2- 172.21.15.103:0/3696077227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10641055d0 0x7f1064199310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.682+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 >> 172.21.15.103:0/3696077227 conn(0x7f1064100d80 msgr2=0x7f1064101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.683+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 shutdown_connections 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:37.683+0000 7f106978f640 1 -- 172.21.15.103:0/3696077227 wait complete. 2024-09-17T00:58:38.418 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial admin user... 2024-09-17T00:58:39.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:39 smithi103 ceph-mon[28156]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:39.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:39 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$En70ktQdEFSwhYwTHuqqgOvs2MWrJ5YgUnVIz3lwUlp80T8iS6Rki", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726534719, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T00:58:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f7086809640 1 Processor -- start 2024-09-17T00:58:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f7086809640 1 -- start start 2024-09-17T00:58:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f7086809640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f7080108420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f7086809640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080079ea0 con 0x7f7080106030 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f707ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f7080108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f707ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f7080108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56592/0 (socket says 172.21.15.103:56592) 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f707ffff640 1 -- 172.21.15.103:0/3025354916 learned_addr learned my addr 172.21.15.103:0/3025354916 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.783+0000 7f707ffff640 1 -- 172.21.15.103:0/3025354916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080108960 con 0x7f7080106030 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.784+0000 7f707ffff640 1 --2- 172.21.15.103:0/3025354916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f7080108420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7070009820 tx=0x7f707002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cb10b3ac3f67d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.784+0000 7f707effd640 1 -- 172.21.15.103:0/3025354916 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f707002ad40 con 0x7f7080106030 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.784+0000 7f707effd640 1 -- 172.21.15.103:0/3025354916 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7070032900 con 0x7f7080106030 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.784+0000 7f707effd640 1 -- 172.21.15.103:0/3025354916 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7070030860 con 0x7f7080106030 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 -- 172.21.15.103:0/3025354916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 msgr2=0x7f7080108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 --2- 172.21.15.103:0/3025354916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f7080108420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7070009820 tx=0x7f707002a270 comp rx=0 tx=0).stop 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 -- 172.21.15.103:0/3025354916 shutdown_connections 2024-09-17T00:58:39.926 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 --2- 172.21.15.103:0/3025354916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f7080108420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 -- 172.21.15.103:0/3025354916 >> 172.21.15.103:0/3025354916 conn(0x7f70800ffc30 msgr2=0x7f7080102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 -- 172.21.15.103:0/3025354916 shutdown_connections 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 -- 172.21.15.103:0/3025354916 wait complete. 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 Processor -- start 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.785+0000 7f7086809640 1 -- start start 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f7086809640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f70801992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f7086809640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080199810 con 0x7f7080106030 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f70801992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f70801992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56600/0 (socket says 172.21.15.103:56600) 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707ffff640 1 -- 172.21.15.103:0/3751329979 learned_addr learned my addr 172.21.15.103:0/3751329979 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707ffff640 1 -- 172.21.15.103:0/3751329979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700094d0 con 0x7f7080106030 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707ffff640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f70801992d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7070032670 tx=0x7f70700326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.927 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7070032c80 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7070032de0 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f707003a720 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.786+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080199a10 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.787+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7080199eb0 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.787+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f707003c400 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.787+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080109770 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.788+0000 7f707d7fa640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f706c0386f0 0x7f706c03abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.788+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f707006ba60 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.788+0000 7f707f7fe640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f706c0386f0 0x7f706c03abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.788+0000 7f707f7fe640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f706c0386f0 0x7f706c03abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70680098c0 tx=0x7f7068006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.792+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7070043310 con 0x7f7080106030 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:38.997+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7080061900 con 0x7f706c0386f0 2024-09-17T00:58:39.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.219+0000 7f707d7fa640 1 -- 172.21.15.103:0/3751329979 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f7080061900 con 0x7f706c0386f0 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f706c0386f0 msgr2=0x7f706c03abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f706c0386f0 0x7f706c03abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70680098c0 tx=0x7f7068006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 msgr2=0x7f70801992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f70801992d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7070032670 tx=0x7f70700326a0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 shutdown_connections 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f706c0386f0 0x7f706c03abb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 --2- 172.21.15.103:0/3751329979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7080106030 0x7f70801992d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 >> 172.21.15.103:0/3751329979 conn(0x7f70800ffc30 msgr2=0x7f7080100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 shutdown_connections 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:39.221+0000 7f7086809640 1 -- 172.21.15.103:0/3751329979 wait complete. 2024-09-17T00:58:39.929 INFO:teuthology.orchestra.run.smithi103.stdout:Fetching dashboard port number... 2024-09-17T00:58:40.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:40 smithi103 ceph-mon[28156]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:41.293 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T00:58:41.293 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174ffe4640 1 Processor -- start 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174ffe4640 1 -- start start 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174ffe4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f17481048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174ffe4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748104eb0 con 0x7f17481044e0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174dd80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f17481048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174dd80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f17481048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56616/0 (socket says 172.21.15.103:56616) 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.319+0000 7f174dd80640 1 -- 172.21.15.103:0/1278585167 learned_addr learned my addr 172.21.15.103:0/1278585167 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.320+0000 7f174dd80640 1 -- 172.21.15.103:0/1278585167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17481056e0 con 0x7f17481044e0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.320+0000 7f174dd80640 1 --2- 172.21.15.103:0/1278585167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f17481048e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1744009820 tx=0x7f174402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7ab6dbbd0cd407 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174cd7e640 1 -- 172.21.15.103:0/1278585167 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f174402ad40 con 0x7f17481044e0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174cd7e640 1 -- 172.21.15.103:0/1278585167 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1744032900 con 0x7f17481044e0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174cd7e640 1 -- 172.21.15.103:0/1278585167 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1744030860 con 0x7f17481044e0 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 -- 172.21.15.103:0/1278585167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 msgr2=0x7f17481048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:41.294 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 --2- 172.21.15.103:0/1278585167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f17481048e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1744009820 tx=0x7f174402a270 comp rx=0 tx=0).stop 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 -- 172.21.15.103:0/1278585167 shutdown_connections 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 --2- 172.21.15.103:0/1278585167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f17481048e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 -- 172.21.15.103:0/1278585167 >> 172.21.15.103:0/1278585167 conn(0x7f17480ffc50 msgr2=0x7f17481020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 -- 172.21.15.103:0/1278585167 shutdown_connections 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.321+0000 7f174ffe4640 1 -- 172.21.15.103:0/1278585167 wait complete. 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174ffe4640 1 Processor -- start 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174ffe4640 1 -- start start 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174ffe4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f1748199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174ffe4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17481998b0 con 0x7f17481044e0 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174dd80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f1748199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174dd80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f1748199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56622/0 (socket says 172.21.15.103:56622) 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174dd80640 1 -- 172.21.15.103:0/2715229934 learned_addr learned my addr 172.21.15.103:0/2715229934 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.322+0000 7f174dd80640 1 -- 172.21.15.103:0/2715229934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17440094d0 con 0x7f17481044e0 2024-09-17T00:58:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.323+0000 7f174dd80640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f1748199370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17440097f0 tx=0x7f1744030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.323+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1744040070 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.323+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1744032dd0 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.323+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f174403a730 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.323+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1748199ab0 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.323+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1748199f50 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.324+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f174403a890 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.324+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17481935b0 con 0x7f17481044e0 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.324+0000 7f173effd640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f17340386f0 0x7f173403abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:41.296 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.324+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f174406b8c0 con 0x7f17481044e0 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.324+0000 7f174d57f640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f17340386f0 0x7f173403abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.325+0000 7f174d57f640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f17340386f0 0x7f173403abb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f17380098c0 tx=0x7f1738006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.329+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f17440396d0 con 0x7f17481044e0 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.498+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f1748108b30 con 0x7f17481044e0 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.499+0000 7f173effd640 1 -- 172.21.15.103:0/2715229934 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f1744031ed0 con 0x7f17481044e0 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f17340386f0 msgr2=0x7f173403abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f17340386f0 0x7f173403abb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f17380098c0 tx=0x7f1738006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 msgr2=0x7f1748199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f1748199370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17440097f0 tx=0x7f1744030d50 comp rx=0 tx=0).stop 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 shutdown_connections 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f17340386f0 0x7f173403abb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 --2- 172.21.15.103:0/2715229934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17481044e0 0x7f1748199370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:41.297 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 >> 172.21.15.103:0/2715229934 conn(0x7f17480ffc50 msgr2=0x7f1748100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:41.298 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 shutdown_connections 2024-09-17T00:58:41.298 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:40.502+0000 7f174ffe4640 1 -- 172.21.15.103:0/2715229934 wait complete. 2024-09-17T00:58:41.302 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:58:41.302 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-17T00:58:41.309 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:58:41.309 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-17T00:58:41.309 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-17T00:58:41.309 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph Dashboard is now available at: 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout: URL: https://smithi103.front.sepia.ceph.com:8443/ 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout: User: admin 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout: Password: 3vqne7xgsk 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:41.311 INFO:teuthology.orchestra.run.smithi103.stdout:Saving cluster configuration to /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config directory 2024-09-17T00:58:41.312 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling autotune for osd_memory_target 2024-09-17T00:58:41.538 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:41 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2715229934' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.715+0000 7f0be0b73640 1 Processor -- start 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.715+0000 7f0be0b73640 1 -- start start 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.716+0000 7f0be0b73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.716+0000 7f0be0b73640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc079e40 con 0x7f0bdc1060b0 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.716+0000 7f0bda59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.716+0000 7f0bda59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56636/0 (socket says 172.21.15.103:56636) 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.716+0000 7f0bda59c640 1 -- 172.21.15.103:0/2246000071 learned_addr learned my addr 172.21.15.103:0/2246000071 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.716+0000 7f0bda59c640 1 -- 172.21.15.103:0/2246000071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc1089e0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.467 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.717+0000 7f0bda59c640 1 --2- 172.21.15.103:0/2246000071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1084a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009820 tx=0x7f0bcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6213f2a78ef187c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.717+0000 7f0bd959a640 1 -- 172.21.15.103:0/2246000071 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bcc02ad40 con 0x7f0bdc1060b0 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.717+0000 7f0bd959a640 1 -- 172.21.15.103:0/2246000071 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bcc032900 con 0x7f0bdc1060b0 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.717+0000 7f0bd959a640 1 -- 172.21.15.103:0/2246000071 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bcc030860 con 0x7f0bdc1060b0 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.717+0000 7f0be0b73640 1 -- 172.21.15.103:0/2246000071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 msgr2=0x7f0bdc1084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 --2- 172.21.15.103:0/2246000071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1084a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009820 tx=0x7f0bcc02a270 comp rx=0 tx=0).stop 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 -- 172.21.15.103:0/2246000071 shutdown_connections 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 --2- 172.21.15.103:0/2246000071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1084a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 -- 172.21.15.103:0/2246000071 >> 172.21.15.103:0/2246000071 conn(0x7f0bdc0ffc50 msgr2=0x7f0bdc1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 -- 172.21.15.103:0/2246000071 shutdown_connections 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 -- 172.21.15.103:0/2246000071 wait complete. 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.718+0000 7f0be0b73640 1 Processor -- start 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0be0b73640 1 -- start start 2024-09-17T00:58:42.468 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0be0b73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0be0b73640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc199810 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bda59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bda59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56648/0 (socket says 172.21.15.103:56648) 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bda59c640 1 -- 172.21.15.103:0/3837149257 learned_addr learned my addr 172.21.15.103:0/3837149257 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bda59c640 1 -- 172.21.15.103:0/3837149257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0094d0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bda59c640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1992d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc032670 tx=0x7f0bcc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bcc032c80 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bcc032de0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc199a10 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.719+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bcc03a720 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.720+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc199eb0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.720+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f0bcc03a950 con 0x7f0bdc1060b0 2024-09-17T00:58:42.469 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.720+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc109790 con 0x7f0bdc1060b0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.721+0000 7f0bd37fe640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0bc8038790 0x7f0bc803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.721+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0bcc06bae0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.721+0000 7f0bd9d9b640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0bc8038790 0x7f0bc803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.721+0000 7f0bd9d9b640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0bc8038790 0x7f0bc803ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40098c0 tx=0x7f0bc4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.725+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0bcc043310 con 0x7f0bdc1060b0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.886+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0bdc1099d0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.887+0000 7f0bd37fe640 1 -- 172.21.15.103:0/3837149257 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0bcc037ed0 con 0x7f0bdc1060b0 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0bc8038790 msgr2=0x7f0bc803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0bc8038790 0x7f0bc803ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40098c0 tx=0x7f0bc4006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 msgr2=0x7f0bdc1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1992d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc032670 tx=0x7f0bcc0326a0 comp rx=0 tx=0).stop 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 shutdown_connections 2024-09-17T00:58:42.470 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0bc8038790 0x7f0bc803ac50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:42.471 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 --2- 172.21.15.103:0/3837149257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bdc1060b0 0x7f0bdc1992d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:42.471 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 >> 172.21.15.103:0/3837149257 conn(0x7f0bdc0ffc50 msgr2=0x7f0bdc100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:42.471 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 shutdown_connections 2024-09-17T00:58:42.471 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:41.889+0000 7f0be0b73640 1 -- 172.21.15.103:0/3837149257 wait complete. 2024-09-17T00:58:42.585 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:42 smithi103 ceph-mon[28156]: mgrmap e13: smithi103.efjaur(active, since 6s) 2024-09-17T00:58:43.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d3668640 1 Processor -- start 2024-09-17T00:58:43.765 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d3668640 1 -- start start 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d3668640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc07a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d3668640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc07a8e0 con 0x7fa3cc07beb0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d1404640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc07a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d1404640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc07a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56156/0 (socket says 172.21.15.103:56156) 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.902+0000 7fa3d1404640 1 -- 172.21.15.103:0/263539808 learned_addr learned my addr 172.21.15.103:0/263539808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.903+0000 7fa3d1404640 1 -- 172.21.15.103:0/263539808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc07aa20 con 0x7fa3cc07beb0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.903+0000 7fa3d1404640 1 --2- 172.21.15.103:0/263539808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc07a310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009820 tx=0x7fa3c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d73918666f5adf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3c3fff640 1 -- 172.21.15.103:0/263539808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3c802ad40 con 0x7fa3cc07beb0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3c3fff640 1 -- 172.21.15.103:0/263539808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3c8032900 con 0x7fa3cc07beb0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3c3fff640 1 -- 172.21.15.103:0/263539808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3c8030860 con 0x7fa3cc07beb0 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 -- 172.21.15.103:0/263539808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 msgr2=0x7fa3cc07a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 --2- 172.21.15.103:0/263539808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc07a310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009820 tx=0x7fa3c802a270 comp rx=0 tx=0).stop 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 -- 172.21.15.103:0/263539808 shutdown_connections 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 --2- 172.21.15.103:0/263539808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc07a310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 -- 172.21.15.103:0/263539808 >> 172.21.15.103:0/263539808 conn(0x7fa3cc100d70 msgr2=0x7fa3cc103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 -- 172.21.15.103:0/263539808 shutdown_connections 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.904+0000 7fa3d3668640 1 -- 172.21.15.103:0/263539808 wait complete. 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d3668640 1 Processor -- start 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d3668640 1 -- start start 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d3668640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d3668640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc19ba60 con 0x7fa3cc07beb0 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d1404640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d1404640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56164/0 (socket says 172.21.15.103:56164) 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.905+0000 7fa3d1404640 1 -- 172.21.15.103:0/1138852260 learned_addr learned my addr 172.21.15.103:0/1138852260 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3d1404640 1 -- 172.21.15.103:0/1138852260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80094d0 con 0x7fa3cc07beb0 2024-09-17T00:58:43.767 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3d1404640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc19b520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009940 tx=0x7fa3c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3c8032c80 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc19bc60 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3c8032de0 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3c803a720 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.906+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc19c100 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.907+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fa3c803c400 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.907+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc10b9c0 con 0x7fa3cc07beb0 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.907+0000 7fa3c27fc640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fa3b8038740 0x7fa3b803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:43.768 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.907+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa3c806bb70 con 0x7fa3cc07beb0 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.907+0000 7fa3d0c03640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fa3b8038740 0x7fa3b803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.908+0000 7fa3d0c03640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fa3b8038740 0x7fa3b803ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0098c0 tx=0x7fa3bc006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:42.912+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3c803a950 con 0x7fa3cc07beb0 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.159+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fa3cc10bc00 con 0x7fa3cc07beb0 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.162+0000 7fa3c27fc640 1 -- 172.21.15.103:0/1138852260 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa3c8031b90 con 0x7fa3cc07beb0 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fa3b8038740 msgr2=0x7fa3b803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fa3b8038740 0x7fa3b803ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0098c0 tx=0x7fa3bc006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 msgr2=0x7fa3cc19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc19b520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009940 tx=0x7fa3c8032670 comp rx=0 tx=0).stop 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 shutdown_connections 2024-09-17T00:58:43.769 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fa3b8038740 0x7fa3b803ac00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 --2- 172.21.15.103:0/1138852260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3cc07beb0 0x7fa3cc19b520 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.164+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 >> 172.21.15.103:0/1138852260 conn(0x7fa3cc100d70 msgr2=0x7fa3cc101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.165+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 shutdown_connections 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-09-17T00:58:43.165+0000 7fa3d3668640 1 -- 172.21.15.103:0/1138852260 wait complete. 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.770 INFO:teuthology.orchestra.run.smithi103.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout: ceph telemetry on 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout:For more information see: 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:43.771 INFO:teuthology.orchestra.run.smithi103.stdout:Bootstrap complete. 2024-09-17T00:58:43.794 INFO:tasks.cephadm:Fetching config... 2024-09-17T00:58:43.795 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:58:43.795 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T00:58:43.851 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T00:58:43.851 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:58:43.851 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T00:58:43.907 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T00:58:43.907 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:58:43.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/keyring of=/dev/stdout 2024-09-17T00:58:43.973 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T00:58:43.973 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T00:58:43.973 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T00:58:44.028 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T00:58:44.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoVGTpePbwleqO6oc1CGU3OKL7Ts01MOCeNWVr+/sTnGATm+QC0xTvg3mSpp3asYaZwIK/Q+v7dHBJWZWsA+u0iT4rizX6ijUJReddWa57UKYfb5TVSRc3dpzboEKbY1krrB83vzPrKjDlyIb6R+G2CpIc1fJEUbeoLzTnTwf8TxIGvZ14pmLavLS3a6Drga8pduJXdjXBGh69hsoCWA+yP7Yv8JBZGdHtcVHOnaxFOMAWPuw3RwHQjsfafQ2JG37rPEsiPww+6Rwz2wmuiAs5v0DPRBJpPnLml+EZV14YkWfCrbgCu3Ej+S0HbrwyYwj7QVWDkF5vsbK0EC4RKznRj2RdK5fBd1YFWZ2pmSKH1+BGd36BniTHb10tV08bMJcD0XiP8muLgXS241rlIY8fbtCZD6vNyDek2+XmTVCoPEBH65Jk8YwdHiL6yY5Er2Phqc+04faD/0Ejm0HnMrKYHUhqS3SxCpmDbfuJSmyF8vcJk1FjTa6Eff73N/DHdTk= ceph-b107b510-748f-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T00:58:44.103 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoVGTpePbwleqO6oc1CGU3OKL7Ts01MOCeNWVr+/sTnGATm+QC0xTvg3mSpp3asYaZwIK/Q+v7dHBJWZWsA+u0iT4rizX6ijUJReddWa57UKYfb5TVSRc3dpzboEKbY1krrB83vzPrKjDlyIb6R+G2CpIc1fJEUbeoLzTnTwf8TxIGvZ14pmLavLS3a6Drga8pduJXdjXBGh69hsoCWA+yP7Yv8JBZGdHtcVHOnaxFOMAWPuw3RwHQjsfafQ2JG37rPEsiPww+6Rwz2wmuiAs5v0DPRBJpPnLml+EZV14YkWfCrbgCu3Ej+S0HbrwyYwj7QVWDkF5vsbK0EC4RKznRj2RdK5fBd1YFWZ2pmSKH1+BGd36BniTHb10tV08bMJcD0XiP8muLgXS241rlIY8fbtCZD6vNyDek2+XmTVCoPEBH65Jk8YwdHiL6yY5Er2Phqc+04faD/0Ejm0HnMrKYHUhqS3SxCpmDbfuJSmyF8vcJk1FjTa6Eff73N/DHdTk= ceph-b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:58:44.115 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoVGTpePbwleqO6oc1CGU3OKL7Ts01MOCeNWVr+/sTnGATm+QC0xTvg3mSpp3asYaZwIK/Q+v7dHBJWZWsA+u0iT4rizX6ijUJReddWa57UKYfb5TVSRc3dpzboEKbY1krrB83vzPrKjDlyIb6R+G2CpIc1fJEUbeoLzTnTwf8TxIGvZ14pmLavLS3a6Drga8pduJXdjXBGh69hsoCWA+yP7Yv8JBZGdHtcVHOnaxFOMAWPuw3RwHQjsfafQ2JG37rPEsiPww+6Rwz2wmuiAs5v0DPRBJpPnLml+EZV14YkWfCrbgCu3Ej+S0HbrwyYwj7QVWDkF5vsbK0EC4RKznRj2RdK5fBd1YFWZ2pmSKH1+BGd36BniTHb10tV08bMJcD0XiP8muLgXS241rlIY8fbtCZD6vNyDek2+XmTVCoPEBH65Jk8YwdHiL6yY5Er2Phqc+04faD/0Ejm0HnMrKYHUhqS3SxCpmDbfuJSmyF8vcJk1FjTa6Eff73N/DHdTk= ceph-b107b510-748f-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T00:58:44.172 INFO:teuthology.orchestra.run.smithi143.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoVGTpePbwleqO6oc1CGU3OKL7Ts01MOCeNWVr+/sTnGATm+QC0xTvg3mSpp3asYaZwIK/Q+v7dHBJWZWsA+u0iT4rizX6ijUJReddWa57UKYfb5TVSRc3dpzboEKbY1krrB83vzPrKjDlyIb6R+G2CpIc1fJEUbeoLzTnTwf8TxIGvZ14pmLavLS3a6Drga8pduJXdjXBGh69hsoCWA+yP7Yv8JBZGdHtcVHOnaxFOMAWPuw3RwHQjsfafQ2JG37rPEsiPww+6Rwz2wmuiAs5v0DPRBJpPnLml+EZV14YkWfCrbgCu3Ej+S0HbrwyYwj7QVWDkF5vsbK0EC4RKznRj2RdK5fBd1YFWZ2pmSKH1+BGd36BniTHb10tV08bMJcD0XiP8muLgXS241rlIY8fbtCZD6vNyDek2+XmTVCoPEBH65Jk8YwdHiL6yY5Er2Phqc+04faD/0Ejm0HnMrKYHUhqS3SxCpmDbfuJSmyF8vcJk1FjTa6Eff73N/DHdTk= ceph-b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T00:58:44.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T00:58:44.381 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T00:58:44.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:44 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1138852260' entity='client.admin' 2024-09-17T00:58:46.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 -- 172.21.15.103:0/1059996480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 msgr2=0x7f124c0fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 --2- 172.21.15.103:0/1059996480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c0fead0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f123c009880 tx=0x7f123c02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 -- 172.21.15.103:0/1059996480 shutdown_connections 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 --2- 172.21.15.103:0/1059996480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c0fead0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 -- 172.21.15.103:0/1059996480 >> 172.21.15.103:0/1059996480 conn(0x7f124c0f9e80 msgr2=0x7f124c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 -- 172.21.15.103:0/1059996480 shutdown_connections 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.549+0000 7f1254432640 1 -- 172.21.15.103:0/1059996480 wait complete. 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f1254432640 1 Processor -- start 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f1254432640 1 -- start start 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f1254432640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:46.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f1254432640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c195230 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12521ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12521ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c194cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56184/0 (socket says 172.21.15.103:56184) 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12521ce640 1 -- 172.21.15.103:0/467134783 learned_addr learned my addr 172.21.15.103:0/467134783 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12521ce640 1 -- 172.21.15.103:0/467134783 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c009560 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12521ce640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c194cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f123c005610 tx=0x7f123c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f123c004b20 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f123c004c80 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c195430 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.550+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f123c031a90 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.551+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c1958d0 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.551+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f123c031d00 con 0x7f124c0fe6d0 2024-09-17T00:58:46.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.551+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c0fead0 con 0x7f124c0fe6d0 2024-09-17T00:58:46.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.552+0000 7f12437fe640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1238038790 0x7f123803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:46.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.552+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f123c06c4e0 con 0x7f124c0fe6d0 2024-09-17T00:58:46.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.552+0000 7f12519cd640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1238038790 0x7f123803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:46.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.552+0000 7f12519cd640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1238038790 0x7f123803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12480098c0 tx=0x7f1248006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:46.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.556+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f123c04ddb0 con 0x7f124c0fe6d0 2024-09-17T00:58:46.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.727+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f124c104850 con 0x7f124c0fe6d0 2024-09-17T00:58:46.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.730+0000 7f12437fe640 1 -- 172.21.15.103:0/467134783 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f123c0350c0 con 0x7f124c0fe6d0 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1238038790 msgr2=0x7f123803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1238038790 0x7f123803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12480098c0 tx=0x7f1248006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 msgr2=0x7f124c194cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c194cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f123c005610 tx=0x7f123c005640 comp rx=0 tx=0).stop 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 shutdown_connections 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1238038790 0x7f123803ac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 --2- 172.21.15.103:0/467134783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f124c0fe6d0 0x7f124c194cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.732+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 >> 172.21.15.103:0/467134783 conn(0x7f124c0f9e80 msgr2=0x7f124c067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.733+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 shutdown_connections 2024-09-17T00:58:46.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:46.733+0000 7f1254432640 1 -- 172.21.15.103:0/467134783 wait complete. 2024-09-17T00:58:47.513 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T00:58:47.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T00:58:48.170 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:47 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/467134783' entity='client.admin' 2024-09-17T00:58:48.269 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:49.462 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:49 smithi103 ceph-mon[28156]: Deploying daemon ceph-exporter.smithi103 on smithi103 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 -- 172.21.15.103:0/1966671873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 msgr2=0x7fd4680ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 --2- 172.21.15.103:0/1966671873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd4680ffc00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd458009880 tx=0x7fd45802a5d0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 -- 172.21.15.103:0/1966671873 shutdown_connections 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 --2- 172.21.15.103:0/1966671873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd4680ffc00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 -- 172.21.15.103:0/1966671873 >> 172.21.15.103:0/1966671873 conn(0x7fd4680faf90 msgr2=0x7fd4680fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 -- 172.21.15.103:0/1966671873 shutdown_connections 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.662+0000 7fd46d65f640 1 -- 172.21.15.103:0/1966671873 wait complete. 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.663+0000 7fd46d65f640 1 Processor -- start 2024-09-17T00:58:50.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.663+0000 7fd46d65f640 1 -- start start 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.663+0000 7fd46d65f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd468074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.663+0000 7fd46d65f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd468074660 con 0x7fd4680ff800 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd466ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd468074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd466ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd468074120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56206/0 (socket says 172.21.15.103:56206) 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd466ffd640 1 -- 172.21.15.103:0/3614038790 learned_addr learned my addr 172.21.15.103:0/3614038790 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd466ffd640 1 -- 172.21.15.103:0/3614038790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009560 con 0x7fd4680ff800 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd466ffd640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd468074120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd458009230 tx=0x7fd4580056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd458004aa0 con 0x7fd4680ff800 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4680728a0 con 0x7fd4680ff800 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd468072d40 con 0x7fd4680ff800 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd458004c00 con 0x7fd4680ff800 2024-09-17T00:58:50.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.664+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd458031a60 con 0x7fd4680ff800 2024-09-17T00:58:50.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.665+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fd458031bc0 con 0x7fd4680ff800 2024-09-17T00:58:50.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.665+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd468105ff0 con 0x7fd4680ff800 2024-09-17T00:58:50.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.665+0000 7fd464ff9640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd454038740 0x7fd45403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:50.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.666+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd45806c430 con 0x7fd4680ff800 2024-09-17T00:58:50.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.666+0000 7fd45e7fc640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd454038740 0x7fd45403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:50.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.666+0000 7fd45e7fc640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd454038740 0x7fd45403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098c0 tx=0x7fd450006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:50.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.670+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd45804ddb0 con 0x7fd4680ff800 2024-09-17T00:58:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.844+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fd468072ff0 con 0x7fd454038740 2024-09-17T00:58:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.848+0000 7fd464ff9640 1 -- 172.21.15.103:0/3614038790 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd468072ff0 con 0x7fd454038740 2024-09-17T00:58:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd454038740 msgr2=0x7fd45403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd454038740 0x7fd45403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098c0 tx=0x7fd450006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 msgr2=0x7fd468074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd468074120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd458009230 tx=0x7fd4580056e0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 shutdown_connections 2024-09-17T00:58:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd454038740 0x7fd45403ac00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 --2- 172.21.15.103:0/3614038790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4680ff800 0x7fd468074120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 >> 172.21.15.103:0/3614038790 conn(0x7fd4680faf90 msgr2=0x7fd4680fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:50.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 shutdown_connections 2024-09-17T00:58:50.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:50.850+0000 7fd46d65f640 1 -- 172.21.15.103:0/3614038790 wait complete. 2024-09-17T00:58:51.465 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi143 2024-09-17T00:58:51.465 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:58:51.465 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/etc/ceph/ceph.conf 2024-09-17T00:58:51.484 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T00:58:51.484 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:58:51.542 INFO:tasks.cephadm:Adding host smithi143 to orchestrator... 2024-09-17T00:58:51.542 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch host add smithi143 2024-09-17T00:58:51.745 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T00:58:52.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:51 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:53.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:52 smithi103 ceph-mon[28156]: Deploying daemon crash.smithi103 on smithi103 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 -- 172.21.15.103:0/1146932703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 msgr2=0x7f50701012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 --2- 172.21.15.103:0/1146932703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f50701012e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5060009880 tx=0x7f506002a5d0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 -- 172.21.15.103:0/1146932703 shutdown_connections 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 --2- 172.21.15.103:0/1146932703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f50701012e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 -- 172.21.15.103:0/1146932703 >> 172.21.15.103:0/1146932703 conn(0x7f50700faf90 msgr2=0x7f50700fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 -- 172.21.15.103:0/1146932703 shutdown_connections 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.346+0000 7f507549c640 1 -- 172.21.15.103:0/1146932703 wait complete. 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f507549c640 1 Processor -- start 2024-09-17T00:58:53.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f507549c640 1 -- start start 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f507549c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f5070194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f507549c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070195350 con 0x7f5070100ee0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f506effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f5070194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f506effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f5070194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35278/0 (socket says 172.21.15.103:35278) 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.347+0000 7f506effd640 1 -- 172.21.15.103:0/2308812745 learned_addr learned my addr 172.21.15.103:0/2308812745 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f506effd640 1 -- 172.21.15.103:0/2308812745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060009560 con 0x7f5070100ee0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f506effd640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f5070194e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5060009230 tx=0x7f50600056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5060004aa0 con 0x7f5070100ee0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5060004c00 con 0x7f5070100ee0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5060031a60 con 0x7f5070100ee0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5070195550 con 0x7f5070100ee0 2024-09-17T00:58:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.348+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50701959f0 con 0x7f5070100ee0 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.349+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f5060031bc0 con 0x7f5070100ee0 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.349+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50701012e0 con 0x7f5070100ee0 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.349+0000 7f5057fff640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f5058038740 0x7f505803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.349+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f506006c3f0 con 0x7f5070100ee0 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.349+0000 7f506e7fc640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f5058038740 0x7f505803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.349+0000 7f506e7fc640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f5058038740 0x7f505803ac00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f50640098c0 tx=0x7f5064006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.354+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f506004d7c0 con 0x7f5070100ee0 2024-09-17T00:58:53.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:53.524+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi143", "target": ["mon-mgr", ""]}) v1 -- 0x7f50700608f0 con 0x7f5058038740 2024-09-17T00:58:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:53 smithi103 ceph-mon[28156]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi143", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:58:55.174 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:54 smithi103 ceph-mon[28156]: Deploying cephadm binary to smithi143 2024-09-17T00:58:56.185 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi143' with addr '172.21.15.143' 2024-09-17T00:58:56.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.185+0000 7f5057fff640 1 -- 172.21.15.103:0/2308812745 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f50700608f0 con 0x7f5058038740 2024-09-17T00:58:56.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f5058038740 msgr2=0x7f505803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:56.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f5058038740 0x7f505803ac00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f50640098c0 tx=0x7f5064006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 msgr2=0x7f5070194e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:56.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f5070194e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5060009230 tx=0x7f50600056e0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 shutdown_connections 2024-09-17T00:58:56.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f5058038740 0x7f505803ac00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 --2- 172.21.15.103:0/2308812745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5070100ee0 0x7f5070194e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 >> 172.21.15.103:0/2308812745 conn(0x7f50700faf90 msgr2=0x7f50700fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:56.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 shutdown_connections 2024-09-17T00:58:56.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:56.188+0000 7f507549c640 1 -- 172.21.15.103:0/2308812745 wait complete. 2024-09-17T00:58:56.499 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:56.499 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:56.499 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:56.500 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:56.500 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:56.500 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:56.500 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:56 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:58:56.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T00:58:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T00:58:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:57 smithi103 ceph-mon[28156]: Deploying daemon node-exporter.smithi103 on smithi103 2024-09-17T00:58:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:57 smithi103 ceph-mon[28156]: Added host smithi143 2024-09-17T00:58:58.575 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:58:58 smithi103 ceph-mon[28156]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.433+0000 7f602b824640 1 -- 172.21.15.103:0/2624178868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 msgr2=0x7f60240fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.433+0000 7f602b824640 1 --2- 172.21.15.103:0/2624178868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240fead0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6020009880 tx=0x7f602002a5d0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.433+0000 7f602b824640 1 -- 172.21.15.103:0/2624178868 shutdown_connections 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.433+0000 7f602b824640 1 --2- 172.21.15.103:0/2624178868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240fead0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.433+0000 7f602b824640 1 -- 172.21.15.103:0/2624178868 >> 172.21.15.103:0/2624178868 conn(0x7f60240f9e80 msgr2=0x7f60240fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.434+0000 7f602b824640 1 -- 172.21.15.103:0/2624178868 shutdown_connections 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.434+0000 7f602b824640 1 -- 172.21.15.103:0/2624178868 wait complete. 2024-09-17T00:58:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.434+0000 7f602b824640 1 Processor -- start 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.434+0000 7f602b824640 1 -- start start 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.434+0000 7f602b824640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.434+0000 7f602b824640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024068610 con 0x7f60240fe6d0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f60295c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f60295c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35310/0 (socket says 172.21.15.103:35310) 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f60295c0640 1 -- 172.21.15.103:0/3834807944 learned_addr learned my addr 172.21.15.103:0/3834807944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f60295c0640 1 -- 172.21.15.103:0/3834807944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020009560 con 0x7f60240fe6d0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f60295c0640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240680d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6020005610 tx=0x7f6020005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60200049d0 con 0x7f60240fe6d0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6020004b30 con 0x7f60240fe6d0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6024197a00 con 0x7f60240fe6d0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60200318e0 con 0x7f60240fe6d0 2024-09-17T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.435+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024197ea0 con 0x7f60240fe6d0 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.436+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f6020031b50 con 0x7f60240fe6d0 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.436+0000 7f601a7fc640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f6010038790 0x7f601003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.437+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f602006c3e0 con 0x7f60240fe6d0 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.437+0000 7f6028dbf640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f6010038790 0x7f601003ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.437+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240fead0 con 0x7f60240fe6d0 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.437+0000 7f6028dbf640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f6010038790 0x7f601003ac50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60140098c0 tx=0x7f6014006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.441+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6020035020 con 0x7f60240fe6d0 2024-09-17T00:58:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.613+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60240608f0 con 0x7f6010038790 2024-09-17T00:58:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.614+0000 7f601a7fc640 1 -- 172.21.15.103:0/3834807944 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f60240608f0 con 0x7f6010038790 2024-09-17T00:58:59.613 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T00:58:59.613 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.143", "hostname": "smithi143", "labels": [], "status": ""}] 2024-09-17T00:58:59.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f6010038790 msgr2=0x7f601003ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f6010038790 0x7f601003ac50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60140098c0 tx=0x7f6014006db0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 msgr2=0x7f60240680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240680d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6020005610 tx=0x7f6020005640 comp rx=0 tx=0).stop 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 shutdown_connections 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f6010038790 0x7f601003ac50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 --2- 172.21.15.103:0/3834807944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60240fe6d0 0x7f60240680d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 >> 172.21.15.103:0/3834807944 conn(0x7f60240f9e80 msgr2=0x7f60240fa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 shutdown_connections 2024-09-17T00:58:59.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:58:59.617+0000 7f602b824640 1 -- 172.21.15.103:0/3834807944 wait complete. 2024-09-17T00:59:00.201 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T00:59:00.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T00:59:00.626 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:00 smithi103 ceph-mon[28156]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:00.710 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T00:59:01.617 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:01 smithi103 ceph-mon[28156]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:59:01.617 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:01 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:01.617 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:01 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:01.617 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:01 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:01.617 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:01 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:01.618 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:01 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 -- 172.21.15.103:0/363171652 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 msgr2=0x7f181c102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 --2- 172.21.15.103:0/363171652 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c102670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f180c009880 tx=0x7f180c02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 -- 172.21.15.103:0/363171652 shutdown_connections 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 --2- 172.21.15.103:0/363171652 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c102670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 -- 172.21.15.103:0/363171652 >> 172.21.15.103:0/363171652 conn(0x7f181c0f9e80 msgr2=0x7f181c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 -- 172.21.15.103:0/363171652 shutdown_connections 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.102+0000 7f1820aed640 1 -- 172.21.15.103:0/363171652 wait complete. 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f1820aed640 1 Processor -- start 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f1820aed640 1 -- start start 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f1820aed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c0ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f1820aed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c100040 con 0x7f181c100280 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f181a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c0ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f181a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c0ffb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35336/0 (socket says 172.21.15.103:35336) 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f181a59c640 1 -- 172.21.15.103:0/3886739128 learned_addr learned my addr 172.21.15.103:0/3886739128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T00:59:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f181a59c640 1 -- 172.21.15.103:0/3886739128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009560 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.103+0000 7f181a59c640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c0ffb00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f180c009230 tx=0x7f180c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.104+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f180c004aa0 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.104+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f180c004c00 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.104+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f180c031af0 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.104+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c0fe230 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.104+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c0fe6d0 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.105+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f180c031c50 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.105+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c105fc0 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.105+0000 7f180b7fe640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1804038740 0x7f180403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.105+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f180c06c4f0 con 0x7f181c100280 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.105+0000 7f1819d9b640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1804038740 0x7f180403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.106+0000 7f1819d9b640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1804038740 0x7f180403ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f18100098c0 tx=0x7f1810006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:02.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.110+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f180c04ddb0 con 0x7f181c100280 2024-09-17T00:59:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.295+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f181c100660 con 0x7f181c100280 2024-09-17T00:59:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:02 smithi103 ceph-mon[28156]: Deploying daemon alertmanager.smithi103 on smithi103 2024-09-17T00:59:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:02 smithi103 ceph-mon[28156]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:02 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3886739128' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T00:59:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.713+0000 7f180b7fe640 1 -- 172.21.15.103:0/3886739128 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f180c035090 con 0x7f181c100280 2024-09-17T00:59:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1804038740 msgr2=0x7f180403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1804038740 0x7f180403ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f18100098c0 tx=0x7f1810006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 msgr2=0x7f181c0ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c0ffb00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f180c009230 tx=0x7f180c0056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 shutdown_connections 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f1804038740 0x7f180403ac00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 --2- 172.21.15.103:0/3886739128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181c100280 0x7f181c0ffb00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 >> 172.21.15.103:0/3886739128 conn(0x7f181c0f9e80 msgr2=0x7f181c0fa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 shutdown_connections 2024-09-17T00:59:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T00:59:02.715+0000 7f1820aed640 1 -- 172.21.15.103:0/3886739128 wait complete. 2024-09-17T00:59:03.885 INFO:tasks.cephadm:Adding mon.smithi103 on smithi103 2024-09-17T00:59:03.885 INFO:tasks.cephadm:Adding mon.smithi143 on smithi143 2024-09-17T00:59:03.885 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi103:172.21.15.103=smithi103;smithi143:172.21.15.143=smithi143' 2024-09-17T00:59:04.098 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:04.142 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:04.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:03 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3886739128' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T00:59:04.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:03 smithi103 ceph-mon[28156]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:59:04.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:03 smithi103 ceph-mon[28156]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:05.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 -- 172.21.15.143:0/189505648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 msgr2=0x7fd7c80ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 --2- 172.21.15.143:0/189505648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c80ffc00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009880 tx=0x7fd7bc02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 -- 172.21.15.143:0/189505648 shutdown_connections 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 --2- 172.21.15.143:0/189505648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c80ffc00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 -- 172.21.15.143:0/189505648 >> 172.21.15.143:0/189505648 conn(0x7fd7c80faf90 msgr2=0x7fd7c80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 -- 172.21.15.143:0/189505648 shutdown_connections 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.673+0000 7fd7cee89640 1 -- 172.21.15.143:0/189505648 wait complete. 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7cee89640 1 Processor -- start 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7cee89640 1 -- start start 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7cee89640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c8194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7cee89640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8195280 con 0x7fd7c80ff800 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7ccc25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c8194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:05.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7ccc25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c8194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:57180/0 (socket says 172.21.15.143:57180) 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7ccc25640 1 -- 172.21.15.143:0/938003564 learned_addr learned my addr 172.21.15.143:0/938003564 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.674+0000 7fd7ccc25640 1 -- 172.21.15.143:0/938003564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc009560 con 0x7fd7c80ff800 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.675+0000 7fd7ccc25640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c8194d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009230 tx=0x7fd7bc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.675+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7bc004aa0 con 0x7fd7c80ff800 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.675+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7bc004c00 con 0x7fd7c80ff800 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.675+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c8195480 con 0x7fd7c80ff800 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.675+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7bc031a60 con 0x7fd7c80ff800 2024-09-17T00:59:05.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.675+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c8195920 con 0x7fd7c80ff800 2024-09-17T00:59:05.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.676+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fd7bc031bc0 con 0x7fd7c80ff800 2024-09-17T00:59:05.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.676+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c80ffc00 con 0x7fd7c80ff800 2024-09-17T00:59:05.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.676+0000 7fd7c5ffb640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd7b8038740 0x7fd7b803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:05.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.676+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd7bc06c470 con 0x7fd7c80ff800 2024-09-17T00:59:05.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.676+0000 7fd7c7fff640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd7b8038740 0x7fd7b803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:05.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.677+0000 7fd7c7fff640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd7b8038740 0x7fd7b803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098c0 tx=0x7fd7b4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:05.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.681+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd7bc043360 con 0x7fd7c80ff800 2024-09-17T00:59:05.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.850+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 --> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi103:172.21.15.103=smithi103;smithi143:172.21.15.143=smithi143", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7c802c5c0 con 0x7fd7b8038740 2024-09-17T00:59:05.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.858+0000 7fd7c5ffb640 1 -- 172.21.15.143:0/938003564 <== mgr.14162 v2:172.21.15.103:6800/3684168093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd7c802c5c0 con 0x7fd7b8038740 2024-09-17T00:59:05.856 INFO:teuthology.orchestra.run.smithi143.stdout:Scheduled mon update... 2024-09-17T00:59:05.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.860+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd7b8038740 msgr2=0x7fd7b803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.860+0000 7fd7cee89640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd7b8038740 0x7fd7b803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098c0 tx=0x7fd7b4006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.860+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 msgr2=0x7fd7c8194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.860+0000 7fd7cee89640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c8194d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009230 tx=0x7fd7bc0056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.861+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 shutdown_connections 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.861+0000 7fd7cee89640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd7b8038740 0x7fd7b803ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.861+0000 7fd7cee89640 1 --2- 172.21.15.143:0/938003564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7c80ff800 0x7fd7c8194d40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.861+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 >> 172.21.15.143:0/938003564 conn(0x7fd7c80faf90 msgr2=0x7fd7c80fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.861+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 shutdown_connections 2024-09-17T00:59:05.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:05.861+0000 7fd7cee89640 1 -- 172.21.15.143:0/938003564 wait complete. 2024-09-17T00:59:06.457 DEBUG:teuthology.orchestra.run.smithi143:mon.smithi143> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi143.service 2024-09-17T00:59:06.459 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:06.460 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:06.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:06 smithi103 ceph-mon[28156]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:06.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:06 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:06.628 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:06 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:06.678 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:06.733 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:07.610 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:07 smithi103 ceph-mon[28156]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi103:172.21.15.103=smithi103;smithi143:172.21.15.143=smithi143", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:07.610 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:07 smithi103 ceph-mon[28156]: Saving service mon spec with placement smithi103:172.21.15.103=smithi103;smithi143:172.21.15.143=smithi143;count:2 2024-09-17T00:59:08.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 -- 172.21.15.143:0/1824471285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 msgr2=0x7f74e00fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:08.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 --2- 172.21.15.143:0/1824471285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e00fead0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009880 tx=0x7f74d002a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 -- 172.21.15.143:0/1824471285 shutdown_connections 2024-09-17T00:59:08.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 --2- 172.21.15.143:0/1824471285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e00fead0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 -- 172.21.15.143:0/1824471285 >> 172.21.15.143:0/1824471285 conn(0x7f74e00f9e80 msgr2=0x7f74e00fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:08.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 -- 172.21.15.143:0/1824471285 shutdown_connections 2024-09-17T00:59:08.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.125+0000 7f74e62b9640 1 -- 172.21.15.143:0/1824471285 wait complete. 2024-09-17T00:59:08.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.126+0000 7f74e62b9640 1 Processor -- start 2024-09-17T00:59:08.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.126+0000 7f74e62b9640 1 -- start start 2024-09-17T00:59:08.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.126+0000 7f74e62b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e0194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:08.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.126+0000 7f74e62b9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0195230 con 0x7f74e00fe6d0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e0194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e0194cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:57198/0 (socket says 172.21.15.143:57198) 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dffff640 1 -- 172.21.15.143:0/2978218042 learned_addr learned my addr 172.21.15.143:0/2978218042 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dffff640 1 -- 172.21.15.143:0/2978218042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0009560 con 0x7f74e00fe6d0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dffff640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e0194cf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005610 tx=0x7f74d0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74d0004b20 con 0x7f74e00fe6d0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74d0004c80 con 0x7f74e00fe6d0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e0195430 con 0x7f74e00fe6d0 2024-09-17T00:59:08.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74d0031a90 con 0x7f74e00fe6d0 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.127+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e01958d0 con 0x7f74e00fe6d0 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.128+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f74d0031d50 con 0x7f74e00fe6d0 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.128+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e00fead0 con 0x7f74e00fe6d0 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.128+0000 7f74dd7fa640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f74cc038740 0x7f74cc03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.128+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f74d006c580 con 0x7f74e00fe6d0 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.129+0000 7f74df7fe640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f74cc038740 0x7f74cc03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:08.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.129+0000 7f74df7fe640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f74cc038740 0x7f74cc03ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098c0 tx=0x7f74c8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:08.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.133+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f74d004d9a0 con 0x7f74e00fe6d0 2024-09-17T00:59:08.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.356+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f74e018e720 con 0x7f74e00fe6d0 2024-09-17T00:59:08.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.357+0000 7f74dd7fa640 1 -- 172.21.15.143:0/2978218042 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f74d0035030 con 0x7f74e00fe6d0 2024-09-17T00:59:08.355 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:08.355 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:08.355 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f74cc038740 msgr2=0x7f74cc03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f74cc038740 0x7f74cc03ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098c0 tx=0x7f74c8006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 msgr2=0x7f74e0194cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e0194cf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005610 tx=0x7f74d0005640 comp rx=0 tx=0).stop 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 shutdown_connections 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f74cc038740 0x7f74cc03ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 --2- 172.21.15.143:0/2978218042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74e00fe6d0 0x7f74e0194cf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 >> 172.21.15.143:0/2978218042 conn(0x7f74e00f9e80 msgr2=0x7f74e0067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 shutdown_connections 2024-09-17T00:59:08.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:08.359+0000 7f74e62b9640 1 -- 172.21.15.143:0/2978218042 wait complete. 2024-09-17T00:59:08.600 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:08 smithi103 ceph-mon[28156]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:09.632 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:09 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/2978218042' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:09.885 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:09.885 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:10.080 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:10.124 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:59:10.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:10.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:10 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:11.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.426+0000 7f0593cfc640 1 -- 172.21.15.143:0/1362931239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 msgr2=0x7f058c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:11.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.426+0000 7f0593cfc640 1 --2- 172.21.15.143:0/1362931239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c072940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0584009880 tx=0x7f058402a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:11.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.426+0000 7f0593cfc640 1 -- 172.21.15.143:0/1362931239 shutdown_connections 2024-09-17T00:59:11.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.426+0000 7f0593cfc640 1 --2- 172.21.15.143:0/1362931239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c072940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.426+0000 7f0593cfc640 1 -- 172.21.15.143:0/1362931239 >> 172.21.15.143:0/1362931239 conn(0x7f058c0faf70 msgr2=0x7f058c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.426+0000 7f0593cfc640 1 -- 172.21.15.143:0/1362931239 shutdown_connections 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.427+0000 7f0593cfc640 1 -- 172.21.15.143:0/1362931239 wait complete. 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.427+0000 7f0593cfc640 1 Processor -- start 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.427+0000 7f0593cfc640 1 -- start start 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.427+0000 7f0593cfc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.427+0000 7f0593cfc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c19b7f0 con 0x7f058c0744e0 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0591a98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0591a98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:43480/0 (socket says 172.21.15.143:43480) 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0591a98640 1 -- 172.21.15.143:0/421431273 learned_addr learned my addr 172.21.15.143:0/421431273 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:11.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0591a98640 1 -- 172.21.15.143:0/421431273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584009560 con 0x7f058c0744e0 2024-09-17T00:59:11.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0591a98640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c19b2b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0584005610 tx=0x7f0584005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:11.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0584004b20 con 0x7f058c0744e0 2024-09-17T00:59:11.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c19b9f0 con 0x7f058c0744e0 2024-09-17T00:59:11.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0584004c80 con 0x7f058c0744e0 2024-09-17T00:59:11.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0584031a90 con 0x7f058c0744e0 2024-09-17T00:59:11.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.428+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c19be90 con 0x7f058c0744e0 2024-09-17T00:59:11.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.429+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f0584031d50 con 0x7f058c0744e0 2024-09-17T00:59:11.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.429+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c072940 con 0x7f058c0744e0 2024-09-17T00:59:11.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.429+0000 7f057effd640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0578038740 0x7f057803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:11.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.429+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f058406c580 con 0x7f058c0744e0 2024-09-17T00:59:11.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.430+0000 7f0591297640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0578038740 0x7f057803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:11.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.430+0000 7f0591297640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0578038740 0x7f057803ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f05800098c0 tx=0x7f0580006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:11.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.434+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f058404dce0 con 0x7f058c0744e0 2024-09-17T00:59:11.636 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:11 smithi103 ceph-mon[28156]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T00:59:11.636 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:11 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:59:11.637 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:11 smithi103 ceph-mon[28156]: Deploying daemon grafana.smithi103 on smithi103 2024-09-17T00:59:11.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.658+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f058c02c3e0 con 0x7f058c0744e0 2024-09-17T00:59:11.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.658+0000 7f057effd640 1 -- 172.21.15.143:0/421431273 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f0584035070 con 0x7f058c0744e0 2024-09-17T00:59:11.656 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:11.657 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:11.657 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0578038740 msgr2=0x7f057803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0578038740 0x7f057803ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f05800098c0 tx=0x7f0580006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 msgr2=0x7f058c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c19b2b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0584005610 tx=0x7f0584005640 comp rx=0 tx=0).stop 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 shutdown_connections 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f0578038740 0x7f057803ac00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:11.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 --2- 172.21.15.143:0/421431273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f058c0744e0 0x7f058c19b2b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:11.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 >> 172.21.15.143:0/421431273 conn(0x7f058c0faf70 msgr2=0x7f058c0fb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:11.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 shutdown_connections 2024-09-17T00:59:11.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:11.660+0000 7f0593cfc640 1 -- 172.21.15.143:0/421431273 wait complete. 2024-09-17T00:59:12.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:12 smithi103 ceph-mon[28156]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:12.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:12 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/421431273' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:13.213 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:13.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:13.409 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:13.453 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:14.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:14 smithi103 ceph-mon[28156]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:14.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/4052754234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 msgr2=0x7fd4b01012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:14.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 --2- 172.21.15.143:0/4052754234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b01012e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009880 tx=0x7fd4a802a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:14.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/4052754234 shutdown_connections 2024-09-17T00:59:14.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 --2- 172.21.15.143:0/4052754234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b01012e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:14.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/4052754234 >> 172.21.15.143:0/4052754234 conn(0x7fd4b00faf90 msgr2=0x7fd4b00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:14.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/4052754234 shutdown_connections 2024-09-17T00:59:14.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.874+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/4052754234 wait complete. 2024-09-17T00:59:14.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4b4b8e640 1 Processor -- start 2024-09-17T00:59:14.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4b4b8e640 1 -- start start 2024-09-17T00:59:14.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4b4b8e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b0074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4b4b8e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b00746b0 con 0x7fd4b0100ee0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4ae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b0074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4ae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b0074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:43502/0 (socket says 172.21.15.143:43502) 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.875+0000 7fd4ae59c640 1 -- 172.21.15.143:0/960347273 learned_addr learned my addr 172.21.15.143:0/960347273 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4ae59c640 1 -- 172.21.15.143:0/960347273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8009560 con 0x7fd4b0100ee0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4ae59c640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b0074170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009230 tx=0x7fd4a80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8004aa0 con 0x7fd4b0100ee0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4a8004c00 con 0x7fd4b0100ee0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b00728a0 con 0x7fd4b0100ee0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8031a60 con 0x7fd4b0100ee0 2024-09-17T00:59:14.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.876+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b0072d40 con 0x7fd4b0100ee0 2024-09-17T00:59:14.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.877+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fd4a8031bc0 con 0x7fd4b0100ee0 2024-09-17T00:59:14.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.877+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b0073740 con 0x7fd4b0100ee0 2024-09-17T00:59:14.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.877+0000 7fd4a77fe640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd49c038740 0x7fd49c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:14.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.877+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd4a806c600 con 0x7fd4b0100ee0 2024-09-17T00:59:14.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.877+0000 7fd4add9b640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd49c038740 0x7fd49c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:14.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.878+0000 7fd4add9b640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd49c038740 0x7fd49c03ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd49800ad30 tx=0x7fd4980093f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:14.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:14.883+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd4a8043360 con 0x7fd4b0100ee0 2024-09-17T00:59:15.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.105+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd4b0101330 con 0x7fd4b0100ee0 2024-09-17T00:59:15.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.106+0000 7fd4a77fe640 1 -- 172.21.15.143:0/960347273 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fd4a8035070 con 0x7fd4b0100ee0 2024-09-17T00:59:15.105 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:15.105 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:15.105 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd49c038740 msgr2=0x7fd49c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd49c038740 0x7fd49c03ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd49800ad30 tx=0x7fd4980093f0 comp rx=0 tx=0).stop 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 msgr2=0x7fd4b0074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b0074170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009230 tx=0x7fd4a80056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 shutdown_connections 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fd49c038740 0x7fd49c03ac00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 --2- 172.21.15.143:0/960347273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b0100ee0 0x7fd4b0074170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 >> 172.21.15.143:0/960347273 conn(0x7fd4b00faf90 msgr2=0x7fd4b00fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 shutdown_connections 2024-09-17T00:59:15.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:15.108+0000 7fd4b4b8e640 1 -- 172.21.15.143:0/960347273 wait complete. 2024-09-17T00:59:15.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:15 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/960347273' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:16.648 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:16 smithi103 ceph-mon[28156]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:16.651 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:16.652 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:16.838 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:16.881 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.356+0000 7f69f3fff640 1 -- 172.21.15.143:0/1011438276 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69f80317f0 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- 172.21.15.143:0/1011438276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 msgr2=0x7f69fc0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 --2- 172.21.15.143:0/1011438276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc0feaf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009880 tx=0x7f69f802a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- 172.21.15.143:0/1011438276 shutdown_connections 2024-09-17T00:59:18.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 --2- 172.21.15.143:0/1011438276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc0feaf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- 172.21.15.143:0/1011438276 >> 172.21.15.143:0/1011438276 conn(0x7f69fc0f9e80 msgr2=0x7f69fc0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- 172.21.15.143:0/1011438276 shutdown_connections 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- 172.21.15.143:0/1011438276 wait complete. 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 Processor -- start 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- start start 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:18.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.357+0000 7f6a037e3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc197400 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.358+0000 7f6a0157f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.358+0000 7f6a0157f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:43514/0 (socket says 172.21.15.143:43514) 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.358+0000 7f6a0157f640 1 -- 172.21.15.143:0/275160714 learned_addr learned my addr 172.21.15.143:0/275160714 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.358+0000 7f6a0157f640 1 -- 172.21.15.143:0/275160714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8009560 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.358+0000 7f6a0157f640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc196ec0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005610 tx=0x7f69f8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.359+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69f8004b20 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.359+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc197600 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.359+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69f8004c80 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.359+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69f8031a90 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.359+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc197aa0 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.359+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f69f8031d50 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.360+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc0feaf0 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.360+0000 7f69f27fc640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f69e8038740 0x7f69e803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.360+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f69f806c5a0 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.360+0000 7f6a00d7e640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f69e8038740 0x7f69e803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:18.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.360+0000 7f6a00d7e640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f69e8038740 0x7f69e803ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0098c0 tx=0x7f69ec006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:18.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.365+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f69f80443b0 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.593+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f69fc190a80 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.594+0000 7f69f27fc640 1 -- 172.21.15.143:0/275160714 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f69f8035070 con 0x7f69fc0fe6f0 2024-09-17T00:59:18.593 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:18.593 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:18.593 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f69e8038740 msgr2=0x7f69e803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f69e8038740 0x7f69e803ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0098c0 tx=0x7f69ec006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 msgr2=0x7f69fc196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc196ec0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005610 tx=0x7f69f8005640 comp rx=0 tx=0).stop 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 shutdown_connections 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f69e8038740 0x7f69e803ac00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 --2- 172.21.15.143:0/275160714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0fe6f0 0x7f69fc196ec0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 >> 172.21.15.143:0/275160714 conn(0x7f69fc0f9e80 msgr2=0x7f69fc0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 shutdown_connections 2024-09-17T00:59:18.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:18.596+0000 7f6a037e3640 1 -- 172.21.15.143:0/275160714 wait complete. 2024-09-17T00:59:18.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:18 smithi103 ceph-mon[28156]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:19.555 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:19 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/275160714' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:20.187 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:20.188 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:20.383 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:20.428 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:20.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:20 smithi103 ceph-mon[28156]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:21.870 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 -- 172.21.15.143:0/4265521268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 msgr2=0x7f70a00fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 --2- 172.21.15.143:0/4265521268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00fead0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7090009880 tx=0x7f709002a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 -- 172.21.15.143:0/4265521268 shutdown_connections 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 --2- 172.21.15.143:0/4265521268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00fead0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 -- 172.21.15.143:0/4265521268 >> 172.21.15.143:0/4265521268 conn(0x7f70a00f9e80 msgr2=0x7f70a00fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 -- 172.21.15.143:0/4265521268 shutdown_connections 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 -- 172.21.15.143:0/4265521268 wait complete. 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.871+0000 7f70a4f6a640 1 Processor -- start 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f70a4f6a640 1 -- start start 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f70a4f6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:21.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f70a4f6a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0068610 con 0x7f70a00fe6d0 2024-09-17T00:59:21.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f709e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:21.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f709e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:60244/0 (socket says 172.21.15.143:60244) 2024-09-17T00:59:21.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f709e59c640 1 -- 172.21.15.143:0/2034142737 learned_addr learned my addr 172.21.15.143:0/2034142737 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:21.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f709e59c640 1 -- 172.21.15.143:0/2034142737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090009560 con 0x7f70a00fe6d0 2024-09-17T00:59:21.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.872+0000 7f709e59c640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00680d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7090005610 tx=0x7f7090005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:21.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.873+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70900049d0 con 0x7f70a00fe6d0 2024-09-17T00:59:21.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.873+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0197a00 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.873+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7090004b30 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.873+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70900318e0 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.873+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a0197ea0 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.874+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f7090031ba0 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.874+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a00fead0 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.874+0000 7f708f7fe640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f7088038740 0x7f708803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.874+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f709006c380 con 0x7f70a00fe6d0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.874+0000 7f709dd9b640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f7088038740 0x7f708803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:21.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.874+0000 7f709dd9b640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f7088038740 0x7f708803ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f70940098c0 tx=0x7f7094006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:21.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:21.882+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f709004d530 con 0x7f70a00fe6d0 2024-09-17T00:59:22.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.106+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f70a018d500 con 0x7f70a00fe6d0 2024-09-17T00:59:22.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.107+0000 7f708f7fe640 1 -- 172.21.15.143:0/2034142737 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f7090035090 con 0x7f70a00fe6d0 2024-09-17T00:59:22.106 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:22.106 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:22.106 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:22.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f7088038740 msgr2=0x7f708803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:22.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f7088038740 0x7f708803ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f70940098c0 tx=0x7f7094006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:22.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 msgr2=0x7f70a00680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:22.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00680d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7090005610 tx=0x7f7090005640 comp rx=0 tx=0).stop 2024-09-17T00:59:22.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 shutdown_connections 2024-09-17T00:59:22.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f7088038740 0x7f708803ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:22.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 --2- 172.21.15.143:0/2034142737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00fe6d0 0x7f70a00680d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:22.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 >> 172.21.15.143:0/2034142737 conn(0x7f70a00f9e80 msgr2=0x7f70a00fa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:22.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 shutdown_connections 2024-09-17T00:59:22.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:22.109+0000 7f70a4f6a640 1 -- 172.21.15.143:0/2034142737 wait complete. 2024-09-17T00:59:22.579 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:22 smithi103 ceph-mon[28156]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:22.579 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:22 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/2034142737' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:23 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:23.679 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:23.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:23.873 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:23.917 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:24.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:24 smithi103 ceph-mon[28156]: Deploying daemon prometheus.smithi103 on smithi103 2024-09-17T00:59:24.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:24 smithi103 ceph-mon[28156]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:25.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 -- 172.21.15.143:0/3217186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 msgr2=0x7fe09c0fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:25.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 --2- 172.21.15.143:0/3217186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fead0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009880 tx=0x7fe08c02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:25.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 -- 172.21.15.143:0/3217186456 shutdown_connections 2024-09-17T00:59:25.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 --2- 172.21.15.143:0/3217186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fead0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:25.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 -- 172.21.15.143:0/3217186456 >> 172.21.15.143:0/3217186456 conn(0x7fe09c0f9e80 msgr2=0x7fe09c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:25.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 -- 172.21.15.143:0/3217186456 shutdown_connections 2024-09-17T00:59:25.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.428+0000 7fe0a0923640 1 -- 172.21.15.143:0/3217186456 wait complete. 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe0a0923640 1 Processor -- start 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe0a0923640 1 -- start start 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe0a0923640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe0a0923640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0fc230 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe09a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe09a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:60268/0 (socket says 172.21.15.143:60268) 2024-09-17T00:59:25.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.429+0000 7fe09a59c640 1 -- 172.21.15.143:0/292415222 learned_addr learned my addr 172.21.15.143:0/292415222 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe09a59c640 1 -- 172.21.15.143:0/292415222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c009560 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe09a59c640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fbcf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe08c005610 tx=0x7fe08c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe08c004b20 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe08c004c80 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0fa420 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe08c031a90 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.430+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c0fa8c0 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.431+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fe08c031d50 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.431+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c104ec0 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.431+0000 7fe0937fe640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fe088038740 0x7fe08803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:25.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.431+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe08c06c4c0 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.431+0000 7fe093fff640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fe088038740 0x7fe08803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:25.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.432+0000 7fe093fff640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fe088038740 0x7fe08803ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098c0 tx=0x7fe084006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:25.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.437+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe08c04dce0 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.658+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe09c0fead0 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.659+0000 7fe0937fe640 1 -- 172.21.15.143:0/292415222 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe08c035070 con 0x7fe09c0fe6d0 2024-09-17T00:59:25.658 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:25.658 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:25.658 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fe088038740 msgr2=0x7fe08803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fe088038740 0x7fe08803ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098c0 tx=0x7fe084006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 msgr2=0x7fe09c0fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fbcf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe08c005610 tx=0x7fe08c005640 comp rx=0 tx=0).stop 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 shutdown_connections 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fe088038740 0x7fe08803ac00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:25.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 --2- 172.21.15.143:0/292415222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe09c0fe6d0 0x7fe09c0fbcf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:25.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 >> 172.21.15.143:0/292415222 conn(0x7fe09c0f9e80 msgr2=0x7fe09c067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:25.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 shutdown_connections 2024-09-17T00:59:25.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:25.661+0000 7fe0a0923640 1 -- 172.21.15.143:0/292415222 wait complete. 2024-09-17T00:59:26.671 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:26 smithi103 ceph-mon[28156]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:26.671 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:26 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:26.671 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:26 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/292415222' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:27.291 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:27.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:27.487 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:27.531 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:28 smithi103 ceph-mon[28156]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:28.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 -- 172.21.15.143:0/1322168335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 msgr2=0x7fc5780ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 --2- 172.21.15.143:0/1322168335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc5780ffc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc568009880 tx=0x7fc56802a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 -- 172.21.15.143:0/1322168335 shutdown_connections 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 --2- 172.21.15.143:0/1322168335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc5780ffc00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 -- 172.21.15.143:0/1322168335 >> 172.21.15.143:0/1322168335 conn(0x7fc5780faf90 msgr2=0x7fc5780fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 -- 172.21.15.143:0/1322168335 shutdown_connections 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.959+0000 7fc57d86b640 1 -- 172.21.15.143:0/1322168335 wait complete. 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc57d86b640 1 Processor -- start 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc57d86b640 1 -- start start 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc57d86b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc578194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc57d86b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578195290 con 0x7fc5780ff800 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc576ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc578194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:28.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc576ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc578194d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:60284/0 (socket says 172.21.15.143:60284) 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.960+0000 7fc576ffd640 1 -- 172.21.15.143:0/4168000417 learned_addr learned my addr 172.21.15.143:0/4168000417 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc576ffd640 1 -- 172.21.15.143:0/4168000417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009560 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc576ffd640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc578194d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc568009230 tx=0x7fc5680056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc568004aa0 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578195490 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc568004c00 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc568031a60 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.961+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578195930 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.962+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fc568031bc0 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.962+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5780ffc00 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.962+0000 7fc57c869640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fc564038740 0x7fc56403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.962+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc56806c460 con 0x7fc5780ff800 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.962+0000 7fc56ffff640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fc564038740 0x7fc56403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:28.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.963+0000 7fc56ffff640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fc564038740 0x7fc56403ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5600098c0 tx=0x7fc560006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:28.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:28.967+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc56804d760 con 0x7fc5780ff800 2024-09-17T00:59:29.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.192+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc57802c3e0 con 0x7fc5780ff800 2024-09-17T00:59:29.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.192+0000 7fc57c869640 1 -- 172.21.15.143:0/4168000417 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fc568035020 con 0x7fc5780ff800 2024-09-17T00:59:29.191 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:29.192 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:29.192 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fc564038740 msgr2=0x7fc56403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fc564038740 0x7fc56403ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5600098c0 tx=0x7fc560006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 msgr2=0x7fc578194d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc578194d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc568009230 tx=0x7fc5680056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 shutdown_connections 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fc564038740 0x7fc56403ac00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:29.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 --2- 172.21.15.143:0/4168000417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5780ff800 0x7fc578194d50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 >> 172.21.15.143:0/4168000417 conn(0x7fc5780faf90 msgr2=0x7fc5780fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 shutdown_connections 2024-09-17T00:59:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:29.195+0000 7fc57d86b640 1 -- 172.21.15.143:0/4168000417 wait complete. 2024-09-17T00:59:29.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:29 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/4168000417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:30.607 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:30 smithi103 ceph-mon[28156]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:30.785 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:30.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:31.024 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:32.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:32 smithi103 ceph-mon[28156]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 -- 172.21.15.143:0/2922613488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 msgr2=0x7fdb4c0fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 --2- 172.21.15.143:0/2922613488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fead0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009c20 tx=0x7fdb3c02aa90 comp rx=0 tx=0).stop 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 -- 172.21.15.143:0/2922613488 shutdown_connections 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 --2- 172.21.15.143:0/2922613488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fead0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 -- 172.21.15.143:0/2922613488 >> 172.21.15.143:0/2922613488 conn(0x7fdb4c0f9e80 msgr2=0x7fdb4c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 -- 172.21.15.143:0/2922613488 shutdown_connections 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 -- 172.21.15.143:0/2922613488 wait complete. 2024-09-17T00:59:32.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.534+0000 7fdb516bf640 1 Processor -- start 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb516bf640 1 -- start start 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb516bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb516bf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0fc230 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb4affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb4affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:40240/0 (socket says 172.21.15.143:40240) 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb4affd640 1 -- 172.21.15.143:0/4262699019 learned_addr learned my addr 172.21.15.143:0/4262699019 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.535+0000 7fdb4affd640 1 -- 172.21.15.143:0/4262699019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c009900 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.536+0000 7fdb4affd640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fbcf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c02f040 tx=0x7fdb3c02e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:32.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.536+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb3c03e070 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.536+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb3c02e940 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.536+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c0fa420 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.536+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb3c038450 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.536+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c0fa8c0 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.537+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fdb3c00a040 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.537+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c104ec0 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.537+0000 7fdb33fff640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fdb34038740 0x7fdb3403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:32.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.537+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdb3c06c400 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.537+0000 7fdb4a7fc640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fdb34038740 0x7fdb3403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:32.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.537+0000 7fdb4a7fc640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fdb34038740 0x7fdb3403ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb400098c0 tx=0x7fdb40006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:32.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.542+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdb3c04c440 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.770+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdb4c0feb50 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.771+0000 7fdb33fff640 1 -- 172.21.15.143:0/4262699019 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fdb3c047020 con 0x7fdb4c0fe6d0 2024-09-17T00:59:32.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:32.770 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:32.770 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:32.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fdb34038740 msgr2=0x7fdb3403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:32.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fdb34038740 0x7fdb3403ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb400098c0 tx=0x7fdb40006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 msgr2=0x7fdb4c0fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:32.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fbcf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c02f040 tx=0x7fdb3c02e5f0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 shutdown_connections 2024-09-17T00:59:32.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7fdb34038740 0x7fdb3403ac00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 --2- 172.21.15.143:0/4262699019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0fe6d0 0x7fdb4c0fbcf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.773+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 >> 172.21.15.143:0/4262699019 conn(0x7fdb4c0f9e80 msgr2=0x7fdb4c067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:32.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.774+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 shutdown_connections 2024-09-17T00:59:32.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:32.774+0000 7fdb516bf640 1 -- 172.21.15.143:0/4262699019 wait complete. 2024-09-17T00:59:33.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:33 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/4262699019' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:33.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:33 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:33.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:33 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:33.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:33 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:33.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:33 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:59:34.381 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:34.381 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:34.557 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:34 smithi103 ceph-mon[28156]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:34.557 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:34 smithi103 ceph-mon[28156]: from='mgr.14162 172.21.15.103:0/1679630182' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:59:34.557 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:34 smithi103 ceph-mon[28156]: mgrmap e14: smithi103.efjaur(active, since 58s) 2024-09-17T00:59:34.566 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:34.611 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:36.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 -- 172.21.15.143:0/237515035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 msgr2=0x7f4d200fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:36.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 --2- 172.21.15.143:0/237515035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d200fead0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009c20 tx=0x7f4d1002aa90 comp rx=0 tx=0).stop 2024-09-17T00:59:36.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 -- 172.21.15.143:0/237515035 shutdown_connections 2024-09-17T00:59:36.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 --2- 172.21.15.143:0/237515035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d200fead0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:36.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 -- 172.21.15.143:0/237515035 >> 172.21.15.143:0/237515035 conn(0x7f4d200f9e80 msgr2=0x7f4d200fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 -- 172.21.15.143:0/237515035 shutdown_connections 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.087+0000 7f4d24bfa640 1 -- 172.21.15.143:0/237515035 wait complete. 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d24bfa640 1 Processor -- start 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d24bfa640 1 -- start start 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d24bfa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d20194d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d24bfa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20195270 con 0x7f4d200fe6d0 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d1e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d20194d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d1e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d20194d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:40254/0 (socket says 172.21.15.143:40254) 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d1e59c640 1 -- 172.21.15.143:0/4241860484 learned_addr learned my addr 172.21.15.143:0/4241860484 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:36.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.088+0000 7f4d1e59c640 1 -- 172.21.15.143:0/4241860484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10009900 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.089+0000 7f4d1e59c640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d20194d30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4d10005cc0 tx=0x7f4d1002e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.089+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d1003e070 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.089+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d20195470 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.089+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d1002e990 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.089+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d10038450 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.089+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d20195910 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.090+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 14) v1 ==== 45627+0+0 (secure 0 0 0) 0x7f4d1000a040 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.090+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d200feb50 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.090+0000 7f4d0f7fe640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 0x7f4d0803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.090+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4d1006c2c0 con 0x7f4d200fe6d0 2024-09-17T00:59:36.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.090+0000 7f4d1dd9b640 1 -- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 msgr2=0x7f4d0803ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3684168093 2024-09-17T00:59:36.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.090+0000 7f4d1dd9b640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 0x7f4d0803ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:59:36.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.095+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4d1004c440 con 0x7f4d200fe6d0 2024-09-17T00:59:36.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.291+0000 7f4d1dd9b640 1 -- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 msgr2=0x7f4d0803ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3684168093 2024-09-17T00:59:36.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.291+0000 7f4d1dd9b640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 0x7f4d0803ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:59:36.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.320+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4d2002c3e0 con 0x7f4d200fe6d0 2024-09-17T00:59:36.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.321+0000 7f4d0f7fe640 1 -- 172.21.15.143:0/4241860484 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f4d10047020 con 0x7f4d200fe6d0 2024-09-17T00:59:36.320 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:36.320 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:36.320 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:36.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 msgr2=0x7f4d0803ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:59:36.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 0x7f4d0803ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:36.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 msgr2=0x7f4d20194d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:36.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d20194d30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4d10005cc0 tx=0x7f4d1002e5f0 comp rx=0 tx=0).stop 2024-09-17T00:59:36.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 shutdown_connections 2024-09-17T00:59:36.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:6800/3684168093,v1:172.21.15.103:6801/3684168093] conn(0x7f4d08038790 0x7f4d0803ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:36.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 --2- 172.21.15.143:0/4241860484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d200fe6d0 0x7f4d20194d30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:36.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 >> 172.21.15.143:0/4241860484 conn(0x7f4d200f9e80 msgr2=0x7f4d20067b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:36.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 shutdown_connections 2024-09-17T00:59:36.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:36.323+0000 7f4d24bfa640 1 -- 172.21.15.143:0/4241860484 wait complete. 2024-09-17T00:59:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:36 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/4241860484' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:38.008 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:38.009 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:38.206 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:38.250 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: Active manager daemon smithi103.efjaur restarted 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: Activating manager daemon smithi103.efjaur 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: mgrmap e15: smithi103.efjaur(active, starting, since 0.00400175s) 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:59:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: Manager daemon smithi103.efjaur is now available 2024-09-17T00:59:38.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:38.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:38.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:38.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.612+0000 7fe180af6640 1 -- 172.21.15.143:0/4287200424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 msgr2=0x7fe17c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.612+0000 7fe180af6640 1 --2- 172.21.15.143:0/4287200424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c100100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009880 tx=0x7fe16c02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.612+0000 7fe180af6640 1 -- 172.21.15.143:0/4287200424 shutdown_connections 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.612+0000 7fe180af6640 1 --2- 172.21.15.143:0/4287200424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c100100 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.612+0000 7fe180af6640 1 -- 172.21.15.143:0/4287200424 >> 172.21.15.143:0/4287200424 conn(0x7fe17c0f9620 msgr2=0x7fe17c0fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.613+0000 7fe180af6640 1 -- 172.21.15.143:0/4287200424 shutdown_connections 2024-09-17T00:59:39.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.613+0000 7fe180af6640 1 -- 172.21.15.143:0/4287200424 wait complete. 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.613+0000 7fe180af6640 1 Processor -- start 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.613+0000 7fe180af6640 1 -- start start 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe180af6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c0fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe180af6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0fe810 con 0x7fe17c0ffd00 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe17a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c0fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe17a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c0fe2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:34132/0 (socket says 172.21.15.143:34132) 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe17a59c640 1 -- 172.21.15.143:0/2914399957 learned_addr learned my addr 172.21.15.143:0/2914399957 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:39.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe17a59c640 1 -- 172.21.15.143:0/2914399957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009560 con 0x7fe17c0ffd00 2024-09-17T00:59:39.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.614+0000 7fe17a59c640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c0fe2d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe16c005610 tx=0x7fe16c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:39.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.615+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe16c0049d0 con 0x7fe17c0ffd00 2024-09-17T00:59:39.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.615+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe16c004b30 con 0x7fe17c0ffd00 2024-09-17T00:59:39.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.615+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c1979a0 con 0x7fe17c0ffd00 2024-09-17T00:59:39.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.615+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe16c031910 con 0x7fe17c0ffd00 2024-09-17T00:59:39.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.615+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c197e40 con 0x7fe17c0ffd00 2024-09-17T00:59:39.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.615+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) v1 ==== 45477+0+0 (secure 0 0 0) 0x7fe16c031bd0 con 0x7fe17c0ffd00 2024-09-17T00:59:39.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.616+0000 7fe16b7fe640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fe1640385d0 0x7fe16403aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:39.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.616+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c100100 con 0x7fe17c0ffd00 2024-09-17T00:59:39.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.616+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe16c06c310 con 0x7fe17c0ffd00 2024-09-17T00:59:39.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.616+0000 7fe179d9b640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fe1640385d0 0x7fe16403aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:39.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.616+0000 7fe179d9b640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fe1640385d0 0x7fe16403aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe1700098c0 tx=0x7fe170006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:39.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.620+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe16c035080 con 0x7fe17c0ffd00 2024-09-17T00:59:39.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:39.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:39.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:39 smithi103 ceph-mon[28156]: mgrmap e16: smithi103.efjaur(active, since 1.00554s) 2024-09-17T00:59:39.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.854+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe17c18d520 con 0x7fe17c0ffd00 2024-09-17T00:59:39.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.855+0000 7fe16b7fe640 1 -- 172.21.15.143:0/2914399957 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe16c040020 con 0x7fe17c0ffd00 2024-09-17T00:59:39.853 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:39.853 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:39.854 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:39.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fe1640385d0 msgr2=0x7fe16403aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:39.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fe1640385d0 0x7fe16403aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe1700098c0 tx=0x7fe170006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:39.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 msgr2=0x7fe17c0fe2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:39.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c0fe2d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe16c005610 tx=0x7fe16c005640 comp rx=0 tx=0).stop 2024-09-17T00:59:39.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 shutdown_connections 2024-09-17T00:59:39.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fe1640385d0 0x7fe16403aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 --2- 172.21.15.143:0/2914399957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17c0ffd00 0x7fe17c0fe2d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 >> 172.21.15.143:0/2914399957 conn(0x7fe17c0f9620 msgr2=0x7fe17c0fa040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 shutdown_connections 2024-09-17T00:59:39.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:39.857+0000 7fe180af6640 1 -- 172.21.15.143:0/2914399957 wait complete. 2024-09-17T00:59:40.985 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:40 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:40.985 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:40 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/2914399957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:40.985 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:40 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:41.414 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:41.414 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:41.737 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:41.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:41 smithi103 ceph-mon[28156]: [17/Sep/2024:00:59:40] ENGINE Bus STARTING 2024-09-17T00:59:41.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:41 smithi103 ceph-mon[28156]: mgrmap e17: smithi103.efjaur(active, since 2s) 2024-09-17T00:59:42.219 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:42 smithi103 ceph-mon[28156]: [17/Sep/2024:00:59:41] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:42 smithi103 ceph-mon[28156]: [17/Sep/2024:00:59:41] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:42 smithi103 ceph-mon[28156]: [17/Sep/2024:00:59:41] ENGINE Bus STARTED 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:42 smithi103 ceph-mon[28156]: [17/Sep/2024:00:59:41] ENGINE Error in HTTPServer.serve 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T00:59:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-17T00:59:43.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T00:59:44.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:44.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:44.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:44.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:44.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:59:44.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.412+0000 7f0029da5640 1 -- 172.21.15.143:0/1369170617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 msgr2=0x7f00241026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:44.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.412+0000 7f0029da5640 1 --2- 172.21.15.143:0/1369170617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f00241026f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0014009880 tx=0x7f001402a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:44.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 -- 172.21.15.143:0/1369170617 shutdown_connections 2024-09-17T00:59:44.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 --2- 172.21.15.143:0/1369170617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f00241026f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:44.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 -- 172.21.15.143:0/1369170617 >> 172.21.15.143:0/1369170617 conn(0x7f00240f9e80 msgr2=0x7f00240fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 -- 172.21.15.143:0/1369170617 shutdown_connections 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 -- 172.21.15.143:0/1369170617 wait complete. 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 Processor -- start 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.413+0000 7f0029da5640 1 -- start start 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f0029da5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f0024194ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f0029da5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00241951e0 con 0x7f0024100300 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f00237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f0024194ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f00237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f0024194ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:34140/0 (socket says 172.21.15.143:34140) 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f00237fe640 1 -- 172.21.15.143:0/806140132 learned_addr learned my addr 172.21.15.143:0/806140132 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f00237fe640 1 -- 172.21.15.143:0/806140132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0014009560 con 0x7f0024100300 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.414+0000 7f00237fe640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f0024194ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0014006010 tx=0x7f0014005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:44.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.415+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0014004aa0 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.415+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0014004c00 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.415+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00241953e0 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.415+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0014031a80 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.415+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0024195880 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.416+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f0014031d40 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.416+0000 7f0020ff9640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f000c038830 0x7f000c03acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.416+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00241006e0 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.416+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f001406c7e0 con 0x7f0024100300 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.416+0000 7f0022ffd640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f000c038830 0x7f000c03acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.417+0000 7f0022ffd640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f000c038830 0x7f000c03acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f00180098c0 tx=0x7f0018006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:44.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.421+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0014040080 con 0x7f0024100300 2024-09-17T00:59:44.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.665+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f002402c3e0 con 0x7f0024100300 2024-09-17T00:59:44.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.665+0000 7f0020ff9640 1 -- 172.21.15.143:0/806140132 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f0014043360 con 0x7f0024100300 2024-09-17T00:59:44.663 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:44.664 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:44.664 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f000c038830 msgr2=0x7f000c03acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f000c038830 0x7f000c03acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f00180098c0 tx=0x7f0018006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 msgr2=0x7f0024194ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f0024194ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0014006010 tx=0x7f0014005630 comp rx=0 tx=0).stop 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 shutdown_connections 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f000c038830 0x7f000c03acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 --2- 172.21.15.143:0/806140132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0024100300 0x7f0024194ca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 >> 172.21.15.143:0/806140132 conn(0x7f00240f9e80 msgr2=0x7f00240fa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 shutdown_connections 2024-09-17T00:59:44.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:44.668+0000 7f0029da5640 1 -- 172.21.15.143:0/806140132 wait complete. 2024-09-17T00:59:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd/host:smithi143", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:59:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/806140132' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T00:59:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T00:59:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:45 smithi103 ceph-mon[28156]: Deploying daemon ceph-exporter.smithi143 on smithi143 2024-09-17T00:59:46.278 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:46.278 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:46.475 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:59:48.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 -- 172.21.15.143:0/1181510178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 msgr2=0x7f5b00104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:48.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 --2- 172.21.15.143:0/1181510178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00104a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009880 tx=0x7f5af002a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:48.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 -- 172.21.15.143:0/1181510178 shutdown_connections 2024-09-17T00:59:48.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 --2- 172.21.15.143:0/1181510178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00104a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:48.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 -- 172.21.15.143:0/1181510178 >> 172.21.15.143:0/1181510178 conn(0x7f5b000fa360 msgr2=0x7f5b000fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 -- 172.21.15.143:0/1181510178 shutdown_connections 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.157+0000 7f5b04c88640 1 -- 172.21.15.143:0/1181510178 wait complete. 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.158+0000 7f5b04c88640 1 Processor -- start 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.158+0000 7f5b04c88640 1 -- start start 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.159+0000 7f5b04c88640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00195010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.159+0000 7f5b04c88640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00195550 con 0x7f5b00104660 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.159+0000 7f5afe59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00195010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.159+0000 7f5afe59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00195010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:34158/0 (socket says 172.21.15.143:34158) 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.159+0000 7f5afe59c640 1 -- 172.21.15.143:0/667474196 learned_addr learned my addr 172.21.15.143:0/667474196 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.159+0000 7f5afe59c640 1 -- 172.21.15.143:0/667474196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009560 con 0x7f5b00104660 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.160+0000 7f5afe59c640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00195010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009230 tx=0x7f5af00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.160+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5af0004aa0 con 0x7f5b00104660 2024-09-17T00:59:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.160+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5af0004c00 con 0x7f5b00104660 2024-09-17T00:59:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.160+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b001957b0 con 0x7f5b00104660 2024-09-17T00:59:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.160+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5af0031940 con 0x7f5b00104660 2024-09-17T00:59:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.160+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00195c30 con 0x7f5b00104660 2024-09-17T00:59:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.161+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f5af0031aa0 con 0x7f5b00104660 2024-09-17T00:59:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.161+0000 7f5af7fff640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5aec038880 0x7f5aec03ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.161+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f5af006d520 con 0x7f5b00104660 2024-09-17T00:59:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.161+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b000ffda0 con 0x7f5b00104660 2024-09-17T00:59:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.161+0000 7f5af5d9b640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5aec038880 0x7f5aec03ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.162+0000 7f5af5d9b640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5aec038880 0x7f5aec03ad40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80098c0 tx=0x7f5ae8006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:48.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.166+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5af0035080 con 0x7f5b00104660 2024-09-17T00:59:48.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.396+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5b00104a40 con 0x7f5b00104660 2024-09-17T00:59:48.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.397+0000 7f5af7fff640 1 -- 172.21.15.143:0/667474196 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f5af0040020 con 0x7f5b00104660 2024-09-17T00:59:48.395 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:48.395 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:48.395 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5aec038880 msgr2=0x7f5aec03ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5aec038880 0x7f5aec03ad40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80098c0 tx=0x7f5ae8006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 msgr2=0x7f5b00195010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00195010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009230 tx=0x7f5af00056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 shutdown_connections 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5aec038880 0x7f5aec03ad40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 --2- 172.21.15.143:0/667474196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00104660 0x7f5b00195010 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:48.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 >> 172.21.15.143:0/667474196 conn(0x7f5b000fa360 msgr2=0x7f5b001032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:48.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 shutdown_connections 2024-09-17T00:59:48.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:48.399+0000 7f5b04c88640 1 -- 172.21.15.143:0/667474196 wait complete. 2024-09-17T00:59:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:48 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/667474196' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:50.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:50.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:50.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:50.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:59:50.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T00:59:50.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:50.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:49 smithi103 ceph-mon[28156]: Deploying daemon crash.smithi143 on smithi143 2024-09-17T00:59:50.278 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:50.278 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:50.483 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 -- 172.21.15.143:0/1494635034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 msgr2=0x7f6a40104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 --2- 172.21.15.143:0/1494635034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40104a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009880 tx=0x7f6a3c02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 -- 172.21.15.143:0/1494635034 shutdown_connections 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 --2- 172.21.15.143:0/1494635034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40104a50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 -- 172.21.15.143:0/1494635034 >> 172.21.15.143:0/1494635034 conn(0x7f6a400fa350 msgr2=0x7f6a400fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 -- 172.21.15.143:0/1494635034 shutdown_connections 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.931+0000 7f6a48304640 1 -- 172.21.15.143:0/1494635034 wait complete. 2024-09-17T00:59:51.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.932+0000 7f6a48304640 1 Processor -- start 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.932+0000 7f6a48304640 1 -- start start 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.932+0000 7f6a48304640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.932+0000 7f6a48304640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40068e40 con 0x7f6a40104670 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a460a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a460a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:55408/0 (socket says 172.21.15.143:55408) 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a460a0640 1 -- 172.21.15.143:0/4119611943 learned_addr learned my addr 172.21.15.143:0/4119611943 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a460a0640 1 -- 172.21.15.143:0/4119611943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009560 con 0x7f6a40104670 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a460a0640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40195ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009230 tx=0x7f6a3c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3c004aa0 con 0x7f6a40104670 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a40196460 con 0x7f6a40104670 2024-09-17T00:59:51.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a3c004c00 con 0x7f6a40104670 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.933+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3c031940 con 0x7f6a40104670 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.934+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a401968e0 con 0x7f6a40104670 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.934+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a400ffdb0 con 0x7f6a40104670 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.934+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f6a3c031b00 con 0x7f6a40104670 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.935+0000 7f6a377fe640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f6a2c038830 0x7f6a2c03acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.935+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6a3c06c600 con 0x7f6a40104670 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.935+0000 7f6a4589f640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f6a2c038830 0x7f6a2c03acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.935+0000 7f6a4589f640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f6a2c038830 0x7f6a2c03acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a300098c0 tx=0x7f6a30006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:51.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:51.939+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6a3c03a590 con 0x7f6a40104670 2024-09-17T00:59:52.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.167+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6a40196be0 con 0x7f6a40104670 2024-09-17T00:59:52.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.168+0000 7f6a377fe640 1 -- 172.21.15.143:0/4119611943 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f6a3c035090 con 0x7f6a40104670 2024-09-17T00:59:52.167 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:52.167 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:52.168 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f6a2c038830 msgr2=0x7f6a2c03acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f6a2c038830 0x7f6a2c03acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a300098c0 tx=0x7f6a30006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 msgr2=0x7f6a40195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40195ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009230 tx=0x7f6a3c0056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 shutdown_connections 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f6a2c038830 0x7f6a2c03acf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 --2- 172.21.15.143:0/4119611943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40104670 0x7f6a40195ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 >> 172.21.15.143:0/4119611943 conn(0x7f6a400fa350 msgr2=0x7f6a400fa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 shutdown_connections 2024-09-17T00:59:52.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:52.171+0000 7f6a48304640 1 -- 172.21.15.143:0/4119611943 wait complete. 2024-09-17T00:59:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:52 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/4119611943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:53 smithi103 ceph-mon[28156]: Deploying daemon node-exporter.smithi143 on smithi143 2024-09-17T00:59:54.045 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:54.046 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:54.243 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:59:54.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:54.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.841+0000 7f3cb0842640 1 -- 172.21.15.143:0/423905553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 msgr2=0x7f3cac104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.841+0000 7f3cb0842640 1 --2- 172.21.15.143:0/423905553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac104a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009880 tx=0x7f3c9c02a5d0 comp rx=0 tx=0).stop 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 -- 172.21.15.143:0/423905553 shutdown_connections 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 --2- 172.21.15.143:0/423905553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac104a50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 -- 172.21.15.143:0/423905553 >> 172.21.15.143:0/423905553 conn(0x7f3cac0fa390 msgr2=0x7f3cac0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 -- 172.21.15.143:0/423905553 shutdown_connections 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 -- 172.21.15.143:0/423905553 wait complete. 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 Processor -- start 2024-09-17T00:59:56.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.842+0000 7f3cb0842640 1 -- start start 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3cb0842640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac195050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3cb0842640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac195590 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3caa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac195050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3caa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac195050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:55428/0 (socket says 172.21.15.143:55428) 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3caa59c640 1 -- 172.21.15.143:0/856363893 learned_addr learned my addr 172.21.15.143:0/856363893 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3caa59c640 1 -- 172.21.15.143:0/856363893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009560 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3caa59c640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac195050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009230 tx=0x7f3c9c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.843+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c9c004aa0 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.844+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac1957f0 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.844+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c9c004c00 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.844+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c9c031940 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.844+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac195c70 con 0x7f3cac104670 2024-09-17T00:59:56.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.844+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac18e3d0 con 0x7f3cac104670 2024-09-17T00:59:56.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.844+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f3c9c031aa0 con 0x7f3cac104670 2024-09-17T00:59:56.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.845+0000 7f3ca37fe640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3c98038830 0x7f3c9803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:56.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.845+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3c9c06c5f0 con 0x7f3cac104670 2024-09-17T00:59:56.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.845+0000 7f3ca3fff640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3c98038830 0x7f3c9803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:56.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.845+0000 7f3ca3fff640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3c98038830 0x7f3c9803acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c940098c0 tx=0x7f3c94006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:56.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:56.850+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3c9c004d70 con 0x7f3cac104670 2024-09-17T00:59:57.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.080+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3cac0ffdb0 con 0x7f3cac104670 2024-09-17T00:59:57.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.081+0000 7f3ca37fe640 1 -- 172.21.15.143:0/856363893 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f3c9c035020 con 0x7f3cac104670 2024-09-17T00:59:57.081 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T00:59:57.081 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:59:57.082 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T00:59:57.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3c98038830 msgr2=0x7f3c9803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:57.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3c98038830 0x7f3c9803acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c940098c0 tx=0x7f3c94006db0 comp rx=0 tx=0).stop 2024-09-17T00:59:57.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 msgr2=0x7f3cac195050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:57.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac195050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009230 tx=0x7f3c9c0056e0 comp rx=0 tx=0).stop 2024-09-17T00:59:57.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 shutdown_connections 2024-09-17T00:59:57.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3c98038830 0x7f3c9803acf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:57.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 --2- 172.21.15.143:0/856363893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac104670 0x7f3cac195050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:57.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 >> 172.21.15.143:0/856363893 conn(0x7f3cac0fa390 msgr2=0x7f3cac067e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:57.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 shutdown_connections 2024-09-17T00:59:57.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T00:59:57.083+0000 7f3cb0842640 1 -- 172.21.15.143:0/856363893 wait complete. 2024-09-17T00:59:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:57 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/856363893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:59:58.742 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:59:58.742 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:59:58.968 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:59:59.229 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:59.229 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: Deploying daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:59:59.230 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 00:59:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 -- 172.21.15.143:0/1781464764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 msgr2=0x7f95f4100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 --2- 172.21.15.143:0/1781464764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4100db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009880 tx=0x7f95e402a670 comp rx=0 tx=0).stop 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 -- 172.21.15.143:0/1781464764 shutdown_connections 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 --2- 172.21.15.143:0/1781464764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4100db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 -- 172.21.15.143:0/1781464764 >> 172.21.15.143:0/1781464764 conn(0x7f95f4075460 msgr2=0x7f95f40fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 -- 172.21.15.143:0/1781464764 shutdown_connections 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.570+0000 7f95f8f16640 1 -- 172.21.15.143:0/1781464764 wait complete. 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.571+0000 7f95f8f16640 1 Processor -- start 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.571+0000 7f95f8f16640 1 -- start start 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.571+0000 7f95f8f16640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4195020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.571+0000 7f95f8f16640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4195560 con 0x7f95f41009d0 2024-09-17T01:00:01.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4195020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:01.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4195020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:39038/0 (socket says 172.21.15.143:39038) 2024-09-17T01:00:01.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f259c640 1 -- 172.21.15.143:0/913250953 learned_addr learned my addr 172.21.15.143:0/913250953 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:00:01.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f259c640 1 -- 172.21.15.143:0/913250953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009560 con 0x7f95f41009d0 2024-09-17T01:00:01.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f259c640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4195020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009230 tx=0x7f95e4004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95e4005320 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f4195760 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95e4005480 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95e403c8e0 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.572+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f4195b80 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.573+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f4067e90 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.573+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f95e403cb10 con 0x7f95f41009d0 2024-09-17T01:00:01.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.573+0000 7f95e37fe640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f95dc038880 0x7f95dc03ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:01.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.574+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f95e406c660 con 0x7f95f41009d0 2024-09-17T01:00:01.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.574+0000 7f95f1d9b640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f95dc038880 0x7f95dc03ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:01.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.574+0000 7f95f1d9b640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f95dc038880 0x7f95dc03ad40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098c0 tx=0x7f95e8006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:01.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.579+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f95e40037d0 con 0x7f95f41009d0 2024-09-17T01:00:01.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.817+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f95f4109c40 con 0x7f95f41009d0 2024-09-17T01:00:01.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.818+0000 7f95e37fe640 1 -- 172.21.15.143:0/913250953 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f95e4035070 con 0x7f95f41009d0 2024-09-17T01:00:01.817 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T01:00:01.817 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:00:01.817 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f95dc038880 msgr2=0x7f95dc03ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f95dc038880 0x7f95dc03ad40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098c0 tx=0x7f95e8006db0 comp rx=0 tx=0).stop 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 msgr2=0x7f95f4195020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4195020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009230 tx=0x7f95e4004d80 comp rx=0 tx=0).stop 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 shutdown_connections 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f95dc038880 0x7f95dc03ad40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 --2- 172.21.15.143:0/913250953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f41009d0 0x7f95f4195020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 >> 172.21.15.143:0/913250953 conn(0x7f95f4075460 msgr2=0x7f95f4101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 shutdown_connections 2024-09-17T01:00:01.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:01.820+0000 7f95f8f16640 1 -- 172.21.15.143:0/913250953 wait complete. 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:00:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:02 smithi103 ceph-mon[28156]: Deploying daemon mon.smithi143 on smithi143 2024-09-17T01:00:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:02 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/913250953' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:00:03.524 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:00:03.524 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:00:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:03 smithi103 ceph-mon[28156]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:03 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:04.567 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:00:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:05 smithi103 ceph-mon[28156]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:06.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 -- 172.21.15.143:0/256456990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 msgr2=0x7f1988105e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 --2- 172.21.15.143:0/256456990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988105e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1978009c20 tx=0x7f197802aa90 comp rx=0 tx=0).stop 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 -- 172.21.15.143:0/256456990 shutdown_connections 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 --2- 172.21.15.143:0/256456990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988105e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 -- 172.21.15.143:0/256456990 >> 172.21.15.143:0/256456990 conn(0x7f1988074620 msgr2=0x7f1988074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 -- 172.21.15.143:0/256456990 shutdown_connections 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.314+0000 7f198f4bf640 1 -- 172.21.15.143:0/256456990 wait complete. 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.315+0000 7f198f4bf640 1 Processor -- start 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.315+0000 7f198f4bf640 1 -- start start 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.315+0000 7f198f4bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988195200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.315+0000 7f198f4bf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988195740 con 0x7f1988105a20 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.315+0000 7f198d25b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988195200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.315+0000 7f198d25b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988195200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.143:39060/0 (socket says 172.21.15.143:39060) 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f198d25b640 1 -- 172.21.15.143:0/1578935704 learned_addr learned my addr 172.21.15.143:0/1578935704 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:00:06.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f198d25b640 1 -- 172.21.15.143:0/1578935704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978009900 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f198d25b640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988195200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f197802f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197803e070 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19881959a0 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1978003e20 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1978004670 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.316+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1988195ea0 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.317+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f197800a040 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.317+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19881010b0 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.317+0000 7f19867fc640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1970038830 0x7f197003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.317+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f197806c850 con 0x7f1988105a20 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.318+0000 7f198ca5a640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1970038830 0x7f197003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.318+0000 7f198ca5a640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1970038830 0x7f197003acf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f197c0098c0 tx=0x7f197c006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:06.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.322+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f197802fbf0 con 0x7f1988105a20 2024-09-17T01:00:06.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.568+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1988105e80 con 0x7f1988105a20 2024-09-17T01:00:06.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.569+0000 7f19867fc640 1 -- 172.21.15.143:0/1578935704 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f1978033070 con 0x7f1988105a20 2024-09-17T01:00:06.568 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T01:00:06.568 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T00:57:34.622316Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:00:06.568 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-17T01:00:06.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1970038830 msgr2=0x7f197003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1970038830 0x7f197003acf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f197c0098c0 tx=0x7f197c006db0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 msgr2=0x7f1988195200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988195200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f197802f8a0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 shutdown_connections 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1970038830 0x7f197003acf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 --2- 172.21.15.143:0/1578935704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1988105a20 0x7f1988195200 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 >> 172.21.15.143:0/1578935704 conn(0x7f1988074620 msgr2=0x7f19880fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 shutdown_connections 2024-09-17T01:00:06.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:06.571+0000 7f198f4bf640 1 -- 172.21.15.143:0/1578935704 wait complete. 2024-09-17T01:00:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:06 smithi103 ceph-mon[28156]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:00:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:06 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:00:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:06 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:00:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:06 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:00:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:06 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:00:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/1578935704' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:00:07.401 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 podman[35417]: 2024-09-17 01:00:07.381358184 +0000 UTC m=+0.989250169 container start a7eceba58ad37033c83d5e1373509ec8e78f0439458f73aa9e9af663dab2b160 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T01:00:07.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:00:07.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 2 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: pidfile_write: ignore empty --pid-file 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: load: jerasure load: lrc 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Git sha 0 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: DB SUMMARY 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: DB Session ID: S8QLKC6S1N2W1STJE31D 2024-09-17T01:00:07.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi143/store.db dir, Total Num: 0, files: 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi143/store.db: 000004.log size: 511 ; 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:00:07.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.env: 0x564111029bc0 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.info_log: 0x5641132bcdc0 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:00:07.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.statistics: (nil) 2024-09-17T01:00:07.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.use_fsync: 0 2024-09-17T01:00:07.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:00:07.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:00:07.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:00:07.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:00:07.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:00:07.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:00:07.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:00:07.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:00:07.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:00:07.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:00:07.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:00:07.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.db_log_dir: 2024-09-17T01:00:07.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.wal_dir: 2024-09-17T01:00:07.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:00:07.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:00:07.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:00:07.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:00:07.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:00:07.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:00:07.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:00:07.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:00:07.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.write_buffer_manager: 0x5641132ca320 2024-09-17T01:00:07.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:00:07.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:00:07.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:00:07.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:00:07.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:00:07.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:00:07.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:00:07.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:00:07.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.unordered_write: 0 2024-09-17T01:00:07.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:00:07.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:00:07.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:00:07.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:00:07.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.row_cache: None 2024-09-17T01:00:07.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.wal_filter: None 2024-09-17T01:00:07.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:00:07.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:00:07.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:00:07.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:00:07.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.wal_compression: 0 2024-09-17T01:00:07.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:00:07.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:00:07.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:00:07.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:00:07.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:00:07.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:00:07.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:00:07.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:00:07.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:00:07.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_open_files: -1 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Compression algorithms supported: 2024-09-17T01:00:07.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kZSTD supported: 0 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi143/store.db/MANIFEST-000005 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:00:07.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.merge_operator: 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_filter: None 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5641132bca20) 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: index_type: 0 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: data_block_index_type: 0 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: index_shortening: 1 2024-09-17T01:00:07.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: checksum: 4 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: no_block_cache: 0 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache: 0x5641132b11f0 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache_options: 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: capacity : 536870912 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: num_shard_bits : 4 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: strict_capacity_limit : 0 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:00:07.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache_compressed: (nil) 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: persistent_cache: (nil) 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_size: 4096 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_size_deviation: 10 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_restart_interval: 16 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: index_block_restart_interval: 1 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: metadata_block_size: 4096 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: partition_filters: 0 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: use_delta_encoding: 1 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: filter_policy: bloomfilter 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: whole_key_filtering: 1 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: verify_compression: 0 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: format_version: 5 2024-09-17T01:00:07.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: enable_index_compression: 1 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_align: 0 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: max_auto_readahead_size: 262144 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: prepopulate_block_cache: 0 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression: NoCompression 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:00:07.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.num_levels: 7 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:00:07.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:00:07.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:00:07.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:00:07.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:00:07.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:00:07.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:00:07.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:00:07.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:00:07.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:00:07.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:00:07.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:00:07.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:00:07.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:00:07.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:00:07.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:00:07.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:00:07.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:00:07.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:00:07.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:00:07.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:00:07.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:00:07.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:00:07.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:00:07.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:00:07.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:00:07.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:00:07.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:00:07.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:00:07.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:00:07.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:00:07.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:00:07.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:00:07.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:00:07.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:00:07.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:00:07.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:00:07.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:00:07.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:00:07.788 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:00:07.788 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:00:07.788 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:00:07.788 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:00:07.788 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:00:07.788 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.ttl: 2592000 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:00:07.789 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:00:07.790 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:00:07.791 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi143/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:00:07.791 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T01:00:07.791 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e4fe47bc-3065-42f6-9d6f-3b68a27d3040 2024-09-17T01:00:07.791 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534807409216, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T01:00:07.791 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-17T01:00:07.791 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534807409677, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726534807, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e4fe47bc-3065-42f6-9d6f-3b68a27d3040", "db_session_id": "S8QLKC6S1N2W1STJE31D", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534807409782, "job": 1, "event": "recovery_finished"} 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi143/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5641132dce00 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: DB pointer 0x5641133d2000 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:00:07.792 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:00:07.793 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** DB Stats ** 2024-09-17T01:00:07.793 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:00:07.793 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:00:07.793 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:00:07.793 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:00:07.793 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:00:07.794 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:00:07.794 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:00:07.794 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:00:07.794 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** Compaction Stats [default] ** 2024-09-17T01:00:07.794 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:00:07.794 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:00:07.795 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:00:07.795 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:00:07.795 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:00:07.795 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:00:07.795 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** Compaction Stats [default] ** 2024-09-17T01:00:07.795 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:00:07.796 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:00:07.796 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:00:07.796 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:00:07.796 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:00:07.796 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:00:07.797 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Block cache BinnedLRUCache@0x5641132b11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143 does not exist in monmap, will attempt to join an existing cluster 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: using public_addr v2:172.21.15.143:0/0 -> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-09-17T01:00:07.798 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: starting mon.smithi143 rank -1 at public addrs [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] at bind addrs [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi143 fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(???) e0 preinit fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).mds e1 new map 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).mds e1 print_map 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: e1 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: legacy client fscid: -1 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:00:07.799 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: No filesystems configured 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-17T01:00:07.800 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:07.801 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: Deploying daemon mon.smithi143 on smithi143 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/913250953' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:07.802 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:07.803 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:07.803 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:00:07.803 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:00:07.803 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:00:07.803 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:00:07.803 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3630493989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:00:07.804 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/1578935704' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:00:07.804 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 ceph-mon[35452]: mon.smithi143@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-17T01:00:07.804 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 bash[35417]: a7eceba58ad37033c83d5e1373509ec8e78f0439458f73aa9e9af663dab2b160 2024-09-17T01:00:07.804 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:07 smithi143 systemd[1]: Started Ceph mon.smithi143 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:00:08.172 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:00:08.172 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:00:08.375 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:00:12.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:00:12.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: mon.smithi103 calling monitor election 2024-09-17T01:00:12.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: mon.smithi143 calling monitor election 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: mon.smithi103 is new leader, mons smithi103,smithi143 in quorum (ranks 0,1) 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: monmap e2: 2 mons at {smithi103=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],smithi143=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T01:00:12.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: fsmap 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: mgrmap e18: smithi103.efjaur(active, since 33s), standbys: smithi143.sxhocv 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: overall HEALTH_OK 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 -- 172.21.15.143:0/1240690378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 msgr2=0x7f25ec0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1240690378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f25ec0059c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26000ffc10 tx=0x7f25fc02bce0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 -- 172.21.15.143:0/1240690378 shutdown_connections 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1240690378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f25ec0059c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 -- 172.21.15.143:0/1240690378 >> 172.21.15.143:0/1240690378 conn(0x7f26000fa440 msgr2=0x7f26000fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 -- 172.21.15.143:0/1240690378 shutdown_connections 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 -- 172.21.15.143:0/1240690378 wait complete. 2024-09-17T01:00:12.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.894+0000 7f2607d1f640 1 Processor -- start 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2607d1f640 1 -- start start 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2607d1f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f2600195240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2607d1f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2607d1f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600195d80 con 0x7f25ec003530 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2607d1f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600195ef0 con 0x7f2600195780 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35242/0 (socket says 172.21.15.143:35242) 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 -- 172.21.15.143:0/1370422576 learned_addr learned my addr 172.21.15.143:0/1370422576 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 -- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 msgr2=0x7f2600199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 -- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 msgr2=0x7f2600199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2605abb640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f2600195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:12.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f26052ba640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2605abb640 1 -- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 msgr2=0x7f2600199b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2605abb640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.895+0000 7f2605abb640 1 -- 172.21.15.143:0/1370422576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc011870 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.896+0000 7f2605abb640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f2600195240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005940 tx=0x7f25fc0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.896+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25fc005430 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.896+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260019a180 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.896+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25fc005590 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.896+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25fc003b60 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.896+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260019a6d0 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.897+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000fcb50 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.897+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f25fc003cc0 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.898+0000 7f25f6ffd640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f25e406ccd0 0x7f25e406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.898+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f25fc032070 con 0x7f25ec003530 2024-09-17T01:00:12.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.898+0000 7f26052ba640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f25e406ccd0 0x7f25e406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:12.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.899+0000 7f26052ba640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f25e406ccd0 0x7f25e406f190 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009100 tx=0x7f25f0008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:12.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:12.902+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f25fc077b60 con 0x7f25ec003530 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: mon.smithi103 calling monitor election 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: mon.smithi143 calling monitor election 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: mon.smithi103 is new leader, mons smithi103,smithi143 in quorum (ranks 0,1) 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: monmap e2: 2 mons at {smithi103=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],smithi143=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: fsmap 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: mgrmap e18: smithi103.efjaur(active, since 33s), standbys: smithi143.sxhocv 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: overall HEALTH_OK 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:12.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:13.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.130+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f26000ffec0 con 0x7f25ec003530 2024-09-17T01:00:13.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.131+0000 7f25f6ffd640 1 -- 172.21.15.143:0/1370422576 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7f25fc0abe70 con 0x7f25ec003530 2024-09-17T01:00:13.130 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T01:00:13.130 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":2,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","modified":"2024-09-17T01:00:07.438962Z","created":"2024-09-17T00:57:34.622316Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi143","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:3300","nonce":0},{"type":"v1","addr":"172.21.15.143:6789","nonce":0}]},"addr":"172.21.15.143:6789/0","public_addr":"172.21.15.143:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T01:00:13.130 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 2 2024-09-17T01:00:13.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f25e406ccd0 msgr2=0x7f25e406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f25e406ccd0 0x7f25e406f190 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009100 tx=0x7f25f0008040 comp rx=0 tx=0).stop 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 msgr2=0x7f2600195240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f2600195240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005940 tx=0x7f25fc0042d0 comp rx=0 tx=0).stop 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 shutdown_connections 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f25e406ccd0 0x7f25e406f190 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2600195780 0x7f2600199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:13.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 --2- 172.21.15.143:0/1370422576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25ec003530 0x7f2600195240 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:13.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.133+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 >> 172.21.15.143:0/1370422576 conn(0x7f26000fa440 msgr2=0x7f2600068840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:13.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.134+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 shutdown_connections 2024-09-17T01:00:13.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:00:13.134+0000 7f2607d1f640 1 -- 172.21.15.143:0/1370422576 wait complete. 2024-09-17T01:00:13.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:13 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:13.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:13 smithi143 ceph-mon[35452]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:13.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:13 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/1370422576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:00:13.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:13 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:13.779 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T01:00:13.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T01:00:13.807 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:13 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:13.807 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:13 smithi103 ceph-mon[28156]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:13.808 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:13 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/1370422576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:00:13.808 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:13 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:00:13.991 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:00:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:14 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.622 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:15.622 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.622 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:00:15.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 -- 172.21.15.103:0/109148906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 msgr2=0x7f5774104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 --2- 172.21.15.103:0/109148906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774104a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5770009880 tx=0x7f577002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 -- 172.21.15.103:0/109148906 shutdown_connections 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 --2- 172.21.15.103:0/109148906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774104a50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 -- 172.21.15.103:0/109148906 >> 172.21.15.103:0/109148906 conn(0x7f5774075460 msgr2=0x7f57740fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 -- 172.21.15.103:0/109148906 shutdown_connections 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 -- 172.21.15.103:0/109148906 wait complete. 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 Processor -- start 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.598+0000 7f577b666640 1 -- start start 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f577b666640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f577b666640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 0x7f57741969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f577b666640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577419f0b0 con 0x7f5774104670 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f577b666640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577419f1f0 con 0x7f5774196580 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34252/0 (socket says 172.21.15.103:34252) 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 -- 172.21.15.103:0/1518036618 learned_addr learned my addr 172.21.15.103:0/1518036618 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5778c01640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 0x7f57741969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5778c01640 1 -- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 msgr2=0x7f57741969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5778c01640 1 -- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 msgr2=0x7f57741969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5778c01640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 0x7f57741969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5778c01640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 0x7f57741969e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:00:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 -- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 msgr2=0x7f57741969e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 0x7f57741969e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 -- 172.21.15.103:0/1518036618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770009560 con 0x7f5774104670 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f5779402640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774196040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f57700055d0 tx=0x7f5770005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.599+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5770004aa0 con 0x7f5774104670 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.600+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5770004c00 con 0x7f5774104670 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.600+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577419f3f0 con 0x7f5774104670 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.600+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5770003a60 con 0x7f5774104670 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.600+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577419f8f0 con 0x7f5774104670 2024-09-17T01:00:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.601+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f5770031c00 con 0x7f5774104670 2024-09-17T01:00:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.601+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57740ffdb0 con 0x7f5774104670 2024-09-17T01:00:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.601+0000 7f576a7fc640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f576006ccd0 0x7f576006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.602+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f57700ac180 con 0x7f5774104670 2024-09-17T01:00:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.602+0000 7f5778c01640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f576006ccd0 0x7f576006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.602+0000 7f5778c01640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f576006ccd0 0x7f576006f190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5764006fd0 tx=0x7f5764008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.606+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5770077630 con 0x7f5774104670 2024-09-17T01:00:15.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:15.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:00:15.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:15.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.828+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5774108b00 con 0x7f5774104670 2024-09-17T01:00:15.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.828+0000 7f576a7fc640 1 -- 172.21.15.103:0/1518036618 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f577004a100 con 0x7f5774104670 2024-09-17T01:00:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:# minimal ceph.conf for b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:00:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-17T01:00:15.826 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:00:15.826 INFO:teuthology.orchestra.run.smithi103.stdout: mon_host = [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-09-17T01:00:15.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f576006ccd0 msgr2=0x7f576006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:15.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f576006ccd0 0x7f576006f190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5764006fd0 tx=0x7f5764008040 comp rx=0 tx=0).stop 2024-09-17T01:00:15.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 msgr2=0x7f5774196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:15.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774196040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f57700055d0 tx=0x7f5770005600 comp rx=0 tx=0).stop 2024-09-17T01:00:15.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 shutdown_connections 2024-09-17T01:00:15.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f576006ccd0 0x7f576006f190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5774196580 0x7f57741969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 --2- 172.21.15.103:0/1518036618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5774104670 0x7f5774196040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 >> 172.21.15.103:0/1518036618 conn(0x7f5774075460 msgr2=0x7f57740fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 shutdown_connections 2024-09-17T01:00:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:15.830+0000 7f577b666640 1 -- 172.21.15.103:0/1518036618 wait complete. 2024-09-17T01:00:16.773 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:00:16.773 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:00:16.774 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:00:16.774 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:00:16.774 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: Reconfiguring mon.smithi103 (unknown last config time)... 2024-09-17T01:00:16.774 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-17T01:00:16.774 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:16 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1518036618' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:17.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:00:17.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:00:17.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:00:17.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:00:17.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: Reconfiguring mon.smithi103 (unknown last config time)... 2024-09-17T01:00:17.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-17T01:00:17.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:16 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1518036618' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:17.328 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T01:00:17.328 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:00:17.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T01:00:17.398 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:00:17.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:00:17.462 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T01:00:17.463 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T01:00:17.496 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T01:00:17.496 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:00:17.566 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T01:00:17.567 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:00:17.567 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:00:17.583 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:00:17.583 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-17T01:00:17.640 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:00:17.640 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T01:00:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-17 00:59:32.286882654 +0000 2024-09-17T01:00:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-17 00:54:07.317083583 +0000 2024-09-17T01:00:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-17 00:54:07.317083583 +0000 2024-09-17T01:00:17.641 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-17 00:54:07.317083583 +0000 2024-09-17T01:00:17.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:00:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-17T01:00:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-17T01:00:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000281039 s, 1.8 MB/s 2024-09-17T01:00:17.705 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:00:17.762 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-17 00:59:32.287882635 +0000 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-17 00:54:07.647077349 +0000 2024-09-17T01:00:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-17 00:54:07.647077349 +0000 2024-09-17T01:00:17.819 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-17 00:54:07.647077349 +0000 2024-09-17T01:00:17.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:00:17.882 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-17T01:00:17.882 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-17T01:00:17.882 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000189644 s, 2.7 MB/s 2024-09-17T01:00:17.884 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:00:17.939 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-17 00:59:32.287882635 +0000 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-17 00:54:07.967071304 +0000 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-17 00:54:07.967071304 +0000 2024-09-17T01:00:17.995 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-17 00:54:07.967071304 +0000 2024-09-17T01:00:17.996 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: Reconfiguring mgr.smithi103.efjaur (unknown last config time)... 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:00:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:17 smithi103 ceph-mon[28156]: Reconfiguring daemon mgr.smithi103.efjaur on smithi103 2024-09-17T01:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-17T01:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-17T01:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000189226 s, 2.7 MB/s 2024-09-17T01:00:18.060 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:00:18.117 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-17T01:00:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:00:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T01:00:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-17 00:59:32.287882635 +0000 2024-09-17T01:00:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-17 00:54:08.294065126 +0000 2024-09-17T01:00:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-17 00:54:08.294065126 +0000 2024-09-17T01:00:18.173 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-17 00:54:08.294065126 +0000 2024-09-17T01:00:18.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:00:18.237 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-17T01:00:18.237 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-17T01:00:18.237 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000210227 s, 2.4 MB/s 2024-09-17T01:00:18.238 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:00:18.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:18.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: Reconfiguring mgr.smithi103.efjaur (unknown last config time)... 2024-09-17T01:00:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:00:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:00:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:17 smithi143 ceph-mon[35452]: Reconfiguring daemon mgr.smithi103.efjaur on smithi103 2024-09-17T01:00:18.295 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T01:00:18.295 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:00:18.315 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:00:18.315 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-09-17T01:00:18.373 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:00:18.373 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:18.373 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T01:00:18.374 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:18.374 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:18.374 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-17 01:00:04.860626889 +0000 2024-09-17T01:00:18.374 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-17 00:54:07.197956223 +0000 2024-09-17T01:00:18.374 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-17 00:54:07.197956223 +0000 2024-09-17T01:00:18.374 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-17 00:54:07.197956223 +0000 2024-09-17T01:00:18.374 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:00:18.441 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-17T01:00:18.441 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-17T01:00:18.441 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000239569 s, 2.1 MB/s 2024-09-17T01:00:18.443 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:00:18.501 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-09-17T01:00:18.558 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-17 01:00:04.860626889 +0000 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-17 00:54:07.531946797 +0000 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-17 00:54:07.531946797 +0000 2024-09-17T01:00:18.559 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-17 00:54:07.531946797 +0000 2024-09-17T01:00:18.560 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:00:18.623 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-17T01:00:18.624 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-17T01:00:18.624 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000268965 s, 1.9 MB/s 2024-09-17T01:00:18.625 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:00:18.682 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-09-17T01:00:18.738 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:00:18.738 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-17 01:00:04.860626889 +0000 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-17 00:54:07.852937738 +0000 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-17 00:54:07.852937738 +0000 2024-09-17T01:00:18.739 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-17 00:54:07.852937738 +0000 2024-09-17T01:00:18.739 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:00:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-17T01:00:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-17T01:00:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.0002034 s, 2.5 MB/s 2024-09-17T01:00:18.806 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:00:18.862 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-17 01:00:04.860626889 +0000 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-17 00:54:08.188928255 +0000 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-17 00:54:08.188928255 +0000 2024-09-17T01:00:18.918 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-17 00:54:08.188928255 +0000 2024-09-17T01:00:18.919 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:00:18.981 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-17T01:00:18.981 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-17T01:00:18.982 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000192644 s, 2.7 MB/s 2024-09-17T01:00:18.983 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:00:19.039 INFO:tasks.cephadm:Deploying osd.0 on smithi103 with /dev/vg_nvme/lv_4... 2024-09-17T01:00:19.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T01:00:19.830 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:19.830 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:19.830 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:19.830 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: Reconfiguring ceph-exporter.smithi103 (monmap changed)... 2024-09-17T01:00:19.831 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:00:19.831 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:19.831 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:19 smithi103 ceph-mon[28156]: Reconfiguring daemon ceph-exporter.smithi103 on smithi103 2024-09-17T01:00:19.834 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:00:20.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: Reconfiguring ceph-exporter.smithi103 (monmap changed)... 2024-09-17T01:00:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:00:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:19 smithi143 ceph-mon[35452]: Reconfiguring daemon ceph-exporter.smithi103 on smithi103 2024-09-17T01:00:21.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:20 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:21.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:20 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:21.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:20 smithi103 ceph-mon[28156]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-17T01:00:21.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:20 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:00:21.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:20 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:21.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:20 smithi103 ceph-mon[28156]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-17T01:00:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:20 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:20 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:20 smithi143 ceph-mon[35452]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-17T01:00:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:20 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:00:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:20 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:20 smithi143 ceph-mon[35452]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-17T01:00:22.157 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:21 smithi103 ceph-mon[28156]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:22.157 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:22.157 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:22.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:21 smithi143 ceph-mon[35452]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:22.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:22.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:23.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:22 smithi103 ceph-mon[28156]: Reconfiguring alertmanager.smithi103 (dependencies changed)... 2024-09-17T01:00:23.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:22 smithi103 ceph-mon[28156]: Reconfiguring daemon alertmanager.smithi103 on smithi103 2024-09-17T01:00:23.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:00:23.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-09-17T01:00:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:22 smithi143 ceph-mon[35452]: Reconfiguring alertmanager.smithi103 (dependencies changed)... 2024-09-17T01:00:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:22 smithi143 ceph-mon[35452]: Reconfiguring daemon alertmanager.smithi103 on smithi103 2024-09-17T01:00:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:23 smithi103 ceph-mon[28156]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:24.128 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:24.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:23 smithi143 ceph-mon[35452]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:24.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:25.289 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:00:26.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:25 smithi143 ceph-mon[35452]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:26.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:25 smithi103 ceph-mon[28156]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 -- 172.21.15.103:0/2508334126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380fea80 msgr2=0x7fa2380fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 --2- 172.21.15.103:0/2508334126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380fea80 0x7fa2380fee80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa228009880 tx=0x7fa22802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:00:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 -- 172.21.15.103:0/2508334126 shutdown_connections 2024-09-17T01:00:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 --2- 172.21.15.103:0/2508334126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380ffc80 0x7fa238100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 --2- 172.21.15.103:0/2508334126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380fea80 0x7fa2380fee80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 -- 172.21.15.103:0/2508334126 >> 172.21.15.103:0/2508334126 conn(0x7fa2380fa230 msgr2=0x7fa2380fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 -- 172.21.15.103:0/2508334126 shutdown_connections 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.141+0000 7fa23e695640 1 -- 172.21.15.103:0/2508334126 wait complete. 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa23e695640 1 Processor -- start 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa23e695640 1 -- start start 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa23e695640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380fea80 0x7fa238068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa23e695640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 0x7fa23819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa23e695640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238196200 con 0x7fa2380ffc80 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa23e695640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23819ccd0 con 0x7fa2380fea80 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa2377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 0x7fa23819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa2377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 0x7fa23819c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52018/0 (socket says 172.21.15.103:52018) 2024-09-17T01:00:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.142+0000 7fa2377fe640 1 -- 172.21.15.103:0/294996675 learned_addr learned my addr 172.21.15.103:0/294996675 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa237fff640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380fea80 0x7fa238068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2377fe640 1 -- 172.21.15.103:0/294996675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380fea80 msgr2=0x7fa238068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2377fe640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380fea80 0x7fa238068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2377fe640 1 -- 172.21.15.103:0/294996675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009560 con 0x7fa2380ffc80 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa237fff640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380fea80 0x7fa238068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2377fe640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 0x7fa23819c790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c8f0 tx=0x7fa22c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa22c007b70 con 0x7fa2380ffc80 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa22c0054e0 con 0x7fa2380ffc80 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa22c00f450 con 0x7fa2380ffc80 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23819cf60 con 0x7fa2380ffc80 2024-09-17T01:00:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.143+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23819d500 con 0x7fa2380ffc80 2024-09-17T01:00:27.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.144+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23818e620 con 0x7fa2380ffc80 2024-09-17T01:00:27.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.145+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7fa22c004f50 con 0x7fa2380ffc80 2024-09-17T01:00:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.145+0000 7fa2357fa640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa22006cbd0 0x7fa22006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.146+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa22c08aea0 con 0x7fa2380ffc80 2024-09-17T01:00:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.146+0000 7fa237fff640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa22006cbd0 0x7fa22006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.146+0000 7fa237fff640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa22006cbd0 0x7fa22006f090 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa228031540 tx=0x7fa228005de0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.150+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa22c0563d0 con 0x7fa2380ffc80 2024-09-17T01:00:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:27.331+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa23802c4f0 con 0x7fa22006cbd0 2024-09-17T01:00:28.155 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:27 smithi103 ceph-mon[28156]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:28.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:00:28.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:00:28.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:27 smithi143 ceph-mon[35452]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:28.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:00:28.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:00:28.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:29.158 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:28 smithi103 ceph-mon[28156]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:28 smithi143 ceph-mon[35452]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:29 smithi103 ceph-mon[28156]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:29 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:29 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:29 smithi143 ceph-mon[35452]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:30.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:29 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:30.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:29 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:30 smithi103 ceph-mon[28156]: Reconfiguring grafana.smithi103 (dependencies changed)... 2024-09-17T01:00:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:30 smithi103 ceph-mon[28156]: Reconfiguring daemon grafana.smithi103 on smithi103 2024-09-17T01:00:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:30 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2611723681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17f01f59-16a2-47ef-b7d5-0088763afc90"}]: dispatch 2024-09-17T01:00:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:30 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2611723681' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17f01f59-16a2-47ef-b7d5-0088763afc90"}]': finished 2024-09-17T01:00:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:30 smithi103 ceph-mon[28156]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T01:00:31.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:30 smithi143 ceph-mon[35452]: Reconfiguring grafana.smithi103 (dependencies changed)... 2024-09-17T01:00:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:30 smithi143 ceph-mon[35452]: Reconfiguring daemon grafana.smithi103 on smithi103 2024-09-17T01:00:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:30 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2611723681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17f01f59-16a2-47ef-b7d5-0088763afc90"}]: dispatch 2024-09-17T01:00:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:30 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2611723681' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17f01f59-16a2-47ef-b7d5-0088763afc90"}]': finished 2024-09-17T01:00:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:30 smithi143 ceph-mon[35452]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T01:00:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:32.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:31 smithi103 ceph-mon[28156]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:32.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:31 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2753635872' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:00:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:31 smithi143 ceph-mon[35452]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:31 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2753635872' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:00:34.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:33 smithi103 ceph-mon[28156]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:34.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:33 smithi143 ceph-mon[35452]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:36.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:35 smithi103 ceph-mon[28156]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:35 smithi143 ceph-mon[35452]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:37 smithi103 ceph-mon[28156]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:38.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:37 smithi143 ceph-mon[35452]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:39.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:40.248 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:39 smithi103 ceph-mon[28156]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:40.248 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:40.248 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:39 smithi143 ceph-mon[35452]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:41.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:40 smithi103 ceph-mon[28156]: Reconfiguring prometheus.smithi103 (dependencies changed)... 2024-09-17T01:00:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:40 smithi143 ceph-mon[35452]: Reconfiguring prometheus.smithi103 (dependencies changed)... 2024-09-17T01:00:42.172 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:41 smithi103 ceph-mon[28156]: Reconfiguring daemon prometheus.smithi103 on smithi103 2024-09-17T01:00:42.172 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:41 smithi103 ceph-mon[28156]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:42.172 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:41 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:00:42.172 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:41 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:41 smithi143 ceph-mon[35452]: Reconfiguring daemon prometheus.smithi103 on smithi103 2024-09-17T01:00:42.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:41 smithi143 ceph-mon[35452]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:42.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:41 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:00:42.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:41 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:43.085 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:42 smithi103 ceph-mon[28156]: Deploying daemon osd.0 on smithi103 2024-09-17T01:00:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:42 smithi143 ceph-mon[35452]: Deploying daemon osd.0 on smithi103 2024-09-17T01:00:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:43 smithi143 ceph-mon[35452]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:44.284 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:43 smithi103 ceph-mon[28156]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:46.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:45 smithi143 ceph-mon[35452]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:46.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:45 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:46.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:45 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:46.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:45 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:00:46.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:45 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:46.301 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:45 smithi103 ceph-mon[28156]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:46.302 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:45 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:46.302 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:45 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:46.302 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:45 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:00:46.302 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:45 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:47.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:46 smithi143 ceph-mon[35452]: Reconfiguring ceph-exporter.smithi143 (monmap changed)... 2024-09-17T01:00:47.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:46 smithi143 ceph-mon[35452]: Reconfiguring daemon ceph-exporter.smithi143 on smithi143 2024-09-17T01:00:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:46 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:46 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:46 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:00:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:46 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:47.125 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:46 smithi103 ceph-mon[28156]: Reconfiguring ceph-exporter.smithi143 (monmap changed)... 2024-09-17T01:00:47.125 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:46 smithi103 ceph-mon[28156]: Reconfiguring daemon ceph-exporter.smithi143 on smithi143 2024-09-17T01:00:47.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:46 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:47.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:46 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:47.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:46 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:00:47.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:46 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:48.245 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:47 smithi103 ceph-mon[28156]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:48.245 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:47 smithi103 ceph-mon[28156]: Reconfiguring crash.smithi143 (monmap changed)... 2024-09-17T01:00:48.245 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:47 smithi103 ceph-mon[28156]: Reconfiguring daemon crash.smithi143 on smithi143 2024-09-17T01:00:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:47 smithi143 ceph-mon[35452]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:47 smithi143 ceph-mon[35452]: Reconfiguring crash.smithi143 (monmap changed)... 2024-09-17T01:00:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:47 smithi143 ceph-mon[35452]: Reconfiguring daemon crash.smithi143 on smithi143 2024-09-17T01:00:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: Reconfiguring mgr.smithi143.sxhocv (monmap changed)... 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: Reconfiguring daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:00:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:49 smithi143 ceph-mon[35452]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:49.345 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:49.345 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:49.345 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: Reconfiguring mgr.smithi143.sxhocv (monmap changed)... 2024-09-17T01:00:49.346 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:00:49.346 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:00:49.346 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:49.346 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: Reconfiguring daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:00:49.346 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:49 smithi103 ceph-mon[28156]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: Reconfiguring mon.smithi143 (monmap changed)... 2024-09-17T01:00:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:00:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:00:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:50.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: Reconfiguring daemon mon.smithi143 on smithi143 2024-09-17T01:00:50.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: Reconfiguring mon.smithi143 (monmap changed)... 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: Reconfiguring daemon mon.smithi143 on smithi143 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi103.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi103.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:00:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi103.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi103.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.759 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi103.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi103.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi103.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:00:51.760 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi103.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:00:51.761 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:51.761 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:51.761 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:53.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.085+0000 7fa2357fa640 1 -- 172.21.15.103:0/294996675 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa23802c4f0 con 0x7fa22006cbd0 2024-09-17T01:00:53.084 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 0 on host 'smithi103' 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa22006cbd0 msgr2=0x7fa22006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa22006cbd0 0x7fa22006f090 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa228031540 tx=0x7fa228005de0 comp rx=0 tx=0).stop 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 msgr2=0x7fa23819c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 0x7fa23819c790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c8f0 tx=0x7fa22c00cdb0 comp rx=0 tx=0).stop 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 shutdown_connections 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa22006cbd0 0x7fa22006f090 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2380ffc80 0x7fa23819c790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 --2- 172.21.15.103:0/294996675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2380fea80 0x7fa238068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 >> 172.21.15.103:0/294996675 conn(0x7fa2380fa230 msgr2=0x7fa238103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:53.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 shutdown_connections 2024-09-17T01:00:53.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:53.087+0000 7fa23e695640 1 -- 172.21.15.103:0/294996675 wait complete. 2024-09-17T01:00:53.648 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.648 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.648 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:53 smithi143 ceph-mon[35452]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:53.649 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.649 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:53 smithi103 ceph-mon[28156]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:53.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:00:53.728 DEBUG:teuthology.orchestra.run.smithi103:osd.0> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T01:00:53.731 INFO:tasks.cephadm:Deploying osd.1 on smithi103 with /dev/vg_nvme/lv_3... 2024-09-17T01:00:53.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T01:00:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:00:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:54 smithi103 ceph-mon[28156]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:00:54.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:00:54 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[47102]: 2024-09-17T01:00:54.126+0000 7f7b61976640 -1 osd.0 0 log_to_monitors true 2024-09-17T01:00:54.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:54 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:54.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:54 smithi143 ceph-mon[35452]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:00:55.381 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[47102]: 2024-09-17T01:00:55.289+0000 7f7b5d0d4640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T01:00:55.381 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[47102]: 2024-09-17T01:00:55.292+0000 7f7b5970f640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:00:55.381 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T01:00:55.382 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: from='osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-17T01:00:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T01:00:55.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:56 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:56 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:56.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:56 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:56.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:56 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:00:56.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-09-17T01:00:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:57 smithi103 ceph-mon[28156]: purged_snaps scrub starts 2024-09-17T01:00:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:57 smithi103 ceph-mon[28156]: purged_snaps scrub ok 2024-09-17T01:00:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:57 smithi103 ceph-mon[28156]: osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] boot 2024-09-17T01:00:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:57 smithi103 ceph-mon[28156]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T01:00:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:57 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:57 smithi103 ceph-mon[28156]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:57.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:57 smithi143 ceph-mon[35452]: purged_snaps scrub starts 2024-09-17T01:00:57.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:57 smithi143 ceph-mon[35452]: purged_snaps scrub ok 2024-09-17T01:00:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:57 smithi143 ceph-mon[35452]: osd.0 [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] boot 2024-09-17T01:00:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:57 smithi143 ceph-mon[35452]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T01:00:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:57 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:00:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:57 smithi143 ceph-mon[35452]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:00:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:00:58.658 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:58 smithi143 ceph-mon[35452]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T01:00:58.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:58 smithi103 ceph-mon[28156]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T01:00:59.584 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:00:59 smithi103 ceph-mon[28156]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:00:59.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 -- 172.21.15.103:0/3889516842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 msgr2=0x7f77c01053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:59.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 --2- 172.21.15.103:0/3889516842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c01053f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009880 tx=0x7f77a802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 -- 172.21.15.103:0/3889516842 shutdown_connections 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 --2- 172.21.15.103:0/3889516842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c01053f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 --2- 172.21.15.103:0/3889516842 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77c01006d0 0x7f77c0102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 -- 172.21.15.103:0/3889516842 >> 172.21.15.103:0/3889516842 conn(0x7f77c00fa230 msgr2=0x7f77c00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 -- 172.21.15.103:0/3889516842 shutdown_connections 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 -- 172.21.15.103:0/3889516842 wait complete. 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.671+0000 7f77c52ab640 1 Processor -- start 2024-09-17T01:00:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77c52ab640 1 -- start start 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77c52ab640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77c01006d0 0x7f77c0100030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77c52ab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77c52ab640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00febc0 con 0x7f77c0103000 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77c52ab640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00fed30 con 0x7f77c01006d0 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c00fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52130/0 (socket says 172.21.15.103:52130) 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 -- 172.21.15.103:0/2777084823 learned_addr learned my addr 172.21.15.103:0/2777084823 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77beffd640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77c01006d0 0x7f77c0100030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 -- 172.21.15.103:0/2777084823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77c01006d0 msgr2=0x7f77c0100030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77c01006d0 0x7f77c0100030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 -- 172.21.15.103:0/2777084823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009560 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.672+0000 7f77be7fc640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c00fe680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f77a802a9c0 tx=0x7f77a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.673+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77a8004aa0 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.673+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77a8005d50 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.673+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c00fefb0 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.673+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77a80039b0 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.673+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c019d690 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.674+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c0100ab0 con 0x7f77c0103000 2024-09-17T01:00:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.674+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f77a8003c70 con 0x7f77c0103000 2024-09-17T01:00:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.674+0000 7f77b7fff640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f77ac06cbc0 0x7f77ac06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.675+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f77a80ac480 con 0x7f77c0103000 2024-09-17T01:00:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.675+0000 7f77beffd640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f77ac06cbc0 0x7f77ac06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.675+0000 7f77beffd640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f77ac06cbc0 0x7f77ac06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009aa0 tx=0x7f77b8005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.679+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f77a80776d0 con 0x7f77c0103000 2024-09-17T01:00:59.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:00:59 smithi143 ceph-mon[35452]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:00:59.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:00:59.860+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f77c01039e0 con 0x7f77ac06cbc0 2024-09-17T01:01:00.525 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:00 smithi103 ceph-mon[28156]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:00.525 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:01:00.525 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:01:00.525 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:00.526 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:00.526 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:00.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:00 smithi143 ceph-mon[35452]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:01:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:01:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:01.413 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:01 smithi103 ceph-mon[28156]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:01.595 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:01 smithi143 ceph-mon[35452]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:03.818 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:03 smithi103 ceph-mon[28156]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:04.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:03 smithi143 ceph-mon[35452]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:05.369 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: Detected new or changed devices on smithi103 2024-09-17T01:01:05.369 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.369 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.369 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi103 to 11840M 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:05.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:05 smithi103 ceph-mon[28156]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:05.485 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: Detected new or changed devices on smithi103 2024-09-17T01:01:05.485 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.485 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.485 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi103 to 11840M 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:05.486 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:05 smithi143 ceph-mon[35452]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:06.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1547380209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94747077-fac6-4911-8ba7-21c1e21f8508"}]: dispatch 2024-09-17T01:01:06.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1547380209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94747077-fac6-4911-8ba7-21c1e21f8508"}]': finished 2024-09-17T01:01:06.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T01:01:06.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:06.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3056523092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:01:06.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:06.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:06 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:06.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1547380209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94747077-fac6-4911-8ba7-21c1e21f8508"}]: dispatch 2024-09-17T01:01:06.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1547380209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94747077-fac6-4911-8ba7-21c1e21f8508"}]': finished 2024-09-17T01:01:06.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T01:01:06.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:06.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3056523092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:01:06.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:06.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:06 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:07.489 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:07 smithi103 ceph-mon[28156]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:07 smithi143 ceph-mon[35452]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:09.625 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:09.625 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:09.625 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:09.625 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:09.625 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:09.626 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:09.626 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:09 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:10.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:10.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:10.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:10.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:10.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:10.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:09 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:11.795 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:11 smithi103 ceph-mon[28156]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:12.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:11 smithi143 ceph-mon[35452]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:12.783 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:01:12.783 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:01:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:13.878 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:13 smithi103 ceph-mon[28156]: Deploying daemon osd.1 on smithi103 2024-09-17T01:01:13.878 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:13 smithi103 ceph-mon[28156]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:14.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:13 smithi143 ceph-mon[35452]: Deploying daemon osd.1 on smithi103 2024-09-17T01:01:14.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:13 smithi143 ceph-mon[35452]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:15.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:15 smithi103 ceph-mon[28156]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:16.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:15 smithi143 ceph-mon[35452]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:17.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:17 smithi103 ceph-mon[28156]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:17.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:17.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:17.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:18.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:17 smithi143 ceph-mon[35452]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:18.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:18.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:18.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:20.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.074+0000 7f77b7fff640 1 -- 172.21.15.103:0/2777084823 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f77c01039e0 con 0x7f77ac06cbc0 2024-09-17T01:01:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 1 on host 'smithi103' 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f77ac06cbc0 msgr2=0x7f77ac06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f77ac06cbc0 0x7f77ac06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009aa0 tx=0x7f77b8005f90 comp rx=0 tx=0).stop 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 msgr2=0x7f77c00fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c00fe680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f77a802a9c0 tx=0x7f77a80055a0 comp rx=0 tx=0).stop 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 shutdown_connections 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f77ac06cbc0 0x7f77ac06f080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c0103000 0x7f77c00fe680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.076+0000 7f77c52ab640 1 --2- 172.21.15.103:0/2777084823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77c01006d0 0x7f77c0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.077+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 >> 172.21.15.103:0/2777084823 conn(0x7f77c00fa230 msgr2=0x7f77c00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.077+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 shutdown_connections 2024-09-17T01:01:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:20.077+0000 7f77c52ab640 1 -- 172.21.15.103:0/2777084823 wait complete. 2024-09-17T01:01:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:19 smithi103 ceph-mon[28156]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:19 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:19 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:20.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:19 smithi143 ceph-mon[35452]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:20.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:19 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:20.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:19 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:20.801 DEBUG:teuthology.orchestra.run.smithi103:osd.1> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T01:01:20.803 INFO:tasks.cephadm:Deploying osd.2 on smithi103 with /dev/vg_nvme/lv_2... 2024-09-17T01:01:20.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T01:01:21.067 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:20 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[54648]: 2024-09-17T01:01:20.905+0000 7f87195c9640 -1 osd.1 0 log_to_monitors true 2024-09-17T01:01:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:21 smithi103 ceph-mon[28156]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:21 smithi103 ceph-mon[28156]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:01:21.468 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:01:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:21 smithi143 ceph-mon[35452]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:21.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:21 smithi143 ceph-mon[35452]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:01:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:22 smithi103 ceph-mon[28156]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:01:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:22 smithi103 ceph-mon[28156]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T01:01:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:22.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:22 smithi103 ceph-mon[28156]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:01:22.178 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:22 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[54648]: 2024-09-17T01:01:22.082+0000 7f8714d27640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T01:01:22.178 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:22 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[54648]: 2024-09-17T01:01:22.086+0000 7f8711362640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:01:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:22 smithi143 ceph-mon[35452]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:01:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:22 smithi143 ceph-mon[35452]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T01:01:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:22.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:22 smithi143 ceph-mon[35452]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:01:23.269 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:23 smithi103 ceph-mon[28156]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-17T01:01:23.269 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:23 smithi103 ceph-mon[28156]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T01:01:23.269 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:23.269 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:23.269 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:23 smithi103 ceph-mon[28156]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:23 smithi143 ceph-mon[35452]: from='osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-17T01:01:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:23 smithi143 ceph-mon[35452]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T01:01:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:23 smithi143 ceph-mon[35452]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:01:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:24 smithi103 ceph-mon[28156]: purged_snaps scrub starts 2024-09-17T01:01:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:24 smithi103 ceph-mon[28156]: purged_snaps scrub ok 2024-09-17T01:01:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:24 smithi103 ceph-mon[28156]: osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] boot 2024-09-17T01:01:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:24 smithi103 ceph-mon[28156]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T01:01:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:24 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:24 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:24.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:24 smithi143 ceph-mon[35452]: purged_snaps scrub starts 2024-09-17T01:01:24.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:24 smithi143 ceph-mon[35452]: purged_snaps scrub ok 2024-09-17T01:01:24.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:24 smithi143 ceph-mon[35452]: osd.1 [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] boot 2024-09-17T01:01:24.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:24 smithi143 ceph-mon[35452]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T01:01:24.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:24 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:01:24.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:24 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:24.632 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:01:24.652 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-09-17T01:01:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:01:25.386 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:25 smithi103 ceph-mon[28156]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T01:01:25.386 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:25 smithi103 ceph-mon[28156]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:25.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:25 smithi143 ceph-mon[35452]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T01:01:25.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:25 smithi143 ceph-mon[35452]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:27 smithi103 ceph-mon[28156]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:27.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:27 smithi143 ceph-mon[35452]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:27.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 -- 172.21.15.103:0/321512519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0ffc30 msgr2=0x7f934c1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:27.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 --2- 172.21.15.103:0/321512519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0ffc30 0x7f934c1000b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9334009880 tx=0x7f933402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:01:27.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 -- 172.21.15.103:0/321512519 shutdown_connections 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 --2- 172.21.15.103:0/321512519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0ffc30 0x7f934c1000b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 --2- 172.21.15.103:0/321512519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f934c0fea30 0x7f934c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 -- 172.21.15.103:0/321512519 >> 172.21.15.103:0/321512519 conn(0x7f934c0fa1c0 msgr2=0x7f934c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 -- 172.21.15.103:0/321512519 shutdown_connections 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 -- 172.21.15.103:0/321512519 wait complete. 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 Processor -- start 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.664+0000 7f9351bd2640 1 -- start start 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9351bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 0x7f934c1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9351bd2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f934c0ffc30 0x7f934c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9351bd2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1984c0 con 0x7f934c0fea30 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9351bd2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c198630 con 0x7f934c0ffc30 2024-09-17T01:01:27.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 0x7f934c1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 0x7f934c1979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56774/0 (socket says 172.21.15.103:56774) 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 -- 172.21.15.103:0/1997712203 learned_addr learned my addr 172.21.15.103:0/1997712203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9343fff640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f934c0ffc30 0x7f934c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 -- 172.21.15.103:0/1997712203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f934c0ffc30 msgr2=0x7f934c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f934c0ffc30 0x7f934c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 -- 172.21.15.103:0/1997712203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334009560 con 0x7f934c0fea30 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f934b7fe640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 0x7f934c1979b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b400 tx=0x7f933c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933c011800 con 0x7f934c0fea30 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f933c011e20 con 0x7f934c0fea30 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c19d060 con 0x7f934c0fea30 2024-09-17T01:01:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933c00f2e0 con 0x7f934c0fea30 2024-09-17T01:01:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.665+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c19d600 con 0x7f934c0fea30 2024-09-17T01:01:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.666+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c1076c0 con 0x7f934c0fea30 2024-09-17T01:01:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.667+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f933c010380 con 0x7f934c0fea30 2024-09-17T01:01:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.668+0000 7f93497fa640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f933806cbd0 0x7f933806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.668+0000 7f9343fff640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f933806cbd0 0x7f933806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.668+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f933c08b210 con 0x7f934c0fea30 2024-09-17T01:01:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.668+0000 7f9343fff640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f933806cbd0 0x7f933806f090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9334000c00 tx=0x7f93340314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.672+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f933c0562b0 con 0x7f934c0fea30 2024-09-17T01:01:27.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:27.847+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f934c19d880 con 0x7f933806cbd0 2024-09-17T01:01:28.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:28 smithi103 ceph-mon[28156]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:28.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:28 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:01:28.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:28 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:01:28.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:28 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:28 smithi143 ceph-mon[35452]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:28 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:01:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:28 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:01:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:28 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:29.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:29 smithi103 ceph-mon[28156]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:29 smithi143 ceph-mon[35452]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:31.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: Detected new or changed devices on smithi103 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi103 to 5920M 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: Detected new or changed devices on smithi103 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi103 to 5920M 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:31.179 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3450600330' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6becb291-d5ea-460f-aef4-10b211a48efe"}]: dispatch 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3450600330' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6becb291-d5ea-460f-aef4-10b211a48efe"}]': finished 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:32.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:31 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3450600330' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6becb291-d5ea-460f-aef4-10b211a48efe"}]: dispatch 2024-09-17T01:01:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3450600330' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6becb291-d5ea-460f-aef4-10b211a48efe"}]': finished 2024-09-17T01:01:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T01:01:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:31 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:32.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:32 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/839253390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:01:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:32 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/839253390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:01:34.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:33 smithi143 ceph-mon[35452]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:34.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:33 smithi103 ceph-mon[28156]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:35.749 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:35.749 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:35.749 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:35.749 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:35.750 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:35.750 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:35 smithi103 ceph-mon[28156]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:36.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:36.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:36.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:36.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:36.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:36.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:35 smithi143 ceph-mon[35452]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:37.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:37 smithi103 ceph-mon[28156]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:37 smithi143 ceph-mon[35452]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:38.897 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:01:38.898 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:38.898 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:39.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:01:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:39.752 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:39 smithi103 ceph-mon[28156]: Deploying daemon osd.2 on smithi103 2024-09-17T01:01:39.752 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:39 smithi103 ceph-mon[28156]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:39 smithi143 ceph-mon[35452]: Deploying daemon osd.2 on smithi103 2024-09-17T01:01:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:39 smithi143 ceph-mon[35452]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:41.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:41 smithi103 ceph-mon[28156]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:42.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:41 smithi143 ceph-mon[35452]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:43.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:43 smithi103 ceph-mon[28156]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:43.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:43.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:43.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:43 smithi143 ceph-mon[35452]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:44.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:45.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:45 smithi103 ceph-mon[28156]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:46.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:45 smithi143 ceph-mon[35452]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:46.313 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 2 on host 'smithi103' 2024-09-17T01:01:46.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.314+0000 7f93497fa640 1 -- 172.21.15.103:0/1997712203 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f934c19d880 con 0x7f933806cbd0 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f933806cbd0 msgr2=0x7f933806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f933806cbd0 0x7f933806f090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9334000c00 tx=0x7f93340314e0 comp rx=0 tx=0).stop 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 msgr2=0x7f934c1979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 0x7f934c1979b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b400 tx=0x7f933c00b8c0 comp rx=0 tx=0).stop 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 shutdown_connections 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f933806cbd0 0x7f933806f090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f934c0ffc30 0x7f934c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:46.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 --2- 172.21.15.103:0/1997712203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c0fea30 0x7f934c1979b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:46.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 >> 172.21.15.103:0/1997712203 conn(0x7f934c0fa1c0 msgr2=0x7f934c067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:46.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 shutdown_connections 2024-09-17T01:01:46.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:01:46.317+0000 7f9351bd2640 1 -- 172.21.15.103:0/1997712203 wait complete. 2024-09-17T01:01:47.016 DEBUG:teuthology.orchestra.run.smithi103:osd.2> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T01:01:47.019 INFO:tasks.cephadm:Deploying osd.3 on smithi143 with /dev/vg_nvme/lv_4... 2024-09-17T01:01:47.019 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T01:01:47.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:47 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[61974]: 2024-09-17T01:01:47.121+0000 7f9108a00640 -1 osd.2 0 log_to_monitors true 2024-09-17T01:01:47.212 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:01:47.539 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:47.539 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:47.539 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:47 smithi103 ceph-mon[28156]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:47.539 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:47 smithi103 ceph-mon[28156]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:01:47.650 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:47.650 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:47.650 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:47 smithi143 ceph-mon[35452]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:47.650 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:47 smithi143 ceph-mon[35452]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:01:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:48 smithi103 ceph-mon[28156]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:01:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:48 smithi103 ceph-mon[28156]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T01:01:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:48 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:48 smithi103 ceph-mon[28156]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:01:48.538 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:48 smithi143 ceph-mon[35452]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:01:48.538 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:48 smithi143 ceph-mon[35452]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T01:01:48.538 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:48 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:48.538 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:48 smithi143 ceph-mon[35452]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:01:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-mon[28156]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-17T01:01:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-mon[28156]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T01:01:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-mon[28156]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-mon[28156]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' 2024-09-17T01:01:49.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[61974]: 2024-09-17T01:01:49.176+0000 7f910415e640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T01:01:49.428 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:49 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[61974]: 2024-09-17T01:01:49.181+0000 7f90fc791640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:01:49.530 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T01:01:49.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_4 2024-09-17T01:01:49.742 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:01:49.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:49 smithi143 ceph-mon[35452]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-17T01:01:49.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:49 smithi143 ceph-mon[35452]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T01:01:49.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:49.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:49.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:49 smithi143 ceph-mon[35452]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:01:49.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:49 smithi143 ceph-mon[35452]: from='osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328]' entity='osd.2' 2024-09-17T01:01:50.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: purged_snaps scrub starts 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: purged_snaps scrub ok 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] boot 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T01:01:50.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:50 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:50.613 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: purged_snaps scrub starts 2024-09-17T01:01:50.613 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: purged_snaps scrub ok 2024-09-17T01:01:50.613 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:50.613 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:50.614 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:50.614 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: osd.2 [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] boot 2024-09-17T01:01:50.614 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T01:01:50.614 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:50 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:01:51.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 -- 172.21.15.143:0/2877186256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 msgr2=0x7f9c38100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:51.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/2877186256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c38100120 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009880 tx=0x7f9c2802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:01:51.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 -- 172.21.15.143:0/2877186256 shutdown_connections 2024-09-17T01:01:51.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/2877186256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c38100120 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/2877186256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 0x7f9c380feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 -- 172.21.15.143:0/2877186256 >> 172.21.15.143:0/2877186256 conn(0x7f9c380fa230 msgr2=0x7f9c380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 -- 172.21.15.143:0/2877186256 shutdown_connections 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 -- 172.21.15.143:0/2877186256 wait complete. 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.313+0000 7f9c3d11a640 1 Processor -- start 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3d11a640 1 -- start start 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3d11a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 0x7f9c38068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3d11a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c3819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3d11a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3819a910 con 0x7f9c380feaa0 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3d11a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3819aa50 con 0x7f9c380ffca0 2024-09-17T01:01:51.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c3819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c3819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57756/0 (socket says 172.21.15.143:57756) 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 -- 172.21.15.143:0/3287970511 learned_addr learned my addr 172.21.15.143:0/3287970511 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c36d9d640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 0x7f9c38068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 -- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 msgr2=0x7f9c38068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 0x7f9c38068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 -- 172.21.15.143:0/3287970511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009560 con 0x7f9c380ffca0 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c36d9d640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 0x7f9c38068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3659c640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c3819a340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9c28005610 tx=0x7f9c28005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c28004ba0 con 0x7f9c380ffca0 2024-09-17T01:01:51.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c28004d00 con 0x7f9c380ffca0 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3819aca0 con 0x7f9c380ffca0 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.314+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c28003bd0 con 0x7f9c380ffca0 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.315+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3819b210 con 0x7f9c380ffca0 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.315+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3818e640 con 0x7f9c380ffca0 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.316+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f9c28031640 con 0x7f9c380ffca0 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.316+0000 7f9c2ffff640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9c2406cbd0 0x7f9c2406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:51.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.317+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3221+0+0 (secure 0 0 0) 0x7f9c280acc00 con 0x7f9c380ffca0 2024-09-17T01:01:51.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.317+0000 7f9c36d9d640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9c2406cbd0 0x7f9c2406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:51.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.317+0000 7f9c36d9d640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9c2406cbd0 0x7f9c2406f090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c200058c0 tx=0x7f9c20005ec0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:51.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.321+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9c280b3080 con 0x7f9c380ffca0 2024-09-17T01:01:51.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:51.498+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3802c4f0 con 0x7f9c2406cbd0 2024-09-17T01:01:51.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:51 smithi103 ceph-mon[28156]: pgmap v73: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:51.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:01:51.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T01:01:51.628 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:51 smithi103 ceph-mon[28156]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T01:01:51.628 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:51 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:01:51.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:51 smithi143 ceph-mon[35452]: pgmap v73: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:01:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T01:01:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:51 smithi143 ceph-mon[35452]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T01:01:51.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:51 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:01:52.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:52 smithi143 ceph-mon[35452]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:52 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:01:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:52 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:01:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:52 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:52 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T01:01:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:52 smithi143 ceph-mon[35452]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T01:01:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:52 smithi103 ceph-mon[28156]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:52 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:01:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:52 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:01:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:52 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:52 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T01:01:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:52 smithi103 ceph-mon[28156]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T01:01:52.961 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66547]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:01:52.961 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:52.961 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:52.961 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66547]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:53.211 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66552]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:01:53.211 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66552]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:53.211 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:53.211 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:01:52 smithi103 sudo[66552]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:53.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:01:53.348+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9c28077d40 con 0x7f9c380ffca0 2024-09-17T01:01:53.500 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66555]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:01:53.500 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:53.500 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:53.500 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66555]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:53.501 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:53.502 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:53.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:53.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:53.761 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:01:53.761 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:53.761 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:53.761 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66656]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:54.012 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66742]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:01:54.012 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66742]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:54.012 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:54.012 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:53 smithi103 sudo[66742]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:54.273 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66761]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:01:54.273 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66761]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:54.273 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:54.273 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66761]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:54.550 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66764]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:01:54.550 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66764]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:54.551 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:54.551 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66764]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:54.864 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66865]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:01:54.864 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:54.864 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:54.864 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 sudo[66865]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: Detected new or changed devices on smithi103 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi103 to 3946M 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: mgrmap e19: smithi103.efjaur(active, since 2m), standbys: smithi143.sxhocv 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/606185966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79344966-91c8-4c10-85b9-08c1bb6c503b"}]: dispatch 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79344966-91c8-4c10-85b9-08c1bb6c503b"}]: dispatch 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79344966-91c8-4c10-85b9-08c1bb6c503b"}]': finished 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:01:54.865 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:54 smithi103 ceph-mon[28156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:01:55.078 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:54 smithi143 sudo[39434]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:01:55.079 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:54 smithi143 sudo[39434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:55.079 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:54 smithi143 sudo[39434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:55.079 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:54 smithi143 sudo[39434]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:55.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 sudo[39438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:01:55.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 sudo[39438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:01:55.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 sudo[39438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:01:55.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 sudo[39438]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:01:55.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: Detected new or changed devices on smithi103 2024-09-17T01:01:55.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi103 to 3946M 2024-09-17T01:01:55.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: mgrmap e19: smithi103.efjaur(active, since 2m), standbys: smithi143.sxhocv 2024-09-17T01:01:55.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T01:01:55.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:01:55.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:55.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/606185966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79344966-91c8-4c10-85b9-08c1bb6c503b"}]: dispatch 2024-09-17T01:01:55.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79344966-91c8-4c10-85b9-08c1bb6c503b"}]: dispatch 2024-09-17T01:01:55.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79344966-91c8-4c10-85b9-08c1bb6c503b"}]': finished 2024-09-17T01:01:55.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T01:01:55.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:01:55.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:01:55.921 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/299272817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:01:55.921 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:01:55.921 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:01:55.921 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:01:55.922 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:01:55.922 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:01:55.922 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:55.922 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:01:55.922 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:01:55.922 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:55 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:56.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/299272817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:01:56.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:01:56.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:01:56.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:01:56.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:01:56.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:01:56.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:56.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:01:56.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:01:56.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:55 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:57 smithi103 ceph-mon[28156]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:57 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:57 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:57 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:57 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:57 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:57.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:57 smithi143 ceph-mon[35452]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:57 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:57 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:57 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:57 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:57.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:57 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:01:59.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:01:59 smithi143 ceph-mon[35452]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:01:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:01:59 smithi103 ceph-mon[28156]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:02:00.910 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:02:00.910 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:00.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:02:00.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:01.909 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:01 smithi143 ceph-mon[35452]: Deploying daemon osd.3 on smithi143 2024-09-17T01:02:01.909 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:01 smithi143 ceph-mon[35452]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T01:02:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:01 smithi103 ceph-mon[28156]: Deploying daemon osd.3 on smithi143 2024-09-17T01:02:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:01 smithi103 ceph-mon[28156]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T01:02:03.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:03 smithi143 ceph-mon[35452]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T01:02:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:03 smithi103 ceph-mon[28156]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T01:02:05.805 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:05 smithi143 ceph-mon[35452]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T01:02:05.805 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:05.805 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:05.805 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:05 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:05 smithi103 ceph-mon[28156]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T01:02:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:05 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:07.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.742+0000 7f9c2ffff640 1 -- 172.21.15.143:0/3287970511 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9c3802c4f0 con 0x7f9c2406cbd0 2024-09-17T01:02:07.741 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 3 on host 'smithi143' 2024-09-17T01:02:07.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9c2406cbd0 msgr2=0x7f9c2406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:07.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9c2406cbd0 0x7f9c2406f090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c200058c0 tx=0x7f9c20005ec0 comp rx=0 tx=0).stop 2024-09-17T01:02:07.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 msgr2=0x7f9c3819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c3819a340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9c28005610 tx=0x7f9c28005640 comp rx=0 tx=0).stop 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 shutdown_connections 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9c2406cbd0 0x7f9c2406f090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380ffca0 0x7f9c3819a340 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 --2- 172.21.15.143:0/3287970511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c380feaa0 0x7f9c38068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.744+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 >> 172.21.15.143:0/3287970511 conn(0x7f9c380fa230 msgr2=0x7f9c38103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.745+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 shutdown_connections 2024-09-17T01:02:07.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:07.745+0000 7f9c3d11a640 1 -- 172.21.15.143:0/3287970511 wait complete. 2024-09-17T01:02:07.827 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:07 smithi143 ceph-mon[35452]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T01:02:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:07 smithi103 ceph-mon[28156]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T01:02:08.728 DEBUG:teuthology.orchestra.run.smithi143:osd.3> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T01:02:08.731 INFO:tasks.cephadm:Deploying osd.4 on smithi143 with /dev/vg_nvme/lv_3... 2024-09-17T01:02:08.731 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T01:02:08.967 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:08.968 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:08.968 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:09.219 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:02:09 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[41416]: 2024-09-17T01:02:09.098+0000 7f67aa0b4640 -1 osd.3 0 log_to_monitors true 2024-09-17T01:02:09.481 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:02:09.938 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:09 smithi143 ceph-mon[35452]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T01:02:09.938 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:09 smithi143 ceph-mon[35452]: from='osd.3 [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:02:09.938 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:09 smithi143 ceph-mon[35452]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:02:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:09 smithi103 ceph-mon[28156]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T01:02:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:09 smithi103 ceph-mon[28156]: from='osd.3 [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:02:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:09 smithi103 ceph-mon[28156]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:02:10.823 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[41416]: 2024-09-17T01:02:10.756+0000 7f67a5812640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T01:02:10.823 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[41416]: 2024-09-17T01:02:10.761+0000 7f67a1e4d640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: from='osd.3 [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:10.824 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:10 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: from='osd.3 [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:10.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:10 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:12.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:11 smithi143 ceph-mon[35452]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:02:12.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:11 smithi143 ceph-mon[35452]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-17T01:02:12.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:11 smithi143 ceph-mon[35452]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T01:02:12.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:11 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:12.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:11 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:11 smithi103 ceph-mon[28156]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:02:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:11 smithi103 ceph-mon[28156]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-17T01:02:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:11 smithi103 ceph-mon[28156]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T01:02:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:11 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:11 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:12.626 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T01:02:12.650 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_3 2024-09-17T01:02:12.912 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:12 smithi143 ceph-mon[35452]: purged_snaps scrub starts 2024-09-17T01:02:12.912 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:12 smithi143 ceph-mon[35452]: purged_snaps scrub ok 2024-09-17T01:02:12.913 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:12 smithi143 ceph-mon[35452]: osd.3 [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] boot 2024-09-17T01:02:12.913 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:12 smithi143 ceph-mon[35452]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T01:02:12.913 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:12.913 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:12 smithi143 ceph-mon[35452]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T01:02:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:12 smithi103 ceph-mon[28156]: purged_snaps scrub starts 2024-09-17T01:02:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:12 smithi103 ceph-mon[28156]: purged_snaps scrub ok 2024-09-17T01:02:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:12 smithi103 ceph-mon[28156]: osd.3 [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] boot 2024-09-17T01:02:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:12 smithi103 ceph-mon[28156]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T01:02:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:12 smithi103 ceph-mon[28156]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T01:02:13.172 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:02:13.836 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:13 smithi143 ceph-mon[35452]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:13.836 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:13 smithi143 ceph-mon[35452]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T01:02:14.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:13 smithi103 ceph-mon[28156]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:14.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:13 smithi103 ceph-mon[28156]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T01:02:15.058 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T01:02:15.058 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: Detected new or changed devices on smithi143 2024-09-17T01:02:15.058 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi143 to 14912M 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:15.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.060 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:15 smithi143 ceph-mon[35452]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-09-17T01:02:15.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/3783922383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 msgr2=0x7f7ff41000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:15.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/3783922383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff41000b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009880 tx=0x7f7fe402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:02:15.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/3783922383 shutdown_connections 2024-09-17T01:02:15.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/3783922383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff41000b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:15.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/3783922383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 0x7f7ff40fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:15.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/3783922383 >> 172.21.15.143:0/3783922383 conn(0x7f7ff40fa1c0 msgr2=0x7f7ff40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:15.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/3783922383 shutdown_connections 2024-09-17T01:02:15.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.252+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/3783922383 wait complete. 2024-09-17T01:02:15.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ffb5aa640 1 Processor -- start 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ffb5aa640 1 -- start start 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ffb5aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 0x7f7ff4194530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ffb5aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff4194a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ffb5aa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4195040 con 0x7f7ff40fea30 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ffb5aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41951b0 con 0x7f7ff40ffc30 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff8b45640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff4194a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff8b45640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff4194a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38212/0 (socket says 172.21.15.143:38212) 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff8b45640 1 -- 172.21.15.143:0/2070875334 learned_addr learned my addr 172.21.15.143:0/2070875334 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff9346640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 0x7f7ff4194530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:15.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff8b45640 1 -- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 msgr2=0x7f7ff4194530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff8b45640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 0x7f7ff4194530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff8b45640 1 -- 172.21.15.143:0/2070875334 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009560 con 0x7f7ff40ffc30 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.253+0000 7f7ff9346640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 0x7f7ff4194530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.254+0000 7f7ff8b45640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff4194a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4005610 tx=0x7f7fe4005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.254+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe4004ba0 con 0x7f7ff40ffc30 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.254+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fe4004d00 con 0x7f7ff40ffc30 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.254+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe4003bd0 con 0x7f7ff40ffc30 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.254+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4067d20 con 0x7f7ff40ffc30 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.254+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff4068290 con 0x7f7ff40ffc30 2024-09-17T01:02:15.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.255+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff4107640 con 0x7f7ff40ffc30 2024-09-17T01:02:15.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.256+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7fe4031640 con 0x7f7ff40ffc30 2024-09-17T01:02:15.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.256+0000 7f7fea7fc640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7fe006cc50 0x7f7fe006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:15.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.256+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f7fe40acf30 con 0x7f7ff40ffc30 2024-09-17T01:02:15.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.257+0000 7f7ff9346640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7fe006cc50 0x7f7fe006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:15.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.257+0000 7f7ff9346640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7fe006cc50 0x7f7fe006f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00058c0 tx=0x7f7ff0005ec0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:15.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.261+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7fe40e0e20 con 0x7f7ff40ffc30 2024-09-17T01:02:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T01:02:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: Detected new or changed devices on smithi143 2024-09-17T01:02:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi143 to 14912M 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:14 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:15 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:15 smithi103 ceph-mon[28156]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-09-17T01:02:15.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:15.438+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ff4068aa0 con 0x7f7fe006cc50 2024-09-17T01:02:16.085 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:16 smithi143 ceph-mon[35452]: osdmap e30: 4 total, 4 up, 4 in 2024-09-17T01:02:16.085 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:16 smithi143 ceph-mon[35452]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:16.085 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:16 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:02:16.085 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:16 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:02:16.085 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:16 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:16 smithi103 ceph-mon[28156]: osdmap e30: 4 total, 4 up, 4 in 2024-09-17T01:02:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:16 smithi103 ceph-mon[28156]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:16 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:02:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:16 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:02:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:16 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:17.341 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:17 smithi143 ceph-mon[35452]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-17T01:02:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:17 smithi103 ceph-mon[28156]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-17T01:02:18.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:18 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/288525368' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5c851d1-3a94-4f34-a5a1-4217bd6ebb40"}]: dispatch 2024-09-17T01:02:18.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:18 smithi143 ceph-mon[35452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5c851d1-3a94-4f34-a5a1-4217bd6ebb40"}]: dispatch 2024-09-17T01:02:18.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:18 smithi143 ceph-mon[35452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5c851d1-3a94-4f34-a5a1-4217bd6ebb40"}]': finished 2024-09-17T01:02:18.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:18 smithi143 ceph-mon[35452]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T01:02:18.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:18.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:18 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/288525368' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5c851d1-3a94-4f34-a5a1-4217bd6ebb40"}]: dispatch 2024-09-17T01:02:18.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:18 smithi103 ceph-mon[28156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5c851d1-3a94-4f34-a5a1-4217bd6ebb40"}]: dispatch 2024-09-17T01:02:18.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:18 smithi103 ceph-mon[28156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5c851d1-3a94-4f34-a5a1-4217bd6ebb40"}]': finished 2024-09-17T01:02:18.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:18 smithi103 ceph-mon[28156]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T01:02:18.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:19.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:19 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/2239684808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:02:19.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:19 smithi143 ceph-mon[35452]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-17T01:02:19.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:19 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/2239684808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:02:19.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:19 smithi103 ceph-mon[28156]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-17T01:02:21.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:21 smithi103 ceph-mon[28156]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T01:02:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:21 smithi143 ceph-mon[35452]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T01:02:23.862 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:23 smithi143 ceph-mon[35452]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:23.862 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:23.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:23 smithi103 ceph-mon[28156]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:23.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:25.658 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:25 smithi143 ceph-mon[35452]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:25.658 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:02:25.658 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:25.658 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:25 smithi143 ceph-mon[35452]: Deploying daemon osd.4 on smithi143 2024-09-17T01:02:25.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:25 smithi103 ceph-mon[28156]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:25.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:02:25.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:25.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:25 smithi103 ceph-mon[28156]: Deploying daemon osd.4 on smithi143 2024-09-17T01:02:27.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:27 smithi143 ceph-mon[35452]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:27.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:27 smithi103 ceph-mon[28156]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:29 smithi103 ceph-mon[28156]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:29 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:29 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:29.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:29 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:29.927 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:29 smithi143 ceph-mon[35452]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:29.927 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:29 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:29.928 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:29 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:29.928 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:29 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:31.916 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:31 smithi143 ceph-mon[35452]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:31.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.916+0000 7f7fea7fc640 1 -- 172.21.15.143:0/2070875334 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7ff4068aa0 con 0x7f7fe006cc50 2024-09-17T01:02:31.917 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 4 on host 'smithi143' 2024-09-17T01:02:31.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7fe006cc50 msgr2=0x7f7fe006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:31.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7fe006cc50 0x7f7fe006f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00058c0 tx=0x7f7ff0005ec0 comp rx=0 tx=0).stop 2024-09-17T01:02:31.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 msgr2=0x7f7ff4194a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:31.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff4194a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4005610 tx=0x7f7fe4005640 comp rx=0 tx=0).stop 2024-09-17T01:02:31.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 shutdown_connections 2024-09-17T01:02:31.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7fe006cc50 0x7f7fe006f110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:31.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ff40ffc30 0x7f7ff4194a70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:31.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 --2- 172.21.15.143:0/2070875334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ff40fea30 0x7f7ff4194530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:31.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 >> 172.21.15.143:0/2070875334 conn(0x7f7ff40fa1c0 msgr2=0x7f7ff4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:31.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 shutdown_connections 2024-09-17T01:02:31.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:31.919+0000 7f7ffb5aa640 1 -- 172.21.15.143:0/2070875334 wait complete. 2024-09-17T01:02:31.926 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:31 smithi103 ceph-mon[28156]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:32.932 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:32 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:32.932 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:32 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:32.953 DEBUG:teuthology.orchestra.run.smithi143:osd.4> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T01:02:32.955 INFO:tasks.cephadm:Deploying osd.5 on smithi143 with /dev/vg_nvme/lv_2... 2024-09-17T01:02:32.956 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T01:02:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:32 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:32 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:33.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:02:33 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[48272]: 2024-09-17T01:02:33.339+0000 7fd57afde640 -1 osd.4 0 log_to_monitors true 2024-09-17T01:02:33.845 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:02:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:33 smithi103 ceph-mon[28156]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:33 smithi103 ceph-mon[28156]: from='osd.4 [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:02:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:33 smithi103 ceph-mon[28156]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:02:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:33 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:33 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:34.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:33 smithi143 ceph-mon[35452]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:34.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:33 smithi143 ceph-mon[35452]: from='osd.4 [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:02:34.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:33 smithi143 ceph-mon[35452]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:02:34.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:33 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:34.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:33 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:35.171 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[48272]: 2024-09-17T01:02:34.931+0000 7fd57673c640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T01:02:35.171 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[48272]: 2024-09-17T01:02:34.938+0000 7fd572d77640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:02:35.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-mon[35452]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:02:35.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-mon[35452]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T01:02:35.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:35.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-mon[35452]: from='osd.4 [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:35.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:34 smithi143 ceph-mon[35452]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:34 smithi103 ceph-mon[28156]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:02:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:34 smithi103 ceph-mon[28156]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T01:02:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:34 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:34 smithi103 ceph-mon[28156]: from='osd.4 [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:34 smithi103 ceph-mon[28156]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:35 smithi143 ceph-mon[35452]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:36.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:35 smithi143 ceph-mon[35452]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-17T01:02:36.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:35 smithi143 ceph-mon[35452]: osdmap e33: 5 total, 4 up, 5 in 2024-09-17T01:02:36.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:36.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:35 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:36.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:35 smithi103 ceph-mon[28156]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:02:36.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:35 smithi103 ceph-mon[28156]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-17T01:02:36.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:35 smithi103 ceph-mon[28156]: osdmap e33: 5 total, 4 up, 5 in 2024-09-17T01:02:36.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:36.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:35 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:37.085 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-17T01:02:37.109 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_2 2024-09-17T01:02:37.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:36 smithi143 ceph-mon[35452]: purged_snaps scrub starts 2024-09-17T01:02:37.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:36 smithi143 ceph-mon[35452]: purged_snaps scrub ok 2024-09-17T01:02:37.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:36 smithi143 ceph-mon[35452]: osd.4 [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] boot 2024-09-17T01:02:37.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:36 smithi143 ceph-mon[35452]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T01:02:37.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:36 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:36 smithi103 ceph-mon[28156]: purged_snaps scrub starts 2024-09-17T01:02:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:36 smithi103 ceph-mon[28156]: purged_snaps scrub ok 2024-09-17T01:02:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:36 smithi103 ceph-mon[28156]: osd.4 [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] boot 2024-09-17T01:02:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:36 smithi103 ceph-mon[28156]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T01:02:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:36 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:37.592 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:02:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:37 smithi103 ceph-mon[28156]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:37 smithi103 ceph-mon[28156]: osdmap e35: 5 total, 5 up, 5 in 2024-09-17T01:02:38.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:37 smithi143 ceph-mon[35452]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:38.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:37 smithi143 ceph-mon[35452]: osdmap e35: 5 total, 5 up, 5 in 2024-09-17T01:02:39.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:39.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:39.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:39.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:39.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:39.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:39.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:39.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 -- 172.21.15.143:0/2317490304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa648101280 msgr2=0x7fa648101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/2317490304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa648101280 0x7fa648101680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa638009880 tx=0x7fa63802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:02:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 -- 172.21.15.143:0/2317490304 shutdown_connections 2024-09-17T01:02:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/2317490304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6480ff7c0 0x7fa6480ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/2317490304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa648101280 0x7fa648101680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:39.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 -- 172.21.15.143:0/2317490304 >> 172.21.15.143:0/2317490304 conn(0x7fa6480fb330 msgr2=0x7fa6480fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:39.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 -- 172.21.15.143:0/2317490304 shutdown_connections 2024-09-17T01:02:39.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 -- 172.21.15.143:0/2317490304 wait complete. 2024-09-17T01:02:39.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.699+0000 7fa64d9e9640 1 Processor -- start 2024-09-17T01:02:39.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa64d9e9640 1 -- start start 2024-09-17T01:02:39.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa64d9e9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 0x7fa648074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:39.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa64d9e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa648101280 0x7fa6480728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:39.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa64d9e9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648072de0 con 0x7fa648101280 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa64d9e9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648072f50 con 0x7fa6480ff7c0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 0x7fa648074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 0x7fa648074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:59374/0 (socket says 172.21.15.143:59374) 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 -- 172.21.15.143:0/3291720697 learned_addr learned my addr 172.21.15.143:0/3291720697 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa6467fc640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa648101280 0x7fa6480728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 -- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa648101280 msgr2=0x7fa6480728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa648101280 0x7fa6480728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 -- 172.21.15.143:0/3291720697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638009560 con 0x7fa6480ff7c0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa646ffd640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 0x7fa648074250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa638006010 tx=0x7fa6380055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.700+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa638004aa0 con 0x7fa6480ff7c0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.701+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa638004c00 con 0x7fa6480ff7c0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.701+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6480731d0 con 0x7fa6480ff7c0 2024-09-17T01:02:39.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.701+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6380039e0 con 0x7fa6480ff7c0 2024-09-17T01:02:39.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.701+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64819d7c0 con 0x7fa6480ff7c0 2024-09-17T01:02:39.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.702+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa648109200 con 0x7fa6480ff7c0 2024-09-17T01:02:39.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.702+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa638031c00 con 0x7fa6480ff7c0 2024-09-17T01:02:39.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.702+0000 7fa64c9e7640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa63006cc50 0x7fa63006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:39.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.703+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7fa6380acd30 con 0x7fa6480ff7c0 2024-09-17T01:02:39.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.703+0000 7fa6467fc640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa63006cc50 0x7fa63006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:39.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.703+0000 7fa6467fc640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa63006cc50 0x7fa63006f110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa648073fd0 tx=0x7fa63c00b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:39.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.707+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa638077720 con 0x7fa6480ff7c0 2024-09-17T01:02:39.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:39.876+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa648108b40 con 0x7fa63006cc50 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: Detected new or changed devices on smithi143 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi143 to 7456M 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:02:40.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: Detected new or changed devices on smithi143 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi143 to 7456M 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:02:40.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:02:40.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:41.150 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:40 smithi143 ceph-mon[35452]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:40 smithi103 ceph-mon[28156]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:41 smithi143 ceph-mon[35452]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:41 smithi103 ceph-mon[28156]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:42 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/1001004337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced92f57-71a3-4473-ae8d-d87c3674fcd4"}]: dispatch 2024-09-17T01:02:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:42 smithi143 ceph-mon[35452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced92f57-71a3-4473-ae8d-d87c3674fcd4"}]: dispatch 2024-09-17T01:02:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:42 smithi143 ceph-mon[35452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ced92f57-71a3-4473-ae8d-d87c3674fcd4"}]': finished 2024-09-17T01:02:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:42 smithi143 ceph-mon[35452]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T01:02:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:42 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:42 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/2799860677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:02:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:42 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/1001004337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced92f57-71a3-4473-ae8d-d87c3674fcd4"}]: dispatch 2024-09-17T01:02:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:42 smithi103 ceph-mon[28156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced92f57-71a3-4473-ae8d-d87c3674fcd4"}]: dispatch 2024-09-17T01:02:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:42 smithi103 ceph-mon[28156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ced92f57-71a3-4473-ae8d-d87c3674fcd4"}]': finished 2024-09-17T01:02:43.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:42 smithi103 ceph-mon[28156]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T01:02:43.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:42 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:43.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:42 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/2799860677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:02:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:43 smithi143 ceph-mon[35452]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:44.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:43 smithi103 ceph-mon[28156]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:44 smithi143 ceph-mon[35452]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:45.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:44 smithi103 ceph-mon[28156]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:47.750 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:47 smithi143 ceph-mon[35452]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:47 smithi103 ceph-mon[28156]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:49.867 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:49 smithi143 ceph-mon[35452]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:49.867 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:02:49.867 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:49 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:49.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:49 smithi103 ceph-mon[28156]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:49.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:02:49.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:49 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:50.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:50 smithi103 ceph-mon[28156]: Deploying daemon osd.5 on smithi143 2024-09-17T01:02:50.936 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:50 smithi143 ceph-mon[35452]: Deploying daemon osd.5 on smithi143 2024-09-17T01:02:51.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:51 smithi143 ceph-mon[35452]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:51.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:51 smithi103 ceph-mon[28156]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:53.910 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:53 smithi143 ceph-mon[35452]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:53.910 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:53 smithi103 ceph-mon[28156]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:54.730 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:54 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:54.731 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:54 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:54.731 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:54 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:54.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:54.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:54.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:54 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:55.902 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:55 smithi143 ceph-mon[35452]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:55.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:55 smithi103 ceph-mon[28156]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:57.692 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:57 smithi143 ceph-mon[35452]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:57.724 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 5 on host 'smithi143' 2024-09-17T01:02:57.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.726+0000 7fa64c9e7640 1 -- 172.21.15.143:0/3291720697 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa648108b40 con 0x7fa63006cc50 2024-09-17T01:02:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa63006cc50 msgr2=0x7fa63006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa63006cc50 0x7fa63006f110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa648073fd0 tx=0x7fa63c00b390 comp rx=0 tx=0).stop 2024-09-17T01:02:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 msgr2=0x7fa648074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 0x7fa648074250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa638006010 tx=0x7fa6380055a0 comp rx=0 tx=0).stop 2024-09-17T01:02:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 shutdown_connections 2024-09-17T01:02:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa63006cc50 0x7fa63006f110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa648101280 0x7fa6480728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 --2- 172.21.15.143:0/3291720697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6480ff7c0 0x7fa648074250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 >> 172.21.15.143:0/3291720697 conn(0x7fa6480fb330 msgr2=0x7fa648104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 shutdown_connections 2024-09-17T01:02:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:02:57.728+0000 7fa64d9e9640 1 -- 172.21.15.143:0/3291720697 wait complete. 2024-09-17T01:02:57.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:57 smithi103 ceph-mon[28156]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:58.311 DEBUG:teuthology.orchestra.run.smithi143:osd.5> sudo journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T01:02:58.314 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-17T01:02:58.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:02:58.525 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:02:58.902 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:58.902 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:58.902 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:58 smithi103 ceph-mon[28156]: from='osd.5 [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:02:58.902 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:58 smithi103 ceph-mon[28156]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:02:58.902 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:58.902 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:58 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:59.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:58 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:59.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:58 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:59.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:58 smithi143 ceph-mon[35452]: from='osd.5 [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:02:59.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:58 smithi143 ceph-mon[35452]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:02:59.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:58 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:59.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:58 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:02:59.737 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:59 smithi143 ceph-mon[35452]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:59.737 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:59 smithi143 ceph-mon[35452]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:02:59.738 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:59 smithi143 ceph-mon[35452]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T01:02:59.738 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:59 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:59.738 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:59 smithi143 ceph-mon[35452]: from='osd.5 [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:59.738 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:02:59 smithi143 ceph-mon[35452]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:59 smithi103 ceph-mon[28156]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:02:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:59 smithi103 ceph-mon[28156]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:02:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:59 smithi103 ceph-mon[28156]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T01:02:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:59 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:59 smithi103 ceph-mon[28156]: from='osd.5 [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:02:59.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:02:59 smithi103 ceph-mon[28156]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 -- 172.21.15.103:0/4140012593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000ffc80 msgr2=0x7fb500100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 --2- 172.21.15.103:0/4140012593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000ffc80 0x7fb500100100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009880 tx=0x7fb4f002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 -- 172.21.15.103:0/4140012593 shutdown_connections 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 --2- 172.21.15.103:0/4140012593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000ffc80 0x7fb500100100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 --2- 172.21.15.103:0/4140012593 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5000fea80 0x7fb5000fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 -- 172.21.15.103:0/4140012593 >> 172.21.15.103:0/4140012593 conn(0x7fb5000fa210 msgr2=0x7fb5000fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 -- 172.21.15.103:0/4140012593 shutdown_connections 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.251+0000 7fb507935640 1 -- 172.21.15.103:0/4140012593 wait complete. 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb507935640 1 Processor -- start 2024-09-17T01:03:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb507935640 1 -- start start 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb507935640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 0x7fb500102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb507935640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5000ffc80 0x7fb500101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb507935640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5001015a0 con 0x7fb5000fea80 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb507935640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb500101710 con 0x7fb5000ffc80 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb5056d1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 0x7fb500102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb5056d1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 0x7fb500102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40062/0 (socket says 172.21.15.103:40062) 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb5056d1640 1 -- 172.21.15.103:0/2010093468 learned_addr learned my addr 172.21.15.103:0/2010093468 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb504ed0640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5000ffc80 0x7fb500101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb5056d1640 1 -- 172.21.15.103:0/2010093468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5000ffc80 msgr2=0x7fb500101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb5056d1640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5000ffc80 0x7fb500101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.252+0000 7fb5056d1640 1 -- 172.21.15.103:0/2010093468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0009560 con 0x7fb5000fea80 2024-09-17T01:03:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.253+0000 7fb5056d1640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 0x7fb500102a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e940 tx=0x7fb4fc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.253+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4fc0096e0 con 0x7fb5000fea80 2024-09-17T01:03:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.253+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5001019f0 con 0x7fb5000fea80 2024-09-17T01:03:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.253+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4fc0044f0 con 0x7fb5000fea80 2024-09-17T01:03:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.253+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4fc010430 con 0x7fb5000fea80 2024-09-17T01:03:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.253+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50019d6c0 con 0x7fb5000fea80 2024-09-17T01:03:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.254+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb500107690 con 0x7fb5000fea80 2024-09-17T01:03:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.255+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb4fc00cc90 con 0x7fb5000fea80 2024-09-17T01:03:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.255+0000 7fb4f67fc640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb4ec06cc50 0x7fb4ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.256+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7fb4fc014070 con 0x7fb5000fea80 2024-09-17T01:03:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.256+0000 7fb504ed0640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb4ec06cc50 0x7fb4ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.256+0000 7fb504ed0640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb4ec06cc50 0x7fb4ec06f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0000c00 tx=0x7fb4f00314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:00.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.260+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb4fc056a90 con 0x7fb5000fea80 2024-09-17T01:03:00.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.425+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fb500107890 con 0x7fb5000fea80 2024-09-17T01:03:00.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.425+0000 7fb4f67fc640 1 -- 172.21.15.103:0/2010093468 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7fb4fc05a0b0 con 0x7fb5000fea80 2024-09-17T01:03:00.425 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:00.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb4ec06cc50 msgr2=0x7fb4ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:00.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb4ec06cc50 0x7fb4ec06f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0000c00 tx=0x7fb4f00314e0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 msgr2=0x7fb500102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:00.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 0x7fb500102a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e940 tx=0x7fb4fc00ee00 comp rx=0 tx=0).stop 2024-09-17T01:03:00.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 shutdown_connections 2024-09-17T01:03:00.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb4ec06cc50 0x7fb4ec06f110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5000ffc80 0x7fb500101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 --2- 172.21.15.103:0/2010093468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5000fea80 0x7fb500102a10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:00.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 >> 172.21.15.103:0/2010093468 conn(0x7fb5000fa210 msgr2=0x7fb500068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:00.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 shutdown_connections 2024-09-17T01:03:00.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:00.427+0000 7fb507935640 1 -- 172.21.15.103:0/2010093468 wait complete. 2024-09-17T01:03:00.740 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[54746]: 2024-09-17T01:03:00.544+0000 7f405adc2640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T01:03:00.740 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[54746]: 2024-09-17T01:03:00.554+0000 7f40533f5640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:03:00.808 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:00 smithi103 ceph-mon[28156]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-17T01:03:00.808 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:00 smithi103 ceph-mon[28156]: osdmap e38: 6 total, 5 up, 6 in 2024-09-17T01:03:00.808 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:00.808 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:00 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:00.809 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:00 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2010093468' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:03:00.809 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:00 smithi103 ceph-mon[28156]: from='osd.5 ' entity='osd.5' 2024-09-17T01:03:01.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-mon[35452]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-17T01:03:01.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-mon[35452]: osdmap e38: 6 total, 5 up, 6 in 2024-09-17T01:03:01.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:01.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:01.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2010093468' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:03:01.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:00 smithi143 ceph-mon[35452]: from='osd.5 ' entity='osd.5' 2024-09-17T01:03:01.112 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1726534955,"num_in_osds":6,"osd_in_since":1726534962,"num_remapped_pgs":0} 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: purged_snaps scrub starts 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: purged_snaps scrub ok 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: osd.5 [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] boot 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T01:03:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:02.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:03:02.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: purged_snaps scrub starts 2024-09-17T01:03:02.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: purged_snaps scrub ok 2024-09-17T01:03:02.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:03:02.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:02.138 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: osd.5 [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] boot 2024-09-17T01:03:02.138 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T01:03:02.138 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:02.315 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:03.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: Detected new or changed devices on smithi143 2024-09-17T01:03:03.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:03:03.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:03:03.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:03:03.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi143 to 4970M 2024-09-17T01:03:03.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:03.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:03.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:03.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:03.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:03.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:02 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: Detected new or changed devices on smithi143 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi143 to 4970M 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:03.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:03.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:02 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:03:03.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 -- 172.21.15.103:0/4164935130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae90100d60 msgr2=0x7fae901011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:03.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 --2- 172.21.15.103:0/4164935130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae90100d60 0x7fae901011e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae80009880 tx=0x7fae8002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:03.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 -- 172.21.15.103:0/4164935130 shutdown_connections 2024-09-17T01:03:03.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 --2- 172.21.15.103:0/4164935130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae90100d60 0x7fae901011e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 --2- 172.21.15.103:0/4164935130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae900ffb60 0x7fae900fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 -- 172.21.15.103:0/4164935130 >> 172.21.15.103:0/4164935130 conn(0x7fae900fb2f0 msgr2=0x7fae900fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 -- 172.21.15.103:0/4164935130 shutdown_connections 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.878+0000 7fae98675640 1 -- 172.21.15.103:0/4164935130 wait complete. 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae98675640 1 Processor -- start 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae98675640 1 -- start start 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae98675640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 0x7fae90074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae98675640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae90100d60 0x7fae900728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae98675640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90072de0 con 0x7fae900ffb60 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae98675640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90072f50 con 0x7fae90100d60 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae96411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 0x7fae90074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:03.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae96411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 0x7fae90074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35250/0 (socket says 172.21.15.103:35250) 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.879+0000 7fae96411640 1 -- 172.21.15.103:0/1150676178 learned_addr learned my addr 172.21.15.103:0/1150676178 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae95c10640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae90100d60 0x7fae900728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae96411640 1 -- 172.21.15.103:0/1150676178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae90100d60 msgr2=0x7fae900728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae96411640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae90100d60 0x7fae900728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae96411640 1 -- 172.21.15.103:0/1150676178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80009560 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae96411640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 0x7fae90074200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00c8f0 tx=0x7fae8c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8c007b80 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae8c007ce0 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae90073230 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8c018870 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.880+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9019d680 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.881+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90109120 con 0x7fae900ffb60 2024-09-17T01:03:03.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.882+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fae8c0189d0 con 0x7fae900ffb60 2024-09-17T01:03:03.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.882+0000 7fae877fe640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fae7c06cc50 0x7fae7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:03.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.882+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fae8c08c000 con 0x7fae900ffb60 2024-09-17T01:03:03.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.882+0000 7fae95c10640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fae7c06cc50 0x7fae7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:03.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.883+0000 7fae95c10640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fae7c06cc50 0x7fae7c06f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae80000c00 tx=0x7fae800314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:03.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:03.886+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fae90109120 con 0x7fae900ffb60 2024-09-17T01:03:04.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.051+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fae9018f6e0 con 0x7fae900ffb60 2024-09-17T01:03:04.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.051+0000 7fae877fe640 1 -- 172.21.15.103:0/1150676178 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fae8c056790 con 0x7fae900ffb60 2024-09-17T01:03:04.051 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fae7c06cc50 msgr2=0x7fae7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fae7c06cc50 0x7fae7c06f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae80000c00 tx=0x7fae800314e0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 msgr2=0x7fae90074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 0x7fae90074200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00c8f0 tx=0x7fae8c00cdb0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 shutdown_connections 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fae7c06cc50 0x7fae7c06f110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae90100d60 0x7fae900728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 --2- 172.21.15.103:0/1150676178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900ffb60 0x7fae90074200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.053+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 >> 172.21.15.103:0/1150676178 conn(0x7fae900fb2f0 msgr2=0x7fae901044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.054+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 shutdown_connections 2024-09-17T01:03:04.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:04.054+0000 7fae98675640 1 -- 172.21.15.103:0/1150676178 wait complete. 2024-09-17T01:03:04.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:03 smithi103 ceph-mon[28156]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:04.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:03 smithi103 ceph-mon[28156]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T01:03:04.235 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:03 smithi143 ceph-mon[35452]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:04.235 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:03 smithi143 ceph-mon[35452]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T01:03:04.755 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726534981,"num_in_osds":6,"osd_in_since":1726534962,"num_remapped_pgs":0} 2024-09-17T01:03:04.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:03:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:05.117 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:04 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1150676178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:03:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:04 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1150676178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:03:06.119 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:05 smithi103 ceph-mon[28156]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:06.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:05 smithi143 ceph-mon[35452]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 -- 172.21.15.103:0/4143530823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc0fe9a0 msgr2=0x7faafc0fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 --2- 172.21.15.103:0/4143530823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc0fe9a0 0x7faafc0fee00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009880 tx=0x7faaf002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 -- 172.21.15.103:0/4143530823 shutdown_connections 2024-09-17T01:03:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 --2- 172.21.15.103:0/4143530823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc0fe9a0 0x7faafc0fee00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 --2- 172.21.15.103:0/4143530823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1049a0 0x7faafc104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 -- 172.21.15.103:0/4143530823 >> 172.21.15.103:0/4143530823 conn(0x7faafc0758c0 msgr2=0x7faafc0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 -- 172.21.15.103:0/4143530823 shutdown_connections 2024-09-17T01:03:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.678+0000 7fab01d85640 1 -- 172.21.15.103:0/4143530823 wait complete. 2024-09-17T01:03:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7fab01d85640 1 Processor -- start 2024-09-17T01:03:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7fab01d85640 1 -- start start 2024-09-17T01:03:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7fab01d85640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc0fe9a0 0x7faafc196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7fab01d85640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 0x7faafc196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7fab01d85640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc197520 con 0x7faafc1049a0 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7fab01d85640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc197690 con 0x7faafc0fe9a0 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7faafaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 0x7faafc196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7faafaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 0x7faafc196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35266/0 (socket says 172.21.15.103:35266) 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7faafaffd640 1 -- 172.21.15.103:0/485991991 learned_addr learned my addr 172.21.15.103:0/485991991 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7faafaffd640 1 -- 172.21.15.103:0/485991991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc0fe9a0 msgr2=0x7faafc196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.679+0000 7faafaffd640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc0fe9a0 0x7faafc196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7faafaffd640 1 -- 172.21.15.103:0/485991991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf0009560 con 0x7faafc1049a0 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7faafaffd640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 0x7faafc196f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faaf002a9c0 tx=0x7faaf00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf0004aa0 con 0x7faafc1049a0 2024-09-17T01:03:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc19fa80 con 0x7faafc1049a0 2024-09-17T01:03:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faaf0004c00 con 0x7faafc1049a0 2024-09-17T01:03:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf0003ab0 con 0x7faafc1049a0 2024-09-17T01:03:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.680+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc19fde0 con 0x7faafc1049a0 2024-09-17T01:03:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.681+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc1000e0 con 0x7faafc1049a0 2024-09-17T01:03:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.681+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7faaf0031d20 con 0x7faafc1049a0 2024-09-17T01:03:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.682+0000 7faaf8ff9640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7faae406cc50 0x7faae406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.682+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faaf00ad020 con 0x7faafc1049a0 2024-09-17T01:03:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.682+0000 7faafb7fe640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7faae406cc50 0x7faae406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.682+0000 7faafb7fe640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7faae406cc50 0x7faae406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faaec009710 tx=0x7faaec006c90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:06.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.686+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faaf0077730 con 0x7faafc1049a0 2024-09-17T01:03:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.848+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faafc106fd0 con 0x7faafc1049a0 2024-09-17T01:03:06.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.849+0000 7faaf8ff9640 1 -- 172.21.15.103:0/485991991 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11400 (secure 0 0 0) 0x7faaf007ad50 con 0x7faafc1049a0 2024-09-17T01:03:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:06.848 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","created":"2024-09-17T00:57:37.320304+0000","modified":"2024-09-17T01:03:02.921049+0000","last_up_change":"2024-09-17T01:03:01.547574+0000","last_in_change":"2024-09-17T01:02:42.099782+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:01:50.857514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17f01f59-16a2-47ef-b7d5-0088763afc90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6803","nonce":1019527091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6805","nonce":1019527091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6809","nonce":1019527091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6807","nonce":1019527091}]},"public_addr":"172.21.15.103:6803/1019527091","cluster_addr":"172.21.15.103:6805/1019527091","heartbeat_back_addr":"172.21.15.103:6809/1019527091","heartbeat_front_addr":"172.21.15.103:6807/1019527091","state":["exists","up"]},{"osd":1,"uuid":"94747077-fac6-4911-8ba7-21c1e21f8508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6811","nonce":1922974319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6813","nonce":1922974319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6817","nonce":1922974319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6815","nonce":1922974319}]},"public_addr":"172.21.15.103:6811/1922974319","cluster_addr":"172.21.15.103:6813/1922974319","heartbeat_back_addr":"172.21.15.103:6817/1922974319","heartbeat_front_addr":"172.21.15.103:6815/1922974319","state":["exists","up"]},{"osd":2,"uuid":"6becb291-d5ea-460f-aef4-10b211a48efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6819","nonce":1054806328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6821","nonce":1054806328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6825","nonce":1054806328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6823","nonce":1054806328}]},"public_addr":"172.21.15.103:6819/1054806328","cluster_addr":"172.21.15.103:6821/1054806328","heartbeat_back_addr":"172.21.15.103:6825/1054806328","heartbeat_front_addr":"172.21.15.103:6823/1054806328","state":["exists","up"]},{"osd":3,"uuid":"79344966-91c8-4c10-85b9-08c1bb6c503b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6801","nonce":3319616449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6803","nonce":3319616449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6807","nonce":3319616449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6805","nonce":3319616449}]},"public_addr":"172.21.15.143:6801/3319616449","cluster_addr":"172.21.15.143:6803/3319616449","heartbeat_back_addr":"172.21.15.143:6807/3319616449","heartbeat_front_addr":"172.21.15.143:6805/3319616449","state":["exists","up"]},{"osd":4,"uuid":"b5c851d1-3a94-4f34-a5a1-4217bd6ebb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6809","nonce":3234539424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6811","nonce":3234539424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6815","nonce":3234539424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6813","nonce":3234539424}]},"public_addr":"172.21.15.143:6809/3234539424","cluster_addr":"172.21.15.143:6811/3234539424","heartbeat_back_addr":"172.21.15.143:6815/3234539424","heartbeat_front_addr":"172.21.15.143:6813/3234539424","state":["exists","up"]},{"osd":5,"uuid":"ced92f57-71a3-4473-ae8d-d87c3674fcd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6817","nonce":1184512887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6819","nonce":1184512887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6823","nonce":1184512887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6821","nonce":1184512887}]},"public_addr":"172.21.15.143:6817/1184512887","cluster_addr":"172.21.15.143:6819/1184512887","heartbeat_back_addr":"172.21.15.143:6823/1184512887","heartbeat_front_addr":"172.21.15.143:6821/1184512887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:00:55.114255+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:01:21.946130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:01:48.117192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:10.073924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:34.326710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:58.959999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/517531851":"2024-09-18T00:59:38.557970+0000","172.21.15.103:0/1081471131":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/1007296496":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/356662493":"2024-09-18T00:58:00.610155+0000","172.21.15.103:6800/2182127784":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/3774926914":"2024-09-18T00:58:35.283351+0000","172.21.15.103:6800/1190379096":"2024-09-18T00:58:35.283351+0000","172.21.15.103:6801/1190379096":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/3632442270":"2024-09-18T00:58:00.610155+0000","172.21.15.103:6801/2182127784":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/4077678822":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/4141211511":"2024-09-18T00:59:38.557970+0000","172.21.15.103:0/1139543399":"2024-09-18T00:59:38.557970+0000","172.21.15.103:6801/3684168093":"2024-09-18T00:59:38.557970+0000","172.21.15.103:6800/3684168093":"2024-09-18T00:59:38.557970+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.850+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7faae406cc50 msgr2=0x7faae406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.850+0000 7fab01d85640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7faae406cc50 0x7faae406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faaec009710 tx=0x7faaec006c90 comp rx=0 tx=0).stop 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 msgr2=0x7faafc196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 0x7faafc196f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faaf002a9c0 tx=0x7faaf00055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 shutdown_connections 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7faae406cc50 0x7faae406f110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc1049a0 0x7faafc196f50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 --2- 172.21.15.103:0/485991991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc0fe9a0 0x7faafc196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 >> 172.21.15.103:0/485991991 conn(0x7faafc0758c0 msgr2=0x7faafc102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 shutdown_connections 2024-09-17T01:03:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:06.851+0000 7fab01d85640 1 -- 172.21.15.103:0/485991991 wait complete. 2024-09-17T01:03:07.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/485991991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:03:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:06 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/485991991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:03:07.573 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:01:50.857514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:03:07.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T01:03:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:08.142 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:07 smithi103 ceph-mon[28156]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:08.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:07 smithi143 ceph-mon[35452]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:09.157 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/4177661912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac105bf0 msgr2=0x7f7eac105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/4177661912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac105bf0 0x7f7eac105fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009880 tx=0x7f7e9c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/4177661912 shutdown_connections 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/4177661912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eac0ffb40 0x7f7eac0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/4177661912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac105bf0 0x7f7eac105fd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/4177661912 >> 172.21.15.103:0/4177661912 conn(0x7f7eac0fb840 msgr2=0x7f7eac0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.327+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/4177661912 shutdown_connections 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.328+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/4177661912 wait complete. 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.328+0000 7f7eb1dbe640 1 Processor -- start 2024-09-17T01:03:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.328+0000 7f7eb1dbe640 1 -- start start 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eb1dbe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 0x7f7eac19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eb1dbe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eac105bf0 0x7f7eac19bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eb1dbe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac19c300 con 0x7f7eac0ffb40 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eb1dbe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac195890 con 0x7f7eac105bf0 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 0x7f7eac19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 0x7f7eac19b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35282/0 (socket says 172.21.15.103:35282) 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 -- 172.21.15.103:0/2037947801 learned_addr learned my addr 172.21.15.103:0/2037947801 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7ea3fff640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eac105bf0 0x7f7eac19bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 -- 172.21.15.103:0/2037947801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eac105bf0 msgr2=0x7f7eac19bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eac105bf0 0x7f7eac19bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 -- 172.21.15.103:0/2037947801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009560 con 0x7f7eac0ffb40 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eab7fe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 0x7f7eac19b7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c02a9c0 tx=0x7f7e9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e9c004aa0 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e9c004c00 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac195b10 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e9c003980 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.329+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac196080 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.330+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac1011f0 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.331+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7e9c003bf0 con 0x7f7eac0ffb40 2024-09-17T01:03:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.331+0000 7f7ea97fa640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7e9806cc50 0x7f7e9806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:09.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.331+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7e9c0aced0 con 0x7f7eac0ffb40 2024-09-17T01:03:09.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.331+0000 7f7ea3fff640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7e9806cc50 0x7f7e9806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:09.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.332+0000 7f7ea3fff640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7e9806cc50 0x7f7e9806f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7eac196d00 tx=0x7f7e9400b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:09.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.336+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e9c077690 con 0x7f7eac0ffb40 2024-09-17T01:03:09.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.498+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7eac0fffa0 con 0x7f7eac0ffb40 2024-09-17T01:03:09.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.498+0000 7f7ea97fa640 1 -- 172.21.15.103:0/2037947801 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7eac0fffa0 con 0x7f7eac0ffb40 2024-09-17T01:03:09.497 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-17T01:03:09.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7e9806cc50 msgr2=0x7f7e9806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:09.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7e9806cc50 0x7f7e9806f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7eac196d00 tx=0x7f7e9400b390 comp rx=0 tx=0).stop 2024-09-17T01:03:09.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 msgr2=0x7f7eac19b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 0x7f7eac19b7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c02a9c0 tx=0x7f7e9c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 shutdown_connections 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7e9806cc50 0x7f7e9806f110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eac105bf0 0x7f7eac19bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 --2- 172.21.15.103:0/2037947801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eac0ffb40 0x7f7eac19b7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 >> 172.21.15.103:0/2037947801 conn(0x7f7eac0fb840 msgr2=0x7f7eac0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 shutdown_connections 2024-09-17T01:03:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:09.500+0000 7f7eb1dbe640 1 -- 172.21.15.103:0/2037947801 wait complete. 2024-09-17T01:03:10.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:09 smithi103 ceph-mon[28156]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:10.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:09 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2037947801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T01:03:10.149 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T01:03:10.149 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T01:03:10.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:09 smithi143 ceph-mon[35452]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:10.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:09 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2037947801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T01:03:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 -- 172.21.15.103:0/104143401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 msgr2=0x7f9d6c105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/104143401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c105330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d600098b0 tx=0x7f9d6002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 -- 172.21.15.103:0/104143401 shutdown_connections 2024-09-17T01:03:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/104143401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c105330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/104143401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d6c100610 0x7f9d6c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 -- 172.21.15.103:0/104143401 >> 172.21.15.103:0/104143401 conn(0x7f9d6c0fa210 msgr2=0x7f9d6c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 -- 172.21.15.103:0/104143401 shutdown_connections 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.010+0000 7f9d71e9a640 1 -- 172.21.15.103:0/104143401 wait complete. 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d71e9a640 1 Processor -- start 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d71e9a640 1 -- start start 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d71e9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d6c100610 0x7f9d6c0fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d71e9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c0fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d71e9a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0feb00 con 0x7f9d6c102f40 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d71e9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0fec70 con 0x7f9d6c100610 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c0fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c0fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35290/0 (socket says 172.21.15.103:35290) 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.011+0000 7f9d6affd640 1 -- 172.21.15.103:0/2671947179 learned_addr learned my addr 172.21.15.103:0/2671947179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d6b7fe640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d6c100610 0x7f9d6c0fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d6affd640 1 -- 172.21.15.103:0/2671947179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d6c100610 msgr2=0x7f9d6c0fff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d6affd640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d6c100610 0x7f9d6c0fff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d6affd640 1 -- 172.21.15.103:0/2671947179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60009560 con 0x7f9d6c102f40 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d6affd640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c0fe5c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d6002a9f0 tx=0x7f9d60005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d60004b20 con 0x7f9d6c102f40 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d60004c80 con 0x7f9d6c102f40 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d60003b80 con 0x7f9d6c102f40 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c0feef0 con 0x7f9d6c102f40 2024-09-17T01:03:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.012+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c19d7e0 con 0x7f9d6c102f40 2024-09-17T01:03:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.013+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6c100a70 con 0x7f9d6c102f40 2024-09-17T01:03:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.013+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9d60031640 con 0x7f9d6c102f40 2024-09-17T01:03:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.014+0000 7f9d68ff9640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9d5406cc50 0x7f9d5406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.014+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9d600ad190 con 0x7f9d6c102f40 2024-09-17T01:03:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.014+0000 7f9d6b7fe640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9d5406cc50 0x7f9d5406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.014+0000 7f9d6b7fe640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9d5406cc50 0x7f9d5406f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009890 tx=0x7f9d5c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:12.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.018+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9d600778a0 con 0x7f9d6c102f40 2024-09-17T01:03:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:11 smithi103 ceph-mon[28156]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.242+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9d6c19da10 con 0x7f9d6c102f40 2024-09-17T01:03:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.247+0000 7f9d68ff9640 1 -- 172.21.15.103:0/2671947179 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9d60077030 con 0x7f9d6c102f40 2024-09-17T01:03:12.247 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-17T01:03:12.247 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBQ1ehmsxKMDhAAqpGEA1MdUvObLOCQpejRtQ== 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.249+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9d5406cc50 msgr2=0x7f9d5406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.249+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9d5406cc50 0x7f9d5406f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009890 tx=0x7f9d5c008040 comp rx=0 tx=0).stop 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 msgr2=0x7f9d6c0fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c0fe5c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d6002a9f0 tx=0x7f9d60005610 comp rx=0 tx=0).stop 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 shutdown_connections 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f9d5406cc50 0x7f9d5406f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c102f40 0x7f9d6c0fe5c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 --2- 172.21.15.103:0/2671947179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d6c100610 0x7f9d6c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 >> 172.21.15.103:0/2671947179 conn(0x7f9d6c0fa210 msgr2=0x7f9d6c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 shutdown_connections 2024-09-17T01:03:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:12.250+0000 7f9d71e9a640 1 -- 172.21.15.103:0/2671947179 wait complete. 2024-09-17T01:03:12.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:11 smithi143 ceph-mon[35452]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:12.863 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:03:12.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T01:03:12.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T01:03:12.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T01:03:13.114 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi143/config 2024-09-17T01:03:13.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:12 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2671947179' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:03:13.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:12 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2671947179' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:03:13.234 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:12 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2671947179' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:03:13.234 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:12 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2671947179' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:03:14.249 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:13 smithi143 ceph-mon[35452]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:14.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:13 smithi103 ceph-mon[28156]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:14.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- 172.21.15.143:0/2808426200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 msgr2=0x7fec040fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:14.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/2808426200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec040fff90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec00009880 tx=0x7fec0002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- 172.21.15.143:0/2808426200 shutdown_connections 2024-09-17T01:03:14.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/2808426200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec04100d90 0x7fec04101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/2808426200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec040fff90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- 172.21.15.143:0/2808426200 >> 172.21.15.143:0/2808426200 conn(0x7fec040fb320 msgr2=0x7fec040fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- 172.21.15.143:0/2808426200 shutdown_connections 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- 172.21.15.143:0/2808426200 wait complete. 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 Processor -- start 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- start start 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec04195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec04100d90 0x7fec04195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04196230 con 0x7fec04100d90 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0c6ba640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec041963a0 con 0x7fec040ffb90 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.558+0000 7fec0a456640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec04195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0a456640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec04195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:57386/0 (socket says 172.21.15.143:57386) 2024-09-17T01:03:14.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0a456640 1 -- 172.21.15.143:0/3055301384 learned_addr learned my addr 172.21.15.143:0/3055301384 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec09c55640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec04100d90 0x7fec04195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0a456640 1 -- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec04100d90 msgr2=0x7fec04195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0a456640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec04100d90 0x7fec04195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0a456640 1 -- 172.21.15.143:0/3055301384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00009560 con 0x7fec040ffb90 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0a456640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec04195720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a9c0 tx=0x7fec00005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec00004b20 con 0x7fec040ffb90 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec00004c80 con 0x7fec040ffb90 2024-09-17T01:03:14.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0419ade0 con 0x7fec040ffb90 2024-09-17T01:03:14.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec00003b80 con 0x7fec040ffb90 2024-09-17T01:03:14.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.559+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0419b2f0 con 0x7fec040ffb90 2024-09-17T01:03:14.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.560+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04108800 con 0x7fec040ffb90 2024-09-17T01:03:14.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.561+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fec00003ce0 con 0x7fec040ffb90 2024-09-17T01:03:14.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.561+0000 7febfb7fe640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7febf006cc50 0x7febf006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:14.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.561+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fec000ad350 con 0x7fec040ffb90 2024-09-17T01:03:14.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.562+0000 7fec09c55640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7febf006cc50 0x7febf006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:14.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.562+0000 7fec09c55640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7febf006cc50 0x7febf006f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec04196c40 tx=0x7febf4009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:14.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.565+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec00077a60 con 0x7fec040ffb90 2024-09-17T01:03:14.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.785+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fec041089c0 con 0x7fec040ffb90 2024-09-17T01:03:14.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.791+0000 7febfb7fe640 1 -- 172.21.15.143:0/3055301384 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fec0007b080 con 0x7fec040ffb90 2024-09-17T01:03:14.790 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2024-09-17T01:03:14.790 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBS1ehm6073LhAAMj9lzlItbbMvWSBossh48g== 2024-09-17T01:03:14.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7febf006cc50 msgr2=0x7febf006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7febf006cc50 0x7febf006f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec04196c40 tx=0x7febf4009110 comp rx=0 tx=0).stop 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 msgr2=0x7fec04195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec04195720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a9c0 tx=0x7fec00005610 comp rx=0 tx=0).stop 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 shutdown_connections 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7febf006cc50 0x7febf006f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec04100d90 0x7fec04195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 --2- 172.21.15.143:0/3055301384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec040ffb90 0x7fec04195720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 >> 172.21.15.143:0/3055301384 conn(0x7fec040fb320 msgr2=0x7fec04103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 shutdown_connections 2024-09-17T01:03:14.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:03:14.793+0000 7fec0c6ba640 1 -- 172.21.15.143:0/3055301384 wait complete. 2024-09-17T01:03:15.230 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:14 smithi143 ceph-mon[35452]: from='client.? 172.21.15.143:0/3055301384' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:03:15.230 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:14 smithi143 ceph-mon[35452]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:03:15.230 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:14 smithi143 ceph-mon[35452]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:03:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:14 smithi103 ceph-mon[28156]: from='client.? 172.21.15.143:0/3055301384' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:03:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:14 smithi103 ceph-mon[28156]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:03:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:14 smithi103 ceph-mon[28156]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:03:15.543 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T01:03:15.544 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T01:03:15.544 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T01:03:15.581 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T01:03:15.582 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T01:03:15.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T01:03:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:15 smithi103 ceph-mon[28156]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:15 smithi143 ceph-mon[35452]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 -- 172.21.15.103:0/218688541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 msgr2=0x7f60700fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 --2- 172.21.15.103:0/218688541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f60700fee50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6064009880 tx=0x7f606402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 -- 172.21.15.103:0/218688541 shutdown_connections 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 --2- 172.21.15.103:0/218688541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f60700fee50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 --2- 172.21.15.103:0/218688541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60701049f0 0x7f6070104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 -- 172.21.15.103:0/218688541 >> 172.21.15.103:0/218688541 conn(0x7f60700fa6d0 msgr2=0x7f60700fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 -- 172.21.15.103:0/218688541 shutdown_connections 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.485+0000 7f6078748640 1 -- 172.21.15.103:0/218688541 wait complete. 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6078748640 1 Processor -- start 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6078748640 1 -- start start 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6078748640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f607019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6078748640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60701049f0 0x7f607019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6078748640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607019b2a0 con 0x7f60700fe9f0 2024-09-17T01:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6078748640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070194820 con 0x7f60701049f0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f607019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f607019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40114/0 (socket says 172.21.15.103:40114) 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 -- 172.21.15.103:0/4137371015 learned_addr learned my addr 172.21.15.103:0/4137371015 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f6075ce3640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60701049f0 0x7f607019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 -- 172.21.15.103:0/4137371015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60701049f0 msgr2=0x7f607019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60701049f0 0x7f607019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 -- 172.21.15.103:0/4137371015 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6064009560 con 0x7f60700fe9f0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.486+0000 7f60764e4640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f607019a6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f606000eb10 tx=0x7f606000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.487+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6060004b20 con 0x7f60700fe9f0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.487+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6060004c80 con 0x7f60700fe9f0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.487+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070194b00 con 0x7f60700fe9f0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.487+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6060010640 con 0x7f60700fe9f0 2024-09-17T01:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.487+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6070195020 con 0x7f60700fe9f0 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.488+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6070100130 con 0x7f60700fe9f0 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.488+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f60600055e0 con 0x7f60700fe9f0 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.489+0000 7f606f7fe640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f605806cc50 0x7f605806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.489+0000 7f6075ce3640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f605806cc50 0x7f605806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.489+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6060014070 con 0x7f60700fe9f0 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.489+0000 7f6075ce3640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f605806cc50 0x7f605806f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6064009230 tx=0x7f6064005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.493+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6060056d30 con 0x7f60700fe9f0 2024-09-17T01:03:17.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.701+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f60700fee50 con 0x7f60700fe9f0 2024-09-17T01:03:17.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.704+0000 7f606f7fe640 1 -- 172.21.15.103:0/4137371015 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174018 (secure 0 0 0) 0x7f606005a350 con 0x7f60700fe9f0 2024-09-17T01:03:17.705 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f605806cc50 msgr2=0x7f605806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f605806cc50 0x7f605806f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6064009230 tx=0x7f6064005a20 comp rx=0 tx=0).stop 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 msgr2=0x7f607019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f607019a6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f606000eb10 tx=0x7f606000c2d0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 shutdown_connections 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f605806cc50 0x7f605806f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60701049f0 0x7f607019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 --2- 172.21.15.103:0/4137371015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60700fe9f0 0x7f607019a6d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 >> 172.21.15.103:0/4137371015 conn(0x7f60700fa6d0 msgr2=0x7f60700fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 shutdown_connections 2024-09-17T01:03:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:17.706+0000 7f6078748640 1 -- 172.21.15.103:0/4137371015 wait complete. 2024-09-17T01:03:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:17 smithi143 ceph-mon[35452]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:18.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:17 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/4137371015' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T01:03:18.370 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:17 smithi103 ceph-mon[28156]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:18.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:17 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/4137371015' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T01:03:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"flags":0,"active_gid":14213,"active_name":"smithi103.efjaur","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":187632070},{"type":"v1","addr":"172.21.15.103:6801","nonce":187632070}]},"active_addr":"172.21.15.103:6801/187632070","active_change":"2024-09-17T00:59:38.558116+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi143.sxhocv","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.103:8443/","prometheus":"http://172.21.15.103:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2256901530}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":871067942}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3024200614}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1169861854}]}]} 2024-09-17T01:03:18.419 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T01:03:18.419 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T01:03:18.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:03:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:20.003 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:19 smithi103 ceph-mon[28156]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 -- 172.21.15.103:0/673874207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 msgr2=0x7fc8c0104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/673874207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c0104fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009880 tx=0x7fc8b002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 -- 172.21.15.103:0/673874207 shutdown_connections 2024-09-17T01:03:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/673874207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8c00fdfe0 0x7fc8c00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/673874207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c0104fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 -- 172.21.15.103:0/673874207 >> 172.21.15.103:0/673874207 conn(0x7fc8c00f9ef0 msgr2=0x7fc8c00fc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 -- 172.21.15.103:0/673874207 shutdown_connections 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 -- 172.21.15.103:0/673874207 wait complete. 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.191+0000 7fc8c68dd640 1 Processor -- start 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8c68dd640 1 -- start start 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8c68dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8c00fdfe0 0x7fc8c019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8c68dd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c019bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8c68dd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c019c4f0 con 0x7fc8c0104bc0 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8c68dd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0195a80 con 0x7fc8c00fdfe0 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c019bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c019bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40128/0 (socket says 172.21.15.103:40128) 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bf7fe640 1 -- 172.21.15.103:0/2598311555 learned_addr learned my addr 172.21.15.103:0/2598311555 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bffff640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8c00fdfe0 0x7fc8c019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bf7fe640 1 -- 172.21.15.103:0/2598311555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8c00fdfe0 msgr2=0x7fc8c019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bf7fe640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8c00fdfe0 0x7fc8c019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.192+0000 7fc8bf7fe640 1 -- 172.21.15.103:0/2598311555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009560 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.193+0000 7fc8bf7fe640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c019bed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b420 tx=0x7fc8b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.193+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b4011800 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.193+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8b4011e20 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.193+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b400f2e0 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.193+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c0195d60 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.193+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c0196260 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.194+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c0101300 con 0x7fc8c0104bc0 2024-09-17T01:03:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.194+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc8b4010380 con 0x7fc8c0104bc0 2024-09-17T01:03:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.195+0000 7fc8bd7fa640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc8a806cc50 0x7fc8a806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.195+0000 7fc8bffff640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc8a806cc50 0x7fc8a806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.195+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc8b408b880 con 0x7fc8c0104bc0 2024-09-17T01:03:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.195+0000 7fc8bffff640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc8a806cc50 0x7fc8a806f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.199+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8b4055f90 con 0x7fc8c0104bc0 2024-09-17T01:03:20.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:19 smithi143 ceph-mon[35452]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.364+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8c0108100 con 0x7fc8c0104bc0 2024-09-17T01:03:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.364+0000 7fc8bd7fa640 1 -- 172.21.15.103:0/2598311555 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11400 (secure 0 0 0) 0x7fc8b40595b0 con 0x7fc8c0104bc0 2024-09-17T01:03:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","created":"2024-09-17T00:57:37.320304+0000","modified":"2024-09-17T01:03:02.921049+0000","last_up_change":"2024-09-17T01:03:01.547574+0000","last_in_change":"2024-09-17T01:02:42.099782+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:01:50.857514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17f01f59-16a2-47ef-b7d5-0088763afc90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6803","nonce":1019527091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6805","nonce":1019527091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6809","nonce":1019527091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6807","nonce":1019527091}]},"public_addr":"172.21.15.103:6803/1019527091","cluster_addr":"172.21.15.103:6805/1019527091","heartbeat_back_addr":"172.21.15.103:6809/1019527091","heartbeat_front_addr":"172.21.15.103:6807/1019527091","state":["exists","up"]},{"osd":1,"uuid":"94747077-fac6-4911-8ba7-21c1e21f8508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6811","nonce":1922974319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6813","nonce":1922974319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6817","nonce":1922974319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6815","nonce":1922974319}]},"public_addr":"172.21.15.103:6811/1922974319","cluster_addr":"172.21.15.103:6813/1922974319","heartbeat_back_addr":"172.21.15.103:6817/1922974319","heartbeat_front_addr":"172.21.15.103:6815/1922974319","state":["exists","up"]},{"osd":2,"uuid":"6becb291-d5ea-460f-aef4-10b211a48efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6819","nonce":1054806328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6821","nonce":1054806328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6825","nonce":1054806328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6823","nonce":1054806328}]},"public_addr":"172.21.15.103:6819/1054806328","cluster_addr":"172.21.15.103:6821/1054806328","heartbeat_back_addr":"172.21.15.103:6825/1054806328","heartbeat_front_addr":"172.21.15.103:6823/1054806328","state":["exists","up"]},{"osd":3,"uuid":"79344966-91c8-4c10-85b9-08c1bb6c503b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6801","nonce":3319616449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6803","nonce":3319616449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6807","nonce":3319616449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6805","nonce":3319616449}]},"public_addr":"172.21.15.143:6801/3319616449","cluster_addr":"172.21.15.143:6803/3319616449","heartbeat_back_addr":"172.21.15.143:6807/3319616449","heartbeat_front_addr":"172.21.15.143:6805/3319616449","state":["exists","up"]},{"osd":4,"uuid":"b5c851d1-3a94-4f34-a5a1-4217bd6ebb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6809","nonce":3234539424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6811","nonce":3234539424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6815","nonce":3234539424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6813","nonce":3234539424}]},"public_addr":"172.21.15.143:6809/3234539424","cluster_addr":"172.21.15.143:6811/3234539424","heartbeat_back_addr":"172.21.15.143:6815/3234539424","heartbeat_front_addr":"172.21.15.143:6813/3234539424","state":["exists","up"]},{"osd":5,"uuid":"ced92f57-71a3-4473-ae8d-d87c3674fcd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6817","nonce":1184512887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6819","nonce":1184512887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6823","nonce":1184512887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6821","nonce":1184512887}]},"public_addr":"172.21.15.143:6817/1184512887","cluster_addr":"172.21.15.143:6819/1184512887","heartbeat_back_addr":"172.21.15.143:6823/1184512887","heartbeat_front_addr":"172.21.15.143:6821/1184512887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:00:55.114255+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:01:21.946130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:01:48.117192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:10.073924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:34.326710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:58.959999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/517531851":"2024-09-18T00:59:38.557970+0000","172.21.15.103:0/1081471131":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/1007296496":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/356662493":"2024-09-18T00:58:00.610155+0000","172.21.15.103:6800/2182127784":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/3774926914":"2024-09-18T00:58:35.283351+0000","172.21.15.103:6800/1190379096":"2024-09-18T00:58:35.283351+0000","172.21.15.103:6801/1190379096":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/3632442270":"2024-09-18T00:58:00.610155+0000","172.21.15.103:6801/2182127784":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/4077678822":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/4141211511":"2024-09-18T00:59:38.557970+0000","172.21.15.103:0/1139543399":"2024-09-18T00:59:38.557970+0000","172.21.15.103:6801/3684168093":"2024-09-18T00:59:38.557970+0000","172.21.15.103:6800/3684168093":"2024-09-18T00:59:38.557970+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:03:20.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.367+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc8a806cc50 msgr2=0x7fc8a806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.367+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc8a806cc50 0x7fc8a806f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0005a20 comp rx=0 tx=0).stop 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.367+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 msgr2=0x7fc8c019bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.367+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c019bed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b420 tx=0x7fc8b400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 shutdown_connections 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc8a806cc50 0x7fc8a806f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0104bc0 0x7fc8c019bed0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 --2- 172.21.15.103:0/2598311555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8c00fdfe0 0x7fc8c019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 >> 172.21.15.103:0/2598311555 conn(0x7fc8c00f9ef0 msgr2=0x7fc8c00fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 shutdown_connections 2024-09-17T01:03:20.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:20.368+0000 7fc8c68dd640 1 -- 172.21.15.103:0/2598311555 wait complete. 2024-09-17T01:03:21.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:20 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2598311555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:03:21.165 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T01:03:21.165 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:03:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:20 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2598311555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:03:21.369 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:22.138 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:21 smithi103 ceph-mon[28156]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:22.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:21 smithi143 ceph-mon[35452]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:23.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 -- 172.21.15.103:0/1473131847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4100ce0 msgr2=0x7f37c41010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 --2- 172.21.15.103:0/1473131847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4100ce0 0x7f37c41010c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009880 tx=0x7f37b402a530 comp rx=0 tx=0).stop 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 -- 172.21.15.103:0/1473131847 shutdown_connections 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 --2- 172.21.15.103:0/1473131847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4101600 0x7f37c4109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 --2- 172.21.15.103:0/1473131847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4100ce0 0x7f37c41010c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 -- 172.21.15.103:0/1473131847 >> 172.21.15.103:0/1473131847 conn(0x7f37c40fa720 msgr2=0x7f37c40fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 -- 172.21.15.103:0/1473131847 shutdown_connections 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 -- 172.21.15.103:0/1473131847 wait complete. 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 Processor -- start 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.001+0000 7f37cb97e640 1 -- start start 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37cb97e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4100ce0 0x7f37c419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37cb97e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 0x7f37c419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37cb97e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419c2f0 con 0x7f37c4101600 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37cb97e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4195910 con 0x7f37c4100ce0 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 0x7f37c419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 0x7f37c419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57400/0 (socket says 172.21.15.103:57400) 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 -- 172.21.15.103:0/587278637 learned_addr learned my addr 172.21.15.103:0/587278637 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c971a640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4100ce0 0x7f37c419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 -- 172.21.15.103:0/587278637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4100ce0 msgr2=0x7f37c419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4100ce0 0x7f37c419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 -- 172.21.15.103:0/587278637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009560 con 0x7f37c4101600 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c971a640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4100ce0 0x7f37c419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c8f19640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 0x7f37c419bd60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c8f0 tx=0x7f37b800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b8007b80 con 0x7f37c4101600 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37b8007ce0 con 0x7f37c4101600 2024-09-17T01:03:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c4195bf0 con 0x7f37c4101600 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b8018830 con 0x7f37c4101600 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.002+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c4196140 con 0x7f37c4101600 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.003+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4068ce0 con 0x7f37c4101600 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.004+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f37b8018aa0 con 0x7f37c4101600 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.004+0000 7f37c27fc640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f37ac06cc50 0x7f37ac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.004+0000 7f37c971a640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f37ac06cc50 0x7f37ac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.004+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f37b808c070 con 0x7f37c4101600 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.005+0000 7f37c971a640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f37ac06cc50 0x7f37ac06f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37b4006010 tx=0x7f37b4005e60 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:23.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.008+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37b8056780 con 0x7f37c4101600 2024-09-17T01:03:23.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.172+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37c41010c0 con 0x7f37c4101600 2024-09-17T01:03:23.172 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:22 smithi103 ceph-mon[28156]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:23.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.173+0000 7f37c27fc640 1 -- 172.21.15.103:0/587278637 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11400 (secure 0 0 0) 0x7f37b8059da0 con 0x7f37c4101600 2024-09-17T01:03:23.172 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"fsid":"b107b510-748f-11ef-bceb-c7b262605968","created":"2024-09-17T00:57:37.320304+0000","modified":"2024-09-17T01:03:02.921049+0000","last_up_change":"2024-09-17T01:03:01.547574+0000","last_in_change":"2024-09-17T01:02:42.099782+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:01:50.857514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17f01f59-16a2-47ef-b7d5-0088763afc90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6803","nonce":1019527091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6805","nonce":1019527091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6809","nonce":1019527091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1019527091},{"type":"v1","addr":"172.21.15.103:6807","nonce":1019527091}]},"public_addr":"172.21.15.103:6803/1019527091","cluster_addr":"172.21.15.103:6805/1019527091","heartbeat_back_addr":"172.21.15.103:6809/1019527091","heartbeat_front_addr":"172.21.15.103:6807/1019527091","state":["exists","up"]},{"osd":1,"uuid":"94747077-fac6-4911-8ba7-21c1e21f8508","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6811","nonce":1922974319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6813","nonce":1922974319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6817","nonce":1922974319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1922974319},{"type":"v1","addr":"172.21.15.103:6815","nonce":1922974319}]},"public_addr":"172.21.15.103:6811/1922974319","cluster_addr":"172.21.15.103:6813/1922974319","heartbeat_back_addr":"172.21.15.103:6817/1922974319","heartbeat_front_addr":"172.21.15.103:6815/1922974319","state":["exists","up"]},{"osd":2,"uuid":"6becb291-d5ea-460f-aef4-10b211a48efe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6819","nonce":1054806328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6821","nonce":1054806328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6825","nonce":1054806328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1054806328},{"type":"v1","addr":"172.21.15.103:6823","nonce":1054806328}]},"public_addr":"172.21.15.103:6819/1054806328","cluster_addr":"172.21.15.103:6821/1054806328","heartbeat_back_addr":"172.21.15.103:6825/1054806328","heartbeat_front_addr":"172.21.15.103:6823/1054806328","state":["exists","up"]},{"osd":3,"uuid":"79344966-91c8-4c10-85b9-08c1bb6c503b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6801","nonce":3319616449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6803","nonce":3319616449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6807","nonce":3319616449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":3319616449},{"type":"v1","addr":"172.21.15.143:6805","nonce":3319616449}]},"public_addr":"172.21.15.143:6801/3319616449","cluster_addr":"172.21.15.143:6803/3319616449","heartbeat_back_addr":"172.21.15.143:6807/3319616449","heartbeat_front_addr":"172.21.15.143:6805/3319616449","state":["exists","up"]},{"osd":4,"uuid":"b5c851d1-3a94-4f34-a5a1-4217bd6ebb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6809","nonce":3234539424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6811","nonce":3234539424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6815","nonce":3234539424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3234539424},{"type":"v1","addr":"172.21.15.143:6813","nonce":3234539424}]},"public_addr":"172.21.15.143:6809/3234539424","cluster_addr":"172.21.15.143:6811/3234539424","heartbeat_back_addr":"172.21.15.143:6815/3234539424","heartbeat_front_addr":"172.21.15.143:6813/3234539424","state":["exists","up"]},{"osd":5,"uuid":"ced92f57-71a3-4473-ae8d-d87c3674fcd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6817","nonce":1184512887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6819","nonce":1184512887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6823","nonce":1184512887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1184512887},{"type":"v1","addr":"172.21.15.143:6821","nonce":1184512887}]},"public_addr":"172.21.15.143:6817/1184512887","cluster_addr":"172.21.15.143:6819/1184512887","heartbeat_back_addr":"172.21.15.143:6823/1184512887","heartbeat_front_addr":"172.21.15.143:6821/1184512887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:00:55.114255+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:01:21.946130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:01:48.117192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:10.073924+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:34.326710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:02:58.959999+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/517531851":"2024-09-18T00:59:38.557970+0000","172.21.15.103:0/1081471131":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/1007296496":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/356662493":"2024-09-18T00:58:00.610155+0000","172.21.15.103:6800/2182127784":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/3774926914":"2024-09-18T00:58:35.283351+0000","172.21.15.103:6800/1190379096":"2024-09-18T00:58:35.283351+0000","172.21.15.103:6801/1190379096":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/3632442270":"2024-09-18T00:58:00.610155+0000","172.21.15.103:6801/2182127784":"2024-09-18T00:58:00.610155+0000","172.21.15.103:0/4077678822":"2024-09-18T00:58:35.283351+0000","172.21.15.103:0/4141211511":"2024-09-18T00:59:38.557970+0000","172.21.15.103:0/1139543399":"2024-09-18T00:59:38.557970+0000","172.21.15.103:6801/3684168093":"2024-09-18T00:59:38.557970+0000","172.21.15.103:6800/3684168093":"2024-09-18T00:59:38.557970+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:03:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f37ac06cc50 msgr2=0x7f37ac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f37ac06cc50 0x7f37ac06f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37b4006010 tx=0x7f37b4005e60 comp rx=0 tx=0).stop 2024-09-17T01:03:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 msgr2=0x7f37c419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 0x7f37c419bd60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c8f0 tx=0x7f37b800cdb0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 shutdown_connections 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f37ac06cc50 0x7f37ac06f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c4101600 0x7f37c419bd60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 --2- 172.21.15.103:0/587278637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37c4100ce0 0x7f37c419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 >> 172.21.15.103:0/587278637 conn(0x7f37c40fa720 msgr2=0x7f37c4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 shutdown_connections 2024-09-17T01:03:23.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:23.175+0000 7f37cb97e640 1 -- 172.21.15.103:0/587278637 wait complete. 2024-09-17T01:03:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:22 smithi143 ceph-mon[35452]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:23.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T01:03:23.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T01:03:23.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T01:03:23.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T01:03:23.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T01:03:23.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T01:03:24.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:23 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/587278637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:03:24.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:24.172 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:24.174 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:24.241 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:24.241 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:24.241 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:24.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:23 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/587278637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:03:24.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:24.674 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:25.144 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:24 smithi103 ceph-mon[28156]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:25.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:24 smithi143 ceph-mon[35452]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:27.818 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:27 smithi103 ceph-mon[28156]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:28.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:27 smithi143 ceph-mon[35452]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:29.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:29 smithi103 ceph-mon[28156]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:30.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:29 smithi143 ceph-mon[35452]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:30.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 -- 172.21.15.103:0/493610789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 msgr2=0x7fc5dc105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 --2- 172.21.15.103:0/493610789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc105fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009880 tx=0x7fc5cc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 -- 172.21.15.103:0/493610789 shutdown_connections 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 --2- 172.21.15.103:0/493610789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5dc0ffb30 0x7fc5dc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 --2- 172.21.15.103:0/493610789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc105fc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 -- 172.21.15.103:0/493610789 >> 172.21.15.103:0/493610789 conn(0x7fc5dc0fb850 msgr2=0x7fc5dc0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 -- 172.21.15.103:0/493610789 shutdown_connections 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.095+0000 7fc5e402c640 1 -- 172.21.15.103:0/493610789 wait complete. 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e402c640 1 Processor -- start 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e402c640 1 -- start start 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e402c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5dc0ffb30 0x7fc5dc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e402c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e402c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc073230 con 0x7fc5dc105be0 2024-09-17T01:03:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e402c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0733a0 con 0x7fc5dc0ffb30 2024-09-17T01:03:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57416/0 (socket says 172.21.15.103:57416) 2024-09-17T01:03:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 -- 172.21.15.103:0/3137133598 learned_addr learned my addr 172.21.15.103:0/3137133598 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 -- 172.21.15.103:0/3137133598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5dc0ffb30 msgr2=0x7fc5dc0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5dc0ffb30 0x7fc5dc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 -- 172.21.15.103:0/3137133598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009560 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5e15c7640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc072cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800d6f0 tx=0x7fc5d800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.096+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d8009a30 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.097+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d80054e0 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.097+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc1a1c60 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.097+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d8010460 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.097+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc1a2040 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.098+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5dc10d0a0 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.098+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc5d8004ec0 con 0x7fc5dc105be0 2024-09-17T01:03:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.098+0000 7fc5d2ffd640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc5c806cc50 0x7fc5c806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.098+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc5d808bad0 con 0x7fc5dc105be0 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.098+0000 7fc5e1dc8640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc5c806cc50 0x7fc5c806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.099+0000 7fc5d2ffd640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] conn(0x7fc5c80729e0 0x7fc5c8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.099+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 --> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5c80754b0 con 0x7fc5c80729e0 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.099+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5d80902a0 con 0x7fc5dc105be0 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.099+0000 7fc5e25c9640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] conn(0x7fc5c80729e0 0x7fc5c8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:30.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.099+0000 7fc5e1dc8640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc5c806cc50 0x7fc5c806f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009880 tx=0x7fc5cc000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.099+0000 7fc5e25c9640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] conn(0x7fc5c80729e0 0x7fc5c8074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.100+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== osd.0 v2:172.21.15.103:6802/1019527091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc5c80754b0 con 0x7fc5c80729e0 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 --> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5dc060bb0 con 0x7fc5c80729e0 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5d2ffd640 1 -- 172.21.15.103:0/3137133598 <== osd.0 v2:172.21.15.103:6802/1019527091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5dc060bb0 con 0x7fc5c80729e0 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] conn(0x7fc5c80729e0 msgr2=0x7fc5c8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] conn(0x7fc5c80729e0 0x7fc5c8074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc5c806cc50 msgr2=0x7fc5c806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc5c806cc50 0x7fc5c806f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009880 tx=0x7fc5cc000bc0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 msgr2=0x7fc5dc072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:30.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc072cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800d6f0 tx=0x7fc5d800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 shutdown_connections 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6802/1019527091,v1:172.21.15.103:6803/1019527091] conn(0x7fc5c80729e0 0x7fc5c8074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc5c806cc50 0x7fc5c806f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5dc105be0 0x7fc5dc072cf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 --2- 172.21.15.103:0/3137133598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5dc0ffb30 0x7fc5dc0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 >> 172.21.15.103:0/3137133598 conn(0x7fc5dc0fb850 msgr2=0x7fc5dc0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 shutdown_connections 2024-09-17T01:03:30.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:30.113+0000 7fc5e402c640 1 -- 172.21.15.103:0/3137133598 wait complete. 2024-09-17T01:03:31.039 INFO:teuthology.orchestra.run.smithi103.stdout:38654705698 2024-09-17T01:03:31.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.195+0000 7f7757647640 1 -- 172.21.15.103:0/1123143502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77501049a0 msgr2=0x7f7750104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.195+0000 7f7757647640 1 --2- 172.21.15.103:0/1123143502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77501049a0 0x7f7750104d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f774c009880 tx=0x7f774c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.195+0000 7f7757647640 1 -- 172.21.15.103:0/1123143502 shutdown_connections 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.196+0000 7f7757647640 1 --2- 172.21.15.103:0/1123143502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77500fe9a0 0x7f77500fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.196+0000 7f7757647640 1 --2- 172.21.15.103:0/1123143502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77501049a0 0x7f7750104d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.196+0000 7f7757647640 1 -- 172.21.15.103:0/1123143502 >> 172.21.15.103:0/1123143502 conn(0x7f77500758c0 msgr2=0x7f77500fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.196+0000 7f7757647640 1 -- 172.21.15.103:0/1123143502 shutdown_connections 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.196+0000 7f7757647640 1 -- 172.21.15.103:0/1123143502 wait complete. 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.196+0000 7f7757647640 1 Processor -- start 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7757647640 1 -- start start 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7757647640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 0x7f775006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7757647640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77501049a0 0x7f775006d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7757647640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750072490 con 0x7f77500fe9a0 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7757647640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775006de80 con 0x7f77501049a0 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f77553e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 0x7f775006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f77553e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 0x7f775006d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57440/0 (socket says 172.21.15.103:57440) 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f77553e3640 1 -- 172.21.15.103:0/4117863350 learned_addr learned my addr 172.21.15.103:0/4117863350 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7754be2640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77501049a0 0x7f775006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f77553e3640 1 -- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77501049a0 msgr2=0x7f775006d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f77553e3640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77501049a0 0x7f775006d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f77553e3640 1 -- 172.21.15.103:0/4117863350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c009560 con 0x7f77500fe9a0 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.197+0000 7f7754be2640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77501049a0 0x7f775006d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.198+0000 7f77553e3640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 0x7f775006d400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f774c02a9c0 tx=0x7f774c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.198+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774c004aa0 con 0x7f77500fe9a0 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.198+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775006e100 con 0x7f77500fe9a0 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.198+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f774c004c00 con 0x7f77500fe9a0 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.198+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774c003980 con 0x7f77500fe9a0 2024-09-17T01:03:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.198+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77501a85b0 con 0x7f77500fe9a0 2024-09-17T01:03:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.199+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f775010d030 con 0x7f77500fe9a0 2024-09-17T01:03:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.199+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f774c003bf0 con 0x7f77500fe9a0 2024-09-17T01:03:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f77467fc640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f773c06cc50 0x7f773c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f774c0acfe0 con 0x7f77500fe9a0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f7754be2640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f773c06cc50 0x7f773c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f77467fc640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] conn(0x7f773c0729e0 0x7f773c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 --> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f773c0754b0 con 0x7f773c0729e0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f774c0af660 con 0x7f77500fe9a0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f7754be2640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f773c06cc50 0x7f773c06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f775006eb80 tx=0x7f7740005e50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.200+0000 7f7755be4640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] conn(0x7f773c0729e0 0x7f773c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.201+0000 7f7755be4640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] conn(0x7f773c0729e0 0x7f773c074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.202+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== osd.3 v2:172.21.15.143:6800/3319616449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f773c0754b0 con 0x7f773c0729e0 2024-09-17T01:03:31.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.215+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 --> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77501000e0 con 0x7f773c0729e0 2024-09-17T01:03:31.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.215+0000 7f77467fc640 1 -- 172.21.15.103:0/4117863350 <== osd.3 v2:172.21.15.143:6800/3319616449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f77501000e0 con 0x7f773c0729e0 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] conn(0x7f773c0729e0 msgr2=0x7f773c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] conn(0x7f773c0729e0 0x7f773c074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f773c06cc50 msgr2=0x7f773c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f773c06cc50 0x7f773c06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f775006eb80 tx=0x7f7740005e50 comp rx=0 tx=0).stop 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 msgr2=0x7f775006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 0x7f775006d400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f774c02a9c0 tx=0x7f774c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 shutdown_connections 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:6800/3319616449,v1:172.21.15.143:6801/3319616449] conn(0x7f773c0729e0 0x7f773c074e00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f773c06cc50 0x7f773c06f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77501049a0 0x7f775006d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 --2- 172.21.15.103:0/4117863350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77500fe9a0 0x7f775006d400 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:31.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 >> 172.21.15.103:0/4117863350 conn(0x7f77500758c0 msgr2=0x7f77500fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:31.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 shutdown_connections 2024-09-17T01:03:31.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.216+0000 7f7757647640 1 -- 172.21.15.103:0/4117863350 wait complete. 2024-09-17T01:03:31.710 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:31 smithi103 ceph-mon[28156]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:32.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:31 smithi143 ceph-mon[35452]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.526+0000 7fca9fc8b640 1 -- 172.21.15.103:0/752338158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 msgr2=0x7fca980fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.526+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/752338158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca980fff50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca94009880 tx=0x7fca9402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.526+0000 7fca9fc8b640 1 -- 172.21.15.103:0/752338158 shutdown_connections 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.526+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/752338158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca980fff50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.526+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/752338158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca98105b80 0x7fca98105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.526+0000 7fca9fc8b640 1 -- 172.21.15.103:0/752338158 >> 172.21.15.103:0/752338158 conn(0x7fca980fb810 msgr2=0x7fca980fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.527+0000 7fca9fc8b640 1 -- 172.21.15.103:0/752338158 shutdown_connections 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.527+0000 7fca9fc8b640 1 -- 172.21.15.103:0/752338158 wait complete. 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.527+0000 7fca9fc8b640 1 Processor -- start 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.527+0000 7fca9fc8b640 1 -- start start 2024-09-17T01:03:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9fc8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca9819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9fc8b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca98105b80 0x7fca9819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9fc8b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9819c3d0 con 0x7fca980ffaf0 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9fc8b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98195960 con 0x7fca98105b80 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca9819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca9819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57464/0 (socket says 172.21.15.103:57464) 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 -- 172.21.15.103:0/3993415089 learned_addr learned my addr 172.21.15.103:0/3993415089 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9d226640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca98105b80 0x7fca9819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 -- 172.21.15.103:0/3993415089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca98105b80 msgr2=0x7fca9819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca98105b80 0x7fca9819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 -- 172.21.15.103:0/3993415089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009560 con 0x7fca980ffaf0 2024-09-17T01:03:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9da27640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca9819b870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d6f0 tx=0x7fca8800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca88009a30 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca98195c40 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca880054e0 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca88010460 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.528+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98196190 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.529+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca9810d080 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.530+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fca88009b90 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.530+0000 7fca8effd640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fca8406cc50 0x7fca8406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.530+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fca8808beb0 con 0x7fca980ffaf0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.530+0000 7fca9d226640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fca8406cc50 0x7fca8406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.531+0000 7fca8effd640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] conn(0x7fca840729e0 0x7fca84074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.531+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 --> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca840754b0 con 0x7fca840729e0 2024-09-17T01:03:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.531+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca8808c310 con 0x7fca980ffaf0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.531+0000 7fca9e228640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] conn(0x7fca840729e0 0x7fca84074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.531+0000 7fca9d226640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fca8406cc50 0x7fca8406f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca94000c00 tx=0x7fca94004040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.531+0000 7fca9e228640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] conn(0x7fca840729e0 0x7fca84074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.532+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== osd.2 v2:172.21.15.103:6818/1054806328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fca840754b0 con 0x7fca840729e0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.544+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 --> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca981965f0 con 0x7fca840729e0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.544+0000 7fca8effd640 1 -- 172.21.15.103:0/3993415089 <== osd.2 v2:172.21.15.103:6818/1054806328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca981965f0 con 0x7fca840729e0 2024-09-17T01:03:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] conn(0x7fca840729e0 msgr2=0x7fca84074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] conn(0x7fca840729e0 0x7fca84074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fca8406cc50 msgr2=0x7fca8406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fca8406cc50 0x7fca8406f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca94000c00 tx=0x7fca94004040 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 msgr2=0x7fca9819b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca9819b870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d6f0 tx=0x7fca8800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 shutdown_connections 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6818/1054806328,v1:172.21.15.103:6819/1054806328] conn(0x7fca840729e0 0x7fca84074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fca8406cc50 0x7fca8406f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca98105b80 0x7fca9819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 --2- 172.21.15.103:0/3993415089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca980ffaf0 0x7fca9819b870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 >> 172.21.15.103:0/3993415089 conn(0x7fca980fb810 msgr2=0x7fca980fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 shutdown_connections 2024-09-17T01:03:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:31.545+0000 7fca9fc8b640 1 -- 172.21.15.103:0/3993415089 wait complete. 2024-09-17T01:03:32.977 INFO:teuthology.orchestra.run.smithi103.stdout:111669149714 2024-09-17T01:03:32.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T01:03:33.913 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:33 smithi103 ceph-mon[28156]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:34.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:33 smithi143 ceph-mon[35452]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 -- 172.21.15.103:0/2936012880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 msgr2=0x7f8984104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 --2- 172.21.15.103:0/2936012880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f8984104d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8974009880 tx=0x7f897402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 -- 172.21.15.103:0/2936012880 shutdown_connections 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 --2- 172.21.15.103:0/2936012880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89840fe9a0 0x7f89840fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 --2- 172.21.15.103:0/2936012880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f8984104d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 -- 172.21.15.103:0/2936012880 >> 172.21.15.103:0/2936012880 conn(0x7f89840758c0 msgr2=0x7f89840fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 -- 172.21.15.103:0/2936012880 shutdown_connections 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 -- 172.21.15.103:0/2936012880 wait complete. 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 Processor -- start 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 -- start start 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.281+0000 7f898ada3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89840fe9a0 0x7f898419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f898ada3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f898419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f898ada3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898419e450 con 0x7f89841049a0 2024-09-17T01:03:34.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f898ada3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898419e5c0 con 0x7f89840fe9a0 2024-09-17T01:03:34.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f898419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f898419de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52762/0 (socket says 172.21.15.103:52762) 2024-09-17T01:03:34.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 -- 172.21.15.103:0/4019939440 learned_addr learned my addr 172.21.15.103:0/4019939440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:34.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8988b3f640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89840fe9a0 0x7f898419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 -- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89840fe9a0 msgr2=0x7f898419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89840fe9a0 0x7f898419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 -- 172.21.15.103:0/4019939440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974009560 con 0x7f89841049a0 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8983fff640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f898419de50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f897800c8a0 tx=0x7f897800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8978007b80 con 0x7f89841049a0 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8978007ce0 con 0x7f89841049a0 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8978018810 con 0x7f89841049a0 2024-09-17T01:03:34.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8984197c70 con 0x7f89841049a0 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.282+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89841981c0 con 0x7f89841049a0 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.283+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f898410bf10 con 0x7f89841049a0 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8978018970 con 0x7f89841049a0 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8981ffb640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f896c06cc50 0x7f896c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8988b3f640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f896c06cc50 0x7f896c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f897808c030 con 0x7f89841049a0 2024-09-17T01:03:34.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8981ffb640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] conn(0x7f896c0729e0 0x7f896c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 --> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f896c0754b0 con 0x7f896c0729e0 2024-09-17T01:03:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.284+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f897808e700 con 0x7f89841049a0 2024-09-17T01:03:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.285+0000 7f8988b3f640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f896c06cc50 0x7f896c06f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8974000c00 tx=0x7f8974005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.285+0000 7f8989340640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] conn(0x7f896c0729e0 0x7f896c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.285+0000 7f8989340640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] conn(0x7f896c0729e0 0x7f896c074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.286+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== osd.4 v2:172.21.15.143:6808/3234539424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f896c0754b0 con 0x7f896c0729e0 2024-09-17T01:03:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.299+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 --> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8984198790 con 0x7f896c0729e0 2024-09-17T01:03:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.299+0000 7f8981ffb640 1 -- 172.21.15.103:0/4019939440 <== osd.4 v2:172.21.15.143:6808/3234539424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8984198790 con 0x7f896c0729e0 2024-09-17T01:03:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.299+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] conn(0x7f896c0729e0 msgr2=0x7f896c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.299+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] conn(0x7f896c0729e0 0x7f896c074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.299+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f896c06cc50 msgr2=0x7f896c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.299+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f896c06cc50 0x7f896c06f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8974000c00 tx=0x7f8974005a20 comp rx=0 tx=0).stop 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 msgr2=0x7f898419de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f898419de50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f897800c8a0 tx=0x7f897800cd60 comp rx=0 tx=0).stop 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 shutdown_connections 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f896c06cc50 0x7f896c06f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89841049a0 0x7f898419de50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:6808/3234539424,v1:172.21.15.143:6809/3234539424] conn(0x7f896c0729e0 0x7f896c074e00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 --2- 172.21.15.103:0/4019939440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89840fe9a0 0x7f898419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 >> 172.21.15.103:0/4019939440 conn(0x7f89840758c0 msgr2=0x7f8984067fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 shutdown_connections 2024-09-17T01:03:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.300+0000 7f898ada3640 1 -- 172.21.15.103:0/4019939440 wait complete. 2024-09-17T01:03:34.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 -- 172.21.15.103:0/4078576590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa338100cd0 msgr2=0x7fa3381010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 --2- 172.21.15.103:0/4078576590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa338100cd0 0x7fa3381010b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa328009c20 tx=0x7fa32802aa00 comp rx=0 tx=0).stop 2024-09-17T01:03:34.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 -- 172.21.15.103:0/4078576590 shutdown_connections 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 --2- 172.21.15.103:0/4078576590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3381015f0 0x7fa338109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 --2- 172.21.15.103:0/4078576590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa338100cd0 0x7fa3381010b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 -- 172.21.15.103:0/4078576590 >> 172.21.15.103:0/4078576590 conn(0x7fa3380fa730 msgr2=0x7fa3380fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 -- 172.21.15.103:0/4078576590 shutdown_connections 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.707+0000 7fa33dd76640 1 -- 172.21.15.103:0/4078576590 wait complete. 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa33dd76640 1 Processor -- start 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa33dd76640 1 -- start start 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa33dd76640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa338100cd0 0x7fa3380fe930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa33dd76640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 0x7fa3380fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa33dd76640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380ff3b0 con 0x7fa3381015f0 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa33dd76640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380ff520 con 0x7fa338100cd0 2024-09-17T01:03:34.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa336ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 0x7fa3380fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa336ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 0x7fa3380fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52774/0 (socket says 172.21.15.103:52774) 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa336ffd640 1 -- 172.21.15.103:0/3973785355 learned_addr learned my addr 172.21.15.103:0/3973785355 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.708+0000 7fa3377fe640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa338100cd0 0x7fa3380fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa336ffd640 1 -- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa338100cd0 msgr2=0x7fa3380fe930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa336ffd640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa338100cd0 0x7fa3380fe930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa336ffd640 1 -- 172.21.15.103:0/3973785355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009900 con 0x7fa3381015f0 2024-09-17T01:03:34.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa3377fe640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa338100cd0 0x7fa3380fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa336ffd640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 0x7fa3380fee70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00d8d0 tx=0x7fa32c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa32c009a30 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3381a1ca0 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa32c009b90 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa32c0049d0 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.709+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3381a2000 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.710+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa33810d060 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.710+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa32c009d00 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa334ff9640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa32006cc50 0x7fa32006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa32c08ba90 con 0x7fa3381015f0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa3377fe640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa32006cc50 0x7fa32006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa334ff9640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] conn(0x7fa3200729e0 0x7fa320074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 --> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3200754b0 con 0x7fa3200729e0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa32c0902a0 con 0x7fa3381015f0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa3377fe640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa32006cc50 0x7fa32006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa328000f80 tx=0x7fa32803b040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.711+0000 7fa337fff640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] conn(0x7fa3200729e0 0x7fa320074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.712+0000 7fa337fff640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] conn(0x7fa3200729e0 0x7fa320074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.713+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== osd.5 v2:172.21.15.143:6816/1184512887 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3200754b0 con 0x7fa3200729e0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.725+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 --> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa338060b30 con 0x7fa3200729e0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa334ff9640 1 -- 172.21.15.103:0/3973785355 <== osd.5 v2:172.21.15.143:6816/1184512887 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa338060b30 con 0x7fa3200729e0 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] conn(0x7fa3200729e0 msgr2=0x7fa320074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] conn(0x7fa3200729e0 0x7fa320074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa32006cc50 msgr2=0x7fa32006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa32006cc50 0x7fa32006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa328000f80 tx=0x7fa32803b040 comp rx=0 tx=0).stop 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 msgr2=0x7fa3380fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 0x7fa3380fee70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00d8d0 tx=0x7fa32c00dd90 comp rx=0 tx=0).stop 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 shutdown_connections 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:6816/1184512887,v1:172.21.15.143:6817/1184512887] conn(0x7fa3200729e0 0x7fa320074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa32006cc50 0x7fa32006f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3381015f0 0x7fa3380fee70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 --2- 172.21.15.103:0/3973785355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa338100cd0 0x7fa3380fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 >> 172.21.15.103:0/3973785355 conn(0x7fa3380fa730 msgr2=0x7fa338101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.726+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 shutdown_connections 2024-09-17T01:03:34.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:34.727+0000 7fa33dd76640 1 -- 172.21.15.103:0/3973785355 wait complete. 2024-09-17T01:03:35.334 INFO:teuthology.orchestra.run.smithi103.stdout:167503724553 2024-09-17T01:03:35.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T01:03:35.777 INFO:teuthology.orchestra.run.smithi103.stdout:81604378648 2024-09-17T01:03:35.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T01:03:35.926 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:35 smithi103 ceph-mon[28156]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:35.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 -- 172.21.15.103:0/1143941948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 msgr2=0x7fa974109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 --2- 172.21.15.103:0/1143941948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa974109b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa968009880 tx=0x7fa96802a530 comp rx=0 tx=0).stop 2024-09-17T01:03:35.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 -- 172.21.15.103:0/1143941948 shutdown_connections 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 --2- 172.21.15.103:0/1143941948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa974109b90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 --2- 172.21.15.103:0/1143941948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa974100d80 0x7fa974101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 -- 172.21.15.103:0/1143941948 >> 172.21.15.103:0/1143941948 conn(0x7fa9740fa720 msgr2=0x7fa9740fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 -- 172.21.15.103:0/1143941948 shutdown_connections 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.958+0000 7fa978bcf640 1 -- 172.21.15.103:0/1143941948 wait complete. 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa978bcf640 1 Processor -- start 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa978bcf640 1 -- start start 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa978bcf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa974100d80 0x7fa97419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa978bcf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa97419be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa978bcf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97419c460 con 0x7fa9741016a0 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa978bcf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9741959f0 con 0x7fa974100d80 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa97419be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa97419be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52790/0 (socket says 172.21.15.103:52790) 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 -- 172.21.15.103:0/4132054856 learned_addr learned my addr 172.21.15.103:0/4132054856 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa97259c640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa974100d80 0x7fa97419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 -- 172.21.15.103:0/4132054856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa974100d80 msgr2=0x7fa97419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa974100d80 0x7fa97419b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 -- 172.21.15.103:0/4132054856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968009560 con 0x7fa9741016a0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.959+0000 7fa971d9b640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa97419be40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa968005940 tx=0x7fa968032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.960+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa968005220 con 0x7fa9741016a0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.960+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa968005380 con 0x7fa9741016a0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.960+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa968003a50 con 0x7fa9741016a0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.960+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa974195c70 con 0x7fa9741016a0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.960+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa974196160 con 0x7fa9741016a0 2024-09-17T01:03:35.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.961+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa97410d130 con 0x7fa9741016a0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.961+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa96802ad50 con 0x7fa9741016a0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.961+0000 7fa9637fe640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa95c06cc50 0x7fa95c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa9680ac9c0 con 0x7fa9741016a0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa97259c640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa95c06cc50 0x7fa95c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa9637fe640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] conn(0x7fa95c0729e0 0x7fa95c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 --> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa95c0754b0 con 0x7fa95c0729e0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9680b12a0 con 0x7fa9741016a0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa972d9d640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] conn(0x7fa95c0729e0 0x7fa95c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa97259c640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa95c06cc50 0x7fa95c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa964009890 tx=0x7fa964008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.962+0000 7fa972d9d640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] conn(0x7fa95c0729e0 0x7fa95c074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:35.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.963+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== osd.1 v2:172.21.15.103:6810/1922974319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa95c0754b0 con 0x7fa95c0729e0 2024-09-17T01:03:35.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 --> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa974068c40 con 0x7fa95c0729e0 2024-09-17T01:03:35.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa9637fe640 1 -- 172.21.15.103:0/4132054856 <== osd.1 v2:172.21.15.103:6810/1922974319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa974068c40 con 0x7fa95c0729e0 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] conn(0x7fa95c0729e0 msgr2=0x7fa95c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] conn(0x7fa95c0729e0 0x7fa95c074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa95c06cc50 msgr2=0x7fa95c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa95c06cc50 0x7fa95c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa964009890 tx=0x7fa964008040 comp rx=0 tx=0).stop 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 msgr2=0x7fa97419be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa97419be40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa968005940 tx=0x7fa968032bd0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 shutdown_connections 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa95c06cc50 0x7fa95c06f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:6810/1922974319,v1:172.21.15.103:6811/1922974319] conn(0x7fa95c0729e0 0x7fa95c074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9741016a0 0x7fa97419be40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 --2- 172.21.15.103:0/4132054856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa974100d80 0x7fa97419b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 >> 172.21.15.103:0/4132054856 conn(0x7fa9740fa720 msgr2=0x7fa974101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 shutdown_connections 2024-09-17T01:03:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:35.976+0000 7fa978bcf640 1 -- 172.21.15.103:0/4132054856 wait complete. 2024-09-17T01:03:36.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:35 smithi143 ceph-mon[35452]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:36.737 INFO:teuthology.orchestra.run.smithi103.stdout:60129542174 2024-09-17T01:03:36.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T01:03:37.284 INFO:teuthology.orchestra.run.smithi103.stdout:146028888078 2024-09-17T01:03:37.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T01:03:37.365 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:37.417 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:37.417 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:37.428 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:37.865 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:37.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:37 smithi103 ceph-mon[28156]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:37 smithi143 ceph-mon[35452]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:38.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:39.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:39.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:39 smithi103 ceph-mon[28156]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:39 smithi143 ceph-mon[35452]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 -- 172.21.15.103:0/1325848664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 msgr2=0x7f40640fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 --2- 172.21.15.103:0/1325848664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f40640fee00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f404c009880 tx=0x7f404c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 -- 172.21.15.103:0/1325848664 shutdown_connections 2024-09-17T01:03:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 --2- 172.21.15.103:0/1325848664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f40640fee00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 --2- 172.21.15.103:0/1325848664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641049a0 0x7f4064104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 -- 172.21.15.103:0/1325848664 >> 172.21.15.103:0/1325848664 conn(0x7f40640758c0 msgr2=0x7f40640fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 -- 172.21.15.103:0/1325848664 shutdown_connections 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.618+0000 7f4069065640 1 -- 172.21.15.103:0/1325848664 wait complete. 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4069065640 1 Processor -- start 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4069065640 1 -- start start 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4069065640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f406419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4069065640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641049a0 0x7f406419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4069065640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406419c440 con 0x7f40640fe9a0 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4069065640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641959d0 con 0x7f40641049a0 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4062d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f406419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4062d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f406419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52808/0 (socket says 172.21.15.103:52808) 2024-09-17T01:03:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4062d9d640 1 -- 172.21.15.103:0/1308879525 learned_addr learned my addr 172.21.15.103:0/1308879525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f406259c640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641049a0 0x7f406419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4062d9d640 1 -- 172.21.15.103:0/1308879525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641049a0 msgr2=0x7f406419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4062d9d640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641049a0 0x7f406419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.619+0000 7f4062d9d640 1 -- 172.21.15.103:0/1308879525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c009560 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.620+0000 7f4062d9d640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f406419b8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f405400c8f0 tx=0x7f405400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.620+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4054007b80 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.620+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40540054e0 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.620+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4064195cb0 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.620+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405400f450 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.620+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40641961d0 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.621+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40641000e0 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.621+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4054004f60 con 0x7f40640fe9a0 2024-09-17T01:03:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.622+0000 7f405bfff640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f405006cc50 0x7f405006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.622+0000 7f406259c640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f405006cc50 0x7f405006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.622+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f405408bcc0 con 0x7f40640fe9a0 2024-09-17T01:03:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.622+0000 7f406259c640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f405006cc50 0x7f405006f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f404c009230 tx=0x7f404c0058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.626+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4054056480 con 0x7f40640fe9a0 2024-09-17T01:03:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.792+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f40640fee00 con 0x7f40640fe9a0 2024-09-17T01:03:41.790 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:41 smithi103 ceph-mon[28156]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.792+0000 7f405bfff640 1 -- 172.21.15.103:0/1308879525 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f405401d020 con 0x7f40640fe9a0 2024-09-17T01:03:41.791 INFO:teuthology.orchestra.run.smithi103.stdout:60129542175 2024-09-17T01:03:41.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f405006cc50 msgr2=0x7f405006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:41.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f405006cc50 0x7f405006f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f404c009230 tx=0x7f404c0058d0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 msgr2=0x7f406419b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:41.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f406419b8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f405400c8f0 tx=0x7f405400cdb0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 shutdown_connections 2024-09-17T01:03:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f405006cc50 0x7f405006f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40641049a0 0x7f406419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 --2- 172.21.15.103:0/1308879525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40640fe9a0 0x7f406419b8e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 >> 172.21.15.103:0/1308879525 conn(0x7f40640758c0 msgr2=0x7f40640fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 shutdown_connections 2024-09-17T01:03:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:41.794+0000 7f4069065640 1 -- 172.21.15.103:0/1308879525 wait complete. 2024-09-17T01:03:42.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:41 smithi143 ceph-mon[35452]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:42.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:42 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1308879525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T01:03:43.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:42 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1308879525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T01:03:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 -- 172.21.15.103:0/2645288873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 msgr2=0x7f6028105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 --2- 172.21.15.103:0/2645288873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f6028105fd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6018009880 tx=0x7f601802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 -- 172.21.15.103:0/2645288873 shutdown_connections 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 --2- 172.21.15.103:0/2645288873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60280ffb40 0x7f60280fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 --2- 172.21.15.103:0/2645288873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f6028105fd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 -- 172.21.15.103:0/2645288873 >> 172.21.15.103:0/2645288873 conn(0x7f60280fb840 msgr2=0x7f60280fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 -- 172.21.15.103:0/2645288873 shutdown_connections 2024-09-17T01:03:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.559+0000 7f602c80b640 1 -- 172.21.15.103:0/2645288873 wait complete. 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.560+0000 7f602c80b640 1 Processor -- start 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.560+0000 7f602c80b640 1 -- start start 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.560+0000 7f602c80b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60280ffb40 0x7f602819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.560+0000 7f602c80b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f602819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.560+0000 7f602c80b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602819c400 con 0x7f6028105bf0 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.560+0000 7f602c80b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028195990 con 0x7f60280ffb40 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f602819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f602659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60280ffb40 0x7f602819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f602819bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40820/0 (socket says 172.21.15.103:40820) 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 -- 172.21.15.103:0/3968595964 learned_addr learned my addr 172.21.15.103:0/3968595964 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 -- 172.21.15.103:0/3968595964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60280ffb40 msgr2=0x7f602819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60280ffb40 0x7f602819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 -- 172.21.15.103:0/3968595964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009560 con 0x7f6028105bf0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601dd9b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f602819bde0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f601000b420 tx=0x7f601000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6010011800 con 0x7f6028105bf0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6010011e20 con 0x7f6028105bf0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6028195c70 con 0x7f6028105bf0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601000f2e0 con 0x7f6028105bf0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.561+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028196240 con 0x7f6028105bf0 2024-09-17T01:03:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.562+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60281011f0 con 0x7f6028105bf0 2024-09-17T01:03:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.563+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6010010380 con 0x7f6028105bf0 2024-09-17T01:03:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.563+0000 7f601ffff640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f601406cc50 0x7f601406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.563+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f601008b7f0 con 0x7f6028105bf0 2024-09-17T01:03:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.563+0000 7f602659c640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f601406cc50 0x7f601406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.564+0000 7f602659c640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f601406cc50 0x7f601406f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6018009230 tx=0x7f60180058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:43.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.568+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6010055f00 con 0x7f6028105bf0 2024-09-17T01:03:43.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.740+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6028100020 con 0x7f6028105bf0 2024-09-17T01:03:43.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.741+0000 7f601ffff640 1 -- 172.21.15.103:0/3968595964 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6010059520 con 0x7f6028105bf0 2024-09-17T01:03:43.739 INFO:teuthology.orchestra.run.smithi103.stdout:111669149717 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f601406cc50 msgr2=0x7f601406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f601406cc50 0x7f601406f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6018009230 tx=0x7f60180058d0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 msgr2=0x7f602819bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f602819bde0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f601000b420 tx=0x7f601000b8e0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 shutdown_connections 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f601406cc50 0x7f601406f110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6028105bf0 0x7f602819bde0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 --2- 172.21.15.103:0/3968595964 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60280ffb40 0x7f602819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 >> 172.21.15.103:0/3968595964 conn(0x7f60280fb840 msgr2=0x7f60280fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:43.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 shutdown_connections 2024-09-17T01:03:43.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.743+0000 7f602c80b640 1 -- 172.21.15.103:0/3968595964 wait complete. 2024-09-17T01:03:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 -- 172.21.15.103:0/1175100012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a40105bf0 msgr2=0x7f7a40105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 --2- 172.21.15.103:0/1175100012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a40105bf0 0x7f7a40105fd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009880 tx=0x7f7a3002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 -- 172.21.15.103:0/1175100012 shutdown_connections 2024-09-17T01:03:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 --2- 172.21.15.103:0/1175100012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a400ffb40 0x7f7a400fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 --2- 172.21.15.103:0/1175100012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a40105bf0 0x7f7a40105fd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 -- 172.21.15.103:0/1175100012 >> 172.21.15.103:0/1175100012 conn(0x7f7a400fb840 msgr2=0x7f7a400fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 -- 172.21.15.103:0/1175100012 shutdown_connections 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.760+0000 7f7a45761640 1 -- 172.21.15.103:0/1175100012 wait complete. 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a45761640 1 Processor -- start 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a45761640 1 -- start start 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a45761640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 0x7f7a4019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a45761640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a40105bf0 0x7f7a4019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a45761640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4019c350 con 0x7f7a400ffb40 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a45761640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40195930 con 0x7f7a40105bf0 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 0x7f7a4019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 0x7f7a4019b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40846/0 (socket says 172.21.15.103:40846) 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a3effd640 1 -- 172.21.15.103:0/3580793198 learned_addr learned my addr 172.21.15.103:0/3580793198 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.761+0000 7f7a3e7fc640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a40105bf0 0x7f7a4019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a3effd640 1 -- 172.21.15.103:0/3580793198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a40105bf0 msgr2=0x7f7a4019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a3effd640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a40105bf0 0x7f7a4019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a3effd640 1 -- 172.21.15.103:0/3580793198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30009560 con 0x7f7a400ffb40 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a3effd640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 0x7f7a4019b7f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002a9c0 tx=0x7f7a300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a30004aa0 con 0x7f7a400ffb40 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a30004c00 con 0x7f7a400ffb40 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a40195bb0 con 0x7f7a400ffb40 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a30003980 con 0x7f7a400ffb40 2024-09-17T01:03:43.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.762+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a401960a0 con 0x7f7a400ffb40 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.763+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a401011f0 con 0x7f7a400ffb40 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.764+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7a30003bf0 con 0x7f7a400ffb40 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.764+0000 7f7a27fff640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7a2806cc50 0x7f7a2806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.764+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7a300aced0 con 0x7f7a400ffb40 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.764+0000 7f7a3e7fc640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7a2806cc50 0x7f7a2806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.765+0000 7f7a3e7fc640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7a2806cc50 0x7f7a2806f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a40196d50 tx=0x7f7a3400b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.769+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a30077690 con 0x7f7a400ffb40 2024-09-17T01:03:43.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:43 smithi103 ceph-mon[28156]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:43.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.936+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7a400fffa0 con 0x7f7a400ffb40 2024-09-17T01:03:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.936+0000 7f7a27fff640 1 -- 172.21.15.103:0/3580793198 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a3007acb0 con 0x7f7a400ffb40 2024-09-17T01:03:43.934 INFO:teuthology.orchestra.run.smithi103.stdout:167503724555 2024-09-17T01:03:43.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7a2806cc50 msgr2=0x7f7a2806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7a2806cc50 0x7f7a2806f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a40196d50 tx=0x7f7a3400b390 comp rx=0 tx=0).stop 2024-09-17T01:03:43.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 msgr2=0x7f7a4019b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:43.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 0x7f7a4019b7f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002a9c0 tx=0x7f7a300055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 shutdown_connections 2024-09-17T01:03:43.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f7a2806cc50 0x7f7a2806f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a40105bf0 0x7f7a4019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 --2- 172.21.15.103:0/3580793198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a400ffb40 0x7f7a4019b7f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 >> 172.21.15.103:0/3580793198 conn(0x7f7a400fb840 msgr2=0x7f7a400fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 shutdown_connections 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:43.938+0000 7f7a45761640 1 -- 172.21.15.103:0/3580793198 wait complete. 2024-09-17T01:03:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:43 smithi143 ceph-mon[35452]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:44.671 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149717 for osd.3 2024-09-17T01:03:44.671 DEBUG:teuthology.parallel:result is None 2024-09-17T01:03:44.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:44 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3968595964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T01:03:44.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:44 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3580793198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T01:03:45.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:44 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3968595964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T01:03:45.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:44 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3580793198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T01:03:45.160 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724553 got 167503724555 for osd.5 2024-09-17T01:03:45.160 DEBUG:teuthology.parallel:result is None 2024-09-17T01:03:45.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:45 smithi103 ceph-mon[28156]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:46.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:45 smithi143 ceph-mon[35452]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:46.523 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542175 for osd.1 2024-09-17T01:03:46.523 DEBUG:teuthology.parallel:result is None 2024-09-17T01:03:46.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 -- 172.21.15.103:0/3462273239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 msgr2=0x7f3090109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:46.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 --2- 172.21.15.103:0/3462273239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f3090109af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3084009880 tx=0x7f308402a530 comp rx=0 tx=0).stop 2024-09-17T01:03:46.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 -- 172.21.15.103:0/3462273239 shutdown_connections 2024-09-17T01:03:46.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 --2- 172.21.15.103:0/3462273239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f3090109af0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 --2- 172.21.15.103:0/3462273239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3090100ce0 0x7f30901010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 -- 172.21.15.103:0/3462273239 >> 172.21.15.103:0/3462273239 conn(0x7f30900fa720 msgr2=0x7f30900fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 -- 172.21.15.103:0/3462273239 shutdown_connections 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.686+0000 7f3097b6d640 1 -- 172.21.15.103:0/3462273239 wait complete. 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3097b6d640 1 Processor -- start 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3097b6d640 1 -- start start 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3097b6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3090100ce0 0x7f30900fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3097b6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f30900fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3097b6d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30900ff3c0 con 0x7f3090101600 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3097b6d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30900ff530 con 0x7f3090100ce0 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f30900fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f30900fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40860/0 (socket says 172.21.15.103:40860) 2024-09-17T01:03:46.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 -- 172.21.15.103:0/1654905958 learned_addr learned my addr 172.21.15.103:0/1654905958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095909640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3090100ce0 0x7f30900fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 -- 172.21.15.103:0/1654905958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3090100ce0 msgr2=0x7f30900fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3090100ce0 0x7f30900fe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 -- 172.21.15.103:0/1654905958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084009560 con 0x7f3090101600 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.687+0000 7f3095108640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f30900fee80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f308402aa50 tx=0x7f30840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.688+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3084004aa0 con 0x7f3090101600 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.688+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3084004c00 con 0x7f3090101600 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.688+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30900ff7b0 con 0x7f3090101600 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.688+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30840039b0 con 0x7f3090101600 2024-09-17T01:03:46.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.688+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30901a2050 con 0x7f3090101600 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.689+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3090068ce0 con 0x7f3090101600 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.689+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f308402ad50 con 0x7f3090101600 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.690+0000 7f3082ffd640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f307c06cc50 0x7f307c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.690+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f30840acae0 con 0x7f3090101600 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.690+0000 7f3095909640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f307c06cc50 0x7f307c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.690+0000 7f3095909640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f307c06cc50 0x7f307c06f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f308c009890 tx=0x7f308c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.694+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3084077270 con 0x7f3090101600 2024-09-17T01:03:46.706 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.866+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30900ff7b0 con 0x7f3090101600 2024-09-17T01:03:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.866+0000 7f3082ffd640 1 -- 172.21.15.103:0/1654905958 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30900ff7b0 con 0x7f3090101600 2024-09-17T01:03:46.864 INFO:teuthology.orchestra.run.smithi103.stdout:38654705701 2024-09-17T01:03:46.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f307c06cc50 msgr2=0x7f307c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:46.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f307c06cc50 0x7f307c06f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f308c009890 tx=0x7f308c008040 comp rx=0 tx=0).stop 2024-09-17T01:03:46.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 msgr2=0x7f30900fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f30900fee80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f308402aa50 tx=0x7f30840055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 shutdown_connections 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f307c06cc50 0x7f307c06f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3090101600 0x7f30900fee80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 --2- 172.21.15.103:0/1654905958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3090100ce0 0x7f30900fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 >> 172.21.15.103:0/1654905958 conn(0x7f30900fa720 msgr2=0x7f3090101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 shutdown_connections 2024-09-17T01:03:46.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:46.868+0000 7f3097b6d640 1 -- 172.21.15.103:0/1654905958 wait complete. 2024-09-17T01:03:47.879 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:47 smithi103 ceph-mon[28156]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:47.879 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:47 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1654905958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T01:03:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:47 smithi143 ceph-mon[35452]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:47 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1654905958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T01:03:48.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705701 for osd.0 2024-09-17T01:03:48.589 DEBUG:teuthology.parallel:result is None 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 -- 172.21.15.103:0/3942170645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c104a90 msgr2=0x7f579c104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 --2- 172.21.15.103:0/3942170645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c104a90 0x7f579c104e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f578c009880 tx=0x7f578c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 -- 172.21.15.103:0/3942170645 shutdown_connections 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 --2- 172.21.15.103:0/3942170645 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f579c0fea90 0x7f579c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 --2- 172.21.15.103:0/3942170645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c104a90 0x7f579c104e70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 -- 172.21.15.103:0/3942170645 >> 172.21.15.103:0/3942170645 conn(0x7f579c0fa7b0 msgr2=0x7f579c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:49.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 -- 172.21.15.103:0/3942170645 shutdown_connections 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.188+0000 7f57a233e640 1 -- 172.21.15.103:0/3942170645 wait complete. 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f57a233e640 1 Processor -- start 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f57a233e640 1 -- start start 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f57a233e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 0x7f579c100660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f57a233e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f579c104a90 0x7f579c100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f57a233e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1010e0 con 0x7f579c0fea90 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f57a233e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c101250 con 0x7f579c104a90 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f579bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 0x7f579c100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f579bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 0x7f579c100660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40882/0 (socket says 172.21.15.103:40882) 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f579bfff640 1 -- 172.21.15.103:0/742379847 learned_addr learned my addr 172.21.15.103:0/742379847 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f579bfff640 1 -- 172.21.15.103:0/742379847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f579c104a90 msgr2=0x7f579c100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f579bfff640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f579c104a90 0x7f579c100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.189+0000 7f579bfff640 1 -- 172.21.15.103:0/742379847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009560 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.190+0000 7f579bfff640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 0x7f579c100660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f578c02a9c0 tx=0x7f578c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.190+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f578c004aa0 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.190+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c1014d0 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.190+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f578c004c00 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.190+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f578c003ab0 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.190+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1a1fd0 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.191+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c1001d0 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.191+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f578c031d20 con 0x7f579c0fea90 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.192+0000 7f57997fa640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f578406cc50 0x7f578406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.192+0000 7f579b7fe640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f578406cc50 0x7f578406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:49.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.192+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f578c0ace60 con 0x7f579c0fea90 2024-09-17T01:03:49.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.192+0000 7f579b7fe640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f578406cc50 0x7f578406f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f579c101de0 tx=0x7f5790006c90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:49.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.196+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f578c077570 con 0x7f579c0fea90 2024-09-17T01:03:49.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.364+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f579c0feef0 con 0x7f579c0fea90 2024-09-17T01:03:49.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.364+0000 7f57997fa640 1 -- 172.21.15.103:0/742379847 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f578c07ab90 con 0x7f579c0fea90 2024-09-17T01:03:49.362 INFO:teuthology.orchestra.run.smithi103.stdout:81604378651 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.366+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f578406cc50 msgr2=0x7f578406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.366+0000 7f57a233e640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f578406cc50 0x7f578406f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f579c101de0 tx=0x7f5790006c90 comp rx=0 tx=0).stop 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.366+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 msgr2=0x7f579c100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.366+0000 7f57a233e640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 0x7f579c100660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f578c02a9c0 tx=0x7f578c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 shutdown_connections 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f578406cc50 0x7f578406f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f579c104a90 0x7f579c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 --2- 172.21.15.103:0/742379847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f579c0fea90 0x7f579c100660 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 >> 172.21.15.103:0/742379847 conn(0x7f579c0fa7b0 msgr2=0x7f579c102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:49.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 shutdown_connections 2024-09-17T01:03:49.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.367+0000 7f57a233e640 1 -- 172.21.15.103:0/742379847 wait complete. 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 -- 172.21.15.103:0/2640479270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 msgr2=0x7f14c81047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 --2- 172.21.15.103:0/2640479270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c81047f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009880 tx=0x7f14b002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 -- 172.21.15.103:0/2640479270 shutdown_connections 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 --2- 172.21.15.103:0/2640479270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c81047f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 --2- 172.21.15.103:0/2640479270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 0x7f14c81001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 -- 172.21.15.103:0/2640479270 >> 172.21.15.103:0/2640479270 conn(0x7f14c80fb8b0 msgr2=0x7f14c80fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 -- 172.21.15.103:0/2640479270 shutdown_connections 2024-09-17T01:03:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 -- 172.21.15.103:0/2640479270 wait complete. 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 Processor -- start 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.403+0000 7f14ce433640 1 -- start start 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14ce433640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 0x7f14c819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14ce433640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14ce433640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c819c360 con 0x7f14c81007a0 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14ce433640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8195980 con 0x7f14c80ffdf0 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40898/0 (socket says 172.21.15.103:40898) 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 -- 172.21.15.103:0/480126459 learned_addr learned my addr 172.21.15.103:0/480126459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14c7fff640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 0x7f14c819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 -- 172.21.15.103:0/480126459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 msgr2=0x7f14c819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 0x7f14c819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 -- 172.21.15.103:0/480126459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0009560 con 0x7f14c81007a0 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14c7fff640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 0x7f14c819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14bffff640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c819bdd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14b002a9c0 tx=0x7f14b00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b0004aa0 con 0x7f14c81007a0 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14b0004c00 con 0x7f14c81007a0 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c8195c00 con 0x7f14c81007a0 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.404+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b0003ab0 con 0x7f14c81007a0 2024-09-17T01:03:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.405+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c81960f0 con 0x7f14c81007a0 2024-09-17T01:03:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.406+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c81012d0 con 0x7f14c81007a0 2024-09-17T01:03:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.406+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f14b0031d20 con 0x7f14c81007a0 2024-09-17T01:03:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.407+0000 7f14c5ffb640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f14b406cc50 0x7f14b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.407+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f14b00acfc0 con 0x7f14c81007a0 2024-09-17T01:03:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.407+0000 7f14c7fff640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f14b406cc50 0x7f14b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.407+0000 7f14c7fff640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f14b406cc50 0x7f14b406f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14b800abe0 tx=0x7f14b800a5c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:49.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.412+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f14b00e0e20 con 0x7f14c81007a0 2024-09-17T01:03:49.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.580+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f14c8108100 con 0x7f14c81007a0 2024-09-17T01:03:49.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.580+0000 7f14c5ffb640 1 -- 172.21.15.103:0/480126459 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14b007b140 con 0x7f14c81007a0 2024-09-17T01:03:49.578 INFO:teuthology.orchestra.run.smithi103.stdout:146028888081 2024-09-17T01:03:49.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f14b406cc50 msgr2=0x7f14b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f14b406cc50 0x7f14b406f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14b800abe0 tx=0x7f14b800a5c0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 msgr2=0x7f14c819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c819bdd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14b002a9c0 tx=0x7f14b00055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 shutdown_connections 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f14b406cc50 0x7f14b406f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14c81007a0 0x7f14c819bdd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 --2- 172.21.15.103:0/480126459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14c80ffdf0 0x7f14c819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 >> 172.21.15.103:0/480126459 conn(0x7f14c80fb8b0 msgr2=0x7f14c80fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 shutdown_connections 2024-09-17T01:03:49.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:49.582+0000 7f14ce433640 1 -- 172.21.15.103:0/480126459 wait complete. 2024-09-17T01:03:49.907 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:49 smithi103 ceph-mon[28156]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:49.907 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:49 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/742379847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T01:03:49.907 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:49 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/480126459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T01:03:50.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:49 smithi143 ceph-mon[35452]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:50.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:49 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/742379847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T01:03:50.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:49 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/480126459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T01:03:50.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-09-17T01:03:50.338 DEBUG:teuthology.parallel:result is None 2024-09-17T01:03:50.793 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888081 for osd.4 2024-09-17T01:03:50.794 DEBUG:teuthology.parallel:result is None 2024-09-17T01:03:50.794 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T01:03:50.794 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T01:03:50.998 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:52.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:51 smithi143 ceph-mon[35452]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:52.009 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:51 smithi103 ceph-mon[28156]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 -- 172.21.15.103:0/906755440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 msgr2=0x7f5b940fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 --2- 172.21.15.103:0/906755440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b940fee00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009880 tx=0x7f5b9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 -- 172.21.15.103:0/906755440 shutdown_connections 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 --2- 172.21.15.103:0/906755440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b940fee00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 --2- 172.21.15.103:0/906755440 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 0x7f5b94104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 -- 172.21.15.103:0/906755440 >> 172.21.15.103:0/906755440 conn(0x7f5b940758c0 msgr2=0x7f5b940fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 -- 172.21.15.103:0/906755440 shutdown_connections 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.526+0000 7f5b9c159640 1 -- 172.21.15.103:0/906755440 wait complete. 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b9c159640 1 Processor -- start 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b9c159640 1 -- start start 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b9c159640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b94196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b9c159640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 0x7f5b94196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b9c159640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94197520 con 0x7f5b940fe9a0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b9c159640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94197690 con 0x7f5b941049a0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b99ef5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b94196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b99ef5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b94196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58260/0 (socket says 172.21.15.103:58260) 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.527+0000 7f5b99ef5640 1 -- 172.21.15.103:0/3516920661 learned_addr learned my addr 172.21.15.103:0/3516920661 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b996f4640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 0x7f5b94196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b99ef5640 1 -- 172.21.15.103:0/3516920661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 msgr2=0x7f5b94196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b99ef5640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 0x7f5b94196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b99ef5640 1 -- 172.21.15.103:0/3516920661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009560 con 0x7f5b940fe9a0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b996f4640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 0x7f5b94196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b99ef5640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b94196a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400b420 tx=0x7f5b8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b84011800 con 0x7f5b940fe9a0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b84011e20 con 0x7f5b940fe9a0 2024-09-17T01:03:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8400f2e0 con 0x7f5b940fe9a0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9419fa80 con 0x7f5b940fe9a0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.528+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9419fe90 con 0x7f5b940fe9a0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.529+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b941000e0 con 0x7f5b940fe9a0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.530+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5b84010380 con 0x7f5b940fe9a0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.530+0000 7f5b8affd640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5b8006cc50 0x7f5b8006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.530+0000 7f5b996f4640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5b8006cc50 0x7f5b8006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.530+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5b8408b880 con 0x7f5b940fe9a0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.531+0000 7f5b996f4640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5b8006cc50 0x7f5b8006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b90000c00 tx=0x7f5b90005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:52.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.535+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b84055f90 con 0x7f5b940fe9a0 2024-09-17T01:03:52.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.697+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b94068240 con 0x7f5b8006cc50 2024-09-17T01:03:52.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.698+0000 7f5b8affd640 1 -- 172.21.15.103:0/3516920661 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28072 (secure 0 0 0) 0x7f5b94068240 con 0x7f5b8006cc50 2024-09-17T01:03:52.698 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.700+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5b8006cc50 msgr2=0x7f5b8006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.700+0000 7f5b9c159640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5b8006cc50 0x7f5b8006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b90000c00 tx=0x7f5b90005a20 comp rx=0 tx=0).stop 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.700+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 msgr2=0x7f5b94196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.700+0000 7f5b9c159640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b94196a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400b420 tx=0x7f5b8400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 shutdown_connections 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5b8006cc50 0x7f5b8006f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b941049a0 0x7f5b94196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 --2- 172.21.15.103:0/3516920661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b940fe9a0 0x7f5b94196a10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 >> 172.21.15.103:0/3516920661 conn(0x7f5b940758c0 msgr2=0x7f5b94102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 shutdown_connections 2024-09-17T01:03:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:52.701+0000 7f5b9c159640 1 -- 172.21.15.103:0/3516920661 wait complete. 2024-09-17T01:03:53.318 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-17T01:03:52.607067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":174200,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":170230,"kb_avail":562296712,"statfs":{"total":575970213888,"available":575791833088,"internally_reserved":0,"allocated":3964928,"data_stored":2608885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":174316199},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002524"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T01:03:01.556179+0000","last_change":"2024-09-17T01:02:35.931683+0000","last_active":"2024-09-17T01:03:01.556179+0000","last_peered":"2024-09-17T01:03:01.556179+0000","last_clean":"2024-09-17T01:03:01.556179+0000","last_became_active":"2024-09-17T01:02:35.931333+0000","last_became_peered":"2024-09-17T01:02:35.931333+0000","last_unstale":"2024-09-17T01:03:01.556179+0000","last_undegraded":"2024-09-17T01:03:01.556179+0000","last_fullsized":"2024-09-17T01:03:01.556179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:01:51.180242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:01:51.180242+0000","last_clean_scrub_stamp":"2024-09-17T01:01:51.180242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:52.894122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46000000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":729764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32700000000000001}]},{"osd":1,"last update":"Tue Sep 17 01:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Tue Sep 17 01:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Sep 17 01:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.27500000000000002}]},{"osd":1,"last update":"Tue Sep 17 01:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.307}]},{"osd":3,"last update":"Tue Sep 17 01:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Sep 17 01:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.672999999999998,"5min":16.672999999999998,"15min":16.672999999999998},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:03:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.309,"15min":0.30499999999999999},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.312,"15min":0.308},"min":{"1min":0.222,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.24399999999999999}]},{"osd":3,"last update":"Tue Sep 17 01:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 01:03:27 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29499999999999998},"min":{"1min":0.24099999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30299999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.441,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.27500000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.30599999999999999}]},{"osd":3,"last update":"Tue Sep 17 01:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.504}]},{"osd":4,"last update":"Tue Sep 17 01:03:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.441},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:03:53.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T01:03:53.519 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:53 smithi103 ceph-mon[28156]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:53 smithi103 ceph-mon[28156]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:03:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:54.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:53 smithi143 ceph-mon[35452]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:53 smithi143 ceph-mon[35452]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:03:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 -- 172.21.15.103:0/2914704118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 msgr2=0x7f4164105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:55.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 --2- 172.21.15.103:0/2914704118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f4164105fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4154009880 tx=0x7f415402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 -- 172.21.15.103:0/2914704118 shutdown_connections 2024-09-17T01:03:55.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 --2- 172.21.15.103:0/2914704118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41640ffb40 0x7f41640fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 --2- 172.21.15.103:0/2914704118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f4164105fd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 -- 172.21.15.103:0/2914704118 >> 172.21.15.103:0/2914704118 conn(0x7f41640fb840 msgr2=0x7f41640fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:55.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 -- 172.21.15.103:0/2914704118 shutdown_connections 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.036+0000 7f416a68d640 1 -- 172.21.15.103:0/2914704118 wait complete. 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f416a68d640 1 Processor -- start 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f416a68d640 1 -- start start 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f416a68d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41640ffb40 0x7f416419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f416a68d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f416419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f416a68d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416419c400 con 0x7f4164105bf0 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f416a68d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4164195990 con 0x7f41640ffb40 2024-09-17T01:03:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f41637fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f416419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f41637fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f416419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58276/0 (socket says 172.21.15.103:58276) 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f41637fe640 1 -- 172.21.15.103:0/501942857 learned_addr learned my addr 172.21.15.103:0/501942857 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.037+0000 7f4163fff640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41640ffb40 0x7f416419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41637fe640 1 -- 172.21.15.103:0/501942857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41640ffb40 msgr2=0x7f416419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41637fe640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41640ffb40 0x7f416419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41637fe640 1 -- 172.21.15.103:0/501942857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154009560 con 0x7f4164105bf0 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41637fe640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f416419bde0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f415800b420 tx=0x7f415800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4158011800 con 0x7f4164105bf0 2024-09-17T01:03:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4158011e20 con 0x7f4164105bf0 2024-09-17T01:03:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4164195c70 con 0x7f4164105bf0 2024-09-17T01:03:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f415800f2e0 con 0x7f4164105bf0 2024-09-17T01:03:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.038+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4164196240 con 0x7f4164105bf0 2024-09-17T01:03:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.039+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41641011f0 con 0x7f4164105bf0 2024-09-17T01:03:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.039+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4158010380 con 0x7f4164105bf0 2024-09-17T01:03:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.040+0000 7f41617fa640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f414c06cc50 0x7f414c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.040+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f415808b720 con 0x7f4164105bf0 2024-09-17T01:03:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.040+0000 7f4163fff640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f414c06cc50 0x7f414c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.040+0000 7f4163fff640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f414c06cc50 0x7f414c06f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4154009230 tx=0x7f41540058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.044+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4158055eb0 con 0x7f4164105bf0 2024-09-17T01:03:55.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.203+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f416410ce10 con 0x7f414c06cc50 2024-09-17T01:03:55.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.204+0000 7f41617fa640 1 -- 172.21.15.103:0/501942857 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28072 (secure 0 0 0) 0x7f416410ce10 con 0x7f414c06cc50 2024-09-17T01:03:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:55.204 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-17T01:03:55.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.206+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f414c06cc50 msgr2=0x7f414c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:55.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.206+0000 7f416a68d640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f414c06cc50 0x7f414c06f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4154009230 tx=0x7f41540058d0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.206+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 msgr2=0x7f416419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:55.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.206+0000 7f416a68d640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f416419bde0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f415800b420 tx=0x7f415800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 shutdown_connections 2024-09-17T01:03:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f414c06cc50 0x7f414c06f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4164105bf0 0x7f416419bde0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 --2- 172.21.15.103:0/501942857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41640ffb40 0x7f416419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 >> 172.21.15.103:0/501942857 conn(0x7f41640fb840 msgr2=0x7f41640fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 shutdown_connections 2024-09-17T01:03:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:55.207+0000 7f416a68d640 1 -- 172.21.15.103:0/501942857 wait complete. 2024-09-17T01:03:55.873 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-17T01:03:54.607384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":174200,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":170230,"kb_avail":562296712,"statfs":{"total":575970213888,"available":575791833088,"internally_reserved":0,"allocated":3964928,"data_stored":2608885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":174316199},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002367"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T01:03:01.556179+0000","last_change":"2024-09-17T01:02:35.931683+0000","last_active":"2024-09-17T01:03:01.556179+0000","last_peered":"2024-09-17T01:03:01.556179+0000","last_clean":"2024-09-17T01:03:01.556179+0000","last_became_active":"2024-09-17T01:02:35.931333+0000","last_became_peered":"2024-09-17T01:02:35.931333+0000","last_unstale":"2024-09-17T01:03:01.556179+0000","last_undegraded":"2024-09-17T01:03:01.556179+0000","last_fullsized":"2024-09-17T01:03:01.556179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:01:51.180242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:01:51.180242+0000","last_clean_scrub_stamp":"2024-09-17T01:01:51.180242+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:52.894122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46000000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":729764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32700000000000001}]},{"osd":1,"last update":"Tue Sep 17 01:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Tue Sep 17 01:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Sep 17 01:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.27500000000000002}]},{"osd":1,"last update":"Tue Sep 17 01:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.307}]},{"osd":3,"last update":"Tue Sep 17 01:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Sep 17 01:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.672999999999998,"5min":16.672999999999998,"15min":16.672999999999998},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:03:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.309,"15min":0.30499999999999999},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.312,"15min":0.308},"min":{"1min":0.222,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.23300000000000001}]},{"osd":2,"last update":"Tue Sep 17 01:03:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34000000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.30599999999999999}]},{"osd":3,"last update":"Tue Sep 17 01:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.61399999999999999}]},{"osd":4,"last update":"Tue Sep 17 01:03:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 01:03:27 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29499999999999998},"min":{"1min":0.24099999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30299999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.441,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.27500000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.30599999999999999}]},{"osd":3,"last update":"Tue Sep 17 01:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.504}]},{"osd":4,"last update":"Tue Sep 17 01:03:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.441},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:03:55.874 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T01:03:55.875 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T01:03:55.875 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T01:03:55.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T01:03:55.901 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:55 smithi103 ceph-mon[28156]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:56.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:55 smithi143 ceph-mon[35452]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:56.877 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:56 smithi103 ceph-mon[28156]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:03:57.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:56 smithi143 ceph-mon[35452]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:03:57.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.709+0000 7ff5d84ee640 1 -- 172.21.15.103:0/475459360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d01049a0 msgr2=0x7ff5d0104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.709+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/475459360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d01049a0 0x7ff5d0104d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009880 tx=0x7ff5cc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- 172.21.15.103:0/475459360 shutdown_connections 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/475459360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d00fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/475459360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d01049a0 0x7ff5d0104d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- 172.21.15.103:0/475459360 >> 172.21.15.103:0/475459360 conn(0x7ff5d00758c0 msgr2=0x7ff5d00fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- 172.21.15.103:0/475459360 shutdown_connections 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- 172.21.15.103:0/475459360 wait complete. 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 Processor -- start 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- start start 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5d01049a0 0x7ff5d019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:57.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d019c2f0 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.710+0000 7ff5d84ee640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d01958e0 con 0x7ff5d01049a0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d019b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58290/0 (socket says 172.21.15.103:58290) 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 -- 172.21.15.103:0/2941649655 learned_addr learned my addr 172.21.15.103:0/2941649655 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d5a89640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5d01049a0 0x7ff5d019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 -- 172.21.15.103:0/2941649655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5d01049a0 msgr2=0x7ff5d019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5d01049a0 0x7ff5d019bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 -- 172.21.15.103:0/2941649655 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009560 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d628a640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d019b720 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc02a9c0 tx=0x7ff5cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5cc004aa0 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d0195b60 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5cc004c00 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.711+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5cc003980 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.712+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d0196050 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.713+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d01000e0 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.719+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff5cc003bf0 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.720+0000 7ff5c77fe640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff5bc06cc50 0x7ff5bc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.720+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff5cc0ad5d0 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.720+0000 7ff5d5a89640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff5bc06cc50 0x7ff5bc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.720+0000 7ff5d5a89640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff5bc06cc50 0x7ff5bc06f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff5d01041a0 tx=0x7ff5c000b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.723+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff5cc077d70 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.918+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff5d0196ee0 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.918 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:57 smithi103 ceph-mon[28156]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.918+0000 7ff5c77fe640 1 -- 172.21.15.103:0/2941649655 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff5cc04a040 con 0x7ff5d00fe9a0 2024-09-17T01:03:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:03:57.918 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff5bc06cc50 msgr2=0x7ff5bc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff5bc06cc50 0x7ff5bc06f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff5d01041a0 tx=0x7ff5c000b390 comp rx=0 tx=0).stop 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 msgr2=0x7ff5d019b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d019b720 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc02a9c0 tx=0x7ff5cc0055a0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 shutdown_connections 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff5bc06cc50 0x7ff5bc06f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5d01049a0 0x7ff5d019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 --2- 172.21.15.103:0/2941649655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5d00fe9a0 0x7ff5d019b720 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 >> 172.21.15.103:0/2941649655 conn(0x7ff5d00758c0 msgr2=0x7ff5d00fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 shutdown_connections 2024-09-17T01:03:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:03:57.921+0000 7ff5d84ee640 1 -- 172.21.15.103:0/2941649655 wait complete. 2024-09-17T01:03:58.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:57 smithi143 ceph-mon[35452]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:03:58.623 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T01:03:58.624 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T01:03:58.624 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:03:58.636 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-17T01:03:58.636 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:03:58.651 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:03:58.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-17T01:03:58.860 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:58 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2941649655' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T01:03:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:03:59.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:58 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2941649655' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T01:03:59.990 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:03:59 smithi103 ceph-mon[28156]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:00.516 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:03:59 smithi143 ceph-mon[35452]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:00.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 -- 172.21.15.103:0/3994715982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640fea30 msgr2=0x7efe640fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:00.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/3994715982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640fea30 0x7efe640fee30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe54009880 tx=0x7efe5402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 -- 172.21.15.103:0/3994715982 shutdown_connections 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/3994715982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640ffc30 0x7efe641000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/3994715982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640fea30 0x7efe640fee30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 -- 172.21.15.103:0/3994715982 >> 172.21.15.103:0/3994715982 conn(0x7efe640fa1c0 msgr2=0x7efe640fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 -- 172.21.15.103:0/3994715982 shutdown_connections 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.499+0000 7efe6a0a1640 1 -- 172.21.15.103:0/3994715982 wait complete. 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe6a0a1640 1 Processor -- start 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe6a0a1640 1 -- start start 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe6a0a1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640fea30 0x7efe64068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe6a0a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 0x7efe6419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe6a0a1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6419a940 con 0x7efe640ffc30 2024-09-17T01:04:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe6a0a1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6419aa80 con 0x7efe640fea30 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 0x7efe6419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 0x7efe6419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58310/0 (socket says 172.21.15.103:58310) 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 -- 172.21.15.103:0/1265930212 learned_addr learned my addr 172.21.15.103:0/1265930212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe637fe640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640fea30 0x7efe64068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 -- 172.21.15.103:0/1265930212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640fea30 msgr2=0x7efe64068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640fea30 0x7efe64068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 -- 172.21.15.103:0/1265930212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009560 con 0x7efe640ffc30 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe637fe640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640fea30 0x7efe64068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.500+0000 7efe5bfff640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 0x7efe6419a370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c810 tx=0x7efe4c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.501+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c0041f0 con 0x7efe640ffc30 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.501+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe4c007e70 con 0x7efe640ffc30 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.501+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6419ad30 con 0x7efe640ffc30 2024-09-17T01:04:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.501+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c0049d0 con 0x7efe640ffc30 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.501+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6419b300 con 0x7efe640ffc30 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.502+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe64107620 con 0x7efe640ffc30 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.502+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efe4c0079b0 con 0x7efe640ffc30 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.503+0000 7efe617fa640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efe5006cc50 0x7efe5006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.503+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efe4c08bd40 con 0x7efe640ffc30 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.503+0000 7efe637fe640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efe5006cc50 0x7efe5006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.503+0000 7efe637fe640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efe5006cc50 0x7efe5006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe54031540 tx=0x7efe54000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.507+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efe4c056450 con 0x7efe640ffc30 2024-09-17T01:04:00.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.672+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7efe6419b550 con 0x7efe640ffc30 2024-09-17T01:04:00.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.676+0000 7efe617fa640 1 -- 172.21.15.103:0/1265930212 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v22)=0 v22) v1 ==== 143+0+0 (secure 0 0 0) 0x7efe4c05ee60 con 0x7efe640ffc30 2024-09-17T01:04:00.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efe5006cc50 msgr2=0x7efe5006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efe5006cc50 0x7efe5006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe54031540 tx=0x7efe54000bc0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 msgr2=0x7efe6419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 0x7efe6419a370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c810 tx=0x7efe4c00ccd0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 shutdown_connections 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efe5006cc50 0x7efe5006f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe640ffc30 0x7efe6419a370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 --2- 172.21.15.103:0/1265930212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640fea30 0x7efe64068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.678+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 >> 172.21.15.103:0/1265930212 conn(0x7efe640fa1c0 msgr2=0x7efe64102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.679+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 shutdown_connections 2024-09-17T01:04:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:00.679+0000 7efe6a0a1640 1 -- 172.21.15.103:0/1265930212 wait complete. 2024-09-17T01:04:01.472 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:04:01.482 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-17T01:04:01.482 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:04:01.490 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:01.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T01:04:01.688 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:01.804 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:01 smithi103 ceph-mon[28156]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:01.804 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:01 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1265930212' entity='client.admin' 2024-09-17T01:04:01.805 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:01.805 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:01.805 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:01.805 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:02.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:01 smithi143 ceph-mon[35452]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:02.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:01 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1265930212' entity='client.admin' 2024-09-17T01:04:02.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:03.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.377+0000 7f88e5206640 1 -- 172.21.15.103:0/1924595800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0102ef0 msgr2=0x7f88e01052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:03.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.377+0000 7f88e5206640 1 --2- 172.21.15.103:0/1924595800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0102ef0 0x7f88e01052e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f88c80098b0 tx=0x7f88c802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.377+0000 7f88e5206640 1 -- 172.21.15.103:0/1924595800 shutdown_connections 2024-09-17T01:04:03.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.377+0000 7f88e5206640 1 --2- 172.21.15.103:0/1924595800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0102ef0 0x7f88e01052e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.377+0000 7f88e5206640 1 --2- 172.21.15.103:0/1924595800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88e01005c0 0x7f88e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.377+0000 7f88e5206640 1 -- 172.21.15.103:0/1924595800 >> 172.21.15.103:0/1924595800 conn(0x7f88e00fa1c0 msgr2=0x7f88e00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.378+0000 7f88e5206640 1 -- 172.21.15.103:0/1924595800 shutdown_connections 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.378+0000 7f88e5206640 1 -- 172.21.15.103:0/1924595800 wait complete. 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.378+0000 7f88e5206640 1 Processor -- start 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.378+0000 7f88e5206640 1 -- start start 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88e5206640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 0x7f88e00fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88e5206640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88e0102ef0 0x7f88e00fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88e5206640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00feab0 con 0x7f88e01005c0 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88e5206640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00fec20 con 0x7f88e0102ef0 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 0x7f88e00fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 0x7f88e00fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35912/0 (socket says 172.21.15.103:35912) 2024-09-17T01:04:03.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 -- 172.21.15.103:0/3766170567 learned_addr learned my addr 172.21.15.103:0/3766170567 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88de59c640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88e0102ef0 0x7f88e00fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 -- 172.21.15.103:0/3766170567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88e0102ef0 msgr2=0x7f88e00fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88e0102ef0 0x7f88e00fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 -- 172.21.15.103:0/3766170567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009560 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88ded9d640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 0x7f88e00fff20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f88d000ba50 tx=0x7f88d000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88d000cb30 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88d000cc90 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00fef00 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88d0007740 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.379+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e019d800 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.380+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e0109170 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.381+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f88d0014b90 con 0x7f88e01005c0 2024-09-17T01:04:03.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.381+0000 7f88d7fff640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f88cc06cc50 0x7f88cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:03.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.381+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f88d008b8e0 con 0x7f88e01005c0 2024-09-17T01:04:03.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.382+0000 7f88de59c640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f88cc06cc50 0x7f88cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:03.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.382+0000 7f88de59c640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f88cc06cc50 0x7f88cc06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009880 tx=0x7f88c8005b50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:03.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.386+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f88e0109170 con 0x7f88e01005c0 2024-09-17T01:04:03.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.561+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88e0109100 con 0x7f88cc06cc50 2024-09-17T01:04:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.562+0000 7f88d7fff640 1 -- 172.21.15.103:0/3766170567 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f88e0109100 con 0x7f88cc06cc50 2024-09-17T01:04:03.561 INFO:teuthology.orchestra.run.smithi103.stdout:Backend: cephadm 2024-09-17T01:04:03.561 INFO:teuthology.orchestra.run.smithi103.stdout:Available: Yes 2024-09-17T01:04:03.562 INFO:teuthology.orchestra.run.smithi103.stdout:Paused: No 2024-09-17T01:04:03.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f88cc06cc50 msgr2=0x7f88cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:03.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f88cc06cc50 0x7f88cc06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009880 tx=0x7f88c8005b50 comp rx=0 tx=0).stop 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 msgr2=0x7f88e00fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 0x7f88e00fff20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f88d000ba50 tx=0x7f88d000bf10 comp rx=0 tx=0).stop 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 shutdown_connections 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f88cc06cc50 0x7f88cc06f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88e0102ef0 0x7f88e00fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 --2- 172.21.15.103:0/3766170567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e01005c0 0x7f88e00fff20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.564+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 >> 172.21.15.103:0/3766170567 conn(0x7f88e00fa1c0 msgr2=0x7f88e00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.565+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 shutdown_connections 2024-09-17T01:04:03.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:03.565+0000 7f88e5206640 1 -- 172.21.15.103:0/3766170567 wait complete. 2024-09-17T01:04:03.920 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:03 smithi103 ceph-mon[28156]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:04.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:03 smithi143 ceph-mon[35452]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:04.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T01:04:04.430 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:04.871 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:04 smithi103 ceph-mon[28156]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:04 smithi143 ceph-mon[35452]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:05.925 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:05 smithi103 ceph-mon[28156]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:05.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 -- 172.21.15.103:0/673795804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200ffc30 msgr2=0x7f41201000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:05.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 --2- 172.21.15.103:0/673795804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200ffc30 0x7f41201000b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4108009880 tx=0x7f410802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:05.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 -- 172.21.15.103:0/673795804 shutdown_connections 2024-09-17T01:04:05.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 --2- 172.21.15.103:0/673795804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200ffc30 0x7f41201000b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:05.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 --2- 172.21.15.103:0/673795804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41200fea30 0x7f41200fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:05.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 -- 172.21.15.103:0/673795804 >> 172.21.15.103:0/673795804 conn(0x7f41200fa1c0 msgr2=0x7f41200fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 -- 172.21.15.103:0/673795804 shutdown_connections 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.926+0000 7f4124870640 1 -- 172.21.15.103:0/673795804 wait complete. 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4124870640 1 Processor -- start 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4124870640 1 -- start start 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4124870640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 0x7f4120068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4124870640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41200ffc30 0x7f412019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4124870640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412019a930 con 0x7f41200fea30 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4124870640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412019aa70 con 0x7f41200ffc30 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 0x7f4120068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 0x7f4120068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35918/0 (socket says 172.21.15.103:35918) 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 -- 172.21.15.103:0/1327682022 learned_addr learned my addr 172.21.15.103:0/1327682022 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f4117fff640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41200ffc30 0x7f412019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 -- 172.21.15.103:0/1327682022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41200ffc30 msgr2=0x7f412019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41200ffc30 0x7f412019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 -- 172.21.15.103:0/1327682022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009560 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.927+0000 7f411e59c640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 0x7f4120068740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f411000e940 tx=0x7f411000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.928+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41100096e0 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.928+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41100044f0 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.928+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412019ad20 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.928+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4110010430 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.928+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412019b2c0 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.929+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41200fee30 con 0x7f41200fea30 2024-09-17T01:04:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.929+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f411000cc90 con 0x7f41200fea30 2024-09-17T01:04:05.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.930+0000 7f41177fe640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f410c06cc50 0x7f410c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:05.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.930+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4110014070 con 0x7f41200fea30 2024-09-17T01:04:05.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.930+0000 7f4117fff640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f410c06cc50 0x7f410c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:05.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.930+0000 7f4117fff640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f410c06cc50 0x7f410c06f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4108000c00 tx=0x7f41080314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:05.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:05.934+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4110056a50 con 0x7f41200fea30 2024-09-17T01:04:06.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:05 smithi143 ceph-mon[35452]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:06.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.104+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4120104580 con 0x7f410c06cc50 2024-09-17T01:04:06.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.112+0000 7f41177fe640 1 -- 172.21.15.103:0/1327682022 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3080 (secure 0 0 0) 0x7f4120104580 con 0x7f410c06cc50 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (3m) 2m ago 4m 26.2M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (5m) 2m ago 5m 7151k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (4m) 67s ago 4m 7042k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (5m) 2m ago 5m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (4m) 67s ago 4m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (3m) 2m ago 4m 80.1M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:9283,8765,8443 running (6m) 2m ago 6m 480M - 18.2.4-855-g19e2a2be 980a0bfcd684 29c1c8578f11 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (4m) 67s ago 4m 439M - 18.2.4-855-g19e2a2be 980a0bfcd684 f45a460ef3a5 2024-09-17T01:04:06.111 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (6m) 2m ago 6m 45.4M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (3m) 67s ago 3m 40.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (5m) 2m ago 5m 16.1M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (4m) 67s ago 4m 17.1M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (3m) 2m ago 3m 43.6M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (2m) 2m ago 2m 40.0M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (2m) 2m ago 2m 47.2M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (2m) 67s ago 2m 40.5M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (97s) 67s ago 96s 40.0M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (72s) 67s ago 72s 12.7M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:04:06.112 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (3m) 2m ago 4m 40.4M - 2.43.0 a07b618ecd1d e84d3109ab0e 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f410c06cc50 msgr2=0x7f410c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f410c06cc50 0x7f410c06f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4108000c00 tx=0x7f41080314e0 comp rx=0 tx=0).stop 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 msgr2=0x7f4120068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 0x7f4120068740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f411000e940 tx=0x7f411000ee00 comp rx=0 tx=0).stop 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 shutdown_connections 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f410c06cc50 0x7f410c06f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41200ffc30 0x7f412019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 --2- 172.21.15.103:0/1327682022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41200fea30 0x7f4120068740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 >> 172.21.15.103:0/1327682022 conn(0x7f41200fa1c0 msgr2=0x7f4120102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 shutdown_connections 2024-09-17T01:04:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:06.114+0000 7f4124870640 1 -- 172.21.15.103:0/1327682022 wait complete. 2024-09-17T01:04:06.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T01:04:07.029 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:07.798 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:07 smithi103 ceph-mon[28156]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:07.798 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:07 smithi103 ceph-mon[28156]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:08.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:07 smithi143 ceph-mon[35452]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:08.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:07 smithi143 ceph-mon[35452]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:08.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 -- 172.21.15.103:0/3169588301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 msgr2=0x7f905c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 --2- 172.21.15.103:0/3169588301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c100120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9044009880 tx=0x7f904402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 -- 172.21.15.103:0/3169588301 shutdown_connections 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 --2- 172.21.15.103:0/3169588301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c100120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 --2- 172.21.15.103:0/3169588301 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f905c0feaa0 0x7f905c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 -- 172.21.15.103:0/3169588301 >> 172.21.15.103:0/3169588301 conn(0x7f905c0fa230 msgr2=0x7f905c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 -- 172.21.15.103:0/3169588301 shutdown_connections 2024-09-17T01:04:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.566+0000 7f9060a8d640 1 -- 172.21.15.103:0/3169588301 wait complete. 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.567+0000 7f9060a8d640 1 Processor -- start 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.567+0000 7f9060a8d640 1 -- start start 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.567+0000 7f9060a8d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f905c0feaa0 0x7f905c1944f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.567+0000 7f9060a8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c194a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.567+0000 7f9060a8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c195000 con 0x7f905c0ffca0 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9060a8d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c195170 con 0x7f905c0feaa0 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c194a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c194a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35946/0 (socket says 172.21.15.103:35946) 2024-09-17T01:04:08.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 -- 172.21.15.103:0/2819705736 learned_addr learned my addr 172.21.15.103:0/2819705736 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f905a59c640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f905c0feaa0 0x7f905c1944f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 -- 172.21.15.103:0/2819705736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f905c0feaa0 msgr2=0x7f905c1944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f905c0feaa0 0x7f905c1944f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 -- 172.21.15.103:0/2819705736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044009560 con 0x7f905c0ffca0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9053fff640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c194a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9044005640 tx=0x7f9044005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9044004ba0 con 0x7f905c0ffca0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9044004d00 con 0x7f905c0ffca0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c199bb0 con 0x7f905c0ffca0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9044003c30 con 0x7f905c0ffca0 2024-09-17T01:04:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.568+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c19a120 con 0x7f905c0ffca0 2024-09-17T01:04:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.569+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c107690 con 0x7f905c0ffca0 2024-09-17T01:04:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.570+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9044031640 con 0x7f905c0ffca0 2024-09-17T01:04:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.570+0000 7f90537fe640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f904806cc50 0x7f904806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.570+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f90440ad200 con 0x7f905c0ffca0 2024-09-17T01:04:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.570+0000 7f905a59c640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f904806cc50 0x7f904806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.571+0000 7f905a59c640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f904806cc50 0x7f904806f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f904c005db0 tx=0x7f904c005d40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:08.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.575+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9044077910 con 0x7f905c0ffca0 2024-09-17T01:04:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.752+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f905c19a310 con 0x7f904806cc50 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.756+0000 7f90537fe640 1 -- 172.21.15.103:0/2819705736 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7f905c19a310 con 0x7f904806cc50 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stdout:crash 2/2 2m ago 5m * 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-17T01:04:08.755 INFO:teuthology.orchestra.run.smithi103.stdout:mgr 2/2 2m ago 5m count:2 2024-09-17T01:04:08.756 INFO:teuthology.orchestra.run.smithi103.stdout:mon 2/2 2m ago 5m smithi103:172.21.15.103=smithi103;smithi143:172.21.15.143=smithi143;count:2 2024-09-17T01:04:08.756 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-17T01:04:08.756 INFO:teuthology.orchestra.run.smithi103.stdout:osd 6 2m ago - 2024-09-17T01:04:08.756 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-17T01:04:08.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f904806cc50 msgr2=0x7f904806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f904806cc50 0x7f904806f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f904c005db0 tx=0x7f904c005d40 comp rx=0 tx=0).stop 2024-09-17T01:04:08.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 msgr2=0x7f905c194a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c194a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9044005640 tx=0x7f9044005670 comp rx=0 tx=0).stop 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 shutdown_connections 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f904806cc50 0x7f904806f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905c0ffca0 0x7f905c194a30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 --2- 172.21.15.103:0/2819705736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f905c0feaa0 0x7f905c1944f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 >> 172.21.15.103:0/2819705736 conn(0x7f905c0fa230 msgr2=0x7f905c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 shutdown_connections 2024-09-17T01:04:08.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:08.758+0000 7f9060a8d640 1 -- 172.21.15.103:0/2819705736 wait complete. 2024-09-17T01:04:08.979 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:09.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:09.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T01:04:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:09.817 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:09 smithi103 ceph-mon[28156]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:09.817 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:09 smithi103 ceph-mon[28156]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:09 smithi143 ceph-mon[35452]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:09 smithi143 ceph-mon[35452]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:11.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 -- 172.21.15.103:0/1633385678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140fea80 msgr2=0x7ff5140fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:11.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 --2- 172.21.15.103:0/1633385678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140fea80 0x7ff5140fee80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff504009880 tx=0x7ff50402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 -- 172.21.15.103:0/1633385678 shutdown_connections 2024-09-17T01:04:11.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 --2- 172.21.15.103:0/1633385678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5140ffc80 0x7ff514100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 --2- 172.21.15.103:0/1633385678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140fea80 0x7ff5140fee80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 -- 172.21.15.103:0/1633385678 >> 172.21.15.103:0/1633385678 conn(0x7ff5140fa230 msgr2=0x7ff5140fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 -- 172.21.15.103:0/1633385678 shutdown_connections 2024-09-17T01:04:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.282+0000 7ff51a216640 1 -- 172.21.15.103:0/1633385678 wait complete. 2024-09-17T01:04:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff51a216640 1 Processor -- start 2024-09-17T01:04:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff51a216640 1 -- start start 2024-09-17T01:04:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff51a216640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5140fea80 0x7ff514102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff51a216640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 0x7ff514101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff51a216640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141015a0 con 0x7ff5140ffc80 2024-09-17T01:04:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff51a216640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514101710 con 0x7ff5140fea80 2024-09-17T01:04:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff512ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 0x7ff514101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff512ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 0x7ff514101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35958/0 (socket says 172.21.15.103:35958) 2024-09-17T01:04:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff512ffd640 1 -- 172.21.15.103:0/2062251889 learned_addr learned my addr 172.21.15.103:0/2062251889 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.283+0000 7ff5137fe640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5140fea80 0x7ff514102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff512ffd640 1 -- 172.21.15.103:0/2062251889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5140fea80 msgr2=0x7ff514102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff512ffd640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5140fea80 0x7ff514102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff512ffd640 1 -- 172.21.15.103:0/2062251889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009560 con 0x7ff5140ffc80 2024-09-17T01:04:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff512ffd640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 0x7ff514101060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff50800b420 tx=0x7ff50800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff508011800 con 0x7ff5140ffc80 2024-09-17T01:04:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff508011e20 con 0x7ff5140ffc80 2024-09-17T01:04:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5141019f0 con 0x7ff5140ffc80 2024-09-17T01:04:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50800f2e0 con 0x7ff5140ffc80 2024-09-17T01:04:11.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.284+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51419d760 con 0x7ff5140ffc80 2024-09-17T01:04:11.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.285+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5140fef00 con 0x7ff5140ffc80 2024-09-17T01:04:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.286+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff508010380 con 0x7ff5140ffc80 2024-09-17T01:04:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.286+0000 7ff510ff9640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff4fc06cc50 0x7ff4fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.286+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff50808b880 con 0x7ff5140ffc80 2024-09-17T01:04:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.286+0000 7ff5137fe640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff4fc06cc50 0x7ff4fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.287+0000 7ff5137fe640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff4fc06cc50 0x7ff4fc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff504009230 tx=0x7ff504005b50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.290+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff508055f90 con 0x7ff5140ffc80 2024-09-17T01:04:11.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.460+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff514068bc0 con 0x7ff4fc06cc50 2024-09-17T01:04:11.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.461+0000 7ff510ff9640 1 -- 172.21.15.103:0/2062251889 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7ff514068bc0 con 0x7ff4fc06cc50 2024-09-17T01:04:11.460 INFO:teuthology.orchestra.run.smithi103.stdout:HOST ADDR LABELS STATUS 2024-09-17T01:04:11.460 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 172.21.15.103 2024-09-17T01:04:11.460 INFO:teuthology.orchestra.run.smithi103.stdout:smithi143 172.21.15.143 2024-09-17T01:04:11.460 INFO:teuthology.orchestra.run.smithi103.stdout:2 hosts in cluster 2024-09-17T01:04:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff4fc06cc50 msgr2=0x7ff4fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff4fc06cc50 0x7ff4fc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff504009230 tx=0x7ff504005b50 comp rx=0 tx=0).stop 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 msgr2=0x7ff514101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 0x7ff514101060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff50800b420 tx=0x7ff50800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 shutdown_connections 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff4fc06cc50 0x7ff4fc06f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5140ffc80 0x7ff514101060 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 --2- 172.21.15.103:0/2062251889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5140fea80 0x7ff514102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.463+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 >> 172.21.15.103:0/2062251889 conn(0x7ff5140fa230 msgr2=0x7ff5140684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.464+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 shutdown_connections 2024-09-17T01:04:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:11.464+0000 7ff51a216640 1 -- 172.21.15.103:0/2062251889 wait complete. 2024-09-17T01:04:11.827 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:11 smithi103 ceph-mon[28156]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:12.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:11 smithi143 ceph-mon[35452]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:12.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T01:04:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:12 smithi143 ceph-mon[35452]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:13.061 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:12 smithi103 ceph-mon[28156]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:13.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 -- 172.21.15.103:0/3975523453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 msgr2=0x7f1bd8100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:13.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 --2- 172.21.15.103:0/3975523453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd8100120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009880 tx=0x7f1bcc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:13.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 -- 172.21.15.103:0/3975523453 shutdown_connections 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 --2- 172.21.15.103:0/3975523453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd8100120 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 --2- 172.21.15.103:0/3975523453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bd80feaa0 0x7f1bd80feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 -- 172.21.15.103:0/3975523453 >> 172.21.15.103:0/3975523453 conn(0x7f1bd80fa230 msgr2=0x7f1bd80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 -- 172.21.15.103:0/3975523453 shutdown_connections 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.871+0000 7f1bdd309640 1 -- 172.21.15.103:0/3975523453 wait complete. 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bdd309640 1 Processor -- start 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bdd309640 1 -- start start 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bdd309640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bd80feaa0 0x7f1bd8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bdd309640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bdd309640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd819aa50 con 0x7f1bd80ffca0 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bdd309640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd819ab90 con 0x7f1bd80feaa0 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:13.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42238/0 (socket says 172.21.15.103:42238) 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd67fc640 1 -- 172.21.15.103:0/2714196427 learned_addr learned my addr 172.21.15.103:0/2714196427 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd67fc640 1 -- 172.21.15.103:0/2714196427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bd80feaa0 msgr2=0x7f1bd8068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd6ffd640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bd80feaa0 0x7f1bd8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd67fc640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bd80feaa0 0x7f1bd8068f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.872+0000 7f1bd67fc640 1 -- 172.21.15.103:0/2714196427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc009560 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.873+0000 7f1bd67fc640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd819a480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc005610 tx=0x7f1bcc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.873+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bcc004ba0 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.873+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd819ade0 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.873+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1bcc004d00 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.873+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bcc003bd0 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.873+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd819b350 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.874+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8107730 con 0x7f1bd80ffca0 2024-09-17T01:04:13.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.874+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1bcc031640 con 0x7f1bd80ffca0 2024-09-17T01:04:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.875+0000 7f1bbffff640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1bc006cc50 0x7f1bc006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.875+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1bcc0ad2a0 con 0x7f1bd80ffca0 2024-09-17T01:04:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.875+0000 7f1bd6ffd640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1bc006cc50 0x7f1bc006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.875+0000 7f1bd6ffd640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1bc006cc50 0x7f1bc006f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ffb00 tx=0x7f1bc8008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:13.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:13.879+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1bcc0779b0 con 0x7f1bd80ffca0 2024-09-17T01:04:13.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:13 smithi103 ceph-mon[28156]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:14.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:13 smithi143 ceph-mon[35452]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:14.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.052+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd819b540 con 0x7f1bc006cc50 2024-09-17T01:04:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.053+0000 7f1bbffff640 1 -- 172.21.15.103:0/2714196427 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f1bd819b540 con 0x7f1bc006cc50 2024-09-17T01:04:14.052 INFO:teuthology.orchestra.run.smithi103.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T01:04:14.052 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-17T01:04:14.052 INFO:teuthology.orchestra.run.smithi103.stdout:smithi143 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330073400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-09-17T01:04:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1bc006cc50 msgr2=0x7f1bc006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1bc006cc50 0x7f1bc006f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ffb00 tx=0x7f1bc8008040 comp rx=0 tx=0).stop 2024-09-17T01:04:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 msgr2=0x7f1bd819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd819a480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc005610 tx=0x7f1bcc005640 comp rx=0 tx=0).stop 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 shutdown_connections 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f1bc006cc50 0x7f1bc006f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd80ffca0 0x7f1bd819a480 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 --2- 172.21.15.103:0/2714196427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bd80feaa0 0x7f1bd8068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 >> 172.21.15.103:0/2714196427 conn(0x7f1bd80fa230 msgr2=0x7f1bd8102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 shutdown_connections 2024-09-17T01:04:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:14.055+0000 7f1bdd309640 1 -- 172.21.15.103:0/2714196427 wait complete. 2024-09-17T01:04:14.691 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:04:14.701 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:14.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-17T01:04:14.902 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:15.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:15 smithi143 ceph-mon[35452]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:15.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:15 smithi143 ceph-mon[35452]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:16.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:15 smithi103 ceph-mon[28156]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:15 smithi103 ceph-mon[28156]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:16.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 -- 172.21.15.103:0/3418041246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 msgr2=0x7fb0440feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:16.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/3418041246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb0440feea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb040009880 tx=0x7fb04002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:16.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 -- 172.21.15.103:0/3418041246 shutdown_connections 2024-09-17T01:04:16.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/3418041246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0440ffca0 0x7fb044100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:16.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/3418041246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb0440feea0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:16.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 -- 172.21.15.103:0/3418041246 >> 172.21.15.103:0/3418041246 conn(0x7fb0440fa230 msgr2=0x7fb0440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:16.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 -- 172.21.15.103:0/3418041246 shutdown_connections 2024-09-17T01:04:16.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.296+0000 7fb04c7ba640 1 -- 172.21.15.103:0/3418041246 wait complete. 2024-09-17T01:04:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04c7ba640 1 Processor -- start 2024-09-17T01:04:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04c7ba640 1 -- start start 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04c7ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb044195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04c7ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0440ffca0 0x7fb044195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04c7ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044196160 con 0x7fb0440feaa0 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04c7ba640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0441962d0 con 0x7fb0440ffca0 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04a556640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb044195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04a556640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb044195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42258/0 (socket says 172.21.15.103:42258) 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04a556640 1 -- 172.21.15.103:0/915066181 learned_addr learned my addr 172.21.15.103:0/915066181 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb049d55640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0440ffca0 0x7fb044195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04a556640 1 -- 172.21.15.103:0/915066181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0440ffca0 msgr2=0x7fb044195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04a556640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0440ffca0 0x7fb044195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.297+0000 7fb04a556640 1 -- 172.21.15.103:0/915066181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009560 con 0x7fb0440feaa0 2024-09-17T01:04:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.298+0000 7fb04a556640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb044195650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb0400054f0 tx=0x7fb040005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.298+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb040004aa0 con 0x7fb0440feaa0 2024-09-17T01:04:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.298+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb040004c00 con 0x7fb0440feaa0 2024-09-17T01:04:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.298+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04419ad10 con 0x7fb0440feaa0 2024-09-17T01:04:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.298+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb040003ac0 con 0x7fb0440feaa0 2024-09-17T01:04:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.298+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04419b230 con 0x7fb0440feaa0 2024-09-17T01:04:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.299+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0441076b0 con 0x7fb0440feaa0 2024-09-17T01:04:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.299+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb040003d30 con 0x7fb0440feaa0 2024-09-17T01:04:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.300+0000 7fb03b7fe640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb03006cc50 0x7fb03006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.300+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb0400acff0 con 0x7fb0440feaa0 2024-09-17T01:04:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.300+0000 7fb049d55640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb03006cc50 0x7fb03006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.300+0000 7fb049d55640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb03006cc50 0x7fb03006f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb044196b70 tx=0x7fb03400b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.304+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb040077830 con 0x7fb0440feaa0 2024-09-17T01:04:16.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:16.487+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb04419b470 con 0x7fb03006cc50 2024-09-17T01:04:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:17 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T01:04:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:17 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T01:04:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.804+0000 7fb03b7fe640 1 -- 172.21.15.103:0/915066181 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb04419b470 con 0x7fb03006cc50 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb03006cc50 msgr2=0x7fb03006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb03006cc50 0x7fb03006f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb044196b70 tx=0x7fb03400b390 comp rx=0 tx=0).stop 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 msgr2=0x7fb044195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb044195650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb0400054f0 tx=0x7fb040005520 comp rx=0 tx=0).stop 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 shutdown_connections 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb03006cc50 0x7fb03006f110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0440ffca0 0x7fb044195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 --2- 172.21.15.103:0/915066181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0440feaa0 0x7fb044195650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 >> 172.21.15.103:0/915066181 conn(0x7fb0440fa230 msgr2=0x7fb0440fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 shutdown_connections 2024-09-17T01:04:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:17.807+0000 7fb04c7ba640 1 -- 172.21.15.103:0/915066181 wait complete. 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:17 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[28152]: 2024-09-17T01:04:17.781+0000 7ff18e586640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T01:04:18.166 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: fsmap cephfs:0 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: Saving service mds.cephfs spec with placement count:4 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:18.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:18.168 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:18.168 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:18 smithi103 ceph-mon[28156]: Deploying daemon mds.cephfs.smithi103.gmmiqj on smithi103 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T01:04:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: fsmap cephfs:0 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: Saving service mds.cephfs spec with placement count:4 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:18.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:18.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:18.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:18 smithi143 ceph-mon[35452]: Deploying daemon mds.cephfs.smithi103.gmmiqj on smithi103 2024-09-17T01:04:18.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:04:19.979 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:20.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:19 smithi143 ceph-mon[35452]: pgmap v171: 65 pgs: 3 creating+peering, 61 unknown, 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:20.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:19 smithi143 ceph-mon[35452]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T01:04:20.159 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:19 smithi103 ceph-mon[28156]: pgmap v171: 65 pgs: 3 creating+peering, 61 unknown, 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:20.159 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:19 smithi103 ceph-mon[28156]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T01:04:21.131 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:20 smithi103 ceph-mon[28156]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:04:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:20 smithi143 ceph-mon[35452]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:04:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 -- 172.21.15.103:0/3814036558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c102ef0 msgr2=0x7f2a3c1052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 --2- 172.21.15.103:0/3814036558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c102ef0 0x7f2a3c1052e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0098b0 tx=0x7f2a2c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 -- 172.21.15.103:0/3814036558 shutdown_connections 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 --2- 172.21.15.103:0/3814036558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c102ef0 0x7f2a3c1052e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 --2- 172.21.15.103:0/3814036558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 -- 172.21.15.103:0/3814036558 >> 172.21.15.103:0/3814036558 conn(0x7f2a3c0fa1c0 msgr2=0x7f2a3c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 -- 172.21.15.103:0/3814036558 shutdown_connections 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.702+0000 7f2a4331e640 1 -- 172.21.15.103:0/3814036558 wait complete. 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a4331e640 1 Processor -- start 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a4331e640 1 -- start start 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a4331e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a4331e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a3c102ef0 0x7f2a3c195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a4331e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c196170 con 0x7f2a3c1005c0 2024-09-17T01:04:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a4331e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1962e0 con 0x7f2a3c102ef0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a410ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a410ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42268/0 (socket says 172.21.15.103:42268) 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a410ba640 1 -- 172.21.15.103:0/486153704 learned_addr learned my addr 172.21.15.103:0/486153704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a408b9640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a3c102ef0 0x7f2a3c195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a410ba640 1 -- 172.21.15.103:0/486153704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a3c102ef0 msgr2=0x7f2a3c195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a410ba640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a3c102ef0 0x7f2a3c195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.703+0000 7f2a410ba640 1 -- 172.21.15.103:0/486153704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009560 con 0x7f2a3c1005c0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.704+0000 7f2a410ba640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c195660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800d720 tx=0x7f2a3800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.704+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a380051f0 con 0x7f2a3c1005c0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.704+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c19ad80 con 0x7f2a3c1005c0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.704+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a38009ce0 con 0x7f2a3c1005c0 2024-09-17T01:04:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.704+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a38010460 con 0x7f2a3c1005c0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.704+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c19b2c0 con 0x7f2a3c1005c0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.705+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c108740 con 0x7f2a3c1005c0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.705+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2a38005350 con 0x7f2a3c1005c0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.706+0000 7f2a327fc640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2a2806cc50 0x7f2a2806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.706+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2a3808beb0 con 0x7f2a3c1005c0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.706+0000 7f2a408b9640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2a2806cc50 0x7f2a2806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.706+0000 7f2a408b9640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2a2806cc50 0x7f2a2806f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.710+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2a380561e0 con 0x7f2a3c1005c0 2024-09-17T01:04:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.911+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a3c19b7a0 con 0x7f2a3c1005c0 2024-09-17T01:04:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.911+0000 7f2a327fc640 1 -- 172.21.15.103:0/486153704 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1114 (secure 0 0 0) 0x7f2a38020470 con 0x7f2a3c1005c0 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:e2 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 2 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:04:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:17.783066+0000 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:in 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:up {} 2024-09-17T01:04:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 0 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:21.912 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:21.913 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-09-17T01:04:21.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2a2806cc50 msgr2=0x7f2a2806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:21.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2a2806cc50 0x7f2a2806f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 msgr2=0x7f2a3c195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c195660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800d720 tx=0x7f2a3800dbe0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 shutdown_connections 2024-09-17T01:04:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2a2806cc50 0x7f2a2806f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a3c102ef0 0x7f2a3c195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 --2- 172.21.15.103:0/486153704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a3c1005c0 0x7f2a3c195660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 >> 172.21.15.103:0/486153704 conn(0x7f2a3c0fa1c0 msgr2=0x7f2a3c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 shutdown_connections 2024-09-17T01:04:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:21.913+0000 7f2a4331e640 1 -- 172.21.15.103:0/486153704 wait complete. 2024-09-17T01:04:22.000 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:21 smithi103 ceph-mon[28156]: pgmap v174: 65 pgs: 3 creating+peering, 40 unknown, 22 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:22.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:21 smithi143 ceph-mon[35452]: pgmap v174: 65 pgs: 3 creating+peering, 40 unknown, 22 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:22.896 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/486153704' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:04:22.896 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:22.896 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:22.897 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:22.897 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:22.897 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:22.897 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:22 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:22.916 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:04:22.929 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:22.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-17T01:04:23.119 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/486153704' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:04:23.119 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:23.119 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:23.119 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:23.119 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:23.119 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:23.120 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:22 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:23.133 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:24.111 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: Deploying daemon mds.cephfs.smithi143.zkrwqj on smithi143 2024-09-17T01:04:24.111 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:24.111 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] up:boot 2024-09-17T01:04:24.111 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: daemon mds.cephfs.smithi103.gmmiqj assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: Cluster is now healthy 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: fsmap cephfs:0 1 up:standby 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:creating} 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: daemon mds.cephfs.smithi103.gmmiqj is now active in filesystem cephfs as rank 0 2024-09-17T01:04:24.112 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: Deploying daemon mds.cephfs.smithi143.zkrwqj on smithi143 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] up:boot 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: daemon mds.cephfs.smithi103.gmmiqj assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:04:24.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: Cluster is now healthy 2024-09-17T01:04:24.128 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: fsmap cephfs:0 1 up:standby 2024-09-17T01:04:24.128 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:04:24.128 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:creating} 2024-09-17T01:04:24.128 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: daemon mds.cephfs.smithi103.gmmiqj is now active in filesystem cephfs as rank 0 2024-09-17T01:04:24.128 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.791+0000 7f6081d76640 1 -- 172.21.15.103:0/2499043807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c103020 msgr2=0x7f607c105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.791+0000 7f6081d76640 1 --2- 172.21.15.103:0/2499043807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c103020 0x7f607c105410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6070009880 tx=0x7f607002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.791+0000 7f6081d76640 1 -- 172.21.15.103:0/2499043807 shutdown_connections 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.791+0000 7f6081d76640 1 --2- 172.21.15.103:0/2499043807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c103020 0x7f607c105410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.791+0000 7f6081d76640 1 --2- 172.21.15.103:0/2499043807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c1006f0 0x7f607c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.792+0000 7f6081d76640 1 -- 172.21.15.103:0/2499043807 >> 172.21.15.103:0/2499043807 conn(0x7f607c0fa230 msgr2=0x7f607c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.792+0000 7f6081d76640 1 -- 172.21.15.103:0/2499043807 shutdown_connections 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.792+0000 7f6081d76640 1 -- 172.21.15.103:0/2499043807 wait complete. 2024-09-17T01:04:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.792+0000 7f6081d76640 1 Processor -- start 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.792+0000 7f6081d76640 1 -- start start 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6081d76640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 0x7f607c195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6081d76640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c103020 0x7f607c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6081d76640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c196130 con 0x7f607c1006f0 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6081d76640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1962a0 con 0x7f607c103020 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 0x7f607c195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 0x7f607c195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53292/0 (socket says 172.21.15.103:53292) 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 -- 172.21.15.103:0/1505217401 learned_addr learned my addr 172.21.15.103:0/1505217401 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607affd640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c103020 0x7f607c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 -- 172.21.15.103:0/1505217401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c103020 msgr2=0x7f607c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c103020 0x7f607c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 -- 172.21.15.103:0/1505217401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009560 con 0x7f607c1006f0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607affd640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c103020 0x7f607c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f607b7fe640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 0x7f607c195620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f606c00ea60 tx=0x7f606c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606c00cdb0 con 0x7f607c1006f0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f606c011930 con 0x7f607c1006f0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c19ad40 con 0x7f607c1006f0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606c01aa30 con 0x7f607c1006f0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.793+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c19b280 con 0x7f607c1006f0 2024-09-17T01:04:24.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.794+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c108790 con 0x7f607c1006f0 2024-09-17T01:04:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.795+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f606c01aca0 con 0x7f607c1006f0 2024-09-17T01:04:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.795+0000 7f6078ff9640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f606406cc60 0x7f606406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.795+0000 7f607affd640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f606406cc60 0x7f606406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.796+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f606c08c9c0 con 0x7f607c1006f0 2024-09-17T01:04:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.796+0000 7f607affd640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f606406cc60 0x7f606406f120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6070000c00 tx=0x7f60700314a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:24.800+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f606c056d90 con 0x7f607c1006f0 2024-09-17T01:04:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.008+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f607c19b4a0 con 0x7f607c1006f0 2024-09-17T01:04:25.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:24 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] up:active 2024-09-17T01:04:25.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:24 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 2024-09-17T01:04:25.202 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:24 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] up:active 2024-09-17T01:04:25.202 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:24 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 2024-09-17T01:04:25.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.863+0000 7f6078ff9640 1 -- 172.21.15.103:0/1505217401 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f606c05a3b0 con 0x7f607c1006f0 2024-09-17T01:04:25.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f606406cc60 msgr2=0x7f606406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:25.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f606406cc60 0x7f606406f120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6070000c00 tx=0x7f60700314a0 comp rx=0 tx=0).stop 2024-09-17T01:04:25.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 msgr2=0x7f607c195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:25.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 0x7f607c195620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f606c00ea60 tx=0x7f606c00ef20 comp rx=0 tx=0).stop 2024-09-17T01:04:25.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 shutdown_connections 2024-09-17T01:04:25.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f606406cc60 0x7f606406f120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:25.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f607c103020 0x7f607c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:25.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 --2- 172.21.15.103:0/1505217401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c1006f0 0x7f607c195620 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:25.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 >> 172.21.15.103:0/1505217401 conn(0x7f607c0fa230 msgr2=0x7f607c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:25.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 shutdown_connections 2024-09-17T01:04:25.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:25.865+0000 7f6081d76640 1 -- 172.21.15.103:0/1505217401 wait complete. 2024-09-17T01:04:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 300 B/s wr, 0 op/s 2024-09-17T01:04:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:boot 2024-09-17T01:04:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby 2024-09-17T01:04:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:04:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: Deploying daemon mds.cephfs.smithi103.rnhmlw on smithi103 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:25 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1505217401' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T01:04:26.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 300 B/s wr, 0 op/s 2024-09-17T01:04:26.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:boot 2024-09-17T01:04:26.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: Deploying daemon mds.cephfs.smithi103.rnhmlw on smithi103 2024-09-17T01:04:26.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:25 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1505217401' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T01:04:26.999 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:04:27.078 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:27.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-17T01:04:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:26 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1505217401' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T01:04:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:26 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby 2024-09-17T01:04:27.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:26 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1505217401' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T01:04:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:26 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby 2024-09-17T01:04:27.595 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:28.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 383 B/s wr, 2 op/s 2024-09-17T01:04:28.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:28.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:28.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:28.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:28.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:28.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:27 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 383 B/s wr, 2 op/s 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:04:28.128 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:27 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:29.044 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:28 smithi103 ceph-mon[28156]: Deploying daemon mds.cephfs.smithi143.uraktq on smithi143 2024-09-17T01:04:29.044 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:28 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] up:boot 2024-09-17T01:04:29.044 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:28 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 2 up:standby 2024-09-17T01:04:29.045 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:28 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:04:29.045 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:28 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:29.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:28 smithi143 ceph-mon[35452]: Deploying daemon mds.cephfs.smithi143.uraktq on smithi143 2024-09-17T01:04:29.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:28 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] up:boot 2024-09-17T01:04:29.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:28 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 2 up:standby 2024-09-17T01:04:29.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:28 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:04:29.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:28 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.264+0000 7fc40a85f640 1 -- 172.21.15.103:0/3072379224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 msgr2=0x7fc4040fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.264+0000 7fc40a85f640 1 --2- 172.21.15.103:0/3072379224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc4040fff50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009880 tx=0x7fc3f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.264+0000 7fc40a85f640 1 -- 172.21.15.103:0/3072379224 shutdown_connections 2024-09-17T01:04:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.264+0000 7fc40a85f640 1 --2- 172.21.15.103:0/3072379224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc404100d50 0x7fc4041011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.264+0000 7fc40a85f640 1 --2- 172.21.15.103:0/3072379224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc4040fff50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.264+0000 7fc40a85f640 1 -- 172.21.15.103:0/3072379224 >> 172.21.15.103:0/3072379224 conn(0x7fc4040fb320 msgr2=0x7fc4040fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.265+0000 7fc40a85f640 1 -- 172.21.15.103:0/3072379224 shutdown_connections 2024-09-17T01:04:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.265+0000 7fc40a85f640 1 -- 172.21.15.103:0/3072379224 wait complete. 2024-09-17T01:04:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.265+0000 7fc40a85f640 1 Processor -- start 2024-09-17T01:04:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.265+0000 7fc40a85f640 1 -- start start 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc40a85f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc404195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc40a85f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc404100d50 0x7fc404195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc40a85f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404196120 con 0x7fc4040ffb50 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc40a85f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404196290 con 0x7fc404100d50 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc404195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc404195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53332/0 (socket says 172.21.15.103:53332) 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 -- 172.21.15.103:0/2505273555 learned_addr learned my addr 172.21.15.103:0/2505273555 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc4037fe640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc404100d50 0x7fc404195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 -- 172.21.15.103:0/2505273555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc404100d50 msgr2=0x7fc404195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc404100d50 0x7fc404195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 -- 172.21.15.103:0/2505273555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4009560 con 0x7fc4040ffb50 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.266+0000 7fc403fff640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc404195610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40054f0 tx=0x7fc3f4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.267+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f4004aa0 con 0x7fc4040ffb50 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.267+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40419acd0 con 0x7fc4040ffb50 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.267+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3f4004c00 con 0x7fc4040ffb50 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.267+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40419b1c0 con 0x7fc4040ffb50 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.267+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f4003ab0 con 0x7fc4040ffb50 2024-09-17T01:04:29.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.268+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc404108760 con 0x7fc4040ffb50 2024-09-17T01:04:29.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.269+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc3f4031c70 con 0x7fc4040ffb50 2024-09-17T01:04:29.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.269+0000 7fc4017fa640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc3ec06cc50 0x7fc3ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:29.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.269+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc3f40ad3c0 con 0x7fc4040ffb50 2024-09-17T01:04:29.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.269+0000 7fc4037fe640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc3ec06cc50 0x7fc3ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:29.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.270+0000 7fc4037fe640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc3ec06cc50 0x7fc3ec06f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc404196b30 tx=0x7fc3f800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:29.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.278+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3f4077840 con 0x7fc4040ffb50 2024-09-17T01:04:29.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.485+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc40419b430 con 0x7fc4040ffb50 2024-09-17T01:04:29.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.884+0000 7fc4017fa640 1 -- 172.21.15.103:0/2505273555 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc3f407ae60 con 0x7fc4040ffb50 2024-09-17T01:04:29.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.886+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc3ec06cc50 msgr2=0x7fc3ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.886+0000 7fc40a85f640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc3ec06cc50 0x7fc3ec06f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc404196b30 tx=0x7fc3f800b390 comp rx=0 tx=0).stop 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.886+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 msgr2=0x7fc404195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.886+0000 7fc40a85f640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc404195610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40054f0 tx=0x7fc3f4005520 comp rx=0 tx=0).stop 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 shutdown_connections 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc3ec06cc50 0x7fc3ec06f110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc404100d50 0x7fc404195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 --2- 172.21.15.103:0/2505273555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4040ffb50 0x7fc404195610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 >> 172.21.15.103:0/2505273555 conn(0x7fc4040fb320 msgr2=0x7fc404103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 shutdown_connections 2024-09-17T01:04:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:29.887+0000 7fc40a85f640 1 -- 172.21.15.103:0/2505273555 wait complete. 2024-09-17T01:04:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:29 smithi103 ceph-mon[28156]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-17T01:04:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:29 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2505273555' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T01:04:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:29 smithi143 ceph-mon[35452]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-17T01:04:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:29 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2505273555' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T01:04:30.668 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:04:30.679 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:30.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2505273555' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.143:6826/839770607,v1:172.21.15.143:6827/839770607] up:boot 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 3 up:standby 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:30.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:30.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:30 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2505273555' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.143:6826/839770607,v1:172.21.15.143:6827/839770607] up:boot 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 3 up:standby 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:30 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:31.622 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:32.071 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:31 smithi103 ceph-mon[28156]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-17T01:04:32.071 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:31 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] up:active 2024-09-17T01:04:32.072 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:31 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:31 smithi143 ceph-mon[35452]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-17T01:04:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:31 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] up:active 2024-09-17T01:04:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:31 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:32 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] up:standby 2024-09-17T01:04:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:32 smithi103 ceph-mon[28156]: Dropping low affinity standby-replay daemon mds.cephfs.smithi143.uraktq in favor of higher affinity standby. 2024-09-17T01:04:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:32 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:32 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T01:04:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:32 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:32 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:32 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] up:standby 2024-09-17T01:04:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:32 smithi143 ceph-mon[35452]: Dropping low affinity standby-replay daemon mds.cephfs.smithi143.uraktq in favor of higher affinity standby. 2024-09-17T01:04:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:32 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:32 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T01:04:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:32 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:32 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:34.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.037+0000 7f5c63340640 1 -- 172.21.15.103:0/353043791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 msgr2=0x7f5c5c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:34.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.037+0000 7f5c63340640 1 --2- 172.21.15.103:0/353043791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c101210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009880 tx=0x7f5c4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- 172.21.15.103:0/353043791 shutdown_connections 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 --2- 172.21.15.103:0/353043791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c101210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 --2- 172.21.15.103:0/353043791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 0x7f5c5c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- 172.21.15.103:0/353043791 >> 172.21.15.103:0/353043791 conn(0x7f5c5c0fb320 msgr2=0x7f5c5c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- 172.21.15.103:0/353043791 shutdown_connections 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- 172.21.15.103:0/353043791 wait complete. 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 Processor -- start 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- start start 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 0x7f5c5c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c1983a0 con 0x7f5c5c100d90 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c63340640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c198510 con 0x7f5c5c0ffb90 2024-09-17T01:04:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c608db640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c608db640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37416/0 (socket says 172.21.15.103:37416) 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.038+0000 7f5c608db640 1 -- 172.21.15.103:0/2138630914 learned_addr learned my addr 172.21.15.103:0/2138630914 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c610dc640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 0x7f5c5c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c608db640 1 -- 172.21.15.103:0/2138630914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 msgr2=0x7f5c5c197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c608db640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 0x7f5c5c197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c608db640 1 -- 172.21.15.103:0/2138630914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c009560 con 0x7f5c5c100d90 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c610dc640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 0x7f5c5c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c608db640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c197dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c005640 tx=0x7f5c4c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4c004ba0 con 0x7f5c5c100d90 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c19cf00 con 0x7f5c5c100d90 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c4c004d00 con 0x7f5c5c100d90 2024-09-17T01:04:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4c003c30 con 0x7f5c5c100d90 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.039+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c19d440 con 0x7f5c5c100d90 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.040+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c0fff90 con 0x7f5c5c100d90 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.041+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5c4c031640 con 0x7f5c5c100d90 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.041+0000 7f5c527fc640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5c4806cc50 0x7f5c4806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.041+0000 7f5c610dc640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5c4806cc50 0x7f5c4806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.041+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5c4c0ad4f0 con 0x7f5c5c100d90 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.042+0000 7f5c610dc640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5c4806cc50 0x7f5c4806f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c100bf0 tx=0x7f5c58005d30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.046+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5c4c0778c0 con 0x7f5c5c100d90 2024-09-17T01:04:34.218 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:33 smithi103 ceph-mon[28156]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-17T01:04:34.219 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:33 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:boot 2024-09-17T01:04:34.219 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:33 smithi103 ceph-mon[28156]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:standby 2024-09-17T01:04:34.219 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:33 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:34.219 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:33 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:04:34.219 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:33 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:34.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.252+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f5c5c1056d0 con 0x7f5c5c100d90 2024-09-17T01:04:34.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:33 smithi143 ceph-mon[35452]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-17T01:04:34.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:33 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:boot 2024-09-17T01:04:34.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:33 smithi143 ceph-mon[35452]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:standby 2024-09-17T01:04:34.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:33 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:34.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:33 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:04:34.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:33 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.953+0000 7f5c527fc640 1 -- 172.21.15.103:0/2138630914 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v16) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5c4c07aee0 con 0x7f5c5c100d90 2024-09-17T01:04:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:inline data disabled 2024-09-17T01:04:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5c4806cc50 msgr2=0x7f5c4806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5c4806cc50 0x7f5c4806f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c100bf0 tx=0x7f5c58005d30 comp rx=0 tx=0).stop 2024-09-17T01:04:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 msgr2=0x7f5c5c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c197dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c005640 tx=0x7f5c4c005670 comp rx=0 tx=0).stop 2024-09-17T01:04:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 shutdown_connections 2024-09-17T01:04:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f5c4806cc50 0x7f5c4806f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c5c100d90 0x7f5c5c197dd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 --2- 172.21.15.103:0/2138630914 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5c5c0ffb90 0x7f5c5c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 >> 172.21.15.103:0/2138630914 conn(0x7f5c5c0fb320 msgr2=0x7f5c5c072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 shutdown_connections 2024-09-17T01:04:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:34.955+0000 7f5c63340640 1 -- 172.21.15.103:0/2138630914 wait complete. 2024-09-17T01:04:35.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:34 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2138630914' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-17T01:04:35.283 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:34 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2138630914' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-17T01:04:35.603 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:04:35.613 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:35.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:04:35.900 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:35 smithi143 ceph-mon[35452]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-17T01:04:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:35 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2138630914' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-17T01:04:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:35 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:36.323 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:35 smithi103 ceph-mon[28156]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-17T01:04:36.323 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:35 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2138630914' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-17T01:04:36.323 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:35 smithi103 ceph-mon[28156]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:04:37.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 -- 172.21.15.103:0/1969590020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8848100d70 msgr2=0x7f88481011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:37.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 --2- 172.21.15.103:0/1969590020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8848100d70 0x7f88481011f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8830009880 tx=0x7f883002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:37.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 -- 172.21.15.103:0/1969590020 shutdown_connections 2024-09-17T01:04:37.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 --2- 172.21.15.103:0/1969590020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8848100d70 0x7f88481011f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:37.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 --2- 172.21.15.103:0/1969590020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88480ffb70 0x7f88480fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:37.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 -- 172.21.15.103:0/1969590020 >> 172.21.15.103:0/1969590020 conn(0x7f88480fb2e0 msgr2=0x7f88480fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:37.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 -- 172.21.15.103:0/1969590020 shutdown_connections 2024-09-17T01:04:37.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 -- 172.21.15.103:0/1969590020 wait complete. 2024-09-17T01:04:37.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.975+0000 7f884c8e1640 1 Processor -- start 2024-09-17T01:04:37.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884c8e1640 1 -- start start 2024-09-17T01:04:37.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884c8e1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 0x7f8848195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:37.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884c8e1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8848100d70 0x7f8848195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:37.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884c8e1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848196130 con 0x7f88480ffb70 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884c8e1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481962a0 con 0x7f8848100d70 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 0x7f8848195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 0x7f8848195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37424/0 (socket says 172.21.15.103:37424) 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 -- 172.21.15.103:0/2931282295 learned_addr learned my addr 172.21.15.103:0/2931282295 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 -- 172.21.15.103:0/2931282295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8848100d70 msgr2=0x7f8848195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f883dd9b640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8848100d70 0x7f8848195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8848100d70 0x7f8848195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 -- 172.21.15.103:0/2931282295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009560 con 0x7f88480ffb70 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.976+0000 7f884659c640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 0x7f8848195620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f883800d900 tx=0x7f883800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.977+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838009c00 con 0x7f88480ffb70 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.977+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884819ad40 con 0x7f88480ffb70 2024-09-17T01:04:37.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.977+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8838009d60 con 0x7f88480ffb70 2024-09-17T01:04:37.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.977+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f883800f660 con 0x7f88480ffb70 2024-09-17T01:04:37.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.977+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884819b2b0 con 0x7f88480ffb70 2024-09-17T01:04:37.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.978+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884818f710 con 0x7f88480ffb70 2024-09-17T01:04:37.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.978+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f883800f8d0 con 0x7f88480ffb70 2024-09-17T01:04:37.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.979+0000 7f883ffff640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f883406cc50 0x7f883406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:37.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.979+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f883808c1a0 con 0x7f88480ffb70 2024-09-17T01:04:37.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.979+0000 7f883dd9b640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f883406cc50 0x7f883406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:37.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.979+0000 7f883dd9b640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f883406cc50 0x7f883406f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8830031540 tx=0x7f8830000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:37.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:37.983+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8838056730 con 0x7f88480ffb70 2024-09-17T01:04:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.198+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f884802c480 con 0x7f88480ffb70 2024-09-17T01:04:38.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.198+0000 7f883ffff640 1 -- 172.21.15.103:0/2931282295 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7f8838059d50 con 0x7f88480ffb70 2024-09-17T01:04:38.197 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:04:38.197 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:04:38.197 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:04:38.197 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:04:38.197 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:04:38.198 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:04:38.199 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:04:38.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f883406cc50 msgr2=0x7f883406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:38.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f883406cc50 0x7f883406f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8830031540 tx=0x7f8830000bc0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 msgr2=0x7f8848195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:38.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 0x7f8848195620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f883800d900 tx=0x7f883800ddc0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 shutdown_connections 2024-09-17T01:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f883406cc50 0x7f883406f110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8848100d70 0x7f8848195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 --2- 172.21.15.103:0/2931282295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88480ffb70 0x7f8848195620 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.200+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 >> 172.21.15.103:0/2931282295 conn(0x7f88480fb2e0 msgr2=0x7f88481044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.201+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 shutdown_connections 2024-09-17T01:04:38.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:38.201+0000 7f884c8e1640 1 -- 172.21.15.103:0/2931282295 wait complete. 2024-09-17T01:04:38.208 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:37 smithi103 ceph-mon[28156]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:04:38.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:37 smithi143 ceph-mon[35452]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:04:38.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2931282295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:39.282 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:39.283 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:39 smithi103 ceph-mon[28156]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-17T01:04:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2931282295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:39 smithi143 ceph-mon[35452]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-17T01:04:39.831 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:41.534 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:41 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:41.534 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:41 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:41.534 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:41 smithi103 ceph-mon[28156]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T01:04:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 -- 172.21.15.103:0/1510967762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480ffca0 msgr2=0x7f1748100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 --2- 172.21.15.103:0/1510967762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480ffca0 0x7f1748100120 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1738009880 tx=0x7f173802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 -- 172.21.15.103:0/1510967762 shutdown_connections 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 --2- 172.21.15.103:0/1510967762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480ffca0 0x7f1748100120 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 --2- 172.21.15.103:0/1510967762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17480feaa0 0x7f17480feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 -- 172.21.15.103:0/1510967762 >> 172.21.15.103:0/1510967762 conn(0x7f17480fa230 msgr2=0x7f17480fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 -- 172.21.15.103:0/1510967762 shutdown_connections 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.702+0000 7f174f41d640 1 -- 172.21.15.103:0/1510967762 wait complete. 2024-09-17T01:04:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174f41d640 1 Processor -- start 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174f41d640 1 -- start start 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174f41d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 0x7f1748068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174f41d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17480ffca0 0x7f174819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174f41d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748196180 con 0x7f17480feaa0 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174f41d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174819cce0 con 0x7f17480ffca0 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 0x7f1748068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 0x7f1748068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37436/0 (socket says 172.21.15.103:37436) 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 -- 172.21.15.103:0/736760906 learned_addr learned my addr 172.21.15.103:0/736760906 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 -- 172.21.15.103:0/736760906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17480ffca0 msgr2=0x7f174819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17480ffca0 0x7f174819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 -- 172.21.15.103:0/736760906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738009560 con 0x7f17480feaa0 2024-09-17T01:04:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.703+0000 7f174d1b9640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 0x7f1748068f10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f174400d900 tx=0x7f174400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.704+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1744009c00 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.704+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1744009d60 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.704+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174819cf40 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.704+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f174400f660 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.704+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174819d4e0 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.705+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480feea0 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.705+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1744010460 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.706+0000 7f173e7fc640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f173406cc50 0x7f173406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.706+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f174408c1b0 con 0x7f17480feaa0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.706+0000 7f174c9b8640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f173406cc50 0x7f173406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.706+0000 7f174c9b8640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f173406cc50 0x7f173406f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f173802a9c0 tx=0x7f1738000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:41.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.710+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f17440564f0 con 0x7f17480feaa0 2024-09-17T01:04:41.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:41 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:41.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:41 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:41.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:41 smithi143 ceph-mon[35452]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-17T01:04:41.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.913+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f174818e640 con 0x7f17480feaa0 2024-09-17T01:04:41.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.914+0000 7f173e7fc640 1 -- 172.21.15.103:0/736760906 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4840 (secure 0 0 0) 0x7f1744059b10 con 0x7f17480feaa0 2024-09-17T01:04:41.912 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:04:41.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f173406cc50 msgr2=0x7f173406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f173406cc50 0x7f173406f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f173802a9c0 tx=0x7f1738000bc0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 msgr2=0x7f1748068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 0x7f1748068f10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f174400d900 tx=0x7f174400ddc0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 shutdown_connections 2024-09-17T01:04:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f173406cc50 0x7f173406f110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17480ffca0 0x7f174819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 --2- 172.21.15.103:0/736760906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17480feaa0 0x7f1748068f10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 >> 172.21.15.103:0/736760906 conn(0x7f17480fa230 msgr2=0x7f1748103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 shutdown_connections 2024-09-17T01:04:41.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:41.916+0000 7f174f41d640 1 -- 172.21.15.103:0/736760906 wait complete. 2024-09-17T01:04:41.923 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:04:42.593 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:42 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/736760906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:04:42.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-17T01:04:42.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:42 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/736760906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:04:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:43.565 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:43 smithi103 ceph-mon[28156]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-17T01:04:43.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:43 smithi143 ceph-mon[35452]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-17T01:04:45.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:45 smithi143 ceph-mon[35452]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:04:45.812 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:45 smithi103 ceph-mon[28156]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:04:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 -- 172.21.15.103:0/1581899782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00feaa0 msgr2=0x7f88b00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 --2- 172.21.15.103:0/1581899782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00feaa0 0x7f88b00feea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009880 tx=0x7f88a002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 -- 172.21.15.103:0/1581899782 shutdown_connections 2024-09-17T01:04:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 --2- 172.21.15.103:0/1581899782 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88b00ffca0 0x7f88b0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 --2- 172.21.15.103:0/1581899782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00feaa0 0x7f88b00feea0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 -- 172.21.15.103:0/1581899782 >> 172.21.15.103:0/1581899782 conn(0x7f88b00fa230 msgr2=0x7f88b00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 -- 172.21.15.103:0/1581899782 shutdown_connections 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 -- 172.21.15.103:0/1581899782 wait complete. 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.186+0000 7f88b5941640 1 Processor -- start 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88b5941640 1 -- start start 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88b5941640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88b00feaa0 0x7f88b0194580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88b5941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 0x7f88b0194ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88b5941640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0195090 con 0x7f88b00ffca0 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88b5941640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0195200 con 0x7f88b00feaa0 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 0x7f88b0194ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 0x7f88b0194ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35338/0 (socket says 172.21.15.103:35338) 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 -- 172.21.15.103:0/259310847 learned_addr learned my addr 172.21.15.103:0/259310847 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88aeffd640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88b00feaa0 0x7f88b0194580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 -- 172.21.15.103:0/259310847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88b00feaa0 msgr2=0x7f88b0194580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88b00feaa0 0x7f88b0194580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 -- 172.21.15.103:0/259310847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0009560 con 0x7f88b00ffca0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.187+0000 7f88ae7fc640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 0x7f88b0194ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f88a400d720 tx=0x7f88a400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.188+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a40051f0 con 0x7f88b00ffca0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.188+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b0199c50 con 0x7f88b00ffca0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.188+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88a4009ce0 con 0x7f88b00ffca0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.188+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a4010460 con 0x7f88b00ffca0 2024-09-17T01:04:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.188+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b019a220 con 0x7f88b00ffca0 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.189+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b018e640 con 0x7f88b00ffca0 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.189+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f88a4005350 con 0x7f88b00ffca0 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.190+0000 7f88b493f640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f889806cc50 0x7f889806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.190+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f88a408bd10 con 0x7f88b00ffca0 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.190+0000 7f88aeffd640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f889806cc50 0x7f889806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.190+0000 7f88aeffd640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f889806cc50 0x7f889806f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009230 tx=0x7f88a00314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.194+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f88a4056190 con 0x7f88b00ffca0 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.480+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f88b01076b0 con 0x7f88b00ffca0 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.480+0000 7f88b493f640 1 -- 172.21.15.103:0/259310847 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+97 (secure 0 0 0) 0x7f88a4020090 con 0x7f88b00ffca0 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.482+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f889806cc50 msgr2=0x7f889806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.482+0000 7f88b5941640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f889806cc50 0x7f889806f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009230 tx=0x7f88a00314e0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.482+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 msgr2=0x7f88b0194ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.482+0000 7f88b5941640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 0x7f88b0194ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f88a400d720 tx=0x7f88a400dbe0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.482+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 shutdown_connections 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.482+0000 7f88b5941640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f889806cc50 0x7f889806f110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.483+0000 7f88b5941640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ffca0 0x7f88b0194ac0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.483+0000 7f88b5941640 1 --2- 172.21.15.103:0/259310847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88b00feaa0 0x7f88b0194580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:46.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.483+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 >> 172.21.15.103:0/259310847 conn(0x7f88b00fa230 msgr2=0x7f88b01033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:46.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.483+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 shutdown_connections 2024-09-17T01:04:46.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:46.483+0000 7f88b5941640 1 -- 172.21.15.103:0/259310847 wait complete. 2024-09-17T01:04:46.491 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:04:47.074 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-17T01:04:47.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T01:04:47.287 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:47.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:47.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:47.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:47.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:47.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/259310847' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T01:04:47.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:47 smithi103 ceph-mon[28156]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-17T01:04:47.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:47.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:47.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:47.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:04:47.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/259310847' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T01:04:47.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:47 smithi143 ceph-mon[35452]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.795+0000 7fc219399640 1 -- 172.21.15.103:0/560963119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 msgr2=0x7fc2140fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.795+0000 7fc219399640 1 --2- 172.21.15.103:0/560963119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc2140fff60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc208009880 tx=0x7fc20802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.795+0000 7fc219399640 1 -- 172.21.15.103:0/560963119 shutdown_connections 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 --2- 172.21.15.103:0/560963119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc2140fff60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 --2- 172.21.15.103:0/560963119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc214105b90 0x7fc214105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 -- 172.21.15.103:0/560963119 >> 172.21.15.103:0/560963119 conn(0x7fc2140fb840 msgr2=0x7fc2140fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 -- 172.21.15.103:0/560963119 shutdown_connections 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 -- 172.21.15.103:0/560963119 wait complete. 2024-09-17T01:04:48.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 Processor -- start 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.796+0000 7fc219399640 1 -- start start 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc219399640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc21419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc219399640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc214105b90 0x7fc21419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc219399640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21419c3e0 con 0x7fc2140ffb00 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc219399640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc214195970 con 0x7fc214105b90 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc21419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc21419b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35362/0 (socket says 172.21.15.103:35362) 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 -- 172.21.15.103:0/3635799886 learned_addr learned my addr 172.21.15.103:0/3635799886 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc2127fc640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc214105b90 0x7fc21419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 -- 172.21.15.103:0/3635799886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc214105b90 msgr2=0x7fc21419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc214105b90 0x7fc21419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 -- 172.21.15.103:0/3635799886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208009560 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc212ffd640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc21419b880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc20400ea00 tx=0x7fc20400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20400cd50 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc204005020 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc214195c50 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2040116a0 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.797+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc214196170 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.798+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc214101200 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.799+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc204005190 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.799+0000 7fc1fbfff640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc1fc06cc50 0x7fc1fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.799+0000 7fc2127fc640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc1fc06cc50 0x7fc1fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.799+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc20408c5f0 con 0x7fc2140ffb00 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.800+0000 7fc2127fc640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc1fc06cc50 0x7fc1fc06f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc208000c00 tx=0x7fc208005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:48.803+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2040569c0 con 0x7fc2140ffb00 2024-09-17T01:04:48.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.000+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2140fff60 con 0x7fc2140ffb00 2024-09-17T01:04:48.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.000+0000 7fc1fbfff640 1 -- 172.21.15.103:0/3635799886 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4840 (secure 0 0 0) 0x7fc204059fe0 con 0x7fc2140ffb00 2024-09-17T01:04:49.000 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:04:49.000 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:04:34.945692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14468":{"gid":14468,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6827/305377133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":305377133},{"type":"v1","addr":"172.21.15.103:6827","nonce":305377133}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14480":{"gid":14480,"name":"cephfs.smithi103.rnhmlw","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.103:6829/1908466108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1908466108},{"type":"v1","addr":"172.21.15.103:6829","nonce":1908466108}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T01:04:49.000 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:04:49.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc1fc06cc50 msgr2=0x7fc1fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:49.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc1fc06cc50 0x7fc1fc06f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc208000c00 tx=0x7fc208005a20 comp rx=0 tx=0).stop 2024-09-17T01:04:49.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 msgr2=0x7fc21419b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc21419b880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc20400ea00 tx=0x7fc20400eec0 comp rx=0 tx=0).stop 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 shutdown_connections 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc1fc06cc50 0x7fc1fc06f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc214105b90 0x7fc21419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 --2- 172.21.15.103:0/3635799886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2140ffb00 0x7fc21419b880 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.002+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 >> 172.21.15.103:0/3635799886 conn(0x7fc2140fb840 msgr2=0x7fc2140fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.003+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 shutdown_connections 2024-09-17T01:04:49.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:49.003+0000 7fc219399640 1 -- 172.21.15.103:0/3635799886 wait complete. 2024-09-17T01:04:49.623 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-17T01:04:49.624 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T01:04:49.650 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T01:04:49.651 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-17T01:04:49.651 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T01:04:49.651 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:04:49.651 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:49.651 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-17T01:04:49.651 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:04:49.651 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:49.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:49.651 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-17T01:04:49.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:49.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-17T01:04:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-17T01:04:49.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:04:49.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:49.739 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-09-17T01:04:49.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:49.759 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-09-17T01:04:49.833 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-09-17T01:04:49.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:04:49.835 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T01:04:49.835 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:04:49.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T01:04:49.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:49 smithi103 ceph-mon[28156]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:04:49.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:49 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3635799886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:04:50.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:49 smithi143 ceph-mon[35452]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:04:50.063 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:49 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3635799886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:04:50.064 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:51.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 -- 172.21.15.103:0/146682358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680ffb40 msgr2=0x7fba680fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:51.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 --2- 172.21.15.103:0/146682358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680ffb40 0x7fba680fffa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba50009880 tx=0x7fba5002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 -- 172.21.15.103:0/146682358 shutdown_connections 2024-09-17T01:04:51.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 --2- 172.21.15.103:0/146682358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680ffb40 0x7fba680fffa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 --2- 172.21.15.103:0/146682358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba68105bf0 0x7fba68105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 -- 172.21.15.103:0/146682358 >> 172.21.15.103:0/146682358 conn(0x7fba680fb840 msgr2=0x7fba680fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:51.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 -- 172.21.15.103:0/146682358 shutdown_connections 2024-09-17T01:04:51.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.589+0000 7fba6cc03640 1 -- 172.21.15.103:0/146682358 wait complete. 2024-09-17T01:04:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6cc03640 1 Processor -- start 2024-09-17T01:04:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6cc03640 1 -- start start 2024-09-17T01:04:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6cc03640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba680ffb40 0x7fba6819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6cc03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 0x7fba6819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6cc03640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6819c2e0 con 0x7fba68105bf0 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6cc03640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68195870 con 0x7fba680ffb40 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 0x7fba6819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 0x7fba6819bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35386/0 (socket says 172.21.15.103:35386) 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba65d9b640 1 -- 172.21.15.103:0/1762791993 learned_addr learned my addr 172.21.15.103:0/1762791993 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6659c640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba680ffb40 0x7fba6819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba65d9b640 1 -- 172.21.15.103:0/1762791993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba680ffb40 msgr2=0x7fba6819b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba65d9b640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba680ffb40 0x7fba6819b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba65d9b640 1 -- 172.21.15.103:0/1762791993 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009560 con 0x7fba68105bf0 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.590+0000 7fba6659c640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba680ffb40 0x7fba6819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.591+0000 7fba65d9b640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 0x7fba6819bcc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fba5002a9c0 tx=0x7fba500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.591+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba50004aa0 con 0x7fba68105bf0 2024-09-17T01:04:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.591+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba68195af0 con 0x7fba68105bf0 2024-09-17T01:04:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.591+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba50004c00 con 0x7fba68105bf0 2024-09-17T01:04:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.591+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba50003980 con 0x7fba68105bf0 2024-09-17T01:04:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.591+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba68196060 con 0x7fba68105bf0 2024-09-17T01:04:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.592+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba681011f0 con 0x7fba68105bf0 2024-09-17T01:04:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.592+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fba50003bf0 con 0x7fba68105bf0 2024-09-17T01:04:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.593+0000 7fba5f7fe640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fba5406cc50 0x7fba5406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.593+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fba500ad2c0 con 0x7fba68105bf0 2024-09-17T01:04:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.593+0000 7fba6659c640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fba5406cc50 0x7fba5406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.593+0000 7fba6659c640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fba5406cc50 0x7fba5406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba58009b40 tx=0x7fba58005e50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.597+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fba50077690 con 0x7fba68105bf0 2024-09-17T01:04:51.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.796+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba680fffa0 con 0x7fba68105bf0 2024-09-17T01:04:51.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.797+0000 7fba5f7fe640 1 -- 172.21.15.103:0/1762791993 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fba5007acb0 con 0x7fba68105bf0 2024-09-17T01:04:51.796 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T01:04:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fba5406cc50 msgr2=0x7fba5406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fba5406cc50 0x7fba5406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba58009b40 tx=0x7fba58005e50 comp rx=0 tx=0).stop 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 msgr2=0x7fba6819bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 0x7fba6819bcc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fba5002a9c0 tx=0x7fba500055a0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 shutdown_connections 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fba5406cc50 0x7fba5406f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68105bf0 0x7fba6819bcc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 --2- 172.21.15.103:0/1762791993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba680ffb40 0x7fba6819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.798+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 >> 172.21.15.103:0/1762791993 conn(0x7fba680fb840 msgr2=0x7fba680fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.799+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 shutdown_connections 2024-09-17T01:04:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:51.799+0000 7fba6cc03640 1 -- 172.21.15.103:0/1762791993 wait complete. 2024-09-17T01:04:51.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:51 smithi103 ceph-mon[28156]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:04:52.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:51 smithi143 ceph-mon[35452]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:04:52.382 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:04:52.383 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:04:52.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:52.384 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-17T01:04:52.399 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:52.400 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42322sec preferred_lft 42322sec 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-17T01:04:52.401 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:04:52.402 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:04:52.402 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-17T01:04:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:52.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:52.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:52.598 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:04:52.623 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-17T01:04:52.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:52.625 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-17T01:04:52.709 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-17T01:04:52.709 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:04:52.709 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:04:52.710 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:04:52.710 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:04:52.710 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:52.710 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-17T01:04:52.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:04:52.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:04:52.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:04:52.711 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-17T01:04:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:52.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:52 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1762791993' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:04:52.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:52.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:52.998 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-17T01:04:53.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:52 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1762791993' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:04:53.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:53.014 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-17T01:04:53.069 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:53.070 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-17T01:04:53.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:04:53.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T01:04:53.070 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-17T01:04:53.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:53.186 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T01:04:53.187 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-17T01:04:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:53.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:53.309 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:53.309 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-17T01:04:53.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-17T01:04:53.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:04:53.309 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-17T01:04:53.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:53.386 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T01:04:53.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:04:53.386 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:53.402 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:04:53.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:04:53.402 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:53.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-17T01:04:53.522 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:04:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-17T01:04:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-17T01:04:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-17T01:04:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-17T01:04:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-17T01:04:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-17T01:04:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/2c5c29924fa6cf94760d72667632de8e0117035532cfa2cd43964bc3df3f21bd/merged 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/8fca341228707fead6fc08fa027ddbde8ea996d9c774fad60e58ce117b933ade/merged 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/03ad7f9a3313b48fdb0c65901f9d4e1aaff8cd077e529d8996b8eee4ad601030/merged 2024-09-17T01:04:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/7f82e2c04706b7b51bd8f156398acc5e473baed64966fde8514389f280a706d1/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/44c6dd657067bc6135fcba8f895da4ff97237599e1f72dbec8e2c07de7f0af58/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/5384dd8a77fb4efcc1db720c5cba7a171c50bcfcc04b237508571d55cdf29d1b/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3efc0c2a3170af897bb23c8da700d1c796de312efab31965767d1d7e16352af6/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/b6645a4534eea6362ee66b859ae7fdb671b30cc4afdd0a1665a7179455218e59/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/f288e582df386d7f9a2d01abe736535c195890c63ade5831623140b4fbef7422/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/247332b06229bc34323922330e17fe2e73fca15438bc62b96def78093d9ed3a7/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/00a72de12bddc136c0e66ca9756b8f605c19f89742c479b5c9ac932624f28fdd/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/d93062a511c23683fc0fb884bac4b2483f95081298315bca1bb4d7f4049ed239/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/75b74e2cbab483ea6ddf0f962ed1c2f2ddb2eadd7c22af2e1c989d6d2a573e51/merged 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:04:53.582 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:04:53.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:53.583 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-17T01:04:53.635 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:04:53.635 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T01:04:53.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-17T01:04:53.701 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-17T01:04:53.758 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-17T01:04:53.759 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/2c5c29924fa6cf94760d72667632de8e0117035532cfa2cd43964bc3df3f21bd/merged 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/8fca341228707fead6fc08fa027ddbde8ea996d9c774fad60e58ce117b933ade/merged 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/03ad7f9a3313b48fdb0c65901f9d4e1aaff8cd077e529d8996b8eee4ad601030/merged 2024-09-17T01:04:53.760 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/7f82e2c04706b7b51bd8f156398acc5e473baed64966fde8514389f280a706d1/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/44c6dd657067bc6135fcba8f895da4ff97237599e1f72dbec8e2c07de7f0af58/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/5384dd8a77fb4efcc1db720c5cba7a171c50bcfcc04b237508571d55cdf29d1b/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3efc0c2a3170af897bb23c8da700d1c796de312efab31965767d1d7e16352af6/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/b6645a4534eea6362ee66b859ae7fdb671b30cc4afdd0a1665a7179455218e59/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/f288e582df386d7f9a2d01abe736535c195890c63ade5831623140b4fbef7422/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/247332b06229bc34323922330e17fe2e73fca15438bc62b96def78093d9ed3a7/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/00a72de12bddc136c0e66ca9756b8f605c19f89742c479b5c9ac932624f28fdd/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/d93062a511c23683fc0fb884bac4b2483f95081298315bca1bb4d7f4049ed239/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/75b74e2cbab483ea6ddf0f962ed1c2f2ddb2eadd7c22af2e1c989d6d2a573e51/merged 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:04:53.761 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:04:53.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:53.762 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-17T01:04:53.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-17T01:04:53.784+0000 7f1762ef2480 -1 init, newargv = 0x56433d12dd40 newargc=15 2024-09-17T01:04:53.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[76131]: starting ceph client 2024-09-17T01:04:53.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[76131]: starting fuse 2024-09-17T01:04:53.798 INFO:teuthology.orchestra.run.smithi103.stdout:165 2024-09-17T01:04:53.798 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-17T01:04:53.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:04:53.798 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-17T01:04:53.799 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-17T01:04:53.800 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-17T01:04:53.861 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:53 smithi103 ceph-mon[28156]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:04:53.861 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:53.916 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.76131.asok 2024-09-17T01:04:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:53.927 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76131.asok 2024-09-17T01:04:53.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:53.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76131.asok status 2024-09-17T01:04:54.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:53 smithi143 ceph-mon[35452]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:04:54.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:54.059 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "76131", 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-17T01:04:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 14520, 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 14520 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2898688174 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2898688174 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.14520 192.168.0.1:0/2898688174", 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2898688174", 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 16, 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 45, 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-17T01:04:54.062 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:04:54.068 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:04:54.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T01:04:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 -- 172.21.15.103:0/3826789973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 msgr2=0x7f0c881105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 --2- 172.21.15.103:0/3826789973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c881105f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009880 tx=0x7f0c7802a530 comp rx=0 tx=0).stop 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 -- 172.21.15.103:0/3826789973 shutdown_connections 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 --2- 172.21.15.103:0/3826789973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c881105f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 --2- 172.21.15.103:0/3826789973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c88072850 0x7f0c88072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 -- 172.21.15.103:0/3826789973 >> 172.21.15.103:0/3826789973 conn(0x7f0c880fb840 msgr2=0x7f0c880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 -- 172.21.15.103:0/3826789973 shutdown_connections 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 -- 172.21.15.103:0/3826789973 wait complete. 2024-09-17T01:04:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 Processor -- start 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.840+0000 7f0c90148640 1 -- start start 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c90148640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c88072850 0x7f0c8819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c90148640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c8819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c90148640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8819cd80 con 0x7f0c88073170 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c90148640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a0af0 con 0x7f0c88072850 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c8819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c8819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52470/0 (socket says 172.21.15.103:52470) 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 -- 172.21.15.103:0/402240166 learned_addr learned my addr 172.21.15.103:0/402240166 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8dee4640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c88072850 0x7f0c8819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 -- 172.21.15.103:0/402240166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c88072850 msgr2=0x7f0c8819c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:55.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c88072850 0x7f0c8819c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 -- 172.21.15.103:0/402240166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78009560 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c8d6e3640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c8819c6f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c7802aa50 tx=0x7f0c78032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c780037c0 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c881a0d70 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c78005d50 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c7803be30 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.841+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c881a12c0 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.842+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c88073f90 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.843+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0c7802ad50 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.843+0000 7f0c7effd640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f0c7406cbf0 0x7f0c7406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.843+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0c780acd40 con 0x7f0c88073170 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.843+0000 7f0c8dee4640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f0c7406cbf0 0x7f0c7406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.844+0000 7f0c8dee4640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f0c7406cbf0 0x7f0c7406f0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c84005d00 tx=0x7f0c8400b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:55.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:55.848+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c780771c0 con 0x7f0c88073170 2024-09-17T01:04:55.862 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:55 smithi103 ceph-mon[28156]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:04:56.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:55 smithi143 ceph-mon[35452]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:04:56.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.050+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c8819d540 con 0x7f0c88073170 2024-09-17T01:04:56.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.050+0000 7f0c7effd640 1 -- 172.21.15.103:0/402240166 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f0c78041070 con 0x7f0c88073170 2024-09-17T01:04:56.050 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T01:04:56.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f0c7406cbf0 msgr2=0x7f0c7406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:56.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f0c7406cbf0 0x7f0c7406f0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c84005d00 tx=0x7f0c8400b410 comp rx=0 tx=0).stop 2024-09-17T01:04:56.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 msgr2=0x7f0c8819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c8819c6f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c7802aa50 tx=0x7f0c78032bb0 comp rx=0 tx=0).stop 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 shutdown_connections 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f0c7406cbf0 0x7f0c7406f0b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88073170 0x7f0c8819c6f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 --2- 172.21.15.103:0/402240166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c88072850 0x7f0c8819c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 >> 172.21.15.103:0/402240166 conn(0x7f0c880fb840 msgr2=0x7f0c880ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:56.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 shutdown_connections 2024-09-17T01:04:56.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:04:56.052+0000 7f0c90148640 1 -- 172.21.15.103:0/402240166 wait complete. 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:04:56.694 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:04:56.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:56.695 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-09-17T01:04:56.715 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:04:56.715 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:04:56.715 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:04:56.715 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:04:56.716 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:04:56.717 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T01:04:56.717 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42306sec preferred_lft 42306sec 2024-09-17T01:04:56.717 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link noprefixroute 2024-09-17T01:04:56.717 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:04:56.717 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:04:56.717 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:56.717 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-17T01:04:56.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:04:56.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2024-09-17T01:04:56.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2024-09-17T01:04:56.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:04:56.718 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-17T01:04:56.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:56.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:56 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/402240166' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:04:56.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:56.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:56.936 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:04:56.947 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:56 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/402240166' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:04:56.962 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-09-17T01:04:56.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:56.964 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-09-17T01:04:57.036 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-09-17T01:04:57.036 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:04:57.036 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:04:57.036 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:04:57.036 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:04:57.037 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:57.037 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-17T01:04:57.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:04:57.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:04:57.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:04:57.037 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-17T01:04:57.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:57.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:57.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:57.347 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-09-17T01:04:57.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:57.364 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-09-17T01:04:57.419 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:57.419 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-17T01:04:57.419 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:04:57.419 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T01:04:57.419 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-17T01:04:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:57.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:57.538 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T01:04:57.538 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:57.538 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-17T01:04:57.539 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T01:04:57.539 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:04:57.539 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T01:04:57.539 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T01:04:57.539 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T01:04:57.539 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-17T01:04:57.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:57.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:57.663 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:04:57.663 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-17T01:04:57.663 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2024-09-17T01:04:57.663 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:04:57.664 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-17T01:04:57.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:04:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:57.742 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T01:04:57.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:04:57.742 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:57.757 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:04:57.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:04:57.757 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:57.814 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-17T01:04:57.874 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:57 smithi143 ceph-mon[35452]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:04:57.879 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:04:57.935 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-17T01:04:57.935 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-17T01:04:57.935 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-17T01:04:57.936 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/0 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:04:57.937 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/5eeea8077354400ae1ba22503409568a0e78a4e6651446531667e809b92f581c/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/daed6307b8f09687cbbf618c9a10c94c53e6c914911fb4bd1aebe15558d1e0f9/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/77932eb6363cca71e9ed0885afc141126e779f82890a7c78addddce4eb3ecd87/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/dcf67d573ddca540a4d2ac7d657f13714b8f1332b0d3360456af8c73f062d7a4/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/b66eacc701f9d8badf88faf1f5dad510d9b54a4057ad8d02c9ce8c79f5849d91/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/186c1d139cc90b6e03501f1c7dfb55bed02ab27e9453f0ce0bf23be9c15d7494/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/d5801ab07b6b79e08e030c7a1aff6e0a4a9405b7c9b5a517a5a93a4d35f51804/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/56832533c8c86f1bcff65bc321d401a2307847c5fbf9a7be94b1fb824fcd11b3/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/b3742abd032fcf8c5c3113806143b6b87c6400636d78838734f6a86fa3b4d28d/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/18fbb68412752915794029d6ad6182d0c6c61ee820028adc24b39ed70f6c39fb/merged 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:04:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:04:57.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:57.939 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-17T01:04:57.990 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:04:57.991 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T01:04:58.033 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-17T01:04:58.057 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:04:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-17T01:04:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-17T01:04:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-17T01:04:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-17T01:04:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-17T01:04:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-17T01:04:58.113 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/0 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/5eeea8077354400ae1ba22503409568a0e78a4e6651446531667e809b92f581c/merged 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/daed6307b8f09687cbbf618c9a10c94c53e6c914911fb4bd1aebe15558d1e0f9/merged 2024-09-17T01:04:58.114 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/77932eb6363cca71e9ed0885afc141126e779f82890a7c78addddce4eb3ecd87/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/dcf67d573ddca540a4d2ac7d657f13714b8f1332b0d3360456af8c73f062d7a4/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/b66eacc701f9d8badf88faf1f5dad510d9b54a4057ad8d02c9ce8c79f5849d91/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/186c1d139cc90b6e03501f1c7dfb55bed02ab27e9453f0ce0bf23be9c15d7494/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/d5801ab07b6b79e08e030c7a1aff6e0a4a9405b7c9b5a517a5a93a4d35f51804/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/56832533c8c86f1bcff65bc321d401a2307847c5fbf9a7be94b1fb824fcd11b3/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/b3742abd032fcf8c5c3113806143b6b87c6400636d78838734f6a86fa3b4d28d/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/containers/storage/overlay/18fbb68412752915794029d6ad6182d0c6c61ee820028adc24b39ed70f6c39fb/merged 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:04:58.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:58.115 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-17T01:04:58.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:2024-09-17T01:04:58.158+0000 7fba2aaad480 -1 init, newargv = 0x55d599781f70 newargc=15 2024-09-17T01:04:58.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:ceph-fuse[61463]: starting ceph client 2024-09-17T01:04:58.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:ceph-fuse[61463]: starting fuse 2024-09-17T01:04:58.170 INFO:teuthology.orchestra.run.smithi143.stdout:129 2024-09-17T01:04:58.170 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-17T01:04:58.170 DEBUG:teuthology.orchestra.run.smithi143:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:04:58.170 DEBUG:teuthology.orchestra.run.smithi143:> import glob 2024-09-17T01:04:58.170 DEBUG:teuthology.orchestra.run.smithi143:> import re 2024-09-17T01:04:58.170 DEBUG:teuthology.orchestra.run.smithi143:> import os 2024-09-17T01:04:58.170 DEBUG:teuthology.orchestra.run.smithi143:> import subprocess 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> def _find_admin_socket(client_name): 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> files = glob.glob(asok_path) 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> # Given a non-glob path, it better be there 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> if "*" not in asok_path: 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> assert(len(files) == 1) 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> return files[0] 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> for f in files: 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:04:58.171 DEBUG:teuthology.orchestra.run.smithi143:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> contents = proc_f.read() 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> if mountpoint in contents: 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> return f 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> print(_find_admin_socket("client.1")) 2024-09-17T01:04:58.172 DEBUG:teuthology.orchestra.run.smithi143:> ' 2024-09-17T01:04:58.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:57 smithi103 ceph-mon[28156]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:04:58.288 INFO:teuthology.orchestra.run.smithi143.stdout:/var/run/ceph/ceph-client.1.61463.asok 2024-09-17T01:04:58.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-17T01:04:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:04:58.298 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61463.asok 2024-09-17T01:04:58.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:58.298 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61463.asok status 2024-09-17T01:04:58.430 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-17T01:04:58.430 INFO:teuthology.orchestra.run.smithi143.stdout: "metadata": { 2024-09-17T01:04:58.430 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_sha1": "19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", 2024-09-17T01:04:58.430 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "entity_id": "1", 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "hostname": "smithi143", 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "pid": "61463", 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "root": "/" 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_count": 0, 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_pinned_count": 0, 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 24309, 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "inst": { 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "name": { 2024-09-17T01:04:58.431 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "client", 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "num": 24309 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 2120554610 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2024-09-17T01:04:58.432 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 2120554610 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "inst_str": "client.24309 192.168.0.1:0/2120554610", 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "addr_str": "192.168.0.1:0/2120554610", 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "inode_count": 1, 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_epoch": 16, 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch": 45, 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "blocklisted": false, 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs" 2024-09-17T01:04:58.433 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-17T01:04:58.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:58.439 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-17T01:04:58.439 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:58.459 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-17T01:04:58.460 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:58.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:58.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:58.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:58.534 DEBUG:teuthology.orchestra.run.smithi143:> stat --file-system '--printf=%T 2024-09-17T01:04:58.534 DEBUG:teuthology.orchestra.run.smithi143:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:58.550 INFO:teuthology.orchestra.run.smithi143.stdout:fuseblk 2024-09-17T01:04:58.550 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:58.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:04:58.551 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:58.618 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:04:58.628 INFO:teuthology.task.print:**** done client 2024-09-17T01:04:58.628 INFO:teuthology.run_tasks:Running task parallel... 2024-09-17T01:04:58.638 INFO:teuthology.task.parallel:starting parallel... 2024-09-17T01:04:58.638 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:04:58.639 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:04:58.639 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:04:58.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-17T01:04:58.640 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:04:58.640 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-17T01:04:58.644 INFO:tasks.workunit:Pulling workunits from ref e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:04:58.645 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T01:04:58.645 INFO:tasks.workunit:timeout=3h 2024-09-17T01:04:58.645 INFO:tasks.workunit:cleanup=True 2024-09-17T01:04:58.645 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:04:58.666 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-17 01:04:22.808983929 +0000 2024-09-17T01:04:58.667 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-17 01:04:58.533496020 +0000 2024-09-17T01:04:58.667 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-17T01:04:58.667 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T01:04:58.667 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T01:04:58.738 DEBUG:teuthology.orchestra.run.smithi143:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:58.754 INFO:teuthology.orchestra.run.smithi143.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:58.755 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:04:58.755 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-17T01:04:58.755 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:04:58.755 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T01:04:58.755 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:04:58.756 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-17 01:04:58.735876766 +0000 2024-09-17T01:04:58.756 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-17 01:04:58.735876766 +0000 2024-09-17T01:04:58.756 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-09-17T01:04:58.756 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-17T01:04:58.756 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-17T01:04:58.825 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:04:58.826 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:04:58.842 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T01:04:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:04:58.882 INFO:tasks.workunit.client.1.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-17T01:04:59.921 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:04:59 smithi103 ceph-mon[28156]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-17T01:05:00.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:04:59 smithi143 ceph-mon[35452]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-17T01:05:00.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.435+0000 7f321ec38640 1 -- 172.21.15.103:0/2183514928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 msgr2=0x7f3218105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.435+0000 7f321ec38640 1 --2- 172.21.15.103:0/2183514928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f3218105360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3204009880 tx=0x7f320402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- 172.21.15.103:0/2183514928 shutdown_connections 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 --2- 172.21.15.103:0/2183514928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f3218105360 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 --2- 172.21.15.103:0/2183514928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3218100640 0x7f3218102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- 172.21.15.103:0/2183514928 >> 172.21.15.103:0/2183514928 conn(0x7f32180fa1c0 msgr2=0x7f32180fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- 172.21.15.103:0/2183514928 shutdown_connections 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- 172.21.15.103:0/2183514928 wait complete. 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 Processor -- start 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- start start 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3218100640 0x7f32180fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f32180fe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180feb30 con 0x7f3218102f70 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.436+0000 7f321ec38640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180feca0 con 0x7f3218100640 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f32180fe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f32180fe5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52492/0 (socket says 172.21.15.103:52492) 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 -- 172.21.15.103:0/382024755 learned_addr learned my addr 172.21.15.103:0/382024755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f321c9d4640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3218100640 0x7f32180fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 -- 172.21.15.103:0/382024755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3218100640 msgr2=0x7f32180fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3218100640 0x7f32180fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 -- 172.21.15.103:0/382024755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204009560 con 0x7f3218102f70 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3217fff640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f32180fe5f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f320402a9c0 tx=0x7f3204005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3204004b20 con 0x7f3218102f70 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180fef20 con 0x7f3218102f70 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3204004c80 con 0x7f3218102f70 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3204003b10 con 0x7f3218102f70 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.437+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321819d770 con 0x7f3218102f70 2024-09-17T01:05:00.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.438+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3218100aa0 con 0x7f3218102f70 2024-09-17T01:05:00.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.439+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3204003d00 con 0x7f3218102f70 2024-09-17T01:05:00.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.439+0000 7f3215ffb640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f320806cc50 0x7f320806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:00.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.439+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f32040ad4d0 con 0x7f3218102f70 2024-09-17T01:05:00.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.440+0000 7f321c9d4640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f320806cc50 0x7f320806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:00.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.440+0000 7f321c9d4640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f320806cc50 0x7f320806f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f320c009990 tx=0x7f320c009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:00.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.444+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f32040778a0 con 0x7f3218102f70 2024-09-17T01:05:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.612+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f321819da10 con 0x7f3218102f70 2024-09-17T01:05:00.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.617+0000 7f3215ffb640 1 -- 172.21.15.103:0/382024755 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v24)=0 v24) v1 ==== 126+0+0 (secure 0 0 0) 0x7f3204077020 con 0x7f3218102f70 2024-09-17T01:05:00.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f320806cc50 msgr2=0x7f320806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f320806cc50 0x7f320806f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f320c009990 tx=0x7f320c009110 comp rx=0 tx=0).stop 2024-09-17T01:05:00.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 msgr2=0x7f32180fe5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f32180fe5f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f320402a9c0 tx=0x7f3204005610 comp rx=0 tx=0).stop 2024-09-17T01:05:00.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 shutdown_connections 2024-09-17T01:05:00.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f320806cc50 0x7f320806f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3218102f70 0x7f32180fe5f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 --2- 172.21.15.103:0/382024755 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3218100640 0x7f32180fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 >> 172.21.15.103:0/382024755 conn(0x7f32180fa1c0 msgr2=0x7f32180fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:00.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 shutdown_connections 2024-09-17T01:05:00.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:00.619+0000 7f321ec38640 1 -- 172.21.15.103:0/382024755 wait complete. 2024-09-17T01:05:01.208 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:05:01.208 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:05:01.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T01:05:01.448 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:05:01.832 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:01 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/382024755' entity='client.admin' 2024-09-17T01:05:01.832 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:01 smithi103 ceph-mon[28156]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-17T01:05:01.832 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:01.832 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:01.833 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:01.833 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:01 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:02.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:01 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/382024755' entity='client.admin' 2024-09-17T01:05:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:01 smithi143 ceph-mon[35452]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-17T01:05:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:02.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:01 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:03.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 -- 172.21.15.103:0/3060753576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 msgr2=0x7f29fc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3060753576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc1000b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009880 tx=0x7f29f002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 -- 172.21.15.103:0/3060753576 shutdown_connections 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3060753576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc1000b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3060753576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 0x7f29fc0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 -- 172.21.15.103:0/3060753576 >> 172.21.15.103:0/3060753576 conn(0x7f29fc0fa1c0 msgr2=0x7f29fc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 -- 172.21.15.103:0/3060753576 shutdown_connections 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 -- 172.21.15.103:0/3060753576 wait complete. 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.150+0000 7f2a03d07640 1 Processor -- start 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a03d07640 1 -- start start 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a03d07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 0x7f29fc195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a03d07640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a03d07640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc196280 con 0x7f29fc0ffc30 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a03d07640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1963f0 con 0x7f29fc0fea30 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a012a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a012a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58420/0 (socket says 172.21.15.103:58420) 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a012a2640 1 -- 172.21.15.103:0/3914433265 learned_addr learned my addr 172.21.15.103:0/3914433265 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a01aa3640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 0x7f29fc195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a012a2640 1 -- 172.21.15.103:0/3914433265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 msgr2=0x7f29fc195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a012a2640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 0x7f29fc195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a012a2640 1 -- 172.21.15.103:0/3914433265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0009560 con 0x7f29fc0ffc30 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.151+0000 7f2a01aa3640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 0x7f29fc195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.152+0000 7f2a012a2640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc195cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005640 tx=0x7f29f0005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.152+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f0004ba0 con 0x7f29fc0ffc30 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.152+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29f0004d00 con 0x7f29fc0ffc30 2024-09-17T01:05:03.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.152+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc19adc0 con 0x7f29fc0ffc30 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.152+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f0003c30 con 0x7f29fc0ffc30 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.152+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc19b330 con 0x7f29fc0ffc30 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.153+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc1076c0 con 0x7f29fc0ffc30 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.153+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f29f0031640 con 0x7f29fc0ffc30 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.154+0000 7f29faffd640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f29e406cc50 0x7f29e406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.154+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f29f00ad420 con 0x7f29fc0ffc30 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.154+0000 7f2a01aa3640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f29e406cc50 0x7f29e406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.154+0000 7f2a01aa3640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f29e406cc50 0x7f29e406f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ffa90 tx=0x7f29f4009570 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:03.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.159+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29f0077870 con 0x7f29fc0ffc30 2024-09-17T01:05:03.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.321+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f29fc107850 con 0x7f29fc0ffc30 2024-09-17T01:05:03.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.321+0000 7f29faffd640 1 -- 172.21.15.103:0/3914433265 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v24)=0 v24) v1 ==== 155+0+0 (secure 0 0 0) 0x7f29f007ae90 con 0x7f29fc0ffc30 2024-09-17T01:05:03.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f29e406cc50 msgr2=0x7f29e406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f29e406cc50 0x7f29e406f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ffa90 tx=0x7f29f4009570 comp rx=0 tx=0).stop 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 msgr2=0x7f29fc195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc195cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005640 tx=0x7f29f0005670 comp rx=0 tx=0).stop 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 shutdown_connections 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f29e406cc50 0x7f29e406f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29fc0ffc30 0x7f29fc195cb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 --2- 172.21.15.103:0/3914433265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29fc0fea30 0x7f29fc195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.323+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 >> 172.21.15.103:0/3914433265 conn(0x7f29fc0fa1c0 msgr2=0x7f29fc067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.324+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 shutdown_connections 2024-09-17T01:05:03.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:03.324+0000 7f2a03d07640 1 -- 172.21.15.103:0/3914433265 wait complete. 2024-09-17T01:05:03.926 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:03 smithi103 ceph-mon[28156]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-17T01:05:04.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:03 smithi143 ceph-mon[35452]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-17T01:05:04.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T01:05:04.394 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:05:05.729 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:05 smithi103 ceph-mon[28156]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.957+0000 7f48b2b23640 1 -- 172.21.15.103:0/3847452217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 msgr2=0x7f48ac100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.957+0000 7f48b2b23640 1 --2- 172.21.15.103:0/3847452217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac100120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4898009880 tx=0x7f489802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.957+0000 7f48b2b23640 1 -- 172.21.15.103:0/3847452217 shutdown_connections 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.957+0000 7f48b2b23640 1 --2- 172.21.15.103:0/3847452217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac100120 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.957+0000 7f48b2b23640 1 --2- 172.21.15.103:0/3847452217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48ac0feaa0 0x7f48ac0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.957+0000 7f48b2b23640 1 -- 172.21.15.103:0/3847452217 >> 172.21.15.103:0/3847452217 conn(0x7f48ac0fa230 msgr2=0x7f48ac0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 -- 172.21.15.103:0/3847452217 shutdown_connections 2024-09-17T01:05:05.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 -- 172.21.15.103:0/3847452217 wait complete. 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 Processor -- start 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 -- start start 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48ac0feaa0 0x7f48ac195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac196170 con 0x7f48ac0ffca0 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48b2b23640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac1962e0 con 0x7f48ac0feaa0 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48abfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48abfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58430/0 (socket says 172.21.15.103:58430) 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.958+0000 7f48abfff640 1 -- 172.21.15.103:0/2422606581 learned_addr learned my addr 172.21.15.103:0/2422606581 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48abfff640 1 -- 172.21.15.103:0/2422606581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48ac0feaa0 msgr2=0x7f48ac195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48b08bf640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48ac0feaa0 0x7f48ac195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:05.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48abfff640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48ac0feaa0 0x7f48ac195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48abfff640 1 -- 172.21.15.103:0/2422606581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898009560 con 0x7f48ac0ffca0 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48abfff640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac195ba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4898005520 tx=0x7f4898005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4898004aa0 con 0x7f48ac0ffca0 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac19ad20 con 0x7f48ac0ffca0 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4898004c00 con 0x7f48ac0ffca0 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4898003b10 con 0x7f48ac0ffca0 2024-09-17T01:05:05.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.959+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac19b210 con 0x7f48ac0ffca0 2024-09-17T01:05:05.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.960+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac107690 con 0x7f48ac0ffca0 2024-09-17T01:05:05.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.961+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4898031d20 con 0x7f48ac0ffca0 2024-09-17T01:05:05.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.961+0000 7f48a9ffb640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f489c06cc50 0x7f489c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:05.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.961+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f48980ad450 con 0x7f48ac0ffca0 2024-09-17T01:05:05.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.961+0000 7f48b08bf640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f489c06cc50 0x7f489c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:05.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.962+0000 7f48b08bf640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f489c06cc50 0x7f489c06f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005fd0 tx=0x7f48a0005c70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:05.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:05.965+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4898077820 con 0x7f48ac0ffca0 2024-09-17T01:05:06.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:05 smithi143 ceph-mon[35452]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T01:05:06.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.127+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f48ac1078d0 con 0x7f48ac0ffca0 2024-09-17T01:05:06.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.128+0000 7f48a9ffb640 1 -- 172.21.15.103:0/2422606581 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v24)=0 v24) v1 ==== 163+0+0 (secure 0 0 0) 0x7f48ac1078d0 con 0x7f48ac0ffca0 2024-09-17T01:05:06.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f489c06cc50 msgr2=0x7f489c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:06.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f489c06cc50 0x7f489c06f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005fd0 tx=0x7f48a0005c70 comp rx=0 tx=0).stop 2024-09-17T01:05:06.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 msgr2=0x7f48ac195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:06.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac195ba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4898005520 tx=0x7f4898005550 comp rx=0 tx=0).stop 2024-09-17T01:05:06.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 shutdown_connections 2024-09-17T01:05:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f489c06cc50 0x7f489c06f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ac0ffca0 0x7f48ac195ba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 --2- 172.21.15.103:0/2422606581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48ac0feaa0 0x7f48ac195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 >> 172.21.15.103:0/2422606581 conn(0x7f48ac0fa230 msgr2=0x7f48ac0684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 shutdown_connections 2024-09-17T01:05:06.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:06.130+0000 7f48b2b23640 1 -- 172.21.15.103:0/2422606581 wait complete. 2024-09-17T01:05:06.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T01:05:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:05:08.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:07 smithi143 ceph-mon[35452]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T01:05:08.017 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:07 smithi103 ceph-mon[28156]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-17T01:05:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 -- 172.21.15.103:0/3787509944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b8100d40 msgr2=0x7fa7b81011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 --2- 172.21.15.103:0/3787509944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b8100d40 0x7fa7b81011c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009880 tx=0x7fa7a002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 -- 172.21.15.103:0/3787509944 shutdown_connections 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 --2- 172.21.15.103:0/3787509944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b8100d40 0x7fa7b81011c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 --2- 172.21.15.103:0/3787509944 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7b80ffb40 0x7fa7b80fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 -- 172.21.15.103:0/3787509944 >> 172.21.15.103:0/3787509944 conn(0x7fa7b80fb2f0 msgr2=0x7fa7b80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 -- 172.21.15.103:0/3787509944 shutdown_connections 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.505+0000 7fa7bce74640 1 -- 172.21.15.103:0/3787509944 wait complete. 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7bce74640 1 Processor -- start 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7bce74640 1 -- start start 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7bce74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 0x7fa7b81955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7bce74640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7b8100d40 0x7fa7b8195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7bce74640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81960f0 con 0x7fa7b80ffb40 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7bce74640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8196260 con 0x7fa7b8100d40 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7b659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 0x7fa7b81955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7b659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 0x7fa7b81955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58446/0 (socket says 172.21.15.103:58446) 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7b659c640 1 -- 172.21.15.103:0/306645425 learned_addr learned my addr 172.21.15.103:0/306645425 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.506+0000 7fa7add9b640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7b8100d40 0x7fa7b8195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7b659c640 1 -- 172.21.15.103:0/306645425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7b8100d40 msgr2=0x7fa7b8195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7b659c640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7b8100d40 0x7fa7b8195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7b659c640 1 -- 172.21.15.103:0/306645425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009560 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7b659c640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 0x7fa7b81955e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800d720 tx=0x7fa7a800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a80041f0 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7a8004350 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b819ad00 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a8003df0 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.507+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b819b240 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.508+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b8108730 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.509+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa7a80035f0 con 0x7fa7b80ffb40 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.509+0000 7fa7affff640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa7a406cc00 0x7fa7a406f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.509+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa7a808bc40 con 0x7fa7b80ffb40 2024-09-17T01:05:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.509+0000 7fa7add9b640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa7a406cc00 0x7fa7a406f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.510+0000 7fa7add9b640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa7a406cc00 0x7fa7a406f0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a00314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.513+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa7a80560c0 con 0x7fa7b80ffb40 2024-09-17T01:05:08.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.677+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fa7b819b480 con 0x7fa7b80ffb40 2024-09-17T01:05:08.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.678+0000 7fa7affff640 1 -- 172.21.15.103:0/306645425 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v24)=0 v24) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa7a80596e0 con 0x7fa7b80ffb40 2024-09-17T01:05:08.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.680+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa7a406cc00 msgr2=0x7fa7a406f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:08.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.680+0000 7fa7bce74640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa7a406cc00 0x7fa7a406f0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a00314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.680+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 msgr2=0x7fa7b81955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:08.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.680+0000 7fa7bce74640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 0x7fa7b81955e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800d720 tx=0x7fa7a800dbe0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 shutdown_connections 2024-09-17T01:05:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa7a406cc00 0x7fa7a406f0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7b8100d40 0x7fa7b8195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 --2- 172.21.15.103:0/306645425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b80ffb40 0x7fa7b81955e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 >> 172.21.15.103:0/306645425 conn(0x7fa7b80fb2f0 msgr2=0x7fa7b8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 shutdown_connections 2024-09-17T01:05:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:08.681+0000 7fa7bce74640 1 -- 172.21.15.103:0/306645425 wait complete. 2024-09-17T01:05:08.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:09.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:09.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T01:05:09.647 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:05:10.010 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:09 smithi143 ceph-mon[35452]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T01:05:10.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:09 smithi103 ceph-mon[28156]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T01:05:11.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 -- 172.21.15.103:0/2182865785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 msgr2=0x7fd374105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:11.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 --2- 172.21.15.103:0/2182865785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374105350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd3600098b0 tx=0x7fd36002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 -- 172.21.15.103:0/2182865785 shutdown_connections 2024-09-17T01:05:11.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 --2- 172.21.15.103:0/2182865785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374105350 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 --2- 172.21.15.103:0/2182865785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd374100630 0x7fd374102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 -- 172.21.15.103:0/2182865785 >> 172.21.15.103:0/2182865785 conn(0x7fd3740fa230 msgr2=0x7fd3740fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:11.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 -- 172.21.15.103:0/2182865785 shutdown_connections 2024-09-17T01:05:11.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 -- 172.21.15.103:0/2182865785 wait complete. 2024-09-17T01:05:11.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 Processor -- start 2024-09-17T01:05:11.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 -- start start 2024-09-17T01:05:11.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.170+0000 7fd37b01d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd374100630 0x7fd374195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:11.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd37b01d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd37b01d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd374196150 con 0x7fd374102f60 2024-09-17T01:05:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd37b01d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741962c0 con 0x7fd374100630 2024-09-17T01:05:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58458/0 (socket says 172.21.15.103:58458) 2024-09-17T01:05:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 -- 172.21.15.103:0/3256923453 learned_addr learned my addr 172.21.15.103:0/3256923453 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:11.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd378db9640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd374100630 0x7fd374195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 -- 172.21.15.103:0/3256923453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd374100630 msgr2=0x7fd374195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd374100630 0x7fd374195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 -- 172.21.15.103:0/3256923453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009560 con 0x7fd374102f60 2024-09-17T01:05:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd373fff640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374195b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd3600055a0 tx=0x7fd3600055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd360004aa0 con 0x7fd374102f60 2024-09-17T01:05:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37419ad00 con 0x7fd374102f60 2024-09-17T01:05:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd360004c00 con 0x7fd374102f60 2024-09-17T01:05:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.171+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd360003b50 con 0x7fd374102f60 2024-09-17T01:05:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.172+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37419b270 con 0x7fd374102f60 2024-09-17T01:05:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.173+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3741087b0 con 0x7fd374102f60 2024-09-17T01:05:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.173+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd360003cb0 con 0x7fd374102f60 2024-09-17T01:05:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.174+0000 7fd371ffb640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fd36406cc50 0x7fd36406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.174+0000 7fd378db9640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fd36406cc50 0x7fd36406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.174+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd3600ad3c0 con 0x7fd374102f60 2024-09-17T01:05:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.174+0000 7fd378db9640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fd36406cc50 0x7fd36406f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd368005fd0 tx=0x7fd36800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.178+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd360077840 con 0x7fd374102f60 2024-09-17T01:05:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.356+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}) v1 -- 0x7fd374103940 con 0x7fd36406cc50 2024-09-17T01:05:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.361+0000 7fd371ffb640 1 -- 172.21.15.103:0/3256923453 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fd374103940 con 0x7fd36406cc50 2024-09-17T01:05:11.361 INFO:teuthology.orchestra.run.smithi103.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:11.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fd36406cc50 msgr2=0x7fd36406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:11.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fd36406cc50 0x7fd36406f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd368005fd0 tx=0x7fd36800b390 comp rx=0 tx=0).stop 2024-09-17T01:05:11.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 msgr2=0x7fd374195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:11.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374195b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd3600055a0 tx=0x7fd3600055d0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 shutdown_connections 2024-09-17T01:05:11.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fd36406cc50 0x7fd36406f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd374102f60 0x7fd374195b80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 --2- 172.21.15.103:0/3256923453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd374100630 0x7fd374195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:11.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 >> 172.21.15.103:0/3256923453 conn(0x7fd3740fa230 msgr2=0x7fd3740fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:11.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 shutdown_connections 2024-09-17T01:05:11.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:11.364+0000 7fd37b01d640 1 -- 172.21.15.103:0/3256923453 wait complete. 2024-09-17T01:05:11.981 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:11 smithi103 ceph-mon[28156]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-17T01:05:11.981 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:11 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:11.981 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:11 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.004 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:05:12.005 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:05:12.005 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T01:05:12.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:11 smithi143 ceph-mon[35452]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-17T01:05:12.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:11 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:12.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:11 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:05:12.956 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:12 smithi103 ceph-mon[28156]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:12.957 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:12 smithi103 ceph-mon[28156]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:12.957 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.957 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.957 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:12 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:12.957 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:12 smithi103 ceph-mon[28156]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:12 smithi143 ceph-mon[35452]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:12 smithi143 ceph-mon[35452]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:12 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:13.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:12 smithi143 ceph-mon[35452]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 -- 172.21.15.103:0/3580711642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32380ffb60 msgr2=0x7f32380fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 --2- 172.21.15.103:0/3580711642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32380ffb60 0x7f32380fff60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3228009880 tx=0x7f322802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 -- 172.21.15.103:0/3580711642 shutdown_connections 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 --2- 172.21.15.103:0/3580711642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3238100d60 0x7f32381011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 --2- 172.21.15.103:0/3580711642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32380ffb60 0x7f32380fff60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 -- 172.21.15.103:0/3580711642 >> 172.21.15.103:0/3580711642 conn(0x7f32380fb2f0 msgr2=0x7f32380fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 -- 172.21.15.103:0/3580711642 shutdown_connections 2024-09-17T01:05:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.794+0000 7f323d98f640 1 -- 172.21.15.103:0/3580711642 wait complete. 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.795+0000 7f323d98f640 1 Processor -- start 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.795+0000 7f323d98f640 1 -- start start 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f323d98f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32380ffb60 0x7f3238074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f323d98f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 0x7f32380728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f323d98f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32381992b0 con 0x7f3238100d60 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f323d98f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238199420 con 0x7f32380ffb60 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f32367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 0x7f32380728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f32367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 0x7f32380728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59418/0 (socket says 172.21.15.103:59418) 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f32367fc640 1 -- 172.21.15.103:0/3546954122 learned_addr learned my addr 172.21.15.103:0/3546954122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f3236ffd640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32380ffb60 0x7f3238074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f32367fc640 1 -- 172.21.15.103:0/3546954122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32380ffb60 msgr2=0x7f3238074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f32367fc640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32380ffb60 0x7f3238074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f32367fc640 1 -- 172.21.15.103:0/3546954122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009560 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.796+0000 7f3236ffd640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32380ffb60 0x7f3238074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.797+0000 7f32367fc640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 0x7f32380728a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f322c00e970 tx=0x7f322c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.797+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322c00cc90 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.797+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238072de0 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.797+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f322c00cdf0 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.797+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32380733b0 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.797+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322c010430 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.798+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3224005280 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.799+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f322c0046c0 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.799+0000 7f323c98d640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f322006cc50 0x7f322006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.799+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f322c014070 con 0x7f3238100d60 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.799+0000 7f3236ffd640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f322006cc50 0x7f322006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.800+0000 7f3236ffd640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f322006cc50 0x7f322006f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3228009230 tx=0x7f32280314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.804+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f322c056b70 con 0x7f3238100d60 2024-09-17T01:05:13.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:13 smithi103 ceph-mon[28156]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-17T01:05:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.986+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3224000bf0 con 0x7f322006cc50 2024-09-17T01:05:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.987+0000 7f323c98d640 1 -- 172.21.15.103:0/3546954122 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f3224000bf0 con 0x7f322006cc50 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f322006cc50 msgr2=0x7f322006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f322006cc50 0x7f322006f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3228009230 tx=0x7f32280314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 msgr2=0x7f32380728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 0x7f32380728a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f322c00e970 tx=0x7f322c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 shutdown_connections 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f322006cc50 0x7f322006f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3238100d60 0x7f32380728a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 --2- 172.21.15.103:0/3546954122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32380ffb60 0x7f3238074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 >> 172.21.15.103:0/3546954122 conn(0x7f32380fb2f0 msgr2=0x7f32381044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 shutdown_connections 2024-09-17T01:05:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:13.989+0000 7f323d98f640 1 -- 172.21.15.103:0/3546954122 wait complete. 2024-09-17T01:05:13.996 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:05:14.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:13 smithi143 ceph-mon[35452]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-17T01:05:14.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 -- 172.21.15.103:0/1116407597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70740fde40 msgr2=0x7f70740fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 --2- 172.21.15.103:0/1116407597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70740fde40 0x7f70740fe240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7070009880 tx=0x7f707002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 -- 172.21.15.103:0/1116407597 shutdown_connections 2024-09-17T01:05:14.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 --2- 172.21.15.103:0/1116407597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7074100e20 0x7f70741012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 --2- 172.21.15.103:0/1116407597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70740fde40 0x7f70740fe240 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 -- 172.21.15.103:0/1116407597 >> 172.21.15.103:0/1116407597 conn(0x7f70740f99b0 msgr2=0x7f70740fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 -- 172.21.15.103:0/1116407597 shutdown_connections 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.071+0000 7f707c594640 1 -- 172.21.15.103:0/1116407597 wait complete. 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707c594640 1 Processor -- start 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707c594640 1 -- start start 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707c594640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70740fde40 0x7f70741955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707c594640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 0x7f7074195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707c594640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7074196040 con 0x7f7074100e20 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707c594640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70741961b0 con 0x7f70740fde40 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 0x7f7074195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 0x7f7074195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59434/0 (socket says 172.21.15.103:59434) 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 -- 172.21.15.103:0/1022448306 learned_addr learned my addr 172.21.15.103:0/1022448306 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707a330640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70740fde40 0x7f70741955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 -- 172.21.15.103:0/1022448306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70740fde40 msgr2=0x7f70741955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70740fde40 0x7f70741955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 -- 172.21.15.103:0/1022448306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009560 con 0x7f7074100e20 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f707a330640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70740fde40 0x7f70741955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.072+0000 7f7079b2f640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 0x7f7074195b00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f706400c8a0 tx=0x7f706400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.073+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7064007b80 con 0x7f7074100e20 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.073+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707419ac90 con 0x7f7074100e20 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.073+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7064007ce0 con 0x7f7074100e20 2024-09-17T01:05:14.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.073+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7064018810 con 0x7f7074100e20 2024-09-17T01:05:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.073+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707419b210 con 0x7f7074100e20 2024-09-17T01:05:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.074+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074108760 con 0x7f7074100e20 2024-09-17T01:05:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.074+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7064018a80 con 0x7f7074100e20 2024-09-17T01:05:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.075+0000 7f706b7fe640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f706006cc50 0x7f706006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.075+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f706408c4a0 con 0x7f7074100e20 2024-09-17T01:05:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.075+0000 7f707a330640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f706006cc50 0x7f706006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.075+0000 7f707a330640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f706006cc50 0x7f706006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7070009230 tx=0x7f70700314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.079+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f70640568f0 con 0x7f7074100e20 2024-09-17T01:05:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.256+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7074105770 con 0x7f706006cc50 2024-09-17T01:05:14.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.257+0000 7f706b7fe640 1 -- 172.21.15.103:0/1022448306 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7074105770 con 0x7f706006cc50 2024-09-17T01:05:14.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f706006cc50 msgr2=0x7f706006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f706006cc50 0x7f706006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7070009230 tx=0x7f70700314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 msgr2=0x7f7074195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 0x7f7074195b00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f706400c8a0 tx=0x7f706400cd60 comp rx=0 tx=0).stop 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 shutdown_connections 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f706006cc50 0x7f706006f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7074100e20 0x7f7074195b00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 --2- 172.21.15.103:0/1022448306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70740fde40 0x7f70741955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 >> 172.21.15.103:0/1022448306 conn(0x7f70740f99b0 msgr2=0x7f7074104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 shutdown_connections 2024-09-17T01:05:14.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.259+0000 7f707c594640 1 -- 172.21.15.103:0/1022448306 wait complete. 2024-09-17T01:05:14.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 -- 172.21.15.103:0/244400911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd640ffb70 msgr2=0x7efd640fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/244400911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd640ffb70 0x7efd640fff70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd60009880 tx=0x7efd6002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 -- 172.21.15.103:0/244400911 shutdown_connections 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/244400911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd64100d70 0x7efd641011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/244400911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd640ffb70 0x7efd640fff70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 -- 172.21.15.103:0/244400911 >> 172.21.15.103:0/244400911 conn(0x7efd640fb2c0 msgr2=0x7efd640fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 -- 172.21.15.103:0/244400911 shutdown_connections 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 -- 172.21.15.103:0/244400911 wait complete. 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.342+0000 7efd6bc5d640 1 Processor -- start 2024-09-17T01:05:14.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd6bc5d640 1 -- start start 2024-09-17T01:05:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd6bc5d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd640ffb70 0x7efd64074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd6bc5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 0x7efd640728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd6bc5d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64072de0 con 0x7efd64100d70 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd6bc5d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64072f50 con 0x7efd640ffb70 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 0x7efd640728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 0x7efd640728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59458/0 (socket says 172.21.15.103:59458) 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 -- 172.21.15.103:0/645247414 learned_addr learned my addr 172.21.15.103:0/645247414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd699f9640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd640ffb70 0x7efd64074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 -- 172.21.15.103:0/645247414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd640ffb70 msgr2=0x7efd64074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd640ffb70 0x7efd64074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 -- 172.21.15.103:0/645247414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009560 con 0x7efd64100d70 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd691f8640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 0x7efd640728a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efd5400d6f0 tx=0x7efd5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.343+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd54009a30 con 0x7efd64100d70 2024-09-17T01:05:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.344+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd540054e0 con 0x7efd64100d70 2024-09-17T01:05:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.344+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd64073230 con 0x7efd64100d70 2024-09-17T01:05:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.344+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd54010460 con 0x7efd64100d70 2024-09-17T01:05:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.344+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6419d6a0 con 0x7efd64100d70 2024-09-17T01:05:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.345+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd640fff70 con 0x7efd64100d70 2024-09-17T01:05:14.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.345+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efd54009b90 con 0x7efd64100d70 2024-09-17T01:05:14.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.345+0000 7efd5affd640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efd5006cc50 0x7efd5006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.346+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7efd5408bc60 con 0x7efd64100d70 2024-09-17T01:05:14.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.346+0000 7efd699f9640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efd5006cc50 0x7efd5006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.346+0000 7efd699f9640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efd5006cc50 0x7efd5006f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd60009230 tx=0x7efd600314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.350+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efd54056160 con 0x7efd64100d70 2024-09-17T01:05:14.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.548+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd641056c0 con 0x7efd5006cc50 2024-09-17T01:05:14.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.558+0000 7efd5affd640 1 -- 172.21.15.103:0/645247414 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7efd641056c0 con 0x7efd5006cc50 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (4m) 28s ago 6m 25.2M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (6m) 28s ago 6m 7558k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (5m) 34s ago 5m 7415k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (6m) 28s ago 6m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (5m) 34s ago 5m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (4m) 28s ago 5m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (52s) 28s ago 52s 16.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (47s) 28s ago 46s 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (45s) 34s ago 44s 11.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (50s) 34s ago 49s 13.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:05:14.557 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:9283,8765,8443 running (7m) 28s ago 7m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 29c1c8578f11 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (5m) 34s ago 5m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 f45a460ef3a5 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (7m) 28s ago 7m 45.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (5m) 34s ago 5m 35.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (6m) 28s ago 6m 16.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (5m) 34s ago 5m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (4m) 28s ago 4m 50.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (3m) 28s ago 3m 47.0M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (3m) 28s ago 3m 52.9M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (3m) 34s ago 3m 45.4M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (2m) 34s ago 2m 44.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (2m) 34s ago 2m 50.7M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:05:14.558 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (4m) 28s ago 5m 55.0M - 2.43.0 a07b618ecd1d e84d3109ab0e 2024-09-17T01:05:14.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efd5006cc50 msgr2=0x7efd5006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efd5006cc50 0x7efd5006f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd60009230 tx=0x7efd600314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 msgr2=0x7efd640728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 0x7efd640728a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efd5400d6f0 tx=0x7efd5400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 shutdown_connections 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efd5006cc50 0x7efd5006f110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd64100d70 0x7efd640728a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 --2- 172.21.15.103:0/645247414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd640ffb70 0x7efd64074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 >> 172.21.15.103:0/645247414 conn(0x7efd640fb2c0 msgr2=0x7efd64103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 shutdown_connections 2024-09-17T01:05:14.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.561+0000 7efd6bc5d640 1 -- 172.21.15.103:0/645247414 wait complete. 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.651+0000 7efc76a9f640 1 -- 172.21.15.103:0/1670301844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700ffc30 msgr2=0x7efc701000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.651+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1670301844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700ffc30 0x7efc701000b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009880 tx=0x7efc5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.651+0000 7efc76a9f640 1 -- 172.21.15.103:0/1670301844 shutdown_connections 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.651+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1670301844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700ffc30 0x7efc701000b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.651+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1670301844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc700fea30 0x7efc700fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.651+0000 7efc76a9f640 1 -- 172.21.15.103:0/1670301844 >> 172.21.15.103:0/1670301844 conn(0x7efc700fa1c0 msgr2=0x7efc700fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 -- 172.21.15.103:0/1670301844 shutdown_connections 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 -- 172.21.15.103:0/1670301844 wait complete. 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 Processor -- start 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 -- start start 2024-09-17T01:05:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 0x7efc70194500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc700ffc30 0x7efc70194a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70195010 con 0x7efc700fea30 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc76a9f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70195180 con 0x7efc700ffc30 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.652+0000 7efc7483b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 0x7efc70194500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc7483b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 0x7efc70194500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59476/0 (socket says 172.21.15.103:59476) 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc7483b640 1 -- 172.21.15.103:0/1523297937 learned_addr learned my addr 172.21.15.103:0/1523297937 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc6ffff640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc700ffc30 0x7efc70194a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc7483b640 1 -- 172.21.15.103:0/1523297937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc700ffc30 msgr2=0x7efc70194a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc7483b640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc700ffc30 0x7efc70194a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc7483b640 1 -- 172.21.15.103:0/1523297937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c009560 con 0x7efc700fea30 2024-09-17T01:05:14.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc7483b640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 0x7efc70194500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc6400eb00 tx=0x7efc64009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc64013070 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70067c40 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc640044f0 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.653+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc64017400 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.654+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc700681e0 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.655+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc700fee30 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.655+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efc640035f0 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.655+0000 7efc6dffb640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efc6006cc50 0x7efc6006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.656+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7efc6408dc90 con 0x7efc700fea30 2024-09-17T01:05:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.656+0000 7efc6ffff640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efc6006cc50 0x7efc6006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.656+0000 7efc6ffff640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efc6006cc50 0x7efc6006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000c00 tx=0x7efc5c0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:14.660+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc64058110 con 0x7efc700fea30 2024-09-17T01:05:14.926 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:14 smithi103 ceph-mon[28156]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:15.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:14 smithi143 ceph-mon[35452]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:15.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.029+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc70107640 con 0x7efc700fea30 2024-09-17T01:05:15.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.029+0000 7efc6dffb640 1 -- 172.21.15.103:0/1523297937 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7efc6405b730 con 0x7efc700fea30 2024-09-17T01:05:15.027 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:05:15.027 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:05:15.027 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:05:15.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:05:15.028 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:05:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efc6006cc50 msgr2=0x7efc6006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efc6006cc50 0x7efc6006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000c00 tx=0x7efc5c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 msgr2=0x7efc70194500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 0x7efc70194500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc6400eb00 tx=0x7efc64009f00 comp rx=0 tx=0).stop 2024-09-17T01:05:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 shutdown_connections 2024-09-17T01:05:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7efc6006cc50 0x7efc6006f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc700ffc30 0x7efc70194a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 --2- 172.21.15.103:0/1523297937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc700fea30 0x7efc70194500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 >> 172.21.15.103:0/1523297937 conn(0x7efc700fa1c0 msgr2=0x7efc70102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 shutdown_connections 2024-09-17T01:05:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.032+0000 7efc76a9f640 1 -- 172.21.15.103:0/1523297937 wait complete. 2024-09-17T01:05:15.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/3057401311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b981005c0 msgr2=0x7f4b981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/3057401311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b981005c0 0x7f4b981029b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4b880098b0 tx=0x7f4b8802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/3057401311 shutdown_connections 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/3057401311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b98102ef0 0x7f4b981052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/3057401311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b981005c0 0x7f4b981029b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/3057401311 >> 172.21.15.103:0/3057401311 conn(0x7f4b980fa1c0 msgr2=0x7f4b980fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/3057401311 shutdown_connections 2024-09-17T01:05:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.129+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/3057401311 wait complete. 2024-09-17T01:05:15.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.130+0000 7f4b9cc6b640 1 Processor -- start 2024-09-17T01:05:15.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.130+0000 7f4b9cc6b640 1 -- start start 2024-09-17T01:05:15.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.130+0000 7f4b9cc6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b981005c0 0x7f4b98191960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.130+0000 7f4b9cc6b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b98102ef0 0x7f4b98191ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b9cc6b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9818e450 con 0x7f4b98102ef0 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b9cc6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9818e5c0 con 0x7f4b981005c0 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b9659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b981005c0 0x7f4b98191960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b98102ef0 0x7f4b98191ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b9659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b981005c0 0x7f4b98191960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:41208/0 (socket says 172.21.15.103:41208) 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b9659c640 1 -- 172.21.15.103:0/309323665 learned_addr learned my addr 172.21.15.103:0/309323665 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b8ffff640 1 -- 172.21.15.103:0/309323665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b981005c0 msgr2=0x7f4b98191960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b8ffff640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b981005c0 0x7f4b98191960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b8ffff640 1 -- 172.21.15.103:0/309323665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009560 con 0x7f4b98102ef0 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b8ffff640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b98102ef0 0x7f4b98191ea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b98068740 tx=0x7f4b8000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.131+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b800051f0 con 0x7f4b98102ef0 2024-09-17T01:05:15.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.132+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9818e8a0 con 0x7f4b98102ef0 2024-09-17T01:05:15.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.132+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b80009c80 con 0x7f4b98102ef0 2024-09-17T01:05:15.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.132+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b80004dd0 con 0x7f4b98102ef0 2024-09-17T01:05:15.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.132+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9818ee70 con 0x7f4b98102ef0 2024-09-17T01:05:15.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.133+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98108770 con 0x7f4b98102ef0 2024-09-17T01:05:15.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.133+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4b800097c0 con 0x7f4b98102ef0 2024-09-17T01:05:15.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.134+0000 7f4b8f7fe640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f4b8406cc50 0x7f4b8406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.134+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4b8008b4d0 con 0x7f4b98102ef0 2024-09-17T01:05:15.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.134+0000 7f4b9659c640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f4b8406cc50 0x7f4b8406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.135+0000 7f4b9659c640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f4b8406cc50 0x7f4b8406f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000c00 tx=0x7f4b880314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:15.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.139+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4b800559d0 con 0x7f4b98102ef0 2024-09-17T01:05:15.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.489+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b98108980 con 0x7f4b98102ef0 2024-09-17T01:05:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.490+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/309323665 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7f4b80020770 con 0x7f4b98102ef0 2024-09-17T01:05:15.488 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:05:15.488 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:05:15.488 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:05:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:05:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f4b8406cc50 msgr2=0x7f4b8406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f4b8406cc50 0x7f4b8406f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000c00 tx=0x7f4b880314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b98102ef0 msgr2=0x7f4b98191ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b98102ef0 0x7f4b98191ea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b98068740 tx=0x7f4b8000db30 comp rx=0 tx=0).stop 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 shutdown_connections 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f4b8406cc50 0x7f4b8406f110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b98102ef0 0x7f4b98191ea0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 --2- 172.21.15.103:0/309323665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b981005c0 0x7f4b98191960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 >> 172.21.15.103:0/309323665 conn(0x7f4b980fa1c0 msgr2=0x7f4b980ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.492+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 shutdown_connections 2024-09-17T01:05:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.493+0000 7f4b9cc6b640 1 -- 172.21.15.103:0/309323665 wait complete. 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/903643676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a40ffb60 msgr2=0x7fa7a40fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/903643676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a40ffb60 0x7fa7a40fff60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa798009880 tx=0x7fa79802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/903643676 shutdown_connections 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/903643676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a4100d60 0x7fa7a41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/903643676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a40ffb60 0x7fa7a40fff60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/903643676 >> 172.21.15.103:0/903643676 conn(0x7fa7a40fb330 msgr2=0x7fa7a40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:15.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/903643676 shutdown_connections 2024-09-17T01:05:15.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.590+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/903643676 wait complete. 2024-09-17T01:05:15.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.591+0000 7fa7ab1cc640 1 Processor -- start 2024-09-17T01:05:15.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.591+0000 7fa7ab1cc640 1 -- start start 2024-09-17T01:05:15.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.591+0000 7fa7ab1cc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ffb60 0x7fa7a41955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.591+0000 7fa7ab1cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.591+0000 7fa7ab1cc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a41960e0 con 0x7fa7a4100d60 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.591+0000 7fa7ab1cc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4196250 con 0x7fa7a40ffb60 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59514/0 (socket says 172.21.15.103:59514) 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 -- 172.21.15.103:0/1862516981 learned_addr learned my addr 172.21.15.103:0/1862516981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a8f68640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ffb60 0x7fa7a41955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 -- 172.21.15.103:0/1862516981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ffb60 msgr2=0x7fa7a41955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ffb60 0x7fa7a41955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 -- 172.21.15.103:0/1862516981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009560 con 0x7fa7a4100d60 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a3fff640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa79000d900 tx=0x7fa79000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa790009c00 con 0x7fa7a4100d60 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa79000b660 con 0x7fa7a4100d60 2024-09-17T01:05:15.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a419ac80 con 0x7fa7a4100d60 2024-09-17T01:05:15.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.592+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79000f680 con 0x7fa7a4100d60 2024-09-17T01:05:15.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.593+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a419b250 con 0x7fa7a4100d60 2024-09-17T01:05:15.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.594+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a418f6e0 con 0x7fa7a4100d60 2024-09-17T01:05:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.594+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa790010ab0 con 0x7fa7a4100d60 2024-09-17T01:05:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.595+0000 7fa7a1ffb640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa79406cc50 0x7fa79406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.595+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa79008bf50 con 0x7fa7a4100d60 2024-09-17T01:05:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.595+0000 7fa7a8f68640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa79406cc50 0x7fa79406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.596+0000 7fa7a8f68640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa79406cc50 0x7fa79406f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa798009230 tx=0x7fa7980314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:15.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.600+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa7900bfe20 con 0x7fa7a4100d60 2024-09-17T01:05:15.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.823+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a402c4f0 con 0x7fa79406cc50 2024-09-17T01:05:15.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.824+0000 7fa7a1ffb640 1 -- 172.21.15.103:0/1862516981 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fa7a402c4f0 con 0x7fa79406cc50 2024-09-17T01:05:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:05:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:05:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:05:15.823 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:05:15.823 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [], 2024-09-17T01:05:15.823 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "", 2024-09-17T01:05:15.823 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f image", 2024-09-17T01:05:15.823 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:05:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa79406cc50 msgr2=0x7fa79406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa79406cc50 0x7fa79406f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa798009230 tx=0x7fa7980314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 msgr2=0x7fa7a4195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa79000d900 tx=0x7fa79000ddc0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 shutdown_connections 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fa79406cc50 0x7fa79406f110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4100d60 0x7fa7a4195b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 --2- 172.21.15.103:0/1862516981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ffb60 0x7fa7a41955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 >> 172.21.15.103:0/1862516981 conn(0x7fa7a40fb330 msgr2=0x7fa7a41044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:15.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 shutdown_connections 2024-09-17T01:05:15.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.827+0000 7fa7ab1cc640 1 -- 172.21.15.103:0/1862516981 wait complete. 2024-09-17T01:05:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 -- 172.21.15.103:0/2618308766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 msgr2=0x7ff8bc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/2618308766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc1000b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009880 tx=0x7ff8ac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 -- 172.21.15.103:0/2618308766 shutdown_connections 2024-09-17T01:05:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/2618308766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc1000b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/2618308766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 0x7ff8bc0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 -- 172.21.15.103:0/2618308766 >> 172.21.15.103:0/2618308766 conn(0x7ff8bc0fa1c0 msgr2=0x7ff8bc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 -- 172.21.15.103:0/2618308766 shutdown_connections 2024-09-17T01:05:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.920+0000 7ff8c39dd640 1 -- 172.21.15.103:0/2618308766 wait complete. 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c39dd640 1 Processor -- start 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c39dd640 1 -- start start 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c39dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 0x7ff8bc102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c39dd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc101520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c39dd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1992b0 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c39dd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc199420 con 0x7ff8bc0fea30 2024-09-17T01:05:15.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c0f78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc101520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c0f78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc101520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59526/0 (socket says 172.21.15.103:59526) 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c0f78640 1 -- 172.21.15.103:0/3114436715 learned_addr learned my addr 172.21.15.103:0/3114436715 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.921+0000 7ff8c1779640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 0x7ff8bc102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c0f78640 1 -- 172.21.15.103:0/3114436715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 msgr2=0x7ff8bc102e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c0f78640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 0x7ff8bc102e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c0f78640 1 -- 172.21.15.103:0/3114436715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009560 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c1779640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 0x7ff8bc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c0f78640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc101520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0054f0 tx=0x7ff8ac005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8ac004aa0 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8ac004c00 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc1996a0 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8ac003ac0 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.922+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc199c10 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.923+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc0fee30 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.924+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff8ac003d30 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.925+0000 7ff8b27fc640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff8a806cc50 0x7ff8a806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:15.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.925+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff8ac0ad370 con 0x7ff8bc0ffc30 2024-09-17T01:05:15.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.925+0000 7ff8c1779640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff8a806cc50 0x7ff8a806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:15.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.925+0000 7ff8c1779640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff8a806cc50 0x7ff8a806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0ffa90 tx=0x7ff8b800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:15.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:15.929+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff8ac077870 con 0x7ff8bc0ffc30 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:15 smithi143 ceph-mon[35452]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:15 smithi143 ceph-mon[35452]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:15 smithi143 ceph-mon[35452]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:15 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1523297937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:15 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/309323665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:15 smithi103 ceph-mon[28156]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:15 smithi103 ceph-mon[28156]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:16.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:15 smithi103 ceph-mon[28156]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-17T01:05:16.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:15 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1523297937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:15 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/309323665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:16.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.214+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff8bc101bb0 con 0x7ff8bc0ffc30 2024-09-17T01:05:16.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.214+0000 7ff8b27fc640 1 -- 172.21.15.103:0/3114436715 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff8ac07ae90 con 0x7ff8bc0ffc30 2024-09-17T01:05:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:05:16.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff8a806cc50 msgr2=0x7ff8a806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:16.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff8a806cc50 0x7ff8a806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0ffa90 tx=0x7ff8b800b390 comp rx=0 tx=0).stop 2024-09-17T01:05:16.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 msgr2=0x7ff8bc101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:16.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc101520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0054f0 tx=0x7ff8ac005520 comp rx=0 tx=0).stop 2024-09-17T01:05:16.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 shutdown_connections 2024-09-17T01:05:16.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff8a806cc50 0x7ff8a806f110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:16.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0ffc30 0x7ff8bc101520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:16.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 --2- 172.21.15.103:0/3114436715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8bc0fea30 0x7ff8bc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:16.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 >> 172.21.15.103:0/3114436715 conn(0x7ff8bc0fa1c0 msgr2=0x7ff8bc0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:16.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.216+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 shutdown_connections 2024-09-17T01:05:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:16.217+0000 7ff8c39dd640 1 -- 172.21.15.103:0/3114436715 wait complete. 2024-09-17T01:05:17.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:16 smithi143 ceph-mon[35452]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:17.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:16 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3114436715' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:16 smithi103 ceph-mon[28156]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:16 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3114436715' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:18.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:17 smithi143 ceph-mon[35452]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-17T01:05:18.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:17 smithi103 ceph-mon[28156]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-17T01:05:20.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:19 smithi143 ceph-mon[35452]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T01:05:20.092 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:19 smithi103 ceph-mon[28156]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-17T01:05:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:21 smithi143 ceph-mon[35452]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-17T01:05:22.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:21 smithi103 ceph-mon[28156]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-17T01:05:24.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:23 smithi143 ceph-mon[35452]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-17T01:05:24.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:24.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:23 smithi103 ceph-mon[28156]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-17T01:05:24.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:26.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:25 smithi143 ceph-mon[35452]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:26.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:25 smithi103 ceph-mon[28156]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:28.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:27 smithi143 ceph-mon[35452]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:28.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:27 smithi103 ceph-mon[28156]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:29 smithi103 ceph-mon[28156]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:29 smithi143 ceph-mon[35452]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:31.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:31 smithi103 ceph-mon[28156]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:31 smithi143 ceph-mon[35452]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:34.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:33 smithi103 ceph-mon[28156]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:34.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:33 smithi143 ceph-mon[35452]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:36.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:35 smithi143 ceph-mon[35452]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:36.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:35 smithi103 ceph-mon[28156]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:37 smithi103 ceph-mon[28156]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:38.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:37 smithi143 ceph-mon[35452]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:39.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:39 smithi103 ceph-mon[28156]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:39 smithi143 ceph-mon[35452]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:42.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:41 smithi103 ceph-mon[28156]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-17T01:05:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:41 smithi143 ceph-mon[35452]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-17T01:05:43.045 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:43 smithi103 ceph-mon[28156]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:43 smithi143 ceph-mon[35452]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:44 smithi103 ceph-mon[28156]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:05:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:44 smithi103 ceph-mon[28156]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:05:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:44 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:44 smithi103 ceph-mon[28156]: Upgrade: Need to upgrade myself (mgr.smithi103.efjaur) 2024-09-17T01:05:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:44 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:44 smithi143 ceph-mon[35452]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:05:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:44 smithi143 ceph-mon[35452]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:05:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:44 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:44 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:05:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:44 smithi143 ceph-mon[35452]: Upgrade: Need to upgrade myself (mgr.smithi103.efjaur) 2024-09-17T01:05:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:45 smithi103 ceph-mon[28156]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 on smithi143 2024-09-17T01:05:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:45 smithi103 ceph-mon[28156]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-17T01:05:46.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:45 smithi143 ceph-mon[35452]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 on smithi143 2024-09-17T01:05:46.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:45 smithi143 ceph-mon[35452]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-17T01:05:46.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 -- 172.21.15.103:0/3170943475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 msgr2=0x7fb7541029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 --2- 172.21.15.103:0/3170943475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7541029d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7440098b0 tx=0x7fb74402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 -- 172.21.15.103:0/3170943475 shutdown_connections 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 --2- 172.21.15.103:0/3170943475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb754102f10 0x7fb754105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 --2- 172.21.15.103:0/3170943475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7541029d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 -- 172.21.15.103:0/3170943475 >> 172.21.15.103:0/3170943475 conn(0x7fb7540fa1c0 msgr2=0x7fb7540fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 -- 172.21.15.103:0/3170943475 shutdown_connections 2024-09-17T01:05:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.334+0000 7fb75922e640 1 -- 172.21.15.103:0/3170943475 wait complete. 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.335+0000 7fb75922e640 1 Processor -- start 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.335+0000 7fb75922e640 1 -- start start 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb75922e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7540fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb75922e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb754102f10 0x7fb7540fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb75922e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540fead0 con 0x7fb7541005e0 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb75922e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540fec40 con 0x7fb754102f10 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb752d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7540fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb752d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7540fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57398/0 (socket says 172.21.15.103:57398) 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb752d9d640 1 -- 172.21.15.103:0/3293295177 learned_addr learned my addr 172.21.15.103:0/3293295177 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb75259c640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb754102f10 0x7fb7540fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb752d9d640 1 -- 172.21.15.103:0/3293295177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb754102f10 msgr2=0x7fb7540fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb752d9d640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb754102f10 0x7fb7540fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.336+0000 7fb752d9d640 1 -- 172.21.15.103:0/3293295177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009560 con 0x7fb7541005e0 2024-09-17T01:05:46.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.337+0000 7fb752d9d640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7540fff40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb744006010 tx=0x7fb7440054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:46.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.337+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb744004b60 con 0x7fb7541005e0 2024-09-17T01:05:46.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.337+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb744004cc0 con 0x7fb7541005e0 2024-09-17T01:05:46.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.337+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb744003b50 con 0x7fb7541005e0 2024-09-17T01:05:46.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.337+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540feec0 con 0x7fb7541005e0 2024-09-17T01:05:46.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.337+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75419d6b0 con 0x7fb7541005e0 2024-09-17T01:05:46.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.338+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb754108770 con 0x7fb7541005e0 2024-09-17T01:05:46.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.339+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb744003cb0 con 0x7fb7541005e0 2024-09-17T01:05:46.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.340+0000 7fb73bfff640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb73c06cc50 0x7fb73c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.340+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb7440ad2e0 con 0x7fb7541005e0 2024-09-17T01:05:46.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.340+0000 7fb75259c640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb73c06cc50 0x7fb73c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.341+0000 7fb75259c640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb73c06cc50 0x7fb73c06f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb748005fd0 tx=0x7fb748005850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:46.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.345+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb744077730 con 0x7fb7541005e0 2024-09-17T01:05:46.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.711+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb754103990 con 0x7fb73c06cc50 2024-09-17T01:05:46.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.712+0000 7fb73bfff640 1 -- 172.21.15.103:0/3293295177 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fb754103990 con 0x7fb73c06cc50 2024-09-17T01:05:46.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb73c06cc50 msgr2=0x7fb73c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb73c06cc50 0x7fb73c06f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb748005fd0 tx=0x7fb748005850 comp rx=0 tx=0).stop 2024-09-17T01:05:46.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 msgr2=0x7fb7540fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7540fff40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb744006010 tx=0x7fb7440054f0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 shutdown_connections 2024-09-17T01:05:46.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb73c06cc50 0x7fb73c06f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb754102f10 0x7fb7540fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 --2- 172.21.15.103:0/3293295177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7541005e0 0x7fb7540fff40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 >> 172.21.15.103:0/3293295177 conn(0x7fb7540fa1c0 msgr2=0x7fb7540fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:46.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 shutdown_connections 2024-09-17T01:05:46.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.715+0000 7fb75922e640 1 -- 172.21.15.103:0/3293295177 wait complete. 2024-09-17T01:05:46.727 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:05:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.817+0000 7fc364cbd640 1 -- 172.21.15.103:0/1779118140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3600fea30 msgr2=0x7fc3600fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.817+0000 7fc364cbd640 1 --2- 172.21.15.103:0/1779118140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3600fea30 0x7fc3600fee30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc350009880 tx=0x7fc35002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.818+0000 7fc364cbd640 1 -- 172.21.15.103:0/1779118140 shutdown_connections 2024-09-17T01:05:46.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.818+0000 7fc364cbd640 1 --2- 172.21.15.103:0/1779118140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 0x7fc3601000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.818+0000 7fc364cbd640 1 --2- 172.21.15.103:0/1779118140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3600fea30 0x7fc3600fee30 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc350009880 tx=0x7fc35002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.818+0000 7fc364cbd640 1 -- 172.21.15.103:0/1779118140 >> 172.21.15.103:0/1779118140 conn(0x7fc3600fa1c0 msgr2=0x7fc3600fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:46.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.818+0000 7fc364cbd640 1 -- 172.21.15.103:0/1779118140 shutdown_connections 2024-09-17T01:05:46.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.818+0000 7fc364cbd640 1 -- 172.21.15.103:0/1779118140 wait complete. 2024-09-17T01:05:46.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc364cbd640 1 Processor -- start 2024-09-17T01:05:46.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc364cbd640 1 -- start start 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc364cbd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 0x7fc360102950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc364cbd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 0x7fc360101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc364cbd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc360102e90 con 0x7fc360101010 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc364cbd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3601019d0 con 0x7fc3600ffc30 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 0x7fc360101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 0x7fc360102950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 0x7fc360102950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:59716/0 (socket says 172.21.15.103:59716) 2024-09-17T01:05:46.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc35e59c640 1 -- 172.21.15.103:0/136683910 learned_addr learned my addr 172.21.15.103:0/136683910 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.819+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 0x7fc360101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57418/0 (socket says 172.21.15.103:57418) 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc35dd9b640 1 -- 172.21.15.103:0/136683910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 msgr2=0x7fc360102950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc35dd9b640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 0x7fc360102950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc35dd9b640 1 -- 172.21.15.103:0/136683910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009560 con 0x7fc360101010 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc35dd9b640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 0x7fc360101490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc35400e970 tx=0x7fc35400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc354009640 con 0x7fc360101010 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc360101c50 con 0x7fc360101010 2024-09-17T01:05:46.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36019dae0 con 0x7fc360101010 2024-09-17T01:05:46.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc35400cc90 con 0x7fc360101010 2024-09-17T01:05:46.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.820+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc354018770 con 0x7fc360101010 2024-09-17T01:05:46.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.822+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360107620 con 0x7fc360101010 2024-09-17T01:05:46.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.822+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc354010b60 con 0x7fc360101010 2024-09-17T01:05:46.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.822+0000 7fc34f7fe640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc34806cc50 0x7fc34806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.823+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc354014070 con 0x7fc360101010 2024-09-17T01:05:46.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.823+0000 7fc35e59c640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc34806cc50 0x7fc34806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.823+0000 7fc35e59c640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc34806cc50 0x7fc34806f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc350000c00 tx=0x7fc3500314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:46.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:46.831+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc354052e20 con 0x7fc360101010 2024-09-17T01:05:47.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.196+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3600682f0 con 0x7fc34806cc50 2024-09-17T01:05:47.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.198+0000 7fc34f7fe640 1 -- 172.21.15.103:0/136683910 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc3600682f0 con 0x7fc34806cc50 2024-09-17T01:05:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc34806cc50 msgr2=0x7fc34806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc34806cc50 0x7fc34806f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc350000c00 tx=0x7fc3500314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 msgr2=0x7fc360101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 0x7fc360101490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc35400e970 tx=0x7fc35400ee30 comp rx=0 tx=0).stop 2024-09-17T01:05:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 shutdown_connections 2024-09-17T01:05:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc34806cc50 0x7fc34806f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc360101010 0x7fc360101490 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 --2- 172.21.15.103:0/136683910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3600ffc30 0x7fc360102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 >> 172.21.15.103:0/136683910 conn(0x7fc3600fa1c0 msgr2=0x7fc360067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 shutdown_connections 2024-09-17T01:05:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.201+0000 7fc364cbd640 1 -- 172.21.15.103:0/136683910 wait complete. 2024-09-17T01:05:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 -- 172.21.15.103:0/4120712402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c1005e0 msgr2=0x7f2b5c1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/4120712402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c1005e0 0x7f2b5c1029d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2b500098b0 tx=0x7f2b5002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 -- 172.21.15.103:0/4120712402 shutdown_connections 2024-09-17T01:05:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/4120712402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c102f10 0x7f2b5c105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/4120712402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c1005e0 0x7f2b5c1029d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 -- 172.21.15.103:0/4120712402 >> 172.21.15.103:0/4120712402 conn(0x7f2b5c0fa1c0 msgr2=0x7f2b5c0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 -- 172.21.15.103:0/4120712402 shutdown_connections 2024-09-17T01:05:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.322+0000 7f2b62cd8640 1 -- 172.21.15.103:0/4120712402 wait complete. 2024-09-17T01:05:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b62cd8640 1 Processor -- start 2024-09-17T01:05:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b62cd8640 1 -- start start 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b62cd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c102f10 0x7f2b5c0fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b62cd8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c0fe590 0x7f2b5c0fea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b62cd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c100480 con 0x7f2b5c102f10 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b62cd8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0fef80 con 0x7f2b5c0fe590 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b60a74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c102f10 0x7f2b5c0fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b60a74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c102f10 0x7f2b5c0fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57434/0 (socket says 172.21.15.103:57434) 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c0fe590 0x7f2b5c0fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.323+0000 7f2b60a74640 1 -- 172.21.15.103:0/1974532441 learned_addr learned my addr 172.21.15.103:0/1974532441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.324+0000 7f2b5bfff640 1 -- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c102f10 msgr2=0x7f2b5c0fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.324+0000 7f2b5bfff640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c102f10 0x7f2b5c0fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.324+0000 7f2b5bfff640 1 -- 172.21.15.103:0/1974532441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009560 con 0x7f2b5c0fe590 2024-09-17T01:05:47.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.324+0000 7f2b5bfff640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c0fe590 0x7f2b5c0fea10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e940 tx=0x7f2b4800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:47.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.324+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b48009640 con 0x7f2b5c0fe590 2024-09-17T01:05:47.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.324+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c0ff260 con 0x7f2b5c0fe590 2024-09-17T01:05:47.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.325+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c19db50 con 0x7f2b5c0fe590 2024-09-17T01:05:47.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.325+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b4800cc90 con 0x7f2b5c0fe590 2024-09-17T01:05:47.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.325+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b48018770 con 0x7f2b5c0fe590 2024-09-17T01:05:47.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.326+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b40005280 con 0x7f2b5c0fe590 2024-09-17T01:05:47.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.327+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2b48010430 con 0x7f2b5c0fe590 2024-09-17T01:05:47.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.327+0000 7f2b59ffb640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2b4c06cc50 0x7f2b4c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:47.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.327+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2b48014070 con 0x7f2b5c0fe590 2024-09-17T01:05:47.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.328+0000 7f2b60a74640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2b4c06cc50 0x7f2b4c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:47.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.328+0000 7f2b60a74640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2b4c06cc50 0x7f2b4c06f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b50000c00 tx=0x7f2b500314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:47.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.333+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2b48052e20 con 0x7f2b5c0fe590 2024-09-17T01:05:47.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.585+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b40000bf0 con 0x7f2b4c06cc50 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.603+0000 7f2b59ffb640 1 -- 172.21.15.103:0/1974532441 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f2b40000bf0 con 0x7f2b4c06cc50 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (5m) 61s ago 6m 25.2M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (6m) 61s ago 6m 7558k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (5m) 67s ago 5m 7415k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (6m) 61s ago 6m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:05:47.602 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (5m) 67s ago 5m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (5m) 61s ago 6m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (85s) 61s ago 85s 16.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (80s) 61s ago 80s 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (78s) 67s ago 77s 11.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (83s) 67s ago 82s 13.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:9283,8765,8443 running (8m) 61s ago 8m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 29c1c8578f11 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (5m) 67s ago 5m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 f45a460ef3a5 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (8m) 61s ago 8m 45.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (5m) 67s ago 5m 35.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (6m) 61s ago 6m 16.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (5m) 67s ago 5m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (4m) 61s ago 4m 50.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:05:47.603 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (4m) 61s ago 4m 47.0M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:05:47.604 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (4m) 61s ago 4m 52.9M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:05:47.604 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (3m) 67s ago 3m 45.4M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:05:47.604 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (3m) 67s ago 3m 44.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:05:47.604 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (2m) 67s ago 2m 50.7M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:05:47.604 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (5m) 61s ago 6m 55.0M - 2.43.0 a07b618ecd1d e84d3109ab0e 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2b4c06cc50 msgr2=0x7f2b4c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2b4c06cc50 0x7f2b4c06f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b50000c00 tx=0x7f2b500314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c0fe590 msgr2=0x7f2b5c0fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c0fe590 0x7f2b5c0fea10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e940 tx=0x7f2b4800ee00 comp rx=0 tx=0).stop 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 shutdown_connections 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f2b4c06cc50 0x7f2b4c06f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b5c0fe590 0x7f2b5c0fea10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 --2- 172.21.15.103:0/1974532441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b5c102f10 0x7f2b5c0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 >> 172.21.15.103:0/1974532441 conn(0x7f2b5c0fa1c0 msgr2=0x7f2b5c0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:47.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 shutdown_connections 2024-09-17T01:05:47.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.606+0000 7f2b62cd8640 1 -- 172.21.15.103:0/1974532441 wait complete. 2024-09-17T01:05:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.691+0000 7ff1eeb23640 1 -- 172.21.15.103:0/3663443165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 msgr2=0x7ff1e80ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.691+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/3663443165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e80ff1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009880 tx=0x7ff1d802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.691+0000 7ff1eeb23640 1 -- 172.21.15.103:0/3663443165 shutdown_connections 2024-09-17T01:05:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.691+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/3663443165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e80ff1b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.691+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/3663443165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 0x7ff1e80fe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.691+0000 7ff1eeb23640 1 -- 172.21.15.103:0/3663443165 >> 172.21.15.103:0/3663443165 conn(0x7ff1e80fa1c0 msgr2=0x7ff1e80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 -- 172.21.15.103:0/3663443165 shutdown_connections 2024-09-17T01:05:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 -- 172.21.15.103:0/3663443165 wait complete. 2024-09-17T01:05:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 Processor -- start 2024-09-17T01:05:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 -- start start 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 0x7ff1e81977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e8197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81982f0 con 0x7ff1e80fed50 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.692+0000 7ff1eeb23640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8198460 con 0x7ff1e80fe410 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e8197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e8197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57460/0 (socket says 172.21.15.103:57460) 2024-09-17T01:05:47.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1dffff640 1 -- 172.21.15.103:0/1597255427 learned_addr learned my addr 172.21.15.103:0/1597255427 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1ec8bf640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 0x7ff1e81977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1ec8bf640 1 -- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 msgr2=0x7ff1e8197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1ec8bf640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e8197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1ec8bf640 1 -- 172.21.15.103:0/1597255427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8009560 con 0x7ff1e80fe410 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1dffff640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e8197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1ec8bf640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 0x7ff1e81977e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400e970 tx=0x7ff1e400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.693+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e4009620 con 0x7ff1e80fe410 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.694+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1e40044f0 con 0x7ff1e80fe410 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.694+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e819cf00 con 0x7ff1e80fe410 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.694+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e40049d0 con 0x7ff1e80fe410 2024-09-17T01:05:47.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.694+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e819d3e0 con 0x7ff1e80fe410 2024-09-17T01:05:47.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.696+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff1e400cc90 con 0x7ff1e80fe410 2024-09-17T01:05:47.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.696+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e80fe810 con 0x7ff1e80fe410 2024-09-17T01:05:47.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.696+0000 7ff1ddffb640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff1d006ca40 0x7ff1d006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:47.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.697+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff1e4014070 con 0x7ff1e80fe410 2024-09-17T01:05:47.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.697+0000 7ff1dffff640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff1d006ca40 0x7ff1d006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.697+0000 7ff1dffff640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff1d006ca40 0x7ff1d006ef00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8198d00 tx=0x7ff1d80314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:47.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.702+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff1e4056940 con 0x7ff1e80fe410 2024-09-17T01:05:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:47 smithi103 ceph-mon[28156]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-17T01:05:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:47 smithi103 ceph-mon[28156]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:47.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.943+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff1e819d920 con 0x7ff1e80fe410 2024-09-17T01:05:47.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.944+0000 7ff1ddffb640 1 -- 172.21.15.103:0/1597255427 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7ff1e4059f60 con 0x7ff1e80fe410 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:47.943 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:05:47.944 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:05:47.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:05:47.944 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:05:47.944 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T01:05:47.944 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:05:47.944 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:05:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.946+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff1d006ca40 msgr2=0x7ff1d006ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.946+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff1d006ca40 0x7ff1d006ef00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8198d00 tx=0x7ff1d80314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.946+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 msgr2=0x7ff1e81977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.946+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 0x7ff1e81977e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400e970 tx=0x7ff1e400ee30 comp rx=0 tx=0).stop 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 shutdown_connections 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff1d006ca40 0x7ff1d006ef00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1e80fed50 0x7ff1e8197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 --2- 172.21.15.103:0/1597255427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1e80fe410 0x7ff1e81977e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 >> 172.21.15.103:0/1597255427 conn(0x7ff1e80fa1c0 msgr2=0x7ff1e8106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 shutdown_connections 2024-09-17T01:05:47.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:47.947+0000 7ff1eeb23640 1 -- 172.21.15.103:0/1597255427 wait complete. 2024-09-17T01:05:48.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 -- 172.21.15.103:0/1169204839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140ffc30 msgr2=0x7f77141000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 --2- 172.21.15.103:0/1169204839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140ffc30 0x7f77141000b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7704009880 tx=0x7f770402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 -- 172.21.15.103:0/1169204839 shutdown_connections 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 --2- 172.21.15.103:0/1169204839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140ffc30 0x7f77141000b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 --2- 172.21.15.103:0/1169204839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77140fea30 0x7f77140fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 -- 172.21.15.103:0/1169204839 >> 172.21.15.103:0/1169204839 conn(0x7f77140fa1c0 msgr2=0x7f77140fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 -- 172.21.15.103:0/1169204839 shutdown_connections 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.072+0000 7f771ba82640 1 -- 172.21.15.103:0/1169204839 wait complete. 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771ba82640 1 Processor -- start 2024-09-17T01:05:48.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771ba82640 1 -- start start 2024-09-17T01:05:48.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771ba82640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 0x7f7714195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771ba82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77140ffc30 0x7f7714195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771ba82640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714196160 con 0x7f77140fea30 2024-09-17T01:05:48.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771ba82640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141962d0 con 0x7f77140ffc30 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771981e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 0x7f7714195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771981e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 0x7f7714195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57486/0 (socket says 172.21.15.103:57486) 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771981e640 1 -- 172.21.15.103:0/1659851128 learned_addr learned my addr 172.21.15.103:0/1659851128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.073+0000 7f771901d640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77140ffc30 0x7f7714195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f771981e640 1 -- 172.21.15.103:0/1659851128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77140ffc30 msgr2=0x7f7714195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f771981e640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77140ffc30 0x7f7714195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f771981e640 1 -- 172.21.15.103:0/1659851128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7704009560 con 0x7f77140fea30 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f771981e640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 0x7f7714195650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f771000e970 tx=0x7f771000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7710009700 con 0x7f77140fea30 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f771000cc90 con 0x7f77140fea30 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.074+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7714100eb0 con 0x7f77140fea30 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.075+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7710010430 con 0x7f77140fea30 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.075+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7714101450 con 0x7f77140fea30 2024-09-17T01:05:48.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.076+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77140fee30 con 0x7f77140fea30 2024-09-17T01:05:48.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.077+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7710003f90 con 0x7f77140fea30 2024-09-17T01:05:48.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.077+0000 7f770affd640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f770006ca40 0x7f770006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.077+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7710014070 con 0x7f77140fea30 2024-09-17T01:05:48.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.078+0000 7f771901d640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f770006ca40 0x7f770006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.078+0000 7f771901d640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f770006ca40 0x7f770006ef00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7704000c00 tx=0x7f7704005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:48.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.085+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7710056bd0 con 0x7f77140fea30 2024-09-17T01:05:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:47 smithi143 ceph-mon[35452]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-17T01:05:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:47 smithi143 ceph-mon[35452]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:48.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.373+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7714101900 con 0x7f77140fea30 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.373+0000 7f770affd640 1 -- 172.21.15.103:0/1659851128 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7f771005a1f0 con 0x7f77140fea30 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:05:48.373 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:48.374 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:05:48.375 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:48.376 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:05:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.376+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f770006ca40 msgr2=0x7f770006ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.376+0000 7f771ba82640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f770006ca40 0x7f770006ef00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7704000c00 tx=0x7f7704005a20 comp rx=0 tx=0).stop 2024-09-17T01:05:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 msgr2=0x7f7714195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 0x7f7714195650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f771000e970 tx=0x7f771000ee30 comp rx=0 tx=0).stop 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 shutdown_connections 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f770006ca40 0x7f770006ef00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77140ffc30 0x7f7714195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 --2- 172.21.15.103:0/1659851128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77140fea30 0x7f7714195650 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 >> 172.21.15.103:0/1659851128 conn(0x7f77140fa1c0 msgr2=0x7f7714067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 shutdown_connections 2024-09-17T01:05:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.377+0000 7f771ba82640 1 -- 172.21.15.103:0/1659851128 wait complete. 2024-09-17T01:05:48.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.464+0000 7fc440210640 1 -- 172.21.15.103:0/589383601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 msgr2=0x7fc4381000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.464+0000 7fc440210640 1 --2- 172.21.15.103:0/589383601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 0x7fc4381000b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc428009880 tx=0x7fc42802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.464+0000 7fc440210640 1 -- 172.21.15.103:0/589383601 shutdown_connections 2024-09-17T01:05:48.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.464+0000 7fc440210640 1 --2- 172.21.15.103:0/589383601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 0x7fc4381000b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.464+0000 7fc440210640 1 --2- 172.21.15.103:0/589383601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc4380fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.465+0000 7fc440210640 1 -- 172.21.15.103:0/589383601 >> 172.21.15.103:0/589383601 conn(0x7fc4380fa1c0 msgr2=0x7fc4380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:48.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.465+0000 7fc440210640 1 -- 172.21.15.103:0/589383601 shutdown_connections 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.465+0000 7fc440210640 1 -- 172.21.15.103:0/589383601 wait complete. 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc440210640 1 Processor -- start 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc440210640 1 -- start start 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc440210640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc438195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc440210640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 0x7fc438195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc440210640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438196160 con 0x7fc4380ffc30 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc440210640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4381962d0 con 0x7fc4380fea30 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc43dfac640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc438195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc43dfac640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc438195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:59790/0 (socket says 172.21.15.103:59790) 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc43dfac640 1 -- 172.21.15.103:0/994838854 learned_addr learned my addr 172.21.15.103:0/994838854 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.466+0000 7fc43d7ab640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 0x7fc438195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc43dfac640 1 -- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 msgr2=0x7fc438195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc43dfac640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 0x7fc438195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc43dfac640 1 -- 172.21.15.103:0/994838854 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428009560 con 0x7fc4380fea30 2024-09-17T01:05:48.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc43dfac640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc438195650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc43400d8d0 tx=0x7fc43400dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43400bea0 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43819ad70 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc434009c00 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43400f790 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.467+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43819b230 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.468+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4380fee30 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.469+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc43400fa50 con 0x7fc4380fea30 2024-09-17T01:05:48.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.470+0000 7fc42effd640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc42406cc50 0x7fc42406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.470+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc43408c600 con 0x7fc4380fea30 2024-09-17T01:05:48.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.470+0000 7fc43d7ab640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc42406cc50 0x7fc42406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.470+0000 7fc43d7ab640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc42406cc50 0x7fc42406f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc428000c00 tx=0x7fc4280314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:48.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.475+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc4340569a0 con 0x7fc4380fea30 2024-09-17T01:05:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.661+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4380683c0 con 0x7fc42406cc50 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.662+0000 7fc42effd640 1 -- 172.21.15.103:0/994838854 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc4380683c0 con 0x7fc42406cc50 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [], 2024-09-17T01:05:48.661 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:05:48.662 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 image on host smithi143", 2024-09-17T01:05:48.662 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:05:48.662 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:05:48.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc42406cc50 msgr2=0x7fc42406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc42406cc50 0x7fc42406f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc428000c00 tx=0x7fc4280314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 msgr2=0x7fc438195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc438195650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc43400d8d0 tx=0x7fc43400dd90 comp rx=0 tx=0).stop 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 shutdown_connections 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fc42406cc50 0x7fc42406f110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4380ffc30 0x7fc438195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 --2- 172.21.15.103:0/994838854 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4380fea30 0x7fc438195650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 >> 172.21.15.103:0/994838854 conn(0x7fc4380fa1c0 msgr2=0x7fc438067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 shutdown_connections 2024-09-17T01:05:48.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.665+0000 7fc440210640 1 -- 172.21.15.103:0/994838854 wait complete. 2024-09-17T01:05:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.748+0000 7f07d9b43640 1 -- 172.21.15.103:0/1224110210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 msgr2=0x7f07d4073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.748+0000 7f07d9b43640 1 --2- 172.21.15.103:0/1224110210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d4073260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009880 tx=0x7f07c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.748+0000 7f07d9b43640 1 -- 172.21.15.103:0/1224110210 shutdown_connections 2024-09-17T01:05:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.748+0000 7f07d9b43640 1 --2- 172.21.15.103:0/1224110210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d4073260 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.748+0000 7f07d9b43640 1 --2- 172.21.15.103:0/1224110210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07d4074460 0x7f07d40728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.748+0000 7f07d9b43640 1 -- 172.21.15.103:0/1224110210 >> 172.21.15.103:0/1224110210 conn(0x7f07d40fb2f0 msgr2=0x7f07d40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.749+0000 7f07d9b43640 1 -- 172.21.15.103:0/1224110210 shutdown_connections 2024-09-17T01:05:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.749+0000 7f07d9b43640 1 -- 172.21.15.103:0/1224110210 wait complete. 2024-09-17T01:05:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.749+0000 7f07d9b43640 1 Processor -- start 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d9b43640 1 -- start start 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d9b43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d9b43640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07d4074460 0x7f07d4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d9b43640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41982d0 con 0x7f07d4072e00 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d9b43640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4198440 con 0x7f07d4074460 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d41977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57528/0 (socket says 172.21.15.103:57528) 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d37fe640 1 -- 172.21.15.103:0/109103509 learned_addr learned my addr 172.21.15.103:0/109103509 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d2ffd640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07d4074460 0x7f07d4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d37fe640 1 -- 172.21.15.103:0/109103509 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07d4074460 msgr2=0x7f07d4197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d37fe640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07d4074460 0x7f07d4197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.750+0000 7f07d37fe640 1 -- 172.21.15.103:0/109103509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8009560 con 0x7f07d4072e00 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.751+0000 7f07d37fe640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d41977c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07c400e9a0 tx=0x7f07c400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.751+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c400cc90 con 0x7f07d4072e00 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.751+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d419cee0 con 0x7f07d4072e00 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.751+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07c400cdf0 con 0x7f07d4072e00 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.751+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c40187f0 con 0x7f07d4072e00 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.751+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d419d420 con 0x7f07d4072e00 2024-09-17T01:05:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.753+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d4073260 con 0x7f07d4072e00 2024-09-17T01:05:48.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.753+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f07c4010c10 con 0x7f07d4072e00 2024-09-17T01:05:48.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.753+0000 7f07d0ff9640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f07bc06cc50 0x7f07bc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:48.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.754+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f07c4014070 con 0x7f07d4072e00 2024-09-17T01:05:48.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.754+0000 7f07d2ffd640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f07bc06cc50 0x7f07bc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:48.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.754+0000 7f07d2ffd640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f07bc06cc50 0x7f07bc06f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f07c8000c00 tx=0x7f07c80314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:48.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.758+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f07c4052e20 con 0x7f07d4072e00 2024-09-17T01:05:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:48 smithi103 ceph-mon[28156]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:48 smithi103 ceph-mon[28156]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:48 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1597255427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:48.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:48 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1659851128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:48.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.992+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f07d410a910 con 0x7f07d4072e00 2024-09-17T01:05:48.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.992+0000 7f07d0ff9640 1 -- 172.21.15.103:0/109103509 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f07c4056a60 con 0x7f07d4072e00 2024-09-17T01:05:48.992 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:05:48.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.994+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f07bc06cc50 msgr2=0x7f07bc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.994+0000 7f07d9b43640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f07bc06cc50 0x7f07bc06f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f07c8000c00 tx=0x7f07c80314e0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.994+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 msgr2=0x7f07d41977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:48.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.994+0000 7f07d9b43640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d41977c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07c400e9a0 tx=0x7f07c400ee60 comp rx=0 tx=0).stop 2024-09-17T01:05:48.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 shutdown_connections 2024-09-17T01:05:48.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f07bc06cc50 0x7f07bc06f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07d4074460 0x7f07d4197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 --2- 172.21.15.103:0/109103509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07d4072e00 0x7f07d41977c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:48.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 >> 172.21.15.103:0/109103509 conn(0x7f07d40fb2f0 msgr2=0x7f07d41059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:48.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 shutdown_connections 2024-09-17T01:05:48.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:05:48.995+0000 7f07d9b43640 1 -- 172.21.15.103:0/109103509 wait complete. 2024-09-17T01:05:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:48 smithi143 ceph-mon[35452]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:48 smithi143 ceph-mon[35452]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:48 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1597255427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:48 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1659851128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:49 smithi103 ceph-mon[28156]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:49 smithi103 ceph-mon[28156]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:49 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/109103509' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:49 smithi143 ceph-mon[35452]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:49 smithi143 ceph-mon[35452]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:49 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/109103509' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:52.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:51 smithi103 ceph-mon[28156]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:52.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:51 smithi143 ceph-mon[35452]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:54.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:53 smithi103 ceph-mon[28156]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:54.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:53 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:54.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:53 smithi143 ceph-mon[35452]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:05:54.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:53 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:56.092 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:55 smithi103 ceph-mon[28156]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:55 smithi143 ceph-mon[35452]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:58.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:57 smithi103 ceph-mon[28156]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:58.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:57 smithi143 ceph-mon[35452]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:05:59.547 INFO:tasks.workunit.client.1.smithi143.stderr:Updating files: 88% (11377/12893) Updating files: 89% (11475/12893) Updating files: 90% (11604/12893) Updating files: 91% (11733/12893) Updating files: 92% (11862/12893) Updating files: 93% (11991/12893) Updating files: 94% (12120/12893) Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T01:06:00.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:05:59 smithi103 ceph-mon[28156]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:06:00.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:05:59 smithi143 ceph-mon[35452]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:06:00.356 INFO:tasks.workunit.client.1.smithi143.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:06:00.356 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.356 INFO:tasks.workunit.client.1.smithi143.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:06:00.356 INFO:tasks.workunit.client.1.smithi143.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:06:00.356 INFO:tasks.workunit.client.1.smithi143.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: git switch -c 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr:Or undo this operation with: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: git switch - 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr: 2024-09-17T01:06:00.357 INFO:tasks.workunit.client.1.smithi143.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:06:00.362 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-17T01:06:00.424 INFO:tasks.workunit.client.1.smithi143.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:06:00.426 INFO:tasks.workunit.client.1.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:06:00.426 INFO:tasks.workunit.client.1.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:06:00.842 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-17T01:06:00.843 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:06:00.847 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T01:06:00.910 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:06:00.912 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:06:00.913 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:06:01.129 INFO:tasks.workunit.client.1.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:06:01.196 INFO:tasks.workunit.client.1.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:06:01.237 INFO:tasks.workunit.client.1.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:06:01.239 INFO:tasks.workunit.client.1.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:06:01.239 INFO:tasks.workunit.client.1.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:06:01.279 INFO:tasks.workunit.client.1.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:06:01.283 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-17T01:06:01.283 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-17T01:06:01.339 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-17T01:06:01.340 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:06:01.341 DEBUG:teuthology.orchestra.run.smithi143:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-17T01:06:01.404 INFO:tasks.workunit.client.1.smithi143.stderr:+ mkdir -p fsstress 2024-09-17T01:06:01.406 INFO:tasks.workunit.client.1.smithi143.stderr:+ pushd fsstress 2024-09-17T01:06:01.408 INFO:tasks.workunit.client.1.smithi143.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:06:01.408 INFO:tasks.workunit.client.1.smithi143.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:06:01.656 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:06:01.717 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:06:01.756 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:06:01.758 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:06:01.758 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:06:01.797 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:06:01.800 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:06:01.800 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T01:06:01.857 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T01:06:01.858 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:06:01.858 DEBUG:teuthology.orchestra.run.smithi103:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T01:06:01.921 INFO:tasks.workunit.client.0.smithi103.stderr:+ mkdir -p fsstress 2024-09-17T01:06:01.923 INFO:tasks.workunit.client.0.smithi103.stderr:+ pushd fsstress 2024-09-17T01:06:01.925 INFO:tasks.workunit.client.0.smithi103.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:06:01.925 INFO:tasks.workunit.client.0.smithi103.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:06:01.951 INFO:tasks.workunit.client.1.smithi143.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:06:02.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:01 smithi143 ceph-mon[35452]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:06:02.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:01 smithi103 ceph-mon[28156]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:06:02.515 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:06:04.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:03 smithi103 ceph-mon[28156]: pgmap v225: 65 pgs: 65 active+clean; 758 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 16 KiB/s wr, 4 op/s 2024-09-17T01:06:04.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:03 smithi143 ceph-mon[35452]: pgmap v225: 65 pgs: 65 active+clean; 758 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 16 KiB/s wr, 4 op/s 2024-09-17T01:06:06.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:05 smithi103 ceph-mon[28156]: pgmap v226: 65 pgs: 65 active+clean; 7.9 MiB data, 192 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 635 KiB/s wr, 21 op/s 2024-09-17T01:06:06.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:05 smithi143 ceph-mon[35452]: pgmap v226: 65 pgs: 65 active+clean; 7.9 MiB data, 192 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 635 KiB/s wr, 21 op/s 2024-09-17T01:06:08.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:07 smithi103 ceph-mon[28156]: pgmap v227: 65 pgs: 65 active+clean; 9.4 MiB data, 225 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 790 KiB/s wr, 58 op/s 2024-09-17T01:06:08.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:07 smithi143 ceph-mon[35452]: pgmap v227: 65 pgs: 65 active+clean; 9.4 MiB data, 225 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 790 KiB/s wr, 58 op/s 2024-09-17T01:06:09.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:08 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:08 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:09 smithi103 ceph-mon[28156]: pgmap v228: 65 pgs: 65 active+clean; 33 MiB data, 297 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.8 MiB/s wr, 204 op/s 2024-09-17T01:06:10.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:09 smithi143 ceph-mon[35452]: pgmap v228: 65 pgs: 65 active+clean; 33 MiB data, 297 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.8 MiB/s wr, 204 op/s 2024-09-17T01:06:12.118 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:11 smithi143 ceph-mon[35452]: pgmap v229: 65 pgs: 65 active+clean; 40 MiB data, 327 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2024-09-17T01:06:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:11 smithi103 ceph-mon[28156]: pgmap v229: 65 pgs: 65 active+clean; 40 MiB data, 327 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2024-09-17T01:06:14.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:13 smithi143 ceph-mon[35452]: pgmap v230: 65 pgs: 65 active+clean; 56 MiB data, 409 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 423 op/s 2024-09-17T01:06:14.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:13 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:14.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:13 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:06:14.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:13 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:06:14.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:13 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:14.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:13 smithi103 ceph-mon[28156]: pgmap v230: 65 pgs: 65 active+clean; 56 MiB data, 409 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 423 op/s 2024-09-17T01:06:14.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:13 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:14.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:13 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:06:14.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:13 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:06:14.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:13 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:14 smithi103 ceph-mon[28156]: Upgrade: Updating mgr.smithi143.sxhocv 2024-09-17T01:06:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:14 smithi103 ceph-mon[28156]: Deploying daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:06:15.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:14 smithi143 ceph-mon[35452]: Upgrade: Updating mgr.smithi143.sxhocv 2024-09-17T01:06:15.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:14 smithi143 ceph-mon[35452]: Deploying daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:06:16.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:15 smithi143 ceph-mon[35452]: pgmap v231: 65 pgs: 65 active+clean; 57 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 450 op/s 2024-09-17T01:06:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:15 smithi103 ceph-mon[28156]: pgmap v231: 65 pgs: 65 active+clean; 57 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 450 op/s 2024-09-17T01:06:18.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:17 smithi103 ceph-mon[28156]: pgmap v232: 65 pgs: 65 active+clean; 66 MiB data, 432 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 482 op/s 2024-09-17T01:06:18.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:17 smithi143 ceph-mon[35452]: pgmap v232: 65 pgs: 65 active+clean; 66 MiB data, 432 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 482 op/s 2024-09-17T01:06:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 -- 172.21.15.103:0/3939611088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 msgr2=0x7f90f40fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/3939611088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f40fee30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009880 tx=0x7f90e402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 -- 172.21.15.103:0/3939611088 shutdown_connections 2024-09-17T01:06:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/3939611088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 0x7f90f41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/3939611088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f40fee30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 -- 172.21.15.103:0/3939611088 >> 172.21.15.103:0/3939611088 conn(0x7f90f40fa1c0 msgr2=0x7f90f40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 -- 172.21.15.103:0/3939611088 shutdown_connections 2024-09-17T01:06:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.102+0000 7f90f8d3b640 1 -- 172.21.15.103:0/3939611088 wait complete. 2024-09-17T01:06:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f8d3b640 1 Processor -- start 2024-09-17T01:06:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f8d3b640 1 -- start start 2024-09-17T01:06:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f8d3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f4195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f8d3b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 0x7f90f4195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f8d3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4196140 con 0x7f90f40fea30 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f8d3b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f41962b0 con 0x7f90f40ffc30 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f4195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f4195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49830/0 (socket says 172.21.15.103:49830) 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90f259c640 1 -- 172.21.15.103:0/2574506404 learned_addr learned my addr 172.21.15.103:0/2574506404 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.103+0000 7f90ebfff640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 0x7f90f4195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90ebfff640 1 -- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 msgr2=0x7f90f4195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90ebfff640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f4195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90ebfff640 1 -- 172.21.15.103:0/2574506404 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4009560 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90f259c640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f4195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90ebfff640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 0x7f90f4195b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e970 tx=0x7f90dc00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90dc009620 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.104+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f419ad50 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.105+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f419b320 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.105+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90dc0044f0 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.105+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90dc0049d0 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.106+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d4005280 con 0x7f90f40ffc30 2024-09-17T01:06:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.106+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f90dc004030 con 0x7f90f40ffc30 2024-09-17T01:06:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.107+0000 7f90eb7fe640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f90e006cc50 0x7f90e006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.107+0000 7f90f259c640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f90e006cc50 0x7f90e006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.107+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f90dc014070 con 0x7f90f40ffc30 2024-09-17T01:06:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.108+0000 7f90f259c640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f90e006cc50 0x7f90e006f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90e4000c00 tx=0x7f90e40314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.112+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f90dc056820 con 0x7f90f40ffc30 2024-09-17T01:06:19.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.313+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90d4000bf0 con 0x7f90e006cc50 2024-09-17T01:06:19.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.315+0000 7f90eb7fe640 1 -- 172.21.15.103:0/2574506404 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f90d4000bf0 con 0x7f90e006cc50 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.317+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f90e006cc50 msgr2=0x7f90e006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.317+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f90e006cc50 0x7f90e006f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90e4000c00 tx=0x7f90e40314e0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 msgr2=0x7f90f4195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 0x7f90f4195b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e970 tx=0x7f90dc00ee30 comp rx=0 tx=0).stop 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 shutdown_connections 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f90e006cc50 0x7f90e006f110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90f40ffc30 0x7f90f4195b70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 --2- 172.21.15.103:0/2574506404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f40fea30 0x7f90f4195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 >> 172.21.15.103:0/2574506404 conn(0x7f90f40fa1c0 msgr2=0x7f90f4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:19.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 shutdown_connections 2024-09-17T01:06:19.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.318+0000 7f90f8d3b640 1 -- 172.21.15.103:0/2574506404 wait complete. 2024-09-17T01:06:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:06:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 -- 172.21.15.103:0/3567455561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80ffca0 msgr2=0x7fb1b8100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/3567455561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8100120 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009880 tx=0x7fb1a802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 -- 172.21.15.103:0/3567455561 shutdown_connections 2024-09-17T01:06:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/3567455561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8100120 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/3567455561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80feaa0 0x7fb1b80feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 -- 172.21.15.103:0/3567455561 >> 172.21.15.103:0/3567455561 conn(0x7fb1b80fa230 msgr2=0x7fb1b80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 -- 172.21.15.103:0/3567455561 shutdown_connections 2024-09-17T01:06:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.437+0000 7fb1c06e8640 1 -- 172.21.15.103:0/3567455561 wait complete. 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1c06e8640 1 Processor -- start 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1c06e8640 1 -- start start 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1c06e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80feaa0 0x7fb1b8068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1c06e8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1c06e8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8198720 con 0x7fb1b80feaa0 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1c06e8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8198890 con 0x7fb1b80ffca0 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1bdc83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1be484640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80feaa0 0x7fb1b8068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.438+0000 7fb1bdc83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:39908/0 (socket says 172.21.15.103:39908) 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1bdc83640 1 -- 172.21.15.103:0/1489454692 learned_addr learned my addr 172.21.15.103:0/1489454692 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1bdc83640 1 -- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80feaa0 msgr2=0x7fb1b8068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1bdc83640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80feaa0 0x7fb1b8068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1bdc83640 1 -- 172.21.15.103:0/1489454692 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8009560 con 0x7fb1b80ffca0 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1bdc83640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8198150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8004650 tx=0x7fb1a80055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a8004aa0 con 0x7fb1b80ffca0 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1a8005d50 con 0x7fb1b80ffca0 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a80039e0 con 0x7fb1b80ffca0 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.439+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b8198b10 con 0x7fb1b80ffca0 2024-09-17T01:06:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.440+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8198fb0 con 0x7fb1b80ffca0 2024-09-17T01:06:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.441+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b819a460 con 0x7fb1b80ffca0 2024-09-17T01:06:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.442+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb1a8031c00 con 0x7fb1b80ffca0 2024-09-17T01:06:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.442+0000 7fb1af7fe640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb1a406cc50 0x7fb1a406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.443+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb1a80ad2a0 con 0x7fb1b80ffca0 2024-09-17T01:06:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.443+0000 7fb1be484640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb1a406cc50 0x7fb1a406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.443+0000 7fb1be484640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb1a406cc50 0x7fb1a406f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ffb00 tx=0x7fb1b4005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.447+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb1a8077720 con 0x7fb1b80ffca0 2024-09-17T01:06:19.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.739+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b80608f0 con 0x7fb1a406cc50 2024-09-17T01:06:19.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.741+0000 7fb1af7fe640 1 -- 172.21.15.103:0/1489454692 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fb1b80608f0 con 0x7fb1a406cc50 2024-09-17T01:06:19.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.745+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb1a406cc50 msgr2=0x7fb1a406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.745+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb1a406cc50 0x7fb1a406f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ffb00 tx=0x7fb1b4005f90 comp rx=0 tx=0).stop 2024-09-17T01:06:19.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.745+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 msgr2=0x7fb1b8198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.745+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8198150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8004650 tx=0x7fb1a80055a0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.745+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 shutdown_connections 2024-09-17T01:06:19.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.745+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7fb1a406cc50 0x7fb1a406f110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.746+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1b80ffca0 0x7fb1b8198150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.746+0000 7fb1c06e8640 1 --2- 172.21.15.103:0/1489454692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b80feaa0 0x7fb1b8068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.746+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 >> 172.21.15.103:0/1489454692 conn(0x7fb1b80fa230 msgr2=0x7fb1b8103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.746+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 shutdown_connections 2024-09-17T01:06:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.746+0000 7fb1c06e8640 1 -- 172.21.15.103:0/1489454692 wait complete. 2024-09-17T01:06:19.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.868+0000 7f433972b640 1 -- 172.21.15.103:0/103942104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43340ffb60 msgr2=0x7f43340fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.868+0000 7f433972b640 1 --2- 172.21.15.103:0/103942104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43340ffb60 0x7f43340fff60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4324009880 tx=0x7f432402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 -- 172.21.15.103:0/103942104 shutdown_connections 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 --2- 172.21.15.103:0/103942104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4334100d60 0x7f43341011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 --2- 172.21.15.103:0/103942104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43340ffb60 0x7f43340fff60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 -- 172.21.15.103:0/103942104 >> 172.21.15.103:0/103942104 conn(0x7f43340fb330 msgr2=0x7f43340fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 -- 172.21.15.103:0/103942104 shutdown_connections 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 -- 172.21.15.103:0/103942104 wait complete. 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 Processor -- start 2024-09-17T01:06:19.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.869+0000 7f433972b640 1 -- start start 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f433972b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43340ffb60 0x7f4334074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f433972b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 0x7f43340728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f433972b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334072de0 con 0x7f4334100d60 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f433972b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334072f50 con 0x7f43340ffb60 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 0x7f43340728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 0x7f43340728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49872/0 (socket says 172.21.15.103:49872) 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 -- 172.21.15.103:0/915894116 learned_addr learned my addr 172.21.15.103:0/915894116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f4332ffd640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43340ffb60 0x7f4334074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 -- 172.21.15.103:0/915894116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43340ffb60 msgr2=0x7f4334074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:19.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43340ffb60 0x7f4334074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 -- 172.21.15.103:0/915894116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4328009490 con 0x7f4334100d60 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f4332ffd640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43340ffb60 0x7f4334074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.870+0000 7f43327fc640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 0x7f43340728a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f432800e9e0 tx=0x7f432800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.871+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432800cd20 con 0x7f4334100d60 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.871+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4324009560 con 0x7f4334100d60 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.871+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f432800ce80 con 0x7f4334100d60 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.871+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4328004a60 con 0x7f4334100d60 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.871+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334073670 con 0x7f4334100d60 2024-09-17T01:06:19.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.872+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433418f6e0 con 0x7f4334100d60 2024-09-17T01:06:19.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.874+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4328004d20 con 0x7f4334100d60 2024-09-17T01:06:19.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.874+0000 7f431bfff640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f431c06cca0 0x7f431c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:19.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.875+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4328014070 con 0x7f4334100d60 2024-09-17T01:06:19.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.875+0000 7f4332ffd640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f431c06cca0 0x7f431c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:19.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.876+0000 7f4332ffd640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f431c06cca0 0x7f431c06f160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4324009230 tx=0x7f4324031470 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:19.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:19.881+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4328056d00 con 0x7f4334100d60 2024-09-17T01:06:20.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.149+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f433402c4f0 con 0x7f431c06cca0 2024-09-17T01:06:20.147 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:19 smithi103 ceph-mon[28156]: pgmap v233: 65 pgs: 65 active+clean; 84 MiB data, 473 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.6 MiB/s wr, 580 op/s 2024-09-17T01:06:20.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.164+0000 7f431bfff640 1 -- 172.21.15.103:0/915894116 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f433402c4f0 con 0x7f431c06cca0 2024-09-17T01:06:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (5m) 93s ago 7m 25.2M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (7m) 93s ago 7m 7558k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (6m) 99s ago 6m 7415k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (7m) 93s ago 7m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (6m) 99s ago 6m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (5m) 93s ago 6m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (118s) 93s ago 117s 16.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (113s) 93s ago 112s 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (110s) 99s ago 110s 11.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (115s) 99s ago 115s 13.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:9283,8765,8443 running (8m) 93s ago 8m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 29c1c8578f11 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (6m) 99s ago 6m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 f45a460ef3a5 2024-09-17T01:06:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (8m) 93s ago 8m 45.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (6m) 99s ago 6m 35.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (7m) 93s ago 7m 16.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (6m) 99s ago 6m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (5m) 93s ago 5m 50.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (5m) 93s ago 5m 47.0M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (4m) 93s ago 4m 52.9M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (4m) 99s ago 4m 45.4M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (3m) 99s ago 3m 44.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (3m) 99s ago 3m 50.7M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:06:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (5m) 93s ago 6m 55.0M - 2.43.0 a07b618ecd1d e84d3109ab0e 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f431c06cca0 msgr2=0x7f431c06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f431c06cca0 0x7f431c06f160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4324009230 tx=0x7f4324031470 comp rx=0 tx=0).stop 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 msgr2=0x7f43340728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 0x7f43340728a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f432800e9e0 tx=0x7f432800eea0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 shutdown_connections 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f431c06cca0 0x7f431c06f160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4334100d60 0x7f43340728a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 --2- 172.21.15.103:0/915894116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43340ffb60 0x7f4334074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.167+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 >> 172.21.15.103:0/915894116 conn(0x7f43340fb330 msgr2=0x7f43341044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.168+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 shutdown_connections 2024-09-17T01:06:20.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.168+0000 7f433972b640 1 -- 172.21.15.103:0/915894116 wait complete. 2024-09-17T01:06:20.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:19 smithi143 ceph-mon[35452]: pgmap v233: 65 pgs: 65 active+clean; 84 MiB data, 473 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.6 MiB/s wr, 580 op/s 2024-09-17T01:06:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.284+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/1219547920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68100e40 msgr2=0x7f8a681012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.284+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/1219547920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68100e40 0x7f8a681012c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00fa90 tx=0x7f8a5c02e640 comp rx=0 tx=0).stop 2024-09-17T01:06:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.284+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/1219547920 shutdown_connections 2024-09-17T01:06:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.285+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/1219547920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68100e40 0x7f8a681012c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.285+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/1219547920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a680fde60 0x7f8a680fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.285+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/1219547920 >> 172.21.15.103:0/1219547920 conn(0x7f8a680f99b0 msgr2=0x7f8a680fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.285+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/1219547920 shutdown_connections 2024-09-17T01:06:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.285+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/1219547920 wait complete. 2024-09-17T01:06:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.286+0000 7f8a6dbd4640 1 Processor -- start 2024-09-17T01:06:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.286+0000 7f8a6dbd4640 1 -- start start 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a6dbd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 0x7f8a681933a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a6dbd4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a68100e40 0x7f8a681938e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a6dbd4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68193eb0 con 0x7f8a680fde60 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a6dbd4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68194020 con 0x7f8a68100e40 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 0x7f8a681933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a66ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a68100e40 0x7f8a681938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 0x7f8a681933a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49892/0 (socket says 172.21.15.103:49892) 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a66ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a68100e40 0x7f8a681938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:39944/0 (socket says 172.21.15.103:39944) 2024-09-17T01:06:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a677fe640 1 -- 172.21.15.103:0/3152139604 learned_addr learned my addr 172.21.15.103:0/3152139604 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a677fe640 1 -- 172.21.15.103:0/3152139604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a68100e40 msgr2=0x7f8a681938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a677fe640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a68100e40 0x7f8a681938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.287+0000 7f8a677fe640 1 -- 172.21.15.103:0/3152139604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009490 con 0x7f8a680fde60 2024-09-17T01:06:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.288+0000 7f8a677fe640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 0x7f8a681933a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e970 tx=0x7f8a5800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.288+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5800cd50 con 0x7f8a680fde60 2024-09-17T01:06:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.288+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a5800ceb0 con 0x7f8a680fde60 2024-09-17T01:06:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.288+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c00f770 con 0x7f8a680fde60 2024-09-17T01:06:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.288+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a580188d0 con 0x7f8a680fde60 2024-09-17T01:06:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.288+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a68198ed0 con 0x7f8a680fde60 2024-09-17T01:06:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.290+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a681065c0 con 0x7f8a680fde60 2024-09-17T01:06:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.291+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8a58018b70 con 0x7f8a680fde60 2024-09-17T01:06:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.291+0000 7f8a64ff9640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f8a5006cd00 0x7f8a5006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.291+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f8a58014070 con 0x7f8a680fde60 2024-09-17T01:06:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.291+0000 7f8a66ffd640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f8a5006cd00 0x7f8a5006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.292+0000 7f8a66ffd640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f8a5006cd00 0x7f8a5006f1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c02ec30 tx=0x7f8a5c000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:20.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.298+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8a58056d40 con 0x7f8a680fde60 2024-09-17T01:06:20.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.713+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a68199180 con 0x7f8a680fde60 2024-09-17T01:06:20.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.714+0000 7f8a64ff9640 1 -- 172.21.15.103:0/3152139604 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f8a5805a360 con 0x7f8a680fde60 2024-09-17T01:06:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:06:20.713 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:06:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:06:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.716+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f8a5006cd00 msgr2=0x7f8a5006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.716+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f8a5006cd00 0x7f8a5006f1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c02ec30 tx=0x7f8a5c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.716+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 msgr2=0x7f8a681933a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.716+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 0x7f8a681933a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e970 tx=0x7f8a5800ee30 comp rx=0 tx=0).stop 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 shutdown_connections 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f8a5006cd00 0x7f8a5006f1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a68100e40 0x7f8a681938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 --2- 172.21.15.103:0/3152139604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a680fde60 0x7f8a681933a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 >> 172.21.15.103:0/3152139604 conn(0x7f8a680f99b0 msgr2=0x7f8a680fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:20.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 shutdown_connections 2024-09-17T01:06:20.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.717+0000 7f8a6dbd4640 1 -- 172.21.15.103:0/3152139604 wait complete. 2024-09-17T01:06:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.834+0000 7f549ea86640 1 -- 172.21.15.103:0/191849396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 msgr2=0x7f5498102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.834+0000 7f549ea86640 1 --2- 172.21.15.103:0/191849396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498102a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f548c009880 tx=0x7f548c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.834+0000 7f549ea86640 1 -- 172.21.15.103:0/191849396 shutdown_connections 2024-09-17T01:06:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.834+0000 7f549ea86640 1 --2- 172.21.15.103:0/191849396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.834+0000 7f549ea86640 1 --2- 172.21.15.103:0/191849396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498102a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.834+0000 7f549ea86640 1 -- 172.21.15.103:0/191849396 >> 172.21.15.103:0/191849396 conn(0x7f54980fa1f0 msgr2=0x7f54980fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.835+0000 7f549ea86640 1 -- 172.21.15.103:0/191849396 shutdown_connections 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.835+0000 7f549ea86640 1 -- 172.21.15.103:0/191849396 wait complete. 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.836+0000 7f549ea86640 1 Processor -- start 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.836+0000 7f549ea86640 1 -- start start 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.836+0000 7f549ea86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.836+0000 7f549ea86640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.836+0000 7f549ea86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498196130 con 0x7f5498100650 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.836+0000 7f549ea86640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981962a0 con 0x7f5498102f80 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:39952/0 (socket says 172.21.15.103:39952) 2024-09-17T01:06:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 -- 172.21.15.103:0/260810392 learned_addr learned my addr 172.21.15.103:0/260810392 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:20.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f549c822640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:20.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 -- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 msgr2=0x7f5498195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:20.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:20.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 -- 172.21.15.103:0/260810392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009490 con 0x7f5498102f80 2024-09-17T01:06:20.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f549c822640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:06:20.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.837+0000 7f5497fff640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498195b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f548400e920 tx=0x7f548400ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:20.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.844+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5484009790 con 0x7f5498102f80 2024-09-17T01:06:20.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.844+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f548400cd50 con 0x7f5498102f80 2024-09-17T01:06:20.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.844+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5484004a40 con 0x7f5498102f80 2024-09-17T01:06:20.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.844+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c009560 con 0x7f5498102f80 2024-09-17T01:06:20.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.844+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549819b130 con 0x7f5498102f80 2024-09-17T01:06:20.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.846+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5498100a30 con 0x7f5498102f80 2024-09-17T01:06:20.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.846+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5484004cb0 con 0x7f5498102f80 2024-09-17T01:06:20.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.846+0000 7f5495ffb640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f548806cc50 0x7f548806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:20.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.846+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5484014070 con 0x7f5498102f80 2024-09-17T01:06:20.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.847+0000 7f549c822640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f548806cc50 0x7f548806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:20.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.847+0000 7f549c822640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f548806cc50 0x7f548806f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f548c000c00 tx=0x7f548c0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:20.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:20.852+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f54840567f0 con 0x7f5498102f80 2024-09-17T01:06:21.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.139+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5498108710 con 0x7f5498102f80 2024-09-17T01:06:21.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:20 smithi103 ceph-mon[28156]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:21.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:20 smithi103 ceph-mon[28156]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:21.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:20 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3152139604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.139+0000 7f5495ffb640 1 -- 172.21.15.103:0/260810392 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7f54840567f0 con 0x7f5498102f80 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:06:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:06:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f548806cc50 msgr2=0x7f548806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f548806cc50 0x7f548806f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f548c000c00 tx=0x7f548c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 msgr2=0x7f5498195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498195b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f548400e920 tx=0x7f548400ede0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 shutdown_connections 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f548806cc50 0x7f548806f110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5498102f80 0x7f5498195b60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 --2- 172.21.15.103:0/260810392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5498100650 0x7f5498195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 >> 172.21.15.103:0/260810392 conn(0x7f54980fa1f0 msgr2=0x7f54980fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:21.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 shutdown_connections 2024-09-17T01:06:21.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.141+0000 7f549ea86640 1 -- 172.21.15.103:0/260810392 wait complete. 2024-09-17T01:06:21.177 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:20 smithi143 ceph-mon[35452]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:21.177 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:20 smithi143 ceph-mon[35452]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:21.177 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:20 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3152139604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.255+0000 7ff64fa52640 1 -- 172.21.15.103:0/3389429008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648102f50 msgr2=0x7ff648105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.255+0000 7ff64fa52640 1 --2- 172.21.15.103:0/3389429008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648102f50 0x7ff648105340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff638009880 tx=0x7ff63802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.255+0000 7ff64fa52640 1 -- 172.21.15.103:0/3389429008 shutdown_connections 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.255+0000 7ff64fa52640 1 --2- 172.21.15.103:0/3389429008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648102f50 0x7ff648105340 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.255+0000 7ff64fa52640 1 --2- 172.21.15.103:0/3389429008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff648100620 0x7ff648102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.255+0000 7ff64fa52640 1 -- 172.21.15.103:0/3389429008 >> 172.21.15.103:0/3389429008 conn(0x7ff6480fa1c0 msgr2=0x7ff6480fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.256+0000 7ff64fa52640 1 -- 172.21.15.103:0/3389429008 shutdown_connections 2024-09-17T01:06:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.256+0000 7ff64fa52640 1 -- 172.21.15.103:0/3389429008 wait complete. 2024-09-17T01:06:21.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.256+0000 7ff64fa52640 1 Processor -- start 2024-09-17T01:06:21.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64fa52640 1 -- start start 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64fa52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 0x7ff6481955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64fa52640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff648102f50 0x7ff648195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64fa52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648196100 con 0x7ff648100620 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64fa52640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648196270 con 0x7ff648102f50 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64d7ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 0x7ff6481955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64d7ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 0x7ff6481955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49938/0 (socket says 172.21.15.103:49938) 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64d7ee640 1 -- 172.21.15.103:0/2294709434 learned_addr learned my addr 172.21.15.103:0/2294709434 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64d7ee640 1 -- 172.21.15.103:0/2294709434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff648102f50 msgr2=0x7ff648195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64d7ee640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff648102f50 0x7ff648195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.257+0000 7ff64d7ee640 1 -- 172.21.15.103:0/2294709434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638009560 con 0x7ff648100620 2024-09-17T01:06:21.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.258+0000 7ff64d7ee640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 0x7ff6481955f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9a0 tx=0x7ff64400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:21.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.258+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64400cd50 con 0x7ff648100620 2024-09-17T01:06:21.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.258+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64819ad10 con 0x7ff648100620 2024-09-17T01:06:21.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.258+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff64400ceb0 con 0x7ff648100620 2024-09-17T01:06:21.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.258+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff644010660 con 0x7ff648100620 2024-09-17T01:06:21.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.258+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64819b2e0 con 0x7ff648100620 2024-09-17T01:06:21.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.260+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6481086d0 con 0x7ff648100620 2024-09-17T01:06:21.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.260+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff6440107c0 con 0x7ff648100620 2024-09-17T01:06:21.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.261+0000 7ff63e7fc640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff63406cc50 0x7ff63406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:21.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.261+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff644014070 con 0x7ff648100620 2024-09-17T01:06:21.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.261+0000 7ff64cfed640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff63406cc50 0x7ff63406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:21.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.262+0000 7ff64cfed640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff63406cc50 0x7ff63406f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff63802a9c0 tx=0x7ff638000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:21.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.267+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff644056c00 con 0x7ff648100620 2024-09-17T01:06:21.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.586+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 --> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff64819b530 con 0x7ff63406cc50 2024-09-17T01:06:21.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.587+0000 7ff63e7fc640 1 -- 172.21.15.103:0/2294709434 <== mgr.14213 v2:172.21.15.103:6800/187632070 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7ff64819b530 con 0x7ff63406cc50 2024-09-17T01:06:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [], 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "", 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:06:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.590+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff63406cc50 msgr2=0x7ff63406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.590+0000 7ff64fa52640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff63406cc50 0x7ff63406f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff63802a9c0 tx=0x7ff638000bc0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.590+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 msgr2=0x7ff6481955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.590+0000 7ff64fa52640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 0x7ff6481955f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9a0 tx=0x7ff64400eda0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 shutdown_connections 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7ff63406cc50 0x7ff63406f110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff648102f50 0x7ff648195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 --2- 172.21.15.103:0/2294709434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff648100620 0x7ff6481955f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 >> 172.21.15.103:0/2294709434 conn(0x7ff6480fa1c0 msgr2=0x7ff6480fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:21.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 shutdown_connections 2024-09-17T01:06:21.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.591+0000 7ff64fa52640 1 -- 172.21.15.103:0/2294709434 wait complete. 2024-09-17T01:06:21.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 -- 172.21.15.103:0/263588634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 msgr2=0x7f3e881011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/263588634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e881011b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009880 tx=0x7f3e7802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 -- 172.21.15.103:0/263588634 shutdown_connections 2024-09-17T01:06:21.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/263588634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e881011b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/263588634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 0x7f3e880fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 -- 172.21.15.103:0/263588634 >> 172.21.15.103:0/263588634 conn(0x7f3e880fb2c0 msgr2=0x7f3e880fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:21.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 -- 172.21.15.103:0/263588634 shutdown_connections 2024-09-17T01:06:21.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.704+0000 7f3e8fae0640 1 -- 172.21.15.103:0/263588634 wait complete. 2024-09-17T01:06:21.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8fae0640 1 Processor -- start 2024-09-17T01:06:21.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8fae0640 1 -- start start 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8fae0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 0x7f3e88195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8fae0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e88195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8fae0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88196120 con 0x7f3e88100d30 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8d07b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e88195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8d87c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 0x7f3e88195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8d07b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e88195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49970/0 (socket says 172.21.15.103:49970) 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8d07b640 1 -- 172.21.15.103:0/401336265 learned_addr learned my addr 172.21.15.103:0/401336265 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:21.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.705+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88196290 con 0x7f3e880ffb30 2024-09-17T01:06:21.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.706+0000 7f3e8d87c640 1 -- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 msgr2=0x7f3e88195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:21.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.706+0000 7f3e8d87c640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e88195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:21.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.706+0000 7f3e8d87c640 1 -- 172.21.15.103:0/401336265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78009560 con 0x7f3e880ffb30 2024-09-17T01:06:21.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.706+0000 7f3e8d87c640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 0x7f3e88195610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e940 tx=0x7f3e8400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:21.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.707+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8400cc90 con 0x7f3e880ffb30 2024-09-17T01:06:21.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.707+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e8400cdf0 con 0x7f3e880ffb30 2024-09-17T01:06:21.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.707+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e84010430 con 0x7f3e880ffb30 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.707+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e88072740 con 0x7f3e880ffb30 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.707+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e88072cb0 con 0x7f3e880ffb30 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.708+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8818f6b0 con 0x7f3e880ffb30 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.709+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3e84003fa0 con 0x7f3e880ffb30 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.709+0000 7f3e7effd640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3e74071060 0x7f3e74073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.709+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3e84014070 con 0x7f3e880ffb30 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.710+0000 7f3e8d07b640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3e74071060 0x7f3e74073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:21.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.710+0000 7f3e8d07b640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3e74071060 0x7f3e74073520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3e88196b30 tx=0x7f3e780314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:21.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:21.715+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e84056a00 con 0x7f3e880ffb30 2024-09-17T01:06:21.835 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:21 smithi103 ceph-mon[28156]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:21.835 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:21 smithi103 ceph-mon[28156]: pgmap v234: 65 pgs: 65 active+clean; 88 MiB data, 497 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 489 op/s 2024-09-17T01:06:21.835 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:21 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/260810392' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:21 smithi143 ceph-mon[35452]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:21 smithi143 ceph-mon[35452]: pgmap v234: 65 pgs: 65 active+clean; 88 MiB data, 497 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 489 op/s 2024-09-17T01:06:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:21 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/260810392' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:22.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:22.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:21 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.125+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3e88108720 con 0x7f3e880ffb30 2024-09-17T01:06:22.124 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:22.124 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:22.124 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:21 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.126+0000 7f3e7effd640 1 -- 172.21.15.103:0/401336265 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3e8405a020 con 0x7f3e880ffb30 2024-09-17T01:06:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:06:22.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3e74071060 msgr2=0x7f3e74073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3e74071060 0x7f3e74073520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3e88196b30 tx=0x7f3e780314e0 comp rx=0 tx=0).stop 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 msgr2=0x7f3e88195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 0x7f3e88195610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e940 tx=0x7f3e8400ee00 comp rx=0 tx=0).stop 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 shutdown_connections 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:6800/187632070,v1:172.21.15.103:6801/187632070] conn(0x7f3e74071060 0x7f3e74073520 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e88100d30 0x7f3e88195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.128+0000 7f3e8fae0640 1 --2- 172.21.15.103:0/401336265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e880ffb30 0x7f3e88195610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.129+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 >> 172.21.15.103:0/401336265 conn(0x7f3e880fb2c0 msgr2=0x7f3e88104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.129+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 shutdown_connections 2024-09-17T01:06:22.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:22.129+0000 7f3e8fae0640 1 -- 172.21.15.103:0/401336265 wait complete. 2024-09-17T01:06:23.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:22 smithi143 ceph-mon[35452]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:23.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:22 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/401336265' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:23.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:22 smithi103 ceph-mon[28156]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:22 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/401336265' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:24.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:23 smithi103 ceph-mon[28156]: pgmap v235: 65 pgs: 65 active+clean; 104 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 564 op/s 2024-09-17T01:06:24.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:23 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:24.184 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:23 smithi143 ceph-mon[35452]: pgmap v235: 65 pgs: 65 active+clean; 104 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 564 op/s 2024-09-17T01:06:24.185 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:23 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:25 smithi103 ceph-mon[28156]: pgmap v236: 65 pgs: 65 active+clean; 105 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 441 op/s 2024-09-17T01:06:26.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:25 smithi143 ceph-mon[35452]: pgmap v236: 65 pgs: 65 active+clean; 105 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 441 op/s 2024-09-17T01:06:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:26 smithi103 ceph-mon[28156]: Standby manager daemon smithi143.sxhocv restarted 2024-09-17T01:06:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:26 smithi103 ceph-mon[28156]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:06:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:26 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:06:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:26 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:26 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:06:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:26 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:27.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:26 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv restarted 2024-09-17T01:06:27.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:26 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:06:27.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:26 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:06:27.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:26 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:27.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:26 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:06:27.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:26 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:28.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:27 smithi103 ceph-mon[28156]: pgmap v237: 65 pgs: 65 active+clean; 106 MiB data, 594 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 452 op/s 2024-09-17T01:06:28.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:27 smithi103 ceph-mon[28156]: mgrmap e20: smithi103.efjaur(active, since 6m), standbys: smithi143.sxhocv 2024-09-17T01:06:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:27 smithi143 ceph-mon[35452]: pgmap v237: 65 pgs: 65 active+clean; 106 MiB data, 594 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 452 op/s 2024-09-17T01:06:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:27 smithi143 ceph-mon[35452]: mgrmap e20: smithi103.efjaur(active, since 6m), standbys: smithi143.sxhocv 2024-09-17T01:06:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:29 smithi103 ceph-mon[28156]: pgmap v238: 65 pgs: 65 active+clean; 117 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 535 op/s 2024-09-17T01:06:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:29 smithi143 ceph-mon[35452]: pgmap v238: 65 pgs: 65 active+clean; 117 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 535 op/s 2024-09-17T01:06:32.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:31 smithi143 ceph-mon[35452]: pgmap v239: 65 pgs: 65 active+clean; 118 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 455 op/s 2024-09-17T01:06:32.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:31 smithi103 ceph-mon[28156]: pgmap v239: 65 pgs: 65 active+clean; 118 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 455 op/s 2024-09-17T01:06:34.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:33 smithi103 ceph-mon[28156]: pgmap v240: 65 pgs: 65 active+clean; 135 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-17T01:06:34.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:33 smithi143 ceph-mon[35452]: pgmap v240: 65 pgs: 65 active+clean; 135 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-17T01:06:36.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:35 smithi103 ceph-mon[28156]: pgmap v241: 65 pgs: 65 active+clean; 137 MiB data, 717 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 423 op/s 2024-09-17T01:06:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:35 smithi143 ceph-mon[35452]: pgmap v241: 65 pgs: 65 active+clean; 137 MiB data, 717 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 423 op/s 2024-09-17T01:06:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:37 smithi103 ceph-mon[28156]: pgmap v242: 65 pgs: 65 active+clean; 141 MiB data, 722 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 431 op/s 2024-09-17T01:06:38.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:37 smithi143 ceph-mon[35452]: pgmap v242: 65 pgs: 65 active+clean; 141 MiB data, 722 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 431 op/s 2024-09-17T01:06:39.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:38 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:38 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:40.153 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:39 smithi143 ceph-mon[35452]: pgmap v243: 65 pgs: 65 active+clean; 157 MiB data, 761 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-17T01:06:40.153 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.154 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.154 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.154 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:39 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:39 smithi103 ceph-mon[28156]: pgmap v243: 65 pgs: 65 active+clean; 157 MiB data, 761 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-17T01:06:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:39 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:42.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:41 smithi103 ceph-mon[28156]: pgmap v244: 65 pgs: 65 active+clean; 163 MiB data, 799 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 427 op/s 2024-09-17T01:06:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:41 smithi143 ceph-mon[35452]: pgmap v244: 65 pgs: 65 active+clean; 163 MiB data, 799 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 427 op/s 2024-09-17T01:06:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: pgmap v245: 65 pgs: 65 active+clean; 179 MiB data, 848 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr fail", "who": "smithi103.efjaur"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: Activating manager daemon smithi143.sxhocv 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:06:44.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "mgr fail", "who": "smithi103.efjaur"}]': finished 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: mgrmap e21: smithi143.sxhocv(active, starting, since 0.00889623s) 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr metadata", "who": "smithi143.sxhocv", "id": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:06:44.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:06:44.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:06:44.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:06:44.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: pgmap v245: 65 pgs: 65 active+clean; 179 MiB data, 848 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-17T01:06:44.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:44.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:44.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.195 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr fail", "who": "smithi103.efjaur"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: Activating manager daemon smithi143.sxhocv 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.14213 172.21.15.103:0/2710721142' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "mgr fail", "who": "smithi103.efjaur"}]': finished 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: mgrmap e21: smithi143.sxhocv(active, starting, since 0.00889623s) 2024-09-17T01:06:44.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr metadata", "who": "smithi143.sxhocv", "id": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:06:44.197 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:06:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: Manager daemon smithi143.sxhocv is now available 2024-09-17T01:06:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: Migrating agent root cert to cert store 2024-09-17T01:06:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: Migrating agent root key to cert store 2024-09-17T01:06:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: Checking for cert/key for grafana.smithi103 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: Migrating grafana.smithi103 cert to cert store 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: Migrating grafana.smithi103 key to cert store 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:44 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: Manager daemon smithi143.sxhocv is now available 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: Migrating agent root cert to cert store 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: Migrating agent root key to cert store 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: Checking for cert/key for grafana.smithi103 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: Migrating grafana.smithi103 cert to cert store 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: Migrating grafana.smithi103 key to cert store 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:44 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi143.sxhocv/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:46.148 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:45 smithi143 ceph-mon[35452]: Deploying cephadm binary to smithi143 2024-09-17T01:06:46.148 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:45 smithi143 ceph-mon[35452]: mgrmap e22: smithi143.sxhocv(active, since 1.14884s) 2024-09-17T01:06:46.148 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:45 smithi143 ceph-mon[35452]: pgmap v3: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:46.148 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:45 smithi143 ceph-mon[35452]: Deploying cephadm binary to smithi103 2024-09-17T01:06:46.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:45 smithi103 ceph-mon[28156]: Deploying cephadm binary to smithi143 2024-09-17T01:06:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:45 smithi103 ceph-mon[28156]: mgrmap e22: smithi143.sxhocv(active, since 1.14884s) 2024-09-17T01:06:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:45 smithi103 ceph-mon[28156]: pgmap v3: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:45 smithi103 ceph-mon[28156]: Deploying cephadm binary to smithi103 2024-09-17T01:06:46.878 INFO:tasks.workunit.client.1.smithi143.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:06:46.885 INFO:tasks.workunit.client.1.smithi143.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:06:46.885 INFO:tasks.workunit.client.1.smithi143.stderr:+ make 2024-09-17T01:06:47.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:46 smithi143 ceph-mon[35452]: pgmap v4: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:46 smithi143 ceph-mon[35452]: [17/Sep/2024:01:06:46] ENGINE Bus STARTING 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:46 smithi143 ceph-mon[35452]: [17/Sep/2024:01:06:46] ENGINE Serving on https://172.21.15.143:7150 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:46 smithi143 ceph-mon[35452]: [17/Sep/2024:01:06:46] ENGINE Error in HTTPServer.serve 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Traceback (most recent call last): 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._run(expiration_interval) 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:06:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: s = self.context.wrap_socket( 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: return self.sslsocket_class._create( 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self.do_handshake() 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._sslobj.do_handshake() 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:46 smithi143 ceph-mon[35452]: [17/Sep/2024:01:06:46] ENGINE Serving on http://172.21.15.143:8765 2024-09-17T01:06:47.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:46 smithi143 ceph-mon[35452]: [17/Sep/2024:01:06:46] ENGINE Bus STARTED 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:46 smithi103 ceph-mon[28156]: pgmap v4: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:46 smithi103 ceph-mon[28156]: [17/Sep/2024:01:06:46] ENGINE Bus STARTING 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:46 smithi103 ceph-mon[28156]: [17/Sep/2024:01:06:46] ENGINE Serving on https://172.21.15.143:7150 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:46 smithi103 ceph-mon[28156]: [17/Sep/2024:01:06:46] ENGINE Error in HTTPServer.serve 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:06:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-17T01:06:47.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:06:47.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:46 smithi103 ceph-mon[28156]: [17/Sep/2024:01:06:46] ENGINE Serving on http://172.21.15.143:8765 2024-09-17T01:06:47.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:46 smithi103 ceph-mon[28156]: [17/Sep/2024:01:06:46] ENGINE Bus STARTED 2024-09-17T01:06:47.480 INFO:tasks.workunit.client.1.smithi143.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:06:48.085 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:47 smithi103 ceph-mon[28156]: mgrmap e23: smithi143.sxhocv(active, since 3s) 2024-09-17T01:06:48.162 INFO:tasks.workunit.client.1.smithi143.stderr:++ readlink -f fsstress 2024-09-17T01:06:48.163 INFO:tasks.workunit.client.1.smithi143.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:06:48.163 INFO:tasks.workunit.client.1.smithi143.stderr:+ popd 2024-09-17T01:06:48.164 INFO:tasks.workunit.client.1.smithi143.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:06:48.165 INFO:tasks.workunit.client.1.smithi143.stderr:+ popd 2024-09-17T01:06:48.165 INFO:tasks.workunit.client.1.smithi143.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:06:48.165 INFO:tasks.workunit.client.1.smithi143.stderr:++ mktemp -d -p . 2024-09-17T01:06:48.168 INFO:tasks.workunit.client.1.smithi143.stderr:+ T=./tmp.bQtaDCqG6L 2024-09-17T01:06:48.169 INFO:tasks.workunit.client.1.smithi143.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.bQtaDCqG6L -l 1 -n 1000 -p 10 -v 2024-09-17T01:06:48.172 INFO:tasks.workunit.client.1.smithi143.stdout:seed = 1726643019 2024-09-17T01:06:48.176 INFO:tasks.workunit.client.1.smithi143.stdout:0/0: chown . 8985 1 2024-09-17T01:06:48.176 INFO:tasks.workunit.client.1.smithi143.stdout:0/1: dwrite - no filename 2024-09-17T01:06:48.176 INFO:tasks.workunit.client.1.smithi143.stdout:0/2: chown . 4553 1 2024-09-17T01:06:48.177 INFO:tasks.workunit.client.1.smithi143.stdout:1/0: dread - no filename 2024-09-17T01:06:48.177 INFO:tasks.workunit.client.1.smithi143.stdout:1/1: link - no file 2024-09-17T01:06:48.177 INFO:tasks.workunit.client.1.smithi143.stdout:1/2: dwrite - no filename 2024-09-17T01:06:48.177 INFO:tasks.workunit.client.1.smithi143.stdout:1/3: readlink - no filename 2024-09-17T01:06:48.177 INFO:tasks.workunit.client.1.smithi143.stdout:1/4: rename - no filename 2024-09-17T01:06:48.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/3: symlink l0 0 2024-09-17T01:06:48.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/4: write - no filename 2024-09-17T01:06:48.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/5: stat l0 0 2024-09-17T01:06:48.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/6: dwrite - no filename 2024-09-17T01:06:48.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/7: dread - no filename 2024-09-17T01:06:48.179 INFO:tasks.workunit.client.1.smithi143.stdout:2/0: chown . 35498 1 2024-09-17T01:06:48.179 INFO:tasks.workunit.client.1.smithi143.stdout:0/8: mknod c1 0 2024-09-17T01:06:48.180 INFO:tasks.workunit.client.1.smithi143.stdout:0/9: stat c1 0 2024-09-17T01:06:48.180 INFO:tasks.workunit.client.1.smithi143.stdout:3/0: rmdir - no directory 2024-09-17T01:06:48.182 INFO:tasks.workunit.client.1.smithi143.stdout:0/10: rename l0 to l2 0 2024-09-17T01:06:48.184 INFO:tasks.workunit.client.1.smithi143.stdout:2/1: mkdir d0 0 2024-09-17T01:06:48.184 INFO:tasks.workunit.client.1.smithi143.stdout:2/2: dread - no filename 2024-09-17T01:06:48.184 INFO:tasks.workunit.client.1.smithi143.stdout:2/3: chown d0 76355892 1 2024-09-17T01:06:48.187 INFO:tasks.workunit.client.1.smithi143.stdout:5/0: dwrite - no filename 2024-09-17T01:06:48.187 INFO:tasks.workunit.client.1.smithi143.stdout:5/1: dwrite - no filename 2024-09-17T01:06:48.187 INFO:tasks.workunit.client.1.smithi143.stdout:5/2: rename - no filename 2024-09-17T01:06:48.189 INFO:tasks.workunit.client.1.smithi143.stdout:4/0: mknod c0 0 2024-09-17T01:06:48.189 INFO:tasks.workunit.client.1.smithi143.stdout:4/1: dread - no filename 2024-09-17T01:06:48.189 INFO:tasks.workunit.client.1.smithi143.stdout:4/2: rmdir - no directory 2024-09-17T01:06:48.189 INFO:tasks.workunit.client.1.smithi143.stdout:4/3: fsync - no filename 2024-09-17T01:06:48.189 INFO:tasks.workunit.client.1.smithi143.stdout:4/4: dwrite - no filename 2024-09-17T01:06:48.189 INFO:tasks.workunit.client.1.smithi143.stdout:4/5: dwrite - no filename 2024-09-17T01:06:48.190 INFO:tasks.workunit.client.1.smithi143.stdout:4/6: chown c0 0 1 2024-09-17T01:06:48.190 INFO:tasks.workunit.client.1.smithi143.stdout:4/7: readlink - no filename 2024-09-17T01:06:48.190 INFO:tasks.workunit.client.1.smithi143.stdout:4/8: write - no filename 2024-09-17T01:06:48.190 INFO:tasks.workunit.client.1.smithi143.stdout:6/0: read - no filename 2024-09-17T01:06:48.191 INFO:tasks.workunit.client.1.smithi143.stdout:2/4: creat d0/f1 x:0 0 0 2024-09-17T01:06:48.193 INFO:tasks.workunit.client.1.smithi143.stdout:4/9: creat f1 x:0 0 0 2024-09-17T01:06:48.194 INFO:tasks.workunit.client.1.smithi143.stdout:4/10: truncate f1 27936 0 2024-09-17T01:06:48.195 INFO:tasks.workunit.client.1.smithi143.stdout:7/0: rename - no filename 2024-09-17T01:06:48.195 INFO:tasks.workunit.client.1.smithi143.stdout:7/1: dread - no filename 2024-09-17T01:06:48.195 INFO:tasks.workunit.client.1.smithi143.stdout:4/11: write f1 [730363,118529] 0 2024-09-17T01:06:48.195 INFO:tasks.workunit.client.1.smithi143.stdout:4/12: readlink - no filename 2024-09-17T01:06:48.197 INFO:tasks.workunit.client.1.smithi143.stdout:5/3: symlink l0 0 2024-09-17T01:06:48.199 INFO:tasks.workunit.client.1.smithi143.stdout:6/1: creat f0 x:0 0 0 2024-09-17T01:06:48.203 INFO:tasks.workunit.client.1.smithi143.stdout:4/13: creat f2 x:0 0 0 2024-09-17T01:06:48.204 INFO:tasks.workunit.client.1.smithi143.stdout:5/4: mkdir d1 0 2024-09-17T01:06:48.204 INFO:tasks.workunit.client.1.smithi143.stdout:5/5: dread - no filename 2024-09-17T01:06:48.206 INFO:tasks.workunit.client.1.smithi143.stdout:6/2: creat f1 x:0 0 0 2024-09-17T01:06:48.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/2: symlink l0 0 2024-09-17T01:06:48.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/3: dwrite - no filename 2024-09-17T01:06:48.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/4: dwrite - no filename 2024-09-17T01:06:48.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/5: write - no filename 2024-09-17T01:06:48.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/6: dwrite - no filename 2024-09-17T01:06:48.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/7: dread - no filename 2024-09-17T01:06:48.208 INFO:tasks.workunit.client.1.smithi143.stdout:7/8: readlink l0 0 2024-09-17T01:06:48.208 INFO:tasks.workunit.client.1.smithi143.stdout:9/0: write - no filename 2024-09-17T01:06:48.209 INFO:tasks.workunit.client.1.smithi143.stdout:4/14: creat f3 x:0 0 0 2024-09-17T01:06:48.209 INFO:tasks.workunit.client.1.smithi143.stdout:4/15: chown f2 158614 1 2024-09-17T01:06:48.210 INFO:tasks.workunit.client.1.smithi143.stdout:4/16: write f3 [580844,74596] 0 2024-09-17T01:06:48.211 INFO:tasks.workunit.client.1.smithi143.stdout:4/17: write f2 [335745,73327] 0 2024-09-17T01:06:48.214 INFO:tasks.workunit.client.1.smithi143.stdout:7/9: mknod c1 0 2024-09-17T01:06:48.216 INFO:tasks.workunit.client.1.smithi143.stdout:5/6: creat d1/f2 x:0 0 0 2024-09-17T01:06:48.219 INFO:tasks.workunit.client.1.smithi143.stdout:9/1: symlink l0 0 2024-09-17T01:06:48.220 INFO:tasks.workunit.client.1.smithi143.stdout:4/18: dwrite f3 [0,4194304] 0 2024-09-17T01:06:48.223 INFO:tasks.workunit.client.1.smithi143.stdout:4/19: write f1 [678245,90671] 0 2024-09-17T01:06:48.227 INFO:tasks.workunit.client.1.smithi143.stdout:5/7: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:06:48.229 INFO:tasks.workunit.client.1.smithi143.stdout:4/20: creat f4 x:0 0 0 2024-09-17T01:06:48.229 INFO:tasks.workunit.client.1.smithi143.stdout:4/21: chown f4 130079 1 2024-09-17T01:06:48.229 INFO:tasks.workunit.client.1.smithi143.stdout:4/22: rmdir - no directory 2024-09-17T01:06:48.235 INFO:tasks.workunit.client.1.smithi143.stdout:5/8: creat d1/f3 x:0 0 0 2024-09-17T01:06:48.235 INFO:tasks.workunit.client.1.smithi143.stdout:4/23: mknod c5 0 2024-09-17T01:06:48.236 INFO:tasks.workunit.client.1.smithi143.stdout:9/2: link l0 l1 0 2024-09-17T01:06:48.240 INFO:tasks.workunit.client.1.smithi143.stdout:5/9: creat d1/f4 x:0 0 0 2024-09-17T01:06:48.240 INFO:tasks.workunit.client.1.smithi143.stdout:5/10: stat d1/f2 0 2024-09-17T01:06:48.241 INFO:tasks.workunit.client.1.smithi143.stdout:5/11: truncate d1/f3 17159 0 2024-09-17T01:06:48.243 INFO:tasks.workunit.client.1.smithi143.stdout:4/24: rename c5 to c6 0 2024-09-17T01:06:48.244 INFO:tasks.workunit.client.1.smithi143.stdout:4/25: chown f4 1 1 2024-09-17T01:06:48.244 INFO:tasks.workunit.client.1.smithi143.stdout:4/26: dread - f4 zero size 2024-09-17T01:06:48.246 INFO:tasks.workunit.client.1.smithi143.stdout:5/12: mkdir d1/d5 0 2024-09-17T01:06:48.248 INFO:tasks.workunit.client.1.smithi143.stdout:9/3: link l0 l2 0 2024-09-17T01:06:48.249 INFO:tasks.workunit.client.1.smithi143.stdout:5/13: mknod d1/c6 0 2024-09-17T01:06:48.252 INFO:tasks.workunit.client.1.smithi143.stdout:4/27: dwrite f1 [0,4194304] 0 2024-09-17T01:06:48.253 INFO:tasks.workunit.client.1.smithi143.stdout:9/4: chown l2 255926 1 2024-09-17T01:06:48.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/14: creat d1/d5/f7 x:0 0 0 2024-09-17T01:06:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:47 smithi143 ceph-mon[35452]: mgrmap e23: smithi143.sxhocv(active, since 3s) 2024-09-17T01:06:48.259 INFO:tasks.workunit.client.1.smithi143.stdout:9/5: mkdir d3 0 2024-09-17T01:06:48.259 INFO:tasks.workunit.client.1.smithi143.stdout:9/6: dwrite - no filename 2024-09-17T01:06:48.259 INFO:tasks.workunit.client.1.smithi143.stdout:9/7: write - no filename 2024-09-17T01:06:48.369 INFO:tasks.workunit.client.1.smithi143.stdout:0/11: readlink l2 0 2024-09-17T01:06:48.373 INFO:tasks.workunit.client.1.smithi143.stdout:0/12: mkdir d3 0 2024-09-17T01:06:48.376 INFO:tasks.workunit.client.1.smithi143.stdout:2/5: getdents d0 0 2024-09-17T01:06:48.376 INFO:tasks.workunit.client.1.smithi143.stdout:0/13: chown l2 141610 1 2024-09-17T01:06:48.379 INFO:tasks.workunit.client.1.smithi143.stdout:2/6: mkdir d0/d2 0 2024-09-17T01:06:48.382 INFO:tasks.workunit.client.1.smithi143.stdout:0/14: getdents d3 0 2024-09-17T01:06:48.383 INFO:tasks.workunit.client.1.smithi143.stdout:2/7: symlink d0/d2/l3 0 2024-09-17T01:06:48.384 INFO:tasks.workunit.client.1.smithi143.stdout:2/8: write d0/f1 [35389,80280] 0 2024-09-17T01:06:48.386 INFO:tasks.workunit.client.1.smithi143.stdout:0/15: symlink d3/l4 0 2024-09-17T01:06:48.388 INFO:tasks.workunit.client.1.smithi143.stdout:2/9: rename d0/f1 to d0/d2/f4 0 2024-09-17T01:06:48.389 INFO:tasks.workunit.client.1.smithi143.stdout:0/16: mkdir d3/d5 0 2024-09-17T01:06:48.389 INFO:tasks.workunit.client.1.smithi143.stdout:0/17: dread - no filename 2024-09-17T01:06:48.389 INFO:tasks.workunit.client.1.smithi143.stdout:6/3: getdents . 0 2024-09-17T01:06:48.390 INFO:tasks.workunit.client.1.smithi143.stdout:6/4: chown f0 3155485 1 2024-09-17T01:06:48.392 INFO:tasks.workunit.client.1.smithi143.stdout:0/18: rename d3/l4 to d3/d5/l6 0 2024-09-17T01:06:48.393 INFO:tasks.workunit.client.1.smithi143.stdout:0/19: stat l2 0 2024-09-17T01:06:48.393 INFO:tasks.workunit.client.1.smithi143.stdout:0/20: dread - no filename 2024-09-17T01:06:48.393 INFO:tasks.workunit.client.1.smithi143.stdout:0/21: write - no filename 2024-09-17T01:06:48.393 INFO:tasks.workunit.client.1.smithi143.stdout:0/22: write - no filename 2024-09-17T01:06:48.393 INFO:tasks.workunit.client.1.smithi143.stdout:0/23: chown d3 33 1 2024-09-17T01:06:48.394 INFO:tasks.workunit.client.1.smithi143.stdout:7/10: getdents . 0 2024-09-17T01:06:48.395 INFO:tasks.workunit.client.1.smithi143.stdout:7/11: truncate - no filename 2024-09-17T01:06:48.395 INFO:tasks.workunit.client.1.smithi143.stdout:5/15: fsync d1/f2 0 2024-09-17T01:06:48.397 INFO:tasks.workunit.client.1.smithi143.stdout:7/12: creat f2 x:0 0 0 2024-09-17T01:06:48.398 INFO:tasks.workunit.client.1.smithi143.stdout:6/5: dwrite f1 [0,4194304] 0 2024-09-17T01:06:48.399 INFO:tasks.workunit.client.1.smithi143.stdout:5/16: mkdir d1/d5/d8 0 2024-09-17T01:06:48.401 INFO:tasks.workunit.client.1.smithi143.stdout:7/13: creat f3 x:0 0 0 2024-09-17T01:06:48.408 INFO:tasks.workunit.client.1.smithi143.stdout:5/17: creat d1/f9 x:0 0 0 2024-09-17T01:06:48.408 INFO:tasks.workunit.client.1.smithi143.stdout:6/6: dwrite f1 [0,4194304] 0 2024-09-17T01:06:48.412 INFO:tasks.workunit.client.1.smithi143.stdout:5/18: mknod d1/ca 0 2024-09-17T01:06:48.418 INFO:tasks.workunit.client.1.smithi143.stdout:4/28: link c6 c7 0 2024-09-17T01:06:48.419 INFO:tasks.workunit.client.1.smithi143.stdout:4/29: write f2 [642652,19023] 0 2024-09-17T01:06:48.420 INFO:tasks.workunit.client.1.smithi143.stdout:5/19: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:06:48.420 INFO:tasks.workunit.client.1.smithi143.stdout:4/30: fdatasync f1 0 2024-09-17T01:06:48.420 INFO:tasks.workunit.client.1.smithi143.stdout:4/31: read - f4 zero size 2024-09-17T01:06:48.425 INFO:tasks.workunit.client.1.smithi143.stdout:5/20: unlink d1/f4 0 2024-09-17T01:06:48.425 INFO:tasks.workunit.client.1.smithi143.stdout:5/21: write d1/d5/f7 [52721,122073] 0 2024-09-17T01:06:48.431 INFO:tasks.workunit.client.1.smithi143.stdout:5/22: symlink d1/lb 0 2024-09-17T01:06:48.431 INFO:tasks.workunit.client.1.smithi143.stdout:5/23: stat d1/f3 0 2024-09-17T01:06:48.439 INFO:tasks.workunit.client.1.smithi143.stdout:5/24: dwrite d1/f3 [0,4194304] 0 2024-09-17T01:06:48.439 INFO:tasks.workunit.client.1.smithi143.stdout:5/25: chown d1/d5/f7 870 1 2024-09-17T01:06:48.448 INFO:tasks.workunit.client.1.smithi143.stdout:5/26: dwrite d1/d5/f7 [0,4194304] 0 2024-09-17T01:06:48.448 INFO:tasks.workunit.client.1.smithi143.stdout:5/27: truncate d1/f9 361896 0 2024-09-17T01:06:48.451 INFO:tasks.workunit.client.1.smithi143.stdout:5/28: symlink d1/d5/d8/lc 0 2024-09-17T01:06:48.452 INFO:tasks.workunit.client.1.smithi143.stdout:0/24: getdents d3 0 2024-09-17T01:06:48.454 INFO:tasks.workunit.client.1.smithi143.stdout:0/25: creat d3/f7 x:0 0 0 2024-09-17T01:06:48.456 INFO:tasks.workunit.client.1.smithi143.stdout:0/26: mkdir d3/d5/d8 0 2024-09-17T01:06:48.456 INFO:tasks.workunit.client.1.smithi143.stdout:7/14: fsync f3 0 2024-09-17T01:06:48.459 INFO:tasks.workunit.client.1.smithi143.stdout:0/27: unlink d3/f7 0 2024-09-17T01:06:48.459 INFO:tasks.workunit.client.1.smithi143.stdout:0/28: chown d3/d5/d8 203898064 1 2024-09-17T01:06:48.460 INFO:tasks.workunit.client.1.smithi143.stdout:7/15: mkdir d4 0 2024-09-17T01:06:48.462 INFO:tasks.workunit.client.1.smithi143.stdout:5/29: fsync d1/f3 0 2024-09-17T01:06:48.463 INFO:tasks.workunit.client.1.smithi143.stdout:0/29: unlink l2 0 2024-09-17T01:06:48.465 INFO:tasks.workunit.client.1.smithi143.stdout:4/32: getdents . 0 2024-09-17T01:06:48.468 INFO:tasks.workunit.client.1.smithi143.stdout:0/30: unlink c1 0 2024-09-17T01:06:48.469 INFO:tasks.workunit.client.1.smithi143.stdout:0/31: chown d3/d5 149168 1 2024-09-17T01:06:48.469 INFO:tasks.workunit.client.1.smithi143.stdout:0/32: truncate - no filename 2024-09-17T01:06:48.470 INFO:tasks.workunit.client.1.smithi143.stdout:0/33: write - no filename 2024-09-17T01:06:48.470 INFO:tasks.workunit.client.1.smithi143.stdout:0/34: dwrite - no filename 2024-09-17T01:06:48.470 INFO:tasks.workunit.client.1.smithi143.stdout:7/16: creat d4/f5 x:0 0 0 2024-09-17T01:06:48.471 INFO:tasks.workunit.client.1.smithi143.stdout:5/30: dwrite d1/f9 [0,4194304] 0 2024-09-17T01:06:48.474 INFO:tasks.workunit.client.1.smithi143.stdout:0/35: creat d3/d5/f9 x:0 0 0 2024-09-17T01:06:48.475 INFO:tasks.workunit.client.1.smithi143.stdout:5/31: mkdir d1/dd 0 2024-09-17T01:06:48.478 INFO:tasks.workunit.client.1.smithi143.stdout:4/33: dwrite f2 [0,4194304] 0 2024-09-17T01:06:48.479 INFO:tasks.workunit.client.1.smithi143.stdout:5/32: chown d1/d5/f7 113699 1 2024-09-17T01:06:48.480 INFO:tasks.workunit.client.1.smithi143.stdout:0/36: symlink d3/d5/la 0 2024-09-17T01:06:48.481 INFO:tasks.workunit.client.1.smithi143.stdout:4/34: symlink l8 0 2024-09-17T01:06:48.482 INFO:tasks.workunit.client.1.smithi143.stdout:0/37: dread - d3/d5/f9 zero size 2024-09-17T01:06:48.484 INFO:tasks.workunit.client.1.smithi143.stdout:5/33: creat d1/d5/fe x:0 0 0 2024-09-17T01:06:48.485 INFO:tasks.workunit.client.1.smithi143.stdout:0/38: readlink d3/d5/la 0 2024-09-17T01:06:48.486 INFO:tasks.workunit.client.1.smithi143.stdout:7/17: dwrite f2 [0,4194304] 0 2024-09-17T01:06:48.487 INFO:tasks.workunit.client.1.smithi143.stdout:0/39: write d3/d5/f9 [129462,79346] 0 2024-09-17T01:06:48.489 INFO:tasks.workunit.client.1.smithi143.stdout:5/34: mkdir d1/d5/df 0 2024-09-17T01:06:48.490 INFO:tasks.workunit.client.1.smithi143.stdout:7/18: dread f2 [0,4194304] 0 2024-09-17T01:06:48.493 INFO:tasks.workunit.client.1.smithi143.stdout:5/35: rmdir d1/d5/d8 39 2024-09-17T01:06:48.494 INFO:tasks.workunit.client.1.smithi143.stdout:5/36: write d1/f9 [5082540,44508] 0 2024-09-17T01:06:48.496 INFO:tasks.workunit.client.1.smithi143.stdout:0/40: fdatasync d3/d5/f9 0 2024-09-17T01:06:48.498 INFO:tasks.workunit.client.1.smithi143.stdout:0/41: write d3/d5/f9 [1161583,17072] 0 2024-09-17T01:06:48.501 INFO:tasks.workunit.client.1.smithi143.stdout:5/37: mkdir d1/d5/d10 0 2024-09-17T01:06:48.502 INFO:tasks.workunit.client.1.smithi143.stdout:7/19: dwrite f2 [0,4194304] 0 2024-09-17T01:06:48.502 INFO:tasks.workunit.client.1.smithi143.stdout:7/20: fdatasync f3 0 2024-09-17T01:06:48.503 INFO:tasks.workunit.client.1.smithi143.stdout:7/21: dread - d4/f5 zero size 2024-09-17T01:06:48.507 INFO:tasks.workunit.client.1.smithi143.stdout:4/35: truncate f3 185697 0 2024-09-17T01:06:48.509 INFO:tasks.workunit.client.1.smithi143.stdout:5/38: mknod d1/d5/df/c11 0 2024-09-17T01:06:48.515 INFO:tasks.workunit.client.1.smithi143.stdout:5/39: symlink d1/l12 0 2024-09-17T01:06:48.517 INFO:tasks.workunit.client.1.smithi143.stdout:4/36: rename c7 to c9 0 2024-09-17T01:06:48.517 INFO:tasks.workunit.client.1.smithi143.stdout:0/42: link d3/d5/l6 d3/lb 0 2024-09-17T01:06:48.519 INFO:tasks.workunit.client.1.smithi143.stdout:0/43: write d3/d5/f9 [320152,28773] 0 2024-09-17T01:06:48.519 INFO:tasks.workunit.client.1.smithi143.stdout:5/40: dread d1/f2 [0,4194304] 0 2024-09-17T01:06:48.520 INFO:tasks.workunit.client.1.smithi143.stdout:4/37: mkdir da 0 2024-09-17T01:06:48.522 INFO:tasks.workunit.client.1.smithi143.stdout:0/44: creat d3/d5/fc x:0 0 0 2024-09-17T01:06:48.523 INFO:tasks.workunit.client.1.smithi143.stdout:5/41: dread d1/d5/f7 [0,4194304] 0 2024-09-17T01:06:48.523 INFO:tasks.workunit.client.1.smithi143.stdout:5/42: dread - d1/d5/fe zero size 2024-09-17T01:06:48.526 INFO:tasks.workunit.client.1.smithi143.stdout:5/43: dread d1/f9 [0,4194304] 0 2024-09-17T01:06:48.528 INFO:tasks.workunit.client.1.smithi143.stdout:0/45: mknod d3/d5/d8/cd 0 2024-09-17T01:06:48.529 INFO:tasks.workunit.client.1.smithi143.stdout:5/44: dread d1/f2 [0,4194304] 0 2024-09-17T01:06:48.534 INFO:tasks.workunit.client.1.smithi143.stdout:0/46: chown d3/lb 10233652 1 2024-09-17T01:06:48.537 INFO:tasks.workunit.client.1.smithi143.stdout:5/45: dwrite d1/f9 [4194304,4194304] 0 2024-09-17T01:06:48.537 INFO:tasks.workunit.client.1.smithi143.stdout:5/46: fdatasync d1/d5/fe 0 2024-09-17T01:06:48.541 INFO:tasks.workunit.client.1.smithi143.stdout:5/47: dread d1/f9 [4194304,4194304] 0 2024-09-17T01:06:48.547 INFO:tasks.workunit.client.1.smithi143.stdout:5/48: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:06:48.552 INFO:tasks.workunit.client.1.smithi143.stdout:5/49: unlink d1/d5/fe 0 2024-09-17T01:06:48.556 INFO:tasks.workunit.client.1.smithi143.stdout:5/50: mknod d1/c13 0 2024-09-17T01:06:48.576 INFO:tasks.workunit.client.1.smithi143.stdout:4/38: dread f3 [0,4194304] 0 2024-09-17T01:06:48.589 INFO:tasks.workunit.client.1.smithi143.stdout:5/51: truncate d1/d5/f7 520044 0 2024-09-17T01:06:48.595 INFO:tasks.workunit.client.1.smithi143.stdout:5/52: rmdir d1/d5/d10 0 2024-09-17T01:06:48.598 INFO:tasks.workunit.client.1.smithi143.stdout:5/53: creat d1/f14 x:0 0 0 2024-09-17T01:06:48.602 INFO:tasks.workunit.client.1.smithi143.stdout:5/54: symlink d1/d5/l15 0 2024-09-17T01:06:48.603 INFO:tasks.workunit.client.1.smithi143.stdout:5/55: write d1/f3 [1838658,36036] 0 2024-09-17T01:06:48.605 INFO:tasks.workunit.client.1.smithi143.stdout:5/56: write d1/f9 [6123093,16008] 0 2024-09-17T01:06:48.639 INFO:tasks.workunit.client.1.smithi143.stdout:4/39: write f3 [857282,45495] 0 2024-09-17T01:06:48.639 INFO:tasks.workunit.client.1.smithi143.stdout:4/40: write f1 [1872737,97089] 0 2024-09-17T01:06:48.643 INFO:tasks.workunit.client.1.smithi143.stdout:4/41: unlink f4 0 2024-09-17T01:06:48.646 INFO:tasks.workunit.client.1.smithi143.stdout:4/42: unlink f3 0 2024-09-17T01:06:48.654 INFO:tasks.workunit.client.1.smithi143.stdout:5/57: rename d1/d5/f7 to d1/d5/d8/f16 0 2024-09-17T01:06:48.657 INFO:tasks.workunit.client.1.smithi143.stdout:4/43: rename f1 to da/fb 0 2024-09-17T01:06:48.662 INFO:tasks.workunit.client.1.smithi143.stdout:4/44: mknod da/cc 0 2024-09-17T01:06:48.663 INFO:tasks.workunit.client.1.smithi143.stdout:5/58: symlink d1/d5/l17 0 2024-09-17T01:06:48.665 INFO:tasks.workunit.client.1.smithi143.stdout:4/45: creat da/fd x:0 0 0 2024-09-17T01:06:48.665 INFO:tasks.workunit.client.1.smithi143.stdout:4/46: fsync f2 0 2024-09-17T01:06:48.668 INFO:tasks.workunit.client.1.smithi143.stdout:4/47: unlink da/fd 0 2024-09-17T01:06:48.669 INFO:tasks.workunit.client.1.smithi143.stdout:5/59: dwrite d1/f3 [0,4194304] 0 2024-09-17T01:06:48.672 INFO:tasks.workunit.client.1.smithi143.stdout:4/48: creat da/fe x:0 0 0 2024-09-17T01:06:48.678 INFO:tasks.workunit.client.1.smithi143.stdout:4/49: rename c6 to da/cf 0 2024-09-17T01:06:48.680 INFO:tasks.workunit.client.1.smithi143.stdout:5/60: creat d1/d5/f18 x:0 0 0 2024-09-17T01:06:48.681 INFO:tasks.workunit.client.1.smithi143.stdout:5/61: readlink d1/d5/l17 0 2024-09-17T01:06:48.681 INFO:tasks.workunit.client.1.smithi143.stdout:5/62: read d1/f3 [1763328,83150] 0 2024-09-17T01:06:48.682 INFO:tasks.workunit.client.1.smithi143.stdout:5/63: write d1/d5/f18 [440947,39154] 0 2024-09-17T01:06:48.717 INFO:tasks.workunit.client.1.smithi143.stdout:5/64: creat d1/f19 x:0 0 0 2024-09-17T01:06:48.720 INFO:tasks.workunit.client.1.smithi143.stdout:5/65: write d1/f3 [1281971,89767] 0 2024-09-17T01:06:48.725 INFO:tasks.workunit.client.1.smithi143.stdout:5/66: getdents d1/dd 0 2024-09-17T01:06:48.725 INFO:tasks.workunit.client.1.smithi143.stdout:5/67: fsync d1/f3 0 2024-09-17T01:06:48.733 INFO:tasks.workunit.client.1.smithi143.stdout:5/68: rename d1/lb to d1/d5/l1a 0 2024-09-17T01:06:48.753 INFO:tasks.workunit.client.1.smithi143.stdout:4/50: fsync da/fb 0 2024-09-17T01:06:48.756 INFO:tasks.workunit.client.1.smithi143.stdout:4/51: dread da/fb [0,4194304] 0 2024-09-17T01:06:48.761 INFO:tasks.workunit.client.1.smithi143.stdout:4/52: truncate da/fb 3638671 0 2024-09-17T01:06:48.798 INFO:tasks.workunit.client.1.smithi143.stdout:5/69: truncate d1/d5/d8/f16 1220742 0 2024-09-17T01:06:48.802 INFO:tasks.workunit.client.1.smithi143.stdout:5/70: rename d1/f9 to d1/d5/df/f1b 0 2024-09-17T01:06:48.803 INFO:tasks.workunit.client.1.smithi143.stdout:5/71: write d1/f19 [757085,16620] 0 2024-09-17T01:06:48.806 INFO:tasks.workunit.client.1.smithi143.stdout:5/72: creat d1/dd/f1c x:0 0 0 2024-09-17T01:06:48.806 INFO:tasks.workunit.client.1.smithi143.stdout:5/73: dread - d1/dd/f1c zero size 2024-09-17T01:06:48.807 INFO:tasks.workunit.client.1.smithi143.stdout:5/74: readlink d1/d5/l17 0 2024-09-17T01:06:48.807 INFO:tasks.workunit.client.1.smithi143.stdout:5/75: chown l0 3574 1 2024-09-17T01:06:48.807 INFO:tasks.workunit.client.1.smithi143.stdout:5/76: readlink l0 0 2024-09-17T01:06:48.808 INFO:tasks.workunit.client.1.smithi143.stdout:5/77: fsync d1/d5/f18 0 2024-09-17T01:06:48.810 INFO:tasks.workunit.client.1.smithi143.stdout:5/78: write d1/dd/f1c [446120,62006] 0 2024-09-17T01:06:48.812 INFO:tasks.workunit.client.1.smithi143.stdout:5/79: read d1/dd/f1c [2605,89153] 0 2024-09-17T01:06:48.818 INFO:tasks.workunit.client.1.smithi143.stdout:5/80: link d1/d5/df/f1b d1/dd/f1d 0 2024-09-17T01:06:48.820 INFO:tasks.workunit.client.1.smithi143.stdout:5/81: mknod d1/dd/c1e 0 2024-09-17T01:06:48.830 INFO:tasks.workunit.client.1.smithi143.stdout:5/82: rename d1/d5/d8 to d1/d5/df/d1f 0 2024-09-17T01:06:48.833 INFO:tasks.workunit.client.1.smithi143.stdout:4/53: write da/fb [3872887,86453] 0 2024-09-17T01:06:48.834 INFO:tasks.workunit.client.1.smithi143.stdout:4/54: readlink l8 0 2024-09-17T01:06:48.835 INFO:tasks.workunit.client.1.smithi143.stdout:4/55: mknod da/c10 0 2024-09-17T01:06:48.836 INFO:tasks.workunit.client.1.smithi143.stdout:4/56: write da/fe [923013,51740] 0 2024-09-17T01:06:48.839 INFO:tasks.workunit.client.1.smithi143.stdout:4/57: creat da/f11 x:0 0 0 2024-09-17T01:06:48.839 INFO:tasks.workunit.client.1.smithi143.stdout:4/58: fsync da/fb 0 2024-09-17T01:06:48.840 INFO:tasks.workunit.client.1.smithi143.stdout:4/59: write da/fe [1297480,717] 0 2024-09-17T01:06:48.845 INFO:tasks.workunit.client.1.smithi143.stdout:4/60: rename c9 to da/c12 0 2024-09-17T01:06:48.846 INFO:tasks.workunit.client.1.smithi143.stdout:4/61: creat da/f13 x:0 0 0 2024-09-17T01:06:48.850 INFO:tasks.workunit.client.1.smithi143.stdout:4/62: dread da/fb [0,4194304] 0 2024-09-17T01:06:48.850 INFO:tasks.workunit.client.1.smithi143.stdout:4/63: write f2 [1016175,58338] 0 2024-09-17T01:06:48.855 INFO:tasks.workunit.client.1.smithi143.stdout:4/64: mknod da/c14 0 2024-09-17T01:06:48.855 INFO:tasks.workunit.client.1.smithi143.stdout:4/65: mknod da/c15 0 2024-09-17T01:06:48.855 INFO:tasks.workunit.client.1.smithi143.stdout:4/66: fdatasync da/fb 0 2024-09-17T01:06:48.869 INFO:tasks.workunit.client.1.smithi143.stdout:4/67: truncate da/fe 949694 0 2024-09-17T01:06:48.872 INFO:tasks.workunit.client.1.smithi143.stdout:4/68: dread f2 [0,4194304] 0 2024-09-17T01:06:48.876 INFO:tasks.workunit.client.1.smithi143.stdout:4/69: link l8 da/l16 0 2024-09-17T01:06:48.878 INFO:tasks.workunit.client.1.smithi143.stdout:4/70: rename da/f13 to da/f17 0 2024-09-17T01:06:48.891 INFO:tasks.workunit.client.1.smithi143.stdout:4/71: write da/fe [1560819,36409] 0 2024-09-17T01:06:48.894 INFO:tasks.workunit.client.1.smithi143.stdout:4/72: rename da/cc to da/c18 0 2024-09-17T01:06:48.899 INFO:tasks.workunit.client.1.smithi143.stdout:4/73: dread da/fe [0,4194304] 0 2024-09-17T01:06:48.899 INFO:tasks.workunit.client.1.smithi143.stdout:4/74: dread - da/f17 zero size 2024-09-17T01:06:48.906 INFO:tasks.workunit.client.1.smithi143.stdout:4/75: dwrite da/f17 [0,4194304] 0 2024-09-17T01:06:48.910 INFO:tasks.workunit.client.1.smithi143.stdout:4/76: fsync da/fe 0 2024-09-17T01:06:48.914 INFO:tasks.workunit.client.1.smithi143.stdout:4/77: dread da/f17 [0,4194304] 0 2024-09-17T01:06:48.915 INFO:tasks.workunit.client.1.smithi143.stdout:4/78: chown da/cf 0 1 2024-09-17T01:06:48.917 INFO:tasks.workunit.client.1.smithi143.stdout:4/79: rmdir da 39 2024-09-17T01:06:48.920 INFO:tasks.workunit.client.1.smithi143.stdout:4/80: dread f2 [0,4194304] 0 2024-09-17T01:06:48.923 INFO:tasks.workunit.client.1.smithi143.stdout:4/81: fdatasync da/f17 0 2024-09-17T01:06:48.925 INFO:tasks.workunit.client.1.smithi143.stdout:4/82: stat da/c18 0 2024-09-17T01:06:48.931 INFO:tasks.workunit.client.1.smithi143.stdout:4/83: dwrite da/fe [0,4194304] 0 2024-09-17T01:06:48.950 INFO:tasks.workunit.client.1.smithi143.stdout:4/84: fsync da/fe 0 2024-09-17T01:06:48.951 INFO:tasks.workunit.client.1.smithi143.stdout:4/85: creat da/f19 x:0 0 0 2024-09-17T01:06:48.955 INFO:tasks.workunit.client.1.smithi143.stdout:4/86: truncate da/fb 1702909 0 2024-09-17T01:06:48.971 INFO:tasks.workunit.client.0.smithi103.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:06:48.977 INFO:tasks.workunit.client.0.smithi103.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:06:48.978 INFO:tasks.workunit.client.0.smithi103.stderr:+ make 2024-09-17T01:06:49.042 INFO:tasks.workunit.client.0.smithi103.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:06:49.071 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:48 smithi103 ceph-mon[28156]: pgmap v5: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:49.092 INFO:tasks.workunit.client.1.smithi143.stdout:4/87: mknod da/c1a 0 2024-09-17T01:06:49.094 INFO:tasks.workunit.client.1.smithi143.stdout:4/88: creat da/f1b x:0 0 0 2024-09-17T01:06:49.097 INFO:tasks.workunit.client.1.smithi143.stdout:4/89: dread da/fb [0,4194304] 0 2024-09-17T01:06:49.097 INFO:tasks.workunit.client.1.smithi143.stdout:4/90: fsync da/fe 0 2024-09-17T01:06:49.097 INFO:tasks.workunit.client.1.smithi143.stdout:4/91: dread - da/f1b zero size 2024-09-17T01:06:49.098 INFO:tasks.workunit.client.1.smithi143.stdout:4/92: creat da/f1c x:0 0 0 2024-09-17T01:06:49.133 INFO:tasks.workunit.client.1.smithi143.stdout:4/93: getdents da 0 2024-09-17T01:06:49.135 INFO:tasks.workunit.client.1.smithi143.stdout:4/94: rename da/f19 to da/f1d 0 2024-09-17T01:06:49.141 INFO:tasks.workunit.client.1.smithi143.stdout:4/95: dwrite da/fe [0,4194304] 0 2024-09-17T01:06:49.141 INFO:tasks.workunit.client.1.smithi143.stdout:4/96: fdatasync da/f11 0 2024-09-17T01:06:49.142 INFO:tasks.workunit.client.1.smithi143.stdout:4/97: write da/fe [937036,2936] 0 2024-09-17T01:06:49.143 INFO:tasks.workunit.client.1.smithi143.stdout:4/98: readlink l8 0 2024-09-17T01:06:49.143 INFO:tasks.workunit.client.1.smithi143.stdout:4/99: chown l8 84 1 2024-09-17T01:06:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:48 smithi143 ceph-mon[35452]: pgmap v5: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:49.684 INFO:tasks.workunit.client.0.smithi103.stderr:++ readlink -f fsstress 2024-09-17T01:06:49.684 INFO:tasks.workunit.client.0.smithi103.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:06:49.685 INFO:tasks.workunit.client.0.smithi103.stderr:+ popd 2024-09-17T01:06:49.685 INFO:tasks.workunit.client.0.smithi103.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:06:49.685 INFO:tasks.workunit.client.0.smithi103.stderr:+ popd 2024-09-17T01:06:49.686 INFO:tasks.workunit.client.0.smithi103.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:06:49.686 INFO:tasks.workunit.client.0.smithi103.stderr:++ mktemp -d -p . 2024-09-17T01:06:49.688 INFO:tasks.workunit.client.0.smithi103.stderr:+ T=./tmp.qbfPf0fcsU 2024-09-17T01:06:49.688 INFO:tasks.workunit.client.0.smithi103.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.qbfPf0fcsU -l 1 -n 1000 -p 10 -v 2024-09-17T01:06:49.691 INFO:tasks.workunit.client.0.smithi103.stdout:seed = 1726103672 2024-09-17T01:06:49.696 INFO:tasks.workunit.client.0.smithi103.stdout:0/0: mknod c0 0 2024-09-17T01:06:49.696 INFO:tasks.workunit.client.0.smithi103.stdout:2/0: dread - no filename 2024-09-17T01:06:49.696 INFO:tasks.workunit.client.0.smithi103.stdout:2/1: dwrite - no filename 2024-09-17T01:06:49.696 INFO:tasks.workunit.client.0.smithi103.stdout:2/2: read - no filename 2024-09-17T01:06:49.696 INFO:tasks.workunit.client.0.smithi103.stdout:2/3: unlink - no file 2024-09-17T01:06:49.697 INFO:tasks.workunit.client.0.smithi103.stdout:2/4: unlink - no file 2024-09-17T01:06:49.697 INFO:tasks.workunit.client.0.smithi103.stdout:2/5: dread - no filename 2024-09-17T01:06:49.697 INFO:tasks.workunit.client.0.smithi103.stdout:2/6: fsync - no filename 2024-09-17T01:06:49.697 INFO:tasks.workunit.client.0.smithi103.stdout:1/0: mknod c0 0 2024-09-17T01:06:49.697 INFO:tasks.workunit.client.0.smithi103.stdout:1/1: fsync - no filename 2024-09-17T01:06:49.698 INFO:tasks.workunit.client.0.smithi103.stdout:3/0: truncate - no filename 2024-09-17T01:06:49.698 INFO:tasks.workunit.client.0.smithi103.stdout:3/1: dwrite - no filename 2024-09-17T01:06:49.699 INFO:tasks.workunit.client.0.smithi103.stdout:1/2: creat f1 x:0 0 0 2024-09-17T01:06:49.700 INFO:tasks.workunit.client.0.smithi103.stdout:0/1: link c0 c1 0 2024-09-17T01:06:49.700 INFO:tasks.workunit.client.0.smithi103.stdout:0/2: dwrite - no filename 2024-09-17T01:06:49.700 INFO:tasks.workunit.client.0.smithi103.stdout:1/3: write f1 [185584,76843] 0 2024-09-17T01:06:49.701 INFO:tasks.workunit.client.0.smithi103.stdout:4/0: chown . 1037831043 1 2024-09-17T01:06:49.701 INFO:tasks.workunit.client.0.smithi103.stdout:4/1: rename - no filename 2024-09-17T01:06:49.701 INFO:tasks.workunit.client.0.smithi103.stdout:4/2: chown . 137 1 2024-09-17T01:06:49.701 INFO:tasks.workunit.client.0.smithi103.stdout:3/2: symlink l0 0 2024-09-17T01:06:49.701 INFO:tasks.workunit.client.0.smithi103.stdout:3/3: write - no filename 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/3: chown . 601266 1 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/4: dread - no filename 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/5: truncate - no filename 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/6: write - no filename 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/7: write - no filename 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/8: chown . 2011761 1 2024-09-17T01:06:49.702 INFO:tasks.workunit.client.0.smithi103.stdout:4/9: fsync - no filename 2024-09-17T01:06:49.708 INFO:tasks.workunit.client.0.smithi103.stdout:3/4: rename l0 to l1 0 2024-09-17T01:06:49.709 INFO:tasks.workunit.client.0.smithi103.stdout:3/5: dread - no filename 2024-09-17T01:06:49.709 INFO:tasks.workunit.client.0.smithi103.stdout:3/6: dwrite - no filename 2024-09-17T01:06:49.710 INFO:tasks.workunit.client.0.smithi103.stdout:1/4: dwrite f1 [0,4194304] 0 2024-09-17T01:06:49.710 INFO:tasks.workunit.client.0.smithi103.stdout:4/10: creat f0 x:0 0 0 2024-09-17T01:06:49.712 INFO:tasks.workunit.client.0.smithi103.stdout:3/7: creat f2 x:0 0 0 2024-09-17T01:06:49.713 INFO:tasks.workunit.client.0.smithi103.stdout:3/8: write f2 [327216,51355] 0 2024-09-17T01:06:49.714 INFO:tasks.workunit.client.0.smithi103.stdout:7/0: dread - no filename 2024-09-17T01:06:49.714 INFO:tasks.workunit.client.0.smithi103.stdout:7/1: dread - no filename 2024-09-17T01:06:49.714 INFO:tasks.workunit.client.0.smithi103.stdout:4/11: symlink l1 0 2024-09-17T01:06:49.714 INFO:tasks.workunit.client.0.smithi103.stdout:0/3: link c1 c2 0 2024-09-17T01:06:49.715 INFO:tasks.workunit.client.0.smithi103.stdout:0/4: write - no filename 2024-09-17T01:06:49.715 INFO:tasks.workunit.client.0.smithi103.stdout:0/5: read - no filename 2024-09-17T01:06:49.715 INFO:tasks.workunit.client.0.smithi103.stdout:0/6: dread - no filename 2024-09-17T01:06:49.715 INFO:tasks.workunit.client.0.smithi103.stdout:0/7: read - no filename 2024-09-17T01:06:49.715 INFO:tasks.workunit.client.0.smithi103.stdout:0/8: readlink - no filename 2024-09-17T01:06:49.715 INFO:tasks.workunit.client.0.smithi103.stdout:1/5: mkdir d2 0 2024-09-17T01:06:49.716 INFO:tasks.workunit.client.0.smithi103.stdout:6/0: mknod c0 0 2024-09-17T01:06:49.716 INFO:tasks.workunit.client.0.smithi103.stdout:6/1: write - no filename 2024-09-17T01:06:49.718 INFO:tasks.workunit.client.0.smithi103.stdout:8/0: dread - no filename 2024-09-17T01:06:49.718 INFO:tasks.workunit.client.0.smithi103.stdout:8/1: fdatasync - no filename 2024-09-17T01:06:49.718 INFO:tasks.workunit.client.0.smithi103.stdout:8/2: unlink - no file 2024-09-17T01:06:49.718 INFO:tasks.workunit.client.0.smithi103.stdout:4/12: mkdir d2 0 2024-09-17T01:06:49.721 INFO:tasks.workunit.client.0.smithi103.stdout:7/2: symlink l0 0 2024-09-17T01:06:49.721 INFO:tasks.workunit.client.0.smithi103.stdout:6/2: creat f1 x:0 0 0 2024-09-17T01:06:49.721 INFO:tasks.workunit.client.0.smithi103.stdout:6/3: stat c0 0 2024-09-17T01:06:49.722 INFO:tasks.workunit.client.0.smithi103.stdout:1/6: dread f1 [0,4194304] 0 2024-09-17T01:06:49.725 INFO:tasks.workunit.client.0.smithi103.stdout:6/4: creat f2 x:0 0 0 2024-09-17T01:06:49.726 INFO:tasks.workunit.client.0.smithi103.stdout:6/5: truncate f2 259818 0 2024-09-17T01:06:49.726 INFO:tasks.workunit.client.0.smithi103.stdout:8/3: mkdir d0 0 2024-09-17T01:06:49.732 INFO:tasks.workunit.client.0.smithi103.stdout:6/6: mkdir d3 0 2024-09-17T01:06:49.735 INFO:tasks.workunit.client.0.smithi103.stdout:9/0: creat f0 x:0 0 0 2024-09-17T01:06:49.736 INFO:tasks.workunit.client.0.smithi103.stdout:9/1: read - f0 zero size 2024-09-17T01:06:49.737 INFO:tasks.workunit.client.0.smithi103.stdout:1/7: dwrite f1 [0,4194304] 0 2024-09-17T01:06:49.737 INFO:tasks.workunit.client.0.smithi103.stdout:4/13: rmdir d2 0 2024-09-17T01:06:49.737 INFO:tasks.workunit.client.0.smithi103.stdout:1/8: stat f1 0 2024-09-17T01:06:49.737 INFO:tasks.workunit.client.0.smithi103.stdout:8/4: getdents d0 0 2024-09-17T01:06:49.738 INFO:tasks.workunit.client.0.smithi103.stdout:8/5: chown d0 0 1 2024-09-17T01:06:49.738 INFO:tasks.workunit.client.0.smithi103.stdout:8/6: dwrite - no filename 2024-09-17T01:06:49.739 INFO:tasks.workunit.client.0.smithi103.stdout:7/3: link l0 l1 0 2024-09-17T01:06:49.740 INFO:tasks.workunit.client.0.smithi103.stdout:9/2: mknod c1 0 2024-09-17T01:06:49.741 INFO:tasks.workunit.client.0.smithi103.stdout:9/3: dread - f0 zero size 2024-09-17T01:06:49.741 INFO:tasks.workunit.client.0.smithi103.stdout:9/4: fdatasync f0 0 2024-09-17T01:06:49.741 INFO:tasks.workunit.client.0.smithi103.stdout:4/14: rename f0 to f3 0 2024-09-17T01:06:49.742 INFO:tasks.workunit.client.0.smithi103.stdout:9/5: truncate f0 780512 0 2024-09-17T01:06:49.743 INFO:tasks.workunit.client.0.smithi103.stdout:6/7: link f2 d3/f4 0 2024-09-17T01:06:49.746 INFO:tasks.workunit.client.0.smithi103.stdout:1/9: creat d2/f3 x:0 0 0 2024-09-17T01:06:49.749 INFO:tasks.workunit.client.0.smithi103.stdout:9/6: symlink l2 0 2024-09-17T01:06:49.750 INFO:tasks.workunit.client.0.smithi103.stdout:8/7: mkdir d0/d1 0 2024-09-17T01:06:49.752 INFO:tasks.workunit.client.0.smithi103.stdout:6/8: rename c0 to d3/c5 0 2024-09-17T01:06:49.755 INFO:tasks.workunit.client.0.smithi103.stdout:6/9: dread d3/f4 [0,4194304] 0 2024-09-17T01:06:49.756 INFO:tasks.workunit.client.0.smithi103.stdout:1/10: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:06:49.757 INFO:tasks.workunit.client.0.smithi103.stdout:1/11: read d2/f3 [413605,126895] 0 2024-09-17T01:06:49.758 INFO:tasks.workunit.client.0.smithi103.stdout:4/15: link l1 l4 0 2024-09-17T01:06:49.759 INFO:tasks.workunit.client.0.smithi103.stdout:1/12: write f1 [2363769,101858] 0 2024-09-17T01:06:49.762 INFO:tasks.workunit.client.0.smithi103.stdout:6/10: mkdir d3/d6 0 2024-09-17T01:06:49.766 INFO:tasks.workunit.client.0.smithi103.stdout:9/7: link l2 l3 0 2024-09-17T01:06:49.766 INFO:tasks.workunit.client.0.smithi103.stdout:9/8: rmdir - no directory 2024-09-17T01:06:49.770 INFO:tasks.workunit.client.0.smithi103.stdout:6/11: write d3/f4 [1289600,49796] 0 2024-09-17T01:06:49.770 INFO:tasks.workunit.client.0.smithi103.stdout:4/16: chown l1 1 1 2024-09-17T01:06:49.781 INFO:tasks.workunit.client.0.smithi103.stdout:9/9: dwrite f0 [0,4194304] 0 2024-09-17T01:06:49.783 INFO:tasks.workunit.client.0.smithi103.stdout:6/12: dwrite f1 [0,4194304] 0 2024-09-17T01:06:49.825 INFO:tasks.workunit.client.0.smithi103.stdout:3/9: chown l1 61470 1 2024-09-17T01:06:49.826 INFO:tasks.workunit.client.0.smithi103.stdout:0/9: getdents . 0 2024-09-17T01:06:49.828 INFO:tasks.workunit.client.0.smithi103.stdout:3/10: dread f2 [0,4194304] 0 2024-09-17T01:06:49.829 INFO:tasks.workunit.client.0.smithi103.stdout:0/10: creat f3 x:0 0 0 2024-09-17T01:06:49.830 INFO:tasks.workunit.client.0.smithi103.stdout:0/11: dread - f3 zero size 2024-09-17T01:06:49.830 INFO:tasks.workunit.client.0.smithi103.stdout:0/12: read - f3 zero size 2024-09-17T01:06:49.830 INFO:tasks.workunit.client.0.smithi103.stdout:0/13: readlink - no filename 2024-09-17T01:06:49.831 INFO:tasks.workunit.client.0.smithi103.stdout:3/11: mkdir d3 0 2024-09-17T01:06:49.832 INFO:tasks.workunit.client.0.smithi103.stdout:0/14: write f3 [56056,60009] 0 2024-09-17T01:06:49.834 INFO:tasks.workunit.client.0.smithi103.stdout:3/12: write f2 [411760,111222] 0 2024-09-17T01:06:49.837 INFO:tasks.workunit.client.0.smithi103.stdout:3/13: dread f2 [0,4194304] 0 2024-09-17T01:06:49.840 INFO:tasks.workunit.client.0.smithi103.stdout:7/4: getdents . 0 2024-09-17T01:06:49.840 INFO:tasks.workunit.client.0.smithi103.stdout:7/5: dread - no filename 2024-09-17T01:06:49.840 INFO:tasks.workunit.client.0.smithi103.stdout:7/6: read - no filename 2024-09-17T01:06:49.841 INFO:tasks.workunit.client.0.smithi103.stdout:3/14: symlink d3/l4 0 2024-09-17T01:06:49.842 INFO:tasks.workunit.client.0.smithi103.stdout:0/15: dwrite f3 [0,4194304] 0 2024-09-17T01:06:49.843 INFO:tasks.workunit.client.0.smithi103.stdout:7/7: creat f2 x:0 0 0 2024-09-17T01:06:49.843 INFO:tasks.workunit.client.0.smithi103.stdout:3/15: truncate f2 1215029 0 2024-09-17T01:06:49.844 INFO:tasks.workunit.client.0.smithi103.stdout:3/16: chown d3/l4 245460718 1 2024-09-17T01:06:49.845 INFO:tasks.workunit.client.0.smithi103.stdout:7/8: stat l1 0 2024-09-17T01:06:49.846 INFO:tasks.workunit.client.0.smithi103.stdout:7/9: write f2 [231447,39569] 0 2024-09-17T01:06:49.849 INFO:tasks.workunit.client.0.smithi103.stdout:1/13: getdents d2 0 2024-09-17T01:06:49.855 INFO:tasks.workunit.client.0.smithi103.stdout:1/14: creat d2/f4 x:0 0 0 2024-09-17T01:06:49.855 INFO:tasks.workunit.client.0.smithi103.stdout:3/17: link d3/l4 d3/l5 0 2024-09-17T01:06:49.864 INFO:tasks.workunit.client.0.smithi103.stdout:0/16: getdents . 0 2024-09-17T01:06:49.867 INFO:tasks.workunit.client.0.smithi103.stdout:7/10: fsync f2 0 2024-09-17T01:06:49.867 INFO:tasks.workunit.client.0.smithi103.stdout:0/17: write f3 [3371209,73981] 0 2024-09-17T01:06:49.868 INFO:tasks.workunit.client.0.smithi103.stdout:1/15: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:06:49.868 INFO:tasks.workunit.client.0.smithi103.stdout:3/18: fsync f2 0 2024-09-17T01:06:49.873 INFO:tasks.workunit.client.0.smithi103.stdout:7/11: mknod c3 0 2024-09-17T01:06:49.873 INFO:tasks.workunit.client.0.smithi103.stdout:9/10: dwrite f0 [4194304,4194304] 0 2024-09-17T01:06:49.873 INFO:tasks.workunit.client.0.smithi103.stdout:0/18: symlink l4 0 2024-09-17T01:06:49.876 INFO:tasks.workunit.client.0.smithi103.stdout:3/19: creat d3/f6 x:0 0 0 2024-09-17T01:06:49.877 INFO:tasks.workunit.client.0.smithi103.stdout:7/12: mkdir d4 0 2024-09-17T01:06:49.884 INFO:tasks.workunit.client.0.smithi103.stdout:1/16: dwrite f1 [0,4194304] 0 2024-09-17T01:06:49.886 INFO:tasks.workunit.client.0.smithi103.stdout:7/13: dread f2 [0,4194304] 0 2024-09-17T01:06:49.890 INFO:tasks.workunit.client.0.smithi103.stdout:1/17: symlink d2/l5 0 2024-09-17T01:06:49.891 INFO:tasks.workunit.client.0.smithi103.stdout:7/14: dread f2 [0,4194304] 0 2024-09-17T01:06:49.893 INFO:tasks.workunit.client.0.smithi103.stdout:1/18: chown d2/l5 103970940 1 2024-09-17T01:06:49.893 INFO:tasks.workunit.client.0.smithi103.stdout:9/11: dread f0 [4194304,4194304] 0 2024-09-17T01:06:49.895 INFO:tasks.workunit.client.0.smithi103.stdout:1/19: chown d2/l5 3274228 1 2024-09-17T01:06:49.899 INFO:tasks.workunit.client.0.smithi103.stdout:3/20: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:06:49.903 INFO:tasks.workunit.client.0.smithi103.stdout:0/19: dwrite f3 [0,4194304] 0 2024-09-17T01:06:49.904 INFO:tasks.workunit.client.0.smithi103.stdout:1/20: link f1 d2/f6 0 2024-09-17T01:06:49.905 INFO:tasks.workunit.client.0.smithi103.stdout:3/21: unlink d3/f6 0 2024-09-17T01:06:49.908 INFO:tasks.workunit.client.0.smithi103.stdout:7/15: dwrite f2 [0,4194304] 0 2024-09-17T01:06:49.909 INFO:tasks.workunit.client.0.smithi103.stdout:3/22: unlink l1 0 2024-09-17T01:06:49.914 INFO:tasks.workunit.client.0.smithi103.stdout:7/16: dread f2 [0,4194304] 0 2024-09-17T01:06:49.915 INFO:tasks.workunit.client.0.smithi103.stdout:3/23: link f2 d3/f7 0 2024-09-17T01:06:49.916 INFO:tasks.workunit.client.0.smithi103.stdout:7/17: creat d4/f5 x:0 0 0 2024-09-17T01:06:49.917 INFO:tasks.workunit.client.0.smithi103.stdout:7/18: dread - d4/f5 zero size 2024-09-17T01:06:49.919 INFO:tasks.workunit.client.0.smithi103.stdout:7/19: mknod d4/c6 0 2024-09-17T01:06:49.920 INFO:tasks.workunit.client.0.smithi103.stdout:7/20: write f2 [1246577,25160] 0 2024-09-17T01:06:50.001 INFO:tasks.workunit.client.0.smithi103.stdout:9/12: fsync f0 0 2024-09-17T01:06:50.001 INFO:tasks.workunit.client.0.smithi103.stdout:9/13: write f0 [8878860,63505] 0 2024-09-17T01:06:50.162 INFO:tasks.workunit.client.0.smithi103.stdout:1/21: fsync f1 0 2024-09-17T01:06:50.162 INFO:tasks.workunit.client.0.smithi103.stdout:9/14: fsync f0 0 2024-09-17T01:06:50.163 INFO:tasks.workunit.client.0.smithi103.stdout:9/15: read f0 [3893774,126631] 0 2024-09-17T01:06:50.168 INFO:tasks.workunit.client.0.smithi103.stdout:9/16: dread f0 [4194304,4194304] 0 2024-09-17T01:06:50.170 INFO:tasks.workunit.client.0.smithi103.stdout:0/20: truncate f3 3400568 0 2024-09-17T01:06:50.173 INFO:tasks.workunit.client.0.smithi103.stdout:3/24: fsync d3/f7 0 2024-09-17T01:06:50.174 INFO:tasks.workunit.client.0.smithi103.stdout:0/21: creat f5 x:0 0 0 2024-09-17T01:06:50.177 INFO:tasks.workunit.client.0.smithi103.stdout:7/21: getdents d4 0 2024-09-17T01:06:50.177 INFO:tasks.workunit.client.0.smithi103.stdout:3/25: dread d3/f7 [0,4194304] 0 2024-09-17T01:06:50.178 INFO:tasks.workunit.client.0.smithi103.stdout:9/17: dwrite f0 [4194304,4194304] 0 2024-09-17T01:06:50.182 INFO:tasks.workunit.client.0.smithi103.stdout:7/22: creat d4/f7 x:0 0 0 2024-09-17T01:06:50.183 INFO:tasks.workunit.client.0.smithi103.stdout:7/23: truncate d4/f7 17175 0 2024-09-17T01:06:50.185 INFO:tasks.workunit.client.0.smithi103.stdout:9/18: mknod c4 0 2024-09-17T01:06:50.186 INFO:tasks.workunit.client.0.smithi103.stdout:7/24: truncate d4/f5 574622 0 2024-09-17T01:06:50.186 INFO:tasks.workunit.client.0.smithi103.stdout:9/19: chown c4 14548747 1 2024-09-17T01:06:50.189 INFO:tasks.workunit.client.0.smithi103.stdout:7/25: write d4/f7 [685174,117849] 0 2024-09-17T01:06:50.191 INFO:tasks.workunit.client.0.smithi103.stdout:7/26: read f2 [739011,59358] 0 2024-09-17T01:06:50.194 INFO:tasks.workunit.client.0.smithi103.stdout:3/26: dwrite f2 [0,4194304] 0 2024-09-17T01:06:50.197 INFO:tasks.workunit.client.0.smithi103.stdout:1/22: fdatasync d2/f3 0 2024-09-17T01:06:50.197 INFO:tasks.workunit.client.0.smithi103.stdout:3/27: read d3/f7 [456434,14428] 0 2024-09-17T01:06:50.199 INFO:tasks.workunit.client.0.smithi103.stdout:9/20: dread f0 [0,4194304] 0 2024-09-17T01:06:50.203 INFO:tasks.workunit.client.0.smithi103.stdout:9/21: creat f5 x:0 0 0 2024-09-17T01:06:50.204 INFO:tasks.workunit.client.0.smithi103.stdout:9/22: stat f0 0 2024-09-17T01:06:50.204 INFO:tasks.workunit.client.0.smithi103.stdout:1/23: mkdir d2/d7 0 2024-09-17T01:06:50.205 INFO:tasks.workunit.client.0.smithi103.stdout:7/27: dwrite f2 [4194304,4194304] 0 2024-09-17T01:06:50.206 INFO:tasks.workunit.client.0.smithi103.stdout:1/24: dread - d2/f4 zero size 2024-09-17T01:06:50.206 INFO:tasks.workunit.client.0.smithi103.stdout:1/25: chown d2/d7 321813 1 2024-09-17T01:06:50.208 INFO:tasks.workunit.client.0.smithi103.stdout:1/26: write d2/f3 [1525065,12050] 0 2024-09-17T01:06:50.208 INFO:tasks.workunit.client.0.smithi103.stdout:1/27: fsync d2/f4 0 2024-09-17T01:06:50.209 INFO:tasks.workunit.client.0.smithi103.stdout:9/23: symlink l6 0 2024-09-17T01:06:50.209 INFO:tasks.workunit.client.0.smithi103.stdout:9/24: dread - f5 zero size 2024-09-17T01:06:50.210 INFO:tasks.workunit.client.0.smithi103.stdout:1/28: fsync d2/f6 0 2024-09-17T01:06:50.211 INFO:tasks.workunit.client.0.smithi103.stdout:7/28: dread f2 [4194304,4194304] 0 2024-09-17T01:06:50.214 INFO:tasks.workunit.client.0.smithi103.stdout:1/29: dread f1 [0,4194304] 0 2024-09-17T01:06:50.215 INFO:tasks.workunit.client.0.smithi103.stdout:9/25: chown l2 17 1 2024-09-17T01:06:50.218 INFO:tasks.workunit.client.0.smithi103.stdout:7/29: rename l1 to d4/l8 0 2024-09-17T01:06:50.218 INFO:tasks.workunit.client.0.smithi103.stdout:1/30: dread f1 [0,4194304] 0 2024-09-17T01:06:50.222 INFO:tasks.workunit.client.0.smithi103.stdout:9/26: mkdir d7 0 2024-09-17T01:06:50.222 INFO:tasks.workunit.client.0.smithi103.stdout:9/27: readlink l2 0 2024-09-17T01:06:50.223 INFO:tasks.workunit.client.0.smithi103.stdout:9/28: chown f5 701425 1 2024-09-17T01:06:50.223 INFO:tasks.workunit.client.0.smithi103.stdout:1/31: dread f1 [0,4194304] 0 2024-09-17T01:06:50.226 INFO:tasks.workunit.client.0.smithi103.stdout:7/30: link f2 d4/f9 0 2024-09-17T01:06:50.229 INFO:tasks.workunit.client.0.smithi103.stdout:9/29: mkdir d7/d8 0 2024-09-17T01:06:50.229 INFO:tasks.workunit.client.0.smithi103.stdout:9/30: chown c1 62 1 2024-09-17T01:06:50.231 INFO:tasks.workunit.client.0.smithi103.stdout:7/31: unlink d4/f9 0 2024-09-17T01:06:50.235 INFO:tasks.workunit.client.0.smithi103.stdout:1/32: link f1 d2/f8 0 2024-09-17T01:06:50.237 INFO:tasks.workunit.client.0.smithi103.stdout:0/22: dread f3 [0,4194304] 0 2024-09-17T01:06:50.237 INFO:tasks.workunit.client.0.smithi103.stdout:1/33: dread - d2/f4 zero size 2024-09-17T01:06:50.237 INFO:tasks.workunit.client.0.smithi103.stdout:7/32: creat d4/fa x:0 0 0 2024-09-17T01:06:50.238 INFO:tasks.workunit.client.0.smithi103.stdout:9/31: dwrite f5 [0,4194304] 0 2024-09-17T01:06:50.240 INFO:tasks.workunit.client.0.smithi103.stdout:7/33: write d4/f5 [538125,119423] 0 2024-09-17T01:06:50.244 INFO:tasks.workunit.client.0.smithi103.stdout:0/23: creat f6 x:0 0 0 2024-09-17T01:06:50.251 INFO:tasks.workunit.client.0.smithi103.stdout:1/34: dread d2/f3 [0,4194304] 0 2024-09-17T01:06:50.254 INFO:tasks.workunit.client.0.smithi103.stdout:1/35: chown d2/f3 4773810 1 2024-09-17T01:06:50.255 INFO:tasks.workunit.client.0.smithi103.stdout:9/32: dwrite f5 [0,4194304] 0 2024-09-17T01:06:50.255 INFO:tasks.workunit.client.0.smithi103.stdout:7/34: dwrite d4/f7 [0,4194304] 0 2024-09-17T01:06:50.256 INFO:tasks.workunit.client.0.smithi103.stdout:9/33: readlink l6 0 2024-09-17T01:06:50.256 INFO:tasks.workunit.client.0.smithi103.stdout:0/24: chown c1 96151 1 2024-09-17T01:06:50.257 INFO:tasks.workunit.client.0.smithi103.stdout:0/25: write f6 [284132,101145] 0 2024-09-17T01:06:50.263 INFO:tasks.workunit.client.0.smithi103.stdout:9/34: dread f0 [0,4194304] 0 2024-09-17T01:06:50.264 INFO:tasks.workunit.client.0.smithi103.stdout:9/35: chown l6 2757 1 2024-09-17T01:06:50.266 INFO:tasks.workunit.client.0.smithi103.stdout:0/26: symlink l7 0 2024-09-17T01:06:50.266 INFO:tasks.workunit.client.0.smithi103.stdout:0/27: readlink l7 0 2024-09-17T01:06:50.266 INFO:tasks.workunit.client.0.smithi103.stdout:7/35: dread f2 [4194304,4194304] 0 2024-09-17T01:06:50.267 INFO:tasks.workunit.client.0.smithi103.stdout:0/28: truncate f5 206877 0 2024-09-17T01:06:50.268 INFO:tasks.workunit.client.0.smithi103.stdout:1/36: getdents d2/d7 0 2024-09-17T01:06:50.268 INFO:tasks.workunit.client.0.smithi103.stdout:0/29: chown f6 24677331 1 2024-09-17T01:06:50.271 INFO:tasks.workunit.client.0.smithi103.stdout:9/36: unlink l6 0 2024-09-17T01:06:50.275 INFO:tasks.workunit.client.0.smithi103.stdout:7/36: rename f2 to d4/fb 0 2024-09-17T01:06:50.275 INFO:tasks.workunit.client.0.smithi103.stdout:0/30: dwrite f6 [0,4194304] 0 2024-09-17T01:06:50.275 INFO:tasks.workunit.client.0.smithi103.stdout:3/28: truncate d3/f7 4170061 0 2024-09-17T01:06:50.276 INFO:tasks.workunit.client.0.smithi103.stdout:7/37: write d4/fa [966498,29954] 0 2024-09-17T01:06:50.282 INFO:tasks.workunit.client.0.smithi103.stdout:9/37: mknod d7/c9 0 2024-09-17T01:06:50.285 INFO:tasks.workunit.client.0.smithi103.stdout:1/37: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:06:50.287 INFO:tasks.workunit.client.0.smithi103.stdout:3/29: creat d3/f8 x:0 0 0 2024-09-17T01:06:50.289 INFO:tasks.workunit.client.0.smithi103.stdout:7/38: symlink d4/lc 0 2024-09-17T01:06:50.291 INFO:tasks.workunit.client.0.smithi103.stdout:0/31: dwrite f3 [0,4194304] 0 2024-09-17T01:06:50.295 INFO:tasks.workunit.client.0.smithi103.stdout:3/30: creat d3/f9 x:0 0 0 2024-09-17T01:06:50.300 INFO:tasks.workunit.client.0.smithi103.stdout:7/39: creat d4/fd x:0 0 0 2024-09-17T01:06:50.303 INFO:tasks.workunit.client.0.smithi103.stdout:1/38: dwrite d2/f6 [0,4194304] 0 2024-09-17T01:06:50.305 INFO:tasks.workunit.client.0.smithi103.stdout:9/38: creat d7/d8/fa x:0 0 0 2024-09-17T01:06:50.308 INFO:tasks.workunit.client.0.smithi103.stdout:0/32: creat f8 x:0 0 0 2024-09-17T01:06:50.310 INFO:tasks.workunit.client.0.smithi103.stdout:0/33: chown l7 236 1 2024-09-17T01:06:50.311 INFO:tasks.workunit.client.0.smithi103.stdout:0/34: write f3 [2270171,83826] 0 2024-09-17T01:06:50.312 INFO:tasks.workunit.client.0.smithi103.stdout:9/39: creat d7/d8/fb x:0 0 0 2024-09-17T01:06:50.312 INFO:tasks.workunit.client.0.smithi103.stdout:7/40: dwrite d4/fd [0,4194304] 0 2024-09-17T01:06:50.313 INFO:tasks.workunit.client.0.smithi103.stdout:0/35: chown f8 321137982 1 2024-09-17T01:06:50.314 INFO:tasks.workunit.client.0.smithi103.stdout:0/36: write f3 [3576415,123184] 0 2024-09-17T01:06:50.315 INFO:tasks.workunit.client.0.smithi103.stdout:0/37: chown f3 37965 1 2024-09-17T01:06:50.322 INFO:tasks.workunit.client.0.smithi103.stdout:7/41: symlink d4/le 0 2024-09-17T01:06:50.328 INFO:tasks.workunit.client.0.smithi103.stdout:1/39: symlink d2/d7/l9 0 2024-09-17T01:06:50.331 INFO:tasks.workunit.client.0.smithi103.stdout:0/38: symlink l9 0 2024-09-17T01:06:50.332 INFO:tasks.workunit.client.0.smithi103.stdout:7/42: creat d4/ff x:0 0 0 2024-09-17T01:06:50.334 INFO:tasks.workunit.client.0.smithi103.stdout:9/40: link f5 d7/fc 0 2024-09-17T01:06:50.339 INFO:tasks.workunit.client.0.smithi103.stdout:0/39: mknod ca 0 2024-09-17T01:06:50.340 INFO:tasks.workunit.client.0.smithi103.stdout:0/40: write f3 [4531454,103233] 0 2024-09-17T01:06:50.341 INFO:tasks.workunit.client.0.smithi103.stdout:7/43: stat l0 0 2024-09-17T01:06:50.341 INFO:tasks.workunit.client.0.smithi103.stdout:0/41: write f6 [3756472,1519] 0 2024-09-17T01:06:50.342 INFO:tasks.workunit.client.0.smithi103.stdout:0/42: write f8 [370785,79890] 0 2024-09-17T01:06:50.348 INFO:tasks.workunit.client.0.smithi103.stdout:3/31: dread f2 [0,4194304] 0 2024-09-17T01:06:50.349 INFO:tasks.workunit.client.0.smithi103.stdout:3/32: write d3/f9 [529734,14657] 0 2024-09-17T01:06:50.350 INFO:tasks.workunit.client.0.smithi103.stdout:3/33: write d3/f8 [591878,62914] 0 2024-09-17T01:06:50.352 INFO:tasks.workunit.client.0.smithi103.stdout:7/44: mkdir d4/d10 0 2024-09-17T01:06:50.353 INFO:tasks.workunit.client.0.smithi103.stdout:7/45: read d4/f5 [199291,39639] 0 2024-09-17T01:06:50.354 INFO:tasks.workunit.client.0.smithi103.stdout:0/43: symlink lb 0 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:2/10: sync 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:5/83: sync 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:6/7: sync 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:1/5: sync 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:0/47: sync 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:3/1: sync 2024-09-17T01:06:50.360 INFO:tasks.workunit.client.1.smithi143.stdout:3/2: dwrite - no filename 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:8/0: sync 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:8/1: dwrite - no filename 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:7/22: sync 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:4/100: sync 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:9/8: sync 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:9/9: dwrite - no filename 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:9/10: fdatasync - no filename 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:9/11: dread - no filename 2024-09-17T01:06:50.361 INFO:tasks.workunit.client.1.smithi143.stdout:9/12: fdatasync - no filename 2024-09-17T01:06:50.362 INFO:tasks.workunit.client.0.smithi103.stdout:0/44: dread f3 [0,4194304] 0 2024-09-17T01:06:50.362 INFO:tasks.workunit.client.0.smithi103.stdout:7/46: mkdir d4/d11 0 2024-09-17T01:06:50.363 INFO:tasks.workunit.client.1.smithi143.stdout:7/23: stat c1 0 2024-09-17T01:06:50.363 INFO:tasks.workunit.client.1.smithi143.stdout:6/8: fdatasync f0 0 2024-09-17T01:06:50.363 INFO:tasks.workunit.client.1.smithi143.stdout:6/9: rmdir - no directory 2024-09-17T01:06:50.364 INFO:tasks.workunit.client.0.smithi103.stdout:3/34: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:06:50.365 INFO:tasks.workunit.client.0.smithi103.stdout:1/40: dwrite f1 [0,4194304] 0 2024-09-17T01:06:50.367 INFO:tasks.workunit.client.0.smithi103.stdout:0/45: creat fc x:0 0 0 2024-09-17T01:06:50.373 INFO:tasks.workunit.client.0.smithi103.stdout:3/35: mknod d3/ca 0 2024-09-17T01:06:50.373 INFO:tasks.workunit.client.0.smithi103.stdout:3/36: chown d3/f7 13 1 2024-09-17T01:06:50.374 INFO:tasks.workunit.client.1.smithi143.stdout:7/24: truncate d4/f5 771240 0 2024-09-17T01:06:50.376 INFO:tasks.workunit.client.0.smithi103.stdout:1/41: symlink d2/d7/la 0 2024-09-17T01:06:50.377 INFO:tasks.workunit.client.0.smithi103.stdout:0/46: mkdir dd 0 2024-09-17T01:06:50.377 INFO:tasks.workunit.client.0.smithi103.stdout:1/42: write d2/f8 [1685287,57007] 0 2024-09-17T01:06:50.377 INFO:tasks.workunit.client.0.smithi103.stdout:0/47: truncate f8 561973 0 2024-09-17T01:06:50.379 INFO:tasks.workunit.client.0.smithi103.stdout:7/47: creat d4/d10/f12 x:0 0 0 2024-09-17T01:06:50.380 INFO:tasks.workunit.client.0.smithi103.stdout:7/48: stat d4/f5 0 2024-09-17T01:06:50.381 INFO:tasks.workunit.client.0.smithi103.stdout:3/37: mknod d3/cb 0 2024-09-17T01:06:50.385 INFO:tasks.workunit.client.0.smithi103.stdout:1/43: dwrite d2/f6 [0,4194304] 0 2024-09-17T01:06:50.392 INFO:tasks.workunit.client.0.smithi103.stdout:3/38: mknod d3/cc 0 2024-09-17T01:06:50.393 INFO:tasks.workunit.client.0.smithi103.stdout:0/48: dread f3 [0,4194304] 0 2024-09-17T01:06:50.395 INFO:tasks.workunit.client.0.smithi103.stdout:1/44: rename f1 to d2/fb 0 2024-09-17T01:06:50.397 INFO:tasks.workunit.client.0.smithi103.stdout:7/49: dwrite d4/f5 [0,4194304] 0 2024-09-17T01:06:50.400 INFO:tasks.workunit.client.0.smithi103.stdout:7/50: truncate d4/d10/f12 607038 0 2024-09-17T01:06:50.400 INFO:tasks.workunit.client.0.smithi103.stdout:7/51: stat c3 0 2024-09-17T01:06:50.401 INFO:tasks.workunit.client.0.smithi103.stdout:9/41: truncate d7/fc 4978914 0 2024-09-17T01:06:50.404 INFO:tasks.workunit.client.0.smithi103.stdout:3/39: rename f2 to d3/fd 0 2024-09-17T01:06:50.406 INFO:tasks.workunit.client.0.smithi103.stdout:0/49: mknod dd/ce 0 2024-09-17T01:06:50.410 INFO:tasks.workunit.client.0.smithi103.stdout:7/52: mknod d4/c13 0 2024-09-17T01:06:50.411 INFO:tasks.workunit.client.0.smithi103.stdout:9/42: mkdir d7/dd 0 2024-09-17T01:06:50.412 INFO:tasks.workunit.client.0.smithi103.stdout:9/43: chown c4 562829203 1 2024-09-17T01:06:50.413 INFO:tasks.workunit.client.0.smithi103.stdout:3/40: creat d3/fe x:0 0 0 2024-09-17T01:06:50.416 INFO:tasks.workunit.client.0.smithi103.stdout:1/45: rename d2/f3 to d2/d7/fc 0 2024-09-17T01:06:50.420 INFO:tasks.workunit.client.0.smithi103.stdout:3/41: write d3/f7 [576801,79477] 0 2024-09-17T01:06:50.422 INFO:tasks.workunit.client.0.smithi103.stdout:1/46: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:06:50.422 INFO:tasks.workunit.client.0.smithi103.stdout:3/42: write d3/f9 [689066,106986] 0 2024-09-17T01:06:50.424 INFO:tasks.workunit.client.0.smithi103.stdout:3/43: write d3/f7 [5232820,46340] 0 2024-09-17T01:06:50.426 INFO:tasks.workunit.client.0.smithi103.stdout:7/53: mknod d4/d11/c14 0 2024-09-17T01:06:50.429 INFO:tasks.workunit.client.0.smithi103.stdout:1/47: dread d2/fb [0,4194304] 0 2024-09-17T01:06:50.430 INFO:tasks.workunit.client.0.smithi103.stdout:7/54: dread d4/d10/f12 [0,4194304] 0 2024-09-17T01:06:50.435 INFO:tasks.workunit.client.0.smithi103.stdout:3/44: chown d3/l4 1 1 2024-09-17T01:06:50.441 INFO:tasks.workunit.client.0.smithi103.stdout:3/45: rename d3/cc to d3/cf 0 2024-09-17T01:06:50.442 INFO:tasks.workunit.client.0.smithi103.stdout:3/46: write d3/fe [54611,80350] 0 2024-09-17T01:06:50.445 INFO:tasks.workunit.client.0.smithi103.stdout:7/55: unlink d4/d10/f12 0 2024-09-17T01:06:50.446 INFO:tasks.workunit.client.0.smithi103.stdout:7/56: readlink d4/lc 0 2024-09-17T01:06:50.447 INFO:tasks.workunit.client.0.smithi103.stdout:7/57: chown c3 294 1 2024-09-17T01:06:50.449 INFO:tasks.workunit.client.0.smithi103.stdout:3/47: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:06:50.454 INFO:tasks.workunit.client.0.smithi103.stdout:1/48: link d2/d7/l9 d2/d7/ld 0 2024-09-17T01:06:50.457 INFO:tasks.workunit.client.0.smithi103.stdout:7/58: creat d4/d10/f15 x:0 0 0 2024-09-17T01:06:50.459 INFO:tasks.workunit.client.0.smithi103.stdout:7/59: dread - d4/d10/f15 zero size 2024-09-17T01:06:50.459 INFO:tasks.workunit.client.0.smithi103.stdout:3/48: dwrite d3/fd [4194304,4194304] 0 2024-09-17T01:06:50.462 INFO:tasks.workunit.client.0.smithi103.stdout:1/49: mkdir d2/de 0 2024-09-17T01:06:50.465 INFO:tasks.workunit.client.0.smithi103.stdout:7/60: mknod d4/d10/c16 0 2024-09-17T01:06:50.467 INFO:tasks.workunit.client.0.smithi103.stdout:1/50: dread d2/f6 [0,4194304] 0 2024-09-17T01:06:50.468 INFO:tasks.workunit.client.0.smithi103.stdout:3/49: mknod d3/c10 0 2024-09-17T01:06:50.469 INFO:tasks.workunit.client.0.smithi103.stdout:7/61: mknod d4/d10/c17 0 2024-09-17T01:06:50.473 INFO:tasks.workunit.client.0.smithi103.stdout:7/62: rename d4/ff to d4/d11/f18 0 2024-09-17T01:06:50.476 INFO:tasks.workunit.client.0.smithi103.stdout:7/63: creat d4/d11/f19 x:0 0 0 2024-09-17T01:06:50.483 INFO:tasks.workunit.client.0.smithi103.stdout:7/64: link d4/fd d4/f1a 0 2024-09-17T01:06:50.486 INFO:tasks.workunit.client.0.smithi103.stdout:7/65: symlink d4/d10/l1b 0 2024-09-17T01:06:50.488 INFO:tasks.workunit.client.0.smithi103.stdout:7/66: symlink d4/l1c 0 2024-09-17T01:06:50.491 INFO:tasks.workunit.client.0.smithi103.stdout:7/67: creat d4/d10/f1d x:0 0 0 2024-09-17T01:06:50.494 INFO:tasks.workunit.client.0.smithi103.stdout:7/68: mknod d4/d11/c1e 0 2024-09-17T01:06:50.500 INFO:tasks.workunit.client.0.smithi103.stdout:7/69: dread d4/fd [0,4194304] 0 2024-09-17T01:06:50.501 INFO:tasks.workunit.client.0.smithi103.stdout:9/44: dwrite f5 [0,4194304] 0 2024-09-17T01:06:50.501 INFO:tasks.workunit.client.0.smithi103.stdout:7/70: stat d4/d10/f15 0 2024-09-17T01:06:50.501 INFO:tasks.workunit.client.0.smithi103.stdout:9/45: readlink l2 0 2024-09-17T01:06:50.504 INFO:tasks.workunit.client.0.smithi103.stdout:7/71: symlink d4/d10/l1f 0 2024-09-17T01:06:50.505 INFO:tasks.workunit.client.0.smithi103.stdout:9/46: creat d7/d8/fe x:0 0 0 2024-09-17T01:06:50.507 INFO:tasks.workunit.client.0.smithi103.stdout:9/47: write d7/d8/fe [64336,36600] 0 2024-09-17T01:06:50.507 INFO:tasks.workunit.client.1.smithi143.stdout:4/101: rename da/c15 to da/c1e 0 2024-09-17T01:06:50.509 INFO:tasks.workunit.client.0.smithi103.stdout:7/72: mknod d4/d11/c20 0 2024-09-17T01:06:50.510 INFO:tasks.workunit.client.1.smithi143.stdout:2/11: fsync d0/d2/f4 0 2024-09-17T01:06:50.511 INFO:tasks.workunit.client.1.smithi143.stdout:2/12: write d0/d2/f4 [765616,86831] 0 2024-09-17T01:06:50.511 INFO:tasks.workunit.client.0.smithi103.stdout:9/48: rename d7/c9 to d7/cf 0 2024-09-17T01:06:50.513 INFO:tasks.workunit.client.1.smithi143.stdout:7/25: mknod d4/c6 0 2024-09-17T01:06:50.514 INFO:tasks.workunit.client.1.smithi143.stdout:1/6: mkdir d0 0 2024-09-17T01:06:50.514 INFO:tasks.workunit.client.1.smithi143.stdout:1/7: truncate - no filename 2024-09-17T01:06:50.514 INFO:tasks.workunit.client.0.smithi103.stdout:7/73: dread d4/f7 [0,4194304] 0 2024-09-17T01:06:50.515 INFO:tasks.workunit.client.0.smithi103.stdout:9/49: creat d7/d8/f10 x:0 0 0 2024-09-17T01:06:50.516 INFO:tasks.workunit.client.0.smithi103.stdout:7/74: readlink d4/l1c 0 2024-09-17T01:06:50.516 INFO:tasks.workunit.client.1.smithi143.stdout:8/2: creat f0 x:0 0 0 2024-09-17T01:06:50.516 INFO:tasks.workunit.client.1.smithi143.stdout:3/3: symlink l0 0 2024-09-17T01:06:50.517 INFO:tasks.workunit.client.1.smithi143.stdout:3/4: dread - no filename 2024-09-17T01:06:50.517 INFO:tasks.workunit.client.1.smithi143.stdout:9/13: creat d3/f4 x:0 0 0 2024-09-17T01:06:50.520 INFO:tasks.workunit.client.1.smithi143.stdout:4/102: rename da/c12 to da/c1f 0 2024-09-17T01:06:50.521 INFO:tasks.workunit.client.1.smithi143.stdout:4/103: truncate da/f1b 1034642 0 2024-09-17T01:06:50.522 INFO:tasks.workunit.client.1.smithi143.stdout:2/13: creat d0/f5 x:0 0 0 2024-09-17T01:06:50.522 INFO:tasks.workunit.client.1.smithi143.stdout:4/104: write da/fe [4108890,5911] 0 2024-09-17T01:06:50.523 INFO:tasks.workunit.client.1.smithi143.stdout:2/14: write d0/f5 [535671,92640] 0 2024-09-17T01:06:50.523 INFO:tasks.workunit.client.1.smithi143.stdout:2/15: readlink d0/d2/l3 0 2024-09-17T01:06:50.526 INFO:tasks.workunit.client.1.smithi143.stdout:3/5: symlink l1 0 2024-09-17T01:06:50.526 INFO:tasks.workunit.client.1.smithi143.stdout:3/6: dread - no filename 2024-09-17T01:06:50.526 INFO:tasks.workunit.client.1.smithi143.stdout:4/105: dread f2 [0,4194304] 0 2024-09-17T01:06:50.527 INFO:tasks.workunit.client.1.smithi143.stdout:9/14: chown l2 1 1 2024-09-17T01:06:50.528 INFO:tasks.workunit.client.1.smithi143.stdout:2/16: dread d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:50.531 INFO:tasks.workunit.client.1.smithi143.stdout:2/17: dread d0/f5 [0,4194304] 0 2024-09-17T01:06:50.531 INFO:tasks.workunit.client.1.smithi143.stdout:1/8: mkdir d0/d1 0 2024-09-17T01:06:50.531 INFO:tasks.workunit.client.1.smithi143.stdout:1/9: chown d0 1309 1 2024-09-17T01:06:50.533 INFO:tasks.workunit.client.1.smithi143.stdout:3/7: rename l1 to l2 0 2024-09-17T01:06:50.533 INFO:tasks.workunit.client.1.smithi143.stdout:3/8: readlink l0 0 2024-09-17T01:06:50.533 INFO:tasks.workunit.client.1.smithi143.stdout:3/9: write - no filename 2024-09-17T01:06:50.535 INFO:tasks.workunit.client.1.smithi143.stdout:4/106: creat da/f20 x:0 0 0 2024-09-17T01:06:50.536 INFO:tasks.workunit.client.1.smithi143.stdout:0/48: getdents d3 0 2024-09-17T01:06:50.536 INFO:tasks.workunit.client.1.smithi143.stdout:0/49: truncate d3/d5/fc 550941 0 2024-09-17T01:06:50.537 INFO:tasks.workunit.client.1.smithi143.stdout:7/26: link c1 d4/c7 0 2024-09-17T01:06:50.537 INFO:tasks.workunit.client.1.smithi143.stdout:0/50: read d3/d5/f9 [720352,116662] 0 2024-09-17T01:06:50.538 INFO:tasks.workunit.client.1.smithi143.stdout:0/51: write d3/d5/fc [167337,122138] 0 2024-09-17T01:06:50.542 INFO:tasks.workunit.client.1.smithi143.stdout:0/52: dread d3/d5/f9 [0,4194304] 0 2024-09-17T01:06:50.543 INFO:tasks.workunit.client.1.smithi143.stdout:7/27: creat d4/f8 x:0 0 0 2024-09-17T01:06:50.544 INFO:tasks.workunit.client.1.smithi143.stdout:1/10: mkdir d0/d1/d2 0 2024-09-17T01:06:50.547 INFO:tasks.workunit.client.1.smithi143.stdout:1/11: creat d0/f3 x:0 0 0 2024-09-17T01:06:50.547 INFO:tasks.workunit.client.1.smithi143.stdout:4/107: dwrite f2 [0,4194304] 0 2024-09-17T01:06:50.548 INFO:tasks.workunit.client.1.smithi143.stdout:0/53: dread d3/d5/f9 [0,4194304] 0 2024-09-17T01:06:50.549 INFO:tasks.workunit.client.1.smithi143.stdout:4/108: dread - da/f11 zero size 2024-09-17T01:06:50.550 INFO:tasks.workunit.client.1.smithi143.stdout:7/28: dread f2 [0,4194304] 0 2024-09-17T01:06:50.550 INFO:tasks.workunit.client.1.smithi143.stdout:1/12: write d0/f3 [802257,81233] 0 2024-09-17T01:06:50.550 INFO:tasks.workunit.client.1.smithi143.stdout:0/54: mkdir d3/de 0 2024-09-17T01:06:50.552 INFO:tasks.workunit.client.1.smithi143.stdout:5/84: write d1/dd/f1d [8222463,23088] 0 2024-09-17T01:06:50.553 INFO:tasks.workunit.client.1.smithi143.stdout:7/29: symlink d4/l9 0 2024-09-17T01:06:50.555 INFO:tasks.workunit.client.1.smithi143.stdout:0/55: mknod d3/d5/d8/cf 0 2024-09-17T01:06:50.558 INFO:tasks.workunit.client.1.smithi143.stdout:5/85: dread d1/dd/f1d [0,4194304] 0 2024-09-17T01:06:50.558 INFO:tasks.workunit.client.1.smithi143.stdout:7/30: dread f2 [0,4194304] 0 2024-09-17T01:06:50.559 INFO:tasks.workunit.client.0.smithi103.stdout:9/50: rename d7/d8 to d7/dd/d11 0 2024-09-17T01:06:50.560 INFO:tasks.workunit.client.1.smithi143.stdout:8/3: fsync f0 0 2024-09-17T01:06:50.560 INFO:tasks.workunit.client.1.smithi143.stdout:8/4: dread - f0 zero size 2024-09-17T01:06:50.561 INFO:tasks.workunit.client.1.smithi143.stdout:9/15: fsync d3/f4 0 2024-09-17T01:06:50.562 INFO:tasks.workunit.client.1.smithi143.stdout:9/16: write d3/f4 [763582,32088] 0 2024-09-17T01:06:50.563 INFO:tasks.workunit.client.0.smithi103.stdout:9/51: creat d7/dd/d11/f12 x:0 0 0 2024-09-17T01:06:50.564 INFO:tasks.workunit.client.1.smithi143.stdout:5/86: creat d1/dd/f20 x:0 0 0 2024-09-17T01:06:50.565 INFO:tasks.workunit.client.1.smithi143.stdout:6/10: truncate f1 2054526 0 2024-09-17T01:06:50.566 INFO:tasks.workunit.client.1.smithi143.stdout:8/5: mknod c1 0 2024-09-17T01:06:50.567 INFO:tasks.workunit.client.1.smithi143.stdout:8/6: fdatasync f0 0 2024-09-17T01:06:50.567 INFO:tasks.workunit.client.1.smithi143.stdout:5/87: dread d1/d5/f18 [0,4194304] 0 2024-09-17T01:06:50.567 INFO:tasks.workunit.client.1.smithi143.stdout:8/7: dread - f0 zero size 2024-09-17T01:06:50.567 INFO:tasks.workunit.client.1.smithi143.stdout:9/17: mknod d3/c5 0 2024-09-17T01:06:50.568 INFO:tasks.workunit.client.1.smithi143.stdout:9/18: write d3/f4 [769159,41411] 0 2024-09-17T01:06:50.569 INFO:tasks.workunit.client.1.smithi143.stdout:9/19: write d3/f4 [1400839,2669] 0 2024-09-17T01:06:50.569 INFO:tasks.workunit.client.1.smithi143.stdout:6/11: mkdir d2 0 2024-09-17T01:06:50.571 INFO:tasks.workunit.client.0.smithi103.stdout:9/52: dwrite d7/dd/d11/f10 [0,4194304] 0 2024-09-17T01:06:50.572 INFO:tasks.workunit.client.1.smithi143.stdout:3/10: readlink l2 0 2024-09-17T01:06:50.573 INFO:tasks.workunit.client.0.smithi103.stdout:9/53: write d7/dd/d11/fb [383376,76508] 0 2024-09-17T01:06:50.575 INFO:tasks.workunit.client.1.smithi143.stdout:8/8: creat f2 x:0 0 0 2024-09-17T01:06:50.575 INFO:tasks.workunit.client.1.smithi143.stdout:8/9: chown f0 3515 1 2024-09-17T01:06:50.576 INFO:tasks.workunit.client.1.smithi143.stdout:4/109: getdents da 0 2024-09-17T01:06:50.577 INFO:tasks.workunit.client.1.smithi143.stdout:4/110: chown da/c18 63 1 2024-09-17T01:06:50.578 INFO:tasks.workunit.client.1.smithi143.stdout:2/18: truncate d0/d2/f4 1398393 0 2024-09-17T01:06:50.582 INFO:tasks.workunit.client.1.smithi143.stdout:9/20: creat d3/f6 x:0 0 0 2024-09-17T01:06:50.583 INFO:tasks.workunit.client.1.smithi143.stdout:3/11: mknod c3 0 2024-09-17T01:06:50.583 INFO:tasks.workunit.client.1.smithi143.stdout:8/10: dwrite f0 [0,4194304] 0 2024-09-17T01:06:50.584 INFO:tasks.workunit.client.1.smithi143.stdout:0/56: truncate d3/d5/f9 835579 0 2024-09-17T01:06:50.589 INFO:tasks.workunit.client.1.smithi143.stdout:0/57: dread d3/d5/fc [0,4194304] 0 2024-09-17T01:06:50.590 INFO:tasks.workunit.client.0.smithi103.stdout:9/54: mknod d7/dd/d11/c13 0 2024-09-17T01:06:50.592 INFO:tasks.workunit.client.1.smithi143.stdout:1/13: truncate d0/f3 700784 0 2024-09-17T01:06:50.595 INFO:tasks.workunit.client.1.smithi143.stdout:3/12: symlink l4 0 2024-09-17T01:06:50.596 INFO:tasks.workunit.client.1.smithi143.stdout:5/88: rmdir d1/dd 39 2024-09-17T01:06:50.597 INFO:tasks.workunit.client.1.smithi143.stdout:5/89: stat l0 0 2024-09-17T01:06:50.599 INFO:tasks.workunit.client.1.smithi143.stdout:8/11: rename c1 to c3 0 2024-09-17T01:06:50.651 INFO:tasks.workunit.client.1.smithi143.stdout:8/12: dread f0 [0,4194304] 0 2024-09-17T01:06:50.651 INFO:tasks.workunit.client.1.smithi143.stdout:2/19: fdatasync d0/d2/f4 0 2024-09-17T01:06:50.652 INFO:tasks.workunit.client.1.smithi143.stdout:3/13: symlink l5 0 2024-09-17T01:06:50.652 INFO:tasks.workunit.client.1.smithi143.stdout:3/14: dwrite - no filename 2024-09-17T01:06:50.652 INFO:tasks.workunit.client.1.smithi143.stdout:3/15: dread - no filename 2024-09-17T01:06:50.656 INFO:tasks.workunit.client.1.smithi143.stdout:0/58: fsync d3/d5/f9 0 2024-09-17T01:06:50.658 INFO:tasks.workunit.client.1.smithi143.stdout:8/13: dwrite f2 [0,4194304] 0 2024-09-17T01:06:50.659 INFO:tasks.workunit.client.1.smithi143.stdout:8/14: chown f2 25202526 1 2024-09-17T01:06:50.665 INFO:tasks.workunit.client.1.smithi143.stdout:3/16: mkdir d6 0 2024-09-17T01:06:50.666 INFO:tasks.workunit.client.1.smithi143.stdout:5/90: mknod d1/dd/c21 0 2024-09-17T01:06:50.668 INFO:tasks.workunit.client.1.smithi143.stdout:4/111: link da/cf da/c21 0 2024-09-17T01:06:50.668 INFO:tasks.workunit.client.1.smithi143.stdout:4/112: readlink da/l16 0 2024-09-17T01:06:50.675 INFO:tasks.workunit.client.1.smithi143.stdout:0/59: mkdir d3/d5/d8/d10 0 2024-09-17T01:06:50.680 INFO:tasks.workunit.client.1.smithi143.stdout:1/14: unlink d0/f3 0 2024-09-17T01:06:50.680 INFO:tasks.workunit.client.1.smithi143.stdout:1/15: dread - no filename 2024-09-17T01:06:50.683 INFO:tasks.workunit.client.1.smithi143.stdout:8/15: dwrite f0 [0,4194304] 0 2024-09-17T01:06:50.685 INFO:tasks.workunit.client.1.smithi143.stdout:4/113: mkdir da/d22 0 2024-09-17T01:06:50.685 INFO:tasks.workunit.client.1.smithi143.stdout:4/114: dread - da/f1c zero size 2024-09-17T01:06:50.689 INFO:tasks.workunit.client.1.smithi143.stdout:0/60: chown d3/d5/l6 14154573 1 2024-09-17T01:06:50.691 INFO:tasks.workunit.client.1.smithi143.stdout:3/17: creat d6/f7 x:0 0 0 2024-09-17T01:06:50.692 INFO:tasks.workunit.client.1.smithi143.stdout:8/16: creat f4 x:0 0 0 2024-09-17T01:06:50.694 INFO:tasks.workunit.client.1.smithi143.stdout:4/115: symlink da/l23 0 2024-09-17T01:06:50.695 INFO:tasks.workunit.client.1.smithi143.stdout:4/116: chown da/l16 7938372 1 2024-09-17T01:06:50.696 INFO:tasks.workunit.client.1.smithi143.stdout:3/18: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:50.697 INFO:tasks.workunit.client.1.smithi143.stdout:0/61: fsync d3/d5/fc 0 2024-09-17T01:06:50.697 INFO:tasks.workunit.client.1.smithi143.stdout:3/19: write d6/f7 [2101459,104216] 0 2024-09-17T01:06:50.700 INFO:tasks.workunit.client.1.smithi143.stdout:4/117: dread f2 [0,4194304] 0 2024-09-17T01:06:50.701 INFO:tasks.workunit.client.1.smithi143.stdout:3/20: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:50.702 INFO:tasks.workunit.client.1.smithi143.stdout:3/21: read d6/f7 [2558180,95076] 0 2024-09-17T01:06:50.703 INFO:tasks.workunit.client.1.smithi143.stdout:3/22: write d6/f7 [2686511,129292] 0 2024-09-17T01:06:50.703 INFO:tasks.workunit.client.1.smithi143.stdout:5/91: rename d1/d5/f18 to d1/d5/f22 0 2024-09-17T01:06:50.704 INFO:tasks.workunit.client.1.smithi143.stdout:5/92: chown d1/d5/df/d1f 744155 1 2024-09-17T01:06:50.704 INFO:tasks.workunit.client.1.smithi143.stdout:5/93: chown d1/dd/c1e 50564666 1 2024-09-17T01:06:50.705 INFO:tasks.workunit.client.1.smithi143.stdout:5/94: chown d1/d5/f22 24385 1 2024-09-17T01:06:50.714 INFO:tasks.workunit.client.1.smithi143.stdout:0/62: mknod d3/d5/d8/c11 0 2024-09-17T01:06:50.715 INFO:tasks.workunit.client.1.smithi143.stdout:0/63: chown d3/d5/l6 14509743 1 2024-09-17T01:06:50.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/16: getdents d0/d1 0 2024-09-17T01:06:50.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/17: truncate - no filename 2024-09-17T01:06:50.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/18: fsync - no filename 2024-09-17T01:06:50.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/19: dwrite - no filename 2024-09-17T01:06:50.724 INFO:tasks.workunit.client.1.smithi143.stdout:1/20: chown d0 769 1 2024-09-17T01:06:50.725 INFO:tasks.workunit.client.1.smithi143.stdout:0/64: write d3/d5/f9 [1726691,86858] 0 2024-09-17T01:06:50.725 INFO:tasks.workunit.client.1.smithi143.stdout:0/65: rename d3 to d3/d5/d8/d10/d12 22 2024-09-17T01:06:50.726 INFO:tasks.workunit.client.1.smithi143.stdout:2/20: write d0/f5 [693670,122434] 0 2024-09-17T01:06:50.727 INFO:tasks.workunit.client.1.smithi143.stdout:2/21: truncate d0/f5 826857 0 2024-09-17T01:06:50.730 INFO:tasks.workunit.client.1.smithi143.stdout:5/95: unlink d1/d5/l1a 0 2024-09-17T01:06:50.730 INFO:tasks.workunit.client.1.smithi143.stdout:5/96: fsync d1/f2 0 2024-09-17T01:06:50.731 INFO:tasks.workunit.client.1.smithi143.stdout:5/97: dread - d1/dd/f20 zero size 2024-09-17T01:06:50.732 INFO:tasks.workunit.client.1.smithi143.stdout:1/21: creat d0/f4 x:0 0 0 2024-09-17T01:06:50.732 INFO:tasks.workunit.client.1.smithi143.stdout:1/22: write d0/f4 [175594,112987] 0 2024-09-17T01:06:50.733 INFO:tasks.workunit.client.1.smithi143.stdout:5/98: dread d1/dd/f1c [0,4194304] 0 2024-09-17T01:06:50.733 INFO:tasks.workunit.client.1.smithi143.stdout:8/17: link c3 c5 0 2024-09-17T01:06:50.735 INFO:tasks.workunit.client.1.smithi143.stdout:0/66: creat d3/d5/d8/f13 x:0 0 0 2024-09-17T01:06:50.735 INFO:tasks.workunit.client.1.smithi143.stdout:0/67: read d3/d5/fc [96607,66455] 0 2024-09-17T01:06:50.736 INFO:tasks.workunit.client.1.smithi143.stdout:2/22: mknod d0/d2/c6 0 2024-09-17T01:06:50.739 INFO:tasks.workunit.client.1.smithi143.stdout:6/12: truncate f1 2502136 0 2024-09-17T01:06:50.740 INFO:tasks.workunit.client.1.smithi143.stdout:1/23: symlink d0/d1/l5 0 2024-09-17T01:06:50.742 INFO:tasks.workunit.client.1.smithi143.stdout:5/99: mkdir d1/d5/df/d23 0 2024-09-17T01:06:50.742 INFO:tasks.workunit.client.1.smithi143.stdout:2/23: dwrite d0/f5 [0,4194304] 0 2024-09-17T01:06:50.743 INFO:tasks.workunit.client.1.smithi143.stdout:0/68: mkdir d3/d14 0 2024-09-17T01:06:50.748 INFO:tasks.workunit.client.1.smithi143.stdout:1/24: mkdir d0/d6 0 2024-09-17T01:06:50.772 INFO:tasks.workunit.client.0.smithi103.stdout:9/55: link d7/dd/d11/c13 d7/dd/c14 0 2024-09-17T01:06:50.773 INFO:tasks.workunit.client.0.smithi103.stdout:9/56: chown d7/dd/d11/fe 1653 1 2024-09-17T01:06:50.775 INFO:tasks.workunit.client.0.smithi103.stdout:9/57: symlink d7/l15 0 2024-09-17T01:06:50.775 INFO:tasks.workunit.client.0.smithi103.stdout:9/58: write d7/fc [1132919,55798] 0 2024-09-17T01:06:50.777 INFO:tasks.workunit.client.0.smithi103.stdout:9/59: write d7/fc [141968,57486] 0 2024-09-17T01:06:50.779 INFO:tasks.workunit.client.0.smithi103.stdout:9/60: creat d7/dd/f16 x:0 0 0 2024-09-17T01:06:50.781 INFO:tasks.workunit.client.0.smithi103.stdout:9/61: write d7/dd/d11/fa [917395,72104] 0 2024-09-17T01:06:50.782 INFO:tasks.workunit.client.0.smithi103.stdout:9/62: symlink d7/dd/l17 0 2024-09-17T01:06:50.783 INFO:tasks.workunit.client.0.smithi103.stdout:9/63: chown l3 468937 1 2024-09-17T01:06:50.836 INFO:tasks.workunit.client.1.smithi143.stdout:2/24: symlink d0/l7 0 2024-09-17T01:06:50.837 INFO:tasks.workunit.client.1.smithi143.stdout:5/100: creat d1/d5/df/d1f/f24 x:0 0 0 2024-09-17T01:06:50.837 INFO:tasks.workunit.client.1.smithi143.stdout:4/118: truncate f2 1201192 0 2024-09-17T01:06:50.838 INFO:tasks.workunit.client.1.smithi143.stdout:6/13: unlink f1 0 2024-09-17T01:06:50.839 INFO:tasks.workunit.client.1.smithi143.stdout:0/69: symlink d3/de/l15 0 2024-09-17T01:06:50.839 INFO:tasks.workunit.client.1.smithi143.stdout:5/101: creat d1/d5/df/f25 x:0 0 0 2024-09-17T01:06:50.839 INFO:tasks.workunit.client.1.smithi143.stdout:1/25: mkdir d0/d6/d7 0 2024-09-17T01:06:50.840 INFO:tasks.workunit.client.1.smithi143.stdout:4/119: mknod da/d22/c24 0 2024-09-17T01:06:50.840 INFO:tasks.workunit.client.1.smithi143.stdout:1/26: fsync d0/f4 0 2024-09-17T01:06:50.841 INFO:tasks.workunit.client.1.smithi143.stdout:5/102: write d1/d5/df/f25 [300960,15107] 0 2024-09-17T01:06:50.841 INFO:tasks.workunit.client.1.smithi143.stdout:6/14: mknod d2/c3 0 2024-09-17T01:06:50.842 INFO:tasks.workunit.client.1.smithi143.stdout:0/70: dread d3/d5/fc [0,4194304] 0 2024-09-17T01:06:50.847 INFO:tasks.workunit.client.1.smithi143.stdout:5/103: creat d1/d5/df/d23/f26 x:0 0 0 2024-09-17T01:06:50.848 INFO:tasks.workunit.client.1.smithi143.stdout:6/15: dwrite f0 [0,4194304] 0 2024-09-17T01:06:50.849 INFO:tasks.workunit.client.1.smithi143.stdout:0/71: link d3/d5/d8/cd d3/d5/d8/c16 0 2024-09-17T01:06:50.851 INFO:tasks.workunit.client.1.smithi143.stdout:1/27: getdents d0 0 2024-09-17T01:06:50.852 INFO:tasks.workunit.client.1.smithi143.stdout:1/28: fdatasync d0/f4 0 2024-09-17T01:06:50.855 INFO:tasks.workunit.client.1.smithi143.stdout:5/104: symlink d1/d5/l27 0 2024-09-17T01:06:50.859 INFO:tasks.workunit.client.1.smithi143.stdout:1/29: mknod d0/d6/c8 0 2024-09-17T01:06:50.860 INFO:tasks.workunit.client.1.smithi143.stdout:5/105: symlink d1/d5/df/d1f/l28 0 2024-09-17T01:06:50.861 INFO:tasks.workunit.client.1.smithi143.stdout:1/30: creat d0/d6/f9 x:0 0 0 2024-09-17T01:06:50.861 INFO:tasks.workunit.client.1.smithi143.stdout:5/106: symlink d1/dd/l29 0 2024-09-17T01:06:50.864 INFO:tasks.workunit.client.1.smithi143.stdout:5/107: creat d1/d5/df/d23/f2a x:0 0 0 2024-09-17T01:06:50.869 INFO:tasks.workunit.client.1.smithi143.stdout:0/72: write d3/d5/fc [1123349,37799] 0 2024-09-17T01:06:50.870 INFO:tasks.workunit.client.1.smithi143.stdout:6/16: truncate f0 2722359 0 2024-09-17T01:06:50.870 INFO:tasks.workunit.client.1.smithi143.stdout:2/25: dwrite d0/f5 [4194304,4194304] 0 2024-09-17T01:06:50.871 INFO:tasks.workunit.client.1.smithi143.stdout:1/31: rmdir d0/d6 39 2024-09-17T01:06:50.871 INFO:tasks.workunit.client.1.smithi143.stdout:1/32: chown d0/d1 6110111 1 2024-09-17T01:06:50.872 INFO:tasks.workunit.client.1.smithi143.stdout:4/120: write f2 [1799558,105127] 0 2024-09-17T01:06:50.874 INFO:tasks.workunit.client.1.smithi143.stdout:7/31: sync 2024-09-17T01:06:50.874 INFO:tasks.workunit.client.1.smithi143.stdout:9/21: sync 2024-09-17T01:06:50.875 INFO:tasks.workunit.client.1.smithi143.stdout:5/108: rmdir d1/d5 39 2024-09-17T01:06:50.878 INFO:tasks.workunit.client.1.smithi143.stdout:1/33: creat d0/d1/fa x:0 0 0 2024-09-17T01:06:50.878 INFO:tasks.workunit.client.1.smithi143.stdout:7/32: dread - d4/f8 zero size 2024-09-17T01:06:50.880 INFO:tasks.workunit.client.1.smithi143.stdout:9/22: mkdir d3/d7 0 2024-09-17T01:06:50.881 INFO:tasks.workunit.client.1.smithi143.stdout:1/34: rmdir d0 39 2024-09-17T01:06:50.882 INFO:tasks.workunit.client.1.smithi143.stdout:7/33: mknod d4/ca 0 2024-09-17T01:06:50.883 INFO:tasks.workunit.client.1.smithi143.stdout:2/26: dread d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:50.884 INFO:tasks.workunit.client.1.smithi143.stdout:4/121: dread f2 [0,4194304] 0 2024-09-17T01:06:50.886 INFO:tasks.workunit.client.1.smithi143.stdout:7/34: fdatasync d4/f8 0 2024-09-17T01:06:50.887 INFO:tasks.workunit.client.1.smithi143.stdout:0/73: dwrite d3/d5/fc [0,4194304] 0 2024-09-17T01:06:50.887 INFO:tasks.workunit.client.1.smithi143.stdout:1/35: read - d0/d6/f9 zero size 2024-09-17T01:06:50.890 INFO:tasks.workunit.client.1.smithi143.stdout:4/122: mkdir da/d22/d25 0 2024-09-17T01:06:50.890 INFO:tasks.workunit.client.1.smithi143.stdout:7/35: write d4/f5 [1687069,42863] 0 2024-09-17T01:06:50.891 INFO:tasks.workunit.client.1.smithi143.stdout:0/74: write d3/d5/d8/f13 [574330,74247] 0 2024-09-17T01:06:50.891 INFO:tasks.workunit.client.1.smithi143.stdout:6/17: dwrite f0 [0,4194304] 0 2024-09-17T01:06:50.892 INFO:tasks.workunit.client.1.smithi143.stdout:7/36: dread - f3 zero size 2024-09-17T01:06:50.893 INFO:tasks.workunit.client.1.smithi143.stdout:1/36: creat d0/d1/fb x:0 0 0 2024-09-17T01:06:50.894 INFO:tasks.workunit.client.1.smithi143.stdout:9/23: getdents d3 0 2024-09-17T01:06:50.895 INFO:tasks.workunit.client.1.smithi143.stdout:5/109: dread d1/d5/df/f1b [0,4194304] 0 2024-09-17T01:06:50.896 INFO:tasks.workunit.client.1.smithi143.stdout:6/18: mknod d2/c4 0 2024-09-17T01:06:50.897 INFO:tasks.workunit.client.1.smithi143.stdout:7/37: write f2 [3142021,76357] 0 2024-09-17T01:06:50.898 INFO:tasks.workunit.client.1.smithi143.stdout:5/110: truncate d1/f14 260311 0 2024-09-17T01:06:50.901 INFO:tasks.workunit.client.1.smithi143.stdout:2/27: dwrite d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:50.902 INFO:tasks.workunit.client.1.smithi143.stdout:9/24: creat d3/f8 x:0 0 0 2024-09-17T01:06:50.902 INFO:tasks.workunit.client.1.smithi143.stdout:5/111: fsync d1/dd/f20 0 2024-09-17T01:06:50.902 INFO:tasks.workunit.client.1.smithi143.stdout:7/38: write f2 [542057,1059] 0 2024-09-17T01:06:50.902 INFO:tasks.workunit.client.1.smithi143.stdout:1/37: mkdir d0/dc 0 2024-09-17T01:06:50.903 INFO:tasks.workunit.client.1.smithi143.stdout:0/75: mkdir d3/d14/d17 0 2024-09-17T01:06:50.903 INFO:tasks.workunit.client.1.smithi143.stdout:5/112: readlink l0 0 2024-09-17T01:06:50.903 INFO:tasks.workunit.client.1.smithi143.stdout:1/38: chown d0 12 1 2024-09-17T01:06:50.904 INFO:tasks.workunit.client.1.smithi143.stdout:6/19: creat d2/f5 x:0 0 0 2024-09-17T01:06:50.905 INFO:tasks.workunit.client.1.smithi143.stdout:7/39: rename d4 to d4/db 22 2024-09-17T01:06:50.905 INFO:tasks.workunit.client.1.smithi143.stdout:4/123: link da/f1b da/f26 0 2024-09-17T01:06:50.906 INFO:tasks.workunit.client.1.smithi143.stdout:2/28: rmdir d0/d2 39 2024-09-17T01:06:50.906 INFO:tasks.workunit.client.1.smithi143.stdout:0/76: write d3/d5/fc [573929,123806] 0 2024-09-17T01:06:50.907 INFO:tasks.workunit.client.1.smithi143.stdout:7/40: truncate d4/f8 1019568 0 2024-09-17T01:06:50.908 INFO:tasks.workunit.client.1.smithi143.stdout:3/23: sync 2024-09-17T01:06:50.909 INFO:tasks.workunit.client.1.smithi143.stdout:4/124: unlink da/fb 0 2024-09-17T01:06:50.912 INFO:tasks.workunit.client.1.smithi143.stdout:1/39: creat d0/d6/fd x:0 0 0 2024-09-17T01:06:50.913 INFO:tasks.workunit.client.1.smithi143.stdout:0/77: dread d3/d5/fc [0,4194304] 0 2024-09-17T01:06:50.914 INFO:tasks.workunit.client.1.smithi143.stdout:9/25: mkdir d3/d7/d9 0 2024-09-17T01:06:50.915 INFO:tasks.workunit.client.1.smithi143.stdout:1/40: read - d0/d6/f9 zero size 2024-09-17T01:06:50.917 INFO:tasks.workunit.client.1.smithi143.stdout:5/113: creat d1/f2b x:0 0 0 2024-09-17T01:06:50.918 INFO:tasks.workunit.client.1.smithi143.stdout:5/114: chown d1 35781 1 2024-09-17T01:06:50.920 INFO:tasks.workunit.client.1.smithi143.stdout:0/78: creat d3/de/f18 x:0 0 0 2024-09-17T01:06:50.921 INFO:tasks.workunit.client.1.smithi143.stdout:7/41: dread d4/f5 [0,4194304] 0 2024-09-17T01:06:50.922 INFO:tasks.workunit.client.1.smithi143.stdout:6/20: rmdir d2 39 2024-09-17T01:06:50.924 INFO:tasks.workunit.client.1.smithi143.stdout:9/26: dread d3/f4 [0,4194304] 0 2024-09-17T01:06:50.924 INFO:tasks.workunit.client.1.smithi143.stdout:0/79: read d3/d5/f9 [58066,106107] 0 2024-09-17T01:06:50.925 INFO:tasks.workunit.client.1.smithi143.stdout:1/41: rename d0/d1 to d0/d6/d7/de 0 2024-09-17T01:06:50.925 INFO:tasks.workunit.client.1.smithi143.stdout:6/21: truncate f0 5231193 0 2024-09-17T01:06:50.928 INFO:tasks.workunit.client.1.smithi143.stdout:9/27: write d3/f8 [448771,5599] 0 2024-09-17T01:06:50.928 INFO:tasks.workunit.client.1.smithi143.stdout:1/42: write d0/d6/f9 [429778,88098] 0 2024-09-17T01:06:50.929 INFO:tasks.workunit.client.1.smithi143.stdout:7/42: chown d4/c7 12405 1 2024-09-17T01:06:50.929 INFO:tasks.workunit.client.1.smithi143.stdout:2/29: dwrite d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:50.930 INFO:tasks.workunit.client.1.smithi143.stdout:5/115: mknod d1/c2c 0 2024-09-17T01:06:50.932 INFO:tasks.workunit.client.1.smithi143.stdout:9/28: write d3/f6 [345001,118872] 0 2024-09-17T01:06:50.933 INFO:tasks.workunit.client.1.smithi143.stdout:2/30: chown d0/d2/c6 7 1 2024-09-17T01:06:50.933 INFO:tasks.workunit.client.1.smithi143.stdout:7/43: write d4/f5 [2758392,123205] 0 2024-09-17T01:06:50.934 INFO:tasks.workunit.client.1.smithi143.stdout:6/22: mknod d2/c6 0 2024-09-17T01:06:50.938 INFO:tasks.workunit.client.1.smithi143.stdout:6/23: fsync d2/f5 0 2024-09-17T01:06:50.939 INFO:tasks.workunit.client.1.smithi143.stdout:1/43: mkdir d0/d6/d7/df 0 2024-09-17T01:06:50.939 INFO:tasks.workunit.client.1.smithi143.stdout:5/116: dread d1/f3 [0,4194304] 0 2024-09-17T01:06:50.939 INFO:tasks.workunit.client.1.smithi143.stdout:0/80: dread d3/d5/fc [0,4194304] 0 2024-09-17T01:06:50.942 INFO:tasks.workunit.client.1.smithi143.stdout:5/117: chown d1/c6 6 1 2024-09-17T01:06:50.942 INFO:tasks.workunit.client.1.smithi143.stdout:3/24: write d6/f7 [4071399,72091] 0 2024-09-17T01:06:50.943 INFO:tasks.workunit.client.1.smithi143.stdout:6/24: mkdir d2/d7 0 2024-09-17T01:06:50.949 INFO:tasks.workunit.client.1.smithi143.stdout:7/44: dwrite f2 [0,4194304] 0 2024-09-17T01:06:50.949 INFO:tasks.workunit.client.1.smithi143.stdout:2/31: creat d0/f8 x:0 0 0 2024-09-17T01:06:50.949 INFO:tasks.workunit.client.1.smithi143.stdout:7/45: rename d4 to d4/dc 22 2024-09-17T01:06:50.950 INFO:tasks.workunit.client.1.smithi143.stdout:1/44: symlink d0/dc/l10 0 2024-09-17T01:06:50.951 INFO:tasks.workunit.client.1.smithi143.stdout:3/25: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:50.951 INFO:tasks.workunit.client.1.smithi143.stdout:0/81: mknod d3/d5/d8/d10/c19 0 2024-09-17T01:06:50.952 INFO:tasks.workunit.client.1.smithi143.stdout:1/45: write d0/d6/d7/de/fa [569978,25663] 0 2024-09-17T01:06:50.953 INFO:tasks.workunit.client.1.smithi143.stdout:3/26: chown l0 150 1 2024-09-17T01:06:50.953 INFO:tasks.workunit.client.1.smithi143.stdout:0/82: readlink d3/d5/l6 0 2024-09-17T01:06:50.954 INFO:tasks.workunit.client.1.smithi143.stdout:7/46: creat d4/fd x:0 0 0 2024-09-17T01:06:50.954 INFO:tasks.workunit.client.1.smithi143.stdout:1/46: write d0/f4 [314990,64621] 0 2024-09-17T01:06:50.954 INFO:tasks.workunit.client.1.smithi143.stdout:0/83: readlink d3/de/l15 0 2024-09-17T01:06:50.955 INFO:tasks.workunit.client.1.smithi143.stdout:6/25: link d2/f5 d2/d7/f8 0 2024-09-17T01:06:50.958 INFO:tasks.workunit.client.1.smithi143.stdout:5/118: creat d1/d5/f2d x:0 0 0 2024-09-17T01:06:50.960 INFO:tasks.workunit.client.1.smithi143.stdout:1/47: dread d0/d6/f9 [0,4194304] 0 2024-09-17T01:06:50.961 INFO:tasks.workunit.client.1.smithi143.stdout:6/26: dread f0 [0,4194304] 0 2024-09-17T01:06:50.962 INFO:tasks.workunit.client.1.smithi143.stdout:7/47: rename d4/l9 to d4/le 0 2024-09-17T01:06:50.963 INFO:tasks.workunit.client.1.smithi143.stdout:9/29: truncate d3/f8 208244 0 2024-09-17T01:06:50.963 INFO:tasks.workunit.client.1.smithi143.stdout:7/48: dread - f3 zero size 2024-09-17T01:06:50.965 INFO:tasks.workunit.client.1.smithi143.stdout:2/32: link d0/f5 d0/f9 0 2024-09-17T01:06:50.965 INFO:tasks.workunit.client.1.smithi143.stdout:5/119: mknod d1/d5/df/d1f/c2e 0 2024-09-17T01:06:50.965 INFO:tasks.workunit.client.1.smithi143.stdout:1/48: dread d0/f4 [0,4194304] 0 2024-09-17T01:06:50.966 INFO:tasks.workunit.client.1.smithi143.stdout:7/49: write d4/fd [187801,88474] 0 2024-09-17T01:06:50.967 INFO:tasks.workunit.client.1.smithi143.stdout:1/49: fsync d0/d6/fd 0 2024-09-17T01:06:50.968 INFO:tasks.workunit.client.1.smithi143.stdout:6/27: mkdir d2/d7/d9 0 2024-09-17T01:06:50.970 INFO:tasks.workunit.client.1.smithi143.stdout:3/27: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:50.970 INFO:tasks.workunit.client.1.smithi143.stdout:7/50: mkdir d4/df 0 2024-09-17T01:06:50.970 INFO:tasks.workunit.client.1.smithi143.stdout:5/120: symlink d1/d5/l2f 0 2024-09-17T01:06:50.972 INFO:tasks.workunit.client.1.smithi143.stdout:1/50: creat d0/d6/f11 x:0 0 0 2024-09-17T01:06:50.973 INFO:tasks.workunit.client.1.smithi143.stdout:2/33: link d0/l7 d0/d2/la 0 2024-09-17T01:06:51.030 INFO:tasks.workunit.client.1.smithi143.stdout:8/18: sync 2024-09-17T01:06:51.050 INFO:tasks.workunit.client.1.smithi143.stdout:3/28: rename l0 to d6/l8 0 2024-09-17T01:06:51.066 INFO:tasks.workunit.client.1.smithi143.stdout:6/28: getdents d2/d7/d9 0 2024-09-17T01:06:51.067 INFO:tasks.workunit.client.1.smithi143.stdout:5/121: creat d1/d5/df/d1f/f30 x:0 0 0 2024-09-17T01:06:51.067 INFO:tasks.workunit.client.1.smithi143.stdout:3/29: fdatasync d6/f7 0 2024-09-17T01:06:51.069 INFO:tasks.workunit.client.1.smithi143.stdout:3/30: stat l2 0 2024-09-17T01:06:51.071 INFO:tasks.workunit.client.1.smithi143.stdout:9/30: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:06:51.072 INFO:tasks.workunit.client.1.smithi143.stdout:6/29: truncate d2/d7/f8 631201 0 2024-09-17T01:06:51.074 INFO:tasks.workunit.client.1.smithi143.stdout:7/51: dwrite f3 [0,4194304] 0 2024-09-17T01:06:51.077 INFO:tasks.workunit.client.1.smithi143.stdout:7/52: chown f3 62681 1 2024-09-17T01:06:51.078 INFO:tasks.workunit.client.1.smithi143.stdout:8/19: dwrite f2 [0,4194304] 0 2024-09-17T01:06:51.078 INFO:tasks.workunit.client.1.smithi143.stdout:7/53: chown d4/ca 14814 1 2024-09-17T01:06:51.080 INFO:tasks.workunit.client.1.smithi143.stdout:3/31: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:51.091 INFO:tasks.workunit.client.1.smithi143.stdout:8/20: dwrite f0 [0,4194304] 0 2024-09-17T01:06:51.093 INFO:tasks.workunit.client.1.smithi143.stdout:7/54: dread f3 [0,4194304] 0 2024-09-17T01:06:51.094 INFO:tasks.workunit.client.1.smithi143.stdout:3/32: dwrite d6/f7 [4194304,4194304] 0 2024-09-17T01:06:51.100 INFO:tasks.workunit.client.1.smithi143.stdout:3/33: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:51.139 INFO:tasks.workunit.client.1.smithi143.stdout:1/51: mknod d0/d6/c12 0 2024-09-17T01:06:51.140 INFO:tasks.workunit.client.1.smithi143.stdout:1/52: readlink d0/d6/d7/de/l5 0 2024-09-17T01:06:51.141 INFO:tasks.workunit.client.1.smithi143.stdout:2/34: rename d0/f9 to d0/d2/fb 0 2024-09-17T01:06:51.144 INFO:tasks.workunit.client.1.smithi143.stdout:4/125: sync 2024-09-17T01:06:51.144 INFO:tasks.workunit.client.1.smithi143.stdout:8/21: creat f6 x:0 0 0 2024-09-17T01:06:51.147 INFO:tasks.workunit.client.1.smithi143.stdout:1/53: write d0/f4 [93742,89347] 0 2024-09-17T01:06:51.147 INFO:tasks.workunit.client.1.smithi143.stdout:5/122: rename l0 to d1/dd/l31 0 2024-09-17T01:06:51.148 INFO:tasks.workunit.client.1.smithi143.stdout:6/30: dread f0 [0,4194304] 0 2024-09-17T01:06:51.150 INFO:tasks.workunit.client.1.smithi143.stdout:6/31: chown d2/d7/f8 6521820 1 2024-09-17T01:06:51.150 INFO:tasks.workunit.client.1.smithi143.stdout:5/123: chown d1/d5/df/d1f/f24 22320370 1 2024-09-17T01:06:51.150 INFO:tasks.workunit.client.1.smithi143.stdout:8/22: dread f2 [0,4194304] 0 2024-09-17T01:06:51.151 INFO:tasks.workunit.client.1.smithi143.stdout:5/124: truncate d1/f2b 103516 0 2024-09-17T01:06:51.152 INFO:tasks.workunit.client.1.smithi143.stdout:9/31: rename d3/f6 to d3/d7/fa 0 2024-09-17T01:06:51.153 INFO:tasks.workunit.client.1.smithi143.stdout:9/32: stat l2 0 2024-09-17T01:06:51.154 INFO:tasks.workunit.client.1.smithi143.stdout:1/54: unlink d0/d6/f9 0 2024-09-17T01:06:51.156 INFO:tasks.workunit.client.1.smithi143.stdout:7/55: rmdir d4/df 0 2024-09-17T01:06:51.156 INFO:tasks.workunit.client.1.smithi143.stdout:1/55: truncate d0/d6/d7/de/fa 1114383 0 2024-09-17T01:06:51.158 INFO:tasks.workunit.client.1.smithi143.stdout:6/32: creat d2/fa x:0 0 0 2024-09-17T01:06:51.158 INFO:tasks.workunit.client.1.smithi143.stdout:1/56: write d0/d6/f11 [311689,119160] 0 2024-09-17T01:06:51.159 INFO:tasks.workunit.client.1.smithi143.stdout:8/23: creat f7 x:0 0 0 2024-09-17T01:06:51.159 INFO:tasks.workunit.client.1.smithi143.stdout:9/33: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:06:51.160 INFO:tasks.workunit.client.1.smithi143.stdout:2/35: rename d0/f8 to d0/fc 0 2024-09-17T01:06:51.161 INFO:tasks.workunit.client.1.smithi143.stdout:8/24: write f4 [669887,122344] 0 2024-09-17T01:06:51.161 INFO:tasks.workunit.client.1.smithi143.stdout:6/33: read d2/d7/f8 [43121,97564] 0 2024-09-17T01:06:51.161 INFO:tasks.workunit.client.1.smithi143.stdout:1/57: chown d0/d6/f11 1 1 2024-09-17T01:06:51.161 INFO:tasks.workunit.client.1.smithi143.stdout:5/125: mknod d1/d5/df/d1f/c32 0 2024-09-17T01:06:51.163 INFO:tasks.workunit.client.1.smithi143.stdout:8/25: dread - f7 zero size 2024-09-17T01:06:51.164 INFO:tasks.workunit.client.1.smithi143.stdout:5/126: readlink d1/d5/l2f 0 2024-09-17T01:06:51.165 INFO:tasks.workunit.client.1.smithi143.stdout:3/34: rename l5 to d6/l9 0 2024-09-17T01:06:51.165 INFO:tasks.workunit.client.1.smithi143.stdout:6/34: chown d2/f5 9414 1 2024-09-17T01:06:51.166 INFO:tasks.workunit.client.1.smithi143.stdout:8/26: dread - f6 zero size 2024-09-17T01:06:51.167 INFO:tasks.workunit.client.1.smithi143.stdout:5/127: readlink d1/d5/l27 0 2024-09-17T01:06:51.167 INFO:tasks.workunit.client.1.smithi143.stdout:7/56: creat d4/f10 x:0 0 0 2024-09-17T01:06:51.168 INFO:tasks.workunit.client.1.smithi143.stdout:8/27: write f6 [484252,62743] 0 2024-09-17T01:06:51.169 INFO:tasks.workunit.client.1.smithi143.stdout:8/28: stat f2 0 2024-09-17T01:06:51.170 INFO:tasks.workunit.client.1.smithi143.stdout:8/29: read - f7 zero size 2024-09-17T01:06:51.171 INFO:tasks.workunit.client.1.smithi143.stdout:2/36: dwrite d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:51.174 INFO:tasks.workunit.client.1.smithi143.stdout:3/35: write d6/f7 [2527068,104889] 0 2024-09-17T01:06:51.175 INFO:tasks.workunit.client.1.smithi143.stdout:7/57: creat d4/f11 x:0 0 0 2024-09-17T01:06:51.176 INFO:tasks.workunit.client.1.smithi143.stdout:5/128: creat d1/dd/f33 x:0 0 0 2024-09-17T01:06:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:50 smithi103 ceph-mon[28156]: pgmap v6: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:50 smithi103 ceph-mon[28156]: Standby manager daemon smithi103.efjaur started 2024-09-17T01:06:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:50 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/crt"}]: dispatch 2024-09-17T01:06:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:50 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:50 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/key"}]: dispatch 2024-09-17T01:06:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:50 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:51.178 INFO:tasks.workunit.client.1.smithi143.stdout:8/30: mknod c8 0 2024-09-17T01:06:51.178 INFO:tasks.workunit.client.1.smithi143.stdout:1/58: mknod d0/d6/d7/df/c13 0 2024-09-17T01:06:51.179 INFO:tasks.workunit.client.1.smithi143.stdout:9/34: dwrite d3/d7/fa [0,4194304] 0 2024-09-17T01:06:51.182 INFO:tasks.workunit.client.1.smithi143.stdout:1/59: write d0/d6/d7/de/fa [541015,61538] 0 2024-09-17T01:06:51.183 INFO:tasks.workunit.client.1.smithi143.stdout:2/37: symlink d0/ld 0 2024-09-17T01:06:51.183 INFO:tasks.workunit.client.1.smithi143.stdout:8/31: write f2 [3305492,3570] 0 2024-09-17T01:06:51.184 INFO:tasks.workunit.client.1.smithi143.stdout:3/36: dread d6/f7 [4194304,4194304] 0 2024-09-17T01:06:51.185 INFO:tasks.workunit.client.1.smithi143.stdout:5/129: rename d1/d5/df/d1f/f24 to d1/d5/df/d1f/f34 0 2024-09-17T01:06:51.189 INFO:tasks.workunit.client.1.smithi143.stdout:8/32: dread f4 [0,4194304] 0 2024-09-17T01:06:51.191 INFO:tasks.workunit.client.1.smithi143.stdout:2/38: creat d0/d2/fe x:0 0 0 2024-09-17T01:06:51.192 INFO:tasks.workunit.client.1.smithi143.stdout:1/60: creat d0/d6/d7/de/f14 x:0 0 0 2024-09-17T01:06:51.193 INFO:tasks.workunit.client.1.smithi143.stdout:1/61: stat d0/dc/l10 0 2024-09-17T01:06:51.194 INFO:tasks.workunit.client.1.smithi143.stdout:8/33: mkdir d9 0 2024-09-17T01:06:51.196 INFO:tasks.workunit.client.1.smithi143.stdout:3/37: dwrite d6/f7 [4194304,4194304] 0 2024-09-17T01:06:51.196 INFO:tasks.workunit.client.1.smithi143.stdout:8/34: fsync f4 0 2024-09-17T01:06:51.198 INFO:tasks.workunit.client.1.smithi143.stdout:5/130: link d1/d5/l27 d1/d5/df/d23/l35 0 2024-09-17T01:06:51.198 INFO:tasks.workunit.client.1.smithi143.stdout:1/62: symlink d0/d6/d7/df/l15 0 2024-09-17T01:06:51.200 INFO:tasks.workunit.client.1.smithi143.stdout:3/38: creat d6/fa x:0 0 0 2024-09-17T01:06:51.200 INFO:tasks.workunit.client.1.smithi143.stdout:2/39: dread d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:51.201 INFO:tasks.workunit.client.1.smithi143.stdout:5/131: read - d1/d5/f2d zero size 2024-09-17T01:06:51.201 INFO:tasks.workunit.client.1.smithi143.stdout:8/35: rename f6 to d9/fa 0 2024-09-17T01:06:51.201 INFO:tasks.workunit.client.1.smithi143.stdout:1/63: read - d0/d6/d7/de/f14 zero size 2024-09-17T01:06:51.203 INFO:tasks.workunit.client.1.smithi143.stdout:5/132: unlink d1/c13 0 2024-09-17T01:06:51.206 INFO:tasks.workunit.client.1.smithi143.stdout:2/40: creat d0/ff x:0 0 0 2024-09-17T01:06:51.210 INFO:tasks.workunit.client.1.smithi143.stdout:5/133: creat d1/d5/df/f36 x:0 0 0 2024-09-17T01:06:51.210 INFO:tasks.workunit.client.1.smithi143.stdout:2/41: unlink d0/f5 0 2024-09-17T01:06:51.218 INFO:tasks.workunit.client.1.smithi143.stdout:3/39: dwrite d6/fa [0,4194304] 0 2024-09-17T01:06:51.218 INFO:tasks.workunit.client.1.smithi143.stdout:8/36: dwrite f7 [0,4194304] 0 2024-09-17T01:06:51.218 INFO:tasks.workunit.client.1.smithi143.stdout:2/42: write d0/d2/fe [902299,6693] 0 2024-09-17T01:06:51.220 INFO:tasks.workunit.client.1.smithi143.stdout:1/64: dwrite d0/d6/f11 [0,4194304] 0 2024-09-17T01:06:51.221 INFO:tasks.workunit.client.1.smithi143.stdout:8/37: rename d9 to d9/db 22 2024-09-17T01:06:51.230 INFO:tasks.workunit.client.1.smithi143.stdout:8/38: creat d9/fc x:0 0 0 2024-09-17T01:06:51.231 INFO:tasks.workunit.client.1.smithi143.stdout:1/65: dread d0/d6/d7/de/fa [0,4194304] 0 2024-09-17T01:06:51.233 INFO:tasks.workunit.client.1.smithi143.stdout:8/39: read f2 [3462391,120280] 0 2024-09-17T01:06:51.233 INFO:tasks.workunit.client.1.smithi143.stdout:5/134: dwrite d1/d5/df/f25 [0,4194304] 0 2024-09-17T01:06:51.233 INFO:tasks.workunit.client.1.smithi143.stdout:3/40: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:51.234 INFO:tasks.workunit.client.1.smithi143.stdout:2/43: mkdir d0/d10 0 2024-09-17T01:06:51.235 INFO:tasks.workunit.client.1.smithi143.stdout:5/135: read d1/f2 [1322015,88912] 0 2024-09-17T01:06:51.236 INFO:tasks.workunit.client.1.smithi143.stdout:3/41: write d6/fa [3970334,79093] 0 2024-09-17T01:06:51.236 INFO:tasks.workunit.client.1.smithi143.stdout:8/40: symlink d9/ld 0 2024-09-17T01:06:51.237 INFO:tasks.workunit.client.1.smithi143.stdout:2/44: write d0/d2/fe [1409385,17676] 0 2024-09-17T01:06:51.238 INFO:tasks.workunit.client.1.smithi143.stdout:5/136: truncate d1/d5/f22 1129728 0 2024-09-17T01:06:51.239 INFO:tasks.workunit.client.1.smithi143.stdout:1/66: write d0/d6/d7/de/fa [1846244,77932] 0 2024-09-17T01:06:51.243 INFO:tasks.workunit.client.1.smithi143.stdout:8/41: mkdir d9/de 0 2024-09-17T01:06:51.245 INFO:tasks.workunit.client.1.smithi143.stdout:5/137: rename d1/dd/l29 to d1/d5/df/l37 0 2024-09-17T01:06:51.246 INFO:tasks.workunit.client.1.smithi143.stdout:1/67: mknod d0/d6/d7/df/c16 0 2024-09-17T01:06:51.247 INFO:tasks.workunit.client.1.smithi143.stdout:1/68: fdatasync d0/f4 0 2024-09-17T01:06:51.247 INFO:tasks.workunit.client.1.smithi143.stdout:2/45: link d0/d2/f4 d0/d10/f11 0 2024-09-17T01:06:51.249 INFO:tasks.workunit.client.1.smithi143.stdout:1/69: readlink d0/d6/d7/df/l15 0 2024-09-17T01:06:51.250 INFO:tasks.workunit.client.1.smithi143.stdout:5/138: mkdir d1/d38 0 2024-09-17T01:06:51.251 INFO:tasks.workunit.client.1.smithi143.stdout:8/42: dwrite f7 [0,4194304] 0 2024-09-17T01:06:51.251 INFO:tasks.workunit.client.1.smithi143.stdout:2/46: symlink d0/l12 0 2024-09-17T01:06:51.254 INFO:tasks.workunit.client.1.smithi143.stdout:0/84: sync 2024-09-17T01:06:51.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/139: mknod d1/dd/c39 0 2024-09-17T01:06:51.256 INFO:tasks.workunit.client.1.smithi143.stdout:8/43: unlink f2 0 2024-09-17T01:06:51.257 INFO:tasks.workunit.client.1.smithi143.stdout:2/47: symlink d0/d2/l13 0 2024-09-17T01:06:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:50 smithi143 ceph-mon[35452]: pgmap v6: 65 pgs: 65 active+clean; 200 MiB data, 951 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:06:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:50 smithi143 ceph-mon[35452]: Standby manager daemon smithi103.efjaur started 2024-09-17T01:06:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:50 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/crt"}]: dispatch 2024-09-17T01:06:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:50 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:50 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/key"}]: dispatch 2024-09-17T01:06:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:50 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/2958934797' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:51.258 INFO:tasks.workunit.client.1.smithi143.stdout:5/140: symlink d1/dd/l3a 0 2024-09-17T01:06:51.261 INFO:tasks.workunit.client.1.smithi143.stdout:8/44: symlink d9/de/lf 0 2024-09-17T01:06:51.261 INFO:tasks.workunit.client.1.smithi143.stdout:1/70: dwrite d0/d6/f11 [0,4194304] 0 2024-09-17T01:06:51.263 INFO:tasks.workunit.client.1.smithi143.stdout:5/141: write d1/dd/f1d [7441165,63921] 0 2024-09-17T01:06:51.264 INFO:tasks.workunit.client.1.smithi143.stdout:8/45: creat d9/de/f10 x:0 0 0 2024-09-17T01:06:51.266 INFO:tasks.workunit.client.1.smithi143.stdout:5/142: write d1/d5/df/d23/f26 [456185,46504] 0 2024-09-17T01:06:51.267 INFO:tasks.workunit.client.1.smithi143.stdout:0/85: dwrite d3/de/f18 [0,4194304] 0 2024-09-17T01:06:51.268 INFO:tasks.workunit.client.1.smithi143.stdout:8/46: rename f4 to d9/f11 0 2024-09-17T01:06:51.269 INFO:tasks.workunit.client.1.smithi143.stdout:8/47: dread - d9/de/f10 zero size 2024-09-17T01:06:51.287 INFO:tasks.workunit.client.1.smithi143.stdout:8/48: mkdir d9/d12 0 2024-09-17T01:06:51.290 INFO:tasks.workunit.client.1.smithi143.stdout:0/86: dread d3/d5/f9 [0,4194304] 0 2024-09-17T01:06:51.291 INFO:tasks.workunit.client.1.smithi143.stdout:2/48: fsync d0/d2/fb 0 2024-09-17T01:06:51.291 INFO:tasks.workunit.client.1.smithi143.stdout:2/49: read - d0/fc zero size 2024-09-17T01:06:51.292 INFO:tasks.workunit.client.1.smithi143.stdout:8/49: mkdir d9/d12/d13 0 2024-09-17T01:06:51.292 INFO:tasks.workunit.client.1.smithi143.stdout:2/50: dread - d0/ff zero size 2024-09-17T01:06:51.294 INFO:tasks.workunit.client.1.smithi143.stdout:0/87: truncate d3/d5/f9 1034750 0 2024-09-17T01:06:51.294 INFO:tasks.workunit.client.1.smithi143.stdout:7/58: fsync d4/f10 0 2024-09-17T01:06:51.295 INFO:tasks.workunit.client.1.smithi143.stdout:7/59: stat d4/fd 0 2024-09-17T01:06:51.296 INFO:tasks.workunit.client.1.smithi143.stdout:0/88: write d3/d5/d8/f13 [1505424,82242] 0 2024-09-17T01:06:51.296 INFO:tasks.workunit.client.1.smithi143.stdout:7/60: write f2 [2373157,80715] 0 2024-09-17T01:06:51.298 INFO:tasks.workunit.client.1.smithi143.stdout:6/35: dwrite f0 [0,4194304] 0 2024-09-17T01:06:51.299 INFO:tasks.workunit.client.1.smithi143.stdout:7/61: creat d4/f12 x:0 0 0 2024-09-17T01:06:51.299 INFO:tasks.workunit.client.1.smithi143.stdout:9/35: write d3/d7/fa [5011938,8000] 0 2024-09-17T01:06:51.300 INFO:tasks.workunit.client.1.smithi143.stdout:7/62: chown d4/f11 88626266 1 2024-09-17T01:06:51.301 INFO:tasks.workunit.client.1.smithi143.stdout:6/36: creat d2/fb x:0 0 0 2024-09-17T01:06:51.301 INFO:tasks.workunit.client.1.smithi143.stdout:7/63: chown f3 1594465 1 2024-09-17T01:06:51.302 INFO:tasks.workunit.client.1.smithi143.stdout:6/37: write d2/fb [193848,110984] 0 2024-09-17T01:06:51.303 INFO:tasks.workunit.client.1.smithi143.stdout:7/64: write d4/f11 [911929,82089] 0 2024-09-17T01:06:51.305 INFO:tasks.workunit.client.1.smithi143.stdout:0/89: link d3/d5/l6 d3/d14/l1a 0 2024-09-17T01:06:51.305 INFO:tasks.workunit.client.1.smithi143.stdout:7/65: write d4/fd [401833,43511] 0 2024-09-17T01:06:51.308 INFO:tasks.workunit.client.1.smithi143.stdout:6/38: rename d2/d7/d9 to d2/dc 0 2024-09-17T01:06:51.309 INFO:tasks.workunit.client.1.smithi143.stdout:3/42: rmdir d6 39 2024-09-17T01:06:51.311 INFO:tasks.workunit.client.1.smithi143.stdout:0/90: creat d3/d5/f1b x:0 0 0 2024-09-17T01:06:51.313 INFO:tasks.workunit.client.1.smithi143.stdout:0/91: creat d3/de/f1c x:0 0 0 2024-09-17T01:06:51.318 INFO:tasks.workunit.client.1.smithi143.stdout:0/92: creat d3/d14/d17/f1d x:0 0 0 2024-09-17T01:06:51.321 INFO:tasks.workunit.client.1.smithi143.stdout:0/93: rename d3/d5/f1b to d3/de/f1e 0 2024-09-17T01:06:51.322 INFO:tasks.workunit.client.1.smithi143.stdout:3/43: link d6/l9 d6/lb 0 2024-09-17T01:06:51.323 INFO:tasks.workunit.client.1.smithi143.stdout:0/94: rmdir d3/d5/d8/d10 39 2024-09-17T01:06:51.327 INFO:tasks.workunit.client.1.smithi143.stdout:0/95: symlink d3/d5/d8/d10/l1f 0 2024-09-17T01:06:51.327 INFO:tasks.workunit.client.1.smithi143.stdout:0/96: chown d3 0 1 2024-09-17T01:06:51.328 INFO:tasks.workunit.client.1.smithi143.stdout:0/97: chown d3/d5 99977361 1 2024-09-17T01:06:51.329 INFO:tasks.workunit.client.1.smithi143.stdout:2/51: fsync d0/d2/f4 0 2024-09-17T01:06:51.332 INFO:tasks.workunit.client.1.smithi143.stdout:0/98: rename d3/d5/d8/cf to d3/d5/d8/c20 0 2024-09-17T01:06:51.335 INFO:tasks.workunit.client.1.smithi143.stdout:5/143: rmdir d1 39 2024-09-17T01:06:51.337 INFO:tasks.workunit.client.1.smithi143.stdout:5/144: chown d1/d5/l27 6 1 2024-09-17T01:06:51.338 INFO:tasks.workunit.client.1.smithi143.stdout:5/145: truncate d1/d5/df/d1f/f30 81050 0 2024-09-17T01:06:51.340 INFO:tasks.workunit.client.1.smithi143.stdout:7/66: rmdir d4 39 2024-09-17T01:06:51.342 INFO:tasks.workunit.client.1.smithi143.stdout:9/36: truncate d3/f4 2468698 0 2024-09-17T01:06:51.342 INFO:tasks.workunit.client.1.smithi143.stdout:7/67: creat d4/f13 x:0 0 0 2024-09-17T01:06:51.363 INFO:tasks.workunit.client.1.smithi143.stdout:3/44: truncate d6/f7 5809845 0 2024-09-17T01:06:51.364 INFO:tasks.workunit.client.1.smithi143.stdout:5/146: dwrite d1/d5/f2d [0,4194304] 0 2024-09-17T01:06:51.364 INFO:tasks.workunit.client.1.smithi143.stdout:9/37: rmdir d3 39 2024-09-17T01:06:51.364 INFO:tasks.workunit.client.1.smithi143.stdout:7/68: fsync d4/f13 0 2024-09-17T01:06:51.365 INFO:tasks.workunit.client.1.smithi143.stdout:7/69: stat d4/f5 0 2024-09-17T01:06:51.366 INFO:tasks.workunit.client.1.smithi143.stdout:5/147: rename d1/d5/df/d1f to d1/d5/df/d1f/d3b 22 2024-09-17T01:06:51.368 INFO:tasks.workunit.client.1.smithi143.stdout:7/70: read f3 [212947,29503] 0 2024-09-17T01:06:51.370 INFO:tasks.workunit.client.1.smithi143.stdout:9/38: rmdir d3/d7 39 2024-09-17T01:06:51.371 INFO:tasks.workunit.client.1.smithi143.stdout:7/71: creat d4/f14 x:0 0 0 2024-09-17T01:06:51.374 INFO:tasks.workunit.client.1.smithi143.stdout:2/52: write d0/d2/f4 [114707,78363] 0 2024-09-17T01:06:51.374 INFO:tasks.workunit.client.1.smithi143.stdout:7/72: readlink d4/le 0 2024-09-17T01:06:51.375 INFO:tasks.workunit.client.1.smithi143.stdout:2/53: chown d0/d10/f11 1007 1 2024-09-17T01:06:51.375 INFO:tasks.workunit.client.1.smithi143.stdout:5/148: creat d1/d5/f3c x:0 0 0 2024-09-17T01:06:51.376 INFO:tasks.workunit.client.1.smithi143.stdout:3/45: truncate d6/f7 1016499 0 2024-09-17T01:06:51.377 INFO:tasks.workunit.client.1.smithi143.stdout:9/39: creat d3/d7/fb x:0 0 0 2024-09-17T01:06:51.377 INFO:tasks.workunit.client.1.smithi143.stdout:7/73: creat d4/f15 x:0 0 0 2024-09-17T01:06:51.377 INFO:tasks.workunit.client.1.smithi143.stdout:9/40: chown d3 240 1 2024-09-17T01:06:51.378 INFO:tasks.workunit.client.1.smithi143.stdout:7/74: write d4/f5 [3060983,126867] 0 2024-09-17T01:06:51.379 INFO:tasks.workunit.client.1.smithi143.stdout:5/149: creat d1/d5/df/f3d x:0 0 0 2024-09-17T01:06:51.380 INFO:tasks.workunit.client.1.smithi143.stdout:9/41: creat d3/d7/fc x:0 0 0 2024-09-17T01:06:51.381 INFO:tasks.workunit.client.1.smithi143.stdout:2/54: creat d0/d2/f14 x:0 0 0 2024-09-17T01:06:51.381 INFO:tasks.workunit.client.1.smithi143.stdout:7/75: mkdir d4/d16 0 2024-09-17T01:06:51.383 INFO:tasks.workunit.client.1.smithi143.stdout:2/55: dread - d0/fc zero size 2024-09-17T01:06:51.384 INFO:tasks.workunit.client.1.smithi143.stdout:5/150: rename d1/dd/f1c to d1/d5/df/d1f/f3e 0 2024-09-17T01:06:51.384 INFO:tasks.workunit.client.1.smithi143.stdout:7/76: read - d4/f15 zero size 2024-09-17T01:06:51.386 INFO:tasks.workunit.client.1.smithi143.stdout:3/46: dwrite d6/fa [0,4194304] 0 2024-09-17T01:06:51.389 INFO:tasks.workunit.client.1.smithi143.stdout:9/42: truncate d3/f4 539936 0 2024-09-17T01:06:51.391 INFO:tasks.workunit.client.1.smithi143.stdout:7/77: rename f3 to d4/d16/f17 0 2024-09-17T01:06:51.393 INFO:tasks.workunit.client.1.smithi143.stdout:7/78: chown d4/f14 29504243 1 2024-09-17T01:06:51.394 INFO:tasks.workunit.client.1.smithi143.stdout:2/56: dread d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:51.395 INFO:tasks.workunit.client.1.smithi143.stdout:3/47: rename c3 to d6/cc 0 2024-09-17T01:06:51.395 INFO:tasks.workunit.client.1.smithi143.stdout:5/151: dwrite d1/d5/df/f1b [8388608,4194304] 0 2024-09-17T01:06:51.395 INFO:tasks.workunit.client.1.smithi143.stdout:7/79: creat d4/f18 x:0 0 0 2024-09-17T01:06:51.396 INFO:tasks.workunit.client.1.smithi143.stdout:7/80: read - d4/f15 zero size 2024-09-17T01:06:51.397 INFO:tasks.workunit.client.1.smithi143.stdout:5/152: write d1/dd/f20 [246658,112280] 0 2024-09-17T01:06:51.398 INFO:tasks.workunit.client.1.smithi143.stdout:7/81: dread - d4/f14 zero size 2024-09-17T01:06:51.399 INFO:tasks.workunit.client.1.smithi143.stdout:5/153: dread - d1/dd/f33 zero size 2024-09-17T01:06:51.402 INFO:tasks.workunit.client.1.smithi143.stdout:2/57: rename d0/d2/c6 to d0/c15 0 2024-09-17T01:06:51.403 INFO:tasks.workunit.client.1.smithi143.stdout:2/58: write d0/ff [274825,66446] 0 2024-09-17T01:06:51.404 INFO:tasks.workunit.client.1.smithi143.stdout:5/154: creat d1/f3f x:0 0 0 2024-09-17T01:06:51.405 INFO:tasks.workunit.client.1.smithi143.stdout:5/155: write d1/f19 [1557357,102989] 0 2024-09-17T01:06:51.411 INFO:tasks.workunit.client.1.smithi143.stdout:2/59: dwrite d0/d2/fe [0,4194304] 0 2024-09-17T01:06:51.411 INFO:tasks.workunit.client.1.smithi143.stdout:4/126: sync 2024-09-17T01:06:51.413 INFO:tasks.workunit.client.1.smithi143.stdout:2/60: chown d0/d2/fb 2908 1 2024-09-17T01:06:51.414 INFO:tasks.workunit.client.1.smithi143.stdout:2/61: dread - d0/fc zero size 2024-09-17T01:06:51.416 INFO:tasks.workunit.client.1.smithi143.stdout:7/82: fsync d4/d16/f17 0 2024-09-17T01:06:51.418 INFO:tasks.workunit.client.1.smithi143.stdout:4/127: rmdir da/d22/d25 0 2024-09-17T01:06:51.419 INFO:tasks.workunit.client.1.smithi143.stdout:3/48: truncate d6/fa 3779400 0 2024-09-17T01:06:51.422 INFO:tasks.workunit.client.1.smithi143.stdout:5/156: getdents d1 0 2024-09-17T01:06:51.424 INFO:tasks.workunit.client.1.smithi143.stdout:5/157: rmdir d1/d38 0 2024-09-17T01:06:51.427 INFO:tasks.workunit.client.1.smithi143.stdout:3/49: write d6/fa [3911256,99630] 0 2024-09-17T01:06:51.427 INFO:tasks.workunit.client.1.smithi143.stdout:7/83: truncate d4/fd 31495 0 2024-09-17T01:06:51.427 INFO:tasks.workunit.client.1.smithi143.stdout:5/158: chown d1/c6 3892 1 2024-09-17T01:06:51.431 INFO:tasks.workunit.client.1.smithi143.stdout:2/62: dwrite d0/d2/fb [0,4194304] 0 2024-09-17T01:06:51.435 INFO:tasks.workunit.client.1.smithi143.stdout:7/84: write d4/d16/f17 [1514928,106442] 0 2024-09-17T01:06:51.437 INFO:tasks.workunit.client.1.smithi143.stdout:5/159: rename d1/ca to d1/d5/c40 0 2024-09-17T01:06:51.438 INFO:tasks.workunit.client.1.smithi143.stdout:7/85: mknod d4/c19 0 2024-09-17T01:06:51.441 INFO:tasks.workunit.client.1.smithi143.stdout:7/86: creat d4/d16/f1a x:0 0 0 2024-09-17T01:06:51.444 INFO:tasks.workunit.client.1.smithi143.stdout:7/87: creat d4/f1b x:0 0 0 2024-09-17T01:06:51.447 INFO:tasks.workunit.client.1.smithi143.stdout:3/50: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:51.448 INFO:tasks.workunit.client.1.smithi143.stdout:7/88: write d4/d16/f1a [767852,1770] 0 2024-09-17T01:06:51.450 INFO:tasks.workunit.client.1.smithi143.stdout:3/51: truncate d6/fa 4152387 0 2024-09-17T01:06:51.450 INFO:tasks.workunit.client.1.smithi143.stdout:5/160: dwrite d1/f2b [0,4194304] 0 2024-09-17T01:06:51.452 INFO:tasks.workunit.client.1.smithi143.stdout:3/52: write d6/f7 [1647741,8511] 0 2024-09-17T01:06:51.452 INFO:tasks.workunit.client.1.smithi143.stdout:7/89: mknod d4/c1c 0 2024-09-17T01:06:51.453 INFO:tasks.workunit.client.1.smithi143.stdout:5/161: chown d1/d5/df/d23/f26 359119903 1 2024-09-17T01:06:51.454 INFO:tasks.workunit.client.1.smithi143.stdout:7/90: creat d4/d16/f1d x:0 0 0 2024-09-17T01:06:51.455 INFO:tasks.workunit.client.1.smithi143.stdout:7/91: dread - d4/d16/f1d zero size 2024-09-17T01:06:51.456 INFO:tasks.workunit.client.1.smithi143.stdout:3/53: rename d6/cc to d6/cd 0 2024-09-17T01:06:51.461 INFO:tasks.workunit.client.1.smithi143.stdout:7/92: rmdir d4/d16 39 2024-09-17T01:06:51.464 INFO:tasks.workunit.client.1.smithi143.stdout:7/93: fsync d4/f1b 0 2024-09-17T01:06:51.465 INFO:tasks.workunit.client.1.smithi143.stdout:5/162: dwrite d1/dd/f33 [0,4194304] 0 2024-09-17T01:06:51.469 INFO:tasks.workunit.client.1.smithi143.stdout:3/54: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:51.469 INFO:tasks.workunit.client.1.smithi143.stdout:5/163: creat d1/d5/df/d23/f41 x:0 0 0 2024-09-17T01:06:51.469 INFO:tasks.workunit.client.1.smithi143.stdout:7/94: symlink d4/l1e 0 2024-09-17T01:06:51.470 INFO:tasks.workunit.client.1.smithi143.stdout:5/164: fdatasync d1/d5/f2d 0 2024-09-17T01:06:51.473 INFO:tasks.workunit.client.1.smithi143.stdout:7/95: mkdir d4/d1f 0 2024-09-17T01:06:51.473 INFO:tasks.workunit.client.1.smithi143.stdout:5/165: rename d1/d5/df to d1/d5/df/d1f/d42 22 2024-09-17T01:06:51.474 INFO:tasks.workunit.client.1.smithi143.stdout:5/166: dread - d1/d5/f3c zero size 2024-09-17T01:06:51.475 INFO:tasks.workunit.client.1.smithi143.stdout:7/96: creat d4/f20 x:0 0 0 2024-09-17T01:06:51.476 INFO:tasks.workunit.client.1.smithi143.stdout:3/55: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:51.477 INFO:tasks.workunit.client.1.smithi143.stdout:7/97: chown d4/d16/f17 278752 1 2024-09-17T01:06:51.477 INFO:tasks.workunit.client.1.smithi143.stdout:3/56: chown d6/l9 20 1 2024-09-17T01:06:51.479 INFO:tasks.workunit.client.1.smithi143.stdout:5/167: getdents d1 0 2024-09-17T01:06:51.480 INFO:tasks.workunit.client.1.smithi143.stdout:5/168: write d1/d5/f3c [946584,82269] 0 2024-09-17T01:06:51.481 INFO:tasks.workunit.client.1.smithi143.stdout:7/98: mkdir d4/d21 0 2024-09-17T01:06:51.481 INFO:tasks.workunit.client.1.smithi143.stdout:5/169: fdatasync d1/d5/df/d23/f26 0 2024-09-17T01:06:51.484 INFO:tasks.workunit.client.1.smithi143.stdout:3/57: truncate d6/f7 2817488 0 2024-09-17T01:06:51.485 INFO:tasks.workunit.client.1.smithi143.stdout:7/99: creat d4/d21/f22 x:0 0 0 2024-09-17T01:06:51.488 INFO:tasks.workunit.client.1.smithi143.stdout:5/170: dwrite d1/f19 [0,4194304] 0 2024-09-17T01:06:51.488 INFO:tasks.workunit.client.1.smithi143.stdout:7/100: creat d4/d1f/f23 x:0 0 0 2024-09-17T01:06:51.489 INFO:tasks.workunit.client.1.smithi143.stdout:5/171: dread - d1/d5/df/d23/f2a zero size 2024-09-17T01:06:51.489 INFO:tasks.workunit.client.1.smithi143.stdout:7/101: truncate d4/f13 388422 0 2024-09-17T01:06:51.490 INFO:tasks.workunit.client.1.smithi143.stdout:5/172: chown d1/dd/l3a 6108596 1 2024-09-17T01:06:51.492 INFO:tasks.workunit.client.1.smithi143.stdout:5/173: write d1/d5/f3c [1084033,69566] 0 2024-09-17T01:06:51.495 INFO:tasks.workunit.client.1.smithi143.stdout:5/174: write d1/d5/df/d1f/f30 [142616,95532] 0 2024-09-17T01:06:51.495 INFO:tasks.workunit.client.1.smithi143.stdout:7/102: dread d4/f11 [0,4194304] 0 2024-09-17T01:06:51.497 INFO:tasks.workunit.client.1.smithi143.stdout:7/103: fdatasync d4/f11 0 2024-09-17T01:06:51.498 INFO:tasks.workunit.client.1.smithi143.stdout:5/175: dread d1/d5/df/f1b [0,4194304] 0 2024-09-17T01:06:51.500 INFO:tasks.workunit.client.1.smithi143.stdout:5/176: creat d1/f43 x:0 0 0 2024-09-17T01:06:51.517 INFO:tasks.workunit.client.1.smithi143.stdout:1/71: sync 2024-09-17T01:06:51.517 INFO:tasks.workunit.client.1.smithi143.stdout:8/50: sync 2024-09-17T01:06:51.518 INFO:tasks.workunit.client.1.smithi143.stdout:8/51: mknod d9/d12/c14 0 2024-09-17T01:06:51.524 INFO:tasks.workunit.client.1.smithi143.stdout:1/72: dwrite d0/d6/d7/de/fa [0,4194304] 0 2024-09-17T01:06:51.526 INFO:tasks.workunit.client.1.smithi143.stdout:1/73: mknod d0/d6/d7/c17 0 2024-09-17T01:06:51.526 INFO:tasks.workunit.client.1.smithi143.stdout:1/74: stat d0/d6 0 2024-09-17T01:06:51.526 INFO:tasks.workunit.client.1.smithi143.stdout:1/75: truncate d0/d6/f11 5119600 0 2024-09-17T01:06:51.528 INFO:tasks.workunit.client.1.smithi143.stdout:1/76: mkdir d0/d6/d7/de/d18 0 2024-09-17T01:06:51.617 INFO:tasks.workunit.client.1.smithi143.stdout:6/39: sync 2024-09-17T01:06:51.654 INFO:tasks.workunit.client.1.smithi143.stdout:9/43: sync 2024-09-17T01:06:51.654 INFO:tasks.workunit.client.1.smithi143.stdout:0/99: sync 2024-09-17T01:06:51.655 INFO:tasks.workunit.client.1.smithi143.stdout:9/44: write d3/d7/fa [6058585,91884] 0 2024-09-17T01:06:51.655 INFO:tasks.workunit.client.1.smithi143.stdout:9/45: rename d3/d7 to d3/d7/d9/dd 22 2024-09-17T01:06:51.667 INFO:tasks.workunit.client.1.smithi143.stdout:6/40: creat d2/dc/fd x:0 0 0 2024-09-17T01:06:51.670 INFO:tasks.workunit.client.1.smithi143.stdout:6/41: dread f0 [0,4194304] 0 2024-09-17T01:06:51.671 INFO:tasks.workunit.client.1.smithi143.stdout:6/42: chown d2/c3 58439 1 2024-09-17T01:06:51.674 INFO:tasks.workunit.client.1.smithi143.stdout:9/46: mknod d3/d7/ce 0 2024-09-17T01:06:51.676 INFO:tasks.workunit.client.1.smithi143.stdout:1/77: creat d0/f19 x:0 0 0 2024-09-17T01:06:51.678 INFO:tasks.workunit.client.1.smithi143.stdout:8/52: truncate f0 1945601 0 2024-09-17T01:06:51.682 INFO:tasks.workunit.client.1.smithi143.stdout:0/100: dwrite d3/de/f1e [0,4194304] 0 2024-09-17T01:06:51.682 INFO:tasks.workunit.client.1.smithi143.stdout:6/43: dwrite d2/dc/fd [0,4194304] 0 2024-09-17T01:06:51.682 INFO:tasks.workunit.client.1.smithi143.stdout:1/78: write d0/d6/d7/de/f14 [242435,36665] 0 2024-09-17T01:06:51.686 INFO:tasks.workunit.client.1.smithi143.stdout:9/47: rename l1 to d3/d7/d9/lf 0 2024-09-17T01:06:51.687 INFO:tasks.workunit.client.1.smithi143.stdout:8/53: mknod d9/c15 0 2024-09-17T01:06:51.693 INFO:tasks.workunit.client.1.smithi143.stdout:6/44: dread d2/dc/fd [0,4194304] 0 2024-09-17T01:06:51.693 INFO:tasks.workunit.client.1.smithi143.stdout:1/79: creat d0/d6/d7/df/f1a x:0 0 0 2024-09-17T01:06:51.694 INFO:tasks.workunit.client.1.smithi143.stdout:0/101: dwrite d3/d5/d8/f13 [0,4194304] 0 2024-09-17T01:06:51.696 INFO:tasks.workunit.client.1.smithi143.stdout:9/48: creat d3/d7/f10 x:0 0 0 2024-09-17T01:06:51.696 INFO:tasks.workunit.client.1.smithi143.stdout:1/80: chown d0/d6/fd 102 1 2024-09-17T01:06:51.696 INFO:tasks.workunit.client.1.smithi143.stdout:8/54: mknod d9/d12/c16 0 2024-09-17T01:06:51.696 INFO:tasks.workunit.client.1.smithi143.stdout:0/102: write d3/de/f1c [243776,45891] 0 2024-09-17T01:06:51.697 INFO:tasks.workunit.client.1.smithi143.stdout:1/81: write d0/d6/fd [473938,129701] 0 2024-09-17T01:06:51.697 INFO:tasks.workunit.client.1.smithi143.stdout:6/45: symlink d2/d7/le 0 2024-09-17T01:06:51.698 INFO:tasks.workunit.client.1.smithi143.stdout:0/103: write d3/d5/d8/f13 [3801426,64005] 0 2024-09-17T01:06:51.700 INFO:tasks.workunit.client.1.smithi143.stdout:1/82: truncate d0/d6/d7/df/f1a 182379 0 2024-09-17T01:06:51.700 INFO:tasks.workunit.client.1.smithi143.stdout:8/55: write d9/fa [1512757,32780] 0 2024-09-17T01:06:51.701 INFO:tasks.workunit.client.1.smithi143.stdout:1/83: chown d0/d6/d7 77336656 1 2024-09-17T01:06:51.706 INFO:tasks.workunit.client.1.smithi143.stdout:6/46: mkdir d2/df 0 2024-09-17T01:06:51.710 INFO:tasks.workunit.client.1.smithi143.stdout:9/49: truncate d3/f8 134301 0 2024-09-17T01:06:51.711 INFO:tasks.workunit.client.1.smithi143.stdout:3/58: truncate d6/f7 2428674 0 2024-09-17T01:06:51.711 INFO:tasks.workunit.client.1.smithi143.stdout:9/50: dread - d3/d7/fb zero size 2024-09-17T01:06:51.712 INFO:tasks.workunit.client.1.smithi143.stdout:3/59: stat d6/lb 0 2024-09-17T01:06:51.712 INFO:tasks.workunit.client.1.smithi143.stdout:8/56: chown c3 0 1 2024-09-17T01:06:51.714 INFO:tasks.workunit.client.1.smithi143.stdout:9/51: fsync d3/d7/fb 0 2024-09-17T01:06:51.714 INFO:tasks.workunit.client.1.smithi143.stdout:6/47: dwrite d2/fa [0,4194304] 0 2024-09-17T01:06:51.715 INFO:tasks.workunit.client.1.smithi143.stdout:0/104: unlink d3/d5/d8/c20 0 2024-09-17T01:06:51.722 INFO:tasks.workunit.client.1.smithi143.stdout:8/57: rename c5 to d9/c17 0 2024-09-17T01:06:51.724 INFO:tasks.workunit.client.1.smithi143.stdout:9/52: creat d3/d7/d9/f11 x:0 0 0 2024-09-17T01:06:51.726 INFO:tasks.workunit.client.1.smithi143.stdout:9/53: truncate d3/d7/fc 125585 0 2024-09-17T01:06:51.729 INFO:tasks.workunit.client.1.smithi143.stdout:7/104: sync 2024-09-17T01:06:51.729 INFO:tasks.workunit.client.1.smithi143.stdout:2/63: sync 2024-09-17T01:06:51.729 INFO:tasks.workunit.client.1.smithi143.stdout:4/128: sync 2024-09-17T01:06:51.729 INFO:tasks.workunit.client.1.smithi143.stdout:5/177: sync 2024-09-17T01:06:51.730 INFO:tasks.workunit.client.1.smithi143.stdout:6/48: mknod d2/dc/c10 0 2024-09-17T01:06:51.731 INFO:tasks.workunit.client.1.smithi143.stdout:8/58: dread d9/fa [0,4194304] 0 2024-09-17T01:06:51.731 INFO:tasks.workunit.client.1.smithi143.stdout:0/105: mkdir d3/d5/d8/d21 0 2024-09-17T01:06:51.732 INFO:tasks.workunit.client.1.smithi143.stdout:9/54: creat d3/d7/f12 x:0 0 0 2024-09-17T01:06:51.736 INFO:tasks.workunit.client.1.smithi143.stdout:1/84: write d0/d6/d7/de/fa [4251310,84991] 0 2024-09-17T01:06:51.737 INFO:tasks.workunit.client.1.smithi143.stdout:4/129: creat da/d22/f27 x:0 0 0 2024-09-17T01:06:51.738 INFO:tasks.workunit.client.1.smithi143.stdout:1/85: readlink d0/d6/d7/df/l15 0 2024-09-17T01:06:51.738 INFO:tasks.workunit.client.1.smithi143.stdout:1/86: fsync d0/f4 0 2024-09-17T01:06:51.741 INFO:tasks.workunit.client.1.smithi143.stdout:7/105: creat d4/d1f/f24 x:0 0 0 2024-09-17T01:06:51.742 INFO:tasks.workunit.client.1.smithi143.stdout:4/130: dread da/f1b [0,4194304] 0 2024-09-17T01:06:51.742 INFO:tasks.workunit.client.1.smithi143.stdout:4/131: write da/f11 [358493,7507] 0 2024-09-17T01:06:51.747 INFO:tasks.workunit.client.1.smithi143.stdout:0/106: mknod d3/d14/d17/c22 0 2024-09-17T01:06:51.747 INFO:tasks.workunit.client.1.smithi143.stdout:0/107: chown d3/d5/d8/f13 30634024 1 2024-09-17T01:06:51.749 INFO:tasks.workunit.client.1.smithi143.stdout:9/55: dread d3/f4 [0,4194304] 0 2024-09-17T01:06:51.750 INFO:tasks.workunit.client.1.smithi143.stdout:9/56: read - d3/d7/f10 zero size 2024-09-17T01:06:51.752 INFO:tasks.workunit.client.1.smithi143.stdout:3/60: getdents d6 0 2024-09-17T01:06:51.754 INFO:tasks.workunit.client.1.smithi143.stdout:2/64: creat d0/d10/f16 x:0 0 0 2024-09-17T01:06:51.754 INFO:tasks.workunit.client.1.smithi143.stdout:2/65: chown d0/d10 9337 1 2024-09-17T01:06:51.755 INFO:tasks.workunit.client.1.smithi143.stdout:2/66: fsync d0/d2/f14 0 2024-09-17T01:06:51.756 INFO:tasks.workunit.client.1.smithi143.stdout:1/87: creat d0/dc/f1b x:0 0 0 2024-09-17T01:06:51.758 INFO:tasks.workunit.client.1.smithi143.stdout:7/106: symlink d4/d21/l25 0 2024-09-17T01:06:51.759 INFO:tasks.workunit.client.1.smithi143.stdout:7/107: write d4/f10 [645758,5623] 0 2024-09-17T01:06:51.760 INFO:tasks.workunit.client.1.smithi143.stdout:7/108: write d4/f13 [198993,27222] 0 2024-09-17T01:06:51.763 INFO:tasks.workunit.client.1.smithi143.stdout:7/109: write d4/d16/f17 [374230,85144] 0 2024-09-17T01:06:51.765 INFO:tasks.workunit.client.1.smithi143.stdout:7/110: dread - d4/f20 zero size 2024-09-17T01:06:51.766 INFO:tasks.workunit.client.1.smithi143.stdout:3/61: rmdir d6 39 2024-09-17T01:06:51.766 INFO:tasks.workunit.client.1.smithi143.stdout:4/132: rmdir da 39 2024-09-17T01:06:51.767 INFO:tasks.workunit.client.1.smithi143.stdout:2/67: creat d0/d10/f17 x:0 0 0 2024-09-17T01:06:51.775 INFO:tasks.workunit.client.1.smithi143.stdout:6/49: link d2/d7/f8 d2/f11 0 2024-09-17T01:06:51.775 INFO:tasks.workunit.client.1.smithi143.stdout:6/50: chown d2/dc/c10 58578107 1 2024-09-17T01:06:51.778 INFO:tasks.workunit.client.1.smithi143.stdout:9/57: symlink d3/l13 0 2024-09-17T01:06:51.779 INFO:tasks.workunit.client.1.smithi143.stdout:5/178: mknod d1/d5/c44 0 2024-09-17T01:06:51.784 INFO:tasks.workunit.client.1.smithi143.stdout:4/133: chown da/l23 4 1 2024-09-17T01:06:51.785 INFO:tasks.workunit.client.1.smithi143.stdout:2/68: write d0/fc [854303,93537] 0 2024-09-17T01:06:51.787 INFO:tasks.workunit.client.1.smithi143.stdout:5/179: creat d1/d5/df/f45 x:0 0 0 2024-09-17T01:06:51.788 INFO:tasks.workunit.client.1.smithi143.stdout:8/59: dwrite f0 [0,4194304] 0 2024-09-17T01:06:51.791 INFO:tasks.workunit.client.1.smithi143.stdout:3/62: symlink d6/le 0 2024-09-17T01:06:51.792 INFO:tasks.workunit.client.1.smithi143.stdout:1/88: link d0/d6/c8 d0/d6/d7/de/d18/c1c 0 2024-09-17T01:06:51.794 INFO:tasks.workunit.client.1.smithi143.stdout:6/51: mkdir d2/df/d12 0 2024-09-17T01:06:51.797 INFO:tasks.workunit.client.1.smithi143.stdout:4/134: truncate da/f26 1436316 0 2024-09-17T01:06:51.799 INFO:tasks.workunit.client.1.smithi143.stdout:2/69: mknod d0/d10/c18 0 2024-09-17T01:06:51.802 INFO:tasks.workunit.client.1.smithi143.stdout:8/60: rename f0 to d9/d12/f18 0 2024-09-17T01:06:51.804 INFO:tasks.workunit.client.1.smithi143.stdout:0/108: link d3/lb d3/d5/d8/d10/l23 0 2024-09-17T01:06:51.808 INFO:tasks.workunit.client.1.smithi143.stdout:6/52: unlink f0 0 2024-09-17T01:06:51.810 INFO:tasks.workunit.client.1.smithi143.stdout:9/58: creat d3/f14 x:0 0 0 2024-09-17T01:06:51.812 INFO:tasks.workunit.client.1.smithi143.stdout:4/135: creat da/f28 x:0 0 0 2024-09-17T01:06:51.814 INFO:tasks.workunit.client.1.smithi143.stdout:7/111: write d4/fd [124032,23838] 0 2024-09-17T01:06:51.817 INFO:tasks.workunit.client.1.smithi143.stdout:8/61: creat d9/f19 x:0 0 0 2024-09-17T01:06:51.818 INFO:tasks.workunit.client.1.smithi143.stdout:8/62: chown d9/ld 24889895 1 2024-09-17T01:06:51.821 INFO:tasks.workunit.client.1.smithi143.stdout:1/89: link d0/d6/f11 d0/d6/d7/de/f1d 0 2024-09-17T01:06:51.822 INFO:tasks.workunit.client.1.smithi143.stdout:6/53: mknod d2/dc/c13 0 2024-09-17T01:06:51.823 INFO:tasks.workunit.client.1.smithi143.stdout:7/112: dwrite d4/d16/f1d [0,4194304] 0 2024-09-17T01:06:51.825 INFO:tasks.workunit.client.1.smithi143.stdout:4/136: mknod da/c29 0 2024-09-17T01:06:51.826 INFO:tasks.workunit.client.1.smithi143.stdout:2/70: mknod d0/d2/c19 0 2024-09-17T01:06:51.830 INFO:tasks.workunit.client.1.smithi143.stdout:5/180: rename d1/d5 to d1/d46 0 2024-09-17T01:06:51.834 INFO:tasks.workunit.client.1.smithi143.stdout:2/71: dwrite d0/ff [0,4194304] 0 2024-09-17T01:06:51.836 INFO:tasks.workunit.client.1.smithi143.stdout:2/72: stat d0/d2/fe 0 2024-09-17T01:06:51.836 INFO:tasks.workunit.client.1.smithi143.stdout:1/90: write d0/d6/d7/de/f1d [3402782,39588] 0 2024-09-17T01:06:51.837 INFO:tasks.workunit.client.1.smithi143.stdout:2/73: fsync d0/d2/fe 0 2024-09-17T01:06:51.843 INFO:tasks.workunit.client.1.smithi143.stdout:3/63: truncate d6/fa 917974 0 2024-09-17T01:06:51.844 INFO:tasks.workunit.client.1.smithi143.stdout:4/137: creat da/f2a x:0 0 0 2024-09-17T01:06:51.848 INFO:tasks.workunit.client.1.smithi143.stdout:8/63: symlink d9/d12/d13/l1a 0 2024-09-17T01:06:51.850 INFO:tasks.workunit.client.1.smithi143.stdout:9/59: creat d3/f15 x:0 0 0 2024-09-17T01:06:51.852 INFO:tasks.workunit.client.1.smithi143.stdout:1/91: mknod d0/d6/d7/df/c1e 0 2024-09-17T01:06:51.854 INFO:tasks.workunit.client.1.smithi143.stdout:6/54: dwrite d2/dc/fd [4194304,4194304] 0 2024-09-17T01:06:51.854 INFO:tasks.workunit.client.1.smithi143.stdout:1/92: readlink d0/dc/l10 0 2024-09-17T01:06:51.864 INFO:tasks.workunit.client.1.smithi143.stdout:7/113: rename d4/d21 to d4/d26 0 2024-09-17T01:06:51.864 INFO:tasks.workunit.client.1.smithi143.stdout:4/138: dread da/fe [0,4194304] 0 2024-09-17T01:06:51.866 INFO:tasks.workunit.client.1.smithi143.stdout:1/93: fdatasync d0/d6/d7/de/f14 0 2024-09-17T01:06:51.867 INFO:tasks.workunit.client.1.smithi143.stdout:9/60: mkdir d3/d16 0 2024-09-17T01:06:51.870 INFO:tasks.workunit.client.1.smithi143.stdout:8/64: dwrite d9/f19 [0,4194304] 0 2024-09-17T01:06:51.870 INFO:tasks.workunit.client.1.smithi143.stdout:7/114: fsync d4/d16/f1d 0 2024-09-17T01:06:51.870 INFO:tasks.workunit.client.1.smithi143.stdout:3/64: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:51.874 INFO:tasks.workunit.client.1.smithi143.stdout:8/65: fsync d9/fc 0 2024-09-17T01:06:51.874 INFO:tasks.workunit.client.1.smithi143.stdout:7/115: truncate d4/f14 299511 0 2024-09-17T01:06:51.874 INFO:tasks.workunit.client.1.smithi143.stdout:3/65: chown d6/f7 2259 1 2024-09-17T01:06:51.875 INFO:tasks.workunit.client.1.smithi143.stdout:6/55: dread d2/fa [0,4194304] 0 2024-09-17T01:06:51.877 INFO:tasks.workunit.client.1.smithi143.stdout:2/74: dwrite d0/d2/f4 [0,4194304] 0 2024-09-17T01:06:51.879 INFO:tasks.workunit.client.1.smithi143.stdout:1/94: dread d0/d6/d7/de/fa [0,4194304] 0 2024-09-17T01:06:51.880 INFO:tasks.workunit.client.1.smithi143.stdout:9/61: fsync d3/f8 0 2024-09-17T01:06:51.884 INFO:tasks.workunit.client.1.smithi143.stdout:3/66: creat d6/ff x:0 0 0 2024-09-17T01:06:51.885 INFO:tasks.workunit.client.1.smithi143.stdout:9/62: dread d3/f8 [0,4194304] 0 2024-09-17T01:06:51.886 INFO:tasks.workunit.client.1.smithi143.stdout:5/181: link d1/d46/l2f d1/d46/df/d23/l47 0 2024-09-17T01:06:51.888 INFO:tasks.workunit.client.1.smithi143.stdout:6/56: write d2/fa [3862472,77631] 0 2024-09-17T01:06:51.891 INFO:tasks.workunit.client.1.smithi143.stdout:8/66: write d9/d12/f18 [4292856,50689] 0 2024-09-17T01:06:51.897 INFO:tasks.workunit.client.1.smithi143.stdout:4/139: truncate da/f17 2060718 0 2024-09-17T01:06:51.898 INFO:tasks.workunit.client.1.smithi143.stdout:1/95: fdatasync d0/d6/d7/de/fa 0 2024-09-17T01:06:51.906 INFO:tasks.workunit.client.1.smithi143.stdout:1/96: dwrite d0/d6/d7/de/f14 [0,4194304] 0 2024-09-17T01:06:51.907 INFO:tasks.workunit.client.1.smithi143.stdout:1/97: chown d0/d6/d7/de/f1d 113 1 2024-09-17T01:06:51.953 INFO:tasks.workunit.client.1.smithi143.stdout:0/109: sync 2024-09-17T01:06:51.996 INFO:tasks.workunit.client.1.smithi143.stdout:5/182: sync 2024-09-17T01:06:52.093 INFO:tasks.workunit.client.1.smithi143.stdout:9/63: creat d3/d7/d9/f17 x:0 0 0 2024-09-17T01:06:52.094 INFO:tasks.workunit.client.1.smithi143.stdout:9/64: write d3/d7/fb [1045922,120435] 0 2024-09-17T01:06:52.101 INFO:tasks.workunit.client.1.smithi143.stdout:8/67: mknod d9/d12/c1b 0 2024-09-17T01:06:52.105 INFO:tasks.workunit.client.1.smithi143.stdout:3/67: write d6/f7 [2262278,72859] 0 2024-09-17T01:06:52.107 INFO:tasks.workunit.client.1.smithi143.stdout:5/183: rmdir d1 39 2024-09-17T01:06:52.124 INFO:tasks.workunit.client.1.smithi143.stdout:0/110: dwrite d3/d5/fc [0,4194304] 0 2024-09-17T01:06:52.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 -- 172.21.15.103:0/2513236391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 msgr2=0x7fba4c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 --2- 172.21.15.103:0/2513236391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c0fee30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009880 tx=0x7fba3c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 -- 172.21.15.103:0/2513236391 shutdown_connections 2024-09-17T01:06:52.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 --2- 172.21.15.103:0/2513236391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 0x7fba4c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 --2- 172.21.15.103:0/2513236391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c0fee30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 -- 172.21.15.103:0/2513236391 >> 172.21.15.103:0/2513236391 conn(0x7fba4c0fa1c0 msgr2=0x7fba4c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:52.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:51 smithi103 ceph-mon[28156]: mgrmap e24: smithi143.sxhocv(active, since 7s), standbys: smithi103.efjaur 2024-09-17T01:06:52.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:52 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 -- 172.21.15.103:0/2513236391 shutdown_connections 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.217+0000 7fba51670640 1 -- 172.21.15.103:0/2513236391 wait complete. 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba51670640 1 Processor -- start 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba51670640 1 -- start start 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba51670640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba51670640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 0x7fba4c101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba51670640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c101550 con 0x7fba4c0fea30 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba51670640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c1016c0 con 0x7fba4c0ffc30 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba4affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba4affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c1029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36758/0 (socket says 172.21.15.103:36758) 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.218+0000 7fba4affd640 1 -- 172.21.15.103:0/1373869150 learned_addr learned my addr 172.21.15.103:0/1373869150 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba4a7fc640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 0x7fba4c101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba4affd640 1 -- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 msgr2=0x7fba4c101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba4affd640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 0x7fba4c101010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba4affd640 1 -- 172.21.15.103:0/1373869150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c009560 con 0x7fba4c0fea30 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba4a7fc640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 0x7fba4c101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba4affd640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c1029c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fba3c02a9c0 tx=0x7fba3c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3c004aa0 con 0x7fba4c0fea30 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba3c004c00 con 0x7fba4c0fea30 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3c003a80 con 0x7fba4c0fea30 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.219+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c101940 con 0x7fba4c0fea30 2024-09-17T01:06:52.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.220+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c19d680 con 0x7fba4c0fea30 2024-09-17T01:06:52.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.221+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c107640 con 0x7fba4c0fea30 2024-09-17T01:06:52.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.221+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fba3c003cf0 con 0x7fba4c0fea30 2024-09-17T01:06:52.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.222+0000 7fba33fff640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fba3406d8a0 0x7fba3406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.222+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fba3c0ae490 con 0x7fba4c0fea30 2024-09-17T01:06:52.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.222+0000 7fba4a7fc640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fba3406d8a0 0x7fba3406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.222+0000 7fba4a7fc640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fba3406d8a0 0x7fba3406fd60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba4c102740 tx=0x7fba4000b390 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:52.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.226+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fba3c077b90 con 0x7fba4c0fea30 2024-09-17T01:06:52.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:51 smithi143 ceph-mon[35452]: mgrmap e24: smithi143.sxhocv(active, since 7s), standbys: smithi103.efjaur 2024-09-17T01:06:52.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:51 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T01:06:52.260 INFO:tasks.workunit.client.1.smithi143.stdout:7/116: rename d4/d1f/f24 to d4/f27 0 2024-09-17T01:06:52.261 INFO:tasks.workunit.client.1.smithi143.stdout:7/117: write d4/f13 [686138,60429] 0 2024-09-17T01:06:52.263 INFO:tasks.workunit.client.1.smithi143.stdout:8/68: unlink d9/f19 0 2024-09-17T01:06:52.264 INFO:tasks.workunit.client.1.smithi143.stdout:2/75: creat d0/f1a x:0 0 0 2024-09-17T01:06:52.264 INFO:tasks.workunit.client.1.smithi143.stdout:8/69: dread - d9/de/f10 zero size 2024-09-17T01:06:52.265 INFO:tasks.workunit.client.1.smithi143.stdout:3/68: mkdir d6/d10 0 2024-09-17T01:06:52.266 INFO:tasks.workunit.client.1.smithi143.stdout:0/111: creat d3/d5/d8/d10/f24 x:0 0 0 2024-09-17T01:06:52.266 INFO:tasks.workunit.client.1.smithi143.stdout:9/65: mknod d3/d16/c18 0 2024-09-17T01:06:52.266 INFO:tasks.workunit.client.1.smithi143.stdout:3/69: write d6/ff [317503,82826] 0 2024-09-17T01:06:52.267 INFO:tasks.workunit.client.1.smithi143.stdout:0/112: fsync d3/de/f1e 0 2024-09-17T01:06:52.267 INFO:tasks.workunit.client.1.smithi143.stdout:1/98: rename d0/f4 to d0/d6/f1f 0 2024-09-17T01:06:52.268 INFO:tasks.workunit.client.1.smithi143.stdout:9/66: write d3/d7/f12 [853950,106337] 0 2024-09-17T01:06:52.270 INFO:tasks.workunit.client.1.smithi143.stdout:7/118: dread f2 [0,4194304] 0 2024-09-17T01:06:52.270 INFO:tasks.workunit.client.1.smithi143.stdout:0/113: write d3/d5/fc [2209717,64751] 0 2024-09-17T01:06:52.273 INFO:tasks.workunit.client.1.smithi143.stdout:0/114: chown d3/d5/d8 0 1 2024-09-17T01:06:52.273 INFO:tasks.workunit.client.1.smithi143.stdout:8/70: chown c3 292 1 2024-09-17T01:06:52.276 INFO:tasks.workunit.client.1.smithi143.stdout:3/70: read d6/fa [236188,34285] 0 2024-09-17T01:06:52.276 INFO:tasks.workunit.client.1.smithi143.stdout:9/67: symlink d3/d16/l19 0 2024-09-17T01:06:52.278 INFO:tasks.workunit.client.1.smithi143.stdout:4/140: getdents da 0 2024-09-17T01:06:52.280 INFO:tasks.workunit.client.1.smithi143.stdout:1/99: dwrite d0/d6/d7/de/f1d [0,4194304] 0 2024-09-17T01:06:52.280 INFO:tasks.workunit.client.1.smithi143.stdout:7/119: rename d4/f20 to d4/d1f/f28 0 2024-09-17T01:06:52.281 INFO:tasks.workunit.client.1.smithi143.stdout:5/184: dread d1/dd/f1d [4194304,4194304] 0 2024-09-17T01:06:52.281 INFO:tasks.workunit.client.1.smithi143.stdout:8/71: symlink d9/l1c 0 2024-09-17T01:06:52.284 INFO:tasks.workunit.client.1.smithi143.stdout:4/141: symlink da/d22/l2b 0 2024-09-17T01:06:52.285 INFO:tasks.workunit.client.1.smithi143.stdout:7/120: mkdir d4/d1f/d29 0 2024-09-17T01:06:52.287 INFO:tasks.workunit.client.1.smithi143.stdout:3/71: creat d6/d10/f11 x:0 0 0 2024-09-17T01:06:52.287 INFO:tasks.workunit.client.1.smithi143.stdout:3/72: write d6/ff [791755,16007] 0 2024-09-17T01:06:52.288 INFO:tasks.workunit.client.1.smithi143.stdout:3/73: write d6/d10/f11 [378558,83768] 0 2024-09-17T01:06:52.290 INFO:tasks.workunit.client.1.smithi143.stdout:1/100: rename d0/dc/f1b to d0/d6/f20 0 2024-09-17T01:06:52.290 INFO:tasks.workunit.client.1.smithi143.stdout:3/74: write d6/ff [1687529,91343] 0 2024-09-17T01:06:52.291 INFO:tasks.workunit.client.1.smithi143.stdout:8/72: mknod d9/c1d 0 2024-09-17T01:06:52.292 INFO:tasks.workunit.client.1.smithi143.stdout:5/185: chown d1/d46/df/l37 1017 1 2024-09-17T01:06:52.294 INFO:tasks.workunit.client.1.smithi143.stdout:0/115: link d3/de/f1c d3/d5/d8/d10/f25 0 2024-09-17T01:06:52.295 INFO:tasks.workunit.client.1.smithi143.stdout:2/76: getdents d0/d2 0 2024-09-17T01:06:52.297 INFO:tasks.workunit.client.1.smithi143.stdout:4/142: rename da/c14 to da/c2c 0 2024-09-17T01:06:52.297 INFO:tasks.workunit.client.1.smithi143.stdout:2/77: write d0/d2/fe [5498,28624] 0 2024-09-17T01:06:52.298 INFO:tasks.workunit.client.1.smithi143.stdout:1/101: dwrite d0/d6/d7/de/fa [0,4194304] 0 2024-09-17T01:06:52.299 INFO:tasks.workunit.client.1.smithi143.stdout:4/143: fdatasync da/d22/f27 0 2024-09-17T01:06:52.301 INFO:tasks.workunit.client.1.smithi143.stdout:3/75: symlink d6/d10/l12 0 2024-09-17T01:06:52.303 INFO:tasks.workunit.client.1.smithi143.stdout:8/73: mkdir d9/de/d1e 0 2024-09-17T01:06:52.305 INFO:tasks.workunit.client.1.smithi143.stdout:7/121: symlink d4/l2a 0 2024-09-17T01:06:52.306 INFO:tasks.workunit.client.1.smithi143.stdout:1/102: dread d0/d6/fd [0,4194304] 0 2024-09-17T01:06:52.306 INFO:tasks.workunit.client.1.smithi143.stdout:3/76: write d6/ff [934937,104434] 0 2024-09-17T01:06:52.307 INFO:tasks.workunit.client.1.smithi143.stdout:4/144: creat da/f2d x:0 0 0 2024-09-17T01:06:52.308 INFO:tasks.workunit.client.1.smithi143.stdout:7/122: dread - d4/f27 zero size 2024-09-17T01:06:52.308 INFO:tasks.workunit.client.1.smithi143.stdout:0/116: creat d3/d5/d8/d21/f26 x:0 0 0 2024-09-17T01:06:52.309 INFO:tasks.workunit.client.1.smithi143.stdout:8/74: mknod d9/c1f 0 2024-09-17T01:06:52.310 INFO:tasks.workunit.client.1.smithi143.stdout:2/78: dwrite d0/d2/fb [0,4194304] 0 2024-09-17T01:06:52.311 INFO:tasks.workunit.client.1.smithi143.stdout:5/186: creat d1/d46/f48 x:0 0 0 2024-09-17T01:06:52.312 INFO:tasks.workunit.client.1.smithi143.stdout:8/75: fdatasync d9/de/f10 0 2024-09-17T01:06:52.312 INFO:tasks.workunit.client.1.smithi143.stdout:4/145: truncate da/d22/f27 264859 0 2024-09-17T01:06:52.315 INFO:tasks.workunit.client.1.smithi143.stdout:2/79: read d0/d10/f11 [2947046,78788] 0 2024-09-17T01:06:52.315 INFO:tasks.workunit.client.1.smithi143.stdout:7/123: rename d4/f15 to d4/d26/f2b 0 2024-09-17T01:06:52.317 INFO:tasks.workunit.client.1.smithi143.stdout:7/124: chown d4/le 78668946 1 2024-09-17T01:06:52.317 INFO:tasks.workunit.client.1.smithi143.stdout:5/187: readlink d1/d46/df/d23/l47 0 2024-09-17T01:06:52.320 INFO:tasks.workunit.client.1.smithi143.stdout:8/76: mknod d9/d12/c20 0 2024-09-17T01:06:52.320 INFO:tasks.workunit.client.1.smithi143.stdout:7/125: chown d4/fd 94152 1 2024-09-17T01:06:52.322 INFO:tasks.workunit.client.1.smithi143.stdout:8/77: read f7 [114632,113008] 0 2024-09-17T01:06:52.382 INFO:tasks.workunit.client.1.smithi143.stdout:7/126: readlink d4/le 0 2024-09-17T01:06:52.383 INFO:tasks.workunit.client.1.smithi143.stdout:4/146: creat da/f2e x:0 0 0 2024-09-17T01:06:52.384 INFO:tasks.workunit.client.1.smithi143.stdout:1/103: dwrite d0/d6/fd [0,4194304] 0 2024-09-17T01:06:52.385 INFO:tasks.workunit.client.1.smithi143.stdout:0/117: dwrite d3/d5/d8/f13 [0,4194304] 0 2024-09-17T01:06:52.385 INFO:tasks.workunit.client.1.smithi143.stdout:5/188: dread d1/d46/f22 [0,4194304] 0 2024-09-17T01:06:52.386 INFO:tasks.workunit.client.1.smithi143.stdout:8/78: chown d9/c15 32623 1 2024-09-17T01:06:52.387 INFO:tasks.workunit.client.1.smithi143.stdout:0/118: fdatasync d3/d5/d8/d21/f26 0 2024-09-17T01:06:52.387 INFO:tasks.workunit.client.1.smithi143.stdout:4/147: truncate da/f1c 56650 0 2024-09-17T01:06:52.388 INFO:tasks.workunit.client.1.smithi143.stdout:1/104: write d0/d6/d7/de/fb [695796,129360] 0 2024-09-17T01:06:52.393 INFO:tasks.workunit.client.1.smithi143.stdout:1/105: dread d0/d6/fd [0,4194304] 0 2024-09-17T01:06:52.400 INFO:tasks.workunit.client.1.smithi143.stdout:1/106: dwrite d0/d6/d7/de/fb [0,4194304] 0 2024-09-17T01:06:52.407 INFO:tasks.workunit.client.1.smithi143.stdout:1/107: dwrite d0/f19 [0,4194304] 0 2024-09-17T01:06:52.409 INFO:tasks.workunit.client.1.smithi143.stdout:9/68: sync 2024-09-17T01:06:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.454+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba4c0fc3d0 con 0x7fba3406d8a0 2024-09-17T01:06:52.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.456+0000 7fba33fff640 1 -- 172.21.15.103:0/1373869150 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fba4c0fc3d0 con 0x7fba3406d8a0 2024-09-17T01:06:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fba3406d8a0 msgr2=0x7fba3406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fba3406d8a0 0x7fba3406fd60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba4c102740 tx=0x7fba4000b390 comp rx=0 tx=0).stop 2024-09-17T01:06:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 msgr2=0x7fba4c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c1029c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fba3c02a9c0 tx=0x7fba3c0054f0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 shutdown_connections 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fba3406d8a0 0x7fba3406fd60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4c0ffc30 0x7fba4c101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 --2- 172.21.15.103:0/1373869150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba4c0fea30 0x7fba4c1029c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 >> 172.21.15.103:0/1373869150 conn(0x7fba4c0fa1c0 msgr2=0x7fba4c0fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 shutdown_connections 2024-09-17T01:06:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.458+0000 7fba51670640 1 -- 172.21.15.103:0/1373869150 wait complete. 2024-09-17T01:06:52.463 INFO:tasks.workunit.client.1.smithi143.stdout:2/80: sync 2024-09-17T01:06:52.464 INFO:tasks.workunit.client.1.smithi143.stdout:2/81: truncate d0/d2/f14 846551 0 2024-09-17T01:06:52.465 INFO:tasks.workunit.client.1.smithi143.stdout:2/82: write d0/d10/f16 [907069,31639] 0 2024-09-17T01:06:52.465 INFO:tasks.workunit.client.1.smithi143.stdout:2/83: write d0/f1a [149672,85396] 0 2024-09-17T01:06:52.466 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:06:52.466 INFO:tasks.workunit.client.1.smithi143.stdout:2/84: fsync d0/d2/fb 0 2024-09-17T01:06:52.529 INFO:tasks.workunit.client.1.smithi143.stdout:7/127: symlink d4/d26/l2c 0 2024-09-17T01:06:52.529 INFO:tasks.workunit.client.1.smithi143.stdout:7/128: chown d4/f12 185663982 1 2024-09-17T01:06:52.532 INFO:tasks.workunit.client.1.smithi143.stdout:4/148: chown da/f1b 2305 1 2024-09-17T01:06:52.539 INFO:tasks.workunit.client.1.smithi143.stdout:1/108: write d0/d6/f1f [1276955,116043] 0 2024-09-17T01:06:52.539 INFO:tasks.workunit.client.1.smithi143.stdout:9/69: creat d3/d7/d9/f1a x:0 0 0 2024-09-17T01:06:52.541 INFO:tasks.workunit.client.1.smithi143.stdout:5/189: symlink d1/l49 0 2024-09-17T01:06:52.543 INFO:tasks.workunit.client.1.smithi143.stdout:8/79: link d9/fc d9/de/f21 0 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 -- 172.21.15.103:0/220473246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 msgr2=0x7f16cc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 --2- 172.21.15.103:0/220473246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc1000b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009880 tx=0x7f16bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 -- 172.21.15.103:0/220473246 shutdown_connections 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 --2- 172.21.15.103:0/220473246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc1000b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 --2- 172.21.15.103:0/220473246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16cc0fea30 0x7f16cc0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 -- 172.21.15.103:0/220473246 >> 172.21.15.103:0/220473246 conn(0x7f16cc0fa1c0 msgr2=0x7f16cc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 -- 172.21.15.103:0/220473246 shutdown_connections 2024-09-17T01:06:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.550+0000 7f16d3afd640 1 -- 172.21.15.103:0/220473246 wait complete. 2024-09-17T01:06:52.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d3afd640 1 Processor -- start 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d3afd640 1 -- start start 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d3afd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16cc0fea30 0x7f16cc068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d3afd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d3afd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc19a930 con 0x7f16cc0ffc30 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d3afd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc19aaa0 con 0x7f16cc0fea30 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d1098640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d1098640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46120/0 (socket says 172.21.15.103:46120) 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d1098640 1 -- 172.21.15.103:0/3367263331 learned_addr learned my addr 172.21.15.103:0/3367263331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.551+0000 7f16d1899640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16cc0fea30 0x7f16cc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16d1098640 1 -- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16cc0fea30 msgr2=0x7f16cc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16d1098640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16cc0fea30 0x7f16cc068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16d1098640 1 -- 172.21.15.103:0/3367263331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc009560 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16d1098640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc19a360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0054f0 tx=0x7f16bc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16bc004aa0 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc19ad20 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16bc004c00 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16bc003ac0 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.552+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc19b290 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.553+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc18e5b0 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.554+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f16bc003d30 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.554+0000 7f16c2ffd640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f16b806d8a0 0x7f16b806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.554+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f16bc0ae5e0 con 0x7f16cc0ffc30 2024-09-17T01:06:52.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.555+0000 7f16d1899640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f16b806d8a0 0x7f16b806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.556+0000 7f16d1899640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f16b806d8a0 0x7f16b806fd60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f16c8005fd0 tx=0x7f16c8005850 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:52.556 INFO:tasks.workunit.client.1.smithi143.stdout:5/190: creat d1/d46/df/d23/f4a x:0 0 0 2024-09-17T01:06:52.557 INFO:tasks.workunit.client.1.smithi143.stdout:1/109: dwrite d0/d6/d7/de/fb [0,4194304] 0 2024-09-17T01:06:52.557 INFO:tasks.workunit.client.1.smithi143.stdout:9/70: rename d3/d7/d9/lf to d3/d7/d9/l1b 0 2024-09-17T01:06:52.557 INFO:tasks.workunit.client.1.smithi143.stdout:1/110: mknod d0/d6/d7/c21 0 2024-09-17T01:06:52.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.559+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f16bc077bc0 con 0x7f16cc0ffc30 2024-09-17T01:06:52.560 INFO:tasks.workunit.client.1.smithi143.stdout:5/191: symlink d1/d46/l4b 0 2024-09-17T01:06:52.565 INFO:tasks.workunit.client.1.smithi143.stdout:5/192: mkdir d1/d46/d4c 0 2024-09-17T01:06:52.567 INFO:tasks.workunit.client.1.smithi143.stdout:5/193: fdatasync d1/d46/df/d1f/f3e 0 2024-09-17T01:06:52.568 INFO:tasks.workunit.client.1.smithi143.stdout:1/111: getdents d0/d6/d7/de/d18 0 2024-09-17T01:06:52.568 INFO:tasks.workunit.client.1.smithi143.stdout:1/112: fdatasync d0/d6/f11 0 2024-09-17T01:06:52.572 INFO:tasks.workunit.client.1.smithi143.stdout:1/113: creat d0/d6/d7/f22 x:0 0 0 2024-09-17T01:06:52.575 INFO:tasks.workunit.client.1.smithi143.stdout:1/114: read - d0/d6/f20 zero size 2024-09-17T01:06:52.577 INFO:tasks.workunit.client.1.smithi143.stdout:5/194: dwrite d1/d46/f48 [0,4194304] 0 2024-09-17T01:06:52.579 INFO:tasks.workunit.client.1.smithi143.stdout:1/115: chown d0/d6/d7/de/d18/c1c 22 1 2024-09-17T01:06:52.583 INFO:tasks.workunit.client.1.smithi143.stdout:5/195: creat d1/f4d x:0 0 0 2024-09-17T01:06:52.587 INFO:tasks.workunit.client.1.smithi143.stdout:5/196: creat d1/d46/df/d23/f4e x:0 0 0 2024-09-17T01:06:52.588 INFO:tasks.workunit.client.1.smithi143.stdout:5/197: readlink d1/d46/l4b 0 2024-09-17T01:06:52.589 INFO:tasks.workunit.client.1.smithi143.stdout:1/116: dwrite d0/f19 [0,4194304] 0 2024-09-17T01:06:52.590 INFO:tasks.workunit.client.1.smithi143.stdout:1/117: stat d0/d6/d7/df 0 2024-09-17T01:06:52.605 INFO:tasks.workunit.client.1.smithi143.stdout:6/57: truncate d2/fa 133659 0 2024-09-17T01:06:52.607 INFO:tasks.workunit.client.1.smithi143.stdout:2/85: getdents d0 0 2024-09-17T01:06:52.613 INFO:tasks.workunit.client.1.smithi143.stdout:6/58: dwrite d2/fb [0,4194304] 0 2024-09-17T01:06:52.613 INFO:tasks.workunit.client.1.smithi143.stdout:0/119: rename d3/de to d3/d5/d8/d27 0 2024-09-17T01:06:52.615 INFO:tasks.workunit.client.1.smithi143.stdout:2/86: dread d0/d2/fe [0,4194304] 0 2024-09-17T01:06:52.616 INFO:tasks.workunit.client.1.smithi143.stdout:6/59: unlink d2/dc/fd 0 2024-09-17T01:06:52.616 INFO:tasks.workunit.client.1.smithi143.stdout:0/120: write d3/d5/d8/d21/f26 [394318,42700] 0 2024-09-17T01:06:52.618 INFO:tasks.workunit.client.1.smithi143.stdout:7/129: rename d4/f12 to d4/d26/f2d 0 2024-09-17T01:06:52.621 INFO:tasks.workunit.client.1.smithi143.stdout:6/60: creat d2/df/f14 x:0 0 0 2024-09-17T01:06:52.621 INFO:tasks.workunit.client.1.smithi143.stdout:5/198: rename d1/dd to d1/d46/df/d23/d4f 0 2024-09-17T01:06:52.622 INFO:tasks.workunit.client.1.smithi143.stdout:2/87: rename d0/d10 to d0/d10/d1b 22 2024-09-17T01:06:52.622 INFO:tasks.workunit.client.1.smithi143.stdout:8/80: getdents d9 0 2024-09-17T01:06:52.623 INFO:tasks.workunit.client.1.smithi143.stdout:5/199: write d1/d46/df/d1f/f3e [58375,36649] 0 2024-09-17T01:06:52.624 INFO:tasks.workunit.client.1.smithi143.stdout:6/61: symlink d2/df/l15 0 2024-09-17T01:06:52.624 INFO:tasks.workunit.client.1.smithi143.stdout:8/81: stat d9/de/d1e 0 2024-09-17T01:06:52.625 INFO:tasks.workunit.client.1.smithi143.stdout:7/130: mknod d4/d1f/d29/c2e 0 2024-09-17T01:06:52.627 INFO:tasks.workunit.client.1.smithi143.stdout:0/121: truncate d3/d5/d8/d27/f1e 1921953 0 2024-09-17T01:06:52.628 INFO:tasks.workunit.client.1.smithi143.stdout:6/62: creat d2/f16 x:0 0 0 2024-09-17T01:06:52.629 INFO:tasks.workunit.client.1.smithi143.stdout:5/200: creat d1/d46/df/d23/f50 x:0 0 0 2024-09-17T01:06:52.630 INFO:tasks.workunit.client.1.smithi143.stdout:7/131: mknod d4/d1f/c2f 0 2024-09-17T01:06:52.632 INFO:tasks.workunit.client.1.smithi143.stdout:0/122: creat d3/d14/d17/f28 x:0 0 0 2024-09-17T01:06:52.634 INFO:tasks.workunit.client.1.smithi143.stdout:5/201: mknod d1/d46/df/d23/c51 0 2024-09-17T01:06:52.635 INFO:tasks.workunit.client.1.smithi143.stdout:5/202: dread - d1/d46/df/d23/f4a zero size 2024-09-17T01:06:52.635 INFO:tasks.workunit.client.1.smithi143.stdout:7/132: creat d4/d1f/f30 x:0 0 0 2024-09-17T01:06:52.643 INFO:tasks.workunit.client.1.smithi143.stdout:5/203: mknod d1/d46/c52 0 2024-09-17T01:06:52.645 INFO:tasks.workunit.client.1.smithi143.stdout:5/204: mkdir d1/d46/df/d53 0 2024-09-17T01:06:52.646 INFO:tasks.workunit.client.1.smithi143.stdout:7/133: dwrite f2 [0,4194304] 0 2024-09-17T01:06:52.648 INFO:tasks.workunit.client.1.smithi143.stdout:7/134: write d4/d26/f22 [9273,62094] 0 2024-09-17T01:06:52.649 INFO:tasks.workunit.client.1.smithi143.stdout:7/135: write d4/d1f/f23 [436171,28395] 0 2024-09-17T01:06:52.656 INFO:tasks.workunit.client.1.smithi143.stdout:7/136: dwrite d4/d16/f17 [0,4194304] 0 2024-09-17T01:06:52.658 INFO:tasks.workunit.client.1.smithi143.stdout:7/137: creat d4/d1f/f31 x:0 0 0 2024-09-17T01:06:52.660 INFO:tasks.workunit.client.1.smithi143.stdout:7/138: dread d4/f14 [0,4194304] 0 2024-09-17T01:06:52.662 INFO:tasks.workunit.client.1.smithi143.stdout:3/77: truncate d6/f7 1465179 0 2024-09-17T01:06:52.670 INFO:tasks.workunit.client.1.smithi143.stdout:4/149: write da/f26 [2279787,36906] 0 2024-09-17T01:06:52.670 INFO:tasks.workunit.client.1.smithi143.stdout:4/150: truncate da/f1b 2834047 0 2024-09-17T01:06:52.671 INFO:tasks.workunit.client.1.smithi143.stdout:3/78: unlink d6/l9 0 2024-09-17T01:06:52.673 INFO:tasks.workunit.client.1.smithi143.stdout:4/151: rmdir da/d22 39 2024-09-17T01:06:52.673 INFO:tasks.workunit.client.1.smithi143.stdout:7/139: dwrite d4/f13 [0,4194304] 0 2024-09-17T01:06:52.675 INFO:tasks.workunit.client.1.smithi143.stdout:3/79: write d6/d10/f11 [770343,70100] 0 2024-09-17T01:06:52.680 INFO:tasks.workunit.client.1.smithi143.stdout:4/152: unlink da/l23 0 2024-09-17T01:06:52.684 INFO:tasks.workunit.client.1.smithi143.stdout:3/80: creat d6/d10/f13 x:0 0 0 2024-09-17T01:06:52.686 INFO:tasks.workunit.client.1.smithi143.stdout:3/81: read d6/fa [786567,8438] 0 2024-09-17T01:06:52.686 INFO:tasks.workunit.client.1.smithi143.stdout:7/140: dwrite d4/d1f/f23 [0,4194304] 0 2024-09-17T01:06:52.693 INFO:tasks.workunit.client.1.smithi143.stdout:3/82: mknod d6/d10/c14 0 2024-09-17T01:06:52.693 INFO:tasks.workunit.client.1.smithi143.stdout:3/83: chown d6/l8 0 1 2024-09-17T01:06:52.693 INFO:tasks.workunit.client.1.smithi143.stdout:7/141: mkdir d4/d26/d32 0 2024-09-17T01:06:52.695 INFO:tasks.workunit.client.1.smithi143.stdout:4/153: mknod da/d22/c2f 0 2024-09-17T01:06:52.703 INFO:tasks.workunit.client.1.smithi143.stdout:9/71: sync 2024-09-17T01:06:52.703 INFO:tasks.workunit.client.1.smithi143.stdout:1/118: sync 2024-09-17T01:06:52.703 INFO:tasks.workunit.client.1.smithi143.stdout:1/119: chown d0/d6/f11 0 1 2024-09-17T01:06:52.706 INFO:tasks.workunit.client.1.smithi143.stdout:7/142: mkdir d4/d33 0 2024-09-17T01:06:52.710 INFO:tasks.workunit.client.1.smithi143.stdout:5/205: getdents d1/d46 0 2024-09-17T01:06:52.711 INFO:tasks.workunit.client.1.smithi143.stdout:4/154: mknod da/c30 0 2024-09-17T01:06:52.712 INFO:tasks.workunit.client.1.smithi143.stdout:7/143: write d4/fd [958920,106492] 0 2024-09-17T01:06:52.716 INFO:tasks.workunit.client.1.smithi143.stdout:1/120: write d0/d6/fd [4469379,22297] 0 2024-09-17T01:06:52.719 INFO:tasks.workunit.client.1.smithi143.stdout:5/206: write d1/d46/df/d23/f2a [506401,7100] 0 2024-09-17T01:06:52.720 INFO:tasks.workunit.client.1.smithi143.stdout:7/144: write d4/d16/f17 [2052023,81982] 0 2024-09-17T01:06:52.721 INFO:tasks.workunit.client.1.smithi143.stdout:6/63: dwrite d2/f11 [0,4194304] 0 2024-09-17T01:06:52.722 INFO:tasks.workunit.client.1.smithi143.stdout:9/72: dwrite d3/d7/fa [4194304,4194304] 0 2024-09-17T01:06:52.723 INFO:tasks.workunit.client.1.smithi143.stdout:0/123: dwrite d3/d5/d8/d10/f25 [0,4194304] 0 2024-09-17T01:06:52.726 INFO:tasks.workunit.client.1.smithi143.stdout:7/145: stat d4/ca 0 2024-09-17T01:06:52.726 INFO:tasks.workunit.client.1.smithi143.stdout:5/207: fsync d1/d46/df/d23/f50 0 2024-09-17T01:06:52.734 INFO:tasks.workunit.client.1.smithi143.stdout:0/124: creat d3/d5/f29 x:0 0 0 2024-09-17T01:06:52.736 INFO:tasks.workunit.client.1.smithi143.stdout:9/73: creat d3/d7/f1c x:0 0 0 2024-09-17T01:06:52.738 INFO:tasks.workunit.client.1.smithi143.stdout:0/125: truncate d3/d5/f29 423362 0 2024-09-17T01:06:52.738 INFO:tasks.workunit.client.1.smithi143.stdout:1/121: dwrite d0/d6/f20 [0,4194304] 0 2024-09-17T01:06:52.738 INFO:tasks.workunit.client.1.smithi143.stdout:9/74: truncate d3/d7/d9/f1a 47441 0 2024-09-17T01:06:52.739 INFO:tasks.workunit.client.1.smithi143.stdout:5/208: creat d1/d46/df/f54 x:0 0 0 2024-09-17T01:06:52.740 INFO:tasks.workunit.client.1.smithi143.stdout:1/122: stat d0/d6/d7/df/c16 0 2024-09-17T01:06:52.740 INFO:tasks.workunit.client.1.smithi143.stdout:9/75: dread - d3/d7/f1c zero size 2024-09-17T01:06:52.741 INFO:tasks.workunit.client.1.smithi143.stdout:9/76: dread - d3/f15 zero size 2024-09-17T01:06:52.741 INFO:tasks.workunit.client.1.smithi143.stdout:7/146: creat d4/d1f/d29/f34 x:0 0 0 2024-09-17T01:06:52.743 INFO:tasks.workunit.client.1.smithi143.stdout:7/147: dread - d4/d1f/f31 zero size 2024-09-17T01:06:52.749 INFO:tasks.workunit.client.1.smithi143.stdout:1/123: dwrite d0/d6/f11 [0,4194304] 0 2024-09-17T01:06:52.750 INFO:tasks.workunit.client.1.smithi143.stdout:1/124: write d0/d6/f11 [2603637,39334] 0 2024-09-17T01:06:52.753 INFO:tasks.workunit.client.1.smithi143.stdout:0/126: chown d3/d5/l6 31 1 2024-09-17T01:06:52.758 INFO:tasks.workunit.client.1.smithi143.stdout:9/77: creat d3/d16/f1d x:0 0 0 2024-09-17T01:06:52.759 INFO:tasks.workunit.client.1.smithi143.stdout:9/78: stat d3/d7/ce 0 2024-09-17T01:06:52.764 INFO:tasks.workunit.client.1.smithi143.stdout:9/79: write d3/d7/d9/f1a [55890,130298] 0 2024-09-17T01:06:52.764 INFO:tasks.workunit.client.1.smithi143.stdout:4/155: getdents da 0 2024-09-17T01:06:52.765 INFO:tasks.workunit.client.1.smithi143.stdout:9/80: chown d3/f4 145541 1 2024-09-17T01:06:52.766 INFO:tasks.workunit.client.1.smithi143.stdout:1/125: creat d0/d6/f23 x:0 0 0 2024-09-17T01:06:52.769 INFO:tasks.workunit.client.1.smithi143.stdout:5/209: creat d1/d46/df/d53/f55 x:0 0 0 2024-09-17T01:06:52.770 INFO:tasks.workunit.client.1.smithi143.stdout:3/84: truncate d6/f7 1910838 0 2024-09-17T01:06:52.770 INFO:tasks.workunit.client.1.smithi143.stdout:5/210: chown d1/d46/df/d23/f41 132796273 1 2024-09-17T01:06:52.771 INFO:tasks.workunit.client.1.smithi143.stdout:5/211: truncate d1/d46/df/d23/d4f/f33 5192695 0 2024-09-17T01:06:52.772 INFO:tasks.workunit.client.1.smithi143.stdout:5/212: readlink d1/d46/df/d1f/l28 0 2024-09-17T01:06:52.772 INFO:tasks.workunit.client.1.smithi143.stdout:4/156: creat da/f31 x:0 0 0 2024-09-17T01:06:52.772 INFO:tasks.workunit.client.1.smithi143.stdout:5/213: stat d1/d46/df/d1f/f30 0 2024-09-17T01:06:52.775 INFO:tasks.workunit.client.1.smithi143.stdout:1/126: unlink d0/d6/d7/de/fa 0 2024-09-17T01:06:52.776 INFO:tasks.workunit.client.1.smithi143.stdout:6/64: getdents d2/df 0 2024-09-17T01:06:52.777 INFO:tasks.workunit.client.1.smithi143.stdout:6/65: chown d2/c6 7 1 2024-09-17T01:06:52.780 INFO:tasks.workunit.client.1.smithi143.stdout:7/148: rmdir d4/d1f 39 2024-09-17T01:06:52.780 INFO:tasks.workunit.client.1.smithi143.stdout:2/88: sync 2024-09-17T01:06:52.781 INFO:tasks.workunit.client.1.smithi143.stdout:7/149: fsync d4/fd 0 2024-09-17T01:06:52.784 INFO:tasks.workunit.client.1.smithi143.stdout:9/81: mknod d3/c1e 0 2024-09-17T01:06:52.786 INFO:tasks.workunit.client.1.smithi143.stdout:5/214: rename d1/d46/df/d1f/f3e to d1/d46/df/d53/f56 0 2024-09-17T01:06:52.786 INFO:tasks.workunit.client.1.smithi143.stdout:7/150: dread d4/fd [0,4194304] 0 2024-09-17T01:06:52.787 INFO:tasks.workunit.client.1.smithi143.stdout:7/151: stat d4/f5 0 2024-09-17T01:06:52.789 INFO:tasks.workunit.client.1.smithi143.stdout:6/66: mkdir d2/d17 0 2024-09-17T01:06:52.791 INFO:tasks.workunit.client.1.smithi143.stdout:7/152: dread d4/d16/f17 [0,4194304] 0 2024-09-17T01:06:52.793 INFO:tasks.workunit.client.1.smithi143.stdout:2/89: mknod d0/c1c 0 2024-09-17T01:06:52.793 INFO:tasks.workunit.client.1.smithi143.stdout:6/67: dread d2/f11 [0,4194304] 0 2024-09-17T01:06:52.794 INFO:tasks.workunit.client.1.smithi143.stdout:3/85: dread - d6/d10/f13 zero size 2024-09-17T01:06:52.797 INFO:tasks.workunit.client.1.smithi143.stdout:9/82: symlink d3/d7/l1f 0 2024-09-17T01:06:52.797 INFO:tasks.workunit.client.1.smithi143.stdout:9/83: truncate d3/f14 826286 0 2024-09-17T01:06:52.802 INFO:tasks.workunit.client.1.smithi143.stdout:9/84: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:06:52.804 INFO:tasks.workunit.client.1.smithi143.stdout:1/127: symlink d0/l24 0 2024-09-17T01:06:52.804 INFO:tasks.workunit.client.1.smithi143.stdout:9/85: write d3/d7/f1c [649709,62696] 0 2024-09-17T01:06:52.808 INFO:tasks.workunit.client.1.smithi143.stdout:0/127: getdents d3/d5 0 2024-09-17T01:06:52.810 INFO:tasks.workunit.client.1.smithi143.stdout:0/128: readlink d3/d5/l6 0 2024-09-17T01:06:52.810 INFO:tasks.workunit.client.1.smithi143.stdout:0/129: readlink d3/d5/l6 0 2024-09-17T01:06:52.810 INFO:tasks.workunit.client.1.smithi143.stdout:2/90: fsync d0/d2/fb 0 2024-09-17T01:06:52.813 INFO:tasks.workunit.client.1.smithi143.stdout:2/91: dread d0/d2/fb [4194304,4194304] 0 2024-09-17T01:06:52.813 INFO:tasks.workunit.client.1.smithi143.stdout:3/86: dread d6/fa [0,4194304] 0 2024-09-17T01:06:52.819 INFO:tasks.workunit.client.1.smithi143.stdout:2/92: dwrite d0/d2/fb [0,4194304] 0 2024-09-17T01:06:52.822 INFO:tasks.workunit.client.1.smithi143.stdout:9/86: symlink d3/d16/l20 0 2024-09-17T01:06:52.826 INFO:tasks.workunit.client.1.smithi143.stdout:0/130: creat d3/d5/d8/d10/f2a x:0 0 0 2024-09-17T01:06:52.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.828+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16cc02c450 con 0x7f16b806d8a0 2024-09-17T01:06:52.828 INFO:tasks.workunit.client.1.smithi143.stdout:6/68: getdents d2/d17 0 2024-09-17T01:06:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.830+0000 7f16c2ffd640 1 -- 172.21.15.103:0/3367263331 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f16cc02c450 con 0x7f16b806d8a0 2024-09-17T01:06:52.830 INFO:tasks.workunit.client.1.smithi143.stdout:3/87: write d6/ff [1817126,114061] 0 2024-09-17T01:06:52.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f16b806d8a0 msgr2=0x7f16b806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f16b806d8a0 0x7f16b806fd60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f16c8005fd0 tx=0x7f16c8005850 comp rx=0 tx=0).stop 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 msgr2=0x7f16cc19a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc19a360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0054f0 tx=0x7f16bc005520 comp rx=0 tx=0).stop 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 shutdown_connections 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc0ffc30 0x7f16cc19a360 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f16b806d8a0 0x7f16b806fd60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 --2- 172.21.15.103:0/3367263331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16cc0fea30 0x7f16cc068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.833+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 >> 172.21.15.103:0/3367263331 conn(0x7f16cc0fa1c0 msgr2=0x7f16cc103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.834+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 shutdown_connections 2024-09-17T01:06:52.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.834+0000 7f16d3afd640 1 -- 172.21.15.103:0/3367263331 wait complete. 2024-09-17T01:06:52.835 INFO:tasks.workunit.client.1.smithi143.stdout:1/128: mknod d0/c25 0 2024-09-17T01:06:52.838 INFO:tasks.workunit.client.1.smithi143.stdout:0/131: creat d3/d5/d8/d27/f2b x:0 0 0 2024-09-17T01:06:52.839 INFO:tasks.workunit.client.1.smithi143.stdout:5/215: getdents d1/d46/df/d1f 0 2024-09-17T01:06:52.840 INFO:tasks.workunit.client.1.smithi143.stdout:0/132: write d3/d14/d17/f1d [758294,80350] 0 2024-09-17T01:06:52.842 INFO:tasks.workunit.client.1.smithi143.stdout:2/93: dwrite d0/d10/f17 [0,4194304] 0 2024-09-17T01:06:52.843 INFO:tasks.workunit.client.1.smithi143.stdout:2/94: chown d0/c1c 434807 1 2024-09-17T01:06:52.844 INFO:tasks.workunit.client.1.smithi143.stdout:6/69: dread d2/d7/f8 [0,4194304] 0 2024-09-17T01:06:52.845 INFO:tasks.workunit.client.1.smithi143.stdout:6/70: readlink d2/d7/le 0 2024-09-17T01:06:52.912 INFO:tasks.workunit.client.1.smithi143.stdout:8/82: sync 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.917+0000 7fabcba9c640 1 -- 172.21.15.103:0/3750491871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 msgr2=0x7fabc40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 --2- 172.21.15.103:0/3750491871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc40feea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009880 tx=0x7fabc002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- 172.21.15.103:0/3750491871 shutdown_connections 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 --2- 172.21.15.103:0/3750491871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40ffca0 0x7fabc4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 --2- 172.21.15.103:0/3750491871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc40feea0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- 172.21.15.103:0/3750491871 >> 172.21.15.103:0/3750491871 conn(0x7fabc40fa230 msgr2=0x7fabc40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- 172.21.15.103:0/3750491871 shutdown_connections 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- 172.21.15.103:0/3750491871 wait complete. 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 Processor -- start 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- start start 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc41956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40ffca0 0x7fabc4195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc41961f0 con 0x7fabc40feaa0 2024-09-17T01:06:52.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.918+0000 7fabcba9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4196360 con 0x7fabc40ffca0 2024-09-17T01:06:52.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc41956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc41956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46150/0 (socket says 172.21.15.103:46150) 2024-09-17T01:06:52.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 -- 172.21.15.103:0/2765037116 learned_addr learned my addr 172.21.15.103:0/2765037116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:52.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9037640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40ffca0 0x7fabc4195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.920 INFO:tasks.workunit.client.1.smithi143.stdout:3/88: creat d6/d10/f15 x:0 0 0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 -- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40ffca0 msgr2=0x7fabc4195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40ffca0 0x7fabc4195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 -- 172.21.15.103:0/2765037116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009560 con 0x7fabc40feaa0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.919+0000 7fabc9838640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc41956e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fabc00054f0 tx=0x7fabc0005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.920+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabc0004aa0 con 0x7fabc40feaa0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.920+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabc0004c00 con 0x7fabc40feaa0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.920+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabc0003ac0 con 0x7fabc40feaa0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.920+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc419ad50 con 0x7fabc40feaa0 2024-09-17T01:06:52.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.920+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc419b180 con 0x7fabc40feaa0 2024-09-17T01:06:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.921+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc41076b0 con 0x7fabc40feaa0 2024-09-17T01:06:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.921+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fabc0003d30 con 0x7fabc40feaa0 2024-09-17T01:06:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.922+0000 7fabb6ffd640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fabb006d8a0 0x7fabb006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.922+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fabc00ae4f0 con 0x7fabc40feaa0 2024-09-17T01:06:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.922+0000 7fabc9037640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fabb006d8a0 0x7fabb006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.923+0000 7fabc9037640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fabb006d8a0 0x7fabb006fd60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fabc4196bb0 tx=0x7fabb800b390 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:52.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:52.926+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fabc0077b80 con 0x7fabc40feaa0 2024-09-17T01:06:52.956 INFO:tasks.workunit.client.1.smithi143.stdout:2/95: creat d0/d10/f1d x:0 0 0 2024-09-17T01:06:52.960 INFO:tasks.workunit.client.1.smithi143.stdout:6/71: rename d2/df/d12 to d2/df/d18 0 2024-09-17T01:06:52.961 INFO:tasks.workunit.client.1.smithi143.stdout:8/83: mknod d9/de/c22 0 2024-09-17T01:06:52.964 INFO:tasks.workunit.client.1.smithi143.stdout:4/157: rename da/f26 to da/f32 0 2024-09-17T01:06:52.966 INFO:tasks.workunit.client.1.smithi143.stdout:3/89: creat d6/d10/f16 x:0 0 0 2024-09-17T01:06:52.968 INFO:tasks.workunit.client.1.smithi143.stdout:1/129: symlink d0/l26 0 2024-09-17T01:06:52.970 INFO:tasks.workunit.client.1.smithi143.stdout:3/90: dread d6/d10/f11 [0,4194304] 0 2024-09-17T01:06:52.972 INFO:tasks.workunit.client.1.smithi143.stdout:2/96: readlink d0/l7 0 2024-09-17T01:06:52.975 INFO:tasks.workunit.client.1.smithi143.stdout:6/72: mkdir d2/d19 0 2024-09-17T01:06:52.975 INFO:tasks.workunit.client.1.smithi143.stdout:1/130: dwrite d0/d6/d7/de/f14 [0,4194304] 0 2024-09-17T01:06:52.976 INFO:tasks.workunit.client.1.smithi143.stdout:6/73: write d2/df/f14 [35296,30896] 0 2024-09-17T01:06:52.977 INFO:tasks.workunit.client.1.smithi143.stdout:8/84: mkdir d9/d23 0 2024-09-17T01:06:52.983 INFO:tasks.workunit.client.1.smithi143.stdout:7/153: sync 2024-09-17T01:06:52.987 INFO:tasks.workunit.client.1.smithi143.stdout:9/87: getdents d3/d7 0 2024-09-17T01:06:52.988 INFO:tasks.workunit.client.1.smithi143.stdout:0/133: dwrite d3/d5/f9 [0,4194304] 0 2024-09-17T01:06:52.989 INFO:tasks.workunit.client.1.smithi143.stdout:3/91: chown d6/lb 34 1 2024-09-17T01:06:52.991 INFO:tasks.workunit.client.1.smithi143.stdout:6/74: creat d2/df/f1a x:0 0 0 2024-09-17T01:06:52.998 INFO:tasks.workunit.client.1.smithi143.stdout:9/88: dread d3/f15 [0,4194304] 0 2024-09-17T01:06:52.998 INFO:tasks.workunit.client.1.smithi143.stdout:2/97: mknod d0/c1e 0 2024-09-17T01:06:53.002 INFO:tasks.workunit.client.1.smithi143.stdout:8/85: mknod d9/d23/c24 0 2024-09-17T01:06:53.004 INFO:tasks.workunit.client.1.smithi143.stdout:8/86: write d9/de/f10 [335053,111667] 0 2024-09-17T01:06:53.004 INFO:tasks.workunit.client.1.smithi143.stdout:9/89: mknod d3/d7/c21 0 2024-09-17T01:06:53.005 INFO:tasks.workunit.client.1.smithi143.stdout:2/98: dwrite d0/d2/fb [4194304,4194304] 0 2024-09-17T01:06:53.005 INFO:tasks.workunit.client.1.smithi143.stdout:9/90: readlink d3/l13 0 2024-09-17T01:06:53.005 INFO:tasks.workunit.client.1.smithi143.stdout:8/87: chown c3 1084 1 2024-09-17T01:06:53.006 INFO:tasks.workunit.client.1.smithi143.stdout:0/134: mknod d3/d5/d8/c2c 0 2024-09-17T01:06:53.009 INFO:tasks.workunit.client.1.smithi143.stdout:6/75: creat d2/d19/f1b x:0 0 0 2024-09-17T01:06:53.011 INFO:tasks.workunit.client.1.smithi143.stdout:2/99: mknod d0/d2/c1f 0 2024-09-17T01:06:53.011 INFO:tasks.workunit.client.1.smithi143.stdout:9/91: creat d3/d16/f22 x:0 0 0 2024-09-17T01:06:53.011 INFO:tasks.workunit.client.1.smithi143.stdout:6/76: write d2/df/f1a [283749,70617] 0 2024-09-17T01:06:53.013 INFO:tasks.workunit.client.1.smithi143.stdout:3/92: rename l4 to d6/l17 0 2024-09-17T01:06:53.013 INFO:tasks.workunit.client.1.smithi143.stdout:6/77: readlink d2/d7/le 0 2024-09-17T01:06:53.015 INFO:tasks.workunit.client.1.smithi143.stdout:4/158: getdents da 0 2024-09-17T01:06:53.015 INFO:tasks.workunit.client.1.smithi143.stdout:0/135: symlink d3/d14/l2d 0 2024-09-17T01:06:53.016 INFO:tasks.workunit.client.1.smithi143.stdout:8/88: dread f7 [0,4194304] 0 2024-09-17T01:06:53.017 INFO:tasks.workunit.client.1.smithi143.stdout:0/136: write d3/d5/d8/d10/f24 [975932,124312] 0 2024-09-17T01:06:53.018 INFO:tasks.workunit.client.1.smithi143.stdout:8/89: truncate d9/fc 623424 0 2024-09-17T01:06:53.018 INFO:tasks.workunit.client.1.smithi143.stdout:8/90: stat d9/l1c 0 2024-09-17T01:06:53.019 INFO:tasks.workunit.client.1.smithi143.stdout:2/100: creat d0/d10/f20 x:0 0 0 2024-09-17T01:06:53.021 INFO:tasks.workunit.client.1.smithi143.stdout:7/154: rename d4/f14 to d4/d1f/d29/f35 0 2024-09-17T01:06:53.021 INFO:tasks.workunit.client.1.smithi143.stdout:8/91: dread d9/fa [0,4194304] 0 2024-09-17T01:06:53.022 INFO:tasks.workunit.client.1.smithi143.stdout:3/93: chown d6/f7 3 1 2024-09-17T01:06:53.023 INFO:tasks.workunit.client.1.smithi143.stdout:6/78: truncate d2/d7/f8 2929858 0 2024-09-17T01:06:53.024 INFO:tasks.workunit.client.1.smithi143.stdout:4/159: symlink da/d22/l33 0 2024-09-17T01:06:53.026 INFO:tasks.workunit.client.1.smithi143.stdout:0/137: rmdir d3/d5/d8/d27 39 2024-09-17T01:06:53.028 INFO:tasks.workunit.client.1.smithi143.stdout:7/155: dwrite d4/f1b [0,4194304] 0 2024-09-17T01:06:53.029 INFO:tasks.workunit.client.1.smithi143.stdout:4/160: dread f2 [0,4194304] 0 2024-09-17T01:06:53.029 INFO:tasks.workunit.client.1.smithi143.stdout:2/101: mkdir d0/d2/d21 0 2024-09-17T01:06:53.030 INFO:tasks.workunit.client.1.smithi143.stdout:2/102: chown d0/d2/fe 933013 1 2024-09-17T01:06:53.031 INFO:tasks.workunit.client.1.smithi143.stdout:0/138: truncate d3/d5/d8/d21/f26 506891 0 2024-09-17T01:06:53.031 INFO:tasks.workunit.client.1.smithi143.stdout:3/94: chown d6/d10 43739 1 2024-09-17T01:06:53.032 INFO:tasks.workunit.client.1.smithi143.stdout:4/161: dread da/d22/f27 [0,4194304] 0 2024-09-17T01:06:53.033 INFO:tasks.workunit.client.1.smithi143.stdout:6/79: creat d2/f1c x:0 0 0 2024-09-17T01:06:53.041 INFO:tasks.workunit.client.1.smithi143.stdout:2/103: dread d0/f1a [0,4194304] 0 2024-09-17T01:06:53.041 INFO:tasks.workunit.client.1.smithi143.stdout:2/104: dread - d0/d10/f1d zero size 2024-09-17T01:06:53.043 INFO:tasks.workunit.client.1.smithi143.stdout:0/139: read - d3/d5/d8/d27/f2b zero size 2024-09-17T01:06:53.046 INFO:tasks.workunit.client.1.smithi143.stdout:6/80: creat d2/dc/f1d x:0 0 0 2024-09-17T01:06:53.048 INFO:tasks.workunit.client.1.smithi143.stdout:7/156: symlink d4/d33/l36 0 2024-09-17T01:06:53.051 INFO:tasks.workunit.client.1.smithi143.stdout:2/105: dwrite d0/f1a [0,4194304] 0 2024-09-17T01:06:53.057 INFO:tasks.workunit.client.1.smithi143.stdout:0/140: mkdir d3/d5/d8/d21/d2e 0 2024-09-17T01:06:53.057 INFO:tasks.workunit.client.1.smithi143.stdout:5/216: sync 2024-09-17T01:06:53.057 INFO:tasks.workunit.client.1.smithi143.stdout:9/92: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:06:53.058 INFO:tasks.workunit.client.1.smithi143.stdout:6/81: mknod d2/d19/c1e 0 2024-09-17T01:06:53.062 INFO:tasks.workunit.client.1.smithi143.stdout:5/217: chown d1/d46/df/d1f/c2e 850 1 2024-09-17T01:06:53.063 INFO:tasks.workunit.client.1.smithi143.stdout:7/157: symlink d4/d16/l37 0 2024-09-17T01:06:53.065 INFO:tasks.workunit.client.1.smithi143.stdout:7/158: chown d4/c1c 585969 1 2024-09-17T01:06:53.068 INFO:tasks.workunit.client.1.smithi143.stdout:8/92: dwrite d9/de/f21 [0,4194304] 0 2024-09-17T01:06:53.069 INFO:tasks.workunit.client.1.smithi143.stdout:9/93: dread d3/f15 [0,4194304] 0 2024-09-17T01:06:53.070 INFO:tasks.workunit.client.1.smithi143.stdout:2/106: write d0/d2/fe [2031766,63839] 0 2024-09-17T01:06:53.071 INFO:tasks.workunit.client.1.smithi143.stdout:0/141: symlink d3/d5/d8/d10/l2f 0 2024-09-17T01:06:53.080 INFO:tasks.workunit.client.1.smithi143.stdout:3/95: rename d6/l17 to d6/l18 0 2024-09-17T01:06:53.082 INFO:tasks.workunit.client.1.smithi143.stdout:4/162: truncate da/f32 1180584 0 2024-09-17T01:06:53.082 INFO:tasks.workunit.client.1.smithi143.stdout:7/159: dwrite f2 [0,4194304] 0 2024-09-17T01:06:53.084 INFO:tasks.workunit.client.1.smithi143.stdout:6/82: getdents d2/d17 0 2024-09-17T01:06:53.085 INFO:tasks.workunit.client.1.smithi143.stdout:9/94: symlink d3/d16/l23 0 2024-09-17T01:06:53.087 INFO:tasks.workunit.client.1.smithi143.stdout:9/95: chown d3/d16/l23 19394 1 2024-09-17T01:06:53.088 INFO:tasks.workunit.client.1.smithi143.stdout:5/218: dwrite d1/f2b [0,4194304] 0 2024-09-17T01:06:53.100 INFO:tasks.workunit.client.1.smithi143.stdout:4/163: unlink da/f17 0 2024-09-17T01:06:53.103 INFO:tasks.workunit.client.1.smithi143.stdout:2/107: mkdir d0/d2/d21/d22 0 2024-09-17T01:06:53.104 INFO:tasks.workunit.client.1.smithi143.stdout:2/108: chown d0/c1c 739478927 1 2024-09-17T01:06:53.108 INFO:tasks.workunit.client.1.smithi143.stdout:7/160: dread d4/d1f/d29/f35 [0,4194304] 0 2024-09-17T01:06:53.108 INFO:tasks.workunit.client.1.smithi143.stdout:7/161: chown d4/d16/f17 189 1 2024-09-17T01:06:53.109 INFO:tasks.workunit.client.1.smithi143.stdout:7/162: write d4/f5 [2174325,48379] 0 2024-09-17T01:06:53.109 INFO:tasks.workunit.client.1.smithi143.stdout:6/83: rename d2/df/f14 to d2/f1f 0 2024-09-17T01:06:53.110 INFO:tasks.workunit.client.1.smithi143.stdout:7/163: write d4/f11 [213537,19001] 0 2024-09-17T01:06:53.113 INFO:tasks.workunit.client.1.smithi143.stdout:9/96: rmdir d3/d7 39 2024-09-17T01:06:53.114 INFO:tasks.workunit.client.1.smithi143.stdout:8/93: dwrite f7 [0,4194304] 0 2024-09-17T01:06:53.115 INFO:tasks.workunit.client.1.smithi143.stdout:6/84: dread d2/df/f1a [0,4194304] 0 2024-09-17T01:06:53.116 INFO:tasks.workunit.client.1.smithi143.stdout:8/94: truncate d9/de/f10 1383608 0 2024-09-17T01:06:53.116 INFO:tasks.workunit.client.1.smithi143.stdout:0/142: link d3/d5/f29 d3/d5/d8/d21/f30 0 2024-09-17T01:06:53.117 INFO:tasks.workunit.client.1.smithi143.stdout:8/95: fsync d9/fc 0 2024-09-17T01:06:53.121 INFO:tasks.workunit.client.1.smithi143.stdout:2/109: write d0/fc [1447392,99299] 0 2024-09-17T01:06:53.127 INFO:tasks.workunit.client.1.smithi143.stdout:2/110: dwrite d0/d2/f14 [0,4194304] 0 2024-09-17T01:06:53.131 INFO:tasks.workunit.client.1.smithi143.stdout:3/96: creat d6/f19 x:0 0 0 2024-09-17T01:06:53.134 INFO:tasks.workunit.client.1.smithi143.stdout:3/97: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:53.136 INFO:tasks.workunit.client.1.smithi143.stdout:6/85: mkdir d2/df/d20 0 2024-09-17T01:06:53.136 INFO:tasks.workunit.client.1.smithi143.stdout:6/86: fdatasync d2/f1c 0 2024-09-17T01:06:53.137 INFO:tasks.workunit.client.1.smithi143.stdout:6/87: write d2/f16 [39873,124552] 0 2024-09-17T01:06:53.142 INFO:tasks.workunit.client.1.smithi143.stdout:0/143: mkdir d3/d5/d8/d27/d31 0 2024-09-17T01:06:53.146 INFO:tasks.workunit.client.1.smithi143.stdout:8/96: dwrite d9/fa [0,4194304] 0 2024-09-17T01:06:53.147 INFO:tasks.workunit.client.1.smithi143.stdout:8/97: write f7 [3719510,9467] 0 2024-09-17T01:06:53.153 INFO:tasks.workunit.client.1.smithi143.stdout:8/98: dread d9/de/f10 [0,4194304] 0 2024-09-17T01:06:53.154 INFO:tasks.workunit.client.1.smithi143.stdout:4/164: read - da/f2a zero size 2024-09-17T01:06:53.158 INFO:tasks.workunit.client.1.smithi143.stdout:3/98: readlink d6/lb 0 2024-09-17T01:06:53.160 INFO:tasks.workunit.client.1.smithi143.stdout:6/88: rename d2/f1c to d2/df/d18/f21 0 2024-09-17T01:06:53.163 INFO:tasks.workunit.client.1.smithi143.stdout:0/144: mkdir d3/d14/d32 0 2024-09-17T01:06:53.163 INFO:tasks.workunit.client.1.smithi143.stdout:0/145: chown d3/d5/d8/d10/l23 59 1 2024-09-17T01:06:53.164 INFO:tasks.workunit.client.1.smithi143.stdout:0/146: write d3/d5/d8/d27/f2b [227899,14271] 0 2024-09-17T01:06:53.166 INFO:tasks.workunit.client.1.smithi143.stdout:2/111: mknod d0/c23 0 2024-09-17T01:06:53.168 INFO:tasks.workunit.client.1.smithi143.stdout:2/112: fdatasync d0/f1a 0 2024-09-17T01:06:53.168 INFO:tasks.workunit.client.1.smithi143.stdout:0/147: dread d3/d5/d8/d27/f2b [0,4194304] 0 2024-09-17T01:06:53.169 INFO:tasks.workunit.client.1.smithi143.stdout:8/99: mkdir d9/d12/d13/d25 0 2024-09-17T01:06:53.169 INFO:tasks.workunit.client.1.smithi143.stdout:8/100: chown c8 1800 1 2024-09-17T01:06:53.174 INFO:tasks.workunit.client.1.smithi143.stdout:0/148: dwrite d3/d5/d8/d27/f1c [0,4194304] 0 2024-09-17T01:06:53.175 INFO:tasks.workunit.client.1.smithi143.stdout:0/149: write d3/d5/d8/d27/f18 [1467226,119429] 0 2024-09-17T01:06:53.179 INFO:tasks.workunit.client.1.smithi143.stdout:1/131: sync 2024-09-17T01:06:53.184 INFO:tasks.workunit.client.1.smithi143.stdout:4/165: creat da/d22/f34 x:0 0 0 2024-09-17T01:06:53.189 INFO:tasks.workunit.client.1.smithi143.stdout:7/164: getdents d4/d1f/d29 0 2024-09-17T01:06:53.189 INFO:tasks.workunit.client.1.smithi143.stdout:7/165: dread - d4/d1f/f28 zero size 2024-09-17T01:06:53.191 INFO:tasks.workunit.client.1.smithi143.stdout:8/101: mkdir d9/d26 0 2024-09-17T01:06:53.192 INFO:tasks.workunit.client.1.smithi143.stdout:8/102: write d9/fa [4503854,53780] 0 2024-09-17T01:06:53.194 INFO:tasks.workunit.client.1.smithi143.stdout:9/97: getdents d3/d16 0 2024-09-17T01:06:53.198 INFO:tasks.workunit.client.1.smithi143.stdout:0/150: mknod d3/d5/d8/d21/c33 0 2024-09-17T01:06:53.199 INFO:tasks.workunit.client.1.smithi143.stdout:0/151: dread - d3/d14/d17/f28 zero size 2024-09-17T01:06:53.201 INFO:tasks.workunit.client.1.smithi143.stdout:1/132: mkdir d0/d6/d7/df/d27 0 2024-09-17T01:06:53.203 INFO:tasks.workunit.client.1.smithi143.stdout:2/113: mkdir d0/d2/d21/d22/d24 0 2024-09-17T01:06:53.204 INFO:tasks.workunit.client.1.smithi143.stdout:3/99: write d6/fa [1017670,88712] 0 2024-09-17T01:06:53.205 INFO:tasks.workunit.client.1.smithi143.stdout:3/100: fsync d6/d10/f16 0 2024-09-17T01:06:53.205 INFO:tasks.workunit.client.1.smithi143.stdout:7/166: creat d4/d16/f38 x:0 0 0 2024-09-17T01:06:53.206 INFO:tasks.workunit.client.1.smithi143.stdout:3/101: write d6/fa [734862,49592] 0 2024-09-17T01:06:53.207 INFO:tasks.workunit.client.1.smithi143.stdout:8/103: rmdir d9/d23 39 2024-09-17T01:06:53.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/167: dread d4/fd [0,4194304] 0 2024-09-17T01:06:53.208 INFO:tasks.workunit.client.1.smithi143.stdout:5/219: sync 2024-09-17T01:06:53.209 INFO:tasks.workunit.client.1.smithi143.stdout:8/104: write d9/d12/f18 [1891615,31942] 0 2024-09-17T01:06:53.210 INFO:tasks.workunit.client.1.smithi143.stdout:7/168: read d4/f10 [460354,103669] 0 2024-09-17T01:06:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.212+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fabc419b4b0 con 0x7fabb006d8a0 2024-09-17T01:06:53.211 INFO:tasks.workunit.client.1.smithi143.stdout:7/169: dread - d4/d26/f2b zero size 2024-09-17T01:06:53.212 INFO:tasks.workunit.client.1.smithi143.stdout:7/170: dread - d4/d26/f2b zero size 2024-09-17T01:06:53.213 INFO:tasks.workunit.client.1.smithi143.stdout:7/171: readlink d4/d26/l25 0 2024-09-17T01:06:53.214 INFO:tasks.workunit.client.1.smithi143.stdout:8/105: dread d9/fa [0,4194304] 0 2024-09-17T01:06:53.215 INFO:tasks.workunit.client.1.smithi143.stdout:7/172: read - d4/d26/f2d zero size 2024-09-17T01:06:53.215 INFO:tasks.workunit.client.1.smithi143.stdout:3/102: creat d6/d10/f1a x:0 0 0 2024-09-17T01:06:53.217 INFO:tasks.workunit.client.1.smithi143.stdout:7/173: write d4/d26/f22 [775441,102135] 0 2024-09-17T01:06:53.218 INFO:tasks.workunit.client.1.smithi143.stdout:9/98: creat d3/d7/d9/f24 x:0 0 0 2024-09-17T01:06:53.219 INFO:tasks.workunit.client.1.smithi143.stdout:6/89: getdents d2/df/d18 0 2024-09-17T01:06:53.219 INFO:tasks.workunit.client.1.smithi143.stdout:0/152: link d3/d14/d17/f1d d3/d5/f34 0 2024-09-17T01:06:53.220 INFO:tasks.workunit.client.1.smithi143.stdout:7/174: read f2 [1695723,112236] 0 2024-09-17T01:06:53.220 INFO:tasks.workunit.client.1.smithi143.stdout:1/133: getdents d0/d6/d7/de/d18 0 2024-09-17T01:06:53.221 INFO:tasks.workunit.client.1.smithi143.stdout:6/90: readlink d2/d7/le 0 2024-09-17T01:06:53.223 INFO:tasks.workunit.client.1.smithi143.stdout:8/106: mkdir d9/d26/d27 0 2024-09-17T01:06:53.223 INFO:tasks.workunit.client.1.smithi143.stdout:2/114: dread d0/d10/f11 [0,4194304] 0 2024-09-17T01:06:53.223 INFO:tasks.workunit.client.1.smithi143.stdout:4/166: getdents da/d22 0 2024-09-17T01:06:53.224 INFO:tasks.workunit.client.1.smithi143.stdout:7/175: read - d4/d26/f2b zero size 2024-09-17T01:06:53.225 INFO:tasks.workunit.client.1.smithi143.stdout:5/220: link d1/c2c d1/d46/df/d23/c57 0 2024-09-17T01:06:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.227+0000 7fabb6ffd640 1 -- 172.21.15.103:0/2765037116 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fabc419b4b0 con 0x7fabb006d8a0 2024-09-17T01:06:53.226 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:06:53.226 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (6m) 2m ago 7m 25.2M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:06:53.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (8m) 2m ago 8m 7558k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (7m) 1s ago 7m 7578k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (7m) 2m ago 7m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (7m) 1s ago 7m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (6m) 2m ago 7m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (2m) 2m ago 2m 16.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (2m) 2m ago 2m 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (2m) 1s ago 2m 13.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (2m) 1s ago 2m 15.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:9283,8765,8443 running (9m) 2m ago 9m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 29c1c8578f11 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (35s) 1s ago 6m 479M - 19.1.1-330-gc2ddf972 ebb0615149de e4a4ae03730a 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (9m) 2m ago 9m 45.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (6m) 1s ago 6m 40.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:06:53.227 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (7m) 2m ago 7m 16.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (6m) 1s ago 6m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (6m) 2m ago 6m 50.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (5m) 2m ago 5m 47.0M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (5m) 2m ago 5m 52.9M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (4m) 1s ago 4m 135M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (4m) 1s ago 4m 124M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (3m) 1s ago 3m 126M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:06:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (6m) 2m ago 7m 55.0M - 2.43.0 a07b618ecd1d e84d3109ab0e 2024-09-17T01:06:53.229 INFO:tasks.workunit.client.1.smithi143.stdout:0/153: dread d3/d5/f29 [0,4194304] 0 2024-09-17T01:06:53.229 INFO:tasks.workunit.client.1.smithi143.stdout:9/99: mknod d3/d7/c25 0 2024-09-17T01:06:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fabb006d8a0 msgr2=0x7fabb006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fabb006d8a0 0x7fabb006fd60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fabc4196bb0 tx=0x7fabb800b390 comp rx=0 tx=0).stop 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 msgr2=0x7fabc41956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc41956e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fabc00054f0 tx=0x7fabc0005520 comp rx=0 tx=0).stop 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 shutdown_connections 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fabb006d8a0 0x7fabb006fd60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40ffca0 0x7fabc4195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 --2- 172.21.15.103:0/2765037116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabc40feaa0 0x7fabc41956e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.229+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 >> 172.21.15.103:0/2765037116 conn(0x7fabc40fa230 msgr2=0x7fabc40684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.230+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 shutdown_connections 2024-09-17T01:06:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.230+0000 7fabcba9c640 1 -- 172.21.15.103:0/2765037116 wait complete. 2024-09-17T01:06:53.239 INFO:tasks.workunit.client.1.smithi143.stdout:1/134: creat d0/d6/d7/de/d2/f28 x:0 0 0 2024-09-17T01:06:53.240 INFO:tasks.workunit.client.1.smithi143.stdout:5/221: write d1/d46/df/f45 [444080,120404] 0 2024-09-17T01:06:53.241 INFO:tasks.workunit.client.1.smithi143.stdout:0/154: truncate d3/d5/f9 4687419 0 2024-09-17T01:06:53.243 INFO:tasks.workunit.client.1.smithi143.stdout:9/100: mkdir d3/d7/d26 0 2024-09-17T01:06:53.243 INFO:tasks.workunit.client.1.smithi143.stdout:3/103: dwrite d6/f19 [0,4194304] 0 2024-09-17T01:06:53.244 INFO:tasks.workunit.client.1.smithi143.stdout:1/135: write d0/d6/f1f [1281550,55986] 0 2024-09-17T01:06:53.247 INFO:tasks.workunit.client.1.smithi143.stdout:6/91: dread d2/fb [0,4194304] 0 2024-09-17T01:06:53.247 INFO:tasks.workunit.client.1.smithi143.stdout:8/107: rmdir d9/de/d1e 0 2024-09-17T01:06:53.248 INFO:tasks.workunit.client.1.smithi143.stdout:9/101: unlink d3/d7/l1f 0 2024-09-17T01:06:53.249 INFO:tasks.workunit.client.1.smithi143.stdout:1/136: creat d0/d6/f29 x:0 0 0 2024-09-17T01:06:53.249 INFO:tasks.workunit.client.1.smithi143.stdout:3/104: mknod d6/d10/c1b 0 2024-09-17T01:06:53.250 INFO:tasks.workunit.client.1.smithi143.stdout:6/92: truncate d2/f1f 429530 0 2024-09-17T01:06:53.250 INFO:tasks.workunit.client.1.smithi143.stdout:9/102: chown d3/d16/f22 0 1 2024-09-17T01:06:53.251 INFO:tasks.workunit.client.1.smithi143.stdout:5/222: rename d1/d46/df/d1f/lc to d1/d46/d4c/l58 0 2024-09-17T01:06:53.251 INFO:tasks.workunit.client.1.smithi143.stdout:9/103: stat d3/d7/d26 0 2024-09-17T01:06:53.251 INFO:tasks.workunit.client.1.smithi143.stdout:6/93: chown d2/c4 0 1 2024-09-17T01:06:53.251 INFO:tasks.workunit.client.1.smithi143.stdout:4/167: link da/l16 da/d22/l35 0 2024-09-17T01:06:53.252 INFO:tasks.workunit.client.1.smithi143.stdout:0/155: truncate d3/d5/d8/d27/f2b 790219 0 2024-09-17T01:06:53.252 INFO:tasks.workunit.client.1.smithi143.stdout:5/223: fdatasync d1/d46/df/d23/d4f/f33 0 2024-09-17T01:06:53.252 INFO:tasks.workunit.client.1.smithi143.stdout:9/104: chown d3/f4 31 1 2024-09-17T01:06:53.253 INFO:tasks.workunit.client.1.smithi143.stdout:7/176: getdents d4/d1f 0 2024-09-17T01:06:53.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/224: dread - d1/f4d zero size 2024-09-17T01:06:53.257 INFO:tasks.workunit.client.1.smithi143.stdout:1/137: creat d0/d6/d7/de/d2/f2a x:0 0 0 2024-09-17T01:06:53.257 INFO:tasks.workunit.client.1.smithi143.stdout:0/156: truncate d3/d5/d8/d21/f26 1376497 0 2024-09-17T01:06:53.258 INFO:tasks.workunit.client.1.smithi143.stdout:4/168: fsync da/f11 0 2024-09-17T01:06:53.260 INFO:tasks.workunit.client.1.smithi143.stdout:7/177: creat d4/d33/f39 x:0 0 0 2024-09-17T01:06:53.265 INFO:tasks.workunit.client.1.smithi143.stdout:6/94: dwrite d2/df/d18/f21 [0,4194304] 0 2024-09-17T01:06:53.267 INFO:tasks.workunit.client.1.smithi143.stdout:4/169: creat da/d22/f36 x:0 0 0 2024-09-17T01:06:53.272 INFO:tasks.workunit.client.1.smithi143.stdout:1/138: mknod d0/c2b 0 2024-09-17T01:06:53.274 INFO:tasks.workunit.client.1.smithi143.stdout:4/170: creat da/d22/f37 x:0 0 0 2024-09-17T01:06:53.274 INFO:tasks.workunit.client.1.smithi143.stdout:6/95: chown d2/d7/f8 0 1 2024-09-17T01:06:53.275 INFO:tasks.workunit.client.1.smithi143.stdout:1/139: write d0/d6/fd [3080717,18903] 0 2024-09-17T01:06:53.276 INFO:tasks.workunit.client.1.smithi143.stdout:8/108: dwrite d9/fa [0,4194304] 0 2024-09-17T01:06:53.277 INFO:tasks.workunit.client.1.smithi143.stdout:1/140: readlink d0/l26 0 2024-09-17T01:06:53.279 INFO:tasks.workunit.client.1.smithi143.stdout:3/105: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:53.288 INFO:tasks.workunit.client.1.smithi143.stdout:4/171: dwrite da/f2a [0,4194304] 0 2024-09-17T01:06:53.297 INFO:tasks.workunit.client.1.smithi143.stdout:4/172: dwrite da/d22/f34 [0,4194304] 0 2024-09-17T01:06:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 -- 172.21.15.103:0/1810570711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 msgr2=0x7f6a40105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/1810570711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40105350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098b0 tx=0x7f6a3402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 -- 172.21.15.103:0/1810570711 shutdown_connections 2024-09-17T01:06:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/1810570711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40105350 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/1810570711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a40100630 0x7f6a40102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 -- 172.21.15.103:0/1810570711 >> 172.21.15.103:0/1810570711 conn(0x7f6a400fa230 msgr2=0x7f6a400fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 -- 172.21.15.103:0/1810570711 shutdown_connections 2024-09-17T01:06:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.323+0000 7f6a44d2f640 1 -- 172.21.15.103:0/1810570711 wait complete. 2024-09-17T01:06:53.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a44d2f640 1 Processor -- start 2024-09-17T01:06:53.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a44d2f640 1 -- start start 2024-09-17T01:06:53.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a44d2f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a40100630 0x7f6a40195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:53.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a44d2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:53.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a44d2f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40196150 con 0x7f6a40102f60 2024-09-17T01:06:53.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a44d2f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a401962c0 con 0x7f6a40100630 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a40100630 0x7f6a40195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46162/0 (socket says 172.21.15.103:46162) 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3dd9b640 1 -- 172.21.15.103:0/4001987992 learned_addr learned my addr 172.21.15.103:0/4001987992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3dd9b640 1 -- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a40100630 msgr2=0x7f6a40195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3dd9b640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a40100630 0x7f6a40195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.324+0000 7f6a3dd9b640 1 -- 172.21.15.103:0/4001987992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009560 con 0x7f6a40102f60 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.325+0000 7f6a3dd9b640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40195b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6a340055a0 tx=0x7f6a340055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.325+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a34004aa0 con 0x7f6a40102f60 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.325+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a34004c00 con 0x7f6a40102f60 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.325+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4019ad00 con 0x7f6a40102f60 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.325+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a34003b50 con 0x7f6a40102f60 2024-09-17T01:06:53.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.325+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4019b1f0 con 0x7f6a40102f60 2024-09-17T01:06:53.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.326+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a40108790 con 0x7f6a40102f60 2024-09-17T01:06:53.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.326+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f6a34003cb0 con 0x7f6a40102f60 2024-09-17T01:06:53.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.327+0000 7f6a2f7fe640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f6a2806d8a0 0x7f6a2806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:53.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.327+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f6a340ae5a0 con 0x7f6a40102f60 2024-09-17T01:06:53.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.327+0000 7f6a3e59c640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f6a2806d8a0 0x7f6a2806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:53.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.327+0000 7f6a3e59c640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f6a2806d8a0 0x7f6a2806fd60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005d00 tx=0x7f6a3000b410 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:53.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.331+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f6a34077bb0 con 0x7f6a40102f60 2024-09-17T01:06:53.359 INFO:tasks.workunit.client.1.smithi143.stdout:2/115: sync 2024-09-17T01:06:53.392 INFO:tasks.workunit.client.1.smithi143.stdout:9/105: link d3/f4 d3/d7/d9/f27 0 2024-09-17T01:06:53.392 INFO:tasks.workunit.client.1.smithi143.stdout:9/106: chown d3/d16 0 1 2024-09-17T01:06:53.395 INFO:tasks.workunit.client.1.smithi143.stdout:7/178: mkdir d4/d3a 0 2024-09-17T01:06:53.396 INFO:tasks.workunit.client.1.smithi143.stdout:5/225: creat d1/f59 x:0 0 0 2024-09-17T01:06:53.398 INFO:tasks.workunit.client.1.smithi143.stdout:9/107: dread d3/f8 [0,4194304] 0 2024-09-17T01:06:53.399 INFO:tasks.workunit.client.1.smithi143.stdout:1/141: creat d0/dc/f2c x:0 0 0 2024-09-17T01:06:53.401 INFO:tasks.workunit.client.1.smithi143.stdout:4/173: mknod da/d22/c38 0 2024-09-17T01:06:53.401 INFO:tasks.workunit.client.1.smithi143.stdout:2/116: mknod d0/d2/c25 0 2024-09-17T01:06:53.403 INFO:tasks.workunit.client.1.smithi143.stdout:5/226: symlink d1/d46/df/l5a 0 2024-09-17T01:06:53.404 INFO:tasks.workunit.client.1.smithi143.stdout:6/96: truncate d2/fa 281979 0 2024-09-17T01:06:53.407 INFO:tasks.workunit.client.1.smithi143.stdout:3/106: mkdir d6/d1c 0 2024-09-17T01:06:53.410 INFO:tasks.workunit.client.1.smithi143.stdout:4/174: stat da/f2e 0 2024-09-17T01:06:53.411 INFO:tasks.workunit.client.1.smithi143.stdout:0/157: dwrite d3/d5/d8/d27/f1e [0,4194304] 0 2024-09-17T01:06:53.412 INFO:tasks.workunit.client.1.smithi143.stdout:2/117: rmdir d0 39 2024-09-17T01:06:53.413 INFO:tasks.workunit.client.1.smithi143.stdout:7/179: truncate d4/fd 986579 0 2024-09-17T01:06:53.414 INFO:tasks.workunit.client.1.smithi143.stdout:8/109: dwrite d9/f11 [0,4194304] 0 2024-09-17T01:06:53.415 INFO:tasks.workunit.client.1.smithi143.stdout:6/97: creat d2/dc/f22 x:0 0 0 2024-09-17T01:06:53.417 INFO:tasks.workunit.client.1.smithi143.stdout:5/227: symlink d1/d46/df/d53/l5b 0 2024-09-17T01:06:53.418 INFO:tasks.workunit.client.1.smithi143.stdout:6/98: readlink d2/df/l15 0 2024-09-17T01:06:53.418 INFO:tasks.workunit.client.1.smithi143.stdout:1/142: dread d0/d6/d7/de/f14 [0,4194304] 0 2024-09-17T01:06:53.418 INFO:tasks.workunit.client.1.smithi143.stdout:0/158: read d3/d5/f34 [810071,110068] 0 2024-09-17T01:06:53.419 INFO:tasks.workunit.client.1.smithi143.stdout:7/180: read - d4/d1f/f28 zero size 2024-09-17T01:06:53.421 INFO:tasks.workunit.client.1.smithi143.stdout:4/175: creat da/d22/f39 x:0 0 0 2024-09-17T01:06:53.422 INFO:tasks.workunit.client.1.smithi143.stdout:1/143: chown d0/d6/f1f 51006 1 2024-09-17T01:06:53.423 INFO:tasks.workunit.client.1.smithi143.stdout:6/99: mkdir d2/d19/d23 0 2024-09-17T01:06:53.423 INFO:tasks.workunit.client.1.smithi143.stdout:0/159: mkdir d3/d5/d35 0 2024-09-17T01:06:53.423 INFO:tasks.workunit.client.1.smithi143.stdout:4/176: read da/f11 [158733,32623] 0 2024-09-17T01:06:53.425 INFO:tasks.workunit.client.1.smithi143.stdout:6/100: readlink d2/df/l15 0 2024-09-17T01:06:53.425 INFO:tasks.workunit.client.1.smithi143.stdout:8/110: dread d9/de/f10 [0,4194304] 0 2024-09-17T01:06:53.426 INFO:tasks.workunit.client.1.smithi143.stdout:9/108: link l0 d3/d7/d9/l28 0 2024-09-17T01:06:53.426 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:53 smithi143 ceph-mon[35452]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 18 MiB/s wr, 242 op/s 2024-09-17T01:06:53.426 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:53 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.426 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:53 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.426 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:53 smithi143 ceph-mon[35452]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:53.426 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:53 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.426 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:53 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:53 smithi103 ceph-mon[28156]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 18 MiB/s wr, 242 op/s 2024-09-17T01:06:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:53 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:53 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:53 smithi103 ceph-mon[28156]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:53 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:53 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:06:53.427 INFO:tasks.workunit.client.1.smithi143.stdout:3/107: rename d6/d10/l12 to d6/l1d 0 2024-09-17T01:06:53.428 INFO:tasks.workunit.client.1.smithi143.stdout:2/118: unlink d0/c15 0 2024-09-17T01:06:53.428 INFO:tasks.workunit.client.1.smithi143.stdout:0/160: chown d3/d5/d8/d27/f1e 13752021 1 2024-09-17T01:06:53.429 INFO:tasks.workunit.client.1.smithi143.stdout:6/101: rmdir d2/dc 39 2024-09-17T01:06:53.429 INFO:tasks.workunit.client.1.smithi143.stdout:8/111: unlink d9/c17 0 2024-09-17T01:06:53.429 INFO:tasks.workunit.client.1.smithi143.stdout:3/108: dread - d6/d10/f16 zero size 2024-09-17T01:06:53.432 INFO:tasks.workunit.client.1.smithi143.stdout:9/109: chown d3/d7/d9/f27 2 1 2024-09-17T01:06:53.434 INFO:tasks.workunit.client.1.smithi143.stdout:3/109: unlink d6/d10/f13 0 2024-09-17T01:06:53.438 INFO:tasks.workunit.client.1.smithi143.stdout:6/102: creat d2/dc/f24 x:0 0 0 2024-09-17T01:06:53.439 INFO:tasks.workunit.client.1.smithi143.stdout:0/161: dread d3/d5/d8/d10/f24 [0,4194304] 0 2024-09-17T01:06:53.440 INFO:tasks.workunit.client.1.smithi143.stdout:9/110: write d3/d7/f12 [1372178,15201] 0 2024-09-17T01:06:53.440 INFO:tasks.workunit.client.1.smithi143.stdout:7/181: write d4/fd [1099758,75408] 0 2024-09-17T01:06:53.441 INFO:tasks.workunit.client.1.smithi143.stdout:1/144: dwrite d0/d6/d7/de/d2/f2a [0,4194304] 0 2024-09-17T01:06:53.448 INFO:tasks.workunit.client.1.smithi143.stdout:6/103: chown d2/df/d18/f21 117679 1 2024-09-17T01:06:53.449 INFO:tasks.workunit.client.1.smithi143.stdout:2/119: dread d0/d10/f17 [0,4194304] 0 2024-09-17T01:06:53.450 INFO:tasks.workunit.client.1.smithi143.stdout:7/182: symlink d4/d16/l3b 0 2024-09-17T01:06:53.450 INFO:tasks.workunit.client.1.smithi143.stdout:0/162: mknod d3/d5/d35/c36 0 2024-09-17T01:06:53.451 INFO:tasks.workunit.client.1.smithi143.stdout:8/112: dwrite d9/fc [0,4194304] 0 2024-09-17T01:06:53.451 INFO:tasks.workunit.client.1.smithi143.stdout:9/111: dread d3/f4 [0,4194304] 0 2024-09-17T01:06:53.451 INFO:tasks.workunit.client.1.smithi143.stdout:4/177: dwrite da/f2d [0,4194304] 0 2024-09-17T01:06:53.452 INFO:tasks.workunit.client.1.smithi143.stdout:1/145: fdatasync d0/d6/d7/de/f14 0 2024-09-17T01:06:53.454 INFO:tasks.workunit.client.1.smithi143.stdout:7/183: chown d4/ca 3378651 1 2024-09-17T01:06:53.456 INFO:tasks.workunit.client.1.smithi143.stdout:6/104: creat d2/d17/f25 x:0 0 0 2024-09-17T01:06:53.456 INFO:tasks.workunit.client.1.smithi143.stdout:2/120: fsync d0/d10/f11 0 2024-09-17T01:06:53.458 INFO:tasks.workunit.client.1.smithi143.stdout:3/110: dwrite d6/f19 [0,4194304] 0 2024-09-17T01:06:53.461 INFO:tasks.workunit.client.1.smithi143.stdout:2/121: chown d0/d2/d21/d22/d24 554473 1 2024-09-17T01:06:53.461 INFO:tasks.workunit.client.1.smithi143.stdout:6/105: truncate d2/f1f 1081453 0 2024-09-17T01:06:53.462 INFO:tasks.workunit.client.1.smithi143.stdout:9/112: mknod d3/d7/d9/c29 0 2024-09-17T01:06:53.464 INFO:tasks.workunit.client.1.smithi143.stdout:4/178: mkdir da/d3a 0 2024-09-17T01:06:53.465 INFO:tasks.workunit.client.1.smithi143.stdout:2/122: write d0/d2/fe [2614146,75367] 0 2024-09-17T01:06:53.467 INFO:tasks.workunit.client.1.smithi143.stdout:1/146: mkdir d0/d6/d7/de/d18/d2d 0 2024-09-17T01:06:53.469 INFO:tasks.workunit.client.1.smithi143.stdout:2/123: write d0/d2/fe [3364448,39824] 0 2024-09-17T01:06:53.470 INFO:tasks.workunit.client.1.smithi143.stdout:9/113: rename d3/d7/d9/f24 to d3/d7/f2a 0 2024-09-17T01:06:53.471 INFO:tasks.workunit.client.1.smithi143.stdout:3/111: truncate d6/d10/f11 1167326 0 2024-09-17T01:06:53.472 INFO:tasks.workunit.client.1.smithi143.stdout:1/147: write d0/d6/d7/de/f1d [5466903,41549] 0 2024-09-17T01:06:53.473 INFO:tasks.workunit.client.1.smithi143.stdout:4/179: creat da/d3a/f3b x:0 0 0 2024-09-17T01:06:53.477 INFO:tasks.workunit.client.1.smithi143.stdout:6/106: dwrite d2/d19/f1b [0,4194304] 0 2024-09-17T01:06:53.478 INFO:tasks.workunit.client.1.smithi143.stdout:4/180: chown da/d22/f27 7943 1 2024-09-17T01:06:53.479 INFO:tasks.workunit.client.1.smithi143.stdout:2/124: creat d0/d2/d21/d22/d24/f26 x:0 0 0 2024-09-17T01:06:53.482 INFO:tasks.workunit.client.1.smithi143.stdout:4/181: rmdir da/d22 39 2024-09-17T01:06:53.484 INFO:tasks.workunit.client.1.smithi143.stdout:1/148: creat d0/d6/d7/df/d27/f2e x:0 0 0 2024-09-17T01:06:53.485 INFO:tasks.workunit.client.1.smithi143.stdout:1/149: chown d0/d6 98954 1 2024-09-17T01:06:53.485 INFO:tasks.workunit.client.1.smithi143.stdout:8/113: truncate d9/de/f21 3307148 0 2024-09-17T01:06:53.486 INFO:tasks.workunit.client.1.smithi143.stdout:7/184: dwrite f2 [4194304,4194304] 0 2024-09-17T01:06:53.488 INFO:tasks.workunit.client.1.smithi143.stdout:7/185: dread - d4/d1f/f28 zero size 2024-09-17T01:06:53.488 INFO:tasks.workunit.client.1.smithi143.stdout:9/114: rename d3/d7 to d3/d16/d2b 0 2024-09-17T01:06:53.492 INFO:tasks.workunit.client.1.smithi143.stdout:6/107: fdatasync d2/fa 0 2024-09-17T01:06:53.496 INFO:tasks.workunit.client.1.smithi143.stdout:1/150: rmdir d0/d6/d7 39 2024-09-17T01:06:53.496 INFO:tasks.workunit.client.1.smithi143.stdout:0/163: dread d3/d5/d8/d27/f18 [0,4194304] 0 2024-09-17T01:06:53.497 INFO:tasks.workunit.client.1.smithi143.stdout:7/186: dread d4/f11 [0,4194304] 0 2024-09-17T01:06:53.497 INFO:tasks.workunit.client.1.smithi143.stdout:4/182: creat da/d22/f3c x:0 0 0 2024-09-17T01:06:53.497 INFO:tasks.workunit.client.1.smithi143.stdout:3/112: truncate d6/fa 740286 0 2024-09-17T01:06:53.499 INFO:tasks.workunit.client.1.smithi143.stdout:7/187: dread - d4/d26/f2d zero size 2024-09-17T01:06:53.501 INFO:tasks.workunit.client.1.smithi143.stdout:4/183: symlink da/d22/l3d 0 2024-09-17T01:06:53.501 INFO:tasks.workunit.client.1.smithi143.stdout:2/125: getdents d0 0 2024-09-17T01:06:53.502 INFO:tasks.workunit.client.1.smithi143.stdout:8/114: creat d9/f28 x:0 0 0 2024-09-17T01:06:53.505 INFO:tasks.workunit.client.1.smithi143.stdout:4/184: chown da/c18 7 1 2024-09-17T01:06:53.507 INFO:tasks.workunit.client.1.smithi143.stdout:0/164: dwrite d3/d5/d8/d27/f1c [0,4194304] 0 2024-09-17T01:06:53.509 INFO:tasks.workunit.client.1.smithi143.stdout:9/115: truncate d3/d16/d2b/fa 2711925 0 2024-09-17T01:06:53.509 INFO:tasks.workunit.client.1.smithi143.stdout:3/113: link d6/lb d6/d1c/l1e 0 2024-09-17T01:06:53.510 INFO:tasks.workunit.client.1.smithi143.stdout:4/185: write da/d22/f34 [1940319,65481] 0 2024-09-17T01:06:53.513 INFO:tasks.workunit.client.1.smithi143.stdout:4/186: chown da/c18 1 1 2024-09-17T01:06:53.513 INFO:tasks.workunit.client.1.smithi143.stdout:3/114: chown d6/d10/c14 1087051460 1 2024-09-17T01:06:53.513 INFO:tasks.workunit.client.1.smithi143.stdout:1/151: truncate d0/d6/f11 5338188 0 2024-09-17T01:06:53.515 INFO:tasks.workunit.client.1.smithi143.stdout:7/188: dwrite d4/fd [0,4194304] 0 2024-09-17T01:06:53.516 INFO:tasks.workunit.client.1.smithi143.stdout:2/126: link d0/d2/d21/d22/d24/f26 d0/d2/d21/f27 0 2024-09-17T01:06:53.517 INFO:tasks.workunit.client.1.smithi143.stdout:7/189: rename d4/d1f/d29 to d4/d1f/d29/d3c 22 2024-09-17T01:06:53.517 INFO:tasks.workunit.client.1.smithi143.stdout:9/116: mknod d3/d16/d2b/d9/c2c 0 2024-09-17T01:06:53.519 INFO:tasks.workunit.client.1.smithi143.stdout:9/117: read - d3/d16/d2b/f2a zero size 2024-09-17T01:06:53.519 INFO:tasks.workunit.client.1.smithi143.stdout:8/115: creat d9/f29 x:0 0 0 2024-09-17T01:06:53.521 INFO:tasks.workunit.client.1.smithi143.stdout:9/118: chown d3/d16/l23 665 1 2024-09-17T01:06:53.521 INFO:tasks.workunit.client.1.smithi143.stdout:9/119: dread - d3/d16/d2b/f10 zero size 2024-09-17T01:06:53.523 INFO:tasks.workunit.client.1.smithi143.stdout:0/165: write d3/d5/d8/d21/f30 [1050596,121214] 0 2024-09-17T01:06:53.525 INFO:tasks.workunit.client.1.smithi143.stdout:7/190: rename d4/f5 to d4/d3a/f3d 0 2024-09-17T01:06:53.526 INFO:tasks.workunit.client.1.smithi143.stdout:8/116: creat d9/d12/f2a x:0 0 0 2024-09-17T01:06:53.527 INFO:tasks.workunit.client.1.smithi143.stdout:8/117: write d9/f29 [8777,80000] 0 2024-09-17T01:06:53.528 INFO:tasks.workunit.client.1.smithi143.stdout:0/166: mkdir d3/d5/d8/d21/d37 0 2024-09-17T01:06:53.529 INFO:tasks.workunit.client.1.smithi143.stdout:1/152: rename d0/d6/c12 to d0/d6/d7/df/c2f 0 2024-09-17T01:06:53.530 INFO:tasks.workunit.client.1.smithi143.stdout:9/120: mknod d3/d16/d2b/d26/c2d 0 2024-09-17T01:06:53.530 INFO:tasks.workunit.client.1.smithi143.stdout:0/167: chown d3/d5/d8/cd 0 1 2024-09-17T01:06:53.531 INFO:tasks.workunit.client.1.smithi143.stdout:9/121: dread - d3/d16/d2b/f2a zero size 2024-09-17T01:06:53.531 INFO:tasks.workunit.client.1.smithi143.stdout:7/191: rename d4/d33/f39 to d4/d1f/f3e 0 2024-09-17T01:06:53.536 INFO:tasks.workunit.client.1.smithi143.stdout:9/122: creat d3/d16/d2b/d9/f2e x:0 0 0 2024-09-17T01:06:53.536 INFO:tasks.workunit.client.1.smithi143.stdout:0/168: dread d3/d5/d8/d27/f2b [0,4194304] 0 2024-09-17T01:06:53.536 INFO:tasks.workunit.client.1.smithi143.stdout:7/192: fdatasync d4/d3a/f3d 0 2024-09-17T01:06:53.537 INFO:tasks.workunit.client.1.smithi143.stdout:2/127: write d0/d2/f4 [4185068,28223] 0 2024-09-17T01:06:53.538 INFO:tasks.workunit.client.1.smithi143.stdout:8/118: rename d9/d26/d27 to d9/d2b 0 2024-09-17T01:06:53.540 INFO:tasks.workunit.client.1.smithi143.stdout:0/169: write d3/d5/fc [4750717,107809] 0 2024-09-17T01:06:53.540 INFO:tasks.workunit.client.1.smithi143.stdout:3/115: dread d6/fa [0,4194304] 0 2024-09-17T01:06:53.541 INFO:tasks.workunit.client.1.smithi143.stdout:9/123: symlink d3/d16/l2f 0 2024-09-17T01:06:53.541 INFO:tasks.workunit.client.1.smithi143.stdout:1/153: dwrite d0/d6/f1f [0,4194304] 0 2024-09-17T01:06:53.542 INFO:tasks.workunit.client.1.smithi143.stdout:2/128: read - d0/d2/d21/f27 zero size 2024-09-17T01:06:53.543 INFO:tasks.workunit.client.1.smithi143.stdout:8/119: mkdir d9/d26/d2c 0 2024-09-17T01:06:53.546 INFO:tasks.workunit.client.1.smithi143.stdout:7/193: fsync d4/d1f/f28 0 2024-09-17T01:06:53.547 INFO:tasks.workunit.client.1.smithi143.stdout:9/124: chown d3/d16/d2b/d26/c2d 2580024 1 2024-09-17T01:06:53.547 INFO:tasks.workunit.client.1.smithi143.stdout:1/154: write d0/d6/fd [1518814,119455] 0 2024-09-17T01:06:53.549 INFO:tasks.workunit.client.1.smithi143.stdout:8/120: rmdir d9/d12/d13 39 2024-09-17T01:06:53.551 INFO:tasks.workunit.client.1.smithi143.stdout:3/116: creat d6/f1f x:0 0 0 2024-09-17T01:06:53.551 INFO:tasks.workunit.client.1.smithi143.stdout:7/194: dread - d4/d1f/f31 zero size 2024-09-17T01:06:53.553 INFO:tasks.workunit.client.1.smithi143.stdout:9/125: fsync d3/f8 0 2024-09-17T01:06:53.556 INFO:tasks.workunit.client.1.smithi143.stdout:4/187: dwrite da/f32 [0,4194304] 0 2024-09-17T01:06:53.557 INFO:tasks.workunit.client.1.smithi143.stdout:1/155: mknod d0/d6/c30 0 2024-09-17T01:06:53.557 INFO:tasks.workunit.client.1.smithi143.stdout:2/129: link d0/d2/d21/f27 d0/d2/d21/d22/f28 0 2024-09-17T01:06:53.559 INFO:tasks.workunit.client.1.smithi143.stdout:7/195: creat d4/d33/f3f x:0 0 0 2024-09-17T01:06:53.560 INFO:tasks.workunit.client.1.smithi143.stdout:0/170: dwrite d3/d5/f9 [4194304,4194304] 0 2024-09-17T01:06:53.561 INFO:tasks.workunit.client.1.smithi143.stdout:8/121: mkdir d9/d12/d2d 0 2024-09-17T01:06:53.562 INFO:tasks.workunit.client.1.smithi143.stdout:2/130: dread - d0/d2/d21/f27 zero size 2024-09-17T01:06:53.564 INFO:tasks.workunit.client.1.smithi143.stdout:9/126: creat d3/d16/d2b/f30 x:0 0 0 2024-09-17T01:06:53.565 INFO:tasks.workunit.client.1.smithi143.stdout:7/196: write d4/f1b [3034762,101227] 0 2024-09-17T01:06:53.570 INFO:tasks.workunit.client.1.smithi143.stdout:2/131: unlink d0/d2/la 0 2024-09-17T01:06:53.571 INFO:tasks.workunit.client.1.smithi143.stdout:7/197: chown d4/d26/f2b 25184973 1 2024-09-17T01:06:53.572 INFO:tasks.workunit.client.1.smithi143.stdout:3/117: dwrite d6/d10/f1a [0,4194304] 0 2024-09-17T01:06:53.573 INFO:tasks.workunit.client.1.smithi143.stdout:2/132: chown d0/c1e 2087 1 2024-09-17T01:06:53.577 INFO:tasks.workunit.client.1.smithi143.stdout:8/122: mknod d9/d12/c2e 0 2024-09-17T01:06:53.577 INFO:tasks.workunit.client.1.smithi143.stdout:4/188: dwrite da/d22/f3c [0,4194304] 0 2024-09-17T01:06:53.577 INFO:tasks.workunit.client.1.smithi143.stdout:3/118: write d6/d10/f1a [526889,123891] 0 2024-09-17T01:06:53.577 INFO:tasks.workunit.client.1.smithi143.stdout:7/198: creat d4/d16/f40 x:0 0 0 2024-09-17T01:06:53.578 INFO:tasks.workunit.client.1.smithi143.stdout:8/123: fsync d9/de/f21 0 2024-09-17T01:06:53.579 INFO:tasks.workunit.client.1.smithi143.stdout:9/127: dread d3/f15 [0,4194304] 0 2024-09-17T01:06:53.579 INFO:tasks.workunit.client.1.smithi143.stdout:8/124: chown d9/d2b 222871 1 2024-09-17T01:06:53.588 INFO:tasks.workunit.client.1.smithi143.stdout:1/156: write d0/d6/d7/de/f1d [5239041,49134] 0 2024-09-17T01:06:53.589 INFO:tasks.workunit.client.1.smithi143.stdout:4/189: dwrite da/f11 [0,4194304] 0 2024-09-17T01:06:53.590 INFO:tasks.workunit.client.1.smithi143.stdout:2/133: link d0/ff d0/d2/d21/d22/d24/f29 0 2024-09-17T01:06:53.590 INFO:tasks.workunit.client.1.smithi143.stdout:4/190: stat da/d22/f39 0 2024-09-17T01:06:53.591 INFO:tasks.workunit.client.1.smithi143.stdout:2/134: write d0/d10/f16 [1382099,92936] 0 2024-09-17T01:06:53.592 INFO:tasks.workunit.client.1.smithi143.stdout:2/135: stat d0/c1e 0 2024-09-17T01:06:53.592 INFO:tasks.workunit.client.1.smithi143.stdout:2/136: stat d0/ff 0 2024-09-17T01:06:53.596 INFO:tasks.workunit.client.1.smithi143.stdout:3/119: creat d6/f20 x:0 0 0 2024-09-17T01:06:53.597 INFO:tasks.workunit.client.1.smithi143.stdout:7/199: write d4/f10 [604625,124640] 0 2024-09-17T01:06:53.597 INFO:tasks.workunit.client.1.smithi143.stdout:4/191: mkdir da/d3a/d3e 0 2024-09-17T01:06:53.598 INFO:tasks.workunit.client.1.smithi143.stdout:8/125: link d9/f11 d9/d12/f2f 0 2024-09-17T01:06:53.601 INFO:tasks.workunit.client.1.smithi143.stdout:8/126: dread - d9/d12/f2a zero size 2024-09-17T01:06:53.601 INFO:tasks.workunit.client.1.smithi143.stdout:3/120: chown d6/l1d 2 1 2024-09-17T01:06:53.601 INFO:tasks.workunit.client.1.smithi143.stdout:1/157: mknod d0/d6/c31 0 2024-09-17T01:06:53.601 INFO:tasks.workunit.client.1.smithi143.stdout:4/192: truncate da/d22/f36 140401 0 2024-09-17T01:06:53.602 INFO:tasks.workunit.client.1.smithi143.stdout:8/127: stat d9/d12/f18 0 2024-09-17T01:06:53.602 INFO:tasks.workunit.client.1.smithi143.stdout:9/128: getdents d3/d16/d2b/d26 0 2024-09-17T01:06:53.602 INFO:tasks.workunit.client.1.smithi143.stdout:4/193: stat da/f2e 0 2024-09-17T01:06:53.602 INFO:tasks.workunit.client.1.smithi143.stdout:9/129: chown d3/d16/d2b/d9 26673468 1 2024-09-17T01:06:53.603 INFO:tasks.workunit.client.1.smithi143.stdout:2/137: getdents d0 0 2024-09-17T01:06:53.603 INFO:tasks.workunit.client.1.smithi143.stdout:2/138: dread - d0/d10/f20 zero size 2024-09-17T01:06:53.604 INFO:tasks.workunit.client.1.smithi143.stdout:1/158: symlink d0/d6/d7/de/l32 0 2024-09-17T01:06:53.606 INFO:tasks.workunit.client.1.smithi143.stdout:1/159: dread - d0/d6/d7/de/d2/f28 zero size 2024-09-17T01:06:53.606 INFO:tasks.workunit.client.1.smithi143.stdout:7/200: creat d4/f41 x:0 0 0 2024-09-17T01:06:53.608 INFO:tasks.workunit.client.1.smithi143.stdout:8/128: mknod d9/d12/c30 0 2024-09-17T01:06:53.611 INFO:tasks.workunit.client.1.smithi143.stdout:3/121: link d6/d10/f15 d6/d10/f21 0 2024-09-17T01:06:53.611 INFO:tasks.workunit.client.1.smithi143.stdout:9/130: dwrite d3/d16/d2b/f1c [0,4194304] 0 2024-09-17T01:06:53.611 INFO:tasks.workunit.client.1.smithi143.stdout:7/201: truncate d4/d16/f1a 1723301 0 2024-09-17T01:06:53.617 INFO:tasks.workunit.client.1.smithi143.stdout:8/129: rename d9/ld to d9/d26/d2c/l31 0 2024-09-17T01:06:53.619 INFO:tasks.workunit.client.1.smithi143.stdout:9/131: write d3/d16/d2b/d9/f17 [731916,128805] 0 2024-09-17T01:06:53.620 INFO:tasks.workunit.client.1.smithi143.stdout:4/194: dwrite da/f1b [0,4194304] 0 2024-09-17T01:06:53.621 INFO:tasks.workunit.client.1.smithi143.stdout:1/160: dread d0/d6/d7/de/f14 [0,4194304] 0 2024-09-17T01:06:53.621 INFO:tasks.workunit.client.1.smithi143.stdout:8/130: fsync d9/de/f21 0 2024-09-17T01:06:53.623 INFO:tasks.workunit.client.1.smithi143.stdout:1/161: readlink d0/d6/d7/de/l5 0 2024-09-17T01:06:53.626 INFO:tasks.workunit.client.1.smithi143.stdout:2/139: dwrite d0/d2/d21/f27 [0,4194304] 0 2024-09-17T01:06:53.628 INFO:tasks.workunit.client.1.smithi143.stdout:9/132: read d3/f14 [809945,122473] 0 2024-09-17T01:06:53.630 INFO:tasks.workunit.client.1.smithi143.stdout:2/140: chown d0/d10/f16 658440 1 2024-09-17T01:06:53.630 INFO:tasks.workunit.client.1.smithi143.stdout:3/122: link l2 d6/l22 0 2024-09-17T01:06:53.630 INFO:tasks.workunit.client.1.smithi143.stdout:1/162: symlink d0/d6/d7/df/d27/l33 0 2024-09-17T01:06:53.631 INFO:tasks.workunit.client.1.smithi143.stdout:9/133: rename d3/c1e to d3/d16/c31 0 2024-09-17T01:06:53.634 INFO:tasks.workunit.client.1.smithi143.stdout:8/131: mkdir d9/d23/d32 0 2024-09-17T01:06:53.635 INFO:tasks.workunit.client.1.smithi143.stdout:7/202: write d4/d1f/d29/f35 [453785,102076] 0 2024-09-17T01:06:53.636 INFO:tasks.workunit.client.1.smithi143.stdout:3/123: mknod d6/d10/c23 0 2024-09-17T01:06:53.636 INFO:tasks.workunit.client.1.smithi143.stdout:7/203: chown d4/d16/l3b 64676 1 2024-09-17T01:06:53.638 INFO:tasks.workunit.client.1.smithi143.stdout:1/163: rename d0/d6/d7/de/l5 to d0/d6/d7/l34 0 2024-09-17T01:06:53.639 INFO:tasks.workunit.client.1.smithi143.stdout:4/195: link c0 da/d3a/d3e/c3f 0 2024-09-17T01:06:53.640 INFO:tasks.workunit.client.1.smithi143.stdout:9/134: symlink d3/l32 0 2024-09-17T01:06:53.641 INFO:tasks.workunit.client.1.smithi143.stdout:1/164: write d0/d6/fd [3269095,30392] 0 2024-09-17T01:06:53.643 INFO:tasks.workunit.client.1.smithi143.stdout:2/141: link d0/d2/d21/f27 d0/d2/d21/d22/d24/f2a 0 2024-09-17T01:06:53.644 INFO:tasks.workunit.client.1.smithi143.stdout:8/132: dwrite d9/d12/f2a [0,4194304] 0 2024-09-17T01:06:53.644 INFO:tasks.workunit.client.1.smithi143.stdout:9/135: write d3/d16/d2b/fc [220235,1258] 0 2024-09-17T01:06:53.646 INFO:tasks.workunit.client.1.smithi143.stdout:3/124: rename d6/d10/f15 to d6/f24 0 2024-09-17T01:06:53.647 INFO:tasks.workunit.client.1.smithi143.stdout:3/125: chown d6/d10/c14 172284577 1 2024-09-17T01:06:53.648 INFO:tasks.workunit.client.1.smithi143.stdout:1/165: unlink d0/d6/d7/c17 0 2024-09-17T01:06:53.650 INFO:tasks.workunit.client.1.smithi143.stdout:2/142: creat d0/d2/f2b x:0 0 0 2024-09-17T01:06:53.650 INFO:tasks.workunit.client.1.smithi143.stdout:9/136: write d3/f14 [1272138,1178] 0 2024-09-17T01:06:53.651 INFO:tasks.workunit.client.1.smithi143.stdout:7/204: getdents d4/d33 0 2024-09-17T01:06:53.652 INFO:tasks.workunit.client.1.smithi143.stdout:4/196: rename da/d22 to da/d3a/d40 0 2024-09-17T01:06:53.653 INFO:tasks.workunit.client.1.smithi143.stdout:2/143: write d0/d2/f14 [2273248,127456] 0 2024-09-17T01:06:53.654 INFO:tasks.workunit.client.1.smithi143.stdout:4/197: stat da/f31 0 2024-09-17T01:06:53.657 INFO:tasks.workunit.client.1.smithi143.stdout:8/133: dwrite d9/f28 [0,4194304] 0 2024-09-17T01:06:53.657 INFO:tasks.workunit.client.1.smithi143.stdout:9/137: dread d3/f14 [0,4194304] 0 2024-09-17T01:06:53.661 INFO:tasks.workunit.client.1.smithi143.stdout:7/205: rename d4/d3a/f3d to d4/d16/f42 0 2024-09-17T01:06:53.665 INFO:tasks.workunit.client.1.smithi143.stdout:3/126: mknod d6/c25 0 2024-09-17T01:06:53.668 INFO:tasks.workunit.client.1.smithi143.stdout:9/138: mknod d3/d16/c33 0 2024-09-17T01:06:53.669 INFO:tasks.workunit.client.1.smithi143.stdout:9/139: dread - d3/d16/d2b/d9/f2e zero size 2024-09-17T01:06:53.671 INFO:tasks.workunit.client.1.smithi143.stdout:9/140: dread d3/d16/d2b/d9/f1a [0,4194304] 0 2024-09-17T01:06:53.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.672+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a4019b3e0 con 0x7f6a40102f60 2024-09-17T01:06:53.671 INFO:tasks.workunit.client.1.smithi143.stdout:3/127: mkdir d6/d10/d26 0 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.673+0000 7f6a2f7fe640 1 -- 172.21.15.103:0/4001987992 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f6a4019b3e0 con 0x7f6a40102f60 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:53.672 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 13, 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:06:53.673 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:06:53.674 INFO:tasks.workunit.client.1.smithi143.stdout:4/198: unlink da/f28 0 2024-09-17T01:06:53.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f6a2806d8a0 msgr2=0x7f6a2806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f6a2806d8a0 0x7f6a2806fd60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005d00 tx=0x7f6a3000b410 comp rx=0 tx=0).stop 2024-09-17T01:06:53.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 msgr2=0x7f6a40195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40195b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6a340055a0 tx=0x7f6a340055d0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 shutdown_connections 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a40102f60 0x7f6a40195b80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f6a2806d8a0 0x7f6a2806fd60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 --2- 172.21.15.103:0/4001987992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a40100630 0x7f6a40195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 >> 172.21.15.103:0/4001987992 conn(0x7f6a400fa230 msgr2=0x7f6a400fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 shutdown_connections 2024-09-17T01:06:53.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.675+0000 7f6a44d2f640 1 -- 172.21.15.103:0/4001987992 wait complete. 2024-09-17T01:06:53.675 INFO:tasks.workunit.client.1.smithi143.stdout:8/134: rename d9/d12/f2a to d9/d12/d13/f33 0 2024-09-17T01:06:53.679 INFO:tasks.workunit.client.1.smithi143.stdout:4/199: symlink da/d3a/d40/l41 0 2024-09-17T01:06:53.680 INFO:tasks.workunit.client.1.smithi143.stdout:1/166: link d0/d6/d7/df/d27/l33 d0/l35 0 2024-09-17T01:06:53.681 INFO:tasks.workunit.client.1.smithi143.stdout:5/228: sync 2024-09-17T01:06:53.681 INFO:tasks.workunit.client.1.smithi143.stdout:7/206: rmdir d4/d26/d32 0 2024-09-17T01:06:53.682 INFO:tasks.workunit.client.1.smithi143.stdout:2/144: dwrite d0/ff [0,4194304] 0 2024-09-17T01:06:53.683 INFO:tasks.workunit.client.1.smithi143.stdout:5/229: write d1/d46/df/f36 [203153,99780] 0 2024-09-17T01:06:53.683 INFO:tasks.workunit.client.1.smithi143.stdout:7/207: chown d4/d33/l36 3949 1 2024-09-17T01:06:53.684 INFO:tasks.workunit.client.1.smithi143.stdout:8/135: symlink d9/d12/l34 0 2024-09-17T01:06:53.684 INFO:tasks.workunit.client.1.smithi143.stdout:4/200: rmdir da/d3a/d40 39 2024-09-17T01:06:53.685 INFO:tasks.workunit.client.1.smithi143.stdout:2/145: write d0/d10/f1d [290017,104139] 0 2024-09-17T01:06:53.687 INFO:tasks.workunit.client.1.smithi143.stdout:2/146: readlink d0/l12 0 2024-09-17T01:06:53.688 INFO:tasks.workunit.client.1.smithi143.stdout:7/208: creat d4/d1f/f43 x:0 0 0 2024-09-17T01:06:53.689 INFO:tasks.workunit.client.1.smithi143.stdout:8/136: mkdir d9/d2b/d35 0 2024-09-17T01:06:53.691 INFO:tasks.workunit.client.1.smithi143.stdout:3/128: getdents d6/d1c 0 2024-09-17T01:06:53.696 INFO:tasks.workunit.client.1.smithi143.stdout:1/167: dwrite d0/d6/d7/df/f1a [0,4194304] 0 2024-09-17T01:06:53.698 INFO:tasks.workunit.client.1.smithi143.stdout:8/137: unlink d9/f28 0 2024-09-17T01:06:53.700 INFO:tasks.workunit.client.1.smithi143.stdout:4/201: mkdir da/d3a/d3e/d42 0 2024-09-17T01:06:53.701 INFO:tasks.workunit.client.1.smithi143.stdout:9/141: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:06:53.702 INFO:tasks.workunit.client.1.smithi143.stdout:5/230: dwrite d1/d46/df/d23/f26 [0,4194304] 0 2024-09-17T01:06:53.707 INFO:tasks.workunit.client.1.smithi143.stdout:9/142: dread d3/f15 [0,4194304] 0 2024-09-17T01:06:53.710 INFO:tasks.workunit.client.1.smithi143.stdout:1/168: creat d0/d6/d7/de/d18/f36 x:0 0 0 2024-09-17T01:06:53.711 INFO:tasks.workunit.client.1.smithi143.stdout:1/169: fdatasync d0/d6/f20 0 2024-09-17T01:06:53.712 INFO:tasks.workunit.client.1.smithi143.stdout:4/202: chown da/d3a/d40/f34 103642 1 2024-09-17T01:06:53.715 INFO:tasks.workunit.client.1.smithi143.stdout:9/143: dread d3/d16/d2b/fb [0,4194304] 0 2024-09-17T01:06:53.716 INFO:tasks.workunit.client.1.smithi143.stdout:9/144: chown d3/d16/d2b/c21 9 1 2024-09-17T01:06:53.716 INFO:tasks.workunit.client.1.smithi143.stdout:5/231: symlink d1/d46/d4c/l5c 0 2024-09-17T01:06:53.716 INFO:tasks.workunit.client.1.smithi143.stdout:9/145: dread - d3/d16/d2b/f10 zero size 2024-09-17T01:06:53.723 INFO:tasks.workunit.client.1.smithi143.stdout:8/138: getdents d9/d2b/d35 0 2024-09-17T01:06:53.725 INFO:tasks.workunit.client.1.smithi143.stdout:4/203: readlink da/d3a/d40/l35 0 2024-09-17T01:06:53.725 INFO:tasks.workunit.client.1.smithi143.stdout:4/204: chown da/d3a/d40/c2f 515031 1 2024-09-17T01:06:53.726 INFO:tasks.workunit.client.1.smithi143.stdout:1/170: symlink d0/d6/d7/de/d2/l37 0 2024-09-17T01:06:53.727 INFO:tasks.workunit.client.1.smithi143.stdout:1/171: write d0/dc/f2c [539169,125304] 0 2024-09-17T01:06:53.727 INFO:tasks.workunit.client.1.smithi143.stdout:7/209: getdents d4/d3a 0 2024-09-17T01:06:53.733 INFO:tasks.workunit.client.1.smithi143.stdout:9/146: mkdir d3/d16/d34 0 2024-09-17T01:06:53.735 INFO:tasks.workunit.client.1.smithi143.stdout:2/147: getdents d0/d2/d21/d22/d24 0 2024-09-17T01:06:53.740 INFO:tasks.workunit.client.1.smithi143.stdout:8/139: unlink d9/de/c22 0 2024-09-17T01:06:53.740 INFO:tasks.workunit.client.1.smithi143.stdout:8/140: stat d9/de/lf 0 2024-09-17T01:06:53.743 INFO:tasks.workunit.client.1.smithi143.stdout:8/141: dread d9/fc [0,4194304] 0 2024-09-17T01:06:53.743 INFO:tasks.workunit.client.1.smithi143.stdout:8/142: truncate f7 4771064 0 2024-09-17T01:06:53.746 INFO:tasks.workunit.client.1.smithi143.stdout:1/172: rename d0/d6/d7/f22 to d0/dc/f38 0 2024-09-17T01:06:53.746 INFO:tasks.workunit.client.1.smithi143.stdout:1/173: chown d0/d6/f29 6072 1 2024-09-17T01:06:53.749 INFO:tasks.workunit.client.1.smithi143.stdout:5/232: unlink d1/c2c 0 2024-09-17T01:06:53.752 INFO:tasks.workunit.client.1.smithi143.stdout:3/129: getdents d6 0 2024-09-17T01:06:53.753 INFO:tasks.workunit.client.1.smithi143.stdout:9/147: symlink d3/d16/d2b/d26/l35 0 2024-09-17T01:06:53.754 INFO:tasks.workunit.client.1.smithi143.stdout:1/174: dwrite d0/d6/f29 [0,4194304] 0 2024-09-17T01:06:53.759 INFO:tasks.workunit.client.1.smithi143.stdout:6/108: sync 2024-09-17T01:06:53.760 INFO:tasks.workunit.client.1.smithi143.stdout:5/233: dwrite d1/d46/f48 [0,4194304] 0 2024-09-17T01:06:53.760 INFO:tasks.workunit.client.1.smithi143.stdout:8/143: dread d9/d12/f18 [0,4194304] 0 2024-09-17T01:06:53.768 INFO:tasks.workunit.client.1.smithi143.stdout:8/144: chown d9/f11 15356147 1 2024-09-17T01:06:53.769 INFO:tasks.workunit.client.1.smithi143.stdout:2/148: dwrite d0/d2/d21/d22/d24/f26 [0,4194304] 0 2024-09-17T01:06:53.769 INFO:tasks.workunit.client.1.smithi143.stdout:7/210: creat d4/f44 x:0 0 0 2024-09-17T01:06:53.770 INFO:tasks.workunit.client.1.smithi143.stdout:1/175: fdatasync d0/dc/f38 0 2024-09-17T01:06:53.770 INFO:tasks.workunit.client.1.smithi143.stdout:4/205: dwrite da/f1d [0,4194304] 0 2024-09-17T01:06:53.771 INFO:tasks.workunit.client.1.smithi143.stdout:4/206: stat da/c18 0 2024-09-17T01:06:53.777 INFO:tasks.workunit.client.1.smithi143.stdout:6/109: mkdir d2/d7/d26 0 2024-09-17T01:06:53.782 INFO:tasks.workunit.client.1.smithi143.stdout:5/234: symlink d1/d46/df/d23/d4f/l5d 0 2024-09-17T01:06:53.785 INFO:tasks.workunit.client.1.smithi143.stdout:8/145: creat d9/d26/f36 x:0 0 0 2024-09-17T01:06:53.790 INFO:tasks.workunit.client.1.smithi143.stdout:7/211: creat d4/d33/f45 x:0 0 0 2024-09-17T01:06:53.792 INFO:tasks.workunit.client.1.smithi143.stdout:9/148: write d3/d16/d2b/d9/f1a [131123,9652] 0 2024-09-17T01:06:53.793 INFO:tasks.workunit.client.1.smithi143.stdout:9/149: dread - d3/d16/d2b/d9/f2e zero size 2024-09-17T01:06:53.793 INFO:tasks.workunit.client.1.smithi143.stdout:3/130: rmdir d6/d10/d26 0 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.797+0000 7f6683434640 1 -- 172.21.15.103:0/2772082570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 msgr2=0x7f667c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.797+0000 7f6683434640 1 --2- 172.21.15.103:0/2772082570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c1011e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f666c009880 tx=0x7f666c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.797+0000 7f6683434640 1 -- 172.21.15.103:0/2772082570 shutdown_connections 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.797+0000 7f6683434640 1 --2- 172.21.15.103:0/2772082570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c1011e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.797+0000 7f6683434640 1 --2- 172.21.15.103:0/2772082570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f667c0ffb60 0x7f667c0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.797+0000 7f6683434640 1 -- 172.21.15.103:0/2772082570 >> 172.21.15.103:0/2772082570 conn(0x7f667c0fb2f0 msgr2=0x7f667c0fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.798+0000 7f6683434640 1 -- 172.21.15.103:0/2772082570 shutdown_connections 2024-09-17T01:06:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.798+0000 7f6683434640 1 -- 172.21.15.103:0/2772082570 wait complete. 2024-09-17T01:06:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.798+0000 7f6683434640 1 Processor -- start 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.798+0000 7f6683434640 1 -- start start 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f6683434640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f667c0ffb60 0x7f667c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f6683434640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f6683434640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1983f0 con 0x7f667c100d60 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f6683434640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c198560 con 0x7f667c0ffb60 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66809cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66809cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46184/0 (socket says 172.21.15.103:46184) 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66809cf640 1 -- 172.21.15.103:0/1980954497 learned_addr learned my addr 172.21.15.103:0/1980954497 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66811d0640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f667c0ffb60 0x7f667c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66809cf640 1 -- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f667c0ffb60 msgr2=0x7f667c1978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66809cf640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f667c0ffb60 0x7f667c1978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.799+0000 7f66809cf640 1 -- 172.21.15.103:0/1980954497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009560 con 0x7f667c100d60 2024-09-17T01:06:53.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.800+0000 7f66809cf640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c197e20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f666c004650 tx=0x7f666c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:53.800 INFO:tasks.workunit.client.1.smithi143.stdout:9/150: dwrite d3/d16/d2b/f12 [0,4194304] 0 2024-09-17T01:06:53.800 INFO:tasks.workunit.client.1.smithi143.stdout:9/151: chown d3 52191795 1 2024-09-17T01:06:53.801 INFO:tasks.workunit.client.1.smithi143.stdout:9/152: readlink d3/d16/l2f 0 2024-09-17T01:06:53.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.800+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f666c004aa0 con 0x7f667c100d60 2024-09-17T01:06:53.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.800+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f666c005d50 con 0x7f667c100d60 2024-09-17T01:06:53.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.800+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c19cfa0 con 0x7f667c100d60 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.800+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f666c0039e0 con 0x7f667c100d60 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.800+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c19d4e0 con 0x7f667c100d60 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.801+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c1056a0 con 0x7f667c100d60 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.802+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f666c003c60 con 0x7f667c100d60 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.802+0000 7f66727fc640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f666806d8a0 0x7f666806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.802+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f666c0ae4e0 con 0x7f667c100d60 2024-09-17T01:06:53.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.803+0000 7f66811d0640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f666806d8a0 0x7f666806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:53.803 INFO:tasks.workunit.client.1.smithi143.stdout:2/149: getdents d0/d2/d21/d22/d24 0 2024-09-17T01:06:53.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.803+0000 7f66811d0640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f666806d8a0 0x7f666806fd60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f667c100bc0 tx=0x7f6678005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:53.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:53.807+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f666c077a50 con 0x7f667c100d60 2024-09-17T01:06:53.807 INFO:tasks.workunit.client.1.smithi143.stdout:4/207: link da/f2e da/d3a/d3e/d42/f43 0 2024-09-17T01:06:53.809 INFO:tasks.workunit.client.1.smithi143.stdout:2/150: dwrite d0/fc [0,4194304] 0 2024-09-17T01:06:53.813 INFO:tasks.workunit.client.1.smithi143.stdout:3/131: rename d6/d10/c1b to d6/d1c/c27 0 2024-09-17T01:06:53.813 INFO:tasks.workunit.client.1.smithi143.stdout:4/208: dread da/d3a/d40/f3c [0,4194304] 0 2024-09-17T01:06:53.813 INFO:tasks.workunit.client.1.smithi143.stdout:3/132: fdatasync d6/d10/f16 0 2024-09-17T01:06:53.814 INFO:tasks.workunit.client.1.smithi143.stdout:3/133: fdatasync d6/f20 0 2024-09-17T01:06:53.815 INFO:tasks.workunit.client.1.smithi143.stdout:5/235: mkdir d1/d5e 0 2024-09-17T01:06:53.819 INFO:tasks.workunit.client.1.smithi143.stdout:8/146: creat d9/d12/d2d/f37 x:0 0 0 2024-09-17T01:06:53.820 INFO:tasks.workunit.client.1.smithi143.stdout:5/236: dwrite d1/d46/df/f25 [0,4194304] 0 2024-09-17T01:06:53.824 INFO:tasks.workunit.client.1.smithi143.stdout:2/151: creat d0/d2/d21/f2c x:0 0 0 2024-09-17T01:06:53.828 INFO:tasks.workunit.client.1.smithi143.stdout:9/153: creat d3/d16/d34/f36 x:0 0 0 2024-09-17T01:06:53.828 INFO:tasks.workunit.client.1.smithi143.stdout:7/212: dwrite d4/d16/f17 [4194304,4194304] 0 2024-09-17T01:06:53.829 INFO:tasks.workunit.client.1.smithi143.stdout:9/154: fdatasync d3/d16/d2b/f10 0 2024-09-17T01:06:53.830 INFO:tasks.workunit.client.1.smithi143.stdout:1/176: getdents d0/d6/d7/de 0 2024-09-17T01:06:53.833 INFO:tasks.workunit.client.1.smithi143.stdout:2/152: dread d0/d10/f11 [0,4194304] 0 2024-09-17T01:06:53.835 INFO:tasks.workunit.client.1.smithi143.stdout:4/209: mknod da/d3a/d3e/d42/c44 0 2024-09-17T01:06:53.841 INFO:tasks.workunit.client.1.smithi143.stdout:8/147: mkdir d9/d12/d38 0 2024-09-17T01:06:53.842 INFO:tasks.workunit.client.1.smithi143.stdout:8/148: write d9/fa [3832993,130218] 0 2024-09-17T01:06:53.842 INFO:tasks.workunit.client.1.smithi143.stdout:7/213: rmdir d4/d1f 39 2024-09-17T01:06:53.846 INFO:tasks.workunit.client.1.smithi143.stdout:1/177: mkdir d0/d6/d7/de/d2/d39 0 2024-09-17T01:06:53.848 INFO:tasks.workunit.client.1.smithi143.stdout:1/178: write d0/d6/d7/de/f1d [18797,38631] 0 2024-09-17T01:06:53.849 INFO:tasks.workunit.client.1.smithi143.stdout:2/153: creat d0/d2/d21/d22/f2d x:0 0 0 2024-09-17T01:06:53.851 INFO:tasks.workunit.client.1.smithi143.stdout:9/155: dwrite d3/d16/d2b/f2a [0,4194304] 0 2024-09-17T01:06:53.857 INFO:tasks.workunit.client.1.smithi143.stdout:7/214: mknod d4/d16/c46 0 2024-09-17T01:06:53.862 INFO:tasks.workunit.client.1.smithi143.stdout:2/154: creat d0/d10/f2e x:0 0 0 2024-09-17T01:06:53.865 INFO:tasks.workunit.client.1.smithi143.stdout:4/210: rename da/cf to da/d3a/d3e/d42/c45 0 2024-09-17T01:06:53.871 INFO:tasks.workunit.client.1.smithi143.stdout:2/155: readlink d0/l7 0 2024-09-17T01:06:53.871 INFO:tasks.workunit.client.1.smithi143.stdout:7/215: rmdir d4 39 2024-09-17T01:06:53.871 INFO:tasks.workunit.client.1.smithi143.stdout:2/156: truncate d0/d10/f2e 852590 0 2024-09-17T01:06:53.873 INFO:tasks.workunit.client.1.smithi143.stdout:2/157: write d0/d2/d21/d22/f28 [3405282,111245] 0 2024-09-17T01:06:53.873 INFO:tasks.workunit.client.1.smithi143.stdout:2/158: fdatasync d0/d10/f1d 0 2024-09-17T01:06:53.876 INFO:tasks.workunit.client.1.smithi143.stdout:1/179: link d0/d6/d7/de/f1d d0/d6/f3a 0 2024-09-17T01:06:53.879 INFO:tasks.workunit.client.1.smithi143.stdout:8/149: truncate f7 357296 0 2024-09-17T01:06:53.883 INFO:tasks.workunit.client.1.smithi143.stdout:7/216: mkdir d4/d16/d47 0 2024-09-17T01:06:53.883 INFO:tasks.workunit.client.1.smithi143.stdout:1/180: dwrite d0/d6/d7/df/d27/f2e [0,4194304] 0 2024-09-17T01:06:53.885 INFO:tasks.workunit.client.1.smithi143.stdout:9/156: getdents d3 0 2024-09-17T01:06:53.889 INFO:tasks.workunit.client.1.smithi143.stdout:7/217: mknod d4/d26/c48 0 2024-09-17T01:06:53.890 INFO:tasks.workunit.client.1.smithi143.stdout:1/181: read d0/d6/d7/de/d2/f2a [3411140,55979] 0 2024-09-17T01:06:53.890 INFO:tasks.workunit.client.1.smithi143.stdout:7/218: stat d4/c19 0 2024-09-17T01:06:53.893 INFO:tasks.workunit.client.1.smithi143.stdout:8/150: dwrite d9/d12/d2d/f37 [0,4194304] 0 2024-09-17T01:06:53.893 INFO:tasks.workunit.client.1.smithi143.stdout:2/159: dread d0/d10/f11 [0,4194304] 0 2024-09-17T01:06:53.893 INFO:tasks.workunit.client.1.smithi143.stdout:1/182: write d0/d6/f20 [2177539,77297] 0 2024-09-17T01:06:53.894 INFO:tasks.workunit.client.1.smithi143.stdout:9/157: creat d3/d16/d2b/d9/f37 x:0 0 0 2024-09-17T01:06:53.901 INFO:tasks.workunit.client.1.smithi143.stdout:7/219: dwrite d4/f13 [0,4194304] 0 2024-09-17T01:06:53.905 INFO:tasks.workunit.client.1.smithi143.stdout:2/160: dwrite d0/d2/fb [4194304,4194304] 0 2024-09-17T01:06:53.906 INFO:tasks.workunit.client.1.smithi143.stdout:1/183: mknod d0/d6/c3b 0 2024-09-17T01:06:53.908 INFO:tasks.workunit.client.1.smithi143.stdout:9/158: unlink d3/d16/d2b/fa 0 2024-09-17T01:06:53.908 INFO:tasks.workunit.client.1.smithi143.stdout:0/171: sync 2024-09-17T01:06:53.908 INFO:tasks.workunit.client.1.smithi143.stdout:2/161: write d0/d2/fe [2778527,4410] 0 2024-09-17T01:06:53.912 INFO:tasks.workunit.client.1.smithi143.stdout:8/151: symlink d9/d23/d32/l39 0 2024-09-17T01:06:53.915 INFO:tasks.workunit.client.1.smithi143.stdout:8/152: dread d9/d12/f2f [0,4194304] 0 2024-09-17T01:06:53.916 INFO:tasks.workunit.client.1.smithi143.stdout:1/184: mkdir d0/d6/d7/de/d2/d3c 0 2024-09-17T01:06:53.918 INFO:tasks.workunit.client.1.smithi143.stdout:2/162: unlink d0/d2/c1f 0 2024-09-17T01:06:53.921 INFO:tasks.workunit.client.1.smithi143.stdout:9/159: symlink d3/d16/l38 0 2024-09-17T01:06:53.922 INFO:tasks.workunit.client.1.smithi143.stdout:8/153: dwrite d9/d12/d2d/f37 [0,4194304] 0 2024-09-17T01:06:53.926 INFO:tasks.workunit.client.1.smithi143.stdout:1/185: creat d0/d6/d7/de/d2/f3d x:0 0 0 2024-09-17T01:06:53.926 INFO:tasks.workunit.client.1.smithi143.stdout:2/163: creat d0/d2/d21/d22/f2f x:0 0 0 2024-09-17T01:06:53.928 INFO:tasks.workunit.client.1.smithi143.stdout:7/220: dwrite d4/d1f/f3e [0,4194304] 0 2024-09-17T01:06:53.928 INFO:tasks.workunit.client.1.smithi143.stdout:1/186: stat d0/d6/d7/de/d2 0 2024-09-17T01:06:53.929 INFO:tasks.workunit.client.1.smithi143.stdout:2/164: fdatasync d0/d2/f2b 0 2024-09-17T01:06:53.934 INFO:tasks.workunit.client.1.smithi143.stdout:2/165: dread d0/d10/f1d [0,4194304] 0 2024-09-17T01:06:53.935 INFO:tasks.workunit.client.1.smithi143.stdout:2/166: write d0/d10/f20 [499324,21205] 0 2024-09-17T01:06:53.936 INFO:tasks.workunit.client.1.smithi143.stdout:2/167: fsync d0/d2/d21/d22/f28 0 2024-09-17T01:06:53.937 INFO:tasks.workunit.client.1.smithi143.stdout:7/221: rename d4/d16/l3b to d4/d3a/l49 0 2024-09-17T01:06:53.939 INFO:tasks.workunit.client.1.smithi143.stdout:0/172: getdents d3/d14/d17 0 2024-09-17T01:06:53.944 INFO:tasks.workunit.client.1.smithi143.stdout:2/168: dwrite d0/d2/d21/d22/f2f [0,4194304] 0 2024-09-17T01:06:53.945 INFO:tasks.workunit.client.1.smithi143.stdout:7/222: dwrite d4/d1f/d29/f35 [0,4194304] 0 2024-09-17T01:06:53.946 INFO:tasks.workunit.client.1.smithi143.stdout:7/223: chown d4/d16/l37 847808282 1 2024-09-17T01:06:53.946 INFO:tasks.workunit.client.1.smithi143.stdout:7/224: fsync d4/f41 0 2024-09-17T01:06:53.948 INFO:tasks.workunit.client.1.smithi143.stdout:7/225: write d4/d16/f38 [263035,2874] 0 2024-09-17T01:06:53.948 INFO:tasks.workunit.client.1.smithi143.stdout:0/173: link d3/d5/d8/d21/f26 d3/d14/d32/f38 0 2024-09-17T01:06:53.952 INFO:tasks.workunit.client.1.smithi143.stdout:0/174: read d3/d5/d8/f13 [3442135,52287] 0 2024-09-17T01:06:53.952 INFO:tasks.workunit.client.1.smithi143.stdout:2/169: unlink d0/d2/c19 0 2024-09-17T01:06:53.956 INFO:tasks.workunit.client.1.smithi143.stdout:2/170: creat d0/d10/f30 x:0 0 0 2024-09-17T01:06:53.957 INFO:tasks.workunit.client.1.smithi143.stdout:2/171: readlink d0/ld 0 2024-09-17T01:06:53.958 INFO:tasks.workunit.client.1.smithi143.stdout:0/175: mkdir d3/d14/d17/d39 0 2024-09-17T01:06:53.959 INFO:tasks.workunit.client.1.smithi143.stdout:9/160: write d3/f8 [688987,109455] 0 2024-09-17T01:06:53.961 INFO:tasks.workunit.client.1.smithi143.stdout:0/176: creat d3/d5/d8/d10/f3a x:0 0 0 2024-09-17T01:06:53.963 INFO:tasks.workunit.client.1.smithi143.stdout:0/177: chown d3/d5/d8/d21/c33 49439932 1 2024-09-17T01:06:53.963 INFO:tasks.workunit.client.1.smithi143.stdout:2/172: dwrite d0/d2/f2b [0,4194304] 0 2024-09-17T01:06:53.964 INFO:tasks.workunit.client.1.smithi143.stdout:9/161: rmdir d3/d16 39 2024-09-17T01:06:53.968 INFO:tasks.workunit.client.1.smithi143.stdout:0/178: creat d3/d5/d8/d21/f3b x:0 0 0 2024-09-17T01:06:53.969 INFO:tasks.workunit.client.1.smithi143.stdout:0/179: chown d3/d5/d8/d21/d2e 39934688 1 2024-09-17T01:06:53.970 INFO:tasks.workunit.client.1.smithi143.stdout:9/162: write d3/d16/d2b/f12 [4016674,77127] 0 2024-09-17T01:06:53.972 INFO:tasks.workunit.client.1.smithi143.stdout:2/173: link d0/d10/f16 d0/f31 0 2024-09-17T01:06:53.973 INFO:tasks.workunit.client.1.smithi143.stdout:2/174: stat d0/f1a 0 2024-09-17T01:06:53.976 INFO:tasks.workunit.client.1.smithi143.stdout:0/180: dwrite d3/d5/fc [4194304,4194304] 0 2024-09-17T01:06:53.977 INFO:tasks.workunit.client.1.smithi143.stdout:0/181: chown d3/d14/d17/f1d 2 1 2024-09-17T01:06:53.977 INFO:tasks.workunit.client.1.smithi143.stdout:2/175: rename d0/d2/f4 to d0/d2/d21/f32 0 2024-09-17T01:06:54.019 INFO:tasks.workunit.client.1.smithi143.stdout:8/154: dread f7 [0,4194304] 0 2024-09-17T01:06:54.020 INFO:tasks.workunit.client.1.smithi143.stdout:7/226: dread d4/d16/f1a [0,4194304] 0 2024-09-17T01:06:54.020 INFO:tasks.workunit.client.1.smithi143.stdout:7/227: chown d4/d16/f1a 2 1 2024-09-17T01:06:54.021 INFO:tasks.workunit.client.1.smithi143.stdout:7/228: dread - d4/d1f/f28 zero size 2024-09-17T01:06:54.023 INFO:tasks.workunit.client.1.smithi143.stdout:7/229: mkdir d4/d1f/d4a 0 2024-09-17T01:06:54.024 INFO:tasks.workunit.client.1.smithi143.stdout:8/155: getdents d9/d26 0 2024-09-17T01:06:54.024 INFO:tasks.workunit.client.1.smithi143.stdout:7/230: write d4/d16/f38 [938999,44489] 0 2024-09-17T01:06:54.026 INFO:tasks.workunit.client.1.smithi143.stdout:7/231: write d4/d26/f2d [494680,122591] 0 2024-09-17T01:06:54.027 INFO:tasks.workunit.client.1.smithi143.stdout:7/232: fsync d4/f41 0 2024-09-17T01:06:54.028 INFO:tasks.workunit.client.1.smithi143.stdout:8/156: rename d9/d12/d13/l1a to d9/l3a 0 2024-09-17T01:06:54.029 INFO:tasks.workunit.client.1.smithi143.stdout:0/182: truncate d3/d5/d8/d21/f26 126130 0 2024-09-17T01:06:54.029 INFO:tasks.workunit.client.1.smithi143.stdout:8/157: dread f7 [0,4194304] 0 2024-09-17T01:06:54.031 INFO:tasks.workunit.client.1.smithi143.stdout:7/233: rename d4/d16/f38 to d4/d33/f4b 0 2024-09-17T01:06:54.031 INFO:tasks.workunit.client.1.smithi143.stdout:7/234: fdatasync d4/d1f/f3e 0 2024-09-17T01:06:54.032 INFO:tasks.workunit.client.1.smithi143.stdout:7/235: write d4/fd [3392759,104671] 0 2024-09-17T01:06:54.034 INFO:tasks.workunit.client.1.smithi143.stdout:7/236: truncate d4/d1f/f30 152495 0 2024-09-17T01:06:54.034 INFO:tasks.workunit.client.1.smithi143.stdout:8/158: rmdir d9/d23/d32 39 2024-09-17T01:06:54.034 INFO:tasks.workunit.client.1.smithi143.stdout:7/237: chown d4/d1f 0 1 2024-09-17T01:06:54.037 INFO:tasks.workunit.client.1.smithi143.stdout:8/159: creat d9/d2b/f3b x:0 0 0 2024-09-17T01:06:54.038 INFO:tasks.workunit.client.1.smithi143.stdout:7/238: rename d4/f8 to d4/d33/f4c 0 2024-09-17T01:06:54.038 INFO:tasks.workunit.client.1.smithi143.stdout:7/239: fdatasync d4/f10 0 2024-09-17T01:06:54.039 INFO:tasks.workunit.client.1.smithi143.stdout:7/240: stat d4/c1c 0 2024-09-17T01:06:54.039 INFO:tasks.workunit.client.1.smithi143.stdout:0/183: rmdir d3/d14/d17/d39 0 2024-09-17T01:06:54.039 INFO:tasks.workunit.client.1.smithi143.stdout:7/241: chown d4/d1f/d29 1345 1 2024-09-17T01:06:54.040 INFO:tasks.workunit.client.1.smithi143.stdout:7/242: write d4/d16/f40 [327565,65648] 0 2024-09-17T01:06:54.041 INFO:tasks.workunit.client.1.smithi143.stdout:7/243: write d4/f13 [1997721,3294] 0 2024-09-17T01:06:54.042 INFO:tasks.workunit.client.1.smithi143.stdout:8/160: mknod d9/d2b/c3c 0 2024-09-17T01:06:54.042 INFO:tasks.workunit.client.1.smithi143.stdout:7/244: chown d4/fd 56230 1 2024-09-17T01:06:54.044 INFO:tasks.workunit.client.1.smithi143.stdout:7/245: write d4/d1f/f31 [1022800,79401] 0 2024-09-17T01:06:54.044 INFO:tasks.workunit.client.1.smithi143.stdout:0/184: write d3/d5/d8/f13 [4245191,102027] 0 2024-09-17T01:06:54.045 INFO:tasks.workunit.client.1.smithi143.stdout:7/246: dread - d4/f27 zero size 2024-09-17T01:06:54.046 INFO:tasks.workunit.client.1.smithi143.stdout:7/247: fdatasync d4/f13 0 2024-09-17T01:06:54.046 INFO:tasks.workunit.client.1.smithi143.stdout:8/161: creat d9/d12/d38/f3d x:0 0 0 2024-09-17T01:06:54.049 INFO:tasks.workunit.client.1.smithi143.stdout:0/185: dread d3/d5/d8/d27/f18 [0,4194304] 0 2024-09-17T01:06:54.051 INFO:tasks.workunit.client.1.smithi143.stdout:7/248: link d4/d33/f45 d4/d33/f4d 0 2024-09-17T01:06:54.051 INFO:tasks.workunit.client.1.smithi143.stdout:0/186: symlink d3/d5/d8/d10/l3c 0 2024-09-17T01:06:54.052 INFO:tasks.workunit.client.1.smithi143.stdout:7/249: mkdir d4/d33/d4e 0 2024-09-17T01:06:54.060 INFO:tasks.workunit.client.1.smithi143.stdout:8/162: dread d9/fa [0,4194304] 0 2024-09-17T01:06:54.074 INFO:tasks.workunit.client.1.smithi143.stdout:7/250: unlink d4/d33/f4c 0 2024-09-17T01:06:54.075 INFO:tasks.workunit.client.1.smithi143.stdout:7/251: write d4/d16/f40 [546817,94169] 0 2024-09-17T01:06:54.077 INFO:tasks.workunit.client.1.smithi143.stdout:7/252: mknod d4/c4f 0 2024-09-17T01:06:54.078 INFO:tasks.workunit.client.1.smithi143.stdout:7/253: rmdir d4/d16 39 2024-09-17T01:06:54.079 INFO:tasks.workunit.client.1.smithi143.stdout:7/254: truncate d4/d26/f2b 242615 0 2024-09-17T01:06:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.081+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f667c02c480 con 0x7f667c100d60 2024-09-17T01:06:54.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.081+0000 7f66727fc640 1 -- 172.21.15.103:0/1980954497 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7f666c031c00 con 0x7f667c100d60 2024-09-17T01:06:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:06:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:06:54.081 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:06:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:54.083 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:06:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f666806d8a0 msgr2=0x7f666806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f666806d8a0 0x7f666806fd60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f667c100bc0 tx=0x7f6678005f90 comp rx=0 tx=0).stop 2024-09-17T01:06:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 msgr2=0x7f667c197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c197e20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f666c004650 tx=0x7f666c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 shutdown_connections 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f667c100d60 0x7f667c197e20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f666806d8a0 0x7f666806fd60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 --2- 172.21.15.103:0/1980954497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f667c0ffb60 0x7f667c1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 >> 172.21.15.103:0/1980954497 conn(0x7f667c0fb2f0 msgr2=0x7f667c072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 shutdown_connections 2024-09-17T01:06:54.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.083+0000 7f6683434640 1 -- 172.21.15.103:0/1980954497 wait complete. 2024-09-17T01:06:54.086 INFO:tasks.workunit.client.1.smithi143.stdout:7/255: read f2 [1656387,13458] 0 2024-09-17T01:06:54.086 INFO:tasks.workunit.client.1.smithi143.stdout:0/187: rmdir d3/d5/d8/d10 39 2024-09-17T01:06:54.086 INFO:tasks.workunit.client.1.smithi143.stdout:7/256: stat d4 0 2024-09-17T01:06:54.086 INFO:tasks.workunit.client.1.smithi143.stdout:8/163: write d9/d12/f2f [2268154,59697] 0 2024-09-17T01:06:54.087 INFO:tasks.workunit.client.1.smithi143.stdout:0/188: dread - d3/d5/d8/d21/f3b zero size 2024-09-17T01:06:54.087 INFO:tasks.workunit.client.1.smithi143.stdout:7/257: write d4/d1f/f30 [1160510,125201] 0 2024-09-17T01:06:54.087 INFO:tasks.workunit.client.1.smithi143.stdout:8/164: fsync d9/fa 0 2024-09-17T01:06:54.088 INFO:tasks.workunit.client.1.smithi143.stdout:8/165: stat d9/d26/d2c 0 2024-09-17T01:06:54.089 INFO:tasks.workunit.client.1.smithi143.stdout:0/189: mkdir d3/d14/d3d 0 2024-09-17T01:06:54.092 INFO:tasks.workunit.client.1.smithi143.stdout:7/258: creat d4/d26/f50 x:0 0 0 2024-09-17T01:06:54.092 INFO:tasks.workunit.client.1.smithi143.stdout:2/176: dwrite d0/d2/d21/f32 [4194304,4194304] 0 2024-09-17T01:06:54.093 INFO:tasks.workunit.client.1.smithi143.stdout:8/166: creat d9/d26/f3e x:0 0 0 2024-09-17T01:06:54.095 INFO:tasks.workunit.client.1.smithi143.stdout:0/190: dread - d3/d5/d8/d10/f2a zero size 2024-09-17T01:06:54.096 INFO:tasks.workunit.client.1.smithi143.stdout:8/167: chown d9/de/f21 1 1 2024-09-17T01:06:54.096 INFO:tasks.workunit.client.1.smithi143.stdout:0/191: dread - d3/d5/d8/d10/f3a zero size 2024-09-17T01:06:54.097 INFO:tasks.workunit.client.1.smithi143.stdout:2/177: chown d0/d2/d21/f2c 195530466 1 2024-09-17T01:06:54.100 INFO:tasks.workunit.client.1.smithi143.stdout:7/259: link d4/d26/f2b d4/d3a/f51 0 2024-09-17T01:06:54.101 INFO:tasks.workunit.client.1.smithi143.stdout:2/178: creat d0/d10/f33 x:0 0 0 2024-09-17T01:06:54.102 INFO:tasks.workunit.client.1.smithi143.stdout:7/260: dread - d4/d1f/f43 zero size 2024-09-17T01:06:54.102 INFO:tasks.workunit.client.1.smithi143.stdout:8/168: truncate d9/de/f10 1747299 0 2024-09-17T01:06:54.102 INFO:tasks.workunit.client.1.smithi143.stdout:2/179: write d0/d2/d21/f32 [6941205,26128] 0 2024-09-17T01:06:54.103 INFO:tasks.workunit.client.1.smithi143.stdout:7/261: chown d4/d1f/d29/c2e 53491356 1 2024-09-17T01:06:54.104 INFO:tasks.workunit.client.1.smithi143.stdout:0/192: rmdir d3/d5/d8/d21/d37 0 2024-09-17T01:06:54.105 INFO:tasks.workunit.client.1.smithi143.stdout:8/169: write d9/d12/f18 [3608129,79481] 0 2024-09-17T01:06:54.105 INFO:tasks.workunit.client.1.smithi143.stdout:2/180: creat d0/d10/f34 x:0 0 0 2024-09-17T01:06:54.106 INFO:tasks.workunit.client.1.smithi143.stdout:7/262: creat d4/d1f/f52 x:0 0 0 2024-09-17T01:06:54.107 INFO:tasks.workunit.client.1.smithi143.stdout:0/193: creat d3/d5/d8/d21/f3e x:0 0 0 2024-09-17T01:06:54.109 INFO:tasks.workunit.client.1.smithi143.stdout:8/170: mkdir d9/d12/d2d/d3f 0 2024-09-17T01:06:54.110 INFO:tasks.workunit.client.1.smithi143.stdout:2/181: rename d0/ld to d0/l35 0 2024-09-17T01:06:54.111 INFO:tasks.workunit.client.1.smithi143.stdout:7/263: creat d4/d3a/f53 x:0 0 0 2024-09-17T01:06:54.111 INFO:tasks.workunit.client.1.smithi143.stdout:0/194: rmdir d3/d14/d32 39 2024-09-17T01:06:54.113 INFO:tasks.workunit.client.1.smithi143.stdout:8/171: creat d9/d26/d2c/f40 x:0 0 0 2024-09-17T01:06:54.114 INFO:tasks.workunit.client.1.smithi143.stdout:2/182: rename d0/f31 to d0/d2/d21/d22/d24/f36 0 2024-09-17T01:06:54.115 INFO:tasks.workunit.client.1.smithi143.stdout:0/195: dread d3/d5/d8/d10/f25 [0,4194304] 0 2024-09-17T01:06:54.116 INFO:tasks.workunit.client.1.smithi143.stdout:8/172: creat d9/d12/d2d/f41 x:0 0 0 2024-09-17T01:06:54.116 INFO:tasks.workunit.client.1.smithi143.stdout:7/264: mknod d4/d33/d4e/c54 0 2024-09-17T01:06:54.117 INFO:tasks.workunit.client.1.smithi143.stdout:0/196: stat d3/d5/d8/d10/f25 0 2024-09-17T01:06:54.117 INFO:tasks.workunit.client.1.smithi143.stdout:2/183: symlink d0/l37 0 2024-09-17T01:06:54.117 INFO:tasks.workunit.client.1.smithi143.stdout:2/184: chown d0/c1e 93199003 1 2024-09-17T01:06:54.118 INFO:tasks.workunit.client.1.smithi143.stdout:8/173: chown d9/d23/d32 88916 1 2024-09-17T01:06:54.119 INFO:tasks.workunit.client.1.smithi143.stdout:6/110: sync 2024-09-17T01:06:54.119 INFO:tasks.workunit.client.1.smithi143.stdout:2/185: chown d0/d2/d21/d22/d24/f2a 95 1 2024-09-17T01:06:54.119 INFO:tasks.workunit.client.1.smithi143.stdout:0/197: creat d3/d5/d35/f3f x:0 0 0 2024-09-17T01:06:54.120 INFO:tasks.workunit.client.1.smithi143.stdout:7/265: symlink d4/l55 0 2024-09-17T01:06:54.120 INFO:tasks.workunit.client.1.smithi143.stdout:8/174: symlink d9/d23/d32/l42 0 2024-09-17T01:06:54.121 INFO:tasks.workunit.client.1.smithi143.stdout:2/186: symlink d0/d10/l38 0 2024-09-17T01:06:54.122 INFO:tasks.workunit.client.1.smithi143.stdout:0/198: truncate d3/d5/f34 431822 0 2024-09-17T01:06:54.128 INFO:tasks.workunit.client.1.smithi143.stdout:8/175: rmdir d9/d2b/d35 0 2024-09-17T01:06:54.128 INFO:tasks.workunit.client.1.smithi143.stdout:7/266: link d4/d1f/d29/c2e d4/d1f/c56 0 2024-09-17T01:06:54.129 INFO:tasks.workunit.client.1.smithi143.stdout:0/199: getdents d3/d14/d32 0 2024-09-17T01:06:54.130 INFO:tasks.workunit.client.1.smithi143.stdout:0/200: chown d3/lb 57863829 1 2024-09-17T01:06:54.131 INFO:tasks.workunit.client.1.smithi143.stdout:8/176: rename d9/d12/f2f to d9/d12/d38/f43 0 2024-09-17T01:06:54.132 INFO:tasks.workunit.client.1.smithi143.stdout:6/111: dread d2/fb [0,4194304] 0 2024-09-17T01:06:54.132 INFO:tasks.workunit.client.1.smithi143.stdout:7/267: creat d4/d1f/d4a/f57 x:0 0 0 2024-09-17T01:06:54.132 INFO:tasks.workunit.client.1.smithi143.stdout:8/177: stat d9/fa 0 2024-09-17T01:06:54.133 INFO:tasks.workunit.client.1.smithi143.stdout:8/178: stat d9/f11 0 2024-09-17T01:06:54.133 INFO:tasks.workunit.client.1.smithi143.stdout:0/201: creat d3/f40 x:0 0 0 2024-09-17T01:06:54.133 INFO:tasks.workunit.client.1.smithi143.stdout:7/268: truncate d4/f13 4957153 0 2024-09-17T01:06:54.134 INFO:tasks.workunit.client.1.smithi143.stdout:0/202: write d3/d5/f9 [3106881,20010] 0 2024-09-17T01:06:54.135 INFO:tasks.workunit.client.1.smithi143.stdout:6/112: truncate d2/d7/f8 980754 0 2024-09-17T01:06:54.137 INFO:tasks.workunit.client.1.smithi143.stdout:0/203: creat d3/d5/f41 x:0 0 0 2024-09-17T01:06:54.138 INFO:tasks.workunit.client.1.smithi143.stdout:0/204: chown d3/d5/d8/d10 7 1 2024-09-17T01:06:54.162 INFO:tasks.workunit.client.1.smithi143.stdout:5/237: sync 2024-09-17T01:06:54.162 INFO:tasks.workunit.client.1.smithi143.stdout:1/187: sync 2024-09-17T01:06:54.162 INFO:tasks.workunit.client.1.smithi143.stdout:4/211: sync 2024-09-17T01:06:54.162 INFO:tasks.workunit.client.1.smithi143.stdout:9/163: sync 2024-09-17T01:06:54.162 INFO:tasks.workunit.client.1.smithi143.stdout:3/134: sync 2024-09-17T01:06:54.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.177+0000 7f6a0718a640 1 -- 172.21.15.103:0/1957283201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 msgr2=0x7f6a00100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.177+0000 7f6a0718a640 1 --2- 172.21.15.103:0/1957283201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a00100810 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009880 tx=0x7f69f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.177+0000 7f6a0718a640 1 -- 172.21.15.103:0/1957283201 shutdown_connections 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.177+0000 7f6a0718a640 1 --2- 172.21.15.103:0/1957283201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a00100d50 0x7f6a001031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.177+0000 7f6a0718a640 1 --2- 172.21.15.103:0/1957283201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a00100810 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.177+0000 7f6a0718a640 1 -- 172.21.15.103:0/1957283201 >> 172.21.15.103:0/1957283201 conn(0x7f6a000fa230 msgr2=0x7f6a000fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 -- 172.21.15.103:0/1957283201 shutdown_connections 2024-09-17T01:06:54.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 -- 172.21.15.103:0/1957283201 wait complete. 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 Processor -- start 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 -- start start 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a0019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a00100d50 0x7f6a0019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0019c6e0 con 0x7f6a000fe400 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.178+0000 7f6a0718a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0019c850 con 0x7f6a00100d50 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a0019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a0019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46188/0 (socket says 172.21.15.103:46188) 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 -- 172.21.15.103:0/3117534265 learned_addr learned my addr 172.21.15.103:0/3117534265 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f69fffff640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a00100d50 0x7f6a0019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 -- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a00100d50 msgr2=0x7f6a0019c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a00100d50 0x7f6a0019c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 -- 172.21.15.103:0/3117534265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009560 con 0x7f6a000fe400 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a04f26640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a0019bbd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f69f40055a0 tx=0x7f69f40055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f4004aa0 con 0x7f6a000fe400 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a001a1290 con 0x7f6a000fe400 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69f4004c00 con 0x7f6a000fe400 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.179+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f4003b10 con 0x7f6a000fe400 2024-09-17T01:06:54.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.180+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a001a1800 con 0x7f6a000fe400 2024-09-17T01:06:54.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.180+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0010ed70 con 0x7f6a000fe400 2024-09-17T01:06:54.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.181+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f69f4003d40 con 0x7f6a000fe400 2024-09-17T01:06:54.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.181+0000 7f69fdffb640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f69f006d8a0 0x7f69f006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:54.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.181+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f69f40ae570 con 0x7f6a000fe400 2024-09-17T01:06:54.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.182+0000 7f69fffff640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f69f006d8a0 0x7f69f006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:54.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.182+0000 7f69fffff640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f69f006d8a0 0x7f69f006fd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a0019d0f0 tx=0x7f69ec005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:54.182 INFO:tasks.workunit.client.1.smithi143.stdout:2/187: dread d0/d2/fb [0,4194304] 0 2024-09-17T01:06:54.182 INFO:tasks.workunit.client.1.smithi143.stdout:3/135: chown d6/d1c 0 1 2024-09-17T01:06:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.186+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f69f4077b90 con 0x7f6a000fe400 2024-09-17T01:06:54.187 INFO:tasks.workunit.client.1.smithi143.stdout:9/164: dread d3/d16/d2b/d9/f1a [0,4194304] 0 2024-09-17T01:06:54.188 INFO:tasks.workunit.client.1.smithi143.stdout:7/269: dwrite d4/d33/f4b [0,4194304] 0 2024-09-17T01:06:54.192 INFO:tasks.workunit.client.1.smithi143.stdout:6/113: dwrite d2/f1f [0,4194304] 0 2024-09-17T01:06:54.192 INFO:tasks.workunit.client.1.smithi143.stdout:3/136: creat d6/d10/f28 x:0 0 0 2024-09-17T01:06:54.192 INFO:tasks.workunit.client.1.smithi143.stdout:9/165: dread - d3/d16/d2b/d9/f2e zero size 2024-09-17T01:06:54.192 INFO:tasks.workunit.client.1.smithi143.stdout:1/188: creat d0/d6/d7/de/d18/f3e x:0 0 0 2024-09-17T01:06:54.192 INFO:tasks.workunit.client.1.smithi143.stdout:6/114: stat d2/f1f 0 2024-09-17T01:06:54.196 INFO:tasks.workunit.client.1.smithi143.stdout:3/137: mkdir d6/d1c/d29 0 2024-09-17T01:06:54.196 INFO:tasks.workunit.client.1.smithi143.stdout:0/205: write d3/d14/d32/f38 [1166928,50671] 0 2024-09-17T01:06:54.197 INFO:tasks.workunit.client.1.smithi143.stdout:5/238: symlink d1/d46/df/d23/l5f 0 2024-09-17T01:06:54.198 INFO:tasks.workunit.client.1.smithi143.stdout:1/189: symlink d0/d6/d7/l3f 0 2024-09-17T01:06:54.200 INFO:tasks.workunit.client.1.smithi143.stdout:2/188: getdents d0 0 2024-09-17T01:06:54.201 INFO:tasks.workunit.client.1.smithi143.stdout:6/115: unlink d2/f11 0 2024-09-17T01:06:54.202 INFO:tasks.workunit.client.1.smithi143.stdout:3/138: truncate d6/d10/f16 144536 0 2024-09-17T01:06:54.204 INFO:tasks.workunit.client.1.smithi143.stdout:2/189: creat d0/d10/f39 x:0 0 0 2024-09-17T01:06:54.204 INFO:tasks.workunit.client.1.smithi143.stdout:3/139: chown d6 490574 1 2024-09-17T01:06:54.204 INFO:tasks.workunit.client.1.smithi143.stdout:6/116: rmdir d2/d7 39 2024-09-17T01:06:54.205 INFO:tasks.workunit.client.1.smithi143.stdout:7/270: dwrite d4/d16/f1d [0,4194304] 0 2024-09-17T01:06:54.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/271: chown d4/d3a/f51 11412967 1 2024-09-17T01:06:54.208 INFO:tasks.workunit.client.1.smithi143.stdout:0/206: link d3/d5/d8/d27/f18 d3/d5/d8/d21/f42 0 2024-09-17T01:06:54.209 INFO:tasks.workunit.client.1.smithi143.stdout:7/272: dread - d4/d1f/f43 zero size 2024-09-17T01:06:54.209 INFO:tasks.workunit.client.1.smithi143.stdout:0/207: chown d3/d5/d35 989 1 2024-09-17T01:06:54.210 INFO:tasks.workunit.client.1.smithi143.stdout:5/239: dread d1/d46/df/d1f/f30 [0,4194304] 0 2024-09-17T01:06:54.212 INFO:tasks.workunit.client.1.smithi143.stdout:7/273: truncate d4/d3a/f53 791992 0 2024-09-17T01:06:54.213 INFO:tasks.workunit.client.1.smithi143.stdout:2/190: dread d0/d2/fb [4194304,4194304] 0 2024-09-17T01:06:54.213 INFO:tasks.workunit.client.1.smithi143.stdout:6/117: dread d2/f16 [0,4194304] 0 2024-09-17T01:06:54.213 INFO:tasks.workunit.client.1.smithi143.stdout:0/208: symlink d3/d5/d8/d27/l43 0 2024-09-17T01:06:54.215 INFO:tasks.workunit.client.1.smithi143.stdout:2/191: chown d0/d10/f16 2015 1 2024-09-17T01:06:54.218 INFO:tasks.workunit.client.1.smithi143.stdout:9/166: truncate d3/d16/d2b/f2a 3747273 0 2024-09-17T01:06:54.219 INFO:tasks.workunit.client.1.smithi143.stdout:6/118: fdatasync d2/fb 0 2024-09-17T01:06:54.221 INFO:tasks.workunit.client.1.smithi143.stdout:7/274: link d4/f18 d4/f58 0 2024-09-17T01:06:54.222 INFO:tasks.workunit.client.1.smithi143.stdout:0/209: creat d3/d5/d8/f44 x:0 0 0 2024-09-17T01:06:54.223 INFO:tasks.workunit.client.1.smithi143.stdout:5/240: rename d1/d46/df/d23/d4f/l3a to d1/d46/df/l60 0 2024-09-17T01:06:54.224 INFO:tasks.workunit.client.1.smithi143.stdout:0/210: write d3/d5/f41 [934216,94071] 0 2024-09-17T01:06:54.226 INFO:tasks.workunit.client.1.smithi143.stdout:0/211: chown d3/d5/fc 32 1 2024-09-17T01:06:54.226 INFO:tasks.workunit.client.1.smithi143.stdout:5/241: truncate d1/d46/df/f54 20099 0 2024-09-17T01:06:54.227 INFO:tasks.workunit.client.1.smithi143.stdout:7/275: dread d4/d1f/f30 [0,4194304] 0 2024-09-17T01:06:54.229 INFO:tasks.workunit.client.1.smithi143.stdout:0/212: write d3/d5/d8/d21/f30 [70576,18456] 0 2024-09-17T01:06:54.230 INFO:tasks.workunit.client.1.smithi143.stdout:5/242: creat d1/d46/df/d53/f61 x:0 0 0 2024-09-17T01:06:54.231 INFO:tasks.workunit.client.1.smithi143.stdout:1/190: dread d0/d6/d7/de/fb [0,4194304] 0 2024-09-17T01:06:54.233 INFO:tasks.workunit.client.1.smithi143.stdout:9/167: dread d3/d16/d2b/f2a [0,4194304] 0 2024-09-17T01:06:54.233 INFO:tasks.workunit.client.1.smithi143.stdout:7/276: symlink d4/l59 0 2024-09-17T01:06:54.234 INFO:tasks.workunit.client.1.smithi143.stdout:1/191: chown d0/d6/d7/de/fb 0 1 2024-09-17T01:06:54.234 INFO:tasks.workunit.client.1.smithi143.stdout:5/243: truncate d1/d46/df/f3d 207023 0 2024-09-17T01:06:54.235 INFO:tasks.workunit.client.1.smithi143.stdout:0/213: dread d3/d5/f9 [4194304,4194304] 0 2024-09-17T01:06:54.236 INFO:tasks.workunit.client.1.smithi143.stdout:7/277: symlink d4/d3a/l5a 0 2024-09-17T01:06:54.237 INFO:tasks.workunit.client.1.smithi143.stdout:5/244: truncate d1/d46/df/d23/f4e 807937 0 2024-09-17T01:06:54.237 INFO:tasks.workunit.client.1.smithi143.stdout:1/192: mkdir d0/d6/d7/de/d2/d40 0 2024-09-17T01:06:54.238 INFO:tasks.workunit.client.1.smithi143.stdout:5/245: chown d1/d46/l15 587178046 1 2024-09-17T01:06:54.238 INFO:tasks.workunit.client.1.smithi143.stdout:9/168: truncate d3/d16/d2b/fb 1045114 0 2024-09-17T01:06:54.239 INFO:tasks.workunit.client.1.smithi143.stdout:1/193: dread - d0/dc/f38 zero size 2024-09-17T01:06:54.239 INFO:tasks.workunit.client.1.smithi143.stdout:0/214: fdatasync d3/d5/d8/d10/f25 0 2024-09-17T01:06:54.240 INFO:tasks.workunit.client.1.smithi143.stdout:1/194: readlink d0/l24 0 2024-09-17T01:06:54.240 INFO:tasks.workunit.client.1.smithi143.stdout:5/246: dread - d1/f3f zero size 2024-09-17T01:06:54.241 INFO:tasks.workunit.client.1.smithi143.stdout:9/169: rmdir d3/d16/d34 39 2024-09-17T01:06:54.243 INFO:tasks.workunit.client.1.smithi143.stdout:7/278: dwrite d4/f41 [0,4194304] 0 2024-09-17T01:06:54.244 INFO:tasks.workunit.client.1.smithi143.stdout:1/195: mknod d0/d6/d7/df/c41 0 2024-09-17T01:06:54.244 INFO:tasks.workunit.client.1.smithi143.stdout:7/279: fdatasync d4/d16/f17 0 2024-09-17T01:06:54.245 INFO:tasks.workunit.client.1.smithi143.stdout:1/196: stat d0/d6/d7/de/l32 0 2024-09-17T01:06:54.246 INFO:tasks.workunit.client.1.smithi143.stdout:1/197: fdatasync d0/d6/fd 0 2024-09-17T01:06:54.248 INFO:tasks.workunit.client.1.smithi143.stdout:7/280: truncate d4/d1f/d4a/f57 1031786 0 2024-09-17T01:06:54.249 INFO:tasks.workunit.client.1.smithi143.stdout:1/198: read - d0/d6/d7/de/d18/f3e zero size 2024-09-17T01:06:54.251 INFO:tasks.workunit.client.1.smithi143.stdout:5/247: dread d1/d46/df/d23/f26 [0,4194304] 0 2024-09-17T01:06:54.251 INFO:tasks.workunit.client.1.smithi143.stdout:1/199: write d0/d6/f23 [545582,49754] 0 2024-09-17T01:06:54.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/248: creat d1/d46/df/f62 x:0 0 0 2024-09-17T01:06:54.255 INFO:tasks.workunit.client.1.smithi143.stdout:9/170: write d3/d16/d2b/d9/f1a [593848,1369] 0 2024-09-17T01:06:54.255 INFO:tasks.workunit.client.1.smithi143.stdout:9/171: stat d3/d16/f1d 0 2024-09-17T01:06:54.256 INFO:tasks.workunit.client.1.smithi143.stdout:1/200: rename d0/d6/f11 to d0/d6/d7/f42 0 2024-09-17T01:06:54.257 INFO:tasks.workunit.client.1.smithi143.stdout:7/281: link d4/d26/f2b d4/d33/d4e/f5b 0 2024-09-17T01:06:54.257 INFO:tasks.workunit.client.1.smithi143.stdout:5/249: symlink d1/d46/l63 0 2024-09-17T01:06:54.258 INFO:tasks.workunit.client.1.smithi143.stdout:1/201: write d0/d6/f20 [764674,100981] 0 2024-09-17T01:06:54.258 INFO:tasks.workunit.client.1.smithi143.stdout:7/282: write d4/d26/f50 [239647,130756] 0 2024-09-17T01:06:54.260 INFO:tasks.workunit.client.1.smithi143.stdout:7/283: fdatasync d4/d1f/f23 0 2024-09-17T01:06:54.260 INFO:tasks.workunit.client.1.smithi143.stdout:9/172: mkdir d3/d39 0 2024-09-17T01:06:54.263 INFO:tasks.workunit.client.1.smithi143.stdout:9/173: truncate d3/d16/d34/f36 626680 0 2024-09-17T01:06:54.266 INFO:tasks.workunit.client.1.smithi143.stdout:5/250: creat d1/d46/d4c/f64 x:0 0 0 2024-09-17T01:06:54.268 INFO:tasks.workunit.client.1.smithi143.stdout:9/174: dread d3/d16/d2b/f12 [0,4194304] 0 2024-09-17T01:06:54.268 INFO:tasks.workunit.client.1.smithi143.stdout:9/175: chown d3/d16/d2b/ce 126205 1 2024-09-17T01:06:54.270 INFO:tasks.workunit.client.1.smithi143.stdout:5/251: truncate d1/d46/f2d 4813165 0 2024-09-17T01:06:54.271 INFO:tasks.workunit.client.1.smithi143.stdout:1/202: rmdir d0/d6/d7/de/d2/d40 0 2024-09-17T01:06:54.271 INFO:tasks.workunit.client.1.smithi143.stdout:9/176: chown d3/l13 418 1 2024-09-17T01:06:54.272 INFO:tasks.workunit.client.1.smithi143.stdout:9/177: write d3/d16/f22 [513296,43642] 0 2024-09-17T01:06:54.273 INFO:tasks.workunit.client.1.smithi143.stdout:1/203: fdatasync d0/d6/d7/f42 0 2024-09-17T01:06:54.274 INFO:tasks.workunit.client.1.smithi143.stdout:7/284: getdents d4/d3a 0 2024-09-17T01:06:54.275 INFO:tasks.workunit.client.1.smithi143.stdout:7/285: stat d4/d1f/f23 0 2024-09-17T01:06:54.277 INFO:tasks.workunit.client.1.smithi143.stdout:9/178: creat d3/d16/d34/f3a x:0 0 0 2024-09-17T01:06:54.278 INFO:tasks.workunit.client.1.smithi143.stdout:5/252: dwrite d1/d46/df/d23/f4e [0,4194304] 0 2024-09-17T01:06:54.292 INFO:tasks.workunit.client.1.smithi143.stdout:1/204: mkdir d0/d6/d43 0 2024-09-17T01:06:54.292 INFO:tasks.workunit.client.1.smithi143.stdout:5/253: chown d1/d46/df/d53/f61 0 1 2024-09-17T01:06:54.294 INFO:tasks.workunit.client.1.smithi143.stdout:1/205: truncate d0/d6/d7/de/f14 4275134 0 2024-09-17T01:06:54.295 INFO:tasks.workunit.client.1.smithi143.stdout:5/254: creat d1/d5e/f65 x:0 0 0 2024-09-17T01:06:54.297 INFO:tasks.workunit.client.1.smithi143.stdout:5/255: readlink d1/d46/l17 0 2024-09-17T01:06:54.297 INFO:tasks.workunit.client.1.smithi143.stdout:1/206: dread d0/dc/f2c [0,4194304] 0 2024-09-17T01:06:54.300 INFO:tasks.workunit.client.1.smithi143.stdout:1/207: creat d0/d6/d43/f44 x:0 0 0 2024-09-17T01:06:54.301 INFO:tasks.workunit.client.1.smithi143.stdout:9/179: dwrite d3/f14 [0,4194304] 0 2024-09-17T01:06:54.302 INFO:tasks.workunit.client.1.smithi143.stdout:9/180: truncate d3/d16/d34/f3a 773820 0 2024-09-17T01:06:54.310 INFO:tasks.workunit.client.1.smithi143.stdout:1/208: dwrite d0/dc/f2c [0,4194304] 0 2024-09-17T01:06:54.310 INFO:tasks.workunit.client.1.smithi143.stdout:1/209: fsync d0/dc/f38 0 2024-09-17T01:06:54.314 INFO:tasks.workunit.client.1.smithi143.stdout:1/210: rename d0/d6/fd to d0/d6/d7/de/d2/d3c/f45 0 2024-09-17T01:06:54.316 INFO:tasks.workunit.client.1.smithi143.stdout:9/181: truncate d3/d16/d2b/f2a 1057501 0 2024-09-17T01:06:54.318 INFO:tasks.workunit.client.1.smithi143.stdout:9/182: mknod d3/d16/d34/c3b 0 2024-09-17T01:06:54.321 INFO:tasks.workunit.client.1.smithi143.stdout:1/211: dwrite d0/d6/d7/df/d27/f2e [4194304,4194304] 0 2024-09-17T01:06:54.321 INFO:tasks.workunit.client.1.smithi143.stdout:9/183: creat d3/d16/d2b/d26/f3c x:0 0 0 2024-09-17T01:06:54.326 INFO:tasks.workunit.client.1.smithi143.stdout:9/184: mkdir d3/d3d 0 2024-09-17T01:06:54.328 INFO:tasks.workunit.client.1.smithi143.stdout:9/185: fdatasync d3/f4 0 2024-09-17T01:06:54.329 INFO:tasks.workunit.client.1.smithi143.stdout:1/212: link d0/d6/c3b d0/d6/d7/de/d18/d2d/c46 0 2024-09-17T01:06:54.331 INFO:tasks.workunit.client.1.smithi143.stdout:9/186: rmdir d3/d16 39 2024-09-17T01:06:54.332 INFO:tasks.workunit.client.1.smithi143.stdout:1/213: write d0/d6/d7/de/fb [4193359,76747] 0 2024-09-17T01:06:54.333 INFO:tasks.workunit.client.1.smithi143.stdout:9/187: fsync d3/d16/d2b/fc 0 2024-09-17T01:06:54.334 INFO:tasks.workunit.client.1.smithi143.stdout:9/188: fdatasync d3/d16/d2b/fc 0 2024-09-17T01:06:54.337 INFO:tasks.workunit.client.1.smithi143.stdout:9/189: mkdir d3/d16/d3e 0 2024-09-17T01:06:54.338 INFO:tasks.workunit.client.1.smithi143.stdout:1/214: write d0/d6/d7/de/f1d [241995,12202] 0 2024-09-17T01:06:54.338 INFO:tasks.workunit.client.1.smithi143.stdout:1/215: stat d0/dc 0 2024-09-17T01:06:54.345 INFO:tasks.workunit.client.1.smithi143.stdout:9/190: dwrite d3/d16/f1d [0,4194304] 0 2024-09-17T01:06:54.345 INFO:tasks.workunit.client.1.smithi143.stdout:1/216: dwrite d0/dc/f38 [0,4194304] 0 2024-09-17T01:06:54.354 INFO:tasks.workunit.client.1.smithi143.stdout:9/191: dwrite d3/d16/d2b/fc [0,4194304] 0 2024-09-17T01:06:54.359 INFO:tasks.workunit.client.1.smithi143.stdout:1/217: dread d0/d6/d7/de/f1d [4194304,4194304] 0 2024-09-17T01:06:54.361 INFO:tasks.workunit.client.1.smithi143.stdout:1/218: write d0/d6/f20 [3201742,86528] 0 2024-09-17T01:06:54.362 INFO:tasks.workunit.client.1.smithi143.stdout:9/192: dread d3/d16/d2b/d9/f27 [0,4194304] 0 2024-09-17T01:06:54.362 INFO:tasks.workunit.client.1.smithi143.stdout:9/193: read d3/d16/f22 [533976,1211] 0 2024-09-17T01:06:54.364 INFO:tasks.workunit.client.1.smithi143.stdout:1/219: truncate d0/d6/d7/de/d2/f3d 753843 0 2024-09-17T01:06:54.364 INFO:tasks.workunit.client.1.smithi143.stdout:1/220: readlink d0/d6/d7/l3f 0 2024-09-17T01:06:54.366 INFO:tasks.workunit.client.1.smithi143.stdout:1/221: mkdir d0/d6/d43/d47 0 2024-09-17T01:06:54.369 INFO:tasks.workunit.client.1.smithi143.stdout:9/194: dwrite d3/d16/d2b/fc [0,4194304] 0 2024-09-17T01:06:54.377 INFO:tasks.workunit.client.1.smithi143.stdout:1/222: dwrite d0/dc/f38 [0,4194304] 0 2024-09-17T01:06:54.378 INFO:tasks.workunit.client.1.smithi143.stdout:1/223: chown d0/d6/f29 100360 1 2024-09-17T01:06:54.380 INFO:tasks.workunit.client.1.smithi143.stdout:1/224: truncate d0/dc/f38 5060494 0 2024-09-17T01:06:54.381 INFO:tasks.workunit.client.1.smithi143.stdout:1/225: readlink d0/l26 0 2024-09-17T01:06:54.382 INFO:tasks.workunit.client.1.smithi143.stdout:9/195: dwrite d3/d16/d2b/fb [0,4194304] 0 2024-09-17T01:06:54.384 INFO:tasks.workunit.client.1.smithi143.stdout:9/196: readlink l0 0 2024-09-17T01:06:54.385 INFO:tasks.workunit.client.1.smithi143.stdout:9/197: dread - d3/d16/d2b/d9/f2e zero size 2024-09-17T01:06:54.386 INFO:tasks.workunit.client.1.smithi143.stdout:9/198: fsync d3/d16/d2b/f1c 0 2024-09-17T01:06:54.387 INFO:tasks.workunit.client.1.smithi143.stdout:1/226: dread d0/d6/d7/de/d2/f2a [0,4194304] 0 2024-09-17T01:06:54.390 INFO:tasks.workunit.client.1.smithi143.stdout:1/227: chown d0/d6/d7/l34 758580 1 2024-09-17T01:06:54.396 INFO:tasks.workunit.client.1.smithi143.stdout:9/199: truncate d3/f14 1300063 0 2024-09-17T01:06:54.396 INFO:tasks.workunit.client.1.smithi143.stdout:1/228: dwrite d0/d6/d7/de/f14 [0,4194304] 0 2024-09-17T01:06:54.396 INFO:tasks.workunit.client.1.smithi143.stdout:9/200: stat d3/d16/d2b/d9 0 2024-09-17T01:06:54.398 INFO:tasks.workunit.client.1.smithi143.stdout:1/229: write d0/d6/f3a [5947565,53571] 0 2024-09-17T01:06:54.399 INFO:tasks.workunit.client.1.smithi143.stdout:9/201: mknod d3/c3f 0 2024-09-17T01:06:54.400 INFO:tasks.workunit.client.1.smithi143.stdout:9/202: fdatasync d3/d16/d2b/d9/f1a 0 2024-09-17T01:06:54.401 INFO:tasks.workunit.client.1.smithi143.stdout:1/230: creat d0/d6/d7/f48 x:0 0 0 2024-09-17T01:06:54.403 INFO:tasks.workunit.client.1.smithi143.stdout:1/231: symlink d0/d6/d7/l49 0 2024-09-17T01:06:54.405 INFO:tasks.workunit.client.1.smithi143.stdout:1/232: write d0/d6/d7/df/f1a [4991382,15608] 0 2024-09-17T01:06:54.405 INFO:tasks.workunit.client.1.smithi143.stdout:9/203: dwrite d3/d16/d2b/fc [0,4194304] 0 2024-09-17T01:06:54.407 INFO:tasks.workunit.client.1.smithi143.stdout:9/204: chown d3/d16/d2b 1008 1 2024-09-17T01:06:54.410 INFO:tasks.workunit.client.1.smithi143.stdout:9/205: mknod d3/c40 0 2024-09-17T01:06:54.414 INFO:tasks.workunit.client.1.smithi143.stdout:1/233: dread d0/dc/f2c [0,4194304] 0 2024-09-17T01:06:54.416 INFO:tasks.workunit.client.1.smithi143.stdout:1/234: mknod d0/d6/d7/df/d27/c4a 0 2024-09-17T01:06:54.419 INFO:tasks.workunit.client.1.smithi143.stdout:1/235: getdents d0/d6/d7/de/d18/d2d 0 2024-09-17T01:06:54.420 INFO:tasks.workunit.client.1.smithi143.stdout:1/236: write d0/f19 [4551606,52423] 0 2024-09-17T01:06:54.421 INFO:tasks.workunit.client.1.smithi143.stdout:1/237: chown d0/d6/d7/de/d2/d3c/f45 9 1 2024-09-17T01:06:54.424 INFO:tasks.workunit.client.1.smithi143.stdout:1/238: rename d0/c25 to d0/d6/d7/de/d18/d2d/c4b 0 2024-09-17T01:06:54.426 INFO:tasks.workunit.client.1.smithi143.stdout:1/239: symlink d0/d6/l4c 0 2024-09-17T01:06:54.426 INFO:tasks.workunit.client.1.smithi143.stdout:1/240: stat d0/dc/f2c 0 2024-09-17T01:06:54.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:54 smithi103 ceph-mon[28156]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:54.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:54 smithi103 ceph-mon[28156]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:54 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/4001987992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:54 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1980954497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:54.427 INFO:tasks.workunit.client.1.smithi143.stdout:1/241: mkdir d0/d6/d7/de/d18/d4d 0 2024-09-17T01:06:54.430 INFO:tasks.workunit.client.1.smithi143.stdout:1/242: rename d0/d6/d7/de/l32 to d0/d6/d43/l4e 0 2024-09-17T01:06:54.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.432+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a00101710 con 0x7f69f006d8a0 2024-09-17T01:06:54.432 INFO:tasks.workunit.client.1.smithi143.stdout:1/243: mknod d0/dc/c4f 0 2024-09-17T01:06:54.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.433+0000 7f69fdffb640 1 -- 172.21.15.103:0/3117534265 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6a00101710 con 0x7f69f006d8a0 2024-09-17T01:06:54.432 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [], 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:06:54.433 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:06:54.433 INFO:tasks.workunit.client.1.smithi143.stdout:1/244: chown d0/dc/f2c 12 1 2024-09-17T01:06:54.434 INFO:tasks.workunit.client.1.smithi143.stdout:1/245: write d0/d6/f3a [3707988,25780] 0 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f69f006d8a0 msgr2=0x7f69f006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f69f006d8a0 0x7f69f006fd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a0019d0f0 tx=0x7f69ec005f90 comp rx=0 tx=0).stop 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 msgr2=0x7f6a0019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a0019bbd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f69f40055a0 tx=0x7f69f40055d0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 shutdown_connections 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f69f006d8a0 0x7f69f006fd60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a00100d50 0x7f6a0019c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 --2- 172.21.15.103:0/3117534265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a000fe400 0x7f6a0019bbd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.435+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 >> 172.21.15.103:0/3117534265 conn(0x7f6a000fa230 msgr2=0x7f6a000fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:54.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.436+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 shutdown_connections 2024-09-17T01:06:54.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.436+0000 7f6a0718a640 1 -- 172.21.15.103:0/3117534265 wait complete. 2024-09-17T01:06:54.436 INFO:tasks.workunit.client.1.smithi143.stdout:1/246: readlink d0/l24 0 2024-09-17T01:06:54.436 INFO:tasks.workunit.client.1.smithi143.stdout:9/206: dwrite d3/d16/f22 [0,4194304] 0 2024-09-17T01:06:54.437 INFO:tasks.workunit.client.1.smithi143.stdout:1/247: chown d0/d6/d7/de/d18/d4d 94943 1 2024-09-17T01:06:54.442 INFO:tasks.workunit.client.1.smithi143.stdout:9/207: getdents d3/d16/d2b/d26 0 2024-09-17T01:06:54.453 INFO:tasks.workunit.client.1.smithi143.stdout:8/179: sync 2024-09-17T01:06:54.453 INFO:tasks.workunit.client.1.smithi143.stdout:8/180: chown d9/d12/d38/f43 995180 1 2024-09-17T01:06:54.454 INFO:tasks.workunit.client.1.smithi143.stdout:8/181: dread - d9/d12/d2d/f41 zero size 2024-09-17T01:06:54.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:54 smithi143 ceph-mon[35452]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:54.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:54 smithi143 ceph-mon[35452]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:54.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:54 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/4001987992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:54.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:54 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1980954497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:54.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 -- 172.21.15.103:0/1072100607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c81006b0 msgr2=0x7fb7c8102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/1072100607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c81006b0 0x7fb7c8102aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009880 tx=0x7fb7c402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 -- 172.21.15.103:0/1072100607 shutdown_connections 2024-09-17T01:06:54.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/1072100607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7c8102fe0 0x7fb7c81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/1072100607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c81006b0 0x7fb7c8102aa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 -- 172.21.15.103:0/1072100607 >> 172.21.15.103:0/1072100607 conn(0x7fb7c80fa230 msgr2=0x7fb7c80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 -- 172.21.15.103:0/1072100607 shutdown_connections 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.518+0000 7fb7d07a7640 1 -- 172.21.15.103:0/1072100607 wait complete. 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7d07a7640 1 Processor -- start 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7d07a7640 1 -- start start 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7d07a7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7c81006b0 0x7fb7c8100010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7d07a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 0x7fb7c80fe660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7d07a7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c80feba0 con 0x7fb7c8102fe0 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7d07a7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c80fed10 con 0x7fb7c81006b0 2024-09-17T01:06:54.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7cdd42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 0x7fb7c80fe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7cdd42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 0x7fb7c80fe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46198/0 (socket says 172.21.15.103:46198) 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7cdd42640 1 -- 172.21.15.103:0/142839998 learned_addr learned my addr 172.21.15.103:0/142839998 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7ce543640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7c81006b0 0x7fb7c8100010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7cdd42640 1 -- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7c81006b0 msgr2=0x7fb7c8100010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7cdd42640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7c81006b0 0x7fb7c8100010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.519+0000 7fb7cdd42640 1 -- 172.21.15.103:0/142839998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c4009560 con 0x7fb7c8102fe0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.520+0000 7fb7cdd42640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 0x7fb7c80fe660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800e970 tx=0x7fb7b800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.520+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7b800cc90 con 0x7fb7c8102fe0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.520+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7b800cdf0 con 0x7fb7c8102fe0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.520+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7b8010430 con 0x7fb7c8102fe0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.520+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c80feff0 con 0x7fb7c8102fe0 2024-09-17T01:06:54.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.520+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c819d660 con 0x7fb7c8102fe0 2024-09-17T01:06:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.521+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c81087b0 con 0x7fb7c8102fe0 2024-09-17T01:06:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.521+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fb7b80046c0 con 0x7fb7c8102fe0 2024-09-17T01:06:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.522+0000 7fb7bf7fe640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fb7b406d8a0 0x7fb7b406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:54.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.522+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fb7b8014070 con 0x7fb7c8102fe0 2024-09-17T01:06:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.522+0000 7fb7ce543640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fb7b406d8a0 0x7fb7b406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:54.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.522+0000 7fb7ce543640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fb7b406d8a0 0x7fb7b406fd60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4000c00 tx=0x7fb7c40314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:54.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.526+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb7b8056f70 con 0x7fb7c8102fe0 2024-09-17T01:06:54.550 INFO:tasks.workunit.client.1.smithi143.stdout:4/212: sync 2024-09-17T01:06:54.574 INFO:tasks.workunit.client.1.smithi143.stdout:4/213: write da/f2a [2949625,60502] 0 2024-09-17T01:06:54.574 INFO:tasks.workunit.client.1.smithi143.stdout:8/182: rename d9/d26/d2c/l31 to d9/d2b/l44 0 2024-09-17T01:06:54.576 INFO:tasks.workunit.client.1.smithi143.stdout:4/214: creat da/d3a/d3e/d42/f46 x:0 0 0 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:2/192: sync 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:1/248: sync 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:3/140: sync 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:6/119: sync 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:5/256: sync 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:7/286: sync 2024-09-17T01:06:54.586 INFO:tasks.workunit.client.1.smithi143.stdout:0/215: sync 2024-09-17T01:06:54.587 INFO:tasks.workunit.client.1.smithi143.stdout:7/287: read - d4/d1f/f52 zero size 2024-09-17T01:06:54.587 INFO:tasks.workunit.client.1.smithi143.stdout:3/141: write d6/d10/f1a [4936289,6035] 0 2024-09-17T01:06:54.589 INFO:tasks.workunit.client.1.smithi143.stdout:9/208: dread d3/d16/d2b/f1c [0,4194304] 0 2024-09-17T01:06:54.617 INFO:tasks.workunit.client.1.smithi143.stdout:5/257: readlink d1/d46/l27 0 2024-09-17T01:06:54.640 INFO:tasks.workunit.client.1.smithi143.stdout:2/193: mknod d0/d10/c3a 0 2024-09-17T01:06:54.643 INFO:tasks.workunit.client.1.smithi143.stdout:3/142: fdatasync d6/f24 0 2024-09-17T01:06:54.643 INFO:tasks.workunit.client.1.smithi143.stdout:7/288: rename d4/d16/c46 to d4/d33/d4e/c5c 0 2024-09-17T01:06:54.643 INFO:tasks.workunit.client.1.smithi143.stdout:3/143: chown d6 1391 1 2024-09-17T01:06:54.643 INFO:tasks.workunit.client.1.smithi143.stdout:9/209: creat d3/d16/d2b/d9/f41 x:0 0 0 2024-09-17T01:06:54.643 INFO:tasks.workunit.client.1.smithi143.stdout:2/194: fsync d0/d2/d21/f27 0 2024-09-17T01:06:54.643 INFO:tasks.workunit.client.1.smithi143.stdout:4/215: mknod da/d3a/c47 0 2024-09-17T01:06:54.644 INFO:tasks.workunit.client.1.smithi143.stdout:8/183: link d9/d2b/l44 d9/d12/d2d/d3f/l45 0 2024-09-17T01:06:54.644 INFO:tasks.workunit.client.1.smithi143.stdout:5/258: readlink d1/d46/df/d23/d4f/l31 0 2024-09-17T01:06:54.644 INFO:tasks.workunit.client.1.smithi143.stdout:3/144: write d6/f1f [908132,19489] 0 2024-09-17T01:06:54.646 INFO:tasks.workunit.client.1.smithi143.stdout:0/216: getdents d3 0 2024-09-17T01:06:54.646 INFO:tasks.workunit.client.1.smithi143.stdout:9/210: mkdir d3/d39/d42 0 2024-09-17T01:06:54.647 INFO:tasks.workunit.client.1.smithi143.stdout:4/216: creat da/d3a/d40/f48 x:0 0 0 2024-09-17T01:06:54.650 INFO:tasks.workunit.client.1.smithi143.stdout:0/217: dread - d3/d5/d8/f44 zero size 2024-09-17T01:06:54.650 INFO:tasks.workunit.client.1.smithi143.stdout:8/184: truncate d9/d26/f36 115715 0 2024-09-17T01:06:54.651 INFO:tasks.workunit.client.1.smithi143.stdout:2/195: rename d0/d10/f20 to d0/d2/d21/f3b 0 2024-09-17T01:06:54.652 INFO:tasks.workunit.client.1.smithi143.stdout:5/259: mkdir d1/d46/df/d1f/d66 0 2024-09-17T01:06:54.654 INFO:tasks.workunit.client.1.smithi143.stdout:6/120: dwrite d2/f16 [0,4194304] 0 2024-09-17T01:06:54.654 INFO:tasks.workunit.client.1.smithi143.stdout:7/289: truncate d4/d1f/d29/f35 3771146 0 2024-09-17T01:06:54.656 INFO:tasks.workunit.client.1.smithi143.stdout:8/185: read - d9/d26/d2c/f40 zero size 2024-09-17T01:06:54.656 INFO:tasks.workunit.client.1.smithi143.stdout:2/196: stat d0/d2/d21/d22/d24 0 2024-09-17T01:06:54.656 INFO:tasks.workunit.client.1.smithi143.stdout:3/145: rename d6/f24 to d6/d1c/f2a 0 2024-09-17T01:06:54.657 INFO:tasks.workunit.client.1.smithi143.stdout:6/121: write d2/f16 [4335569,54385] 0 2024-09-17T01:06:54.663 INFO:tasks.workunit.client.1.smithi143.stdout:4/217: dread f2 [0,4194304] 0 2024-09-17T01:06:54.664 INFO:tasks.workunit.client.1.smithi143.stdout:0/218: dread d3/d5/f29 [0,4194304] 0 2024-09-17T01:06:54.665 INFO:tasks.workunit.client.1.smithi143.stdout:2/197: unlink d0/d2/d21/d22/d24/f26 0 2024-09-17T01:06:54.666 INFO:tasks.workunit.client.1.smithi143.stdout:5/260: mknod d1/d46/df/d23/c67 0 2024-09-17T01:06:54.666 INFO:tasks.workunit.client.1.smithi143.stdout:4/218: truncate da/d3a/d40/f37 467957 0 2024-09-17T01:06:54.667 INFO:tasks.workunit.client.1.smithi143.stdout:9/211: dwrite d3/d16/d2b/f12 [0,4194304] 0 2024-09-17T01:06:54.668 INFO:tasks.workunit.client.1.smithi143.stdout:0/219: write d3/d5/d8/d10/f3a [505398,52763] 0 2024-09-17T01:06:54.670 INFO:tasks.workunit.client.1.smithi143.stdout:7/290: rename d4/d3a to d4/d16/d47/d5d 0 2024-09-17T01:06:54.672 INFO:tasks.workunit.client.1.smithi143.stdout:7/291: write d4/d1f/f3e [625185,87991] 0 2024-09-17T01:06:54.672 INFO:tasks.workunit.client.1.smithi143.stdout:2/198: creat d0/d2/d21/d22/f3c x:0 0 0 2024-09-17T01:06:54.673 INFO:tasks.workunit.client.1.smithi143.stdout:4/219: mkdir da/d3a/d3e/d49 0 2024-09-17T01:06:54.674 INFO:tasks.workunit.client.1.smithi143.stdout:2/199: chown d0/l12 27 1 2024-09-17T01:06:54.674 INFO:tasks.workunit.client.1.smithi143.stdout:4/220: chown da 12638 1 2024-09-17T01:06:54.674 INFO:tasks.workunit.client.1.smithi143.stdout:0/220: creat d3/d14/d17/f45 x:0 0 0 2024-09-17T01:06:54.675 INFO:tasks.workunit.client.1.smithi143.stdout:8/186: creat d9/f46 x:0 0 0 2024-09-17T01:06:54.677 INFO:tasks.workunit.client.1.smithi143.stdout:4/221: fdatasync da/d3a/d3e/d42/f46 0 2024-09-17T01:06:54.681 INFO:tasks.workunit.client.1.smithi143.stdout:2/200: mkdir d0/d2/d21/d22/d3d 0 2024-09-17T01:06:54.681 INFO:tasks.workunit.client.1.smithi143.stdout:0/221: write d3/d5/d8/d21/f3b [270623,71733] 0 2024-09-17T01:06:54.681 INFO:tasks.workunit.client.1.smithi143.stdout:3/146: dread d6/f1f [0,4194304] 0 2024-09-17T01:06:54.683 INFO:tasks.workunit.client.1.smithi143.stdout:9/212: rename d3/f14 to d3/d3d/f43 0 2024-09-17T01:06:54.684 INFO:tasks.workunit.client.1.smithi143.stdout:5/261: link d1/d46/df/d53/f55 d1/f68 0 2024-09-17T01:06:54.685 INFO:tasks.workunit.client.1.smithi143.stdout:4/222: stat c0 0 2024-09-17T01:06:54.687 INFO:tasks.workunit.client.1.smithi143.stdout:9/213: write d3/d16/d2b/f1c [139357,69553] 0 2024-09-17T01:06:54.688 INFO:tasks.workunit.client.1.smithi143.stdout:8/187: dwrite d9/d26/f36 [0,4194304] 0 2024-09-17T01:06:54.692 INFO:tasks.workunit.client.1.smithi143.stdout:0/222: symlink d3/d5/d35/l46 0 2024-09-17T01:06:54.693 INFO:tasks.workunit.client.1.smithi143.stdout:4/223: fsync f2 0 2024-09-17T01:06:54.693 INFO:tasks.workunit.client.1.smithi143.stdout:3/147: read d6/ff [1501607,106971] 0 2024-09-17T01:06:54.694 INFO:tasks.workunit.client.1.smithi143.stdout:1/249: sync 2024-09-17T01:06:54.695 INFO:tasks.workunit.client.1.smithi143.stdout:1/250: fdatasync d0/d6/f20 0 2024-09-17T01:06:54.695 INFO:tasks.workunit.client.1.smithi143.stdout:2/201: dread d0/d2/d21/f32 [4194304,4194304] 0 2024-09-17T01:06:54.695 INFO:tasks.workunit.client.1.smithi143.stdout:9/214: symlink d3/d3d/l44 0 2024-09-17T01:06:54.696 INFO:tasks.workunit.client.1.smithi143.stdout:6/122: write d2/d7/f8 [712737,50842] 0 2024-09-17T01:06:54.697 INFO:tasks.workunit.client.1.smithi143.stdout:5/262: symlink d1/d46/df/d1f/d66/l69 0 2024-09-17T01:06:54.698 INFO:tasks.workunit.client.1.smithi143.stdout:8/188: symlink d9/d26/d2c/l47 0 2024-09-17T01:06:54.698 INFO:tasks.workunit.client.1.smithi143.stdout:4/224: chown da/d3a/d40/f3c 116218787 1 2024-09-17T01:06:54.700 INFO:tasks.workunit.client.1.smithi143.stdout:9/215: write d3/d16/d2b/f1c [2451440,28420] 0 2024-09-17T01:06:54.700 INFO:tasks.workunit.client.1.smithi143.stdout:7/292: getdents d4/d16/d47 0 2024-09-17T01:06:54.702 INFO:tasks.workunit.client.1.smithi143.stdout:4/225: write f2 [2690058,79349] 0 2024-09-17T01:06:54.704 INFO:tasks.workunit.client.1.smithi143.stdout:0/223: rmdir d3/d5/d8/d21 39 2024-09-17T01:06:54.705 INFO:tasks.workunit.client.1.smithi143.stdout:4/226: write da/f2a [461324,1099] 0 2024-09-17T01:06:54.708 INFO:tasks.workunit.client.1.smithi143.stdout:2/202: write d0/d2/d21/f32 [9059646,103906] 0 2024-09-17T01:06:54.712 INFO:tasks.workunit.client.1.smithi143.stdout:3/148: rmdir d6/d10 39 2024-09-17T01:06:54.719 INFO:tasks.workunit.client.1.smithi143.stdout:4/227: mkdir da/d3a/d3e/d4a 0 2024-09-17T01:06:54.721 INFO:tasks.workunit.client.1.smithi143.stdout:1/251: mknod d0/d6/d7/de/d2/d39/c50 0 2024-09-17T01:06:54.722 INFO:tasks.workunit.client.1.smithi143.stdout:1/252: dread - d0/d6/d43/f44 zero size 2024-09-17T01:06:54.722 INFO:tasks.workunit.client.1.smithi143.stdout:7/293: dwrite d4/d33/f4d [0,4194304] 0 2024-09-17T01:06:54.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/253: read d0/dc/f38 [132093,98475] 0 2024-09-17T01:06:54.724 INFO:tasks.workunit.client.1.smithi143.stdout:0/224: creat d3/d5/d8/d21/f47 x:0 0 0 2024-09-17T01:06:54.728 INFO:tasks.workunit.client.1.smithi143.stdout:4/228: creat da/d3a/d3e/d42/f4b x:0 0 0 2024-09-17T01:06:54.730 INFO:tasks.workunit.client.1.smithi143.stdout:1/254: dread d0/d6/f23 [0,4194304] 0 2024-09-17T01:06:54.730 INFO:tasks.workunit.client.1.smithi143.stdout:7/294: dread d4/d16/f1d [0,4194304] 0 2024-09-17T01:06:54.732 INFO:tasks.workunit.client.1.smithi143.stdout:7/295: write d4/d26/f50 [786643,86905] 0 2024-09-17T01:06:54.732 INFO:tasks.workunit.client.1.smithi143.stdout:1/255: read d0/d6/d7/de/d2/f2a [2032438,7935] 0 2024-09-17T01:06:54.732 INFO:tasks.workunit.client.1.smithi143.stdout:7/296: readlink d4/d33/l36 0 2024-09-17T01:06:54.734 INFO:tasks.workunit.client.1.smithi143.stdout:8/189: rename d9/d26/d2c to d9/d23/d48 0 2024-09-17T01:06:54.736 INFO:tasks.workunit.client.1.smithi143.stdout:7/297: dread d4/f10 [0,4194304] 0 2024-09-17T01:06:54.737 INFO:tasks.workunit.client.1.smithi143.stdout:7/298: write d4/d1f/f43 [172633,119306] 0 2024-09-17T01:06:54.738 INFO:tasks.workunit.client.1.smithi143.stdout:7/299: chown d4/f1b 18718 1 2024-09-17T01:06:54.740 INFO:tasks.workunit.client.1.smithi143.stdout:6/123: link d2/c3 d2/c27 0 2024-09-17T01:06:54.740 INFO:tasks.workunit.client.1.smithi143.stdout:6/124: chown d2/d19/c1e 4 1 2024-09-17T01:06:54.741 INFO:tasks.workunit.client.1.smithi143.stdout:4/229: stat da/c10 0 2024-09-17T01:06:54.743 INFO:tasks.workunit.client.1.smithi143.stdout:9/216: getdents d3 0 2024-09-17T01:06:54.748 INFO:tasks.workunit.client.1.smithi143.stdout:9/217: dwrite d3/d16/f1d [0,4194304] 0 2024-09-17T01:06:54.749 INFO:tasks.workunit.client.1.smithi143.stdout:9/218: stat d3/d16/d2b/c21 0 2024-09-17T01:06:54.749 INFO:tasks.workunit.client.1.smithi143.stdout:1/256: creat d0/d6/d7/de/d18/d2d/f51 x:0 0 0 2024-09-17T01:06:54.752 INFO:tasks.workunit.client.1.smithi143.stdout:8/190: fsync f7 0 2024-09-17T01:06:54.754 INFO:tasks.workunit.client.1.smithi143.stdout:2/203: getdents d0/d2/d21/d22 0 2024-09-17T01:06:54.757 INFO:tasks.workunit.client.1.smithi143.stdout:0/225: truncate d3/d5/f34 1462502 0 2024-09-17T01:06:54.758 INFO:tasks.workunit.client.1.smithi143.stdout:0/226: chown d3/d14/d32/f38 450534370 1 2024-09-17T01:06:54.759 INFO:tasks.workunit.client.1.smithi143.stdout:9/219: dwrite d3/d16/f1d [4194304,4194304] 0 2024-09-17T01:06:54.766 INFO:tasks.workunit.client.1.smithi143.stdout:1/257: mkdir d0/d6/d7/d52 0 2024-09-17T01:06:54.770 INFO:tasks.workunit.client.1.smithi143.stdout:5/263: rename d1/d46/df/d23/f50 to d1/d46/df/d23/d4f/f6a 0 2024-09-17T01:06:54.771 INFO:tasks.workunit.client.1.smithi143.stdout:7/300: write d4/f18 [47195,120071] 0 2024-09-17T01:06:54.777 INFO:tasks.workunit.client.1.smithi143.stdout:6/125: getdents d2/df/d20 0 2024-09-17T01:06:54.777 INFO:tasks.workunit.client.1.smithi143.stdout:7/301: dwrite d4/d1f/f28 [0,4194304] 0 2024-09-17T01:06:54.777 INFO:tasks.workunit.client.1.smithi143.stdout:3/149: write d6/d1c/f2a [165964,56599] 0 2024-09-17T01:06:54.779 INFO:tasks.workunit.client.1.smithi143.stdout:7/302: stat d4/f11 0 2024-09-17T01:06:54.779 INFO:tasks.workunit.client.1.smithi143.stdout:6/126: write d2/fb [4012233,114488] 0 2024-09-17T01:06:54.779 INFO:tasks.workunit.client.1.smithi143.stdout:4/230: mkdir da/d4c 0 2024-09-17T01:06:54.781 INFO:tasks.workunit.client.1.smithi143.stdout:7/303: write d4/d26/f2d [1403941,115211] 0 2024-09-17T01:06:54.783 INFO:tasks.workunit.client.1.smithi143.stdout:1/258: creat d0/d6/d7/de/d2/d3c/f53 x:0 0 0 2024-09-17T01:06:54.787 INFO:tasks.workunit.client.1.smithi143.stdout:5/264: creat d1/d46/d4c/f6b x:0 0 0 2024-09-17T01:06:54.788 INFO:tasks.workunit.client.1.smithi143.stdout:6/127: dwrite d2/dc/f1d [0,4194304] 0 2024-09-17T01:06:54.789 INFO:tasks.workunit.client.1.smithi143.stdout:6/128: readlink d2/d7/le 0 2024-09-17T01:06:54.789 INFO:tasks.workunit.client.1.smithi143.stdout:5/265: dread - d1/d46/df/d53/f61 zero size 2024-09-17T01:06:54.791 INFO:tasks.workunit.client.1.smithi143.stdout:8/191: unlink d9/l3a 0 2024-09-17T01:06:54.792 INFO:tasks.workunit.client.1.smithi143.stdout:6/129: write d2/f16 [4615221,87612] 0 2024-09-17T01:06:54.792 INFO:tasks.workunit.client.1.smithi143.stdout:1/259: dwrite d0/f19 [0,4194304] 0 2024-09-17T01:06:54.795 INFO:tasks.workunit.client.1.smithi143.stdout:2/204: mknod d0/d2/d21/d22/d24/c3e 0 2024-09-17T01:06:54.804 INFO:tasks.workunit.client.1.smithi143.stdout:1/260: mknod d0/d6/d43/c54 0 2024-09-17T01:06:54.804 INFO:tasks.workunit.client.1.smithi143.stdout:2/205: symlink d0/d2/l3f 0 2024-09-17T01:06:54.804 INFO:tasks.workunit.client.1.smithi143.stdout:0/227: dwrite d3/d5/d8/d21/f42 [4194304,4194304] 0 2024-09-17T01:06:54.805 INFO:tasks.workunit.client.1.smithi143.stdout:2/206: dread - d0/d2/d21/d22/f3c zero size 2024-09-17T01:06:54.805 INFO:tasks.workunit.client.1.smithi143.stdout:9/220: link d3/d16/d2b/f30 d3/d16/f45 0 2024-09-17T01:06:54.806 INFO:tasks.workunit.client.1.smithi143.stdout:0/228: read - d3/d14/d17/f28 zero size 2024-09-17T01:06:54.806 INFO:tasks.workunit.client.1.smithi143.stdout:4/231: getdents da/d3a/d3e/d4a 0 2024-09-17T01:06:54.809 INFO:tasks.workunit.client.1.smithi143.stdout:5/266: unlink d1/d46/df/l60 0 2024-09-17T01:06:54.817 INFO:tasks.workunit.client.1.smithi143.stdout:2/207: truncate d0/d2/d21/d22/d24/f36 1688835 0 2024-09-17T01:06:54.817 INFO:tasks.workunit.client.1.smithi143.stdout:0/229: unlink d3/d5/d8/d10/f24 0 2024-09-17T01:06:54.818 INFO:tasks.workunit.client.1.smithi143.stdout:0/230: chown d3/d5/d35/l46 1998533 1 2024-09-17T01:06:54.819 INFO:tasks.workunit.client.1.smithi143.stdout:5/267: creat d1/d46/df/d1f/d66/f6c x:0 0 0 2024-09-17T01:06:54.819 INFO:tasks.workunit.client.1.smithi143.stdout:0/231: write d3/d5/d8/d27/f1e [3673817,16200] 0 2024-09-17T01:06:54.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.820+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb7c8108990 con 0x7fb7c8102fe0 2024-09-17T01:06:54.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.820+0000 7fb7bf7fe640 1 -- 172.21.15.103:0/142839998 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb7b805a630 con 0x7fb7c8102fe0 2024-09-17T01:06:54.820 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:06:54.820 INFO:tasks.workunit.client.1.smithi143.stdout:8/192: rmdir d9/d12/d13/d25 0 2024-09-17T01:06:54.820 INFO:tasks.workunit.client.1.smithi143.stdout:0/232: stat d3/d5/d8/d21/f42 0 2024-09-17T01:06:54.821 INFO:tasks.workunit.client.1.smithi143.stdout:6/130: creat d2/f28 x:0 0 0 2024-09-17T01:06:54.822 INFO:tasks.workunit.client.1.smithi143.stdout:3/150: getdents d6/d1c 0 2024-09-17T01:06:54.822 INFO:tasks.workunit.client.1.smithi143.stdout:0/233: dread - d3/d5/d35/f3f zero size 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fb7b406d8a0 msgr2=0x7fb7b406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fb7b406d8a0 0x7fb7b406fd60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4000c00 tx=0x7fb7c40314e0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 msgr2=0x7fb7c80fe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 0x7fb7c80fe660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800e970 tx=0x7fb7b800ee30 comp rx=0 tx=0).stop 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 shutdown_connections 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c8102fe0 0x7fb7c80fe660 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fb7b406d8a0 0x7fb7b406fd60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 --2- 172.21.15.103:0/142839998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7c81006b0 0x7fb7c8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.823+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 >> 172.21.15.103:0/142839998 conn(0x7fb7c80fa230 msgr2=0x7fb7c80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:54.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.824+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 shutdown_connections 2024-09-17T01:06:54.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:06:54.824+0000 7fb7d07a7640 1 -- 172.21.15.103:0/142839998 wait complete. 2024-09-17T01:06:54.824 INFO:tasks.workunit.client.1.smithi143.stdout:6/131: fdatasync d2/d17/f25 0 2024-09-17T01:06:54.824 INFO:tasks.workunit.client.1.smithi143.stdout:5/268: dread d1/d46/df/f45 [0,4194304] 0 2024-09-17T01:06:54.825 INFO:tasks.workunit.client.1.smithi143.stdout:7/304: truncate d4/f41 179616 0 2024-09-17T01:06:54.825 INFO:tasks.workunit.client.1.smithi143.stdout:0/234: dread - d3/d5/d8/d21/f3e zero size 2024-09-17T01:06:54.827 INFO:tasks.workunit.client.1.smithi143.stdout:2/208: chown d0/d2/d21/d22/d24/f2a 747524 1 2024-09-17T01:06:54.829 INFO:tasks.workunit.client.1.smithi143.stdout:9/221: creat d3/d16/f46 x:0 0 0 2024-09-17T01:06:54.830 INFO:tasks.workunit.client.1.smithi143.stdout:9/222: chown d3/c40 6 1 2024-09-17T01:06:54.831 INFO:tasks.workunit.client.1.smithi143.stdout:5/269: creat d1/d46/df/d1f/f6d x:0 0 0 2024-09-17T01:06:54.831 INFO:tasks.workunit.client.1.smithi143.stdout:6/132: dread d2/fb [0,4194304] 0 2024-09-17T01:06:54.833 INFO:tasks.workunit.client.1.smithi143.stdout:8/193: mkdir d9/d12/d49 0 2024-09-17T01:06:54.833 INFO:tasks.workunit.client.1.smithi143.stdout:6/133: fsync d2/d19/f1b 0 2024-09-17T01:06:54.833 INFO:tasks.workunit.client.1.smithi143.stdout:1/261: dread d0/d6/d7/de/f1d [0,4194304] 0 2024-09-17T01:06:54.834 INFO:tasks.workunit.client.1.smithi143.stdout:4/232: truncate da/f1b 560746 0 2024-09-17T01:06:54.838 INFO:tasks.workunit.client.1.smithi143.stdout:0/235: mkdir d3/d5/d8/d27/d31/d48 0 2024-09-17T01:06:54.840 INFO:tasks.workunit.client.1.smithi143.stdout:6/134: write d2/f16 [3028448,14051] 0 2024-09-17T01:06:54.843 INFO:tasks.workunit.client.1.smithi143.stdout:5/270: truncate d1/d46/df/d23/d4f/f6a 827687 0 2024-09-17T01:06:54.846 INFO:tasks.workunit.client.1.smithi143.stdout:2/209: write d0/d10/f16 [651986,87094] 0 2024-09-17T01:06:54.846 INFO:tasks.workunit.client.1.smithi143.stdout:3/151: dwrite d6/d10/f16 [0,4194304] 0 2024-09-17T01:06:54.851 INFO:tasks.workunit.client.1.smithi143.stdout:0/236: truncate d3/d5/d8/d10/f25 4304305 0 2024-09-17T01:06:54.852 INFO:tasks.workunit.client.1.smithi143.stdout:9/223: dwrite d3/d16/d2b/f10 [0,4194304] 0 2024-09-17T01:06:54.857 INFO:tasks.workunit.client.1.smithi143.stdout:8/194: dwrite d9/d12/d2d/f37 [0,4194304] 0 2024-09-17T01:06:54.857 INFO:tasks.workunit.client.1.smithi143.stdout:4/233: getdents da 0 2024-09-17T01:06:54.862 INFO:tasks.workunit.client.1.smithi143.stdout:5/271: mkdir d1/d46/d6e 0 2024-09-17T01:06:54.862 INFO:tasks.workunit.client.1.smithi143.stdout:3/152: read d6/f1f [344301,77504] 0 2024-09-17T01:06:54.863 INFO:tasks.workunit.client.1.smithi143.stdout:0/237: creat d3/d5/d8/d21/f49 x:0 0 0 2024-09-17T01:06:54.863 INFO:tasks.workunit.client.1.smithi143.stdout:4/234: fsync da/d3a/f3b 0 2024-09-17T01:06:54.864 INFO:tasks.workunit.client.1.smithi143.stdout:1/262: dwrite d0/dc/f2c [0,4194304] 0 2024-09-17T01:06:54.868 INFO:tasks.workunit.client.1.smithi143.stdout:8/195: readlink d9/d2b/l44 0 2024-09-17T01:06:54.868 INFO:tasks.workunit.client.1.smithi143.stdout:2/210: getdents d0/d10 0 2024-09-17T01:06:54.869 INFO:tasks.workunit.client.1.smithi143.stdout:4/235: mkdir da/d4d 0 2024-09-17T01:06:54.871 INFO:tasks.workunit.client.1.smithi143.stdout:3/153: fsync d6/f1f 0 2024-09-17T01:06:54.872 INFO:tasks.workunit.client.1.smithi143.stdout:9/224: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:06:54.872 INFO:tasks.workunit.client.1.smithi143.stdout:6/135: dwrite d2/fb [0,4194304] 0 2024-09-17T01:06:54.874 INFO:tasks.workunit.client.1.smithi143.stdout:1/263: symlink d0/d6/d7/de/d2/d3c/l55 0 2024-09-17T01:06:54.875 INFO:tasks.workunit.client.1.smithi143.stdout:8/196: mknod d9/d12/d38/c4a 0 2024-09-17T01:06:54.877 INFO:tasks.workunit.client.1.smithi143.stdout:2/211: truncate d0/d2/d21/d22/f3c 643830 0 2024-09-17T01:06:54.879 INFO:tasks.workunit.client.1.smithi143.stdout:3/154: mkdir d6/d10/d2b 0 2024-09-17T01:06:54.881 INFO:tasks.workunit.client.1.smithi143.stdout:5/272: creat d1/d46/df/d23/f6f x:0 0 0 2024-09-17T01:06:54.886 INFO:tasks.workunit.client.1.smithi143.stdout:6/136: dread d2/fa [0,4194304] 0 2024-09-17T01:06:54.887 INFO:tasks.workunit.client.1.smithi143.stdout:3/155: rename d6/d10/c14 to d6/d10/d2b/c2c 0 2024-09-17T01:06:54.888 INFO:tasks.workunit.client.1.smithi143.stdout:8/197: getdents d9 0 2024-09-17T01:06:54.889 INFO:tasks.workunit.client.1.smithi143.stdout:5/273: mkdir d1/d46/df/d1f/d66/d70 0 2024-09-17T01:06:54.890 INFO:tasks.workunit.client.1.smithi143.stdout:0/238: dwrite d3/d5/d8/d27/f2b [0,4194304] 0 2024-09-17T01:06:54.891 INFO:tasks.workunit.client.1.smithi143.stdout:8/198: readlink d9/d2b/l44 0 2024-09-17T01:06:54.891 INFO:tasks.workunit.client.1.smithi143.stdout:6/137: mknod d2/d17/c29 0 2024-09-17T01:06:54.893 INFO:tasks.workunit.client.1.smithi143.stdout:5/274: dread - d1/d46/df/d1f/f34 zero size 2024-09-17T01:06:54.894 INFO:tasks.workunit.client.1.smithi143.stdout:2/212: dwrite d0/d2/fe [0,4194304] 0 2024-09-17T01:06:54.897 INFO:tasks.workunit.client.1.smithi143.stdout:1/264: fdatasync d0/dc/f2c 0 2024-09-17T01:06:54.897 INFO:tasks.workunit.client.1.smithi143.stdout:0/239: write d3/d5/d8/d21/f47 [165274,90038] 0 2024-09-17T01:06:54.899 INFO:tasks.workunit.client.1.smithi143.stdout:6/138: symlink d2/d7/d26/l2a 0 2024-09-17T01:06:54.902 INFO:tasks.workunit.client.1.smithi143.stdout:2/213: rename d0/l12 to d0/d2/l40 0 2024-09-17T01:06:54.904 INFO:tasks.workunit.client.1.smithi143.stdout:0/240: read d3/d5/f9 [7050780,79419] 0 2024-09-17T01:06:54.905 INFO:tasks.workunit.client.1.smithi143.stdout:1/265: write d0/d6/d7/de/d2/f3d [1031256,91868] 0 2024-09-17T01:06:54.906 INFO:tasks.workunit.client.1.smithi143.stdout:6/139: read - d2/dc/f22 zero size 2024-09-17T01:06:54.908 INFO:tasks.workunit.client.1.smithi143.stdout:9/225: truncate d3/d16/d34/f36 506536 0 2024-09-17T01:06:54.910 INFO:tasks.workunit.client.1.smithi143.stdout:6/140: chown d2/dc/c10 2 1 2024-09-17T01:06:54.911 INFO:tasks.workunit.client.1.smithi143.stdout:5/275: dwrite d1/f43 [0,4194304] 0 2024-09-17T01:06:54.911 INFO:tasks.workunit.client.1.smithi143.stdout:8/199: dwrite d9/d12/d13/f33 [0,4194304] 0 2024-09-17T01:06:54.911 INFO:tasks.workunit.client.1.smithi143.stdout:3/156: write d6/ff [202890,83017] 0 2024-09-17T01:06:54.913 INFO:tasks.workunit.client.1.smithi143.stdout:1/266: creat d0/d6/d7/de/d2/f56 x:0 0 0 2024-09-17T01:06:54.914 INFO:tasks.workunit.client.1.smithi143.stdout:5/276: write d1/d46/df/f3d [723167,18066] 0 2024-09-17T01:06:54.916 INFO:tasks.workunit.client.1.smithi143.stdout:6/141: mkdir d2/d17/d2b 0 2024-09-17T01:06:54.916 INFO:tasks.workunit.client.1.smithi143.stdout:8/200: dread f7 [0,4194304] 0 2024-09-17T01:06:54.918 INFO:tasks.workunit.client.1.smithi143.stdout:0/241: link d3/d14/d17/c22 d3/d14/d17/c4a 0 2024-09-17T01:06:54.919 INFO:tasks.workunit.client.1.smithi143.stdout:8/201: dread - d9/f46 zero size 2024-09-17T01:06:54.921 INFO:tasks.workunit.client.1.smithi143.stdout:6/142: write d2/f5 [231109,86390] 0 2024-09-17T01:06:54.922 INFO:tasks.workunit.client.1.smithi143.stdout:0/242: readlink d3/d5/d8/d27/l43 0 2024-09-17T01:06:54.922 INFO:tasks.workunit.client.1.smithi143.stdout:9/226: write d3/d16/d2b/f30 [520107,101131] 0 2024-09-17T01:06:54.926 INFO:tasks.workunit.client.1.smithi143.stdout:5/277: mknod d1/d46/df/d1f/d66/d70/c71 0 2024-09-17T01:06:54.926 INFO:tasks.workunit.client.1.smithi143.stdout:1/267: dread d0/d6/d7/de/fb [0,4194304] 0 2024-09-17T01:06:54.927 INFO:tasks.workunit.client.1.smithi143.stdout:8/202: truncate d9/d23/d48/f40 579820 0 2024-09-17T01:06:54.929 INFO:tasks.workunit.client.1.smithi143.stdout:9/227: mknod d3/d16/d2b/d26/c47 0 2024-09-17T01:06:54.931 INFO:tasks.workunit.client.1.smithi143.stdout:3/157: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:54.933 INFO:tasks.workunit.client.1.smithi143.stdout:1/268: write d0/d6/d7/f48 [1008986,29598] 0 2024-09-17T01:06:54.933 INFO:tasks.workunit.client.1.smithi143.stdout:0/243: link d3/d5/d8/d27/f2b d3/d5/d8/d27/f4b 0 2024-09-17T01:06:54.933 INFO:tasks.workunit.client.1.smithi143.stdout:9/228: mkdir d3/d3d/d48 0 2024-09-17T01:06:54.937 INFO:tasks.workunit.client.1.smithi143.stdout:3/158: write d6/d10/f16 [1193842,126533] 0 2024-09-17T01:06:54.938 INFO:tasks.workunit.client.1.smithi143.stdout:8/203: rename d9/d12/d2d to d9/d12/d4b 0 2024-09-17T01:06:54.938 INFO:tasks.workunit.client.1.smithi143.stdout:6/143: dwrite d2/d7/f8 [0,4194304] 0 2024-09-17T01:06:54.939 INFO:tasks.workunit.client.1.smithi143.stdout:5/278: rename d1/f43 to d1/d46/df/d23/f72 0 2024-09-17T01:06:54.943 INFO:tasks.workunit.client.1.smithi143.stdout:1/269: mkdir d0/dc/d57 0 2024-09-17T01:06:54.944 INFO:tasks.workunit.client.1.smithi143.stdout:8/204: fdatasync d9/d12/d4b/f41 0 2024-09-17T01:06:54.944 INFO:tasks.workunit.client.1.smithi143.stdout:9/229: chown d3/d16/c31 311000963 1 2024-09-17T01:06:54.945 INFO:tasks.workunit.client.1.smithi143.stdout:3/159: dread d6/f1f [0,4194304] 0 2024-09-17T01:06:54.946 INFO:tasks.workunit.client.1.smithi143.stdout:8/205: fsync d9/de/f21 0 2024-09-17T01:06:54.947 INFO:tasks.workunit.client.1.smithi143.stdout:2/214: dread d0/f1a [0,4194304] 0 2024-09-17T01:06:54.949 INFO:tasks.workunit.client.1.smithi143.stdout:0/244: rename d3/d14/d17 to d3/d5/d8/d27/d31/d4c 0 2024-09-17T01:06:54.951 INFO:tasks.workunit.client.1.smithi143.stdout:9/230: creat d3/d16/d2b/d9/f49 x:0 0 0 2024-09-17T01:06:54.954 INFO:tasks.workunit.client.1.smithi143.stdout:6/144: dread d2/f1f [0,4194304] 0 2024-09-17T01:06:54.955 INFO:tasks.workunit.client.1.smithi143.stdout:0/245: write d3/d5/d8/d21/f49 [747306,23318] 0 2024-09-17T01:06:54.957 INFO:tasks.workunit.client.1.smithi143.stdout:6/145: read d2/f16 [154916,76527] 0 2024-09-17T01:06:54.960 INFO:tasks.workunit.client.1.smithi143.stdout:8/206: mknod d9/d12/d4b/d3f/c4c 0 2024-09-17T01:06:54.964 INFO:tasks.workunit.client.1.smithi143.stdout:3/160: rename d6/ff to d6/f2d 0 2024-09-17T01:06:54.964 INFO:tasks.workunit.client.1.smithi143.stdout:5/279: dread d1/d46/df/d1f/f16 [0,4194304] 0 2024-09-17T01:06:54.964 INFO:tasks.workunit.client.1.smithi143.stdout:1/270: truncate d0/d6/f29 2738707 0 2024-09-17T01:06:54.965 INFO:tasks.workunit.client.1.smithi143.stdout:2/215: dwrite d0/d10/f17 [0,4194304] 0 2024-09-17T01:06:54.966 INFO:tasks.workunit.client.1.smithi143.stdout:0/246: dread d3/d5/d8/d21/f3b [0,4194304] 0 2024-09-17T01:06:54.967 INFO:tasks.workunit.client.1.smithi143.stdout:6/146: rename d2/dc to d2/df/d20/d2c 0 2024-09-17T01:06:54.969 INFO:tasks.workunit.client.1.smithi143.stdout:9/231: dwrite d3/d16/d2b/d9/f27 [0,4194304] 0 2024-09-17T01:06:54.971 INFO:tasks.workunit.client.1.smithi143.stdout:3/161: chown d6/l22 0 1 2024-09-17T01:06:54.972 INFO:tasks.workunit.client.1.smithi143.stdout:5/280: symlink d1/d46/df/l73 0 2024-09-17T01:06:54.974 INFO:tasks.workunit.client.1.smithi143.stdout:6/147: dread - d2/d17/f25 zero size 2024-09-17T01:06:54.975 INFO:tasks.workunit.client.1.smithi143.stdout:3/162: chown d6/f2d 5793960 1 2024-09-17T01:06:54.976 INFO:tasks.workunit.client.1.smithi143.stdout:6/148: chown d2/f28 10986 1 2024-09-17T01:06:54.977 INFO:tasks.workunit.client.1.smithi143.stdout:9/232: mknod d3/c4a 0 2024-09-17T01:06:54.983 INFO:tasks.workunit.client.1.smithi143.stdout:8/207: dread d9/d12/d4b/f37 [0,4194304] 0 2024-09-17T01:06:54.983 INFO:tasks.workunit.client.1.smithi143.stdout:0/247: symlink d3/d5/d8/d27/d31/l4d 0 2024-09-17T01:06:54.983 INFO:tasks.workunit.client.1.smithi143.stdout:1/271: mkdir d0/dc/d57/d58 0 2024-09-17T01:06:54.985 INFO:tasks.workunit.client.1.smithi143.stdout:6/149: symlink d2/d7/l2d 0 2024-09-17T01:06:54.987 INFO:tasks.workunit.client.1.smithi143.stdout:2/216: dwrite d0/d2/d21/d22/f3c [0,4194304] 0 2024-09-17T01:06:54.988 INFO:tasks.workunit.client.1.smithi143.stdout:8/208: truncate d9/fa 4814496 0 2024-09-17T01:06:54.990 INFO:tasks.workunit.client.1.smithi143.stdout:0/248: symlink d3/d5/d8/d10/l4e 0 2024-09-17T01:06:54.990 INFO:tasks.workunit.client.1.smithi143.stdout:2/217: stat d0/d10/f16 0 2024-09-17T01:06:54.990 INFO:tasks.workunit.client.1.smithi143.stdout:5/281: write d1/d46/df/d23/f2a [1111633,85722] 0 2024-09-17T01:06:54.994 INFO:tasks.workunit.client.1.smithi143.stdout:8/209: write d9/d12/d38/f3d [94264,40314] 0 2024-09-17T01:06:54.995 INFO:tasks.workunit.client.1.smithi143.stdout:6/150: creat d2/df/f2e x:0 0 0 2024-09-17T01:06:54.998 INFO:tasks.workunit.client.1.smithi143.stdout:9/233: write d3/d16/d2b/f30 [307037,66379] 0 2024-09-17T01:06:55.000 INFO:tasks.workunit.client.1.smithi143.stdout:8/210: write d9/de/f21 [1758436,62639] 0 2024-09-17T01:06:55.001 INFO:tasks.workunit.client.1.smithi143.stdout:6/151: truncate d2/f28 989323 0 2024-09-17T01:06:55.002 INFO:tasks.workunit.client.1.smithi143.stdout:3/163: dwrite d6/d10/f28 [0,4194304] 0 2024-09-17T01:06:55.004 INFO:tasks.workunit.client.1.smithi143.stdout:1/272: getdents d0/d6/d43 0 2024-09-17T01:06:55.007 INFO:tasks.workunit.client.1.smithi143.stdout:2/218: dwrite d0/d2/fe [0,4194304] 0 2024-09-17T01:06:55.009 INFO:tasks.workunit.client.1.smithi143.stdout:1/273: chown d0/d6/d7/de/d2 0 1 2024-09-17T01:06:55.012 INFO:tasks.workunit.client.1.smithi143.stdout:3/164: rmdir d6/d1c/d29 0 2024-09-17T01:06:55.012 INFO:tasks.workunit.client.1.smithi143.stdout:6/152: write d2/f16 [2897657,106443] 0 2024-09-17T01:06:55.012 INFO:tasks.workunit.client.1.smithi143.stdout:0/249: dwrite d3/d5/d8/d21/f3e [0,4194304] 0 2024-09-17T01:06:55.013 INFO:tasks.workunit.client.1.smithi143.stdout:1/274: read d0/d6/d7/de/fb [3377959,105510] 0 2024-09-17T01:06:55.017 INFO:tasks.workunit.client.1.smithi143.stdout:3/165: readlink d6/l1d 0 2024-09-17T01:06:55.017 INFO:tasks.workunit.client.1.smithi143.stdout:0/250: chown d3/d5/d8/d21 6208 1 2024-09-17T01:06:55.025 INFO:tasks.workunit.client.1.smithi143.stdout:2/219: dwrite d0/d2/d21/d22/f2d [0,4194304] 0 2024-09-17T01:06:55.026 INFO:tasks.workunit.client.1.smithi143.stdout:3/166: mkdir d6/d10/d2e 0 2024-09-17T01:06:55.027 INFO:tasks.workunit.client.1.smithi143.stdout:2/220: stat d0/d2/d21/d22/d3d 0 2024-09-17T01:06:55.027 INFO:tasks.workunit.client.1.smithi143.stdout:2/221: stat d0/c1c 0 2024-09-17T01:06:55.027 INFO:tasks.workunit.client.1.smithi143.stdout:1/275: creat d0/d6/d7/de/d18/f59 x:0 0 0 2024-09-17T01:06:55.030 INFO:tasks.workunit.client.1.smithi143.stdout:2/222: rmdir d0 39 2024-09-17T01:06:55.032 INFO:tasks.workunit.client.1.smithi143.stdout:3/167: getdents d6/d10/d2e 0 2024-09-17T01:06:55.034 INFO:tasks.workunit.client.1.smithi143.stdout:3/168: rmdir d6/d1c 39 2024-09-17T01:06:55.036 INFO:tasks.workunit.client.1.smithi143.stdout:0/251: dread d3/d5/d8/d10/f3a [0,4194304] 0 2024-09-17T01:06:55.036 INFO:tasks.workunit.client.1.smithi143.stdout:1/276: dread d0/f19 [0,4194304] 0 2024-09-17T01:06:55.036 INFO:tasks.workunit.client.1.smithi143.stdout:8/211: dread d9/d12/f18 [0,4194304] 0 2024-09-17T01:06:55.037 INFO:tasks.workunit.client.1.smithi143.stdout:1/277: stat d0/d6/d7/c21 0 2024-09-17T01:06:55.037 INFO:tasks.workunit.client.1.smithi143.stdout:2/223: creat d0/d2/d21/d22/f41 x:0 0 0 2024-09-17T01:06:55.038 INFO:tasks.workunit.client.1.smithi143.stdout:8/212: chown d9/c1d 1 1 2024-09-17T01:06:55.038 INFO:tasks.workunit.client.1.smithi143.stdout:1/278: dread - d0/d6/d7/de/d2/d3c/f53 zero size 2024-09-17T01:06:55.039 INFO:tasks.workunit.client.1.smithi143.stdout:3/169: creat d6/d10/f2f x:0 0 0 2024-09-17T01:06:55.040 INFO:tasks.workunit.client.1.smithi143.stdout:6/153: write d2/df/f1a [255333,113784] 0 2024-09-17T01:06:55.041 INFO:tasks.workunit.client.1.smithi143.stdout:2/224: truncate d0/d2/d21/f27 3365415 0 2024-09-17T01:06:55.042 INFO:tasks.workunit.client.1.smithi143.stdout:8/213: rename d9/d2b/f3b to d9/d12/d13/f4d 0 2024-09-17T01:06:55.042 INFO:tasks.workunit.client.1.smithi143.stdout:6/154: write d2/f16 [4062314,4448] 0 2024-09-17T01:06:55.043 INFO:tasks.workunit.client.1.smithi143.stdout:3/170: dread - d6/f20 zero size 2024-09-17T01:06:55.045 INFO:tasks.workunit.client.1.smithi143.stdout:8/214: mknod d9/de/c4e 0 2024-09-17T01:06:55.045 INFO:tasks.workunit.client.1.smithi143.stdout:1/279: symlink d0/d6/d7/de/l5a 0 2024-09-17T01:06:55.045 INFO:tasks.workunit.client.1.smithi143.stdout:2/225: read - d0/d2/d21/f2c zero size 2024-09-17T01:06:55.049 INFO:tasks.workunit.client.1.smithi143.stdout:3/171: truncate d6/f1f 980308 0 2024-09-17T01:06:55.049 INFO:tasks.workunit.client.1.smithi143.stdout:8/215: mkdir d9/d23/d4f 0 2024-09-17T01:06:55.054 INFO:tasks.workunit.client.1.smithi143.stdout:0/252: dwrite d3/d5/f9 [4194304,4194304] 0 2024-09-17T01:06:55.056 INFO:tasks.workunit.client.1.smithi143.stdout:0/253: readlink d3/d5/d35/l46 0 2024-09-17T01:06:55.059 INFO:tasks.workunit.client.1.smithi143.stdout:1/280: dwrite d0/d6/f1f [0,4194304] 0 2024-09-17T01:06:55.063 INFO:tasks.workunit.client.1.smithi143.stdout:6/155: dwrite d2/df/d20/d2c/f22 [0,4194304] 0 2024-09-17T01:06:55.087 INFO:tasks.workunit.client.1.smithi143.stdout:2/226: dread d0/d2/d21/d22/d24/f29 [0,4194304] 0 2024-09-17T01:06:55.095 INFO:tasks.workunit.client.1.smithi143.stdout:8/216: mknod d9/d12/d38/c50 0 2024-09-17T01:06:55.095 INFO:tasks.workunit.client.1.smithi143.stdout:8/217: stat d9/d12/c30 0 2024-09-17T01:06:55.096 INFO:tasks.workunit.client.1.smithi143.stdout:8/218: dread - d9/d12/d13/f4d zero size 2024-09-17T01:06:55.097 INFO:tasks.workunit.client.1.smithi143.stdout:0/254: rename d3/d5/d8/d27/f1c to d3/d5/d8/d10/f4f 0 2024-09-17T01:06:55.097 INFO:tasks.workunit.client.1.smithi143.stdout:1/281: creat d0/d6/d7/de/d2/f5b x:0 0 0 2024-09-17T01:06:55.098 INFO:tasks.workunit.client.1.smithi143.stdout:6/156: rmdir d2/d7/d26 39 2024-09-17T01:06:55.100 INFO:tasks.workunit.client.1.smithi143.stdout:2/227: unlink d0/l7 0 2024-09-17T01:06:55.101 INFO:tasks.workunit.client.1.smithi143.stdout:3/172: unlink d6/f19 0 2024-09-17T01:06:55.104 INFO:tasks.workunit.client.1.smithi143.stdout:8/219: dwrite d9/f29 [0,4194304] 0 2024-09-17T01:06:55.107 INFO:tasks.workunit.client.1.smithi143.stdout:6/157: rename d2/df/d20/d2c/f1d to d2/df/d20/d2c/f2f 0 2024-09-17T01:06:55.107 INFO:tasks.workunit.client.1.smithi143.stdout:1/282: rmdir d0/d6 39 2024-09-17T01:06:55.110 INFO:tasks.workunit.client.1.smithi143.stdout:0/255: creat d3/d5/d8/d21/d2e/f50 x:0 0 0 2024-09-17T01:06:55.111 INFO:tasks.workunit.client.1.smithi143.stdout:8/220: creat d9/d23/d32/f51 x:0 0 0 2024-09-17T01:06:55.117 INFO:tasks.workunit.client.1.smithi143.stdout:6/158: mkdir d2/d30 0 2024-09-17T01:06:55.124 INFO:tasks.workunit.client.1.smithi143.stdout:2/228: link d0/d2/d21/d22/f28 d0/f42 0 2024-09-17T01:06:55.128 INFO:tasks.workunit.client.1.smithi143.stdout:0/256: dwrite d3/d5/d8/d10/f2a [0,4194304] 0 2024-09-17T01:06:55.128 INFO:tasks.workunit.client.1.smithi143.stdout:8/221: dwrite d9/fc [4194304,4194304] 0 2024-09-17T01:06:55.134 INFO:tasks.workunit.client.1.smithi143.stdout:2/229: write d0/d10/f11 [8583607,117703] 0 2024-09-17T01:06:55.142 INFO:tasks.workunit.client.1.smithi143.stdout:0/257: chown d3/d5/d8/d21/c33 2564 1 2024-09-17T01:06:55.146 INFO:tasks.workunit.client.1.smithi143.stdout:3/173: dwrite d6/fa [0,4194304] 0 2024-09-17T01:06:55.150 INFO:tasks.workunit.client.1.smithi143.stdout:1/283: dwrite d0/d6/d7/de/d18/f59 [0,4194304] 0 2024-09-17T01:06:55.150 INFO:tasks.workunit.client.1.smithi143.stdout:3/174: chown d6/fa 360743 1 2024-09-17T01:06:55.152 INFO:tasks.workunit.client.1.smithi143.stdout:6/159: dread d2/df/d20/d2c/f2f [0,4194304] 0 2024-09-17T01:06:55.158 INFO:tasks.workunit.client.1.smithi143.stdout:3/175: mkdir d6/d10/d2e/d30 0 2024-09-17T01:06:55.159 INFO:tasks.workunit.client.1.smithi143.stdout:8/222: link d9/d12/c1b d9/d2b/c52 0 2024-09-17T01:06:55.161 INFO:tasks.workunit.client.1.smithi143.stdout:3/176: truncate d6/d10/f1a 5264554 0 2024-09-17T01:06:55.162 INFO:tasks.workunit.client.1.smithi143.stdout:2/230: creat d0/d2/d21/d22/d24/f43 x:0 0 0 2024-09-17T01:06:55.162 INFO:tasks.workunit.client.1.smithi143.stdout:6/160: rmdir d2/d19/d23 0 2024-09-17T01:06:55.163 INFO:tasks.workunit.client.1.smithi143.stdout:6/161: dread - d2/d17/f25 zero size 2024-09-17T01:06:55.166 INFO:tasks.workunit.client.1.smithi143.stdout:2/231: mkdir d0/d44 0 2024-09-17T01:06:55.167 INFO:tasks.workunit.client.1.smithi143.stdout:8/223: dread d9/d12/f18 [0,4194304] 0 2024-09-17T01:06:55.170 INFO:tasks.workunit.client.1.smithi143.stdout:2/232: unlink d0/d10/l38 0 2024-09-17T01:06:55.172 INFO:tasks.workunit.client.1.smithi143.stdout:3/177: rmdir d6 39 2024-09-17T01:06:55.172 INFO:tasks.workunit.client.1.smithi143.stdout:6/162: dwrite d2/f5 [0,4194304] 0 2024-09-17T01:06:55.172 INFO:tasks.workunit.client.1.smithi143.stdout:8/224: chown d9/d12/c1b 4 1 2024-09-17T01:06:55.177 INFO:tasks.workunit.client.1.smithi143.stdout:3/178: fsync d6/fa 0 2024-09-17T01:06:55.178 INFO:tasks.workunit.client.1.smithi143.stdout:6/163: rename d2/f16 to d2/df/f31 0 2024-09-17T01:06:55.184 INFO:tasks.workunit.client.1.smithi143.stdout:2/233: dwrite d0/d10/f33 [0,4194304] 0 2024-09-17T01:06:55.184 INFO:tasks.workunit.client.1.smithi143.stdout:6/164: write d2/df/d20/d2c/f24 [415906,109448] 0 2024-09-17T01:06:55.185 INFO:tasks.workunit.client.1.smithi143.stdout:0/258: dread d3/d5/d8/d10/f4f [0,4194304] 0 2024-09-17T01:06:55.188 INFO:tasks.workunit.client.1.smithi143.stdout:2/234: fsync d0/ff 0 2024-09-17T01:06:55.190 INFO:tasks.workunit.client.1.smithi143.stdout:3/179: rename d6/cd to d6/d10/d2b/c31 0 2024-09-17T01:06:55.191 INFO:tasks.workunit.client.1.smithi143.stdout:8/225: dwrite d9/d26/f3e [0,4194304] 0 2024-09-17T01:06:55.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/180: truncate d6/f2d 2373508 0 2024-09-17T01:06:55.193 INFO:tasks.workunit.client.1.smithi143.stdout:2/235: chown d0/d2/d21/d22/d24/f43 20291260 1 2024-09-17T01:06:55.195 INFO:tasks.workunit.client.1.smithi143.stdout:6/165: rename d2/df/f1a to d2/d7/d26/f32 0 2024-09-17T01:06:55.196 INFO:tasks.workunit.client.1.smithi143.stdout:3/181: stat d6/d1c/f2a 0 2024-09-17T01:06:55.196 INFO:tasks.workunit.client.1.smithi143.stdout:8/226: unlink d9/d12/d4b/d3f/c4c 0 2024-09-17T01:06:55.198 INFO:tasks.workunit.client.1.smithi143.stdout:0/259: dread d3/d5/d8/d21/f3e [0,4194304] 0 2024-09-17T01:06:55.198 INFO:tasks.workunit.client.1.smithi143.stdout:6/166: chown d2/df/d18/f21 1641052 1 2024-09-17T01:06:55.199 INFO:tasks.workunit.client.1.smithi143.stdout:8/227: chown d9/de/c4e 2077355 1 2024-09-17T01:06:55.199 INFO:tasks.workunit.client.1.smithi143.stdout:6/167: chown d2/d19/c1e 2611886 1 2024-09-17T01:06:55.200 INFO:tasks.workunit.client.1.smithi143.stdout:8/228: mkdir d9/de/d53 0 2024-09-17T01:06:55.202 INFO:tasks.workunit.client.1.smithi143.stdout:0/260: symlink d3/d14/l51 0 2024-09-17T01:06:55.203 INFO:tasks.workunit.client.1.smithi143.stdout:3/182: link d6/f2d d6/d10/d2e/d30/f32 0 2024-09-17T01:06:55.204 INFO:tasks.workunit.client.1.smithi143.stdout:0/261: creat d3/d5/f52 x:0 0 0 2024-09-17T01:06:55.204 INFO:tasks.workunit.client.1.smithi143.stdout:3/183: mkdir d6/d1c/d33 0 2024-09-17T01:06:55.205 INFO:tasks.workunit.client.1.smithi143.stdout:6/168: link d2/d19/c1e d2/d7/d26/c33 0 2024-09-17T01:06:55.206 INFO:tasks.workunit.client.1.smithi143.stdout:8/229: symlink d9/de/d53/l54 0 2024-09-17T01:06:55.206 INFO:tasks.workunit.client.1.smithi143.stdout:0/262: fdatasync d3/d5/d8/d10/f25 0 2024-09-17T01:06:55.206 INFO:tasks.workunit.client.1.smithi143.stdout:3/184: truncate d6/d10/f2f 507407 0 2024-09-17T01:06:55.207 INFO:tasks.workunit.client.1.smithi143.stdout:6/169: unlink d2/d7/d26/c33 0 2024-09-17T01:06:55.208 INFO:tasks.workunit.client.1.smithi143.stdout:0/263: rmdir d3/d5/d8/d21/d2e 39 2024-09-17T01:06:55.210 INFO:tasks.workunit.client.1.smithi143.stdout:3/185: write d6/d10/d2e/d30/f32 [2689390,42390] 0 2024-09-17T01:06:55.212 INFO:tasks.workunit.client.1.smithi143.stdout:6/170: chown d2/df/d20/d2c/f2f 3936912 1 2024-09-17T01:06:55.214 INFO:tasks.workunit.client.1.smithi143.stdout:3/186: truncate d6/d1c/f2a 941096 0 2024-09-17T01:06:55.217 INFO:tasks.workunit.client.1.smithi143.stdout:8/230: dwrite d9/d23/d32/f51 [0,4194304] 0 2024-09-17T01:06:55.217 INFO:tasks.workunit.client.1.smithi143.stdout:0/264: rename d3/d5/d35/l46 to d3/d5/d8/l53 0 2024-09-17T01:06:55.217 INFO:tasks.workunit.client.1.smithi143.stdout:8/231: readlink d9/de/lf 0 2024-09-17T01:06:55.218 INFO:tasks.workunit.client.1.smithi143.stdout:0/265: stat d3/d5/d35 0 2024-09-17T01:06:55.218 INFO:tasks.workunit.client.1.smithi143.stdout:3/187: creat d6/d1c/f34 x:0 0 0 2024-09-17T01:06:55.219 INFO:tasks.workunit.client.1.smithi143.stdout:8/232: mkdir d9/d23/d48/d55 0 2024-09-17T01:06:55.220 INFO:tasks.workunit.client.1.smithi143.stdout:2/236: dread d0/d2/d21/d22/d24/f2a [0,4194304] 0 2024-09-17T01:06:55.221 INFO:tasks.workunit.client.1.smithi143.stdout:0/266: write d3/d5/d8/d10/f4f [2274859,57459] 0 2024-09-17T01:06:55.225 INFO:tasks.workunit.client.1.smithi143.stdout:0/267: creat d3/d14/d3d/f54 x:0 0 0 2024-09-17T01:06:55.227 INFO:tasks.workunit.client.1.smithi143.stdout:3/188: dread d6/d10/f21 [0,4194304] 0 2024-09-17T01:06:55.228 INFO:tasks.workunit.client.1.smithi143.stdout:8/233: dwrite d9/f29 [0,4194304] 0 2024-09-17T01:06:55.228 INFO:tasks.workunit.client.1.smithi143.stdout:0/268: write d3/d5/d35/f3f [761235,2202] 0 2024-09-17T01:06:55.229 INFO:tasks.workunit.client.1.smithi143.stdout:2/237: dread d0/d2/fe [0,4194304] 0 2024-09-17T01:06:55.229 INFO:tasks.workunit.client.1.smithi143.stdout:3/189: chown d6/d10/d2e/d30/f32 3 1 2024-09-17T01:06:55.232 INFO:tasks.workunit.client.1.smithi143.stdout:8/234: mkdir d9/d23/d48/d56 0 2024-09-17T01:06:55.234 INFO:tasks.workunit.client.1.smithi143.stdout:2/238: rmdir d0/d2/d21/d22 39 2024-09-17T01:06:55.235 INFO:tasks.workunit.client.1.smithi143.stdout:0/269: creat d3/d5/d8/d21/f55 x:0 0 0 2024-09-17T01:06:55.236 INFO:tasks.workunit.client.1.smithi143.stdout:3/190: symlink d6/l35 0 2024-09-17T01:06:55.237 INFO:tasks.workunit.client.1.smithi143.stdout:8/235: mkdir d9/d23/d48/d55/d57 0 2024-09-17T01:06:55.238 INFO:tasks.workunit.client.1.smithi143.stdout:0/270: symlink d3/d5/d8/d10/l56 0 2024-09-17T01:06:55.240 INFO:tasks.workunit.client.1.smithi143.stdout:3/191: creat d6/d1c/d33/f36 x:0 0 0 2024-09-17T01:06:55.241 INFO:tasks.workunit.client.1.smithi143.stdout:2/239: creat d0/d2/d21/d22/d3d/f45 x:0 0 0 2024-09-17T01:06:55.243 INFO:tasks.workunit.client.1.smithi143.stdout:2/240: unlink d0/f1a 0 2024-09-17T01:06:55.245 INFO:tasks.workunit.client.1.smithi143.stdout:3/192: creat d6/d10/d2e/d30/f37 x:0 0 0 2024-09-17T01:06:55.245 INFO:tasks.workunit.client.1.smithi143.stdout:0/271: dread d3/d5/f34 [0,4194304] 0 2024-09-17T01:06:55.245 INFO:tasks.workunit.client.1.smithi143.stdout:8/236: dwrite d9/d12/f18 [0,4194304] 0 2024-09-17T01:06:55.246 INFO:tasks.workunit.client.1.smithi143.stdout:2/241: write d0/d10/f34 [457595,94966] 0 2024-09-17T01:06:55.251 INFO:tasks.workunit.client.1.smithi143.stdout:2/242: creat d0/d44/f46 x:0 0 0 2024-09-17T01:06:55.252 INFO:tasks.workunit.client.1.smithi143.stdout:0/272: mknod d3/d5/d8/d21/d2e/c57 0 2024-09-17T01:06:55.255 INFO:tasks.workunit.client.1.smithi143.stdout:0/273: write d3/d14/d3d/f54 [569493,49913] 0 2024-09-17T01:06:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:55 smithi143 ceph-mon[35452]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 187 op/s 2024-09-17T01:06:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:55 smithi143 ceph-mon[35452]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:55 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/142839998' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:55.258 INFO:tasks.workunit.client.1.smithi143.stdout:8/237: dwrite d9/f46 [0,4194304] 0 2024-09-17T01:06:55.259 INFO:tasks.workunit.client.1.smithi143.stdout:3/193: dwrite d6/d10/f28 [0,4194304] 0 2024-09-17T01:06:55.260 INFO:tasks.workunit.client.1.smithi143.stdout:0/274: fdatasync d3/d5/d8/d27/f4b 0 2024-09-17T01:06:55.261 INFO:tasks.workunit.client.1.smithi143.stdout:2/243: dread d0/d2/d21/d22/f2d [0,4194304] 0 2024-09-17T01:06:55.262 INFO:tasks.workunit.client.1.smithi143.stdout:8/238: unlink d9/d23/d48/l47 0 2024-09-17T01:06:55.264 INFO:tasks.workunit.client.1.smithi143.stdout:2/244: write d0/d2/d21/d22/d24/f43 [705230,129571] 0 2024-09-17T01:06:55.270 INFO:tasks.workunit.client.1.smithi143.stdout:8/239: dwrite d9/d12/d4b/f41 [0,4194304] 0 2024-09-17T01:06:55.273 INFO:tasks.workunit.client.1.smithi143.stdout:2/245: dwrite d0/d10/f30 [0,4194304] 0 2024-09-17T01:06:55.275 INFO:tasks.workunit.client.1.smithi143.stdout:8/240: mkdir d9/d12/d38/d58 0 2024-09-17T01:06:55.275 INFO:tasks.workunit.client.1.smithi143.stdout:2/246: write d0/d10/f16 [1959620,130723] 0 2024-09-17T01:06:55.279 INFO:tasks.workunit.client.1.smithi143.stdout:8/241: creat d9/f59 x:0 0 0 2024-09-17T01:06:55.280 INFO:tasks.workunit.client.1.smithi143.stdout:2/247: creat d0/d10/f47 x:0 0 0 2024-09-17T01:06:55.282 INFO:tasks.workunit.client.1.smithi143.stdout:3/194: read d6/f2d [1752687,130807] 0 2024-09-17T01:06:55.284 INFO:tasks.workunit.client.1.smithi143.stdout:2/248: symlink d0/d2/d21/d22/l48 0 2024-09-17T01:06:55.284 INFO:tasks.workunit.client.1.smithi143.stdout:2/249: chown d0/f42 295476 1 2024-09-17T01:06:55.284 INFO:tasks.workunit.client.1.smithi143.stdout:2/250: stat d0/d2 0 2024-09-17T01:06:55.288 INFO:tasks.workunit.client.1.smithi143.stdout:2/251: link d0/d10/f34 d0/d2/d21/f49 0 2024-09-17T01:06:55.290 INFO:tasks.workunit.client.1.smithi143.stdout:2/252: rename d0/d2/d21/d22/d24/f29 to d0/f4a 0 2024-09-17T01:06:55.291 INFO:tasks.workunit.client.1.smithi143.stdout:2/253: mknod d0/d10/c4b 0 2024-09-17T01:06:55.295 INFO:tasks.workunit.client.1.smithi143.stdout:3/195: dread d6/d10/f11 [0,4194304] 0 2024-09-17T01:06:55.297 INFO:tasks.workunit.client.1.smithi143.stdout:3/196: dread d6/f1f [0,4194304] 0 2024-09-17T01:06:55.299 INFO:tasks.workunit.client.1.smithi143.stdout:3/197: unlink d6/d10/d2b/c31 0 2024-09-17T01:06:55.301 INFO:tasks.workunit.client.1.smithi143.stdout:3/198: unlink d6/d1c/d33/f36 0 2024-09-17T01:06:55.302 INFO:tasks.workunit.client.1.smithi143.stdout:3/199: fdatasync d6/d10/d2e/d30/f32 0 2024-09-17T01:06:55.359 INFO:tasks.workunit.client.1.smithi143.stdout:0/275: dread d3/d5/f9 [0,4194304] 0 2024-09-17T01:06:55.421 INFO:tasks.workunit.client.1.smithi143.stdout:3/200: rename d6/f2d to d6/d1c/d33/f38 0 2024-09-17T01:06:55.424 INFO:tasks.workunit.client.1.smithi143.stdout:0/276: getdents d3/d5/d8/d21/d2e 0 2024-09-17T01:06:55.425 INFO:tasks.workunit.client.1.smithi143.stdout:0/277: fdatasync d3/d5/d8/d21/f47 0 2024-09-17T01:06:55.425 INFO:tasks.workunit.client.1.smithi143.stdout:0/278: readlink d3/d5/d8/d10/l2f 0 2024-09-17T01:06:55.427 INFO:tasks.workunit.client.1.smithi143.stdout:0/279: truncate d3/d14/d32/f38 2173435 0 2024-09-17T01:06:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:55 smithi103 ceph-mon[28156]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 187 op/s 2024-09-17T01:06:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:55 smithi103 ceph-mon[28156]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:55 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/142839998' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:55.436 INFO:tasks.workunit.client.1.smithi143.stdout:0/280: mkdir d3/d5/d8/d58 0 2024-09-17T01:06:55.436 INFO:tasks.workunit.client.1.smithi143.stdout:2/254: rmdir d0 39 2024-09-17T01:06:55.437 INFO:tasks.workunit.client.1.smithi143.stdout:8/242: symlink d9/d12/d49/l5a 0 2024-09-17T01:06:55.438 INFO:tasks.workunit.client.1.smithi143.stdout:8/243: chown d9/d12 221787 1 2024-09-17T01:06:55.440 INFO:tasks.workunit.client.1.smithi143.stdout:2/255: read d0/d10/f11 [7002348,102287] 0 2024-09-17T01:06:55.441 INFO:tasks.workunit.client.1.smithi143.stdout:0/281: mknod d3/d5/d8/d21/c59 0 2024-09-17T01:06:55.442 INFO:tasks.workunit.client.1.smithi143.stdout:2/256: chown d0/d2/d21/d22/f3c 747431 1 2024-09-17T01:06:55.443 INFO:tasks.workunit.client.1.smithi143.stdout:8/244: dwrite d9/d12/d13/f33 [4194304,4194304] 0 2024-09-17T01:06:55.444 INFO:tasks.workunit.client.1.smithi143.stdout:0/282: write d3/d5/f29 [245824,120426] 0 2024-09-17T01:06:55.445 INFO:tasks.workunit.client.1.smithi143.stdout:2/257: mkdir d0/d2/d21/d22/d3d/d4c 0 2024-09-17T01:06:55.446 INFO:tasks.workunit.client.1.smithi143.stdout:0/283: read - d3/d5/d8/d21/d2e/f50 zero size 2024-09-17T01:06:55.446 INFO:tasks.workunit.client.1.smithi143.stdout:8/245: mknod d9/d12/d38/c5b 0 2024-09-17T01:06:55.448 INFO:tasks.workunit.client.1.smithi143.stdout:2/258: write d0/d2/d21/f32 [4410913,34486] 0 2024-09-17T01:06:55.449 INFO:tasks.workunit.client.1.smithi143.stdout:2/259: dread - d0/d10/f47 zero size 2024-09-17T01:06:55.452 INFO:tasks.workunit.client.1.smithi143.stdout:8/246: write d9/f11 [3725773,11082] 0 2024-09-17T01:06:55.455 INFO:tasks.workunit.client.1.smithi143.stdout:2/260: dwrite d0/d10/f16 [0,4194304] 0 2024-09-17T01:06:55.456 INFO:tasks.workunit.client.1.smithi143.stdout:8/247: read d9/d23/d32/f51 [2390460,110628] 0 2024-09-17T01:06:55.458 INFO:tasks.workunit.client.1.smithi143.stdout:2/261: mknod d0/c4d 0 2024-09-17T01:06:55.462 INFO:tasks.workunit.client.1.smithi143.stdout:8/248: dwrite d9/d12/f18 [0,4194304] 0 2024-09-17T01:06:55.463 INFO:tasks.workunit.client.1.smithi143.stdout:2/262: unlink d0/c23 0 2024-09-17T01:06:55.464 INFO:tasks.workunit.client.1.smithi143.stdout:2/263: fsync d0/d2/f2b 0 2024-09-17T01:06:55.464 INFO:tasks.workunit.client.1.smithi143.stdout:0/284: write d3/d5/f34 [167860,101461] 0 2024-09-17T01:06:55.469 INFO:tasks.workunit.client.1.smithi143.stdout:0/285: write d3/d14/d32/f38 [1938305,121444] 0 2024-09-17T01:06:55.471 INFO:tasks.workunit.client.1.smithi143.stdout:0/286: dread - d3/d5/d8/d21/d2e/f50 zero size 2024-09-17T01:06:55.472 INFO:tasks.workunit.client.1.smithi143.stdout:2/264: symlink d0/d2/d21/d22/d24/l4e 0 2024-09-17T01:06:55.473 INFO:tasks.workunit.client.1.smithi143.stdout:8/249: getdents d9/de/d53 0 2024-09-17T01:06:55.474 INFO:tasks.workunit.client.1.smithi143.stdout:4/236: sync 2024-09-17T01:06:55.475 INFO:tasks.workunit.client.1.smithi143.stdout:2/265: symlink d0/d2/d21/d22/d3d/l4f 0 2024-09-17T01:06:55.477 INFO:tasks.workunit.client.1.smithi143.stdout:0/287: rename d3/d5/la to d3/d5/d8/l5a 0 2024-09-17T01:06:55.477 INFO:tasks.workunit.client.1.smithi143.stdout:7/305: sync 2024-09-17T01:06:55.477 INFO:tasks.workunit.client.1.smithi143.stdout:0/288: dread - d3/d5/d8/d27/d31/d4c/f45 zero size 2024-09-17T01:06:55.478 INFO:tasks.workunit.client.1.smithi143.stdout:8/250: creat d9/d12/d49/f5c x:0 0 0 2024-09-17T01:06:55.480 INFO:tasks.workunit.client.1.smithi143.stdout:0/289: symlink d3/d5/l5b 0 2024-09-17T01:06:55.481 INFO:tasks.workunit.client.1.smithi143.stdout:7/306: mknod d4/c5e 0 2024-09-17T01:06:55.482 INFO:tasks.workunit.client.1.smithi143.stdout:0/290: write d3/d5/f34 [2002850,6381] 0 2024-09-17T01:06:55.483 INFO:tasks.workunit.client.1.smithi143.stdout:8/251: getdents d9/de 0 2024-09-17T01:06:55.484 INFO:tasks.workunit.client.1.smithi143.stdout:4/237: truncate da/d3a/f3b 906718 0 2024-09-17T01:06:55.485 INFO:tasks.workunit.client.1.smithi143.stdout:7/307: symlink d4/d1f/d4a/l5f 0 2024-09-17T01:06:55.488 INFO:tasks.workunit.client.1.smithi143.stdout:2/266: dwrite d0/d2/fe [0,4194304] 0 2024-09-17T01:06:55.488 INFO:tasks.workunit.client.1.smithi143.stdout:0/291: read d3/d5/fc [5581026,101276] 0 2024-09-17T01:06:55.489 INFO:tasks.workunit.client.1.smithi143.stdout:7/308: creat d4/d1f/f60 x:0 0 0 2024-09-17T01:06:55.491 INFO:tasks.workunit.client.1.smithi143.stdout:7/309: readlink d4/l1e 0 2024-09-17T01:06:55.493 INFO:tasks.workunit.client.1.smithi143.stdout:0/292: creat d3/d5/d8/d10/f5c x:0 0 0 2024-09-17T01:06:55.494 INFO:tasks.workunit.client.1.smithi143.stdout:2/267: creat d0/d2/d21/d22/d3d/f50 x:0 0 0 2024-09-17T01:06:55.495 INFO:tasks.workunit.client.1.smithi143.stdout:7/310: creat d4/d26/f61 x:0 0 0 2024-09-17T01:06:55.496 INFO:tasks.workunit.client.1.smithi143.stdout:0/293: creat d3/d14/d3d/f5d x:0 0 0 2024-09-17T01:06:55.497 INFO:tasks.workunit.client.1.smithi143.stdout:8/252: dwrite d9/d12/d13/f33 [0,4194304] 0 2024-09-17T01:06:55.497 INFO:tasks.workunit.client.1.smithi143.stdout:2/268: creat d0/f51 x:0 0 0 2024-09-17T01:06:55.501 INFO:tasks.workunit.client.1.smithi143.stdout:7/311: truncate d4/d16/f1d 2255466 0 2024-09-17T01:06:55.502 INFO:tasks.workunit.client.1.smithi143.stdout:8/253: creat d9/d12/d13/f5d x:0 0 0 2024-09-17T01:06:55.503 INFO:tasks.workunit.client.1.smithi143.stdout:4/238: dwrite da/f32 [0,4194304] 0 2024-09-17T01:06:55.506 INFO:tasks.workunit.client.1.smithi143.stdout:8/254: write d9/f59 [75391,22614] 0 2024-09-17T01:06:55.506 INFO:tasks.workunit.client.1.smithi143.stdout:0/294: creat d3/d5/d8/d27/d31/d48/f5e x:0 0 0 2024-09-17T01:06:55.508 INFO:tasks.workunit.client.1.smithi143.stdout:7/312: creat d4/f62 x:0 0 0 2024-09-17T01:06:55.509 INFO:tasks.workunit.client.1.smithi143.stdout:4/239: stat da/c1f 0 2024-09-17T01:06:55.511 INFO:tasks.workunit.client.1.smithi143.stdout:0/295: truncate d3/d5/d8/d27/d31/d4c/f45 986666 0 2024-09-17T01:06:55.512 INFO:tasks.workunit.client.1.smithi143.stdout:8/255: mknod d9/d12/c5e 0 2024-09-17T01:06:55.512 INFO:tasks.workunit.client.1.smithi143.stdout:8/256: chown d9/d12/d13 3418 1 2024-09-17T01:06:55.513 INFO:tasks.workunit.client.1.smithi143.stdout:7/313: creat d4/d1f/f63 x:0 0 0 2024-09-17T01:06:55.518 INFO:tasks.workunit.client.1.smithi143.stdout:0/296: link d3/d5/d8/f44 d3/f5f 0 2024-09-17T01:06:55.518 INFO:tasks.workunit.client.1.smithi143.stdout:7/314: rename d4/d33/f4d to d4/d1f/d29/f64 0 2024-09-17T01:06:55.519 INFO:tasks.workunit.client.1.smithi143.stdout:2/269: dwrite d0/d2/d21/d22/f28 [0,4194304] 0 2024-09-17T01:06:55.519 INFO:tasks.workunit.client.1.smithi143.stdout:8/257: getdents d9/d23/d48/d56 0 2024-09-17T01:06:55.520 INFO:tasks.workunit.client.1.smithi143.stdout:7/315: write d4/f13 [4602747,47757] 0 2024-09-17T01:06:55.524 INFO:tasks.workunit.client.1.smithi143.stdout:7/316: write d4/f44 [127898,14533] 0 2024-09-17T01:06:55.524 INFO:tasks.workunit.client.1.smithi143.stdout:2/270: creat d0/d2/d21/d22/f52 x:0 0 0 2024-09-17T01:06:55.526 INFO:tasks.workunit.client.1.smithi143.stdout:0/297: creat d3/d14/f60 x:0 0 0 2024-09-17T01:06:55.527 INFO:tasks.workunit.client.1.smithi143.stdout:5/282: sync 2024-09-17T01:06:55.528 INFO:tasks.workunit.client.1.smithi143.stdout:2/271: fsync d0/d2/d21/d22/f2d 0 2024-09-17T01:06:55.528 INFO:tasks.workunit.client.1.smithi143.stdout:8/258: rename d9/d12/c30 to d9/d23/c5f 0 2024-09-17T01:06:55.531 INFO:tasks.workunit.client.1.smithi143.stdout:2/272: mknod d0/c53 0 2024-09-17T01:06:55.531 INFO:tasks.workunit.client.1.smithi143.stdout:8/259: write d9/f29 [2630376,109540] 0 2024-09-17T01:06:55.532 INFO:tasks.workunit.client.1.smithi143.stdout:7/317: dwrite d4/f1b [4194304,4194304] 0 2024-09-17T01:06:55.532 INFO:tasks.workunit.client.1.smithi143.stdout:0/298: creat d3/d14/f61 x:0 0 0 2024-09-17T01:06:55.533 INFO:tasks.workunit.client.1.smithi143.stdout:2/273: fsync d0/d2/d21/f32 0 2024-09-17T01:06:55.537 INFO:tasks.workunit.client.1.smithi143.stdout:2/274: symlink d0/d44/l54 0 2024-09-17T01:06:55.537 INFO:tasks.workunit.client.1.smithi143.stdout:4/240: dread da/f11 [0,4194304] 0 2024-09-17T01:06:55.537 INFO:tasks.workunit.client.1.smithi143.stdout:4/241: read - da/f31 zero size 2024-09-17T01:06:55.538 INFO:tasks.workunit.client.1.smithi143.stdout:4/242: chown da/d3a/d40/f34 12524 1 2024-09-17T01:06:55.539 INFO:tasks.workunit.client.1.smithi143.stdout:4/243: fsync da/d3a/d40/f39 0 2024-09-17T01:06:55.539 INFO:tasks.workunit.client.1.smithi143.stdout:7/318: rename d4/d16/d47 to d4/d1f/d29/d65 0 2024-09-17T01:06:55.542 INFO:tasks.workunit.client.1.smithi143.stdout:7/319: mkdir d4/d1f/d4a/d66 0 2024-09-17T01:06:55.544 INFO:tasks.workunit.client.1.smithi143.stdout:2/275: mkdir d0/d2/d21/d55 0 2024-09-17T01:06:55.545 INFO:tasks.workunit.client.1.smithi143.stdout:7/320: creat d4/d1f/d4a/d66/f67 x:0 0 0 2024-09-17T01:06:55.546 INFO:tasks.workunit.client.1.smithi143.stdout:5/283: truncate d1/d46/df/d23/d4f/f1d 9315494 0 2024-09-17T01:06:55.550 INFO:tasks.workunit.client.1.smithi143.stdout:8/260: truncate d9/d26/f3e 1581610 0 2024-09-17T01:06:55.551 INFO:tasks.workunit.client.1.smithi143.stdout:2/276: getdents d0 0 2024-09-17T01:06:55.551 INFO:tasks.workunit.client.1.smithi143.stdout:2/277: chown d0/d2/d21/d22/l48 144 1 2024-09-17T01:06:55.552 INFO:tasks.workunit.client.1.smithi143.stdout:8/261: mknod d9/d23/c60 0 2024-09-17T01:06:55.552 INFO:tasks.workunit.client.1.smithi143.stdout:2/278: readlink d0/d2/l3f 0 2024-09-17T01:06:55.553 INFO:tasks.workunit.client.1.smithi143.stdout:2/279: fdatasync d0/d10/f33 0 2024-09-17T01:06:55.553 INFO:tasks.workunit.client.1.smithi143.stdout:8/262: read d9/f11 [2904577,11802] 0 2024-09-17T01:06:55.555 INFO:tasks.workunit.client.1.smithi143.stdout:2/280: stat d0/d2/d21/d22/d24/c3e 0 2024-09-17T01:06:55.556 INFO:tasks.workunit.client.1.smithi143.stdout:8/263: mkdir d9/d23/d48/d55/d61 0 2024-09-17T01:06:55.558 INFO:tasks.workunit.client.1.smithi143.stdout:2/281: mkdir d0/d10/d56 0 2024-09-17T01:06:55.558 INFO:tasks.workunit.client.1.smithi143.stdout:2/282: readlink d0/l37 0 2024-09-17T01:06:55.559 INFO:tasks.workunit.client.1.smithi143.stdout:2/283: fdatasync d0/d10/f33 0 2024-09-17T01:06:55.560 INFO:tasks.workunit.client.1.smithi143.stdout:8/264: fsync d9/d23/d32/f51 0 2024-09-17T01:06:55.560 INFO:tasks.workunit.client.1.smithi143.stdout:8/265: chown d9/d12/d4b/d3f 715 1 2024-09-17T01:06:55.561 INFO:tasks.workunit.client.1.smithi143.stdout:2/284: creat d0/d44/f57 x:0 0 0 2024-09-17T01:06:55.564 INFO:tasks.workunit.client.1.smithi143.stdout:2/285: getdents d0/d10/d56 0 2024-09-17T01:06:55.565 INFO:tasks.workunit.client.1.smithi143.stdout:2/286: write d0/d2/d21/d22/f3c [4151546,92415] 0 2024-09-17T01:06:55.566 INFO:tasks.workunit.client.1.smithi143.stdout:8/266: dwrite d9/d12/d13/f33 [0,4194304] 0 2024-09-17T01:06:55.566 INFO:tasks.workunit.client.1.smithi143.stdout:2/287: chown d0/d2/d21 3532740 1 2024-09-17T01:06:55.568 INFO:tasks.workunit.client.1.smithi143.stdout:8/267: write d9/d23/d48/f40 [360597,44683] 0 2024-09-17T01:06:55.570 INFO:tasks.workunit.client.1.smithi143.stdout:5/284: dread d1/d46/f2d [0,4194304] 0 2024-09-17T01:06:55.570 INFO:tasks.workunit.client.1.smithi143.stdout:2/288: mkdir d0/d10/d58 0 2024-09-17T01:06:55.571 INFO:tasks.workunit.client.1.smithi143.stdout:8/268: symlink d9/d26/l62 0 2024-09-17T01:06:55.571 INFO:tasks.workunit.client.1.smithi143.stdout:5/285: mkdir d1/d46/df/d53/d74 0 2024-09-17T01:06:55.572 INFO:tasks.workunit.client.1.smithi143.stdout:8/269: symlink d9/d23/d48/d55/l63 0 2024-09-17T01:06:55.573 INFO:tasks.workunit.client.1.smithi143.stdout:2/289: mkdir d0/d2/d21/d22/d3d/d4c/d59 0 2024-09-17T01:06:55.574 INFO:tasks.workunit.client.1.smithi143.stdout:5/286: mknod d1/d46/df/d1f/d66/c75 0 2024-09-17T01:06:55.578 INFO:tasks.workunit.client.1.smithi143.stdout:5/287: chown d1/d46/df/d23/c51 491 1 2024-09-17T01:06:55.580 INFO:tasks.workunit.client.1.smithi143.stdout:8/270: dwrite d9/d26/f36 [0,4194304] 0 2024-09-17T01:06:55.580 INFO:tasks.workunit.client.1.smithi143.stdout:5/288: creat d1/d46/df/f76 x:0 0 0 2024-09-17T01:06:55.581 INFO:tasks.workunit.client.1.smithi143.stdout:2/290: dwrite d0/d2/d21/d22/d24/f36 [0,4194304] 0 2024-09-17T01:06:55.581 INFO:tasks.workunit.client.1.smithi143.stdout:8/271: creat d9/d12/d38/f64 x:0 0 0 2024-09-17T01:06:55.583 INFO:tasks.workunit.client.1.smithi143.stdout:5/289: symlink d1/d46/df/d1f/d66/l77 0 2024-09-17T01:06:55.585 INFO:tasks.workunit.client.1.smithi143.stdout:5/290: truncate d1/f68 18755 0 2024-09-17T01:06:55.588 INFO:tasks.workunit.client.1.smithi143.stdout:5/291: write d1/d46/df/f3d [675,46040] 0 2024-09-17T01:06:55.589 INFO:tasks.workunit.client.1.smithi143.stdout:8/272: dread d9/f46 [0,4194304] 0 2024-09-17T01:06:55.611 INFO:tasks.workunit.client.1.smithi143.stdout:2/291: dread d0/d2/d21/d22/f2f [0,4194304] 0 2024-09-17T01:06:55.616 INFO:tasks.workunit.client.1.smithi143.stdout:2/292: dwrite d0/d44/f46 [0,4194304] 0 2024-09-17T01:06:55.616 INFO:tasks.workunit.client.1.smithi143.stdout:2/293: chown d0/d10/f16 4496239 1 2024-09-17T01:06:55.617 INFO:tasks.workunit.client.1.smithi143.stdout:2/294: write d0/fc [812842,76998] 0 2024-09-17T01:06:55.689 INFO:tasks.workunit.client.1.smithi143.stdout:8/273: mknod d9/d12/c65 0 2024-09-17T01:06:55.690 INFO:tasks.workunit.client.1.smithi143.stdout:8/274: truncate d9/d12/d13/f5d 424312 0 2024-09-17T01:06:55.690 INFO:tasks.workunit.client.1.smithi143.stdout:8/275: chown d9/de/d53/l54 14115 1 2024-09-17T01:06:55.694 INFO:tasks.workunit.client.1.smithi143.stdout:2/295: mkdir d0/d10/d58/d5a 0 2024-09-17T01:06:55.695 INFO:tasks.workunit.client.1.smithi143.stdout:8/276: mkdir d9/d23/d48/d56/d66 0 2024-09-17T01:06:55.695 INFO:tasks.workunit.client.1.smithi143.stdout:8/277: fdatasync d9/d26/f36 0 2024-09-17T01:06:55.697 INFO:tasks.workunit.client.1.smithi143.stdout:2/296: rename d0/d2/d21/d22/d3d to d0/d10/d58/d5a/d5b 0 2024-09-17T01:06:55.698 INFO:tasks.workunit.client.1.smithi143.stdout:8/278: mknod d9/d12/d13/c67 0 2024-09-17T01:06:55.699 INFO:tasks.workunit.client.1.smithi143.stdout:2/297: creat d0/d10/f5c x:0 0 0 2024-09-17T01:06:55.700 INFO:tasks.workunit.client.1.smithi143.stdout:2/298: fsync d0/d2/d21/d22/d24/f2a 0 2024-09-17T01:06:55.702 INFO:tasks.workunit.client.1.smithi143.stdout:8/279: getdents d9/d23 0 2024-09-17T01:06:55.703 INFO:tasks.workunit.client.1.smithi143.stdout:2/299: link d0/d10/f47 d0/d44/f5d 0 2024-09-17T01:06:55.703 INFO:tasks.workunit.client.1.smithi143.stdout:8/280: fdatasync d9/d12/d13/f5d 0 2024-09-17T01:06:55.704 INFO:tasks.workunit.client.1.smithi143.stdout:2/300: stat d0/d10/f47 0 2024-09-17T01:06:55.704 INFO:tasks.workunit.client.1.smithi143.stdout:2/301: stat d0/c1e 0 2024-09-17T01:06:55.706 INFO:tasks.workunit.client.1.smithi143.stdout:8/281: rename d9/f29 to d9/de/d53/f68 0 2024-09-17T01:06:55.709 INFO:tasks.workunit.client.1.smithi143.stdout:5/292: dread d1/d46/df/f25 [0,4194304] 0 2024-09-17T01:06:55.710 INFO:tasks.workunit.client.1.smithi143.stdout:2/302: dwrite d0/fc [0,4194304] 0 2024-09-17T01:06:55.718 INFO:tasks.workunit.client.1.smithi143.stdout:5/293: creat d1/d46/d6e/f78 x:0 0 0 2024-09-17T01:06:55.720 INFO:tasks.workunit.client.1.smithi143.stdout:1/284: sync 2024-09-17T01:06:55.721 INFO:tasks.workunit.client.1.smithi143.stdout:9/234: sync 2024-09-17T01:06:55.721 INFO:tasks.workunit.client.1.smithi143.stdout:2/303: mknod d0/d2/d21/d22/d24/c5e 0 2024-09-17T01:06:55.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/285: truncate d0/d6/d7/de/d2/f5b 399512 0 2024-09-17T01:06:55.724 INFO:tasks.workunit.client.1.smithi143.stdout:2/304: chown d0/d2/d21/d22/d24/f36 0 1 2024-09-17T01:06:55.726 INFO:tasks.workunit.client.1.smithi143.stdout:2/305: readlink d0/d2/l3 0 2024-09-17T01:06:55.727 INFO:tasks.workunit.client.1.smithi143.stdout:8/282: dwrite d9/d12/d4b/f41 [0,4194304] 0 2024-09-17T01:06:55.727 INFO:tasks.workunit.client.1.smithi143.stdout:2/306: write d0/d10/f30 [228954,34159] 0 2024-09-17T01:06:55.728 INFO:tasks.workunit.client.1.smithi143.stdout:5/294: creat d1/d46/f79 x:0 0 0 2024-09-17T01:06:55.728 INFO:tasks.workunit.client.1.smithi143.stdout:2/307: stat d0/d44/l54 0 2024-09-17T01:06:55.736 INFO:tasks.workunit.client.1.smithi143.stdout:9/235: getdents d3/d3d/d48 0 2024-09-17T01:06:55.737 INFO:tasks.workunit.client.1.smithi143.stdout:5/295: mkdir d1/d46/df/d1f/d7a 0 2024-09-17T01:06:55.738 INFO:tasks.workunit.client.1.smithi143.stdout:2/308: creat d0/d10/d58/d5a/f5f x:0 0 0 2024-09-17T01:06:55.739 INFO:tasks.workunit.client.1.smithi143.stdout:2/309: chown d0/c4d 4218 1 2024-09-17T01:06:55.742 INFO:tasks.workunit.client.1.smithi143.stdout:5/296: rmdir d1/d46/df/d53 39 2024-09-17T01:06:55.743 INFO:tasks.workunit.client.1.smithi143.stdout:2/310: mknod d0/d10/d58/d5a/d5b/d4c/c60 0 2024-09-17T01:06:55.744 INFO:tasks.workunit.client.1.smithi143.stdout:8/283: dread d9/de/f10 [0,4194304] 0 2024-09-17T01:06:55.745 INFO:tasks.workunit.client.1.smithi143.stdout:1/286: getdents d0/d6/d7/de/d18 0 2024-09-17T01:06:55.745 INFO:tasks.workunit.client.1.smithi143.stdout:9/236: read d3/f8 [3027005,118762] 0 2024-09-17T01:06:55.747 INFO:tasks.workunit.client.1.smithi143.stdout:1/287: write d0/dc/f2c [2432243,112459] 0 2024-09-17T01:06:55.750 INFO:tasks.workunit.client.1.smithi143.stdout:5/297: getdents d1/d46/df/d1f/d66 0 2024-09-17T01:06:55.754 INFO:tasks.workunit.client.1.smithi143.stdout:1/288: rename d0/d6/d7/de/l5a to d0/d6/d7/de/d2/l5c 0 2024-09-17T01:06:55.754 INFO:tasks.workunit.client.1.smithi143.stdout:0/299: sync 2024-09-17T01:06:55.755 INFO:tasks.workunit.client.1.smithi143.stdout:6/171: sync 2024-09-17T01:06:55.755 INFO:tasks.workunit.client.1.smithi143.stdout:3/201: sync 2024-09-17T01:06:55.755 INFO:tasks.workunit.client.1.smithi143.stdout:5/298: mknod d1/d46/df/d1f/d66/c7b 0 2024-09-17T01:06:55.756 INFO:tasks.workunit.client.1.smithi143.stdout:2/311: dwrite d0/d10/f1d [0,4194304] 0 2024-09-17T01:06:55.757 INFO:tasks.workunit.client.1.smithi143.stdout:3/202: fsync d6/d10/f1a 0 2024-09-17T01:06:55.757 INFO:tasks.workunit.client.1.smithi143.stdout:8/284: dwrite d9/d12/f18 [4194304,4194304] 0 2024-09-17T01:06:55.759 INFO:tasks.workunit.client.1.smithi143.stdout:5/299: creat d1/d46/d6e/f7c x:0 0 0 2024-09-17T01:06:55.765 INFO:tasks.workunit.client.1.smithi143.stdout:6/172: rename d2/df/d20/d2c/f2f to d2/df/d20/f34 0 2024-09-17T01:06:55.766 INFO:tasks.workunit.client.1.smithi143.stdout:2/312: truncate d0/d2/d21/f49 591688 0 2024-09-17T01:06:55.767 INFO:tasks.workunit.client.1.smithi143.stdout:1/289: truncate d0/d6/d7/de/d18/d2d/f51 529323 0 2024-09-17T01:06:55.769 INFO:tasks.workunit.client.1.smithi143.stdout:5/300: unlink d1/d46/df/d53/f55 0 2024-09-17T01:06:55.770 INFO:tasks.workunit.client.1.smithi143.stdout:8/285: truncate d9/d26/f36 2679434 0 2024-09-17T01:06:55.771 INFO:tasks.workunit.client.1.smithi143.stdout:2/313: read d0/d10/f11 [4963253,70199] 0 2024-09-17T01:06:55.771 INFO:tasks.workunit.client.1.smithi143.stdout:0/300: dwrite d3/d14/f61 [0,4194304] 0 2024-09-17T01:06:55.772 INFO:tasks.workunit.client.1.smithi143.stdout:9/237: dread d3/d16/d2b/f2a [0,4194304] 0 2024-09-17T01:06:55.776 INFO:tasks.workunit.client.1.smithi143.stdout:3/203: dwrite d6/d10/f16 [0,4194304] 0 2024-09-17T01:06:55.776 INFO:tasks.workunit.client.1.smithi143.stdout:8/286: chown d9/fc 630274 1 2024-09-17T01:06:55.776 INFO:tasks.workunit.client.1.smithi143.stdout:5/301: mkdir d1/d46/df/d23/d4f/d7d 0 2024-09-17T01:06:55.776 INFO:tasks.workunit.client.1.smithi143.stdout:9/238: stat d3/d16/d2b/d26/l35 0 2024-09-17T01:06:55.778 INFO:tasks.workunit.client.1.smithi143.stdout:5/302: stat d1/d46/df/d1f/d7a 0 2024-09-17T01:06:55.778 INFO:tasks.workunit.client.1.smithi143.stdout:1/290: dread d0/d6/d7/de/d18/d2d/f51 [0,4194304] 0 2024-09-17T01:06:55.779 INFO:tasks.workunit.client.1.smithi143.stdout:2/314: rename d0/d44/f57 to d0/d44/f61 0 2024-09-17T01:06:55.780 INFO:tasks.workunit.client.1.smithi143.stdout:8/287: readlink d9/d23/d32/l42 0 2024-09-17T01:06:55.780 INFO:tasks.workunit.client.1.smithi143.stdout:3/204: creat d6/d10/f39 x:0 0 0 2024-09-17T01:06:55.785 INFO:tasks.workunit.client.1.smithi143.stdout:8/288: chown d9/de/f21 2 1 2024-09-17T01:06:55.785 INFO:tasks.workunit.client.1.smithi143.stdout:3/205: truncate d6/d10/f1a 6021154 0 2024-09-17T01:06:55.786 INFO:tasks.workunit.client.1.smithi143.stdout:6/173: rmdir d2/df 39 2024-09-17T01:06:55.787 INFO:tasks.workunit.client.1.smithi143.stdout:5/303: creat d1/d46/df/d23/d4f/f7e x:0 0 0 2024-09-17T01:06:55.788 INFO:tasks.workunit.client.1.smithi143.stdout:2/315: dread d0/d2/d21/d22/d24/f43 [0,4194304] 0 2024-09-17T01:06:55.789 INFO:tasks.workunit.client.1.smithi143.stdout:3/206: fsync d6/d10/f1a 0 2024-09-17T01:06:55.790 INFO:tasks.workunit.client.1.smithi143.stdout:1/291: write d0/d6/d7/de/d2/d3c/f45 [2302234,113556] 0 2024-09-17T01:06:55.792 INFO:tasks.workunit.client.1.smithi143.stdout:6/174: write d2/d19/f1b [4449528,123652] 0 2024-09-17T01:06:55.793 INFO:tasks.workunit.client.1.smithi143.stdout:2/316: write d0/f51 [285870,6879] 0 2024-09-17T01:06:55.793 INFO:tasks.workunit.client.1.smithi143.stdout:9/239: dwrite d3/d16/d2b/d9/f41 [0,4194304] 0 2024-09-17T01:06:55.794 INFO:tasks.workunit.client.1.smithi143.stdout:3/207: symlink d6/d10/l3a 0 2024-09-17T01:06:55.797 INFO:tasks.workunit.client.1.smithi143.stdout:1/292: creat d0/dc/d57/f5d x:0 0 0 2024-09-17T01:06:55.802 INFO:tasks.workunit.client.1.smithi143.stdout:6/175: chown d2/d19/c1e 5 1 2024-09-17T01:06:55.803 INFO:tasks.workunit.client.1.smithi143.stdout:8/289: dread d9/d12/f18 [0,4194304] 0 2024-09-17T01:06:55.806 INFO:tasks.workunit.client.1.smithi143.stdout:2/317: creat d0/d2/d21/f62 x:0 0 0 2024-09-17T01:06:55.807 INFO:tasks.workunit.client.1.smithi143.stdout:1/293: dread d0/d6/d7/de/d18/d2d/f51 [0,4194304] 0 2024-09-17T01:06:55.807 INFO:tasks.workunit.client.1.smithi143.stdout:3/208: rename d6/d10/f2f to d6/d10/d2b/f3b 0 2024-09-17T01:06:55.808 INFO:tasks.workunit.client.1.smithi143.stdout:5/304: dwrite d1/d46/df/d23/d4f/f20 [0,4194304] 0 2024-09-17T01:06:55.810 INFO:tasks.workunit.client.1.smithi143.stdout:7/321: sync 2024-09-17T01:06:55.810 INFO:tasks.workunit.client.1.smithi143.stdout:4/244: sync 2024-09-17T01:06:55.812 INFO:tasks.workunit.client.1.smithi143.stdout:0/301: truncate d3/d5/d8/d10/f4f 1116096 0 2024-09-17T01:06:55.813 INFO:tasks.workunit.client.1.smithi143.stdout:8/290: write d9/de/d53/f68 [1169587,52908] 0 2024-09-17T01:06:55.816 INFO:tasks.workunit.client.1.smithi143.stdout:7/322: write d4/fd [3492988,9688] 0 2024-09-17T01:06:55.817 INFO:tasks.workunit.client.1.smithi143.stdout:9/240: rename d3/d16/d2b/d9/f17 to d3/d39/f4b 0 2024-09-17T01:06:55.819 INFO:tasks.workunit.client.1.smithi143.stdout:3/209: mknod d6/d10/d2e/c3c 0 2024-09-17T01:06:55.819 INFO:tasks.workunit.client.1.smithi143.stdout:2/318: creat d0/d10/d58/d5a/d5b/d4c/f63 x:0 0 0 2024-09-17T01:06:55.821 INFO:tasks.workunit.client.1.smithi143.stdout:4/245: dread - da/f20 zero size 2024-09-17T01:06:55.821 INFO:tasks.workunit.client.1.smithi143.stdout:7/323: write d4/d1f/d4a/d66/f67 [456890,63661] 0 2024-09-17T01:06:55.824 INFO:tasks.workunit.client.1.smithi143.stdout:1/294: creat d0/d6/d7/de/d2/d39/f5e x:0 0 0 2024-09-17T01:06:55.824 INFO:tasks.workunit.client.1.smithi143.stdout:7/324: fsync d4/d1f/f31 0 2024-09-17T01:06:55.824 INFO:tasks.workunit.client.1.smithi143.stdout:6/176: dread d2/df/d20/f34 [0,4194304] 0 2024-09-17T01:06:55.825 INFO:tasks.workunit.client.1.smithi143.stdout:2/319: write d0/d2/d21/f62 [32215,57787] 0 2024-09-17T01:06:55.828 INFO:tasks.workunit.client.1.smithi143.stdout:0/302: mkdir d3/d5/d8/d27/d31/d48/d62 0 2024-09-17T01:06:55.828 INFO:tasks.workunit.client.1.smithi143.stdout:8/291: dwrite d9/f59 [0,4194304] 0 2024-09-17T01:06:55.828 INFO:tasks.workunit.client.1.smithi143.stdout:3/210: fdatasync d6/d10/d2e/d30/f32 0 2024-09-17T01:06:55.829 INFO:tasks.workunit.client.1.smithi143.stdout:9/241: write d3/f4 [3504332,70438] 0 2024-09-17T01:06:55.830 INFO:tasks.workunit.client.1.smithi143.stdout:6/177: creat d2/df/d18/f35 x:0 0 0 2024-09-17T01:06:55.871 INFO:tasks.workunit.client.1.smithi143.stdout:4/246: unlink da/f2e 0 2024-09-17T01:06:55.873 INFO:tasks.workunit.client.1.smithi143.stdout:3/211: unlink d6/d10/c23 0 2024-09-17T01:06:55.873 INFO:tasks.workunit.client.1.smithi143.stdout:4/247: dread - da/d3a/d3e/d42/f46 zero size 2024-09-17T01:06:55.874 INFO:tasks.workunit.client.1.smithi143.stdout:0/303: dread d3/d5/f29 [0,4194304] 0 2024-09-17T01:06:55.874 INFO:tasks.workunit.client.1.smithi143.stdout:9/242: unlink d3/d16/f22 0 2024-09-17T01:06:55.875 INFO:tasks.workunit.client.1.smithi143.stdout:7/325: rename d4/d1f/d29/f35 to d4/d1f/f68 0 2024-09-17T01:06:55.876 INFO:tasks.workunit.client.1.smithi143.stdout:1/295: creat d0/d6/f5f x:0 0 0 2024-09-17T01:06:55.876 INFO:tasks.workunit.client.1.smithi143.stdout:8/292: symlink d9/d23/d48/d55/d57/l69 0 2024-09-17T01:06:55.877 INFO:tasks.workunit.client.1.smithi143.stdout:3/212: creat d6/d10/d2b/f3d x:0 0 0 2024-09-17T01:06:55.880 INFO:tasks.workunit.client.1.smithi143.stdout:9/243: creat d3/d16/d34/f4c x:0 0 0 2024-09-17T01:06:55.881 INFO:tasks.workunit.client.1.smithi143.stdout:8/293: readlink d9/d12/d4b/d3f/l45 0 2024-09-17T01:06:55.883 INFO:tasks.workunit.client.1.smithi143.stdout:3/213: mknod d6/d1c/c3e 0 2024-09-17T01:06:55.883 INFO:tasks.workunit.client.1.smithi143.stdout:5/305: dwrite d1/d46/df/d23/f4a [0,4194304] 0 2024-09-17T01:06:55.885 INFO:tasks.workunit.client.1.smithi143.stdout:1/296: chown d0/d6/d7/de/d18/d2d/c46 31013785 1 2024-09-17T01:06:55.886 INFO:tasks.workunit.client.1.smithi143.stdout:0/304: getdents d3/d5/d8/d27/d31/d4c 0 2024-09-17T01:06:55.887 INFO:tasks.workunit.client.1.smithi143.stdout:6/178: dwrite d2/df/f31 [0,4194304] 0 2024-09-17T01:06:55.887 INFO:tasks.workunit.client.1.smithi143.stdout:5/306: stat d1/d46/df/d53/l5b 0 2024-09-17T01:06:55.888 INFO:tasks.workunit.client.1.smithi143.stdout:8/294: fdatasync d9/d12/d13/f4d 0 2024-09-17T01:06:55.891 INFO:tasks.workunit.client.1.smithi143.stdout:7/326: dwrite d4/d33/f4b [0,4194304] 0 2024-09-17T01:06:55.897 INFO:tasks.workunit.client.1.smithi143.stdout:4/248: truncate f2 1839151 0 2024-09-17T01:06:55.900 INFO:tasks.workunit.client.1.smithi143.stdout:5/307: mknod d1/d46/d6e/c7f 0 2024-09-17T01:06:55.901 INFO:tasks.workunit.client.1.smithi143.stdout:1/297: symlink d0/d6/d7/d52/l60 0 2024-09-17T01:06:55.902 INFO:tasks.workunit.client.1.smithi143.stdout:4/249: write da/d3a/d40/f37 [957557,111848] 0 2024-09-17T01:06:55.902 INFO:tasks.workunit.client.1.smithi143.stdout:0/305: symlink d3/d5/d8/d21/l63 0 2024-09-17T01:06:55.902 INFO:tasks.workunit.client.1.smithi143.stdout:6/179: dread d2/df/f31 [0,4194304] 0 2024-09-17T01:06:55.903 INFO:tasks.workunit.client.1.smithi143.stdout:3/214: getdents d6/d10 0 2024-09-17T01:06:55.905 INFO:tasks.workunit.client.1.smithi143.stdout:8/295: link d9/d26/l62 d9/de/d53/l6a 0 2024-09-17T01:06:55.906 INFO:tasks.workunit.client.1.smithi143.stdout:5/308: chown d1/f4d 12343 1 2024-09-17T01:06:55.908 INFO:tasks.workunit.client.1.smithi143.stdout:6/180: write d2/df/d20/d2c/f22 [4605988,49658] 0 2024-09-17T01:06:55.909 INFO:tasks.workunit.client.1.smithi143.stdout:4/250: dread da/d3a/d40/f36 [0,4194304] 0 2024-09-17T01:06:55.911 INFO:tasks.workunit.client.1.smithi143.stdout:0/306: dread d3/d5/d8/d10/f3a [0,4194304] 0 2024-09-17T01:06:55.912 INFO:tasks.workunit.client.1.smithi143.stdout:7/327: dwrite d4/d1f/f23 [4194304,4194304] 0 2024-09-17T01:06:55.914 INFO:tasks.workunit.client.1.smithi143.stdout:3/215: dread d6/d10/f28 [0,4194304] 0 2024-09-17T01:06:55.914 INFO:tasks.workunit.client.1.smithi143.stdout:4/251: symlink da/d3a/d3e/l4e 0 2024-09-17T01:06:55.915 INFO:tasks.workunit.client.1.smithi143.stdout:1/298: link d0/l35 d0/d6/d7/de/d18/d2d/l61 0 2024-09-17T01:06:55.915 INFO:tasks.workunit.client.1.smithi143.stdout:7/328: write d4/d1f/d4a/f57 [1093265,120604] 0 2024-09-17T01:06:55.916 INFO:tasks.workunit.client.1.smithi143.stdout:6/181: creat d2/df/d20/d2c/f36 x:0 0 0 2024-09-17T01:06:55.917 INFO:tasks.workunit.client.1.smithi143.stdout:3/216: dread - d6/d10/f39 zero size 2024-09-17T01:06:55.918 INFO:tasks.workunit.client.1.smithi143.stdout:1/299: fsync d0/d6/f20 0 2024-09-17T01:06:55.918 INFO:tasks.workunit.client.1.smithi143.stdout:6/182: fdatasync d2/df/d20/d2c/f22 0 2024-09-17T01:06:55.921 INFO:tasks.workunit.client.1.smithi143.stdout:3/217: write d6/d10/d2e/d30/f37 [517183,48164] 0 2024-09-17T01:06:55.922 INFO:tasks.workunit.client.1.smithi143.stdout:1/300: chown d0/d6/d7/df/l15 2 1 2024-09-17T01:06:55.922 INFO:tasks.workunit.client.1.smithi143.stdout:6/183: write d2/df/d20/d2c/f22 [2118188,18886] 0 2024-09-17T01:06:55.925 INFO:tasks.workunit.client.1.smithi143.stdout:3/218: mkdir d6/d1c/d33/d3f 0 2024-09-17T01:06:55.926 INFO:tasks.workunit.client.1.smithi143.stdout:5/309: write d1/d46/df/f45 [123191,3635] 0 2024-09-17T01:06:55.926 INFO:tasks.workunit.client.1.smithi143.stdout:0/307: link d3/d5/d8/d21/c33 d3/d5/d8/d27/d31/d4c/c64 0 2024-09-17T01:06:55.928 INFO:tasks.workunit.client.1.smithi143.stdout:7/329: creat d4/f69 x:0 0 0 2024-09-17T01:06:55.929 INFO:tasks.workunit.client.1.smithi143.stdout:8/296: truncate d9/fc 2916823 0 2024-09-17T01:06:55.930 INFO:tasks.workunit.client.1.smithi143.stdout:5/310: dread - d1/d46/df/d53/f61 zero size 2024-09-17T01:06:55.931 INFO:tasks.workunit.client.1.smithi143.stdout:6/184: mknod d2/d17/d2b/c37 0 2024-09-17T01:06:55.931 INFO:tasks.workunit.client.1.smithi143.stdout:0/308: write d3/d5/d8/d21/d2e/f50 [1040453,53454] 0 2024-09-17T01:06:55.932 INFO:tasks.workunit.client.1.smithi143.stdout:1/301: dwrite d0/d6/f1f [0,4194304] 0 2024-09-17T01:06:55.936 INFO:tasks.workunit.client.1.smithi143.stdout:4/252: truncate da/f2d 3434823 0 2024-09-17T01:06:55.938 INFO:tasks.workunit.client.1.smithi143.stdout:5/311: mknod d1/d46/d6e/c80 0 2024-09-17T01:06:55.940 INFO:tasks.workunit.client.1.smithi143.stdout:0/309: mkdir d3/d5/d8/d27/d31/d4c/d65 0 2024-09-17T01:06:55.944 INFO:tasks.workunit.client.1.smithi143.stdout:8/297: rename d9/de/d53/l6a to d9/l6b 0 2024-09-17T01:06:55.944 INFO:tasks.workunit.client.1.smithi143.stdout:4/253: dread - da/d3a/d3e/d42/f43 zero size 2024-09-17T01:06:55.946 INFO:tasks.workunit.client.1.smithi143.stdout:0/310: chown d3/d5/d8/d10/c19 17488878 1 2024-09-17T01:06:55.949 INFO:tasks.workunit.client.1.smithi143.stdout:6/185: dwrite d2/df/d20/d2c/f24 [0,4194304] 0 2024-09-17T01:06:55.949 INFO:tasks.workunit.client.1.smithi143.stdout:5/312: truncate d1/f3 2896426 0 2024-09-17T01:06:55.950 INFO:tasks.workunit.client.1.smithi143.stdout:1/302: dwrite d0/d6/d7/de/f1d [4194304,4194304] 0 2024-09-17T01:06:55.951 INFO:tasks.workunit.client.1.smithi143.stdout:7/330: rename d4/d1f/d29/d65/d5d/f53 to d4/d1f/d4a/d66/f6a 0 2024-09-17T01:06:55.951 INFO:tasks.workunit.client.1.smithi143.stdout:5/313: stat d1/d46/df/d1f/f34 0 2024-09-17T01:06:55.954 INFO:tasks.workunit.client.1.smithi143.stdout:3/219: dread d6/f7 [0,4194304] 0 2024-09-17T01:06:55.955 INFO:tasks.workunit.client.1.smithi143.stdout:0/311: symlink d3/d14/d32/l66 0 2024-09-17T01:06:55.956 INFO:tasks.workunit.client.1.smithi143.stdout:6/186: rmdir d2/df 39 2024-09-17T01:06:55.958 INFO:tasks.workunit.client.1.smithi143.stdout:1/303: creat d0/d6/d7/f62 x:0 0 0 2024-09-17T01:06:55.959 INFO:tasks.workunit.client.1.smithi143.stdout:0/312: truncate d3/d5/f29 1743997 0 2024-09-17T01:06:55.959 INFO:tasks.workunit.client.1.smithi143.stdout:6/187: chown d2/c4 5530 1 2024-09-17T01:06:55.960 INFO:tasks.workunit.client.1.smithi143.stdout:0/313: readlink d3/d14/l1a 0 2024-09-17T01:06:55.960 INFO:tasks.workunit.client.1.smithi143.stdout:8/298: rename d9/d12/f18 to d9/d23/d48/f6c 0 2024-09-17T01:06:55.962 INFO:tasks.workunit.client.1.smithi143.stdout:7/331: dwrite d4/f1b [0,4194304] 0 2024-09-17T01:06:55.963 INFO:tasks.workunit.client.1.smithi143.stdout:7/332: dread - d4/d33/f3f zero size 2024-09-17T01:06:55.968 INFO:tasks.workunit.client.1.smithi143.stdout:4/254: rmdir da/d4c 0 2024-09-17T01:06:55.970 INFO:tasks.workunit.client.1.smithi143.stdout:3/220: creat d6/d10/f40 x:0 0 0 2024-09-17T01:06:55.972 INFO:tasks.workunit.client.1.smithi143.stdout:1/304: mknod d0/d6/d7/de/d2/c63 0 2024-09-17T01:06:55.973 INFO:tasks.workunit.client.1.smithi143.stdout:7/333: dread d4/f18 [0,4194304] 0 2024-09-17T01:06:55.974 INFO:tasks.workunit.client.1.smithi143.stdout:7/334: truncate d4/d1f/f28 4981968 0 2024-09-17T01:06:55.974 INFO:tasks.workunit.client.1.smithi143.stdout:7/335: chown d4/c5e 7 1 2024-09-17T01:06:55.975 INFO:tasks.workunit.client.1.smithi143.stdout:0/314: mknod d3/d5/d8/d27/d31/d48/c67 0 2024-09-17T01:06:55.976 INFO:tasks.workunit.client.1.smithi143.stdout:0/315: dread - d3/d14/f60 zero size 2024-09-17T01:06:55.982 INFO:tasks.workunit.client.1.smithi143.stdout:0/316: mkdir d3/d68 0 2024-09-17T01:06:55.983 INFO:tasks.workunit.client.1.smithi143.stdout:3/221: rename d6/d10 to d6/d1c/d33/d41 0 2024-09-17T01:06:55.986 INFO:tasks.workunit.client.1.smithi143.stdout:1/305: mkdir d0/d6/d64 0 2024-09-17T01:06:55.986 INFO:tasks.workunit.client.1.smithi143.stdout:3/222: stat d6/d1c/d33/d41/d2b/f3b 0 2024-09-17T01:06:55.986 INFO:tasks.workunit.client.1.smithi143.stdout:0/317: mknod d3/d5/d8/d10/c69 0 2024-09-17T01:06:55.987 INFO:tasks.workunit.client.1.smithi143.stdout:7/336: dwrite d4/d33/f45 [0,4194304] 0 2024-09-17T01:06:55.987 INFO:tasks.workunit.client.1.smithi143.stdout:6/188: getdents d2/d17/d2b 0 2024-09-17T01:06:55.991 INFO:tasks.workunit.client.1.smithi143.stdout:9/244: sync 2024-09-17T01:06:55.991 INFO:tasks.workunit.client.1.smithi143.stdout:2/320: sync 2024-09-17T01:06:55.995 INFO:tasks.workunit.client.1.smithi143.stdout:0/318: creat d3/d5/d8/d27/f6a x:0 0 0 2024-09-17T01:06:55.996 INFO:tasks.workunit.client.1.smithi143.stdout:7/337: symlink d4/d1f/d29/l6b 0 2024-09-17T01:06:55.999 INFO:tasks.workunit.client.1.smithi143.stdout:4/255: dwrite f2 [0,4194304] 0 2024-09-17T01:06:56.000 INFO:tasks.workunit.client.1.smithi143.stdout:9/245: truncate d3/d16/d34/f3a 1076549 0 2024-09-17T01:06:56.002 INFO:tasks.workunit.client.1.smithi143.stdout:3/223: dread d6/d1c/d33/d41/f28 [0,4194304] 0 2024-09-17T01:06:56.002 INFO:tasks.workunit.client.1.smithi143.stdout:5/314: dread d1/d46/df/d23/f26 [0,4194304] 0 2024-09-17T01:06:56.004 INFO:tasks.workunit.client.1.smithi143.stdout:7/338: creat d4/d1f/d4a/d66/f6c x:0 0 0 2024-09-17T01:06:56.004 INFO:tasks.workunit.client.1.smithi143.stdout:8/299: dread d9/de/f21 [0,4194304] 0 2024-09-17T01:06:56.007 INFO:tasks.workunit.client.1.smithi143.stdout:3/224: stat d6/d1c/c27 0 2024-09-17T01:06:56.009 INFO:tasks.workunit.client.1.smithi143.stdout:1/306: dwrite d0/dc/f38 [0,4194304] 0 2024-09-17T01:06:56.010 INFO:tasks.workunit.client.1.smithi143.stdout:2/321: truncate d0/d2/d21/d22/f2f 3517329 0 2024-09-17T01:06:56.012 INFO:tasks.workunit.client.1.smithi143.stdout:5/315: write d1/d5e/f65 [540921,69801] 0 2024-09-17T01:06:56.012 INFO:tasks.workunit.client.1.smithi143.stdout:4/256: truncate da/d3a/d40/f48 1010458 0 2024-09-17T01:06:56.013 INFO:tasks.workunit.client.1.smithi143.stdout:7/339: read d4/d1f/f30 [912425,77113] 0 2024-09-17T01:06:56.024 INFO:tasks.workunit.client.1.smithi143.stdout:0/319: dwrite d3/d14/d3d/f5d [0,4194304] 0 2024-09-17T01:06:56.024 INFO:tasks.workunit.client.1.smithi143.stdout:7/340: creat d4/d16/f6d x:0 0 0 2024-09-17T01:06:56.028 INFO:tasks.workunit.client.1.smithi143.stdout:2/322: write d0/d44/f5d [54987,47168] 0 2024-09-17T01:06:56.034 INFO:tasks.workunit.client.1.smithi143.stdout:7/341: rmdir d4/d33 39 2024-09-17T01:06:56.034 INFO:tasks.workunit.client.1.smithi143.stdout:8/300: dwrite d9/d12/d13/f33 [4194304,4194304] 0 2024-09-17T01:06:56.037 INFO:tasks.workunit.client.1.smithi143.stdout:3/225: dwrite d6/d1c/f2a [0,4194304] 0 2024-09-17T01:06:56.037 INFO:tasks.workunit.client.1.smithi143.stdout:2/323: rmdir d0/d2 39 2024-09-17T01:06:56.037 INFO:tasks.workunit.client.1.smithi143.stdout:1/307: dwrite d0/d6/f20 [0,4194304] 0 2024-09-17T01:06:56.037 INFO:tasks.workunit.client.1.smithi143.stdout:0/320: mkdir d3/d5/d6b 0 2024-09-17T01:06:56.040 INFO:tasks.workunit.client.1.smithi143.stdout:3/226: unlink d6/l35 0 2024-09-17T01:06:56.042 INFO:tasks.workunit.client.1.smithi143.stdout:7/342: write d4/d1f/f60 [678081,54455] 0 2024-09-17T01:06:56.042 INFO:tasks.workunit.client.1.smithi143.stdout:9/246: dread d3/d16/d2b/f1c [0,4194304] 0 2024-09-17T01:06:56.042 INFO:tasks.workunit.client.1.smithi143.stdout:8/301: symlink d9/de/l6d 0 2024-09-17T01:06:56.044 INFO:tasks.workunit.client.1.smithi143.stdout:4/257: link da/l16 da/d3a/l4f 0 2024-09-17T01:06:56.045 INFO:tasks.workunit.client.1.smithi143.stdout:4/258: stat da/f31 0 2024-09-17T01:06:56.048 INFO:tasks.workunit.client.1.smithi143.stdout:7/343: truncate d4/d1f/f23 9363415 0 2024-09-17T01:06:56.048 INFO:tasks.workunit.client.1.smithi143.stdout:3/227: mkdir d6/d1c/d33/d41/d42 0 2024-09-17T01:06:56.050 INFO:tasks.workunit.client.1.smithi143.stdout:3/228: stat d6/d1c/d33/d41/d2e 0 2024-09-17T01:06:56.052 INFO:tasks.workunit.client.1.smithi143.stdout:8/302: creat d9/d23/d4f/f6e x:0 0 0 2024-09-17T01:06:56.052 INFO:tasks.workunit.client.1.smithi143.stdout:4/259: mknod da/c50 0 2024-09-17T01:06:56.053 INFO:tasks.workunit.client.1.smithi143.stdout:2/324: rmdir d0/d2/d21/d55 0 2024-09-17T01:06:56.053 INFO:tasks.workunit.client.1.smithi143.stdout:9/247: creat d3/d16/d3e/f4d x:0 0 0 2024-09-17T01:06:56.054 INFO:tasks.workunit.client.1.smithi143.stdout:7/344: dread d4/f10 [0,4194304] 0 2024-09-17T01:06:56.054 INFO:tasks.workunit.client.1.smithi143.stdout:3/229: unlink d6/f20 0 2024-09-17T01:06:56.054 INFO:tasks.workunit.client.1.smithi143.stdout:1/308: dread d0/d6/f20 [0,4194304] 0 2024-09-17T01:06:56.055 INFO:tasks.workunit.client.1.smithi143.stdout:2/325: readlink d0/d2/l3f 0 2024-09-17T01:06:56.058 INFO:tasks.workunit.client.1.smithi143.stdout:2/326: readlink d0/d2/l13 0 2024-09-17T01:06:56.058 INFO:tasks.workunit.client.1.smithi143.stdout:0/321: dread d3/d5/d8/d21/f26 [0,4194304] 0 2024-09-17T01:06:56.059 INFO:tasks.workunit.client.1.smithi143.stdout:4/260: creat da/d3a/f51 x:0 0 0 2024-09-17T01:06:56.059 INFO:tasks.workunit.client.1.smithi143.stdout:1/309: dread - d0/d6/d7/de/d18/f36 zero size 2024-09-17T01:06:56.060 INFO:tasks.workunit.client.1.smithi143.stdout:4/261: chown da 75 1 2024-09-17T01:06:56.060 INFO:tasks.workunit.client.1.smithi143.stdout:3/230: write d6/d1c/d33/d41/f40 [1016301,72512] 0 2024-09-17T01:06:56.061 INFO:tasks.workunit.client.1.smithi143.stdout:5/316: dread d1/d46/f48 [0,4194304] 0 2024-09-17T01:06:56.066 INFO:tasks.workunit.client.1.smithi143.stdout:1/310: dread - d0/d6/d7/de/d2/f28 zero size 2024-09-17T01:06:56.066 INFO:tasks.workunit.client.1.smithi143.stdout:2/327: getdents d0/d10 0 2024-09-17T01:06:56.068 INFO:tasks.workunit.client.1.smithi143.stdout:8/303: dread d9/d12/d13/f33 [4194304,4194304] 0 2024-09-17T01:06:56.068 INFO:tasks.workunit.client.1.smithi143.stdout:3/231: write d6/d1c/d33/d41/f39 [248003,127645] 0 2024-09-17T01:06:56.071 INFO:tasks.workunit.client.1.smithi143.stdout:7/345: write d4/f58 [1131643,71745] 0 2024-09-17T01:06:56.072 INFO:tasks.workunit.client.1.smithi143.stdout:4/262: rename da/d3a/d3e/c3f to da/d3a/d3e/d42/c52 0 2024-09-17T01:06:56.073 INFO:tasks.workunit.client.1.smithi143.stdout:3/232: chown d6/d1c/d33/d41/f39 2 1 2024-09-17T01:06:56.073 INFO:tasks.workunit.client.1.smithi143.stdout:7/346: stat d4/f27 0 2024-09-17T01:06:56.075 INFO:tasks.workunit.client.1.smithi143.stdout:2/328: creat d0/d10/d58/d5a/d5b/d4c/f64 x:0 0 0 2024-09-17T01:06:56.075 INFO:tasks.workunit.client.1.smithi143.stdout:8/304: chown d9/l1c 3033 1 2024-09-17T01:06:56.076 INFO:tasks.workunit.client.1.smithi143.stdout:0/322: dwrite d3/d14/d3d/f54 [0,4194304] 0 2024-09-17T01:06:56.077 INFO:tasks.workunit.client.1.smithi143.stdout:5/317: rename d1/d46/df/d23/d4f/f7e to d1/d46/df/d53/f81 0 2024-09-17T01:06:56.077 INFO:tasks.workunit.client.1.smithi143.stdout:7/347: fsync d4/d1f/f60 0 2024-09-17T01:06:56.080 INFO:tasks.workunit.client.1.smithi143.stdout:2/329: write d0/d2/d21/f2c [957639,38050] 0 2024-09-17T01:06:56.109 INFO:tasks.workunit.client.1.smithi143.stdout:3/233: dread d6/d1c/d33/d41/d2b/f3b [0,4194304] 0 2024-09-17T01:06:56.109 INFO:tasks.workunit.client.1.smithi143.stdout:5/318: rename d1/d46/d4c to d1/d46/df/d23/d4f/d82 0 2024-09-17T01:06:56.110 INFO:tasks.workunit.client.1.smithi143.stdout:2/330: mknod d0/c65 0 2024-09-17T01:06:56.110 INFO:tasks.workunit.client.1.smithi143.stdout:1/311: dwrite d0/d6/d7/de/d2/d3c/f45 [0,4194304] 0 2024-09-17T01:06:56.112 INFO:tasks.workunit.client.1.smithi143.stdout:9/248: dread d3/d16/f1d [0,4194304] 0 2024-09-17T01:06:56.112 INFO:tasks.workunit.client.1.smithi143.stdout:0/323: getdents d3/d14/d32 0 2024-09-17T01:06:56.113 INFO:tasks.workunit.client.1.smithi143.stdout:4/263: dread da/f1b [0,4194304] 0 2024-09-17T01:06:56.114 INFO:tasks.workunit.client.1.smithi143.stdout:5/319: read d1/f3 [932043,66300] 0 2024-09-17T01:06:56.117 INFO:tasks.workunit.client.1.smithi143.stdout:1/312: creat d0/d6/d43/f65 x:0 0 0 2024-09-17T01:06:56.117 INFO:tasks.workunit.client.1.smithi143.stdout:9/249: mknod d3/d16/d34/c4e 0 2024-09-17T01:06:56.119 INFO:tasks.workunit.client.1.smithi143.stdout:4/264: write da/f1d [3155545,105866] 0 2024-09-17T01:06:56.122 INFO:tasks.workunit.client.1.smithi143.stdout:4/265: stat da/d3a/d40/l2b 0 2024-09-17T01:06:56.123 INFO:tasks.workunit.client.1.smithi143.stdout:5/320: write d1/d46/df/d1f/f34 [939707,96427] 0 2024-09-17T01:06:56.125 INFO:tasks.workunit.client.1.smithi143.stdout:9/250: creat d3/d39/f4f x:0 0 0 2024-09-17T01:06:56.125 INFO:tasks.workunit.client.1.smithi143.stdout:3/234: dread d6/d1c/d33/d41/f21 [0,4194304] 0 2024-09-17T01:06:56.125 INFO:tasks.workunit.client.1.smithi143.stdout:1/313: truncate d0/d6/d7/df/d27/f2e 8579003 0 2024-09-17T01:06:56.126 INFO:tasks.workunit.client.1.smithi143.stdout:5/321: dread - d1/d46/df/d23/f6f zero size 2024-09-17T01:06:56.128 INFO:tasks.workunit.client.1.smithi143.stdout:2/331: truncate d0/f51 33266 0 2024-09-17T01:06:56.129 INFO:tasks.workunit.client.1.smithi143.stdout:1/314: write d0/d6/d7/f42 [8745674,111062] 0 2024-09-17T01:06:56.130 INFO:tasks.workunit.client.1.smithi143.stdout:9/251: symlink d3/d3d/l50 0 2024-09-17T01:06:56.131 INFO:tasks.workunit.client.1.smithi143.stdout:5/322: dread - d1/d46/df/f76 zero size 2024-09-17T01:06:56.133 INFO:tasks.workunit.client.1.smithi143.stdout:0/324: dwrite d3/d5/f29 [0,4194304] 0 2024-09-17T01:06:56.135 INFO:tasks.workunit.client.1.smithi143.stdout:1/315: mkdir d0/d6/d43/d66 0 2024-09-17T01:06:56.136 INFO:tasks.workunit.client.1.smithi143.stdout:9/252: mkdir d3/d16/d3e/d51 0 2024-09-17T01:06:56.136 INFO:tasks.workunit.client.1.smithi143.stdout:0/325: chown d3/d5/d8/d21/d2e 15 1 2024-09-17T01:06:56.138 INFO:tasks.workunit.client.1.smithi143.stdout:2/332: rename d0/d2/d21/d22/d24/f2a to d0/d10/d56/f66 0 2024-09-17T01:06:56.138 INFO:tasks.workunit.client.1.smithi143.stdout:5/323: mknod d1/d46/df/d23/c83 0 2024-09-17T01:06:56.139 INFO:tasks.workunit.client.1.smithi143.stdout:1/316: creat d0/d6/d43/f67 x:0 0 0 2024-09-17T01:06:56.140 INFO:tasks.workunit.client.1.smithi143.stdout:9/253: read d3/d16/d2b/f12 [1098918,12918] 0 2024-09-17T01:06:56.140 INFO:tasks.workunit.client.1.smithi143.stdout:3/235: dwrite d6/d1c/d33/f38 [0,4194304] 0 2024-09-17T01:06:56.141 INFO:tasks.workunit.client.1.smithi143.stdout:0/326: creat d3/d68/f6c x:0 0 0 2024-09-17T01:06:56.143 INFO:tasks.workunit.client.1.smithi143.stdout:9/254: dread - d3/d16/d2b/d9/f11 zero size 2024-09-17T01:06:56.143 INFO:tasks.workunit.client.1.smithi143.stdout:1/317: read - d0/d6/d7/de/d2/d3c/f53 zero size 2024-09-17T01:06:56.144 INFO:tasks.workunit.client.1.smithi143.stdout:3/236: write d6/d1c/f2a [2399445,41109] 0 2024-09-17T01:06:56.150 INFO:tasks.workunit.client.1.smithi143.stdout:1/318: truncate d0/d6/d7/f48 1157384 0 2024-09-17T01:06:56.151 INFO:tasks.workunit.client.1.smithi143.stdout:2/333: dwrite d0/d10/f16 [0,4194304] 0 2024-09-17T01:06:56.152 INFO:tasks.workunit.client.1.smithi143.stdout:0/327: rename d3/d5/d8/d10/f5c to d3/d5/d8/d27/d31/d4c/f6d 0 2024-09-17T01:06:56.153 INFO:tasks.workunit.client.1.smithi143.stdout:3/237: mknod d6/d1c/d33/d41/d42/c43 0 2024-09-17T01:06:56.155 INFO:tasks.workunit.client.1.smithi143.stdout:9/255: mkdir d3/d16/d3e/d51/d52 0 2024-09-17T01:06:56.156 INFO:tasks.workunit.client.1.smithi143.stdout:2/334: write d0/d2/f2b [2818074,64650] 0 2024-09-17T01:06:56.156 INFO:tasks.workunit.client.1.smithi143.stdout:5/324: dwrite d1/d46/df/d23/d4f/f6a [0,4194304] 0 2024-09-17T01:06:56.157 INFO:tasks.workunit.client.1.smithi143.stdout:1/319: write d0/dc/d57/f5d [544498,104951] 0 2024-09-17T01:06:56.159 INFO:tasks.workunit.client.1.smithi143.stdout:0/328: rmdir d3/d5/d8/d27/d31/d48 39 2024-09-17T01:06:56.159 INFO:tasks.workunit.client.1.smithi143.stdout:3/238: fdatasync d6/d1c/d33/d41/f1a 0 2024-09-17T01:06:56.159 INFO:tasks.workunit.client.1.smithi143.stdout:2/335: chown d0/d10/d58 0 1 2024-09-17T01:06:56.160 INFO:tasks.workunit.client.1.smithi143.stdout:1/320: stat d0/d6/d7/df/d27/c4a 0 2024-09-17T01:06:56.160 INFO:tasks.workunit.client.1.smithi143.stdout:9/256: creat d3/d39/f53 x:0 0 0 2024-09-17T01:06:56.161 INFO:tasks.workunit.client.1.smithi143.stdout:4/266: dread da/fe [0,4194304] 0 2024-09-17T01:06:56.163 INFO:tasks.workunit.client.1.smithi143.stdout:5/325: mknod d1/d46/df/d1f/d66/c84 0 2024-09-17T01:06:56.164 INFO:tasks.workunit.client.1.smithi143.stdout:4/267: fdatasync da/d3a/f3b 0 2024-09-17T01:06:56.164 INFO:tasks.workunit.client.1.smithi143.stdout:2/336: creat d0/d2/d21/d22/f67 x:0 0 0 2024-09-17T01:06:56.166 INFO:tasks.workunit.client.1.smithi143.stdout:3/239: fdatasync d6/d1c/d33/d41/d2b/f3b 0 2024-09-17T01:06:56.168 INFO:tasks.workunit.client.1.smithi143.stdout:4/268: write da/d3a/d40/f34 [3870374,122798] 0 2024-09-17T01:06:56.172 INFO:tasks.workunit.client.1.smithi143.stdout:1/321: mkdir d0/d6/d43/d47/d68 0 2024-09-17T01:06:56.172 INFO:tasks.workunit.client.1.smithi143.stdout:0/329: fdatasync d3/d5/d8/d10/f4f 0 2024-09-17T01:06:56.174 INFO:tasks.workunit.client.1.smithi143.stdout:3/240: unlink d6/d1c/d33/d41/f40 0 2024-09-17T01:06:56.175 INFO:tasks.workunit.client.1.smithi143.stdout:3/241: read d6/d1c/d33/d41/f11 [21658,28896] 0 2024-09-17T01:06:56.178 INFO:tasks.workunit.client.1.smithi143.stdout:1/322: creat d0/d6/d7/de/d2/f69 x:0 0 0 2024-09-17T01:06:56.180 INFO:tasks.workunit.client.1.smithi143.stdout:0/330: symlink d3/d5/d8/d21/l6e 0 2024-09-17T01:06:56.181 INFO:tasks.workunit.client.1.smithi143.stdout:2/337: getdents d0/d10 0 2024-09-17T01:06:56.181 INFO:tasks.workunit.client.1.smithi143.stdout:5/326: getdents d1/d46/df/d23/d4f 0 2024-09-17T01:06:56.182 INFO:tasks.workunit.client.1.smithi143.stdout:4/269: dwrite da/fe [0,4194304] 0 2024-09-17T01:06:56.184 INFO:tasks.workunit.client.1.smithi143.stdout:3/242: creat d6/f44 x:0 0 0 2024-09-17T01:06:56.185 INFO:tasks.workunit.client.1.smithi143.stdout:0/331: mknod d3/d5/d8/d21/d2e/c6f 0 2024-09-17T01:06:56.188 INFO:tasks.workunit.client.1.smithi143.stdout:1/323: rename d0/d6/d7 to d0/d6/d43/d6a 0 2024-09-17T01:06:56.189 INFO:tasks.workunit.client.1.smithi143.stdout:3/243: write d6/fa [4091401,84927] 0 2024-09-17T01:06:56.190 INFO:tasks.workunit.client.1.smithi143.stdout:4/270: creat da/d4d/f53 x:0 0 0 2024-09-17T01:06:56.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/244: unlink d6/d1c/c27 0 2024-09-17T01:06:56.194 INFO:tasks.workunit.client.1.smithi143.stdout:0/332: write d3/d5/fc [5319491,83977] 0 2024-09-17T01:06:56.195 INFO:tasks.workunit.client.1.smithi143.stdout:5/327: getdents d1/d46/d6e 0 2024-09-17T01:06:56.197 INFO:tasks.workunit.client.1.smithi143.stdout:9/257: dwrite d3/d16/d2b/f2a [0,4194304] 0 2024-09-17T01:06:56.198 INFO:tasks.workunit.client.1.smithi143.stdout:6/189: sync 2024-09-17T01:06:56.198 INFO:tasks.workunit.client.1.smithi143.stdout:2/338: dwrite d0/d10/f33 [4194304,4194304] 0 2024-09-17T01:06:56.201 INFO:tasks.workunit.client.1.smithi143.stdout:5/328: write d1/f59 [13200,112192] 0 2024-09-17T01:06:56.203 INFO:tasks.workunit.client.1.smithi143.stdout:3/245: rename d6/f1f to d6/d1c/d33/d41/d2b/f45 0 2024-09-17T01:06:56.205 INFO:tasks.workunit.client.1.smithi143.stdout:2/339: rmdir d0/d10/d58/d5a/d5b/d4c 39 2024-09-17T01:06:56.205 INFO:tasks.workunit.client.1.smithi143.stdout:4/271: creat da/f54 x:0 0 0 2024-09-17T01:06:56.206 INFO:tasks.workunit.client.1.smithi143.stdout:6/190: dread - d2/df/f2e zero size 2024-09-17T01:06:56.208 INFO:tasks.workunit.client.1.smithi143.stdout:9/258: creat d3/d39/d42/f54 x:0 0 0 2024-09-17T01:06:56.208 INFO:tasks.workunit.client.1.smithi143.stdout:5/329: read d1/d46/f3c [129537,48987] 0 2024-09-17T01:06:56.209 INFO:tasks.workunit.client.1.smithi143.stdout:6/191: stat d2/fa 0 2024-09-17T01:06:56.210 INFO:tasks.workunit.client.1.smithi143.stdout:1/324: truncate d0/d6/d43/d6a/f42 7710907 0 2024-09-17T01:06:56.211 INFO:tasks.workunit.client.1.smithi143.stdout:0/333: dwrite d3/d5/d8/d21/d2e/f50 [0,4194304] 0 2024-09-17T01:06:56.213 INFO:tasks.workunit.client.1.smithi143.stdout:2/340: creat d0/d10/d58/f68 x:0 0 0 2024-09-17T01:06:56.215 INFO:tasks.workunit.client.1.smithi143.stdout:0/334: write d3/d5/d8/d27/d31/d4c/f45 [1262835,106368] 0 2024-09-17T01:06:56.216 INFO:tasks.workunit.client.1.smithi143.stdout:2/341: read d0/ff [1291759,6178] 0 2024-09-17T01:06:56.216 INFO:tasks.workunit.client.1.smithi143.stdout:9/259: mkdir d3/d16/d2b/d9/d55 0 2024-09-17T01:06:56.217 INFO:tasks.workunit.client.1.smithi143.stdout:3/246: symlink d6/d1c/d33/d41/d2e/d30/l46 0 2024-09-17T01:06:56.218 INFO:tasks.workunit.client.1.smithi143.stdout:6/192: rmdir d2/df/d20/d2c 39 2024-09-17T01:06:56.219 INFO:tasks.workunit.client.1.smithi143.stdout:5/330: creat d1/d46/df/d53/f85 x:0 0 0 2024-09-17T01:06:56.220 INFO:tasks.workunit.client.1.smithi143.stdout:4/272: symlink da/d3a/d3e/d49/l55 0 2024-09-17T01:06:56.222 INFO:tasks.workunit.client.1.smithi143.stdout:2/342: mknod d0/d44/c69 0 2024-09-17T01:06:56.223 INFO:tasks.workunit.client.1.smithi143.stdout:9/260: symlink d3/d3d/d48/l56 0 2024-09-17T01:06:56.223 INFO:tasks.workunit.client.1.smithi143.stdout:5/331: write d1/d46/df/d1f/f34 [1663377,116070] 0 2024-09-17T01:06:56.224 INFO:tasks.workunit.client.1.smithi143.stdout:3/247: creat d6/d1c/d33/d41/d2e/f47 x:0 0 0 2024-09-17T01:06:56.225 INFO:tasks.workunit.client.1.smithi143.stdout:4/273: symlink da/d3a/d3e/d4a/l56 0 2024-09-17T01:06:56.228 INFO:tasks.workunit.client.1.smithi143.stdout:5/332: creat d1/d46/df/d53/f86 x:0 0 0 2024-09-17T01:06:56.230 INFO:tasks.workunit.client.1.smithi143.stdout:3/248: write d6/d1c/d33/d41/f39 [1228129,59043] 0 2024-09-17T01:06:56.233 INFO:tasks.workunit.client.1.smithi143.stdout:4/274: truncate da/d3a/d40/f39 808598 0 2024-09-17T01:06:56.233 INFO:tasks.workunit.client.1.smithi143.stdout:5/333: mknod d1/d46/d6e/c87 0 2024-09-17T01:06:56.234 INFO:tasks.workunit.client.1.smithi143.stdout:0/335: dread d3/d5/d8/d21/f30 [0,4194304] 0 2024-09-17T01:06:56.237 INFO:tasks.workunit.client.1.smithi143.stdout:4/275: readlink da/d3a/d3e/d4a/l56 0 2024-09-17T01:06:56.240 INFO:tasks.workunit.client.1.smithi143.stdout:1/325: truncate d0/d6/d43/d6a/de/f1d 2452102 0 2024-09-17T01:06:56.240 INFO:tasks.workunit.client.1.smithi143.stdout:2/343: dwrite d0/d2/d21/d22/f67 [0,4194304] 0 2024-09-17T01:06:56.241 INFO:tasks.workunit.client.1.smithi143.stdout:9/261: dwrite d3/d39/f4b [0,4194304] 0 2024-09-17T01:06:56.241 INFO:tasks.workunit.client.1.smithi143.stdout:0/336: rmdir d3/d5/d8/d21/d2e 39 2024-09-17T01:06:56.241 INFO:tasks.workunit.client.1.smithi143.stdout:5/334: truncate d1/d46/df/d23/f2a 1891552 0 2024-09-17T01:06:56.242 INFO:tasks.workunit.client.1.smithi143.stdout:3/249: write d6/d1c/d33/d41/f11 [1530453,80379] 0 2024-09-17T01:06:56.244 INFO:tasks.workunit.client.1.smithi143.stdout:4/276: dread - da/d3a/d3e/d42/f4b zero size 2024-09-17T01:06:56.245 INFO:tasks.workunit.client.1.smithi143.stdout:2/344: mkdir d0/d44/d6a 0 2024-09-17T01:06:56.246 INFO:tasks.workunit.client.1.smithi143.stdout:1/326: mkdir d0/d6/d43/d6a/de/d2/d39/d6b 0 2024-09-17T01:06:56.246 INFO:tasks.workunit.client.1.smithi143.stdout:3/250: chown d6/d1c/d33/d41/d2e/c3c 104852 1 2024-09-17T01:06:56.247 INFO:tasks.workunit.client.1.smithi143.stdout:0/337: write d3/d14/d32/f38 [1642976,28809] 0 2024-09-17T01:06:56.247 INFO:tasks.workunit.client.1.smithi143.stdout:4/277: creat da/d4d/f57 x:0 0 0 2024-09-17T01:06:56.252 INFO:tasks.workunit.client.1.smithi143.stdout:4/278: write da/f1c [195796,7614] 0 2024-09-17T01:06:56.254 INFO:tasks.workunit.client.1.smithi143.stdout:1/327: chown d0/d6/d43/d6a/df/c2f 636746 1 2024-09-17T01:06:56.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/335: dwrite d1/d46/df/d53/f85 [0,4194304] 0 2024-09-17T01:06:56.254 INFO:tasks.workunit.client.1.smithi143.stdout:3/251: creat d6/d1c/d33/d3f/f48 x:0 0 0 2024-09-17T01:06:56.257 INFO:tasks.workunit.client.1.smithi143.stdout:0/338: rename d3/d5/d8/d27/f18 to d3/d68/f70 0 2024-09-17T01:06:56.259 INFO:tasks.workunit.client.1.smithi143.stdout:4/279: dread da/d3a/d40/f48 [0,4194304] 0 2024-09-17T01:06:56.261 INFO:tasks.workunit.client.1.smithi143.stdout:1/328: unlink d0/d6/d43/d6a/de/fb 0 2024-09-17T01:06:56.261 INFO:tasks.workunit.client.1.smithi143.stdout:4/280: readlink da/d3a/d3e/d49/l55 0 2024-09-17T01:06:56.261 INFO:tasks.workunit.client.1.smithi143.stdout:5/336: mknod d1/d46/df/d23/c88 0 2024-09-17T01:06:56.261 INFO:tasks.workunit.client.1.smithi143.stdout:4/281: read da/f32 [2912414,16333] 0 2024-09-17T01:06:56.262 INFO:tasks.workunit.client.1.smithi143.stdout:0/339: mknod d3/d5/d8/d21/c71 0 2024-09-17T01:06:56.264 INFO:tasks.workunit.client.1.smithi143.stdout:5/337: truncate d1/f68 247148 0 2024-09-17T01:06:56.266 INFO:tasks.workunit.client.1.smithi143.stdout:0/340: mkdir d3/d5/d8/d27/d31/d48/d72 0 2024-09-17T01:06:56.268 INFO:tasks.workunit.client.1.smithi143.stdout:1/329: dwrite d0/d6/d43/f44 [0,4194304] 0 2024-09-17T01:06:56.269 INFO:tasks.workunit.client.1.smithi143.stdout:0/341: chown d3/d5/l5b 5708 1 2024-09-17T01:06:56.269 INFO:tasks.workunit.client.1.smithi143.stdout:4/282: link da/c10 da/d3a/c58 0 2024-09-17T01:06:56.271 INFO:tasks.workunit.client.1.smithi143.stdout:0/342: write d3/d5/d8/d21/f3b [1228203,104005] 0 2024-09-17T01:06:56.272 INFO:tasks.workunit.client.1.smithi143.stdout:4/283: unlink da/c2c 0 2024-09-17T01:06:56.272 INFO:tasks.workunit.client.1.smithi143.stdout:5/338: dread d1/d46/f3c [0,4194304] 0 2024-09-17T01:06:56.273 INFO:tasks.workunit.client.1.smithi143.stdout:1/330: creat d0/d6/d43/d6a/de/d2/d39/f6c x:0 0 0 2024-09-17T01:06:56.276 INFO:tasks.workunit.client.1.smithi143.stdout:4/284: dread f2 [0,4194304] 0 2024-09-17T01:06:56.276 INFO:tasks.workunit.client.1.smithi143.stdout:1/331: mkdir d0/d6/d43/d6d 0 2024-09-17T01:06:56.276 INFO:tasks.workunit.client.1.smithi143.stdout:5/339: symlink d1/d46/df/d1f/d7a/l89 0 2024-09-17T01:06:56.277 INFO:tasks.workunit.client.1.smithi143.stdout:1/332: readlink d0/d6/d43/d6a/de/d2/l37 0 2024-09-17T01:06:56.279 INFO:tasks.workunit.client.1.smithi143.stdout:5/340: mknod d1/d46/df/d53/c8a 0 2024-09-17T01:06:56.279 INFO:tasks.workunit.client.1.smithi143.stdout:4/285: creat da/d3a/f59 x:0 0 0 2024-09-17T01:06:56.279 INFO:tasks.workunit.client.1.smithi143.stdout:5/341: readlink d1/d46/df/d1f/d66/l69 0 2024-09-17T01:06:56.280 INFO:tasks.workunit.client.1.smithi143.stdout:0/343: dread d3/d5/d35/f3f [0,4194304] 0 2024-09-17T01:06:56.281 INFO:tasks.workunit.client.1.smithi143.stdout:5/342: write d1/f2 [4253023,9223] 0 2024-09-17T01:06:56.281 INFO:tasks.workunit.client.1.smithi143.stdout:4/286: symlink da/d3a/l5a 0 2024-09-17T01:06:56.282 INFO:tasks.workunit.client.1.smithi143.stdout:4/287: read da/d3a/f3b [580063,9156] 0 2024-09-17T01:06:56.282 INFO:tasks.workunit.client.1.smithi143.stdout:5/343: mknod d1/d5e/c8b 0 2024-09-17T01:06:56.283 INFO:tasks.workunit.client.1.smithi143.stdout:0/344: truncate d3/d5/d8/d27/d31/d48/f5e 839417 0 2024-09-17T01:06:56.284 INFO:tasks.workunit.client.1.smithi143.stdout:4/288: creat da/d3a/d40/f5b x:0 0 0 2024-09-17T01:06:56.284 INFO:tasks.workunit.client.1.smithi143.stdout:5/344: truncate d1/d46/df/d1f/f6d 580360 0 2024-09-17T01:06:56.287 INFO:tasks.workunit.client.1.smithi143.stdout:5/345: mknod d1/d46/df/d23/d4f/d82/c8c 0 2024-09-17T01:06:56.289 INFO:tasks.workunit.client.1.smithi143.stdout:3/252: dread d6/d1c/d33/d41/f1a [0,4194304] 0 2024-09-17T01:06:56.291 INFO:tasks.workunit.client.1.smithi143.stdout:0/345: dwrite d3/d5/d8/d27/d31/d4c/f45 [0,4194304] 0 2024-09-17T01:06:56.292 INFO:tasks.workunit.client.1.smithi143.stdout:4/289: dwrite da/f32 [0,4194304] 0 2024-09-17T01:06:56.293 INFO:tasks.workunit.client.1.smithi143.stdout:0/346: symlink d3/d14/d3d/l73 0 2024-09-17T01:06:56.295 INFO:tasks.workunit.client.1.smithi143.stdout:0/347: rmdir d3/d5/d35 39 2024-09-17T01:06:56.296 INFO:tasks.workunit.client.1.smithi143.stdout:0/348: mknod d3/d14/d3d/c74 0 2024-09-17T01:06:56.297 INFO:tasks.workunit.client.1.smithi143.stdout:0/349: mkdir d3/d68/d75 0 2024-09-17T01:06:56.297 INFO:tasks.workunit.client.1.smithi143.stdout:4/290: link da/l16 da/d4d/l5c 0 2024-09-17T01:06:56.299 INFO:tasks.workunit.client.1.smithi143.stdout:4/291: chown da/d3a/d40/l35 37804621 1 2024-09-17T01:06:56.300 INFO:tasks.workunit.client.1.smithi143.stdout:7/348: sync 2024-09-17T01:06:56.300 INFO:tasks.workunit.client.1.smithi143.stdout:0/350: dread d3/d14/f61 [0,4194304] 0 2024-09-17T01:06:56.301 INFO:tasks.workunit.client.1.smithi143.stdout:8/305: sync 2024-09-17T01:06:56.306 INFO:tasks.workunit.client.1.smithi143.stdout:0/351: creat d3/d14/d3d/f76 x:0 0 0 2024-09-17T01:06:56.306 INFO:tasks.workunit.client.1.smithi143.stdout:7/349: creat d4/d1f/d29/d65/f6e x:0 0 0 2024-09-17T01:06:56.313 INFO:tasks.workunit.client.1.smithi143.stdout:7/350: mknod d4/d33/d4e/c6f 0 2024-09-17T01:06:56.313 INFO:tasks.workunit.client.1.smithi143.stdout:7/351: chown d4/d16/f6d 64 1 2024-09-17T01:06:56.313 INFO:tasks.workunit.client.1.smithi143.stdout:7/352: readlink d4/d1f/d29/l6b 0 2024-09-17T01:06:56.314 INFO:tasks.workunit.client.1.smithi143.stdout:9/262: dread d3/d3d/f43 [0,4194304] 0 2024-09-17T01:06:56.315 INFO:tasks.workunit.client.1.smithi143.stdout:0/352: dread d3/d5/d8/d27/d31/d48/f5e [0,4194304] 0 2024-09-17T01:06:56.317 INFO:tasks.workunit.client.1.smithi143.stdout:0/353: fdatasync d3/d5/d8/d21/f30 0 2024-09-17T01:06:56.321 INFO:tasks.workunit.client.1.smithi143.stdout:7/353: dread d4/d16/f1a [0,4194304] 0 2024-09-17T01:06:56.322 INFO:tasks.workunit.client.1.smithi143.stdout:7/354: symlink d4/l70 0 2024-09-17T01:06:56.323 INFO:tasks.workunit.client.1.smithi143.stdout:0/354: dread d3/d5/d8/d10/f25 [0,4194304] 0 2024-09-17T01:06:56.324 INFO:tasks.workunit.client.1.smithi143.stdout:7/355: chown d4/d1f/d29/d65/f6e 1 1 2024-09-17T01:06:56.324 INFO:tasks.workunit.client.1.smithi143.stdout:0/355: read - d3/d5/d8/d21/f55 zero size 2024-09-17T01:06:56.325 INFO:tasks.workunit.client.1.smithi143.stdout:7/356: creat d4/d1f/d29/f71 x:0 0 0 2024-09-17T01:06:56.327 INFO:tasks.workunit.client.1.smithi143.stdout:7/357: symlink d4/d33/d4e/l72 0 2024-09-17T01:06:56.327 INFO:tasks.workunit.client.1.smithi143.stdout:0/356: link d3/d14/l1a d3/d68/l77 0 2024-09-17T01:06:56.329 INFO:tasks.workunit.client.1.smithi143.stdout:7/358: unlink d4/c7 0 2024-09-17T01:06:56.329 INFO:tasks.workunit.client.1.smithi143.stdout:0/357: readlink d3/d5/d8/l53 0 2024-09-17T01:06:56.330 INFO:tasks.workunit.client.1.smithi143.stdout:7/359: creat d4/d1f/f73 x:0 0 0 2024-09-17T01:06:56.330 INFO:tasks.workunit.client.1.smithi143.stdout:0/358: creat d3/d68/f78 x:0 0 0 2024-09-17T01:06:56.333 INFO:tasks.workunit.client.1.smithi143.stdout:8/306: dread d9/d26/f3e [0,4194304] 0 2024-09-17T01:06:56.333 INFO:tasks.workunit.client.1.smithi143.stdout:0/359: getdents d3/d5/d8/d27/d31/d4c/d65 0 2024-09-17T01:06:56.342 INFO:tasks.workunit.client.1.smithi143.stdout:0/360: dread d3/d5/d8/d27/d31/d4c/f1d [0,4194304] 0 2024-09-17T01:06:56.343 INFO:tasks.workunit.client.1.smithi143.stdout:1/333: rename d0/d6/d43/d6a/de to d0/d6/d43/d6a/df/d6e 0 2024-09-17T01:06:56.344 INFO:tasks.workunit.client.1.smithi143.stdout:1/334: fsync d0/d6/d43/d6a/df/d6e/d2/d3c/f45 0 2024-09-17T01:06:56.345 INFO:tasks.workunit.client.1.smithi143.stdout:5/346: rename d1/d46/df/d1f/f6d to d1/d46/d6e/f8d 0 2024-09-17T01:06:56.345 INFO:tasks.workunit.client.1.smithi143.stdout:5/347: chown d1/d46/df/d1f/d66 0 1 2024-09-17T01:06:56.346 INFO:tasks.workunit.client.1.smithi143.stdout:1/335: dread - d0/d6/d43/d6a/df/d6e/d2/d39/f6c zero size 2024-09-17T01:06:56.347 INFO:tasks.workunit.client.1.smithi143.stdout:0/361: creat d3/d5/d8/d27/d31/d4c/f79 x:0 0 0 2024-09-17T01:06:56.349 INFO:tasks.workunit.client.1.smithi143.stdout:3/253: rename d6/l22 to d6/d1c/d33/d41/d2b/l49 0 2024-09-17T01:06:56.349 INFO:tasks.workunit.client.1.smithi143.stdout:1/336: write d0/d6/d43/d6a/df/d6e/d2/d39/f5e [690767,125462] 0 2024-09-17T01:06:56.349 INFO:tasks.workunit.client.1.smithi143.stdout:0/362: read d3/d5/d8/d21/f49 [643603,116650] 0 2024-09-17T01:06:56.352 INFO:tasks.workunit.client.1.smithi143.stdout:4/292: rename da/d3a/d40/f48 to da/d3a/d3e/d49/f5d 0 2024-09-17T01:06:56.352 INFO:tasks.workunit.client.1.smithi143.stdout:1/337: write d0/d6/d43/d6a/df/d6e/d2/d39/f6c [928595,68068] 0 2024-09-17T01:06:56.352 INFO:tasks.workunit.client.1.smithi143.stdout:3/254: mknod d6/d1c/d33/d41/c4a 0 2024-09-17T01:06:56.354 INFO:tasks.workunit.client.1.smithi143.stdout:0/363: creat d3/d68/f7a x:0 0 0 2024-09-17T01:06:56.356 INFO:tasks.workunit.client.1.smithi143.stdout:4/293: rename da/d4d to da/d3a/d3e/d5e 0 2024-09-17T01:06:56.356 INFO:tasks.workunit.client.1.smithi143.stdout:5/348: dwrite d1/d46/df/f25 [0,4194304] 0 2024-09-17T01:06:56.357 INFO:tasks.workunit.client.1.smithi143.stdout:9/263: write d3/d3d/f43 [2093941,12613] 0 2024-09-17T01:06:56.358 INFO:tasks.workunit.client.1.smithi143.stdout:3/255: write d6/d1c/d33/d41/d2e/d30/f32 [5009263,107408] 0 2024-09-17T01:06:56.359 INFO:tasks.workunit.client.1.smithi143.stdout:0/364: fdatasync d3/d5/d8/d10/f3a 0 2024-09-17T01:06:56.360 INFO:tasks.workunit.client.1.smithi143.stdout:3/256: fsync d6/d1c/f2a 0 2024-09-17T01:06:56.361 INFO:tasks.workunit.client.1.smithi143.stdout:5/349: readlink d1/d46/df/d1f/d66/l77 0 2024-09-17T01:06:56.363 INFO:tasks.workunit.client.1.smithi143.stdout:1/338: rename d0/d6/d43/d6a/df/d6e/d2/f69 to d0/d6/d43/d6a/d52/f6f 0 2024-09-17T01:06:56.363 INFO:tasks.workunit.client.1.smithi143.stdout:3/257: dread - d6/d1c/d33/d41/d2e/f47 zero size 2024-09-17T01:06:56.363 INFO:tasks.workunit.client.1.smithi143.stdout:7/360: truncate d4/d26/f22 782185 0 2024-09-17T01:06:56.365 INFO:tasks.workunit.client.1.smithi143.stdout:8/307: write d9/d26/f36 [1281405,67810] 0 2024-09-17T01:06:56.368 INFO:tasks.workunit.client.1.smithi143.stdout:1/339: write d0/d6/d43/d6a/df/f1a [3800313,108252] 0 2024-09-17T01:06:56.370 INFO:tasks.workunit.client.1.smithi143.stdout:7/361: write d4/d1f/d29/d65/f6e [204288,113763] 0 2024-09-17T01:06:56.372 INFO:tasks.workunit.client.1.smithi143.stdout:4/294: dwrite da/d3a/d40/f34 [0,4194304] 0 2024-09-17T01:06:56.373 INFO:tasks.workunit.client.1.smithi143.stdout:9/264: symlink d3/d16/d3e/d51/d52/l57 0 2024-09-17T01:06:56.373 INFO:tasks.workunit.client.1.smithi143.stdout:1/340: dread - d0/d6/f5f zero size 2024-09-17T01:06:56.375 INFO:tasks.workunit.client.1.smithi143.stdout:3/258: unlink d6/d1c/l1e 0 2024-09-17T01:06:56.377 INFO:tasks.workunit.client.1.smithi143.stdout:5/350: dwrite d1/d46/df/f3d [0,4194304] 0 2024-09-17T01:06:56.378 INFO:tasks.workunit.client.1.smithi143.stdout:7/362: creat d4/d26/f74 x:0 0 0 2024-09-17T01:06:56.379 INFO:tasks.workunit.client.1.smithi143.stdout:3/259: chown d6/d1c/d33/d41/f11 12288445 1 2024-09-17T01:06:56.382 INFO:tasks.workunit.client.1.smithi143.stdout:6/193: sync 2024-09-17T01:06:56.382 INFO:tasks.workunit.client.1.smithi143.stdout:7/363: write d4/d1f/f3e [4808029,79436] 0 2024-09-17T01:06:56.383 INFO:tasks.workunit.client.1.smithi143.stdout:3/260: readlink l2 0 2024-09-17T01:06:56.384 INFO:tasks.workunit.client.1.smithi143.stdout:5/351: write d1/d46/d6e/f78 [858254,107428] 0 2024-09-17T01:06:56.385 INFO:tasks.workunit.client.1.smithi143.stdout:1/341: read - d0/d6/d43/d6a/df/d6e/d2/d3c/f53 zero size 2024-09-17T01:06:56.385 INFO:tasks.workunit.client.1.smithi143.stdout:4/295: mkdir da/d3a/d3e/d42/d5f 0 2024-09-17T01:06:56.388 INFO:tasks.workunit.client.1.smithi143.stdout:9/265: dread d3/d16/f1d [4194304,4194304] 0 2024-09-17T01:06:56.388 INFO:tasks.workunit.client.1.smithi143.stdout:3/261: unlink d6/l18 0 2024-09-17T01:06:56.389 INFO:tasks.workunit.client.1.smithi143.stdout:7/364: creat d4/d1f/d4a/d66/f75 x:0 0 0 2024-09-17T01:06:56.389 INFO:tasks.workunit.client.1.smithi143.stdout:8/308: dread d9/fa [0,4194304] 0 2024-09-17T01:06:56.390 INFO:tasks.workunit.client.1.smithi143.stdout:4/296: read da/d3a/d40/f27 [29706,126569] 0 2024-09-17T01:06:56.390 INFO:tasks.workunit.client.1.smithi143.stdout:6/194: mkdir d2/df/d20/d2c/d38 0 2024-09-17T01:06:56.391 INFO:tasks.workunit.client.1.smithi143.stdout:3/262: mkdir d6/d1c/d4b 0 2024-09-17T01:06:56.392 INFO:tasks.workunit.client.1.smithi143.stdout:9/266: mkdir d3/d39/d42/d58 0 2024-09-17T01:06:56.393 INFO:tasks.workunit.client.1.smithi143.stdout:1/342: link d0/dc/f2c d0/d6/d43/d6a/f70 0 2024-09-17T01:06:56.394 INFO:tasks.workunit.client.1.smithi143.stdout:8/309: creat d9/de/f6f x:0 0 0 2024-09-17T01:06:56.394 INFO:tasks.workunit.client.1.smithi143.stdout:7/365: dread - d4/d16/f6d zero size 2024-09-17T01:06:56.396 INFO:tasks.workunit.client.1.smithi143.stdout:4/297: symlink da/d3a/d40/l60 0 2024-09-17T01:06:56.396 INFO:tasks.workunit.client.1.smithi143.stdout:6/195: write d2/f1f [4296368,27446] 0 2024-09-17T01:06:56.398 INFO:tasks.workunit.client.1.smithi143.stdout:0/365: dread d3/d5/d8/d21/f42 [0,4194304] 0 2024-09-17T01:06:56.398 INFO:tasks.workunit.client.1.smithi143.stdout:5/352: dwrite d1/d46/df/f76 [0,4194304] 0 2024-09-17T01:06:56.399 INFO:tasks.workunit.client.1.smithi143.stdout:3/263: creat d6/d1c/d33/d41/d42/f4c x:0 0 0 2024-09-17T01:06:56.400 INFO:tasks.workunit.client.1.smithi143.stdout:9/267: creat d3/d3d/d48/f59 x:0 0 0 2024-09-17T01:06:56.402 INFO:tasks.workunit.client.1.smithi143.stdout:4/298: mkdir da/d3a/d3e/d49/d61 0 2024-09-17T01:06:56.404 INFO:tasks.workunit.client.1.smithi143.stdout:3/264: mkdir d6/d1c/d4d 0 2024-09-17T01:06:56.408 INFO:tasks.workunit.client.1.smithi143.stdout:3/265: chown d6/d1c/d33/f38 58466334 1 2024-09-17T01:06:56.410 INFO:tasks.workunit.client.1.smithi143.stdout:5/353: dwrite d1/d46/df/d23/f4a [0,4194304] 0 2024-09-17T01:06:56.415 INFO:tasks.workunit.client.1.smithi143.stdout:6/196: dwrite d2/df/f31 [4194304,4194304] 0 2024-09-17T01:06:56.418 INFO:tasks.workunit.client.1.smithi143.stdout:1/343: getdents d0/d6/d43/d6a 0 2024-09-17T01:06:56.420 INFO:tasks.workunit.client.1.smithi143.stdout:1/344: rename d0/d6/d43 to d0/d6/d43/d71 22 2024-09-17T01:06:56.420 INFO:tasks.workunit.client.1.smithi143.stdout:7/366: write d4/d26/f2b [50259,42431] 0 2024-09-17T01:06:56.421 INFO:tasks.workunit.client.1.smithi143.stdout:0/366: write d3/d5/d8/d10/f4f [688294,128377] 0 2024-09-17T01:06:56.425 INFO:tasks.workunit.client.1.smithi143.stdout:7/367: write f2 [5961263,90971] 0 2024-09-17T01:06:56.425 INFO:tasks.workunit.client.1.smithi143.stdout:1/345: mkdir d0/d6/d43/d47/d72 0 2024-09-17T01:06:56.426 INFO:tasks.workunit.client.1.smithi143.stdout:9/268: write d3/d16/d34/f36 [1056236,26344] 0 2024-09-17T01:06:56.426 INFO:tasks.workunit.client.1.smithi143.stdout:6/197: creat d2/df/d20/d2c/d38/f39 x:0 0 0 2024-09-17T01:06:56.428 INFO:tasks.workunit.client.1.smithi143.stdout:5/354: link d1/d46/df/d53/f86 d1/d46/df/d23/f8e 0 2024-09-17T01:06:56.429 INFO:tasks.workunit.client.1.smithi143.stdout:3/266: getdents d6/d1c/d33/d41/d2e/d30 0 2024-09-17T01:06:56.429 INFO:tasks.workunit.client.1.smithi143.stdout:7/368: chown d4/d26/f74 0 1 2024-09-17T01:06:56.431 INFO:tasks.workunit.client.1.smithi143.stdout:0/367: dread d3/d5/d8/d27/d31/d4c/f45 [0,4194304] 0 2024-09-17T01:06:56.440 INFO:tasks.workunit.client.1.smithi143.stdout:7/369: truncate d4/d1f/f28 2471847 0 2024-09-17T01:06:56.442 INFO:tasks.workunit.client.1.smithi143.stdout:1/346: dwrite d0/d6/d43/d6a/df/f1a [0,4194304] 0 2024-09-17T01:06:56.444 INFO:tasks.workunit.client.1.smithi143.stdout:3/267: dread d6/d1c/d33/d41/f1a [0,4194304] 0 2024-09-17T01:06:56.444 INFO:tasks.workunit.client.1.smithi143.stdout:7/370: chown d4/d1f/f3e 0 1 2024-09-17T01:06:56.444 INFO:tasks.workunit.client.1.smithi143.stdout:5/355: link d1/d46/df/d1f/d7a/l89 d1/d46/df/d53/l8f 0 2024-09-17T01:06:56.445 INFO:tasks.workunit.client.1.smithi143.stdout:6/198: dwrite d2/d7/d26/f32 [0,4194304] 0 2024-09-17T01:06:56.446 INFO:tasks.workunit.client.1.smithi143.stdout:0/368: dread d3/d5/d8/d21/f42 [4194304,4194304] 0 2024-09-17T01:06:56.450 INFO:tasks.workunit.client.1.smithi143.stdout:1/347: unlink d0/d6/d43/d6a/df/c41 0 2024-09-17T01:06:56.450 INFO:tasks.workunit.client.1.smithi143.stdout:6/199: chown d2/d17/d2b/c37 242 1 2024-09-17T01:06:56.451 INFO:tasks.workunit.client.1.smithi143.stdout:0/369: chown d3/d5/d8/d27/d31/d4c/f79 53420 1 2024-09-17T01:06:56.454 INFO:tasks.workunit.client.1.smithi143.stdout:3/268: mknod d6/d1c/d4d/c4e 0 2024-09-17T01:06:56.456 INFO:tasks.workunit.client.1.smithi143.stdout:6/200: rename d2/d17/d2b to d2/d17/d3a 0 2024-09-17T01:06:56.457 INFO:tasks.workunit.client.1.smithi143.stdout:5/356: creat d1/d46/df/d23/f90 x:0 0 0 2024-09-17T01:06:56.458 INFO:tasks.workunit.client.1.smithi143.stdout:3/269: creat d6/d1c/d33/d41/d42/f4f x:0 0 0 2024-09-17T01:06:56.459 INFO:tasks.workunit.client.1.smithi143.stdout:5/357: dread - d1/d46/f79 zero size 2024-09-17T01:06:56.459 INFO:tasks.workunit.client.1.smithi143.stdout:6/201: unlink d2/df/l15 0 2024-09-17T01:06:56.462 INFO:tasks.workunit.client.1.smithi143.stdout:5/358: chown d1/f4d 2727 1 2024-09-17T01:06:56.462 INFO:tasks.workunit.client.1.smithi143.stdout:0/370: dwrite d3/d5/d8/d21/f55 [0,4194304] 0 2024-09-17T01:06:56.464 INFO:tasks.workunit.client.1.smithi143.stdout:5/359: write d1/f2 [295215,81817] 0 2024-09-17T01:06:56.465 INFO:tasks.workunit.client.1.smithi143.stdout:9/269: dread d3/d16/d2b/fb [0,4194304] 0 2024-09-17T01:06:56.465 INFO:tasks.workunit.client.1.smithi143.stdout:7/371: dread d4/d1f/f31 [0,4194304] 0 2024-09-17T01:06:56.466 INFO:tasks.workunit.client.1.smithi143.stdout:3/270: rename d6/d1c/d33/d41/d2e/d30/f37 to d6/d1c/d4b/f50 0 2024-09-17T01:06:56.474 INFO:tasks.workunit.client.1.smithi143.stdout:9/270: read - d3/d16/d2b/d26/f3c zero size 2024-09-17T01:06:56.474 INFO:tasks.workunit.client.1.smithi143.stdout:3/271: write d6/d1c/d33/d41/f21 [5145127,31020] 0 2024-09-17T01:06:56.475 INFO:tasks.workunit.client.1.smithi143.stdout:5/360: creat d1/d46/f91 x:0 0 0 2024-09-17T01:06:56.477 INFO:tasks.workunit.client.1.smithi143.stdout:7/372: dread d4/d1f/f60 [0,4194304] 0 2024-09-17T01:06:56.478 INFO:tasks.workunit.client.1.smithi143.stdout:6/202: dwrite d2/d7/d26/f32 [0,4194304] 0 2024-09-17T01:06:56.480 INFO:tasks.workunit.client.1.smithi143.stdout:9/271: write d3/d39/f4b [2723292,90450] 0 2024-09-17T01:06:56.481 INFO:tasks.workunit.client.1.smithi143.stdout:0/371: dwrite d3/d5/d8/d21/f26 [0,4194304] 0 2024-09-17T01:06:56.481 INFO:tasks.workunit.client.1.smithi143.stdout:1/348: dread d0/d6/d43/d6a/df/d6e/f1d [0,4194304] 0 2024-09-17T01:06:56.483 INFO:tasks.workunit.client.1.smithi143.stdout:5/361: write d1/d46/df/f62 [860059,20353] 0 2024-09-17T01:06:56.483 INFO:tasks.workunit.client.1.smithi143.stdout:7/373: write f2 [8013586,114133] 0 2024-09-17T01:06:56.486 INFO:tasks.workunit.client.1.smithi143.stdout:6/203: creat d2/d7/d26/f3b x:0 0 0 2024-09-17T01:06:56.487 INFO:tasks.workunit.client.1.smithi143.stdout:9/272: fdatasync d3/d16/d2b/d9/f27 0 2024-09-17T01:06:56.489 INFO:tasks.workunit.client.1.smithi143.stdout:6/204: readlink d2/d7/d26/l2a 0 2024-09-17T01:06:56.493 INFO:tasks.workunit.client.1.smithi143.stdout:0/372: truncate d3/d5/d8/d10/f4f 2060694 0 2024-09-17T01:06:56.494 INFO:tasks.workunit.client.1.smithi143.stdout:5/362: mkdir d1/d46/df/d23/d4f/d7d/d92 0 2024-09-17T01:06:56.496 INFO:tasks.workunit.client.1.smithi143.stdout:3/272: dwrite d6/d1c/d33/d41/f16 [0,4194304] 0 2024-09-17T01:06:56.497 INFO:tasks.workunit.client.1.smithi143.stdout:7/374: getdents d4/d26 0 2024-09-17T01:06:56.498 INFO:tasks.workunit.client.1.smithi143.stdout:0/373: dread - d3/d5/d8/d27/f6a zero size 2024-09-17T01:06:56.500 INFO:tasks.workunit.client.1.smithi143.stdout:9/273: getdents d3/d16/d34 0 2024-09-17T01:06:56.502 INFO:tasks.workunit.client.1.smithi143.stdout:3/273: fsync d6/d1c/d33/d41/d2b/f3d 0 2024-09-17T01:06:56.503 INFO:tasks.workunit.client.1.smithi143.stdout:1/349: dwrite d0/d6/d43/d6a/df/d6e/d2/d3c/f53 [0,4194304] 0 2024-09-17T01:06:56.504 INFO:tasks.workunit.client.1.smithi143.stdout:2/345: sync 2024-09-17T01:06:56.506 INFO:tasks.workunit.client.1.smithi143.stdout:9/274: chown d3/f8 0 1 2024-09-17T01:06:56.506 INFO:tasks.workunit.client.1.smithi143.stdout:7/375: rename d4/d33/f4b to d4/d26/f76 0 2024-09-17T01:06:56.508 INFO:tasks.workunit.client.1.smithi143.stdout:6/205: dwrite d2/df/f2e [0,4194304] 0 2024-09-17T01:06:56.509 INFO:tasks.workunit.client.1.smithi143.stdout:0/374: read - d3/d5/d8/d27/d31/d4c/f79 zero size 2024-09-17T01:06:56.510 INFO:tasks.workunit.client.1.smithi143.stdout:3/274: write d6/d1c/d33/d41/f16 [497756,130001] 0 2024-09-17T01:06:56.511 INFO:tasks.workunit.client.1.smithi143.stdout:2/346: write d0/d10/f17 [4867072,108442] 0 2024-09-17T01:06:56.513 INFO:tasks.workunit.client.1.smithi143.stdout:7/376: dread d4/d26/f2b [0,4194304] 0 2024-09-17T01:06:56.516 INFO:tasks.workunit.client.1.smithi143.stdout:3/275: rename d6/d1c/d33/d41/d2e to d6/d1c/d33/d41/d2e/d51 22 2024-09-17T01:06:56.517 INFO:tasks.workunit.client.1.smithi143.stdout:1/350: fdatasync d0/d6/d43/d6a/f70 0 2024-09-17T01:06:56.517 INFO:tasks.workunit.client.1.smithi143.stdout:6/206: creat d2/d17/d3a/f3c x:0 0 0 2024-09-17T01:06:56.518 INFO:tasks.workunit.client.1.smithi143.stdout:9/275: mkdir d3/d39/d42/d58/d5a 0 2024-09-17T01:06:56.519 INFO:tasks.workunit.client.1.smithi143.stdout:3/276: readlink d6/d1c/d33/d41/l3a 0 2024-09-17T01:06:56.519 INFO:tasks.workunit.client.1.smithi143.stdout:0/375: fdatasync d3/d5/d35/f3f 0 2024-09-17T01:06:56.520 INFO:tasks.workunit.client.1.smithi143.stdout:7/377: symlink d4/d1f/d4a/d66/l77 0 2024-09-17T01:06:56.520 INFO:tasks.workunit.client.1.smithi143.stdout:6/207: write d2/d7/f8 [3217082,3545] 0 2024-09-17T01:06:56.522 INFO:tasks.workunit.client.1.smithi143.stdout:7/378: stat d4/d26/f2d 0 2024-09-17T01:06:56.523 INFO:tasks.workunit.client.1.smithi143.stdout:6/208: fdatasync d2/d7/d26/f3b 0 2024-09-17T01:06:56.524 INFO:tasks.workunit.client.1.smithi143.stdout:0/376: symlink d3/d5/d8/d27/l7b 0 2024-09-17T01:06:56.524 INFO:tasks.workunit.client.1.smithi143.stdout:2/347: dwrite d0/d44/f46 [4194304,4194304] 0 2024-09-17T01:06:56.524 INFO:tasks.workunit.client.1.smithi143.stdout:9/276: rename d3/d16/d2b/f1c to d3/d16/d34/f5b 0 2024-09-17T01:06:56.525 INFO:tasks.workunit.client.1.smithi143.stdout:3/277: chown d6/d1c/d33/d41/d2e/d30/l46 54806 1 2024-09-17T01:06:56.527 INFO:tasks.workunit.client.1.smithi143.stdout:6/209: read - d2/d17/f25 zero size 2024-09-17T01:06:56.527 INFO:tasks.workunit.client.1.smithi143.stdout:3/278: fdatasync d6/d1c/d33/d41/f21 0 2024-09-17T01:06:56.529 INFO:tasks.workunit.client.1.smithi143.stdout:0/377: symlink d3/d5/d8/d27/d31/d4c/l7c 0 2024-09-17T01:06:56.530 INFO:tasks.workunit.client.1.smithi143.stdout:0/378: write d3/d5/d8/d10/f4f [1847004,109409] 0 2024-09-17T01:06:56.530 INFO:tasks.workunit.client.1.smithi143.stdout:2/348: write d0/d2/d21/d22/d24/f43 [1564960,58622] 0 2024-09-17T01:06:56.532 INFO:tasks.workunit.client.1.smithi143.stdout:9/277: rename d3/f4 to d3/d16/d2b/d9/f5c 0 2024-09-17T01:06:56.533 INFO:tasks.workunit.client.1.smithi143.stdout:6/210: unlink d2/c4 0 2024-09-17T01:06:56.533 INFO:tasks.workunit.client.1.smithi143.stdout:2/349: truncate d0/d10/f39 440910 0 2024-09-17T01:06:56.534 INFO:tasks.workunit.client.1.smithi143.stdout:2/350: stat d0/d10/d56/f66 0 2024-09-17T01:06:56.539 INFO:tasks.workunit.client.1.smithi143.stdout:7/379: dread d4/d16/f1d [0,4194304] 0 2024-09-17T01:06:56.539 INFO:tasks.workunit.client.1.smithi143.stdout:2/351: write d0/d2/d21/d22/f28 [3467649,32503] 0 2024-09-17T01:06:56.540 INFO:tasks.workunit.client.1.smithi143.stdout:1/351: truncate d0/d6/d43/d6a/df/d6e/d2/d3c/f53 1544440 0 2024-09-17T01:06:56.541 INFO:tasks.workunit.client.1.smithi143.stdout:6/211: symlink d2/d30/l3d 0 2024-09-17T01:06:56.542 INFO:tasks.workunit.client.1.smithi143.stdout:0/379: mknod d3/d5/d8/d21/c7d 0 2024-09-17T01:06:56.545 INFO:tasks.workunit.client.1.smithi143.stdout:7/380: stat d4/d33/d4e/c5c 0 2024-09-17T01:06:56.546 INFO:tasks.workunit.client.1.smithi143.stdout:2/352: rename d0/d10/c18 to d0/d44/d6a/c6b 0 2024-09-17T01:06:56.548 INFO:tasks.workunit.client.1.smithi143.stdout:3/279: link d6/le d6/d1c/d33/d41/d42/l52 0 2024-09-17T01:06:56.550 INFO:tasks.workunit.client.1.smithi143.stdout:7/381: mkdir d4/d33/d78 0 2024-09-17T01:06:56.551 INFO:tasks.workunit.client.1.smithi143.stdout:1/352: creat d0/d6/d43/d47/d68/f73 x:0 0 0 2024-09-17T01:06:56.554 INFO:tasks.workunit.client.1.smithi143.stdout:6/212: creat d2/d7/f3e x:0 0 0 2024-09-17T01:06:56.555 INFO:tasks.workunit.client.1.smithi143.stdout:7/382: creat d4/d1f/d29/f79 x:0 0 0 2024-09-17T01:06:56.557 INFO:tasks.workunit.client.1.smithi143.stdout:1/353: mkdir d0/dc/d74 0 2024-09-17T01:06:56.559 INFO:tasks.workunit.client.1.smithi143.stdout:1/354: write d0/d6/f5f [428894,119964] 0 2024-09-17T01:06:56.560 INFO:tasks.workunit.client.1.smithi143.stdout:6/213: mknod d2/d7/d26/c3f 0 2024-09-17T01:06:56.561 INFO:tasks.workunit.client.1.smithi143.stdout:7/383: dwrite d4/d1f/f60 [0,4194304] 0 2024-09-17T01:06:56.562 INFO:tasks.workunit.client.1.smithi143.stdout:1/355: write d0/d6/d43/d6a/df/f1a [2630268,130026] 0 2024-09-17T01:06:56.563 INFO:tasks.workunit.client.1.smithi143.stdout:9/278: link d3/d16/d2b/f12 d3/d39/d42/f5d 0 2024-09-17T01:06:56.563 INFO:tasks.workunit.client.1.smithi143.stdout:0/380: truncate d3/d14/d3d/f5d 1295065 0 2024-09-17T01:06:56.565 INFO:tasks.workunit.client.1.smithi143.stdout:0/381: chown d3/d14 206 1 2024-09-17T01:06:56.565 INFO:tasks.workunit.client.1.smithi143.stdout:2/353: getdents d0/d10/d58/d5a/d5b 0 2024-09-17T01:06:56.566 INFO:tasks.workunit.client.1.smithi143.stdout:6/214: mkdir d2/df/d40 0 2024-09-17T01:06:56.566 INFO:tasks.workunit.client.1.smithi143.stdout:7/384: write d4/d26/f2b [33317,24594] 0 2024-09-17T01:06:56.567 INFO:tasks.workunit.client.1.smithi143.stdout:3/280: getdents d6/d1c/d33 0 2024-09-17T01:06:56.568 INFO:tasks.workunit.client.1.smithi143.stdout:9/279: rmdir d3 39 2024-09-17T01:06:56.570 INFO:tasks.workunit.client.1.smithi143.stdout:1/356: symlink d0/dc/d74/l75 0 2024-09-17T01:06:56.571 INFO:tasks.workunit.client.1.smithi143.stdout:2/354: creat d0/d10/d58/d5a/d5b/d4c/f6c x:0 0 0 2024-09-17T01:06:56.572 INFO:tasks.workunit.client.1.smithi143.stdout:7/385: symlink d4/d1f/d4a/l7a 0 2024-09-17T01:06:56.575 INFO:tasks.workunit.client.1.smithi143.stdout:9/280: fsync d3/d39/f4b 0 2024-09-17T01:06:56.576 INFO:tasks.workunit.client.1.smithi143.stdout:1/357: unlink d0/d6/d43/d6a/df/d6e/f14 0 2024-09-17T01:06:56.577 INFO:tasks.workunit.client.1.smithi143.stdout:6/215: dwrite d2/df/d20/d2c/d38/f39 [0,4194304] 0 2024-09-17T01:06:56.578 INFO:tasks.workunit.client.1.smithi143.stdout:7/386: truncate d4/d1f/d29/d65/d5d/f51 1206843 0 2024-09-17T01:06:56.580 INFO:tasks.workunit.client.1.smithi143.stdout:3/281: rename d6/lb to d6/d1c/d33/d41/l53 0 2024-09-17T01:06:56.581 INFO:tasks.workunit.client.1.smithi143.stdout:9/281: unlink d3/d16/d2b/f10 0 2024-09-17T01:06:56.582 INFO:tasks.workunit.client.1.smithi143.stdout:3/282: write d6/d1c/d33/d41/d2e/d30/f32 [2681970,61716] 0 2024-09-17T01:06:56.585 INFO:tasks.workunit.client.1.smithi143.stdout:1/358: rename d0/c2b to d0/d6/d43/d47/d72/c76 0 2024-09-17T01:06:56.585 INFO:tasks.workunit.client.1.smithi143.stdout:3/283: rename d6/d1c to d6/d1c/d33/d54 22 2024-09-17T01:06:56.589 INFO:tasks.workunit.client.1.smithi143.stdout:6/216: getdents d2/df 0 2024-09-17T01:06:56.589 INFO:tasks.workunit.client.1.smithi143.stdout:9/282: mkdir d3/d39/d42/d58/d5a/d5e 0 2024-09-17T01:06:56.590 INFO:tasks.workunit.client.1.smithi143.stdout:1/359: symlink d0/d6/d43/d6a/df/d6e/d18/d4d/l77 0 2024-09-17T01:06:56.591 INFO:tasks.workunit.client.1.smithi143.stdout:3/284: truncate d6/d1c/d33/d41/f1a 5425986 0 2024-09-17T01:06:56.591 INFO:tasks.workunit.client.1.smithi143.stdout:6/217: fdatasync d2/df/d20/f34 0 2024-09-17T01:06:56.592 INFO:tasks.workunit.client.1.smithi143.stdout:9/283: creat d3/d16/d2b/d26/f5f x:0 0 0 2024-09-17T01:06:56.592 INFO:tasks.workunit.client.1.smithi143.stdout:3/285: fsync d6/fa 0 2024-09-17T01:06:56.594 INFO:tasks.workunit.client.1.smithi143.stdout:3/286: chown d6/le 608377 1 2024-09-17T01:06:56.595 INFO:tasks.workunit.client.1.smithi143.stdout:1/360: unlink d0/d6/d43/d6a/df/d6e/d2/d3c/f45 0 2024-09-17T01:06:56.597 INFO:tasks.workunit.client.1.smithi143.stdout:6/218: mkdir d2/df/d40/d41 0 2024-09-17T01:06:56.598 INFO:tasks.workunit.client.1.smithi143.stdout:7/387: truncate d4/d1f/f30 132136 0 2024-09-17T01:06:56.598 INFO:tasks.workunit.client.1.smithi143.stdout:3/287: dread d6/d1c/f2a [4194304,4194304] 0 2024-09-17T01:06:56.599 INFO:tasks.workunit.client.1.smithi143.stdout:7/388: dread - d4/f27 zero size 2024-09-17T01:06:56.601 INFO:tasks.workunit.client.1.smithi143.stdout:3/288: fsync d6/d1c/d33/d41/d42/f4c 0 2024-09-17T01:06:56.603 INFO:tasks.workunit.client.1.smithi143.stdout:1/361: dwrite d0/dc/f38 [0,4194304] 0 2024-09-17T01:06:56.606 INFO:tasks.workunit.client.1.smithi143.stdout:6/219: dwrite d2/f28 [0,4194304] 0 2024-09-17T01:06:56.607 INFO:tasks.workunit.client.1.smithi143.stdout:3/289: symlink d6/l55 0 2024-09-17T01:06:56.608 INFO:tasks.workunit.client.1.smithi143.stdout:7/389: dread d4/d1f/d29/d65/d5d/f51 [0,4194304] 0 2024-09-17T01:06:56.613 INFO:tasks.workunit.client.1.smithi143.stdout:1/362: mkdir d0/d6/d43/d6a/df/d6e/d18/d2d/d78 0 2024-09-17T01:06:56.615 INFO:tasks.workunit.client.1.smithi143.stdout:1/363: dread - d0/d6/d43/d6a/df/d6e/d2/f56 zero size 2024-09-17T01:06:56.616 INFO:tasks.workunit.client.1.smithi143.stdout:6/220: link d2/df/d20/d2c/f24 d2/df/d40/f42 0 2024-09-17T01:06:56.618 INFO:tasks.workunit.client.1.smithi143.stdout:3/290: getdents d6/d1c/d33/d3f 0 2024-09-17T01:06:56.619 INFO:tasks.workunit.client.1.smithi143.stdout:1/364: mkdir d0/d6/d43/d6a/df/d6e/d2/d39/d79 0 2024-09-17T01:06:56.620 INFO:tasks.workunit.client.1.smithi143.stdout:7/390: dwrite d4/d1f/d29/d65/f6e [0,4194304] 0 2024-09-17T01:06:56.623 INFO:tasks.workunit.client.1.smithi143.stdout:7/391: chown d4/d16/f17 0 1 2024-09-17T01:06:56.626 INFO:tasks.workunit.client.1.smithi143.stdout:1/365: write d0/d6/d43/d6a/df/d6e/d2/d39/f6c [1025084,83649] 0 2024-09-17T01:06:56.630 INFO:tasks.workunit.client.1.smithi143.stdout:1/366: stat d0/d6/f29 0 2024-09-17T01:06:56.631 INFO:tasks.workunit.client.1.smithi143.stdout:6/221: dwrite d2/d7/d26/f32 [0,4194304] 0 2024-09-17T01:06:56.633 INFO:tasks.workunit.client.1.smithi143.stdout:3/291: dwrite d6/d1c/d33/d41/d42/f4f [0,4194304] 0 2024-09-17T01:06:56.637 INFO:tasks.workunit.client.1.smithi143.stdout:8/310: sync 2024-09-17T01:06:56.638 INFO:tasks.workunit.client.1.smithi143.stdout:7/392: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:06:56.638 INFO:tasks.workunit.client.1.smithi143.stdout:6/222: rename d2/df/d20/d2c/f36 to d2/df/f43 0 2024-09-17T01:06:56.640 INFO:tasks.workunit.client.1.smithi143.stdout:3/292: stat d6/d1c/d33/d41/d2b/c2c 0 2024-09-17T01:06:56.641 INFO:tasks.workunit.client.1.smithi143.stdout:7/393: write d4/d1f/d29/f64 [1083120,129407] 0 2024-09-17T01:06:56.642 INFO:tasks.workunit.client.1.smithi143.stdout:1/367: rename d0/d6/d43/d6a/df/d6e/d2/d3c/f53 to d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a 0 2024-09-17T01:06:56.642 INFO:tasks.workunit.client.1.smithi143.stdout:6/223: write d2/d7/d26/f3b [170082,62404] 0 2024-09-17T01:06:56.643 INFO:tasks.workunit.client.1.smithi143.stdout:6/224: read - d2/d17/d3a/f3c zero size 2024-09-17T01:06:56.644 INFO:tasks.workunit.client.1.smithi143.stdout:3/293: symlink d6/d1c/d4b/l56 0 2024-09-17T01:06:56.647 INFO:tasks.workunit.client.1.smithi143.stdout:1/368: mkdir d0/d6/d43/d47/d68/d7b 0 2024-09-17T01:06:56.649 INFO:tasks.workunit.client.1.smithi143.stdout:3/294: mkdir d6/d1c/d4b/d57 0 2024-09-17T01:06:56.652 INFO:tasks.workunit.client.1.smithi143.stdout:8/311: truncate d9/d12/d13/f33 2197603 0 2024-09-17T01:06:56.654 INFO:tasks.workunit.client.1.smithi143.stdout:1/369: read d0/d6/d43/d6a/df/d6e/d2/f2a [3615379,86399] 0 2024-09-17T01:06:56.657 INFO:tasks.workunit.client.1.smithi143.stdout:6/225: dwrite d2/d7/f3e [0,4194304] 0 2024-09-17T01:06:56.657 INFO:tasks.workunit.client.1.smithi143.stdout:8/312: unlink d9/de/c4e 0 2024-09-17T01:06:56.666 INFO:tasks.workunit.client.1.smithi143.stdout:8/313: readlink d9/d23/d32/l39 0 2024-09-17T01:06:56.666 INFO:tasks.workunit.client.1.smithi143.stdout:7/394: dwrite d4/d26/f22 [0,4194304] 0 2024-09-17T01:06:56.666 INFO:tasks.workunit.client.1.smithi143.stdout:6/226: dread - d2/d17/d3a/f3c zero size 2024-09-17T01:06:56.667 INFO:tasks.workunit.client.1.smithi143.stdout:1/370: chown d0/d6/d43/d6a/df/d6e/d2/l37 1031562 1 2024-09-17T01:06:56.667 INFO:tasks.workunit.client.1.smithi143.stdout:3/295: truncate d6/d1c/d33/d41/d2b/f45 1281732 0 2024-09-17T01:06:56.667 INFO:tasks.workunit.client.1.smithi143.stdout:7/395: fdatasync d4/f69 0 2024-09-17T01:06:56.667 INFO:tasks.workunit.client.1.smithi143.stdout:1/371: mknod d0/dc/c7c 0 2024-09-17T01:06:56.667 INFO:tasks.workunit.client.1.smithi143.stdout:7/396: symlink d4/d1f/l7b 0 2024-09-17T01:06:56.668 INFO:tasks.workunit.client.1.smithi143.stdout:6/227: creat d2/d7/f44 x:0 0 0 2024-09-17T01:06:56.671 INFO:tasks.workunit.client.1.smithi143.stdout:1/372: dread d0/d6/f3a [0,4194304] 0 2024-09-17T01:06:56.671 INFO:tasks.workunit.client.1.smithi143.stdout:6/228: write d2/df/d20/d2c/d38/f39 [4706672,35834] 0 2024-09-17T01:06:56.672 INFO:tasks.workunit.client.1.smithi143.stdout:7/397: creat d4/d1f/d29/d65/f7c x:0 0 0 2024-09-17T01:06:56.674 INFO:tasks.workunit.client.1.smithi143.stdout:1/373: write d0/d6/f1f [2443364,51936] 0 2024-09-17T01:06:56.674 INFO:tasks.workunit.client.1.smithi143.stdout:3/296: rename d6/d1c/d33/d41/d2b/f3b to d6/f58 0 2024-09-17T01:06:56.676 INFO:tasks.workunit.client.1.smithi143.stdout:3/297: write d6/d1c/d33/d41/d2e/f47 [1016461,39321] 0 2024-09-17T01:06:56.676 INFO:tasks.workunit.client.1.smithi143.stdout:7/398: mknod d4/d1f/d4a/d66/c7d 0 2024-09-17T01:06:56.677 INFO:tasks.workunit.client.1.smithi143.stdout:1/374: rmdir d0/d6/d43/d6a/df/d6e/d2/d39/d79 39 2024-09-17T01:06:56.678 INFO:tasks.workunit.client.1.smithi143.stdout:6/229: read d2/df/d20/d2c/f24 [3557792,92894] 0 2024-09-17T01:06:56.678 INFO:tasks.workunit.client.1.smithi143.stdout:7/399: mknod d4/d33/d4e/c7e 0 2024-09-17T01:06:56.679 INFO:tasks.workunit.client.1.smithi143.stdout:3/298: symlink d6/d1c/d33/d41/d42/l59 0 2024-09-17T01:06:56.679 INFO:tasks.workunit.client.1.smithi143.stdout:7/400: fdatasync d4/f1b 0 2024-09-17T01:06:56.680 INFO:tasks.workunit.client.1.smithi143.stdout:1/375: fdatasync d0/d6/d43/d6a/f70 0 2024-09-17T01:06:56.682 INFO:tasks.workunit.client.1.smithi143.stdout:7/401: chown d4/d1f/l7b 3538225 1 2024-09-17T01:06:56.684 INFO:tasks.workunit.client.1.smithi143.stdout:1/376: creat d0/dc/d57/f7d x:0 0 0 2024-09-17T01:06:56.685 INFO:tasks.workunit.client.1.smithi143.stdout:7/402: symlink d4/d33/d4e/l7f 0 2024-09-17T01:06:56.689 INFO:tasks.workunit.client.1.smithi143.stdout:3/299: dwrite d6/d1c/f2a [0,4194304] 0 2024-09-17T01:06:56.689 INFO:tasks.workunit.client.1.smithi143.stdout:1/377: chown d0/d6/d43/d6a/df/d6e/d18/d2d/f51 8073437 1 2024-09-17T01:06:56.689 INFO:tasks.workunit.client.1.smithi143.stdout:7/403: creat d4/d1f/f80 x:0 0 0 2024-09-17T01:06:56.691 INFO:tasks.workunit.client.1.smithi143.stdout:3/300: write d6/d1c/d33/f38 [2705247,28380] 0 2024-09-17T01:06:56.692 INFO:tasks.workunit.client.1.smithi143.stdout:7/404: write d4/d1f/d29/d65/f7c [477600,84038] 0 2024-09-17T01:06:56.693 INFO:tasks.workunit.client.1.smithi143.stdout:8/314: dread d9/d23/d48/f6c [0,4194304] 0 2024-09-17T01:06:56.693 INFO:tasks.workunit.client.1.smithi143.stdout:3/301: chown d6/d1c/d33/d41/d2e/d30/l46 4 1 2024-09-17T01:06:56.694 INFO:tasks.workunit.client.1.smithi143.stdout:1/378: rmdir d0/d6/d43/d6a/df/d6e/d2/d39/d79 39 2024-09-17T01:06:56.694 INFO:tasks.workunit.client.1.smithi143.stdout:8/315: readlink d9/d23/d32/l42 0 2024-09-17T01:06:56.694 INFO:tasks.workunit.client.1.smithi143.stdout:7/405: truncate d4/d26/f22 4977061 0 2024-09-17T01:06:56.696 INFO:tasks.workunit.client.1.smithi143.stdout:7/406: write d4/d16/f17 [7100850,3967] 0 2024-09-17T01:06:56.698 INFO:tasks.workunit.client.1.smithi143.stdout:1/379: mknod d0/dc/d57/d58/c7e 0 2024-09-17T01:06:56.699 INFO:tasks.workunit.client.1.smithi143.stdout:8/316: mkdir d9/d12/d38/d58/d70 0 2024-09-17T01:06:56.700 INFO:tasks.workunit.client.1.smithi143.stdout:6/230: dread d2/df/d20/d2c/f24 [0,4194304] 0 2024-09-17T01:06:56.700 INFO:tasks.workunit.client.1.smithi143.stdout:3/302: dread d6/d1c/d33/d41/d2e/f47 [0,4194304] 0 2024-09-17T01:06:56.700 INFO:tasks.workunit.client.1.smithi143.stdout:7/407: rename d4/f27 to d4/d1f/d29/f81 0 2024-09-17T01:06:56.701 INFO:tasks.workunit.client.1.smithi143.stdout:1/380: fdatasync d0/d6/d43/d6a/df/d6e/d18/f36 0 2024-09-17T01:06:56.703 INFO:tasks.workunit.client.1.smithi143.stdout:8/317: creat d9/d12/d38/d58/d70/f71 x:0 0 0 2024-09-17T01:06:56.705 INFO:tasks.workunit.client.1.smithi143.stdout:7/408: unlink d4/d1f/f60 0 2024-09-17T01:06:56.707 INFO:tasks.workunit.client.1.smithi143.stdout:8/318: mkdir d9/d12/d4b/d3f/d72 0 2024-09-17T01:06:56.708 INFO:tasks.workunit.client.1.smithi143.stdout:7/409: fdatasync d4/d16/f1a 0 2024-09-17T01:06:56.711 INFO:tasks.workunit.client.1.smithi143.stdout:1/381: mkdir d0/d6/d43/d47/d68/d7b/d7f 0 2024-09-17T01:06:56.712 INFO:tasks.workunit.client.1.smithi143.stdout:8/319: mkdir d9/d12/d13/d73 0 2024-09-17T01:06:56.716 INFO:tasks.workunit.client.1.smithi143.stdout:1/382: dwrite d0/dc/f38 [4194304,4194304] 0 2024-09-17T01:06:56.717 INFO:tasks.workunit.client.1.smithi143.stdout:3/303: link d6/l1d d6/d1c/d4b/d57/l5a 0 2024-09-17T01:06:56.718 INFO:tasks.workunit.client.1.smithi143.stdout:3/304: write d6/d1c/d33/d41/d2e/d30/f32 [3023146,35675] 0 2024-09-17T01:06:56.719 INFO:tasks.workunit.client.1.smithi143.stdout:6/231: getdents d2 0 2024-09-17T01:06:56.719 INFO:tasks.workunit.client.1.smithi143.stdout:6/232: fsync d2/df/d18/f35 0 2024-09-17T01:06:56.720 INFO:tasks.workunit.client.1.smithi143.stdout:8/320: creat d9/d26/f74 x:0 0 0 2024-09-17T01:06:56.722 INFO:tasks.workunit.client.1.smithi143.stdout:1/383: chown d0/d6/d43/d6a/df/d6e/d18/d2d/l61 2 1 2024-09-17T01:06:56.723 INFO:tasks.workunit.client.1.smithi143.stdout:1/384: write d0/d6/f5f [383388,52555] 0 2024-09-17T01:06:56.724 INFO:tasks.workunit.client.1.smithi143.stdout:8/321: truncate f7 1389948 0 2024-09-17T01:06:56.724 INFO:tasks.workunit.client.1.smithi143.stdout:6/233: dread d2/d7/d26/f32 [0,4194304] 0 2024-09-17T01:06:56.730 INFO:tasks.workunit.client.1.smithi143.stdout:6/234: unlink d2/df/d18/f35 0 2024-09-17T01:06:56.731 INFO:tasks.workunit.client.1.smithi143.stdout:7/410: link d4/d1f/f30 d4/f82 0 2024-09-17T01:06:56.731 INFO:tasks.workunit.client.1.smithi143.stdout:1/385: creat d0/d6/d64/f80 x:0 0 0 2024-09-17T01:06:56.732 INFO:tasks.workunit.client.1.smithi143.stdout:7/411: mknod d4/d16/c83 0 2024-09-17T01:06:56.734 INFO:tasks.workunit.client.1.smithi143.stdout:7/412: write d4/f69 [1044081,46389] 0 2024-09-17T01:06:56.735 INFO:tasks.workunit.client.1.smithi143.stdout:1/386: getdents d0/d6/d43/d6a/df/d6e/d2/d39/d6b 0 2024-09-17T01:06:56.737 INFO:tasks.workunit.client.1.smithi143.stdout:1/387: stat d0/d6/d43/d6a/d52/l60 0 2024-09-17T01:06:56.737 INFO:tasks.workunit.client.1.smithi143.stdout:6/235: dwrite d2/df/f31 [0,4194304] 0 2024-09-17T01:06:56.737 INFO:tasks.workunit.client.1.smithi143.stdout:7/413: mknod d4/c84 0 2024-09-17T01:06:56.738 INFO:tasks.workunit.client.1.smithi143.stdout:6/236: chown d2/df/d20 25 1 2024-09-17T01:06:56.738 INFO:tasks.workunit.client.1.smithi143.stdout:1/388: fsync d0/d6/d43/d6a/df/d6e/d2/f56 0 2024-09-17T01:06:56.740 INFO:tasks.workunit.client.1.smithi143.stdout:8/322: write d9/de/f10 [1964741,33320] 0 2024-09-17T01:06:56.741 INFO:tasks.workunit.client.1.smithi143.stdout:6/237: unlink d2/f28 0 2024-09-17T01:06:56.743 INFO:tasks.workunit.client.1.smithi143.stdout:7/414: creat d4/d33/d78/f85 x:0 0 0 2024-09-17T01:06:56.745 INFO:tasks.workunit.client.1.smithi143.stdout:8/323: mkdir d9/de/d53/d75 0 2024-09-17T01:06:56.746 INFO:tasks.workunit.client.1.smithi143.stdout:1/389: mknod d0/d6/c81 0 2024-09-17T01:06:56.746 INFO:tasks.workunit.client.1.smithi143.stdout:8/324: stat d9/d12/c1b 0 2024-09-17T01:06:56.747 INFO:tasks.workunit.client.1.smithi143.stdout:1/390: dread - d0/d6/d64/f80 zero size 2024-09-17T01:06:56.748 INFO:tasks.workunit.client.1.smithi143.stdout:8/325: creat d9/d23/d48/f76 x:0 0 0 2024-09-17T01:06:56.750 INFO:tasks.workunit.client.1.smithi143.stdout:8/326: mknod d9/d12/d49/c77 0 2024-09-17T01:06:56.753 INFO:tasks.workunit.client.1.smithi143.stdout:1/391: dwrite d0/d6/d43/d6a/df/f1a [0,4194304] 0 2024-09-17T01:06:56.755 INFO:tasks.workunit.client.1.smithi143.stdout:1/392: creat d0/dc/f82 x:0 0 0 2024-09-17T01:06:56.757 INFO:tasks.workunit.client.1.smithi143.stdout:8/327: dwrite d9/f59 [0,4194304] 0 2024-09-17T01:06:56.758 INFO:tasks.workunit.client.1.smithi143.stdout:8/328: fsync d9/d23/d4f/f6e 0 2024-09-17T01:06:56.758 INFO:tasks.workunit.client.1.smithi143.stdout:1/393: write d0/d6/d43/d6a/df/d6e/d18/f36 [909477,76557] 0 2024-09-17T01:06:56.761 INFO:tasks.workunit.client.1.smithi143.stdout:8/329: stat d9/d23/d48/d55/d57 0 2024-09-17T01:06:56.761 INFO:tasks.workunit.client.1.smithi143.stdout:6/238: unlink d2/d7/f44 0 2024-09-17T01:06:56.761 INFO:tasks.workunit.client.1.smithi143.stdout:1/394: fsync d0/d6/d43/d6a/f62 0 2024-09-17T01:06:56.764 INFO:tasks.workunit.client.1.smithi143.stdout:1/395: creat d0/dc/f83 x:0 0 0 2024-09-17T01:06:56.765 INFO:tasks.workunit.client.1.smithi143.stdout:6/239: mkdir d2/d30/d45 0 2024-09-17T01:06:56.767 INFO:tasks.workunit.client.1.smithi143.stdout:6/240: write d2/df/f43 [888417,14012] 0 2024-09-17T01:06:56.768 INFO:tasks.workunit.client.1.smithi143.stdout:1/396: dread d0/d6/f3a [0,4194304] 0 2024-09-17T01:06:56.768 INFO:tasks.workunit.client.1.smithi143.stdout:6/241: chown d2/df/d18 605700 1 2024-09-17T01:06:56.780 INFO:tasks.workunit.client.1.smithi143.stdout:1/397: dwrite d0/dc/f2c [0,4194304] 0 2024-09-17T01:06:56.784 INFO:tasks.workunit.client.1.smithi143.stdout:4/299: sync 2024-09-17T01:06:56.785 INFO:tasks.workunit.client.1.smithi143.stdout:1/398: rename d0/d6/d43/d6a/df/d6e/d2/d39/f6c to d0/d6/d43/d6a/df/d27/f84 0 2024-09-17T01:06:56.785 INFO:tasks.workunit.client.1.smithi143.stdout:4/300: dread - da/d3a/d40/f5b zero size 2024-09-17T01:06:56.785 INFO:tasks.workunit.client.1.smithi143.stdout:4/301: stat da/fe 0 2024-09-17T01:06:56.786 INFO:tasks.workunit.client.1.smithi143.stdout:1/399: mknod d0/d6/d43/d47/d68/c85 0 2024-09-17T01:06:56.787 INFO:tasks.workunit.client.1.smithi143.stdout:4/302: creat da/d3a/d3e/d5e/f62 x:0 0 0 2024-09-17T01:06:56.789 INFO:tasks.workunit.client.1.smithi143.stdout:1/400: fdatasync d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a 0 2024-09-17T01:06:56.927 INFO:tasks.workunit.client.1.smithi143.stdout:5/363: sync 2024-09-17T01:06:56.927 INFO:tasks.workunit.client.1.smithi143.stdout:5/364: chown d1/d46/df/d1f/d66/c7b 51005 1 2024-09-17T01:06:56.939 INFO:tasks.workunit.client.1.smithi143.stdout:4/303: rmdir da/d3a/d3e/d42/d5f 0 2024-09-17T01:06:56.939 INFO:tasks.workunit.client.1.smithi143.stdout:1/401: link d0/d6/c81 d0/d6/d43/d6a/df/d6e/d2/c86 0 2024-09-17T01:06:56.939 INFO:tasks.workunit.client.1.smithi143.stdout:4/304: stat da/f20 0 2024-09-17T01:06:56.941 INFO:tasks.workunit.client.1.smithi143.stdout:5/365: getdents d1/d46 0 2024-09-17T01:06:56.943 INFO:tasks.workunit.client.1.smithi143.stdout:4/305: mkdir da/d3a/d3e/d5e/d63 0 2024-09-17T01:06:56.945 INFO:tasks.workunit.client.1.smithi143.stdout:5/366: mknod d1/d46/df/c93 0 2024-09-17T01:06:56.946 INFO:tasks.workunit.client.1.smithi143.stdout:1/402: dwrite d0/d6/d43/d6a/df/f1a [0,4194304] 0 2024-09-17T01:06:56.948 INFO:tasks.workunit.client.1.smithi143.stdout:5/367: fdatasync d1/d46/df/d23/f4e 0 2024-09-17T01:06:56.951 INFO:tasks.workunit.client.1.smithi143.stdout:5/368: symlink d1/d46/df/d1f/d7a/l94 0 2024-09-17T01:06:56.954 INFO:tasks.workunit.client.1.smithi143.stdout:5/369: rmdir d1/d46/df/d1f/d66 39 2024-09-17T01:06:56.956 INFO:tasks.workunit.client.1.smithi143.stdout:5/370: mkdir d1/d46/d6e/d95 0 2024-09-17T01:06:56.963 INFO:tasks.workunit.client.1.smithi143.stdout:1/403: dread d0/d6/d43/d6a/df/d27/f2e [0,4194304] 0 2024-09-17T01:06:56.964 INFO:tasks.workunit.client.1.smithi143.stdout:5/371: dwrite d1/d46/f22 [0,4194304] 0 2024-09-17T01:06:56.966 INFO:tasks.workunit.client.1.smithi143.stdout:1/404: stat d0/d6/d43/d6a/df/d6e/d2/f28 0 2024-09-17T01:06:56.966 INFO:tasks.workunit.client.1.smithi143.stdout:5/372: write d1/d46/df/d53/f61 [939301,83984] 0 2024-09-17T01:06:56.968 INFO:tasks.workunit.client.1.smithi143.stdout:1/405: symlink d0/dc/d57/d58/l87 0 2024-09-17T01:06:56.970 INFO:tasks.workunit.client.1.smithi143.stdout:1/406: write d0/dc/f82 [552992,26509] 0 2024-09-17T01:06:56.971 INFO:tasks.workunit.client.1.smithi143.stdout:1/407: dread - d0/dc/f83 zero size 2024-09-17T01:06:56.973 INFO:tasks.workunit.client.1.smithi143.stdout:1/408: write d0/d6/d43/d6a/df/d6e/d2/d39/f5e [1638619,77457] 0 2024-09-17T01:06:56.976 INFO:tasks.workunit.client.1.smithi143.stdout:1/409: mkdir d0/d6/d43/d47/d88 0 2024-09-17T01:06:56.976 INFO:tasks.workunit.client.1.smithi143.stdout:4/306: dread da/d3a/d40/f3c [0,4194304] 0 2024-09-17T01:06:56.979 INFO:tasks.workunit.client.1.smithi143.stdout:8/330: sync 2024-09-17T01:06:56.979 INFO:tasks.workunit.client.1.smithi143.stdout:3/305: sync 2024-09-17T01:06:56.979 INFO:tasks.workunit.client.1.smithi143.stdout:9/284: sync 2024-09-17T01:06:56.979 INFO:tasks.workunit.client.1.smithi143.stdout:7/415: sync 2024-09-17T01:06:56.979 INFO:tasks.workunit.client.1.smithi143.stdout:0/382: sync 2024-09-17T01:06:56.979 INFO:tasks.workunit.client.1.smithi143.stdout:1/410: rename d0/d6/d43/d47/d68/d7b/d7f to d0/dc/d89 0 2024-09-17T01:06:56.980 INFO:tasks.workunit.client.1.smithi143.stdout:6/242: sync 2024-09-17T01:06:56.980 INFO:tasks.workunit.client.1.smithi143.stdout:2/355: sync 2024-09-17T01:06:56.983 INFO:tasks.workunit.client.1.smithi143.stdout:0/383: symlink d3/d14/d3d/l7e 0 2024-09-17T01:06:56.983 INFO:tasks.workunit.client.1.smithi143.stdout:3/306: dread - d6/d1c/d33/d41/d2b/f3d zero size 2024-09-17T01:06:56.985 INFO:tasks.workunit.client.1.smithi143.stdout:1/411: write d0/d6/d43/d6a/f70 [3811374,81544] 0 2024-09-17T01:06:56.985 INFO:tasks.workunit.client.1.smithi143.stdout:9/285: creat d3/d16/d2b/d9/f60 x:0 0 0 2024-09-17T01:06:56.986 INFO:tasks.workunit.client.1.smithi143.stdout:7/416: mkdir d4/d1f/d4a/d66/d86 0 2024-09-17T01:06:56.989 INFO:tasks.workunit.client.1.smithi143.stdout:6/243: truncate d2/d17/f25 8322 0 2024-09-17T01:06:56.989 INFO:tasks.workunit.client.1.smithi143.stdout:0/384: rmdir d3/d5/d8/d27 39 2024-09-17T01:06:57.027 INFO:tasks.workunit.client.1.smithi143.stdout:1/412: creat d0/dc/d74/f8a x:0 0 0 2024-09-17T01:06:57.027 INFO:tasks.workunit.client.1.smithi143.stdout:7/417: stat d4/d1f/d29/f81 0 2024-09-17T01:06:57.027 INFO:tasks.workunit.client.1.smithi143.stdout:9/286: chown d3/d16/d34/c4e 1 1 2024-09-17T01:06:57.027 INFO:tasks.workunit.client.1.smithi143.stdout:4/307: dwrite da/d3a/d3e/d5e/f53 [0,4194304] 0 2024-09-17T01:06:57.031 INFO:tasks.workunit.client.1.smithi143.stdout:9/287: mknod d3/d39/c61 0 2024-09-17T01:06:57.032 INFO:tasks.workunit.client.1.smithi143.stdout:6/244: write d2/d7/d26/f3b [795011,128339] 0 2024-09-17T01:06:57.033 INFO:tasks.workunit.client.1.smithi143.stdout:1/413: rmdir d0/d6/d43/d6a/d52 39 2024-09-17T01:06:57.033 INFO:tasks.workunit.client.1.smithi143.stdout:4/308: fdatasync da/d3a/d40/f37 0 2024-09-17T01:06:57.034 INFO:tasks.workunit.client.1.smithi143.stdout:0/385: creat d3/d5/d8/d58/f7f x:0 0 0 2024-09-17T01:06:57.037 INFO:tasks.workunit.client.1.smithi143.stdout:7/418: creat d4/d33/d78/f87 x:0 0 0 2024-09-17T01:06:57.037 INFO:tasks.workunit.client.1.smithi143.stdout:4/309: symlink da/d3a/d3e/d4a/l64 0 2024-09-17T01:06:57.039 INFO:tasks.workunit.client.1.smithi143.stdout:8/331: dwrite f7 [0,4194304] 0 2024-09-17T01:06:57.039 INFO:tasks.workunit.client.1.smithi143.stdout:9/288: readlink d3/d16/d3e/d51/d52/l57 0 2024-09-17T01:06:57.040 INFO:tasks.workunit.client.1.smithi143.stdout:2/356: dwrite d0/d2/d21/f2c [0,4194304] 0 2024-09-17T01:06:57.042 INFO:tasks.workunit.client.1.smithi143.stdout:0/386: rename d3/d14/l2d to d3/l80 0 2024-09-17T01:06:57.042 INFO:tasks.workunit.client.1.smithi143.stdout:4/310: dread - da/d3a/d3e/d42/f4b zero size 2024-09-17T01:06:57.042 INFO:tasks.workunit.client.1.smithi143.stdout:1/414: mkdir d0/d6/d43/d6d/d8b 0 2024-09-17T01:06:57.049 INFO:tasks.workunit.client.1.smithi143.stdout:9/289: chown d3/c3f 5876 1 2024-09-17T01:06:57.049 INFO:tasks.workunit.client.1.smithi143.stdout:1/415: fsync d0/d6/d43/f67 0 2024-09-17T01:06:57.050 INFO:tasks.workunit.client.1.smithi143.stdout:4/311: chown da/d3a/d40/l3d 8 1 2024-09-17T01:06:57.051 INFO:tasks.workunit.client.1.smithi143.stdout:0/387: unlink d3/d5/d35/c36 0 2024-09-17T01:06:57.053 INFO:tasks.workunit.client.1.smithi143.stdout:6/245: write d2/df/d40/f42 [2726906,7074] 0 2024-09-17T01:06:57.056 INFO:tasks.workunit.client.1.smithi143.stdout:9/290: truncate d3/d16/d2b/d9/f1a 688702 0 2024-09-17T01:06:57.057 INFO:tasks.workunit.client.1.smithi143.stdout:8/332: dwrite d9/de/f6f [0,4194304] 0 2024-09-17T01:06:57.059 INFO:tasks.workunit.client.1.smithi143.stdout:0/388: write d3/d5/d8/d21/f26 [3750064,55443] 0 2024-09-17T01:06:57.061 INFO:tasks.workunit.client.1.smithi143.stdout:7/419: dwrite d4/d1f/f23 [4194304,4194304] 0 2024-09-17T01:06:57.061 INFO:tasks.workunit.client.1.smithi143.stdout:9/291: creat d3/d39/d42/d58/d5a/f62 x:0 0 0 2024-09-17T01:06:57.062 INFO:tasks.workunit.client.1.smithi143.stdout:8/333: creat d9/d2b/f78 x:0 0 0 2024-09-17T01:06:57.063 INFO:tasks.workunit.client.1.smithi143.stdout:7/420: mknod d4/d1f/c88 0 2024-09-17T01:06:57.063 INFO:tasks.workunit.client.1.smithi143.stdout:0/389: mknod d3/d5/d8/d10/c81 0 2024-09-17T01:06:57.066 INFO:tasks.workunit.client.1.smithi143.stdout:7/421: creat d4/d1f/d4a/f89 x:0 0 0 2024-09-17T01:06:57.067 INFO:tasks.workunit.client.1.smithi143.stdout:8/334: rename d9/d12/d4b/d3f/d72 to d9/d12/d38/d58/d79 0 2024-09-17T01:06:57.068 INFO:tasks.workunit.client.1.smithi143.stdout:0/390: write d3/d14/d3d/f76 [1021941,108818] 0 2024-09-17T01:06:57.071 INFO:tasks.workunit.client.1.smithi143.stdout:7/422: write d4/d33/f3f [678076,94330] 0 2024-09-17T01:06:57.072 INFO:tasks.workunit.client.1.smithi143.stdout:6/246: write d2/fa [31126,128052] 0 2024-09-17T01:06:57.073 INFO:tasks.workunit.client.1.smithi143.stdout:8/335: mkdir d9/d12/d38/d7a 0 2024-09-17T01:06:57.076 INFO:tasks.workunit.client.1.smithi143.stdout:9/292: dwrite d3/d39/f4b [0,4194304] 0 2024-09-17T01:06:57.078 INFO:tasks.workunit.client.1.smithi143.stdout:0/391: creat d3/d5/d8/d27/f82 x:0 0 0 2024-09-17T01:06:57.078 INFO:tasks.workunit.client.1.smithi143.stdout:9/293: stat d3/d16/c31 0 2024-09-17T01:06:57.079 INFO:tasks.workunit.client.1.smithi143.stdout:8/336: readlink d9/d12/l34 0 2024-09-17T01:06:57.079 INFO:tasks.workunit.client.1.smithi143.stdout:6/247: mkdir d2/d7/d26/d46 0 2024-09-17T01:06:57.081 INFO:tasks.workunit.client.1.smithi143.stdout:8/337: rmdir d9/d23/d32 39 2024-09-17T01:06:57.084 INFO:tasks.workunit.client.1.smithi143.stdout:9/294: creat d3/d16/d3e/d51/f63 x:0 0 0 2024-09-17T01:06:57.085 INFO:tasks.workunit.client.1.smithi143.stdout:6/248: chown d2/df/d20/d2c/f22 102 1 2024-09-17T01:06:57.087 INFO:tasks.workunit.client.1.smithi143.stdout:4/312: dwrite da/d3a/d40/f36 [0,4194304] 0 2024-09-17T01:06:57.088 INFO:tasks.workunit.client.1.smithi143.stdout:2/357: dread d0/d10/d56/f66 [0,4194304] 0 2024-09-17T01:06:57.090 INFO:tasks.workunit.client.1.smithi143.stdout:7/423: dwrite d4/f1b [4194304,4194304] 0 2024-09-17T01:06:57.090 INFO:tasks.workunit.client.1.smithi143.stdout:8/338: write d9/d23/d48/f76 [956011,52332] 0 2024-09-17T01:06:57.090 INFO:tasks.workunit.client.1.smithi143.stdout:9/295: write d3/d3d/d48/f59 [80044,109382] 0 2024-09-17T01:06:57.090 INFO:tasks.workunit.client.1.smithi143.stdout:0/392: link d3/d5/d8/d10/f2a d3/d14/d3d/f83 0 2024-09-17T01:06:57.093 INFO:tasks.workunit.client.1.smithi143.stdout:7/424: chown d4/d16/f17 8 1 2024-09-17T01:06:57.094 INFO:tasks.workunit.client.1.smithi143.stdout:6/249: mkdir d2/d17/d3a/d47 0 2024-09-17T01:06:57.094 INFO:tasks.workunit.client.1.smithi143.stdout:7/425: readlink d4/d26/l2c 0 2024-09-17T01:06:57.098 INFO:tasks.workunit.client.1.smithi143.stdout:2/358: creat d0/d10/d56/f6d x:0 0 0 2024-09-17T01:06:57.098 INFO:tasks.workunit.client.1.smithi143.stdout:0/393: chown d3/d5/d8/d27/d31/d48/f5e 79604096 1 2024-09-17T01:06:57.098 INFO:tasks.workunit.client.1.smithi143.stdout:4/313: write da/d3a/d3e/d5e/f62 [497615,31876] 0 2024-09-17T01:06:57.099 INFO:tasks.workunit.client.1.smithi143.stdout:9/296: mknod d3/d3d/c64 0 2024-09-17T01:06:57.099 INFO:tasks.workunit.client.1.smithi143.stdout:8/339: read d9/d12/d13/f5d [62766,65460] 0 2024-09-17T01:06:57.099 INFO:tasks.workunit.client.1.smithi143.stdout:6/250: truncate d2/df/f2e 4563232 0 2024-09-17T01:06:57.106 INFO:tasks.workunit.client.1.smithi143.stdout:9/297: symlink d3/d16/d3e/l65 0 2024-09-17T01:06:57.106 INFO:tasks.workunit.client.1.smithi143.stdout:4/314: rmdir da/d3a/d3e/d4a 39 2024-09-17T01:06:57.108 INFO:tasks.workunit.client.1.smithi143.stdout:0/394: creat d3/d5/f84 x:0 0 0 2024-09-17T01:06:57.108 INFO:tasks.workunit.client.1.smithi143.stdout:7/426: dread d4/d26/f2d [0,4194304] 0 2024-09-17T01:06:57.109 INFO:tasks.workunit.client.1.smithi143.stdout:5/373: sync 2024-09-17T01:06:57.109 INFO:tasks.workunit.client.1.smithi143.stdout:3/307: sync 2024-09-17T01:06:57.112 INFO:tasks.workunit.client.1.smithi143.stdout:8/340: creat d9/d12/d38/d7a/f7b x:0 0 0 2024-09-17T01:06:57.112 INFO:tasks.workunit.client.1.smithi143.stdout:4/315: rename da to da/d3a/d3e/d65 22 2024-09-17T01:06:57.113 INFO:tasks.workunit.client.1.smithi143.stdout:9/298: creat d3/d16/d2b/d9/f66 x:0 0 0 2024-09-17T01:06:57.115 INFO:tasks.workunit.client.1.smithi143.stdout:8/341: chown d9/d12/d13/f33 113 1 2024-09-17T01:06:57.115 INFO:tasks.workunit.client.1.smithi143.stdout:5/374: mkdir d1/d96 0 2024-09-17T01:06:57.116 INFO:tasks.workunit.client.1.smithi143.stdout:7/427: creat d4/d26/f8a x:0 0 0 2024-09-17T01:06:57.116 INFO:tasks.workunit.client.1.smithi143.stdout:3/308: rename d6/d1c/d33/d41 to d6/d1c/d33/d41/d2e/d5b 22 2024-09-17T01:06:57.117 INFO:tasks.workunit.client.1.smithi143.stdout:4/316: symlink da/l66 0 2024-09-17T01:06:57.119 INFO:tasks.workunit.client.1.smithi143.stdout:8/342: mkdir d9/d12/d13/d7c 0 2024-09-17T01:06:57.119 INFO:tasks.workunit.client.1.smithi143.stdout:7/428: chown d4/d33/d78/f85 224865 1 2024-09-17T01:06:57.119 INFO:tasks.workunit.client.1.smithi143.stdout:3/309: read d6/d1c/d33/d41/f11 [331185,89077] 0 2024-09-17T01:06:57.119 INFO:tasks.workunit.client.1.smithi143.stdout:0/395: mkdir d3/d5/d8/d27/d31/d85 0 2024-09-17T01:06:57.120 INFO:tasks.workunit.client.1.smithi143.stdout:5/375: write d1/d46/df/f45 [179174,129432] 0 2024-09-17T01:06:57.122 INFO:tasks.workunit.client.1.smithi143.stdout:4/317: readlink da/d3a/d40/l35 0 2024-09-17T01:06:57.123 INFO:tasks.workunit.client.1.smithi143.stdout:7/429: chown d4/d1f/d29/d65/f6e 3932849 1 2024-09-17T01:06:57.123 INFO:tasks.workunit.client.1.smithi143.stdout:8/343: write d9/d12/d38/d58/d70/f71 [981811,38282] 0 2024-09-17T01:06:57.124 INFO:tasks.workunit.client.1.smithi143.stdout:3/310: mkdir d6/d1c/d33/d3f/d5c 0 2024-09-17T01:06:57.125 INFO:tasks.workunit.client.1.smithi143.stdout:8/344: fsync d9/d26/f74 0 2024-09-17T01:06:57.126 INFO:tasks.workunit.client.1.smithi143.stdout:5/376: mknod d1/d46/df/d23/d4f/d7d/c97 0 2024-09-17T01:06:57.127 INFO:tasks.workunit.client.1.smithi143.stdout:0/396: mknod d3/d14/c86 0 2024-09-17T01:06:57.127 INFO:tasks.workunit.client.1.smithi143.stdout:2/359: dread d0/d2/fb [4194304,4194304] 0 2024-09-17T01:06:57.129 INFO:tasks.workunit.client.1.smithi143.stdout:7/430: creat d4/d1f/f8b x:0 0 0 2024-09-17T01:06:57.129 INFO:tasks.workunit.client.1.smithi143.stdout:4/318: mkdir da/d3a/d3e/d42/d67 0 2024-09-17T01:06:57.130 INFO:tasks.workunit.client.1.smithi143.stdout:8/345: mkdir d9/d23/d48/d56/d66/d7d 0 2024-09-17T01:06:57.131 INFO:tasks.workunit.client.1.smithi143.stdout:0/397: write d3/d5/d8/d21/f55 [941222,130465] 0 2024-09-17T01:06:57.133 INFO:tasks.workunit.client.1.smithi143.stdout:4/319: fsync da/d3a/d40/f5b 0 2024-09-17T01:06:57.134 INFO:tasks.workunit.client.1.smithi143.stdout:2/360: write d0/d44/f61 [316446,74319] 0 2024-09-17T01:06:57.134 INFO:tasks.workunit.client.1.smithi143.stdout:5/377: dread d1/d46/df/d53/f56 [0,4194304] 0 2024-09-17T01:06:57.135 INFO:tasks.workunit.client.1.smithi143.stdout:7/431: chown d4/d1f/d4a/l7a 11 1 2024-09-17T01:06:57.136 INFO:tasks.workunit.client.1.smithi143.stdout:3/311: dwrite d6/fa [0,4194304] 0 2024-09-17T01:06:57.137 INFO:tasks.workunit.client.1.smithi143.stdout:8/346: creat d9/d12/d49/f7e x:0 0 0 2024-09-17T01:06:57.137 INFO:tasks.workunit.client.1.smithi143.stdout:4/320: fdatasync da/d3a/f3b 0 2024-09-17T01:06:57.139 INFO:tasks.workunit.client.1.smithi143.stdout:9/299: truncate d3/d16/f1d 4383745 0 2024-09-17T01:06:57.140 INFO:tasks.workunit.client.1.smithi143.stdout:2/361: rmdir d0/d44 39 2024-09-17T01:06:57.142 INFO:tasks.workunit.client.1.smithi143.stdout:6/251: dread d2/f1f [0,4194304] 0 2024-09-17T01:06:57.142 INFO:tasks.workunit.client.1.smithi143.stdout:7/432: unlink d4/d26/f74 0 2024-09-17T01:06:57.143 INFO:tasks.workunit.client.1.smithi143.stdout:3/312: mkdir d6/d1c/d33/d5d 0 2024-09-17T01:06:57.144 INFO:tasks.workunit.client.1.smithi143.stdout:0/398: rename d3/d5/d8/c16 to d3/d5/d8/d27/d31/d4c/c87 0 2024-09-17T01:06:57.145 INFO:tasks.workunit.client.1.smithi143.stdout:8/347: creat d9/d12/d38/f7f x:0 0 0 2024-09-17T01:06:57.145 INFO:tasks.workunit.client.1.smithi143.stdout:0/399: chown d3/d5/d8/d27 12720738 1 2024-09-17T01:06:57.146 INFO:tasks.workunit.client.1.smithi143.stdout:9/300: rmdir d3/d16/d3e/d51 39 2024-09-17T01:06:57.150 INFO:tasks.workunit.client.1.smithi143.stdout:3/313: creat d6/d1c/d33/f5e x:0 0 0 2024-09-17T01:06:57.152 INFO:tasks.workunit.client.1.smithi143.stdout:5/378: rename d1/d46/df/f54 to d1/d46/df/d23/d4f/d7d/f98 0 2024-09-17T01:06:57.152 INFO:tasks.workunit.client.1.smithi143.stdout:1/416: sync 2024-09-17T01:06:57.153 INFO:tasks.workunit.client.1.smithi143.stdout:3/314: stat d6/d1c/d33/f38 0 2024-09-17T01:06:57.153 INFO:tasks.workunit.client.1.smithi143.stdout:0/400: mkdir d3/d88 0 2024-09-17T01:06:57.154 INFO:tasks.workunit.client.1.smithi143.stdout:4/321: dwrite da/f2a [0,4194304] 0 2024-09-17T01:06:57.157 INFO:tasks.workunit.client.1.smithi143.stdout:9/301: truncate d3/d16/d2b/d9/f11 374454 0 2024-09-17T01:06:57.158 INFO:tasks.workunit.client.1.smithi143.stdout:7/433: dwrite d4/d1f/d29/f34 [0,4194304] 0 2024-09-17T01:06:57.158 INFO:tasks.workunit.client.1.smithi143.stdout:8/348: write d9/d12/d4b/f37 [891764,78391] 0 2024-09-17T01:06:57.160 INFO:tasks.workunit.client.1.smithi143.stdout:3/315: symlink d6/d1c/d33/d41/l5f 0 2024-09-17T01:06:57.166 INFO:tasks.workunit.client.1.smithi143.stdout:7/434: stat d4/d1f/d4a/d66/d86 0 2024-09-17T01:06:57.166 INFO:tasks.workunit.client.1.smithi143.stdout:9/302: read d3/d16/d2b/fb [3113959,93467] 0 2024-09-17T01:06:57.168 INFO:tasks.workunit.client.1.smithi143.stdout:5/379: write d1/d46/df/d23/d4f/d7d/f98 [1038034,56578] 0 2024-09-17T01:06:57.173 INFO:tasks.workunit.client.1.smithi143.stdout:3/316: chown d6/d1c/d33/d41/d2b/f45 256441211 1 2024-09-17T01:06:57.173 INFO:tasks.workunit.client.1.smithi143.stdout:2/362: rename d0/d2/d21/d22/d24/f43 to d0/f6e 0 2024-09-17T01:06:57.175 INFO:tasks.workunit.client.1.smithi143.stdout:1/417: link d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a d0/d6/d43/d6a/df/f8c 0 2024-09-17T01:06:57.175 INFO:tasks.workunit.client.1.smithi143.stdout:8/349: symlink d9/d12/d13/d73/l80 0 2024-09-17T01:06:57.176 INFO:tasks.workunit.client.1.smithi143.stdout:6/252: dread d2/df/d18/f21 [0,4194304] 0 2024-09-17T01:06:57.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/401: dwrite d3/d5/f29 [0,4194304] 0 2024-09-17T01:06:57.180 INFO:tasks.workunit.client.1.smithi143.stdout:5/380: rename d1/d46/c44 to d1/d46/df/d53/c99 0 2024-09-17T01:06:57.181 INFO:tasks.workunit.client.1.smithi143.stdout:4/322: dwrite da/d3a/f51 [0,4194304] 0 2024-09-17T01:06:57.183 INFO:tasks.workunit.client.1.smithi143.stdout:9/303: truncate d3/d16/d3e/d51/f63 883836 0 2024-09-17T01:06:57.183 INFO:tasks.workunit.client.1.smithi143.stdout:0/402: chown d3/d14/d3d 6 1 2024-09-17T01:06:57.186 INFO:tasks.workunit.client.1.smithi143.stdout:4/323: fsync da/d3a/d3e/d5e/f53 0 2024-09-17T01:06:57.186 INFO:tasks.workunit.client.1.smithi143.stdout:2/363: symlink d0/d44/l6f 0 2024-09-17T01:06:57.188 INFO:tasks.workunit.client.1.smithi143.stdout:6/253: creat d2/d7/d26/f48 x:0 0 0 2024-09-17T01:06:57.189 INFO:tasks.workunit.client.1.smithi143.stdout:7/435: dwrite d4/d26/f8a [0,4194304] 0 2024-09-17T01:06:57.189 INFO:tasks.workunit.client.1.smithi143.stdout:8/350: creat d9/d12/d4b/d3f/f81 x:0 0 0 2024-09-17T01:06:57.191 INFO:tasks.workunit.client.1.smithi143.stdout:0/403: chown d3/d5/d8/d27/d31/d4c/d65 10 1 2024-09-17T01:06:57.195 INFO:tasks.workunit.client.1.smithi143.stdout:9/304: creat d3/d16/d34/f67 x:0 0 0 2024-09-17T01:06:57.197 INFO:tasks.workunit.client.1.smithi143.stdout:7/436: write d4/d1f/f8b [757471,8879] 0 2024-09-17T01:06:57.203 INFO:tasks.workunit.client.1.smithi143.stdout:1/418: dwrite d0/dc/d57/f5d [0,4194304] 0 2024-09-17T01:06:57.205 INFO:tasks.workunit.client.1.smithi143.stdout:8/351: symlink d9/d23/d32/l82 0 2024-09-17T01:06:57.205 INFO:tasks.workunit.client.1.smithi143.stdout:3/317: dwrite d6/d1c/d33/d41/f11 [0,4194304] 0 2024-09-17T01:06:57.206 INFO:tasks.workunit.client.1.smithi143.stdout:4/324: rename da/d3a/d3e/d49 to da/d68 0 2024-09-17T01:06:57.207 INFO:tasks.workunit.client.1.smithi143.stdout:9/305: mkdir d3/d39/d42/d58/d5a/d68 0 2024-09-17T01:06:57.208 INFO:tasks.workunit.client.1.smithi143.stdout:5/381: mkdir d1/d46/df/d53/d74/d9a 0 2024-09-17T01:06:57.208 INFO:tasks.workunit.client.1.smithi143.stdout:7/437: rename d4/d1f/d4a/l7a to d4/d1f/d4a/l8c 0 2024-09-17T01:06:57.209 INFO:tasks.workunit.client.1.smithi143.stdout:8/352: symlink d9/d12/d13/l83 0 2024-09-17T01:06:57.212 INFO:tasks.workunit.client.1.smithi143.stdout:1/419: creat d0/dc/d57/f8d x:0 0 0 2024-09-17T01:06:57.212 INFO:tasks.workunit.client.1.smithi143.stdout:5/382: chown d1/d46/df/d1f/f30 39417350 1 2024-09-17T01:06:57.212 INFO:tasks.workunit.client.1.smithi143.stdout:3/318: mkdir d6/d1c/d33/d41/d60 0 2024-09-17T01:06:57.215 INFO:tasks.workunit.client.1.smithi143.stdout:1/420: chown d0/l24 0 1 2024-09-17T01:06:57.215 INFO:tasks.workunit.client.1.smithi143.stdout:8/353: chown d9/d26/f3e 1286 1 2024-09-17T01:06:57.215 INFO:tasks.workunit.client.1.smithi143.stdout:0/404: dread d3/d5/d8/d21/f30 [0,4194304] 0 2024-09-17T01:06:57.216 INFO:tasks.workunit.client.1.smithi143.stdout:9/306: write d3/d16/d2b/d9/f5c [3409844,39707] 0 2024-09-17T01:06:57.216 INFO:tasks.workunit.client.1.smithi143.stdout:5/383: write d1/d46/df/f25 [3449835,127823] 0 2024-09-17T01:06:57.218 INFO:tasks.workunit.client.1.smithi143.stdout:3/319: chown d6/d1c/d33/d41/d2e 58862 1 2024-09-17T01:06:57.221 INFO:tasks.workunit.client.1.smithi143.stdout:6/254: truncate d2/f5 2743189 0 2024-09-17T01:06:57.221 INFO:tasks.workunit.client.1.smithi143.stdout:9/307: creat d3/d16/d2b/d26/f69 x:0 0 0 2024-09-17T01:06:57.224 INFO:tasks.workunit.client.1.smithi143.stdout:5/384: write d1/d46/df/d1f/d66/f6c [594816,73293] 0 2024-09-17T01:06:57.224 INFO:tasks.workunit.client.1.smithi143.stdout:9/308: fdatasync d3/d16/d34/f36 0 2024-09-17T01:06:57.225 INFO:tasks.workunit.client.1.smithi143.stdout:0/405: rename d3/d5/d35/f3f to d3/d5/d35/f89 0 2024-09-17T01:06:57.225 INFO:tasks.workunit.client.1.smithi143.stdout:4/325: creat da/d3a/d3e/d42/f69 x:0 0 0 2024-09-17T01:06:57.225 INFO:tasks.workunit.client.1.smithi143.stdout:6/255: mknod d2/df/d40/c49 0 2024-09-17T01:06:57.227 INFO:tasks.workunit.client.1.smithi143.stdout:8/354: rename d9/d12/d49 to d9/d84 0 2024-09-17T01:06:57.228 INFO:tasks.workunit.client.1.smithi143.stdout:0/406: write d3/d5/d8/d10/f25 [1991601,96826] 0 2024-09-17T01:06:57.230 INFO:tasks.workunit.client.1.smithi143.stdout:3/320: getdents d6/d1c/d4d 0 2024-09-17T01:06:57.232 INFO:tasks.workunit.client.1.smithi143.stdout:8/355: creat d9/d2b/f85 x:0 0 0 2024-09-17T01:06:57.232 INFO:tasks.workunit.client.1.smithi143.stdout:4/326: read da/f2d [2043495,47517] 0 2024-09-17T01:06:57.234 INFO:tasks.workunit.client.1.smithi143.stdout:4/327: fsync da/d3a/d40/f39 0 2024-09-17T01:06:57.235 INFO:tasks.workunit.client.1.smithi143.stdout:2/364: dread d0/d2/d21/d22/f2d [0,4194304] 0 2024-09-17T01:06:57.236 INFO:tasks.workunit.client.1.smithi143.stdout:8/356: dread d9/d12/d13/f5d [0,4194304] 0 2024-09-17T01:06:57.236 INFO:tasks.workunit.client.1.smithi143.stdout:6/256: mkdir d2/d30/d45/d4a 0 2024-09-17T01:06:57.238 INFO:tasks.workunit.client.1.smithi143.stdout:3/321: creat d6/d1c/d33/d41/d2e/f61 x:0 0 0 2024-09-17T01:06:57.239 INFO:tasks.workunit.client.1.smithi143.stdout:7/438: truncate d4/d26/f8a 526633 0 2024-09-17T01:06:57.240 INFO:tasks.workunit.client.1.smithi143.stdout:2/365: mknod d0/d10/d58/c70 0 2024-09-17T01:06:57.242 INFO:tasks.workunit.client.1.smithi143.stdout:9/309: getdents d3/d39/d42/d58/d5a 0 2024-09-17T01:06:57.242 INFO:tasks.workunit.client.1.smithi143.stdout:3/322: mkdir d6/d1c/d4b/d62 0 2024-09-17T01:06:57.244 INFO:tasks.workunit.client.1.smithi143.stdout:2/366: dread d0/d2/d21/f62 [0,4194304] 0 2024-09-17T01:06:57.244 INFO:tasks.workunit.client.1.smithi143.stdout:4/328: unlink da/d3a/d3e/d4a/l64 0 2024-09-17T01:06:57.246 INFO:tasks.workunit.client.1.smithi143.stdout:7/439: read d4/d1f/f30 [79034,30830] 0 2024-09-17T01:06:57.247 INFO:tasks.workunit.client.1.smithi143.stdout:1/421: dwrite d0/d6/d43/d6a/df/d6e/d2/f2a [0,4194304] 0 2024-09-17T01:06:57.248 INFO:tasks.workunit.client.1.smithi143.stdout:3/323: write d6/d1c/d33/d41/d42/f4c [506307,102024] 0 2024-09-17T01:06:57.250 INFO:tasks.workunit.client.1.smithi143.stdout:8/357: link d9/d2b/f85 d9/de/d53/d75/f86 0 2024-09-17T01:06:57.250 INFO:tasks.workunit.client.1.smithi143.stdout:9/310: unlink d3/d16/d34/f3a 0 2024-09-17T01:06:57.251 INFO:tasks.workunit.client.1.smithi143.stdout:1/422: read d0/d6/f20 [442732,22883] 0 2024-09-17T01:06:57.252 INFO:tasks.workunit.client.1.smithi143.stdout:0/407: getdents d3/d5/d8/d21 0 2024-09-17T01:06:57.253 INFO:tasks.workunit.client.1.smithi143.stdout:0/408: chown d3/d5/f52 1074688249 1 2024-09-17T01:06:57.256 INFO:tasks.workunit.client.1.smithi143.stdout:6/257: rename d2/d7/f8 to d2/d7/d26/d46/f4b 0 2024-09-17T01:06:57.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:57 smithi143 ceph-mon[35452]: pgmap v9: 65 pgs: 65 active+clean; 764 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s rd, 89 MiB/s wr, 277 op/s 2024-09-17T01:06:57.257 INFO:tasks.workunit.client.1.smithi143.stdout:6/258: chown d2 16086522 1 2024-09-17T01:06:57.260 INFO:tasks.workunit.client.1.smithi143.stdout:2/367: mkdir d0/d10/d58/d5a/d5b/d4c/d71 0 2024-09-17T01:06:57.260 INFO:tasks.workunit.client.1.smithi143.stdout:3/324: chown d6/c25 803282063 1 2024-09-17T01:06:57.260 INFO:tasks.workunit.client.1.smithi143.stdout:4/329: mkdir da/d68/d61/d6a 0 2024-09-17T01:06:57.260 INFO:tasks.workunit.client.1.smithi143.stdout:8/358: readlink d9/d26/l62 0 2024-09-17T01:06:57.261 INFO:tasks.workunit.client.1.smithi143.stdout:1/423: dwrite d0/dc/d57/f7d [0,4194304] 0 2024-09-17T01:06:57.262 INFO:tasks.workunit.client.1.smithi143.stdout:9/311: rename d3/d16/d2b to d3/d39/d6a 0 2024-09-17T01:06:57.263 INFO:tasks.workunit.client.1.smithi143.stdout:0/409: getdents d3/d88 0 2024-09-17T01:06:57.266 INFO:tasks.workunit.client.1.smithi143.stdout:6/259: creat d2/df/d40/d41/f4c x:0 0 0 2024-09-17T01:06:57.266 INFO:tasks.workunit.client.1.smithi143.stdout:9/312: stat d3/d16/c18 0 2024-09-17T01:06:57.268 INFO:tasks.workunit.client.1.smithi143.stdout:0/410: dread - d3/d5/d8/f44 zero size 2024-09-17T01:06:57.269 INFO:tasks.workunit.client.1.smithi143.stdout:9/313: rmdir d3/d3d/d48 39 2024-09-17T01:06:57.271 INFO:tasks.workunit.client.1.smithi143.stdout:9/314: stat d3/d16/l19 0 2024-09-17T01:06:57.271 INFO:tasks.workunit.client.1.smithi143.stdout:1/424: symlink d0/d6/d43/d6a/df/d6e/d18/d4d/l8e 0 2024-09-17T01:06:57.272 INFO:tasks.workunit.client.1.smithi143.stdout:0/411: chown d3/d5/d8/d27/d31/d4c 1343918 1 2024-09-17T01:06:57.273 INFO:tasks.workunit.client.1.smithi143.stdout:3/325: dwrite d6/d1c/d33/d41/d42/f4c [0,4194304] 0 2024-09-17T01:06:57.274 INFO:tasks.workunit.client.1.smithi143.stdout:6/260: write d2/f1f [4623970,55415] 0 2024-09-17T01:06:57.275 INFO:tasks.workunit.client.1.smithi143.stdout:7/440: stat d4/d26/f8a 0 2024-09-17T01:06:57.278 INFO:tasks.workunit.client.1.smithi143.stdout:6/261: chown d2/df/d20/d2c 109 1 2024-09-17T01:06:57.281 INFO:tasks.workunit.client.1.smithi143.stdout:7/441: rmdir d4/d1f/d4a/d66 39 2024-09-17T01:06:57.282 INFO:tasks.workunit.client.1.smithi143.stdout:1/425: mkdir d0/d6/d43/d6a/d8f 0 2024-09-17T01:06:57.282 INFO:tasks.workunit.client.1.smithi143.stdout:8/359: write d9/fa [259388,77343] 0 2024-09-17T01:06:57.283 INFO:tasks.workunit.client.1.smithi143.stdout:9/315: link d3/d39/f53 d3/d39/d6a/d9/f6b 0 2024-09-17T01:06:57.283 INFO:tasks.workunit.client.1.smithi143.stdout:6/262: creat d2/d30/d45/f4d x:0 0 0 2024-09-17T01:06:57.284 INFO:tasks.workunit.client.1.smithi143.stdout:2/368: truncate d0/d2/d21/d22/f28 57500 0 2024-09-17T01:06:57.287 INFO:tasks.workunit.client.1.smithi143.stdout:3/326: dread d6/fa [0,4194304] 0 2024-09-17T01:06:57.288 INFO:tasks.workunit.client.1.smithi143.stdout:2/369: chown d0/d10/f34 53513314 1 2024-09-17T01:06:57.288 INFO:tasks.workunit.client.1.smithi143.stdout:9/316: stat d3/d39/d42/f54 0 2024-09-17T01:06:57.288 INFO:tasks.workunit.client.1.smithi143.stdout:7/442: symlink d4/d1f/d4a/l8d 0 2024-09-17T01:06:57.289 INFO:tasks.workunit.client.1.smithi143.stdout:6/263: fdatasync d2/d7/d26/f32 0 2024-09-17T01:06:57.290 INFO:tasks.workunit.client.1.smithi143.stdout:0/412: dwrite d3/d5/d8/d21/f3e [0,4194304] 0 2024-09-17T01:06:57.290 INFO:tasks.workunit.client.1.smithi143.stdout:8/360: mknod d9/d23/d48/d56/d66/d7d/c87 0 2024-09-17T01:06:57.292 INFO:tasks.workunit.client.1.smithi143.stdout:8/361: chown d9/d2b 1130475 1 2024-09-17T01:06:57.294 INFO:tasks.workunit.client.1.smithi143.stdout:8/362: fsync d9/d12/d38/f64 0 2024-09-17T01:06:57.294 INFO:tasks.workunit.client.1.smithi143.stdout:1/426: rename d0/d6/d43/d6a/f62 to d0/d6/d43/d6a/df/d6e/d18/d2d/d78/f90 0 2024-09-17T01:06:57.295 INFO:tasks.workunit.client.1.smithi143.stdout:3/327: getdents d6/d1c/d33/d5d 0 2024-09-17T01:06:57.296 INFO:tasks.workunit.client.1.smithi143.stdout:0/413: mknod d3/d5/d8/d21/c8a 0 2024-09-17T01:06:57.296 INFO:tasks.workunit.client.1.smithi143.stdout:1/427: fdatasync d0/d6/d43/d6a/df/d6e/d2/f5b 0 2024-09-17T01:06:57.296 INFO:tasks.workunit.client.1.smithi143.stdout:3/328: fdatasync d6/d1c/d33/d41/d2e/f61 0 2024-09-17T01:06:57.299 INFO:tasks.workunit.client.1.smithi143.stdout:4/330: dread da/f32 [0,4194304] 0 2024-09-17T01:06:57.302 INFO:tasks.workunit.client.1.smithi143.stdout:8/363: rmdir d9/d12/d4b 39 2024-09-17T01:06:57.306 INFO:tasks.workunit.client.1.smithi143.stdout:9/317: link d3/d39/d6a/d9/f60 d3/d39/d6a/d9/d55/f6c 0 2024-09-17T01:06:57.308 INFO:tasks.workunit.client.1.smithi143.stdout:8/364: read - d9/d2b/f85 zero size 2024-09-17T01:06:57.310 INFO:tasks.workunit.client.1.smithi143.stdout:1/428: symlink d0/d6/d43/d6a/d52/l91 0 2024-09-17T01:06:57.310 INFO:tasks.workunit.client.1.smithi143.stdout:0/414: mknod d3/d5/d8/d27/d31/d48/d72/c8b 0 2024-09-17T01:06:57.312 INFO:tasks.workunit.client.1.smithi143.stdout:3/329: link d6/d1c/d33/d41/d42/f4c d6/d1c/d33/d41/d42/f63 0 2024-09-17T01:06:57.313 INFO:tasks.workunit.client.1.smithi143.stdout:3/330: chown d6/d1c/d33/d41/f16 2932 1 2024-09-17T01:06:57.315 INFO:tasks.workunit.client.1.smithi143.stdout:9/318: symlink d3/d16/d3e/d51/d52/l6d 0 2024-09-17T01:06:57.316 INFO:tasks.workunit.client.1.smithi143.stdout:2/370: link d0/d2/l40 d0/d10/d58/d5a/d5b/d4c/d59/l72 0 2024-09-17T01:06:57.317 INFO:tasks.workunit.client.1.smithi143.stdout:6/264: getdents d2/d7/d26 0 2024-09-17T01:06:57.319 INFO:tasks.workunit.client.1.smithi143.stdout:1/429: creat d0/d6/d43/d47/d68/f92 x:0 0 0 2024-09-17T01:06:57.319 INFO:tasks.workunit.client.1.smithi143.stdout:7/443: dread d4/d16/f17 [4194304,4194304] 0 2024-09-17T01:06:57.319 INFO:tasks.workunit.client.1.smithi143.stdout:0/415: mkdir d3/d5/d8/d27/d8c 0 2024-09-17T01:06:57.320 INFO:tasks.workunit.client.1.smithi143.stdout:7/444: dread - d4/d1f/f52 zero size 2024-09-17T01:06:57.323 INFO:tasks.workunit.client.1.smithi143.stdout:0/416: write d3/d14/d32/f38 [3745967,125002] 0 2024-09-17T01:06:57.324 INFO:tasks.workunit.client.1.smithi143.stdout:7/445: dread - d4/d1f/f52 zero size 2024-09-17T01:06:57.331 INFO:tasks.workunit.client.1.smithi143.stdout:6/265: dwrite d2/d7/d26/f3b [0,4194304] 0 2024-09-17T01:06:57.336 INFO:tasks.workunit.client.1.smithi143.stdout:6/266: write d2/df/f31 [4202556,102428] 0 2024-09-17T01:06:57.337 INFO:tasks.workunit.client.1.smithi143.stdout:1/430: dwrite d0/d6/d43/d47/d68/f73 [0,4194304] 0 2024-09-17T01:06:57.337 INFO:tasks.workunit.client.1.smithi143.stdout:0/417: dwrite d3/d14/d3d/f76 [0,4194304] 0 2024-09-17T01:06:57.346 INFO:tasks.workunit.client.1.smithi143.stdout:5/385: sync 2024-09-17T01:06:57.348 INFO:tasks.workunit.client.1.smithi143.stdout:6/267: dwrite d2/d7/f3e [4194304,4194304] 0 2024-09-17T01:06:57.350 INFO:tasks.workunit.client.1.smithi143.stdout:4/331: rmdir da/d3a/d3e/d42/d67 0 2024-09-17T01:06:57.350 INFO:tasks.workunit.client.1.smithi143.stdout:9/319: symlink d3/d39/d42/d58/l6e 0 2024-09-17T01:06:57.353 INFO:tasks.workunit.client.1.smithi143.stdout:8/365: creat d9/de/d53/d75/f88 x:0 0 0 2024-09-17T01:06:57.359 INFO:tasks.workunit.client.1.smithi143.stdout:3/331: getdents d6/d1c/d4b/d62 0 2024-09-17T01:06:57.360 INFO:tasks.workunit.client.1.smithi143.stdout:7/446: write d4/d26/f76 [488990,52674] 0 2024-09-17T01:06:57.361 INFO:tasks.workunit.client.1.smithi143.stdout:4/332: dwrite da/f20 [0,4194304] 0 2024-09-17T01:06:57.365 INFO:tasks.workunit.client.1.smithi143.stdout:0/418: mkdir d3/d5/d8/d27/d31/d48/d8d 0 2024-09-17T01:06:57.366 INFO:tasks.workunit.client.1.smithi143.stdout:6/268: unlink d2/d7/d26/c3f 0 2024-09-17T01:06:57.367 INFO:tasks.workunit.client.1.smithi143.stdout:0/419: chown d3/d14/f61 39135 1 2024-09-17T01:06:57.370 INFO:tasks.workunit.client.1.smithi143.stdout:0/420: write d3/d5/f41 [1371702,88763] 0 2024-09-17T01:06:57.372 INFO:tasks.workunit.client.1.smithi143.stdout:4/333: fsync da/f2d 0 2024-09-17T01:06:57.373 INFO:tasks.workunit.client.1.smithi143.stdout:7/447: symlink d4/d33/l8e 0 2024-09-17T01:06:57.376 INFO:tasks.workunit.client.1.smithi143.stdout:2/371: creat d0/d2/d21/d22/d24/f73 x:0 0 0 2024-09-17T01:06:57.378 INFO:tasks.workunit.client.1.smithi143.stdout:3/332: dwrite d6/d1c/d33/d41/d2e/f61 [0,4194304] 0 2024-09-17T01:06:57.379 INFO:tasks.workunit.client.1.smithi143.stdout:9/320: truncate d3/d3d/d48/f59 440799 0 2024-09-17T01:06:57.384 INFO:tasks.workunit.client.1.smithi143.stdout:7/448: read d4/f58 [3898268,125526] 0 2024-09-17T01:06:57.385 INFO:tasks.workunit.client.1.smithi143.stdout:6/269: dwrite d2/d30/d45/f4d [0,4194304] 0 2024-09-17T01:06:57.387 INFO:tasks.workunit.client.1.smithi143.stdout:8/366: getdents d9 0 2024-09-17T01:06:57.387 INFO:tasks.workunit.client.1.smithi143.stdout:1/431: getdents d0/d6/d43/d6a/df/d6e 0 2024-09-17T01:06:57.389 INFO:tasks.workunit.client.1.smithi143.stdout:0/421: dread d3/d5/d8/d27/d31/d48/f5e [0,4194304] 0 2024-09-17T01:06:57.390 INFO:tasks.workunit.client.1.smithi143.stdout:4/334: rename da/d3a/d40/c24 to da/d3a/d3e/d4a/c6b 0 2024-09-17T01:06:57.393 INFO:tasks.workunit.client.1.smithi143.stdout:4/335: read da/d3a/d40/f37 [145179,3345] 0 2024-09-17T01:06:57.396 INFO:tasks.workunit.client.1.smithi143.stdout:1/432: symlink d0/d6/d43/l93 0 2024-09-17T01:06:57.396 INFO:tasks.workunit.client.1.smithi143.stdout:8/367: mknod d9/d12/d38/d7a/c89 0 2024-09-17T01:06:57.398 INFO:tasks.workunit.client.1.smithi143.stdout:8/368: chown d9/d23/d48/d55/d61 0 1 2024-09-17T01:06:57.401 INFO:tasks.workunit.client.1.smithi143.stdout:1/433: mkdir d0/dc/d74/d94 0 2024-09-17T01:06:57.403 INFO:tasks.workunit.client.1.smithi143.stdout:3/333: truncate d6/d1c/d33/d41/d42/f63 1321485 0 2024-09-17T01:06:57.405 INFO:tasks.workunit.client.1.smithi143.stdout:8/369: rename d9/d12/d13/d73/l80 to d9/d84/l8a 0 2024-09-17T01:06:57.405 INFO:tasks.workunit.client.1.smithi143.stdout:9/321: link d3/d39/d6a/c25 d3/d16/d3e/d51/d52/c6f 0 2024-09-17T01:06:57.405 INFO:tasks.workunit.client.1.smithi143.stdout:4/336: dwrite da/d3a/d40/f36 [0,4194304] 0 2024-09-17T01:06:57.407 INFO:tasks.workunit.client.1.smithi143.stdout:8/370: read f7 [2167053,33400] 0 2024-09-17T01:06:57.408 INFO:tasks.workunit.client.1.smithi143.stdout:1/434: creat d0/dc/d89/f95 x:0 0 0 2024-09-17T01:06:57.409 INFO:tasks.workunit.client.1.smithi143.stdout:4/337: dread - da/d3a/d3e/d5e/f57 zero size 2024-09-17T01:06:57.410 INFO:tasks.workunit.client.1.smithi143.stdout:3/334: readlink d6/l8 0 2024-09-17T01:06:57.412 INFO:tasks.workunit.client.1.smithi143.stdout:8/371: fsync d9/de/d53/d75/f88 0 2024-09-17T01:06:57.413 INFO:tasks.workunit.client.1.smithi143.stdout:4/338: fsync da/d3a/d3e/d5e/f53 0 2024-09-17T01:06:57.415 INFO:tasks.workunit.client.1.smithi143.stdout:4/339: chown da 982 1 2024-09-17T01:06:57.416 INFO:tasks.workunit.client.1.smithi143.stdout:3/335: rmdir d6/d1c/d4b/d62 0 2024-09-17T01:06:57.418 INFO:tasks.workunit.client.1.smithi143.stdout:8/372: mknod d9/d12/d4b/c8b 0 2024-09-17T01:06:57.420 INFO:tasks.workunit.client.1.smithi143.stdout:4/340: symlink da/d3a/d40/l6c 0 2024-09-17T01:06:57.420 INFO:tasks.workunit.client.1.smithi143.stdout:3/336: rename d6/d1c/d33 to d6/d1c/d33/d41/d2b/d64 22 2024-09-17T01:06:57.421 INFO:tasks.workunit.client.1.smithi143.stdout:9/322: dwrite d3/d16/f46 [0,4194304] 0 2024-09-17T01:06:57.424 INFO:tasks.workunit.client.1.smithi143.stdout:1/435: getdents d0/d6/d43/d6a/df/d6e/d2/d39 0 2024-09-17T01:06:57.424 INFO:tasks.workunit.client.1.smithi143.stdout:8/373: rmdir d9/d12/d4b 39 2024-09-17T01:06:57.426 INFO:tasks.workunit.client.1.smithi143.stdout:5/386: write d1/d46/df/f1b [7961999,2161] 0 2024-09-17T01:06:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:57 smithi103 ceph-mon[28156]: pgmap v9: 65 pgs: 65 active+clean; 764 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s rd, 89 MiB/s wr, 277 op/s 2024-09-17T01:06:57.427 INFO:tasks.workunit.client.1.smithi143.stdout:1/436: write d0/d6/d43/d6a/df/d6e/d18/f59 [2474466,89596] 0 2024-09-17T01:06:57.428 INFO:tasks.workunit.client.1.smithi143.stdout:6/270: rmdir d2/d7 39 2024-09-17T01:06:57.429 INFO:tasks.workunit.client.1.smithi143.stdout:4/341: truncate da/d3a/d3e/d42/f43 703107 0 2024-09-17T01:06:57.429 INFO:tasks.workunit.client.1.smithi143.stdout:8/374: dread - d9/de/d53/d75/f88 zero size 2024-09-17T01:06:57.430 INFO:tasks.workunit.client.1.smithi143.stdout:5/387: chown d1/f3f 3671 1 2024-09-17T01:06:57.431 INFO:tasks.workunit.client.1.smithi143.stdout:3/337: read d6/d1c/d33/d41/f1a [1380290,79939] 0 2024-09-17T01:06:57.432 INFO:tasks.workunit.client.1.smithi143.stdout:1/437: chown d0/d6/d43/d47/d72/c76 236724 1 2024-09-17T01:06:57.435 INFO:tasks.workunit.client.1.smithi143.stdout:8/375: fdatasync d9/d12/d38/d58/d70/f71 0 2024-09-17T01:06:57.436 INFO:tasks.workunit.client.1.smithi143.stdout:9/323: creat d3/d3d/f70 x:0 0 0 2024-09-17T01:06:57.437 INFO:tasks.workunit.client.1.smithi143.stdout:0/422: write d3/f5f [242250,42647] 0 2024-09-17T01:06:57.441 INFO:tasks.workunit.client.1.smithi143.stdout:5/388: rmdir d1/d46/df 39 2024-09-17T01:06:57.441 INFO:tasks.workunit.client.1.smithi143.stdout:8/376: chown d9/l6b 72217725 1 2024-09-17T01:06:57.441 INFO:tasks.workunit.client.1.smithi143.stdout:9/324: chown d3/d39/f53 7 1 2024-09-17T01:06:57.443 INFO:tasks.workunit.client.1.smithi143.stdout:4/342: mkdir da/d6d 0 2024-09-17T01:06:57.445 INFO:tasks.workunit.client.1.smithi143.stdout:7/449: rename d4/f69 to d4/f8f 0 2024-09-17T01:06:57.446 INFO:tasks.workunit.client.1.smithi143.stdout:6/271: symlink d2/df/d20/d2c/l4e 0 2024-09-17T01:06:57.447 INFO:tasks.workunit.client.1.smithi143.stdout:1/438: rename d0/d6/d43/d66 to d0/d6/d43/d6a/df/d6e/d2/d39/d79/d96 0 2024-09-17T01:06:57.448 INFO:tasks.workunit.client.1.smithi143.stdout:2/372: dwrite d0/d2/d21/f27 [0,4194304] 0 2024-09-17T01:06:57.449 INFO:tasks.workunit.client.1.smithi143.stdout:9/325: creat d3/d16/d3e/d51/f71 x:0 0 0 2024-09-17T01:06:57.449 INFO:tasks.workunit.client.1.smithi143.stdout:5/389: mkdir d1/d46/d9b 0 2024-09-17T01:06:57.451 INFO:tasks.workunit.client.1.smithi143.stdout:2/373: chown d0/c4d 3 1 2024-09-17T01:06:57.455 INFO:tasks.workunit.client.1.smithi143.stdout:3/338: link d6/d1c/d33/d41/l5f d6/d1c/d33/d41/l65 0 2024-09-17T01:06:57.455 INFO:tasks.workunit.client.1.smithi143.stdout:9/326: write d3/d39/d6a/d9/f1a [123056,96671] 0 2024-09-17T01:06:57.457 INFO:tasks.workunit.client.1.smithi143.stdout:8/377: dwrite d9/d12/d38/d58/d70/f71 [0,4194304] 0 2024-09-17T01:06:57.457 INFO:tasks.workunit.client.1.smithi143.stdout:7/450: creat d4/d1f/d4a/d66/f90 x:0 0 0 2024-09-17T01:06:57.459 INFO:tasks.workunit.client.1.smithi143.stdout:5/390: write d1/d46/df/f1b [7028895,114425] 0 2024-09-17T01:06:57.460 INFO:tasks.workunit.client.1.smithi143.stdout:1/439: rename d0/d6/c8 to d0/d6/d43/d47/d88/c97 0 2024-09-17T01:06:57.460 INFO:tasks.workunit.client.1.smithi143.stdout:0/423: dread d3/d5/d8/d21/f49 [0,4194304] 0 2024-09-17T01:06:57.461 INFO:tasks.workunit.client.1.smithi143.stdout:4/343: symlink da/d3a/d3e/d5e/d63/l6e 0 2024-09-17T01:06:57.464 INFO:tasks.workunit.client.1.smithi143.stdout:1/440: chown d0/d6/d43/d6a/df/d6e/d2/l37 124100320 1 2024-09-17T01:06:57.464 INFO:tasks.workunit.client.1.smithi143.stdout:6/272: unlink d2/d7/d26/f48 0 2024-09-17T01:06:57.466 INFO:tasks.workunit.client.1.smithi143.stdout:1/441: dread - d0/d6/d43/d6a/df/d6e/d18/f3e zero size 2024-09-17T01:06:57.467 INFO:tasks.workunit.client.1.smithi143.stdout:3/339: dwrite d6/d1c/d33/d41/d2e/d30/f32 [0,4194304] 0 2024-09-17T01:06:57.467 INFO:tasks.workunit.client.1.smithi143.stdout:9/327: creat d3/d39/f72 x:0 0 0 2024-09-17T01:06:57.468 INFO:tasks.workunit.client.1.smithi143.stdout:1/442: chown d0/d6/f20 728619 1 2024-09-17T01:06:57.468 INFO:tasks.workunit.client.1.smithi143.stdout:7/451: readlink d4/d1f/d4a/l8c 0 2024-09-17T01:06:57.471 INFO:tasks.workunit.client.1.smithi143.stdout:2/374: rename d0/d10/d58/d5a/d5b/f50 to d0/d44/d6a/f74 0 2024-09-17T01:06:57.471 INFO:tasks.workunit.client.1.smithi143.stdout:7/452: truncate d4/d1f/d4a/f89 415620 0 2024-09-17T01:06:57.475 INFO:tasks.workunit.client.1.smithi143.stdout:0/424: creat d3/d14/d3d/f8e x:0 0 0 2024-09-17T01:06:57.475 INFO:tasks.workunit.client.1.smithi143.stdout:3/340: rmdir d6/d1c/d33/d41/d2e 39 2024-09-17T01:06:57.476 INFO:tasks.workunit.client.1.smithi143.stdout:5/391: truncate d1/f3 2430830 0 2024-09-17T01:06:57.479 INFO:tasks.workunit.client.1.smithi143.stdout:6/273: symlink d2/df/d20/l4f 0 2024-09-17T01:06:57.479 INFO:tasks.workunit.client.1.smithi143.stdout:0/425: mkdir d3/d68/d8f 0 2024-09-17T01:06:57.481 INFO:tasks.workunit.client.1.smithi143.stdout:9/328: dwrite d3/d39/d6a/d26/f3c [0,4194304] 0 2024-09-17T01:06:57.481 INFO:tasks.workunit.client.1.smithi143.stdout:7/453: rename d4/d1f/d4a/d66/f90 to d4/d33/d78/f91 0 2024-09-17T01:06:57.482 INFO:tasks.workunit.client.1.smithi143.stdout:3/341: creat d6/d1c/f66 x:0 0 0 2024-09-17T01:06:57.485 INFO:tasks.workunit.client.1.smithi143.stdout:6/274: write d2/d19/f1b [1920112,84210] 0 2024-09-17T01:06:57.486 INFO:tasks.workunit.client.1.smithi143.stdout:7/454: rename d4/d1f/d4a/l5f to d4/d1f/d4a/d66/l92 0 2024-09-17T01:06:57.486 INFO:tasks.workunit.client.1.smithi143.stdout:7/455: readlink l0 0 2024-09-17T01:06:57.492 INFO:tasks.workunit.client.1.smithi143.stdout:7/456: mknod d4/d33/c93 0 2024-09-17T01:06:57.492 INFO:tasks.workunit.client.1.smithi143.stdout:8/378: dread d9/d23/d32/f51 [0,4194304] 0 2024-09-17T01:06:57.495 INFO:tasks.workunit.client.1.smithi143.stdout:6/275: dwrite d2/df/d20/f34 [0,4194304] 0 2024-09-17T01:06:57.495 INFO:tasks.workunit.client.1.smithi143.stdout:7/457: fdatasync d4/d16/f40 0 2024-09-17T01:06:57.497 INFO:tasks.workunit.client.1.smithi143.stdout:1/443: truncate d0/d6/d43/f44 2829610 0 2024-09-17T01:06:57.499 INFO:tasks.workunit.client.1.smithi143.stdout:0/426: getdents d3/d5/d8 0 2024-09-17T01:06:57.503 INFO:tasks.workunit.client.1.smithi143.stdout:3/342: truncate d6/f58 481655 0 2024-09-17T01:06:57.504 INFO:tasks.workunit.client.1.smithi143.stdout:4/344: dwrite da/d68/f5d [0,4194304] 0 2024-09-17T01:06:57.504 INFO:tasks.workunit.client.1.smithi143.stdout:2/375: mknod d0/d10/d58/d5a/d5b/d4c/d59/c75 0 2024-09-17T01:06:57.504 INFO:tasks.workunit.client.1.smithi143.stdout:6/276: chown d2/d30/l3d 12 1 2024-09-17T01:06:57.504 INFO:tasks.workunit.client.1.smithi143.stdout:9/329: truncate d3/d39/d6a/d9/f5c 3750014 0 2024-09-17T01:06:57.504 INFO:tasks.workunit.client.1.smithi143.stdout:0/427: readlink d3/d5/d8/d27/l43 0 2024-09-17T01:06:57.504 INFO:tasks.workunit.client.1.smithi143.stdout:5/392: dread d1/d46/df/f25 [0,4194304] 0 2024-09-17T01:06:57.505 INFO:tasks.workunit.client.1.smithi143.stdout:2/376: read d0/d10/d56/f66 [20635,30510] 0 2024-09-17T01:06:57.506 INFO:tasks.workunit.client.1.smithi143.stdout:1/444: symlink d0/d6/d43/d6a/df/l98 0 2024-09-17T01:06:57.507 INFO:tasks.workunit.client.1.smithi143.stdout:8/379: rename d9/l6b to d9/d23/l8c 0 2024-09-17T01:06:57.509 INFO:tasks.workunit.client.1.smithi143.stdout:6/277: chown d2/d17 55811312 1 2024-09-17T01:06:57.513 INFO:tasks.workunit.client.1.smithi143.stdout:0/428: write d3/d5/d8/d27/d31/d4c/f45 [4576345,41147] 0 2024-09-17T01:06:57.516 INFO:tasks.workunit.client.1.smithi143.stdout:1/445: mkdir d0/d6/d99 0 2024-09-17T01:06:57.518 INFO:tasks.workunit.client.1.smithi143.stdout:2/377: write d0/d2/d21/d22/f28 [514520,58746] 0 2024-09-17T01:06:57.518 INFO:tasks.workunit.client.1.smithi143.stdout:6/278: creat d2/d30/d45/f50 x:0 0 0 2024-09-17T01:06:57.519 INFO:tasks.workunit.client.1.smithi143.stdout:9/330: dwrite d3/d39/f72 [0,4194304] 0 2024-09-17T01:06:57.520 INFO:tasks.workunit.client.1.smithi143.stdout:4/345: dwrite da/d3a/d40/f39 [0,4194304] 0 2024-09-17T01:06:57.521 INFO:tasks.workunit.client.1.smithi143.stdout:5/393: mkdir d1/d46/df/d53/d74/d9a/d9c 0 2024-09-17T01:06:57.522 INFO:tasks.workunit.client.1.smithi143.stdout:3/343: truncate d6/fa 3440737 0 2024-09-17T01:06:57.525 INFO:tasks.workunit.client.1.smithi143.stdout:3/344: dread - d6/f44 zero size 2024-09-17T01:06:57.525 INFO:tasks.workunit.client.1.smithi143.stdout:6/279: chown d2/df/d20/d2c/d38/f39 1216952797 1 2024-09-17T01:06:57.527 INFO:tasks.workunit.client.1.smithi143.stdout:8/380: read - d9/de/d53/d75/f88 zero size 2024-09-17T01:06:57.527 INFO:tasks.workunit.client.1.smithi143.stdout:7/458: dwrite d4/d26/f2b [0,4194304] 0 2024-09-17T01:06:57.536 INFO:tasks.workunit.client.1.smithi143.stdout:0/429: creat d3/d5/d6b/f90 x:0 0 0 2024-09-17T01:06:57.536 INFO:tasks.workunit.client.1.smithi143.stdout:3/345: write d6/d1c/d33/d3f/f48 [291535,92070] 0 2024-09-17T01:06:57.539 INFO:tasks.workunit.client.1.smithi143.stdout:9/331: symlink d3/d39/d6a/l73 0 2024-09-17T01:06:57.540 INFO:tasks.workunit.client.1.smithi143.stdout:3/346: dread - d6/f44 zero size 2024-09-17T01:06:57.541 INFO:tasks.workunit.client.1.smithi143.stdout:4/346: mknod da/d3a/d3e/d4a/c6f 0 2024-09-17T01:06:57.542 INFO:tasks.workunit.client.1.smithi143.stdout:2/378: fsync d0/f51 0 2024-09-17T01:06:57.544 INFO:tasks.workunit.client.1.smithi143.stdout:5/394: mkdir d1/d46/d9d 0 2024-09-17T01:06:57.544 INFO:tasks.workunit.client.1.smithi143.stdout:4/347: stat da/d3a/d40/f34 0 2024-09-17T01:06:57.545 INFO:tasks.workunit.client.1.smithi143.stdout:1/446: dwrite d0/d6/d43/d6a/df/d6e/d18/f3e [0,4194304] 0 2024-09-17T01:06:57.547 INFO:tasks.workunit.client.1.smithi143.stdout:6/280: dwrite d2/d7/f3e [4194304,4194304] 0 2024-09-17T01:06:57.548 INFO:tasks.workunit.client.1.smithi143.stdout:3/347: creat d6/d1c/d4b/f67 x:0 0 0 2024-09-17T01:06:57.549 INFO:tasks.workunit.client.1.smithi143.stdout:8/381: write d9/d12/d38/d7a/f7b [422985,112114] 0 2024-09-17T01:06:57.550 INFO:tasks.workunit.client.1.smithi143.stdout:9/332: unlink d3/d16/d3e/d51/d52/l57 0 2024-09-17T01:06:57.553 INFO:tasks.workunit.client.1.smithi143.stdout:2/379: symlink d0/l76 0 2024-09-17T01:06:57.558 INFO:tasks.workunit.client.1.smithi143.stdout:6/281: dread d2/d17/f25 [0,4194304] 0 2024-09-17T01:06:57.558 INFO:tasks.workunit.client.1.smithi143.stdout:0/430: link d3/d5/d8/d10/f4f d3/d5/d8/d21/d2e/f91 0 2024-09-17T01:06:57.560 INFO:tasks.workunit.client.1.smithi143.stdout:2/380: readlink d0/d10/d58/d5a/d5b/l4f 0 2024-09-17T01:06:57.563 INFO:tasks.workunit.client.1.smithi143.stdout:8/382: symlink d9/d23/d48/d55/l8d 0 2024-09-17T01:06:57.564 INFO:tasks.workunit.client.1.smithi143.stdout:0/431: read d3/d5/f29 [235048,129625] 0 2024-09-17T01:06:57.567 INFO:tasks.workunit.client.1.smithi143.stdout:4/348: dwrite da/d3a/f51 [0,4194304] 0 2024-09-17T01:06:57.567 INFO:tasks.workunit.client.1.smithi143.stdout:6/282: chown d2/d17/d3a/c37 6775 1 2024-09-17T01:06:57.577 INFO:tasks.workunit.client.1.smithi143.stdout:9/333: dwrite d3/d39/f4f [0,4194304] 0 2024-09-17T01:06:57.579 INFO:tasks.workunit.client.1.smithi143.stdout:3/348: dwrite d6/d1c/d33/d41/f21 [0,4194304] 0 2024-09-17T01:06:57.579 INFO:tasks.workunit.client.1.smithi143.stdout:1/447: dwrite d0/d6/d43/d6a/df/d6e/d2/f56 [0,4194304] 0 2024-09-17T01:06:57.579 INFO:tasks.workunit.client.1.smithi143.stdout:6/283: creat d2/d17/d3a/f51 x:0 0 0 2024-09-17T01:06:57.585 INFO:tasks.workunit.client.1.smithi143.stdout:9/334: unlink d3/d39/d6a/c21 0 2024-09-17T01:06:57.587 INFO:tasks.workunit.client.1.smithi143.stdout:4/349: dread da/d3a/d40/f36 [0,4194304] 0 2024-09-17T01:06:57.587 INFO:tasks.workunit.client.1.smithi143.stdout:5/395: write d1/d46/df/d53/f86 [250403,117369] 0 2024-09-17T01:06:57.588 INFO:tasks.workunit.client.1.smithi143.stdout:9/335: fdatasync d3/d16/d34/f4c 0 2024-09-17T01:06:57.590 INFO:tasks.workunit.client.1.smithi143.stdout:0/432: dwrite d3/d68/f70 [0,4194304] 0 2024-09-17T01:06:57.591 INFO:tasks.workunit.client.1.smithi143.stdout:1/448: dread d0/d6/d43/d6a/df/d6e/d18/d2d/f51 [0,4194304] 0 2024-09-17T01:06:57.594 INFO:tasks.workunit.client.1.smithi143.stdout:6/284: link d2/df/f2e d2/d30/f52 0 2024-09-17T01:06:57.595 INFO:tasks.workunit.client.1.smithi143.stdout:8/383: write d9/d26/f3e [1243043,125123] 0 2024-09-17T01:06:57.598 INFO:tasks.workunit.client.1.smithi143.stdout:0/433: write d3/d5/f84 [464328,52901] 0 2024-09-17T01:06:57.598 INFO:tasks.workunit.client.1.smithi143.stdout:4/350: rmdir da/d3a 39 2024-09-17T01:06:57.602 INFO:tasks.workunit.client.1.smithi143.stdout:3/349: dwrite d6/d1c/d33/d41/f39 [0,4194304] 0 2024-09-17T01:06:57.604 INFO:tasks.workunit.client.1.smithi143.stdout:1/449: dread d0/d6/d43/d6a/df/d6e/d18/d2d/f51 [0,4194304] 0 2024-09-17T01:06:57.606 INFO:tasks.workunit.client.1.smithi143.stdout:0/434: write d3/d5/f29 [4423469,74059] 0 2024-09-17T01:06:57.607 INFO:tasks.workunit.client.1.smithi143.stdout:9/336: rename d3/d39/d6a/d9/d55 to d3/d39/d6a/d9/d74 0 2024-09-17T01:06:57.611 INFO:tasks.workunit.client.1.smithi143.stdout:8/384: fdatasync d9/d2b/f85 0 2024-09-17T01:06:57.611 INFO:tasks.workunit.client.1.smithi143.stdout:6/285: dwrite d2/df/f2e [0,4194304] 0 2024-09-17T01:06:57.616 INFO:tasks.workunit.client.1.smithi143.stdout:4/351: dread - da/d3a/d3e/d42/f46 zero size 2024-09-17T01:06:57.618 INFO:tasks.workunit.client.1.smithi143.stdout:4/352: chown da/d3a/d40/l2b 0 1 2024-09-17T01:06:57.618 INFO:tasks.workunit.client.1.smithi143.stdout:4/353: readlink da/d3a/l4f 0 2024-09-17T01:06:57.619 INFO:tasks.workunit.client.1.smithi143.stdout:1/450: unlink d0/d6/d43/d47/d68/c85 0 2024-09-17T01:06:57.621 INFO:tasks.workunit.client.1.smithi143.stdout:9/337: rename d3/d39/d6a/d9/f1a to d3/d39/d6a/d26/f75 0 2024-09-17T01:06:57.626 INFO:tasks.workunit.client.1.smithi143.stdout:5/396: link d1/d46/df/d23/f8e d1/d46/df/d23/d4f/d7d/d92/f9e 0 2024-09-17T01:06:57.629 INFO:tasks.workunit.client.1.smithi143.stdout:9/338: creat d3/d39/d42/d58/f76 x:0 0 0 2024-09-17T01:06:57.630 INFO:tasks.workunit.client.1.smithi143.stdout:8/385: link d9/f59 d9/d12/d38/d58/f8e 0 2024-09-17T01:06:57.631 INFO:tasks.workunit.client.1.smithi143.stdout:1/451: creat d0/dc/d74/d94/f9a x:0 0 0 2024-09-17T01:06:57.632 INFO:tasks.workunit.client.1.smithi143.stdout:4/354: link da/f1b da/d3a/d3e/d5e/d63/f70 0 2024-09-17T01:06:57.633 INFO:tasks.workunit.client.1.smithi143.stdout:6/286: creat d2/df/d20/f53 x:0 0 0 2024-09-17T01:06:57.633 INFO:tasks.workunit.client.1.smithi143.stdout:4/355: write da/f20 [632325,28833] 0 2024-09-17T01:06:57.633 INFO:tasks.workunit.client.1.smithi143.stdout:9/339: mknod d3/d39/d6a/d9/c77 0 2024-09-17T01:06:57.634 INFO:tasks.workunit.client.1.smithi143.stdout:5/397: mkdir d1/d46/df/d1f/d9f 0 2024-09-17T01:06:57.635 INFO:tasks.workunit.client.1.smithi143.stdout:8/386: rename d9/d23/d48/d55/d61 to d9/d12/d38/d7a/d8f 0 2024-09-17T01:06:57.636 INFO:tasks.workunit.client.1.smithi143.stdout:4/356: write da/f54 [631333,21079] 0 2024-09-17T01:06:57.638 INFO:tasks.workunit.client.1.smithi143.stdout:6/287: unlink d2/d7/d26/l2a 0 2024-09-17T01:06:57.638 INFO:tasks.workunit.client.1.smithi143.stdout:0/435: getdents d3/d5/d8 0 2024-09-17T01:06:57.640 INFO:tasks.workunit.client.1.smithi143.stdout:8/387: write d9/de/d53/d75/f86 [531807,128506] 0 2024-09-17T01:06:57.640 INFO:tasks.workunit.client.1.smithi143.stdout:4/357: chown da/d3a/d40/l60 29614587 1 2024-09-17T01:06:57.641 INFO:tasks.workunit.client.1.smithi143.stdout:9/340: truncate d3/d39/d6a/f12 2584933 0 2024-09-17T01:06:57.642 INFO:tasks.workunit.client.1.smithi143.stdout:1/452: dwrite d0/d6/d43/d6a/f70 [0,4194304] 0 2024-09-17T01:06:57.643 INFO:tasks.workunit.client.1.smithi143.stdout:5/398: rmdir d1/d46/d6e/d95 0 2024-09-17T01:06:57.644 INFO:tasks.workunit.client.1.smithi143.stdout:9/341: dread - d3/d39/d42/f54 zero size 2024-09-17T01:06:57.647 INFO:tasks.workunit.client.1.smithi143.stdout:4/358: mknod da/d3a/d3e/d5e/d63/c71 0 2024-09-17T01:06:57.647 INFO:tasks.workunit.client.1.smithi143.stdout:1/453: write d0/dc/d74/d94/f9a [570341,39183] 0 2024-09-17T01:06:57.648 INFO:tasks.workunit.client.1.smithi143.stdout:5/399: fsync d1/d46/df/d23/f90 0 2024-09-17T01:06:57.651 INFO:tasks.workunit.client.1.smithi143.stdout:9/342: write d3/d16/d3e/d51/f63 [1582346,40673] 0 2024-09-17T01:06:57.654 INFO:tasks.workunit.client.1.smithi143.stdout:0/436: fdatasync d3/d5/d8/d21/f42 0 2024-09-17T01:06:57.654 INFO:tasks.workunit.client.1.smithi143.stdout:6/288: dread d2/df/f2e [0,4194304] 0 2024-09-17T01:06:57.655 INFO:tasks.workunit.client.1.smithi143.stdout:4/359: write da/d3a/d3e/d42/f4b [920706,61566] 0 2024-09-17T01:06:57.655 INFO:tasks.workunit.client.1.smithi143.stdout:8/388: dwrite d9/de/d53/f68 [4194304,4194304] 0 2024-09-17T01:06:57.657 INFO:tasks.workunit.client.1.smithi143.stdout:6/289: readlink d2/d30/l3d 0 2024-09-17T01:06:57.659 INFO:tasks.workunit.client.1.smithi143.stdout:9/343: creat d3/d16/d3e/d51/f78 x:0 0 0 2024-09-17T01:06:57.661 INFO:tasks.workunit.client.1.smithi143.stdout:0/437: chown d3/d5/d8/d27/d31/d4c/l7c 12068 1 2024-09-17T01:06:57.665 INFO:tasks.workunit.client.1.smithi143.stdout:0/438: dread - d3/d5/d8/d27/f82 zero size 2024-09-17T01:06:57.666 INFO:tasks.workunit.client.1.smithi143.stdout:5/400: dwrite d1/d46/df/d1f/d66/f6c [0,4194304] 0 2024-09-17T01:06:57.666 INFO:tasks.workunit.client.1.smithi143.stdout:8/389: rename d9/f46 to d9/d12/d13/d73/f90 0 2024-09-17T01:06:57.667 INFO:tasks.workunit.client.1.smithi143.stdout:1/454: getdents d0/d6/d43/d6a/df/d6e/d18/d2d 0 2024-09-17T01:06:57.669 INFO:tasks.workunit.client.1.smithi143.stdout:4/360: dwrite da/d3a/d40/f36 [0,4194304] 0 2024-09-17T01:06:57.671 INFO:tasks.workunit.client.1.smithi143.stdout:9/344: dread d3/d39/d6a/f30 [0,4194304] 0 2024-09-17T01:06:57.674 INFO:tasks.workunit.client.1.smithi143.stdout:5/401: mkdir d1/d46/d6e/da0 0 2024-09-17T01:06:57.675 INFO:tasks.workunit.client.1.smithi143.stdout:9/345: mknod d3/d39/d42/c79 0 2024-09-17T01:06:57.676 INFO:tasks.workunit.client.1.smithi143.stdout:0/439: getdents d3/d88 0 2024-09-17T01:06:57.677 INFO:tasks.workunit.client.1.smithi143.stdout:0/440: chown d3/d5/d8/d21/f49 5211 1 2024-09-17T01:06:57.678 INFO:tasks.workunit.client.1.smithi143.stdout:5/402: mknod d1/d46/df/d1f/d7a/ca1 0 2024-09-17T01:06:57.679 INFO:tasks.workunit.client.1.smithi143.stdout:9/346: mknod d3/d16/c7a 0 2024-09-17T01:06:57.680 INFO:tasks.workunit.client.1.smithi143.stdout:0/441: rmdir d3/d5/d8/d58 39 2024-09-17T01:06:57.681 INFO:tasks.workunit.client.1.smithi143.stdout:5/403: creat d1/d46/df/d53/fa2 x:0 0 0 2024-09-17T01:06:57.682 INFO:tasks.workunit.client.1.smithi143.stdout:0/442: read d3/d68/f70 [3728253,73931] 0 2024-09-17T01:06:57.682 INFO:tasks.workunit.client.1.smithi143.stdout:0/443: chown d3/d68/d8f 1175406 1 2024-09-17T01:06:57.685 INFO:tasks.workunit.client.1.smithi143.stdout:5/404: creat d1/d46/df/d53/d74/fa3 x:0 0 0 2024-09-17T01:06:57.686 INFO:tasks.workunit.client.1.smithi143.stdout:0/444: mkdir d3/d5/d8/d27/d92 0 2024-09-17T01:06:57.688 INFO:tasks.workunit.client.1.smithi143.stdout:0/445: mkdir d3/d88/d93 0 2024-09-17T01:06:57.695 INFO:tasks.workunit.client.1.smithi143.stdout:6/290: truncate d2/df/f2e 668677 0 2024-09-17T01:06:57.697 INFO:tasks.workunit.client.1.smithi143.stdout:9/347: read d3/d39/d6a/f12 [2052106,89279] 0 2024-09-17T01:06:57.698 INFO:tasks.workunit.client.1.smithi143.stdout:1/455: dread d0/d6/f3a [0,4194304] 0 2024-09-17T01:06:57.698 INFO:tasks.workunit.client.1.smithi143.stdout:0/446: dwrite d3/d68/f6c [0,4194304] 0 2024-09-17T01:06:57.702 INFO:tasks.workunit.client.1.smithi143.stdout:8/390: rmdir d9/de/d53 39 2024-09-17T01:06:57.702 INFO:tasks.workunit.client.1.smithi143.stdout:5/405: dwrite d1/d46/f48 [0,4194304] 0 2024-09-17T01:06:57.703 INFO:tasks.workunit.client.1.smithi143.stdout:6/291: write d2/df/d20/d2c/d38/f39 [4857836,92856] 0 2024-09-17T01:06:57.703 INFO:tasks.workunit.client.1.smithi143.stdout:1/456: stat d0/d6/d43/d6a/d8f 0 2024-09-17T01:06:57.709 INFO:tasks.workunit.client.1.smithi143.stdout:0/447: rmdir d3/d5/d8/d58 39 2024-09-17T01:06:57.709 INFO:tasks.workunit.client.1.smithi143.stdout:1/457: write d0/d6/d43/f65 [98785,95022] 0 2024-09-17T01:06:57.710 INFO:tasks.workunit.client.1.smithi143.stdout:8/391: rmdir d9/d26 39 2024-09-17T01:06:57.710 INFO:tasks.workunit.client.1.smithi143.stdout:1/458: write d0/d6/d43/f65 [414034,68235] 0 2024-09-17T01:06:57.710 INFO:tasks.workunit.client.1.smithi143.stdout:0/448: truncate d3/d14/f60 55608 0 2024-09-17T01:06:57.711 INFO:tasks.workunit.client.1.smithi143.stdout:6/292: unlink d2/d7/l2d 0 2024-09-17T01:06:57.711 INFO:tasks.workunit.client.1.smithi143.stdout:0/449: dread - d3/d5/d8/d27/d31/d4c/f6d zero size 2024-09-17T01:06:57.712 INFO:tasks.workunit.client.1.smithi143.stdout:9/348: rmdir d3/d39/d42/d58/d5a/d68 0 2024-09-17T01:06:57.714 INFO:tasks.workunit.client.1.smithi143.stdout:5/406: creat d1/d46/df/d1f/d9f/fa4 x:0 0 0 2024-09-17T01:06:57.715 INFO:tasks.workunit.client.1.smithi143.stdout:1/459: symlink d0/l9b 0 2024-09-17T01:06:57.717 INFO:tasks.workunit.client.1.smithi143.stdout:8/392: dread - d9/d12/d38/f64 zero size 2024-09-17T01:06:57.717 INFO:tasks.workunit.client.1.smithi143.stdout:1/460: truncate d0/dc/d74/f8a 82954 0 2024-09-17T01:06:57.719 INFO:tasks.workunit.client.1.smithi143.stdout:1/461: fsync d0/d6/d43/d47/d68/f73 0 2024-09-17T01:06:57.719 INFO:tasks.workunit.client.1.smithi143.stdout:0/450: rmdir d3/d5/d8/d27/d92 0 2024-09-17T01:06:57.721 INFO:tasks.workunit.client.1.smithi143.stdout:0/451: readlink d3/d5/d8/d10/l23 0 2024-09-17T01:06:57.723 INFO:tasks.workunit.client.1.smithi143.stdout:9/349: getdents d3/d39/d42/d58/d5a 0 2024-09-17T01:06:57.724 INFO:tasks.workunit.client.1.smithi143.stdout:1/462: dread d0/d6/d43/d6a/df/d6e/f1d [0,4194304] 0 2024-09-17T01:06:57.725 INFO:tasks.workunit.client.1.smithi143.stdout:0/452: truncate d3/d5/d8/d27/d31/d4c/f6d 332144 0 2024-09-17T01:06:57.725 INFO:tasks.workunit.client.1.smithi143.stdout:6/293: truncate d2/d30/d45/f4d 567934 0 2024-09-17T01:06:57.726 INFO:tasks.workunit.client.1.smithi143.stdout:9/350: creat d3/d16/d3e/d51/d52/f7b x:0 0 0 2024-09-17T01:06:57.728 INFO:tasks.workunit.client.1.smithi143.stdout:9/351: chown d3/d16/c33 12222 1 2024-09-17T01:06:57.728 INFO:tasks.workunit.client.1.smithi143.stdout:5/407: truncate d1/d46/df/d23/d4f/f6a 974633 0 2024-09-17T01:06:57.730 INFO:tasks.workunit.client.1.smithi143.stdout:9/352: fdatasync d3/d39/d42/d58/d5a/f62 0 2024-09-17T01:06:57.730 INFO:tasks.workunit.client.1.smithi143.stdout:0/453: dread d3/d5/d35/f89 [0,4194304] 0 2024-09-17T01:06:57.731 INFO:tasks.workunit.client.1.smithi143.stdout:6/294: creat d2/df/d20/f54 x:0 0 0 2024-09-17T01:06:57.732 INFO:tasks.workunit.client.1.smithi143.stdout:9/353: dread - d3/d39/d6a/d26/f5f zero size 2024-09-17T01:06:57.734 INFO:tasks.workunit.client.1.smithi143.stdout:9/354: dread - d3/d39/d6a/d9/d74/f6c zero size 2024-09-17T01:06:57.735 INFO:tasks.workunit.client.1.smithi143.stdout:0/454: rmdir d3/d5/d8 39 2024-09-17T01:06:57.735 INFO:tasks.workunit.client.1.smithi143.stdout:5/408: link d1/d46/d6e/c87 d1/d96/ca5 0 2024-09-17T01:06:57.736 INFO:tasks.workunit.client.1.smithi143.stdout:9/355: write d3/d39/d42/f54 [201412,17540] 0 2024-09-17T01:06:57.738 INFO:tasks.workunit.client.1.smithi143.stdout:9/356: dread d3/d16/f45 [0,4194304] 0 2024-09-17T01:06:57.740 INFO:tasks.workunit.client.1.smithi143.stdout:0/455: symlink d3/d5/d35/l94 0 2024-09-17T01:06:57.742 INFO:tasks.workunit.client.1.smithi143.stdout:5/409: unlink d1/d46/f3c 0 2024-09-17T01:06:57.743 INFO:tasks.workunit.client.1.smithi143.stdout:1/463: dread d0/d6/f20 [0,4194304] 0 2024-09-17T01:06:57.743 INFO:tasks.workunit.client.1.smithi143.stdout:5/410: chown d1/d46/df/d1f/f16 2046 1 2024-09-17T01:06:57.744 INFO:tasks.workunit.client.1.smithi143.stdout:5/411: write d1/d46/df/f45 [1553405,23108] 0 2024-09-17T01:06:57.745 INFO:tasks.workunit.client.1.smithi143.stdout:9/357: unlink d3/d16/d3e/d51/d52/f7b 0 2024-09-17T01:06:57.747 INFO:tasks.workunit.client.1.smithi143.stdout:1/464: mknod d0/d6/d43/d47/d68/d7b/c9c 0 2024-09-17T01:06:57.750 INFO:tasks.workunit.client.1.smithi143.stdout:5/412: mkdir d1/d46/df/d23/d4f/d82/da6 0 2024-09-17T01:06:57.753 INFO:tasks.workunit.client.1.smithi143.stdout:1/465: rmdir d0/d6/d43/d6a/df/d6e/d2/d39/d79 39 2024-09-17T01:06:57.753 INFO:tasks.workunit.client.1.smithi143.stdout:6/295: dwrite d2/d7/d26/d46/f4b [0,4194304] 0 2024-09-17T01:06:57.754 INFO:tasks.workunit.client.1.smithi143.stdout:9/358: dwrite d3/d39/d6a/f2a [0,4194304] 0 2024-09-17T01:06:57.754 INFO:tasks.workunit.client.1.smithi143.stdout:5/413: creat d1/d46/df/d53/d74/fa7 x:0 0 0 2024-09-17T01:06:57.762 INFO:tasks.workunit.client.1.smithi143.stdout:1/466: mkdir d0/d6/d43/d6a/df/d6e/d2/d39/d6b/d9d 0 2024-09-17T01:06:57.762 INFO:tasks.workunit.client.1.smithi143.stdout:6/296: write d2/df/f2e [311955,35448] 0 2024-09-17T01:06:57.765 INFO:tasks.workunit.client.1.smithi143.stdout:6/297: mknod d2/d17/c55 0 2024-09-17T01:06:57.766 INFO:tasks.workunit.client.1.smithi143.stdout:9/359: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:06:57.769 INFO:tasks.workunit.client.1.smithi143.stdout:9/360: truncate d3/d39/d6a/d9/f6b 398942 0 2024-09-17T01:06:57.769 INFO:tasks.workunit.client.1.smithi143.stdout:6/298: mkdir d2/d30/d45/d56 0 2024-09-17T01:06:57.771 INFO:tasks.workunit.client.1.smithi143.stdout:9/361: write d3/d39/d6a/d26/f3c [4190981,128391] 0 2024-09-17T01:06:57.772 INFO:tasks.workunit.client.1.smithi143.stdout:6/299: creat d2/d30/f57 x:0 0 0 2024-09-17T01:06:57.773 INFO:tasks.workunit.client.1.smithi143.stdout:6/300: chown d2/df/f2e 1927 1 2024-09-17T01:06:57.775 INFO:tasks.workunit.client.1.smithi143.stdout:9/362: creat d3/d3d/f7c x:0 0 0 2024-09-17T01:06:57.775 INFO:tasks.workunit.client.1.smithi143.stdout:6/301: rmdir d2/d7/d26/d46 39 2024-09-17T01:06:57.776 INFO:tasks.workunit.client.1.smithi143.stdout:9/363: write d3/d16/d3e/d51/f78 [858517,19205] 0 2024-09-17T01:06:57.777 INFO:tasks.workunit.client.1.smithi143.stdout:9/364: chown d3/d39/d6a/d26 247 1 2024-09-17T01:06:57.778 INFO:tasks.workunit.client.1.smithi143.stdout:1/467: getdents d0/d6/d43/d6a/df/d6e/d2/d39/d6b 0 2024-09-17T01:06:57.779 INFO:tasks.workunit.client.1.smithi143.stdout:6/302: symlink d2/d7/l58 0 2024-09-17T01:06:57.779 INFO:tasks.workunit.client.1.smithi143.stdout:9/365: write d3/d39/f72 [757586,31377] 0 2024-09-17T01:06:57.779 INFO:tasks.workunit.client.1.smithi143.stdout:1/468: chown d0/d6/d43/d47/d72/c76 488616 1 2024-09-17T01:06:57.783 INFO:tasks.workunit.client.1.smithi143.stdout:1/469: creat d0/d6/d43/d47/d72/f9e x:0 0 0 2024-09-17T01:06:57.784 INFO:tasks.workunit.client.1.smithi143.stdout:9/366: creat d3/d39/d42/d58/d5a/d5e/f7d x:0 0 0 2024-09-17T01:06:57.787 INFO:tasks.workunit.client.1.smithi143.stdout:9/367: symlink d3/d39/d42/d58/l7e 0 2024-09-17T01:06:57.788 INFO:tasks.workunit.client.1.smithi143.stdout:6/303: dwrite d2/d17/d3a/f51 [0,4194304] 0 2024-09-17T01:06:57.788 INFO:tasks.workunit.client.1.smithi143.stdout:9/368: chown d3/d16/d3e/l65 149606 1 2024-09-17T01:06:57.796 INFO:tasks.workunit.client.1.smithi143.stdout:9/369: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:06:57.798 INFO:tasks.workunit.client.1.smithi143.stdout:9/370: dread d3/d16/f45 [0,4194304] 0 2024-09-17T01:06:57.800 INFO:tasks.workunit.client.1.smithi143.stdout:9/371: mknod d3/d39/d6a/d26/c7f 0 2024-09-17T01:06:57.808 INFO:tasks.workunit.client.1.smithi143.stdout:9/372: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:06:57.810 INFO:tasks.workunit.client.1.smithi143.stdout:6/304: dread d2/d7/f3e [0,4194304] 0 2024-09-17T01:06:57.812 INFO:tasks.workunit.client.1.smithi143.stdout:6/305: creat d2/df/d40/f59 x:0 0 0 2024-09-17T01:06:57.813 INFO:tasks.workunit.client.1.smithi143.stdout:6/306: dread - d2/d30/d45/f50 zero size 2024-09-17T01:06:57.815 INFO:tasks.workunit.client.1.smithi143.stdout:9/373: dwrite d3/d16/d34/f5b [0,4194304] 0 2024-09-17T01:06:57.886 INFO:tasks.workunit.client.1.smithi143.stdout:6/307: link d2/fb d2/df/d20/f5a 0 2024-09-17T01:06:57.886 INFO:tasks.workunit.client.1.smithi143.stdout:6/308: chown d2/df/f31 457997 1 2024-09-17T01:06:57.887 INFO:tasks.workunit.client.1.smithi143.stdout:9/374: write d3/d39/d6a/d9/d74/f6c [894013,112824] 0 2024-09-17T01:06:57.888 INFO:tasks.workunit.client.1.smithi143.stdout:9/375: stat d3/d39/d6a/d9/l28 0 2024-09-17T01:06:57.889 INFO:tasks.workunit.client.1.smithi143.stdout:6/309: creat d2/df/d20/f5b x:0 0 0 2024-09-17T01:06:57.890 INFO:tasks.workunit.client.1.smithi143.stdout:6/310: write d2/df/d20/f54 [236732,78585] 0 2024-09-17T01:06:57.905 INFO:tasks.workunit.client.1.smithi143.stdout:6/311: fsync d2/d7/d26/f32 0 2024-09-17T01:06:57.905 INFO:tasks.workunit.client.1.smithi143.stdout:6/312: fsync d2/df/d20/d2c/f24 0 2024-09-17T01:06:57.906 INFO:tasks.workunit.client.1.smithi143.stdout:6/313: chown d2/df/d20/d2c 0 1 2024-09-17T01:06:57.908 INFO:tasks.workunit.client.1.smithi143.stdout:6/314: mknod d2/d7/c5c 0 2024-09-17T01:06:57.908 INFO:tasks.workunit.client.1.smithi143.stdout:6/315: chown d2/df/d18 630051 1 2024-09-17T01:06:57.911 INFO:tasks.workunit.client.1.smithi143.stdout:6/316: dread d2/df/d20/f34 [0,4194304] 0 2024-09-17T01:06:57.915 INFO:tasks.workunit.client.1.smithi143.stdout:6/317: truncate d2/d7/d26/f32 1484662 0 2024-09-17T01:06:57.917 INFO:tasks.workunit.client.1.smithi143.stdout:6/318: read d2/df/d20/d2c/f22 [170832,37029] 0 2024-09-17T01:06:57.917 INFO:tasks.workunit.client.1.smithi143.stdout:6/319: stat d2/d7/c5c 0 2024-09-17T01:06:57.917 INFO:tasks.workunit.client.1.smithi143.stdout:6/320: chown d2/df/d20/f5a 1200687276 1 2024-09-17T01:06:57.919 INFO:tasks.workunit.client.1.smithi143.stdout:6/321: read d2/df/d20/f5a [1960004,58919] 0 2024-09-17T01:06:57.933 INFO:tasks.workunit.client.1.smithi143.stdout:6/322: dread d2/df/d20/d2c/f22 [0,4194304] 0 2024-09-17T01:06:57.934 INFO:tasks.workunit.client.1.smithi143.stdout:6/323: chown d2/f5 35240411 1 2024-09-17T01:06:57.935 INFO:tasks.workunit.client.1.smithi143.stdout:6/324: symlink d2/df/d20/l5d 0 2024-09-17T01:06:57.938 INFO:tasks.workunit.client.1.smithi143.stdout:6/325: dread d2/d7/d26/f3b [0,4194304] 0 2024-09-17T01:06:57.940 INFO:tasks.workunit.client.1.smithi143.stdout:6/326: mkdir d2/d30/d45/d4a/d5e 0 2024-09-17T01:06:57.941 INFO:tasks.workunit.client.1.smithi143.stdout:6/327: mknod d2/d17/d3a/c5f 0 2024-09-17T01:06:57.947 INFO:tasks.workunit.client.1.smithi143.stdout:6/328: dwrite d2/d7/d26/f3b [0,4194304] 0 2024-09-17T01:06:57.947 INFO:tasks.workunit.client.1.smithi143.stdout:6/329: fsync d2/f5 0 2024-09-17T01:06:57.951 INFO:tasks.workunit.client.1.smithi143.stdout:6/330: fdatasync d2/d30/d45/f4d 0 2024-09-17T01:06:57.956 INFO:tasks.workunit.client.1.smithi143.stdout:6/331: creat d2/d30/d45/d56/f60 x:0 0 0 2024-09-17T01:06:57.956 INFO:tasks.workunit.client.1.smithi143.stdout:6/332: dread - d2/d30/d45/f50 zero size 2024-09-17T01:06:57.958 INFO:tasks.workunit.client.1.smithi143.stdout:6/333: creat d2/df/d20/f61 x:0 0 0 2024-09-17T01:06:57.959 INFO:tasks.workunit.client.1.smithi143.stdout:6/334: mkdir d2/d30/d45/d62 0 2024-09-17T01:06:57.961 INFO:tasks.workunit.client.1.smithi143.stdout:6/335: write d2/d7/d26/d46/f4b [3745442,71326] 0 2024-09-17T01:06:57.962 INFO:tasks.workunit.client.1.smithi143.stdout:6/336: mknod d2/d30/c63 0 2024-09-17T01:06:57.964 INFO:tasks.workunit.client.1.smithi143.stdout:6/337: mkdir d2/d64 0 2024-09-17T01:06:57.966 INFO:tasks.workunit.client.1.smithi143.stdout:6/338: write d2/d7/f3e [1467623,109153] 0 2024-09-17T01:06:57.966 INFO:tasks.workunit.client.1.smithi143.stdout:6/339: readlink d2/d7/l58 0 2024-09-17T01:06:57.969 INFO:tasks.workunit.client.1.smithi143.stdout:6/340: getdents d2/d7 0 2024-09-17T01:06:57.971 INFO:tasks.workunit.client.1.smithi143.stdout:6/341: mkdir d2/d7/d26/d46/d65 0 2024-09-17T01:06:57.972 INFO:tasks.workunit.client.1.smithi143.stdout:6/342: unlink d2/d7/c5c 0 2024-09-17T01:06:57.973 INFO:tasks.workunit.client.1.smithi143.stdout:6/343: write d2/df/f31 [3557308,26393] 0 2024-09-17T01:06:57.978 INFO:tasks.workunit.client.1.smithi143.stdout:6/344: mkdir d2/d7/d26/d46/d66 0 2024-09-17T01:06:57.981 INFO:tasks.workunit.client.1.smithi143.stdout:6/345: rmdir d2/d30/d45/d62 0 2024-09-17T01:06:57.982 INFO:tasks.workunit.client.1.smithi143.stdout:6/346: chown d2/df/d20/d2c/f24 5216754 1 2024-09-17T01:06:57.987 INFO:tasks.workunit.client.1.smithi143.stdout:6/347: dwrite d2/df/d40/d41/f4c [0,4194304] 0 2024-09-17T01:06:57.989 INFO:tasks.workunit.client.1.smithi143.stdout:6/348: write d2/df/d18/f21 [1535706,83623] 0 2024-09-17T01:06:57.990 INFO:tasks.workunit.client.1.smithi143.stdout:6/349: fdatasync d2/df/d20/d2c/d38/f39 0 2024-09-17T01:06:57.997 INFO:tasks.workunit.client.1.smithi143.stdout:6/350: dread d2/d7/d26/f32 [0,4194304] 0 2024-09-17T01:06:57.999 INFO:tasks.workunit.client.1.smithi143.stdout:6/351: mkdir d2/d30/d45/d67 0 2024-09-17T01:06:58.001 INFO:tasks.workunit.client.1.smithi143.stdout:6/352: rename d2/d17/c55 to d2/d17/c68 0 2024-09-17T01:06:58.002 INFO:tasks.workunit.client.1.smithi143.stdout:6/353: truncate d2/df/f2e 1479455 0 2024-09-17T01:06:58.003 INFO:tasks.workunit.client.1.smithi143.stdout:6/354: mkdir d2/df/d18/d69 0 2024-09-17T01:06:58.005 INFO:tasks.workunit.client.1.smithi143.stdout:6/355: symlink d2/df/d20/d2c/d38/l6a 0 2024-09-17T01:06:58.006 INFO:tasks.workunit.client.1.smithi143.stdout:6/356: chown d2/df/d20/d2c 201639461 1 2024-09-17T01:06:58.008 INFO:tasks.workunit.client.1.smithi143.stdout:6/357: rename d2/df/d40/f59 to d2/df/f6b 0 2024-09-17T01:06:58.008 INFO:tasks.workunit.client.1.smithi143.stdout:6/358: fsync d2/df/f31 0 2024-09-17T01:06:58.009 INFO:tasks.workunit.client.1.smithi143.stdout:6/359: readlink d2/d30/l3d 0 2024-09-17T01:06:58.009 INFO:tasks.workunit.client.1.smithi143.stdout:6/360: fsync d2/d7/d26/d46/f4b 0 2024-09-17T01:06:58.011 INFO:tasks.workunit.client.1.smithi143.stdout:6/361: truncate d2/d17/f25 464868 0 2024-09-17T01:06:58.050 INFO:tasks.workunit.client.1.smithi143.stdout:7/459: sync 2024-09-17T01:06:58.050 INFO:tasks.workunit.client.1.smithi143.stdout:2/381: sync 2024-09-17T01:06:58.052 INFO:tasks.workunit.client.1.smithi143.stdout:2/382: mkdir d0/d10/d58/d5a/d5b/d4c/d77 0 2024-09-17T01:06:58.053 INFO:tasks.workunit.client.1.smithi143.stdout:2/383: chown d0/d2/d21/d22/f2f 0 1 2024-09-17T01:06:58.061 INFO:tasks.workunit.client.1.smithi143.stdout:2/384: dwrite d0/d10/d58/d5a/d5b/d4c/f63 [0,4194304] 0 2024-09-17T01:06:58.062 INFO:tasks.workunit.client.1.smithi143.stdout:7/460: dread d4/d1f/f23 [0,4194304] 0 2024-09-17T01:06:58.063 INFO:tasks.workunit.client.1.smithi143.stdout:2/385: creat d0/d10/d58/d5a/f78 x:0 0 0 2024-09-17T01:06:58.066 INFO:tasks.workunit.client.1.smithi143.stdout:7/461: rmdir d4/d1f/d4a 39 2024-09-17T01:06:58.071 INFO:tasks.workunit.client.1.smithi143.stdout:2/386: dwrite d0/d2/d21/d22/f3c [4194304,4194304] 0 2024-09-17T01:06:58.072 INFO:tasks.workunit.client.1.smithi143.stdout:7/462: write d4/d16/f1a [276967,129217] 0 2024-09-17T01:06:58.074 INFO:tasks.workunit.client.1.smithi143.stdout:2/387: rmdir d0/d10/d58 39 2024-09-17T01:06:58.075 INFO:tasks.workunit.client.1.smithi143.stdout:2/388: chown d0/d10/d56 1390605975 1 2024-09-17T01:06:58.076 INFO:tasks.workunit.client.1.smithi143.stdout:7/463: unlink d4/d1f/f43 0 2024-09-17T01:06:58.080 INFO:tasks.workunit.client.1.smithi143.stdout:2/389: mkdir d0/d10/d58/d79 0 2024-09-17T01:06:58.081 INFO:tasks.workunit.client.1.smithi143.stdout:2/390: mkdir d0/d44/d7a 0 2024-09-17T01:06:58.084 INFO:tasks.workunit.client.1.smithi143.stdout:7/464: creat d4/d1f/d4a/f94 x:0 0 0 2024-09-17T01:06:58.084 INFO:tasks.workunit.client.1.smithi143.stdout:2/391: symlink d0/d44/d6a/l7b 0 2024-09-17T01:06:58.090 INFO:tasks.workunit.client.1.smithi143.stdout:7/465: dwrite d4/d1f/d4a/f94 [0,4194304] 0 2024-09-17T01:06:58.090 INFO:tasks.workunit.client.1.smithi143.stdout:2/392: dwrite d0/d10/f16 [4194304,4194304] 0 2024-09-17T01:06:58.091 INFO:tasks.workunit.client.1.smithi143.stdout:7/466: fsync d4/d1f/f52 0 2024-09-17T01:06:58.093 INFO:tasks.workunit.client.1.smithi143.stdout:7/467: write d4/d1f/f3e [3506168,107469] 0 2024-09-17T01:06:58.095 INFO:tasks.workunit.client.1.smithi143.stdout:2/393: symlink d0/d10/d58/d5a/d5b/d4c/d77/l7c 0 2024-09-17T01:06:58.101 INFO:tasks.workunit.client.1.smithi143.stdout:7/468: dwrite d4/d1f/d29/d65/f7c [0,4194304] 0 2024-09-17T01:06:58.128 INFO:tasks.workunit.client.1.smithi143.stdout:2/394: dread d0/d2/fe [0,4194304] 0 2024-09-17T01:06:58.132 INFO:tasks.workunit.client.1.smithi143.stdout:2/395: link d0/f42 d0/d44/d7a/f7d 0 2024-09-17T01:06:58.132 INFO:tasks.workunit.client.1.smithi143.stdout:2/396: readlink d0/d44/l6f 0 2024-09-17T01:06:58.136 INFO:tasks.workunit.client.1.smithi143.stdout:7/469: dread d4/f1b [4194304,4194304] 0 2024-09-17T01:06:58.137 INFO:tasks.workunit.client.1.smithi143.stdout:2/397: dwrite d0/d10/f47 [0,4194304] 0 2024-09-17T01:06:58.138 INFO:tasks.workunit.client.1.smithi143.stdout:7/470: rmdir d4/d1f/d4a 39 2024-09-17T01:06:58.144 INFO:tasks.workunit.client.1.smithi143.stdout:2/398: symlink d0/d10/d58/d5a/d5b/d4c/d71/l7e 0 2024-09-17T01:06:58.144 INFO:tasks.workunit.client.1.smithi143.stdout:2/399: chown d0/d2/d21/d22/f28 194101376 1 2024-09-17T01:06:58.144 INFO:tasks.workunit.client.1.smithi143.stdout:7/471: dwrite d4/d16/f1a [0,4194304] 0 2024-09-17T01:06:58.150 INFO:tasks.workunit.client.1.smithi143.stdout:7/472: dread - d4/d1f/d4a/d66/f75 zero size 2024-09-17T01:06:58.154 INFO:tasks.workunit.client.1.smithi143.stdout:7/473: creat d4/f95 x:0 0 0 2024-09-17T01:06:58.156 INFO:tasks.workunit.client.1.smithi143.stdout:7/474: creat d4/d1f/d4a/f96 x:0 0 0 2024-09-17T01:06:58.162 INFO:tasks.workunit.client.1.smithi143.stdout:7/475: dwrite d4/d1f/f3e [0,4194304] 0 2024-09-17T01:06:58.166 INFO:tasks.workunit.client.1.smithi143.stdout:7/476: getdents d4/d16 0 2024-09-17T01:06:58.168 INFO:tasks.workunit.client.1.smithi143.stdout:7/477: write d4/d16/f17 [614808,101441] 0 2024-09-17T01:06:58.170 INFO:tasks.workunit.client.1.smithi143.stdout:7/478: mkdir d4/d16/d97 0 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:0/456: sync 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:5/414: sync 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:4/361: sync 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:8/393: sync 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:9/376: sync 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:3/350: sync 2024-09-17T01:06:58.171 INFO:tasks.workunit.client.1.smithi143.stdout:1/470: sync 2024-09-17T01:06:58.172 INFO:tasks.workunit.client.1.smithi143.stdout:7/479: chown d4/d16/f1d 350817 1 2024-09-17T01:06:58.172 INFO:tasks.workunit.client.1.smithi143.stdout:2/400: dread d0/d44/f46 [4194304,4194304] 0 2024-09-17T01:06:58.174 INFO:tasks.workunit.client.1.smithi143.stdout:8/394: write d9/d12/d38/f3d [1106450,88444] 0 2024-09-17T01:06:58.176 INFO:tasks.workunit.client.1.smithi143.stdout:0/457: readlink d3/d5/d8/d27/l7b 0 2024-09-17T01:06:58.181 INFO:tasks.workunit.client.1.smithi143.stdout:5/415: getdents d1/d46/df/d53/d74/d9a/d9c 0 2024-09-17T01:06:58.185 INFO:tasks.workunit.client.1.smithi143.stdout:2/401: dread d0/d2/d21/f49 [0,4194304] 0 2024-09-17T01:06:58.187 INFO:tasks.workunit.client.1.smithi143.stdout:8/395: creat d9/d12/d13/d7c/f91 x:0 0 0 2024-09-17T01:06:58.188 INFO:tasks.workunit.client.1.smithi143.stdout:0/458: creat d3/d5/d8/d27/d31/d48/d72/f95 x:0 0 0 2024-09-17T01:06:58.190 INFO:tasks.workunit.client.1.smithi143.stdout:5/416: write d1/d46/f48 [2765004,58530] 0 2024-09-17T01:06:58.190 INFO:tasks.workunit.client.1.smithi143.stdout:9/377: dread d3/d16/d34/f5b [0,4194304] 0 2024-09-17T01:06:58.190 INFO:tasks.workunit.client.1.smithi143.stdout:2/402: fsync d0/d10/f5c 0 2024-09-17T01:06:58.191 INFO:tasks.workunit.client.1.smithi143.stdout:1/471: dread d0/d6/d43/d6a/df/f8c [0,4194304] 0 2024-09-17T01:06:58.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/351: dwrite d6/d1c/f2a [4194304,4194304] 0 2024-09-17T01:06:58.194 INFO:tasks.workunit.client.1.smithi143.stdout:7/480: dwrite d4/d1f/f80 [0,4194304] 0 2024-09-17T01:06:58.194 INFO:tasks.workunit.client.1.smithi143.stdout:4/362: dwrite da/d3a/d3e/d42/f69 [0,4194304] 0 2024-09-17T01:06:58.196 INFO:tasks.workunit.client.1.smithi143.stdout:9/378: stat d3/d39/f72 0 2024-09-17T01:06:58.198 INFO:tasks.workunit.client.1.smithi143.stdout:2/403: fsync d0/f42 0 2024-09-17T01:06:58.198 INFO:tasks.workunit.client.1.smithi143.stdout:3/352: readlink d6/l8 0 2024-09-17T01:06:58.198 INFO:tasks.workunit.client.1.smithi143.stdout:0/459: write d3/d5/d8/d27/f6a [163666,13799] 0 2024-09-17T01:06:58.200 INFO:tasks.workunit.client.1.smithi143.stdout:6/362: sync 2024-09-17T01:06:58.202 INFO:tasks.workunit.client.1.smithi143.stdout:2/404: fdatasync d0/d10/d58/f68 0 2024-09-17T01:06:58.203 INFO:tasks.workunit.client.1.smithi143.stdout:0/460: chown d3/f40 31942 1 2024-09-17T01:06:58.205 INFO:tasks.workunit.client.1.smithi143.stdout:4/363: mkdir da/d3a/d3e/d72 0 2024-09-17T01:06:58.206 INFO:tasks.workunit.client.1.smithi143.stdout:7/481: truncate d4/f18 649860 0 2024-09-17T01:06:58.208 INFO:tasks.workunit.client.1.smithi143.stdout:3/353: mkdir d6/d68 0 2024-09-17T01:06:58.210 INFO:tasks.workunit.client.1.smithi143.stdout:0/461: mknod d3/d14/d32/c96 0 2024-09-17T01:06:58.210 INFO:tasks.workunit.client.1.smithi143.stdout:6/363: fsync d2/d30/d45/f4d 0 2024-09-17T01:06:58.212 INFO:tasks.workunit.client.1.smithi143.stdout:4/364: rmdir da/d3a/d3e/d4a 39 2024-09-17T01:06:58.212 INFO:tasks.workunit.client.1.smithi143.stdout:8/396: dwrite d9/d2b/f78 [0,4194304] 0 2024-09-17T01:06:58.213 INFO:tasks.workunit.client.1.smithi143.stdout:5/417: getdents d1/d46/df/d53/d74/d9a 0 2024-09-17T01:06:58.214 INFO:tasks.workunit.client.1.smithi143.stdout:7/482: mkdir d4/d1f/d98 0 2024-09-17T01:06:58.219 INFO:tasks.workunit.client.1.smithi143.stdout:1/472: dread d0/d6/d43/d6a/df/d6e/d2/f3d [0,4194304] 0 2024-09-17T01:06:58.219 INFO:tasks.workunit.client.1.smithi143.stdout:0/462: fsync d3/d14/d3d/f83 0 2024-09-17T01:06:58.220 INFO:tasks.workunit.client.1.smithi143.stdout:4/365: dread - da/d3a/d3e/d42/f46 zero size 2024-09-17T01:06:58.220 INFO:tasks.workunit.client.1.smithi143.stdout:6/364: unlink d2/d30/f52 0 2024-09-17T01:06:58.223 INFO:tasks.workunit.client.1.smithi143.stdout:7/483: truncate d4/f44 944182 0 2024-09-17T01:06:58.223 INFO:tasks.workunit.client.1.smithi143.stdout:3/354: creat d6/d1c/d33/d41/d2e/d30/f69 x:0 0 0 2024-09-17T01:06:58.225 INFO:tasks.workunit.client.1.smithi143.stdout:2/405: dread d0/d2/d21/f27 [0,4194304] 0 2024-09-17T01:06:58.225 INFO:tasks.workunit.client.1.smithi143.stdout:8/397: creat d9/d12/d38/d7a/d8f/f92 x:0 0 0 2024-09-17T01:06:58.226 INFO:tasks.workunit.client.1.smithi143.stdout:9/379: dwrite d3/d39/d6a/d9/f11 [0,4194304] 0 2024-09-17T01:06:58.228 INFO:tasks.workunit.client.1.smithi143.stdout:0/463: mknod d3/d5/d35/c97 0 2024-09-17T01:06:58.231 INFO:tasks.workunit.client.1.smithi143.stdout:1/473: rename d0/d6/f23 to d0/d6/d43/d47/d68/d7b/f9f 0 2024-09-17T01:06:58.232 INFO:tasks.workunit.client.1.smithi143.stdout:7/484: creat d4/d1f/d29/d65/f99 x:0 0 0 2024-09-17T01:06:58.238 INFO:tasks.workunit.client.1.smithi143.stdout:8/398: creat d9/d23/d48/d56/d66/d7d/f93 x:0 0 0 2024-09-17T01:06:58.239 INFO:tasks.workunit.client.1.smithi143.stdout:3/355: dwrite d6/d1c/d33/d41/d2e/f47 [0,4194304] 0 2024-09-17T01:06:58.240 INFO:tasks.workunit.client.1.smithi143.stdout:4/366: creat da/f73 x:0 0 0 2024-09-17T01:06:58.242 INFO:tasks.workunit.client.1.smithi143.stdout:4/367: chown da/d3a/d3e/d5e/d63/l6e 4122257 1 2024-09-17T01:06:58.242 INFO:tasks.workunit.client.1.smithi143.stdout:9/380: unlink d3/d16/d3e/d51/d52/c6f 0 2024-09-17T01:06:58.244 INFO:tasks.workunit.client.1.smithi143.stdout:4/368: fsync da/d3a/d40/f34 0 2024-09-17T01:06:58.244 INFO:tasks.workunit.client.1.smithi143.stdout:0/464: creat d3/d88/d93/f98 x:0 0 0 2024-09-17T01:06:58.246 INFO:tasks.workunit.client.1.smithi143.stdout:4/369: write da/fe [2823271,91328] 0 2024-09-17T01:06:58.249 INFO:tasks.workunit.client.1.smithi143.stdout:5/418: dread d1/f2b [0,4194304] 0 2024-09-17T01:06:58.250 INFO:tasks.workunit.client.1.smithi143.stdout:6/365: getdents d2/df/d20 0 2024-09-17T01:06:58.256 INFO:tasks.workunit.client.1.smithi143.stdout:3/356: mknod d6/d1c/d33/d3f/d5c/c6a 0 2024-09-17T01:06:58.256 INFO:tasks.workunit.client.1.smithi143.stdout:8/399: creat d9/d12/d4b/d3f/f94 x:0 0 0 2024-09-17T01:06:58.257 INFO:tasks.workunit.client.1.smithi143.stdout:6/366: mkdir d2/df/d40/d41/d6c 0 2024-09-17T01:06:58.258 INFO:tasks.workunit.client.1.smithi143.stdout:0/465: dread d3/d5/d8/d21/f47 [0,4194304] 0 2024-09-17T01:06:58.258 INFO:tasks.workunit.client.1.smithi143.stdout:2/406: rename d0/d44/d6a/c6b to d0/d10/d58/d5a/d5b/c7f 0 2024-09-17T01:06:58.260 INFO:tasks.workunit.client.1.smithi143.stdout:4/370: dread da/f32 [0,4194304] 0 2024-09-17T01:06:58.264 INFO:tasks.workunit.client.1.smithi143.stdout:5/419: dwrite d1/d46/df/d53/f85 [0,4194304] 0 2024-09-17T01:06:58.264 INFO:tasks.workunit.client.1.smithi143.stdout:7/485: rename d4/d1f/d4a/d66/f67 to d4/d33/f9a 0 2024-09-17T01:06:58.265 INFO:tasks.workunit.client.1.smithi143.stdout:8/400: write d9/d12/d13/f33 [2121370,25753] 0 2024-09-17T01:06:58.266 INFO:tasks.workunit.client.1.smithi143.stdout:9/381: getdents d3/d16 0 2024-09-17T01:06:58.271 INFO:tasks.workunit.client.1.smithi143.stdout:4/371: creat da/d6d/f74 x:0 0 0 2024-09-17T01:06:58.271 INFO:tasks.workunit.client.1.smithi143.stdout:2/407: creat d0/f80 x:0 0 0 2024-09-17T01:06:58.272 INFO:tasks.workunit.client.1.smithi143.stdout:6/367: link d2/df/d20/f53 d2/f6d 0 2024-09-17T01:06:58.273 INFO:tasks.workunit.client.1.smithi143.stdout:1/474: dwrite d0/d6/d43/d47/d68/d7b/f9f [0,4194304] 0 2024-09-17T01:06:58.275 INFO:tasks.workunit.client.1.smithi143.stdout:5/420: symlink d1/d46/df/d1f/d9f/la8 0 2024-09-17T01:06:58.276 INFO:tasks.workunit.client.1.smithi143.stdout:8/401: read - d9/d23/d4f/f6e zero size 2024-09-17T01:06:58.280 INFO:tasks.workunit.client.1.smithi143.stdout:3/357: truncate d6/d1c/d33/f38 5001647 0 2024-09-17T01:06:58.280 INFO:tasks.workunit.client.1.smithi143.stdout:2/408: chown d0/d10/f17 1 1 2024-09-17T01:06:58.281 INFO:tasks.workunit.client.1.smithi143.stdout:6/368: rename d2/d7 to d2/d17/d6e 0 2024-09-17T01:06:58.282 INFO:tasks.workunit.client.1.smithi143.stdout:8/402: symlink d9/d23/d48/d55/d57/l95 0 2024-09-17T01:06:58.283 INFO:tasks.workunit.client.1.smithi143.stdout:1/475: chown d0/d6/d43/d6a/df/d6e/d2/d39 0 1 2024-09-17T01:06:58.284 INFO:tasks.workunit.client.1.smithi143.stdout:7/486: dwrite d4/d26/f76 [0,4194304] 0 2024-09-17T01:06:58.286 INFO:tasks.workunit.client.1.smithi143.stdout:9/382: write d3/d39/d6a/d9/f6b [810390,40019] 0 2024-09-17T01:06:58.286 INFO:tasks.workunit.client.1.smithi143.stdout:6/369: readlink d2/df/d20/d2c/l4e 0 2024-09-17T01:06:58.289 INFO:tasks.workunit.client.1.smithi143.stdout:0/466: link d3/d5/d8/d27/d31/d4c/c87 d3/d5/d8/d27/d31/d48/d62/c99 0 2024-09-17T01:06:58.292 INFO:tasks.workunit.client.1.smithi143.stdout:2/409: write d0/d10/f34 [1458247,87718] 0 2024-09-17T01:06:58.292 INFO:tasks.workunit.client.1.smithi143.stdout:8/403: creat d9/d23/d48/d56/f96 x:0 0 0 2024-09-17T01:06:58.293 INFO:tasks.workunit.client.1.smithi143.stdout:5/421: symlink d1/d46/d9d/la9 0 2024-09-17T01:06:58.293 INFO:tasks.workunit.client.1.smithi143.stdout:1/476: rmdir d0/dc/d57/d58 39 2024-09-17T01:06:58.293 INFO:tasks.workunit.client.1.smithi143.stdout:4/372: dwrite da/d68/f5d [0,4194304] 0 2024-09-17T01:06:58.294 INFO:tasks.workunit.client.1.smithi143.stdout:9/383: dread d3/d16/f45 [0,4194304] 0 2024-09-17T01:06:58.295 INFO:tasks.workunit.client.1.smithi143.stdout:7/487: chown d4/d1f/d29/c2e 5033 1 2024-09-17T01:06:58.298 INFO:tasks.workunit.client.1.smithi143.stdout:2/410: symlink d0/d2/d21/l81 0 2024-09-17T01:06:58.307 INFO:tasks.workunit.client.1.smithi143.stdout:1/477: mknod d0/d6/d43/d6a/df/d27/ca0 0 2024-09-17T01:06:58.308 INFO:tasks.workunit.client.1.smithi143.stdout:6/370: truncate d2/df/d20/d2c/d38/f39 1016404 0 2024-09-17T01:06:58.310 INFO:tasks.workunit.client.1.smithi143.stdout:5/422: write d1/f68 [234347,14289] 0 2024-09-17T01:06:58.311 INFO:tasks.workunit.client.1.smithi143.stdout:0/467: dread d3/d68/f70 [0,4194304] 0 2024-09-17T01:06:58.413 INFO:tasks.workunit.client.1.smithi143.stdout:1/478: mkdir d0/da1 0 2024-09-17T01:06:58.413 INFO:tasks.workunit.client.1.smithi143.stdout:2/411: rename d0/d10/d58/d5a/d5b/l4f to d0/d44/l82 0 2024-09-17T01:06:58.414 INFO:tasks.workunit.client.1.smithi143.stdout:3/358: dwrite d6/d1c/d33/d41/f1a [4194304,4194304] 0 2024-09-17T01:06:58.414 INFO:tasks.workunit.client.1.smithi143.stdout:8/404: link d9/d12/d38/f43 d9/de/f97 0 2024-09-17T01:06:58.416 INFO:tasks.workunit.client.1.smithi143.stdout:5/423: dread - d1/d46/df/d53/fa2 zero size 2024-09-17T01:06:58.422 INFO:tasks.workunit.client.1.smithi143.stdout:7/488: dwrite d4/d1f/d4a/d66/f6c [0,4194304] 0 2024-09-17T01:06:58.422 INFO:tasks.workunit.client.1.smithi143.stdout:6/371: dread d2/df/f2e [0,4194304] 0 2024-09-17T01:06:58.423 INFO:tasks.workunit.client.1.smithi143.stdout:5/424: write d1/d46/df/f3d [2478608,43522] 0 2024-09-17T01:06:58.426 INFO:tasks.workunit.client.1.smithi143.stdout:3/359: symlink d6/d1c/d33/d3f/d5c/l6b 0 2024-09-17T01:06:58.426 INFO:tasks.workunit.client.1.smithi143.stdout:7/489: read d4/d16/f1d [1320894,79684] 0 2024-09-17T01:06:58.427 INFO:tasks.workunit.client.1.smithi143.stdout:0/468: symlink d3/d5/d8/d27/d31/d85/l9a 0 2024-09-17T01:06:58.428 INFO:tasks.workunit.client.1.smithi143.stdout:1/479: symlink d0/d6/d43/d6a/df/d6e/d18/d2d/la2 0 2024-09-17T01:06:58.430 INFO:tasks.workunit.client.1.smithi143.stdout:3/360: write d6/d1c/f2a [1905619,68707] 0 2024-09-17T01:06:58.431 INFO:tasks.workunit.client.1.smithi143.stdout:1/480: chown d0/d6/d43 113239411 1 2024-09-17T01:06:58.431 INFO:tasks.workunit.client.1.smithi143.stdout:6/372: rename d2/df/f43 to d2/d30/d45/d56/f6f 0 2024-09-17T01:06:58.432 INFO:tasks.workunit.client.1.smithi143.stdout:8/405: dread d9/d23/d48/f40 [0,4194304] 0 2024-09-17T01:06:58.434 INFO:tasks.workunit.client.1.smithi143.stdout:0/469: mkdir d3/d5/d8/d21/d9b 0 2024-09-17T01:06:58.436 INFO:tasks.workunit.client.1.smithi143.stdout:6/373: fsync d2/df/f2e 0 2024-09-17T01:06:58.436 INFO:tasks.workunit.client.1.smithi143.stdout:5/425: dread d1/f2b [0,4194304] 0 2024-09-17T01:06:58.438 INFO:tasks.workunit.client.1.smithi143.stdout:1/481: rmdir d0/d6/d43/d6a/df/d6e 39 2024-09-17T01:06:58.440 INFO:tasks.workunit.client.1.smithi143.stdout:3/361: getdents d6/d1c/d33/d41/d42 0 2024-09-17T01:06:58.441 INFO:tasks.workunit.client.1.smithi143.stdout:0/470: read d3/d5/f9 [2010402,73355] 0 2024-09-17T01:06:58.443 INFO:tasks.workunit.client.1.smithi143.stdout:5/426: readlink d1/d46/df/d1f/d9f/la8 0 2024-09-17T01:06:58.443 INFO:tasks.workunit.client.1.smithi143.stdout:9/384: dread d3/d16/f46 [0,4194304] 0 2024-09-17T01:06:58.443 INFO:tasks.workunit.client.1.smithi143.stdout:6/374: fsync d2/d30/d45/f50 0 2024-09-17T01:06:58.443 INFO:tasks.workunit.client.1.smithi143.stdout:7/490: dwrite d4/d1f/d4a/f89 [0,4194304] 0 2024-09-17T01:06:58.500 INFO:tasks.workunit.client.1.smithi143.stdout:3/362: creat d6/d1c/d33/d41/d2e/d30/f6c x:0 0 0 2024-09-17T01:06:58.501 INFO:tasks.workunit.client.1.smithi143.stdout:7/491: chown d4/d33/d4e/c7e 72565 1 2024-09-17T01:06:58.501 INFO:tasks.workunit.client.1.smithi143.stdout:1/482: symlink d0/d6/d43/d6a/df/d6e/d2/la3 0 2024-09-17T01:06:58.502 INFO:tasks.workunit.client.1.smithi143.stdout:8/406: dwrite d9/d23/d48/f76 [0,4194304] 0 2024-09-17T01:06:58.502 INFO:tasks.workunit.client.1.smithi143.stdout:5/427: truncate d1/d46/df/d23/f90 107454 0 2024-09-17T01:06:58.502 INFO:tasks.workunit.client.1.smithi143.stdout:9/385: truncate d3/d39/d6a/d9/f49 804145 0 2024-09-17T01:06:58.504 INFO:tasks.workunit.client.1.smithi143.stdout:6/375: unlink d2/df/d20/d2c/d38/l6a 0 2024-09-17T01:06:58.506 INFO:tasks.workunit.client.1.smithi143.stdout:7/492: mknod d4/d33/c9b 0 2024-09-17T01:06:58.510 INFO:tasks.workunit.client.1.smithi143.stdout:5/428: dread d1/d5e/f65 [0,4194304] 0 2024-09-17T01:06:58.567 INFO:tasks.workunit.client.1.smithi143.stdout:9/386: mkdir d3/d39/d42/d80 0 2024-09-17T01:06:58.567 INFO:tasks.workunit.client.1.smithi143.stdout:9/387: stat d3/d39/d6a/f2a 0 2024-09-17T01:06:58.567 INFO:tasks.workunit.client.1.smithi143.stdout:6/376: mkdir d2/d30/d45/d70 0 2024-09-17T01:06:58.568 INFO:tasks.workunit.client.1.smithi143.stdout:4/373: sync 2024-09-17T01:06:58.568 INFO:tasks.workunit.client.1.smithi143.stdout:0/471: sync 2024-09-17T01:06:58.569 INFO:tasks.workunit.client.1.smithi143.stdout:2/412: sync 2024-09-17T01:06:58.570 INFO:tasks.workunit.client.1.smithi143.stdout:8/407: rename d9/d23/c24 to d9/d23/d4f/c98 0 2024-09-17T01:06:58.572 INFO:tasks.workunit.client.1.smithi143.stdout:5/429: mkdir d1/d46/d9b/daa 0 2024-09-17T01:06:58.573 INFO:tasks.workunit.client.1.smithi143.stdout:9/388: mkdir d3/d81 0 2024-09-17T01:06:58.575 INFO:tasks.workunit.client.1.smithi143.stdout:3/363: link d6/d1c/d33/d41/d42/f63 d6/d1c/d4d/f6d 0 2024-09-17T01:06:58.576 INFO:tasks.workunit.client.1.smithi143.stdout:8/408: unlink d9/d23/d32/l42 0 2024-09-17T01:06:58.576 INFO:tasks.workunit.client.1.smithi143.stdout:9/389: dread - d3/d3d/f7c zero size 2024-09-17T01:06:58.577 INFO:tasks.workunit.client.1.smithi143.stdout:1/483: rename d0/d6/c81 to d0/d6/d43/d6a/df/d6e/d2/d39/d79/ca4 0 2024-09-17T01:06:58.581 INFO:tasks.workunit.client.1.smithi143.stdout:7/493: getdents d4/d33 0 2024-09-17T01:06:58.582 INFO:tasks.workunit.client.1.smithi143.stdout:2/413: dwrite d0/d10/f11 [8388608,4194304] 0 2024-09-17T01:06:58.582 INFO:tasks.workunit.client.1.smithi143.stdout:3/364: symlink d6/d1c/l6e 0 2024-09-17T01:06:58.584 INFO:tasks.workunit.client.1.smithi143.stdout:4/374: dwrite da/d3a/d3e/d5e/f62 [0,4194304] 0 2024-09-17T01:06:58.585 INFO:tasks.workunit.client.1.smithi143.stdout:1/484: stat d0/d6/d43/d6a/df/d6e/d18/d4d/l77 0 2024-09-17T01:06:58.585 INFO:tasks.workunit.client.1.smithi143.stdout:9/390: truncate d3/d39/d42/f54 822765 0 2024-09-17T01:06:58.586 INFO:tasks.workunit.client.1.smithi143.stdout:6/377: rename d2/df/d20/d2c/f24 to d2/d30/d45/d67/f71 0 2024-09-17T01:06:58.587 INFO:tasks.workunit.client.1.smithi143.stdout:8/409: symlink d9/d23/d48/d56/d66/l99 0 2024-09-17T01:06:58.592 INFO:tasks.workunit.client.1.smithi143.stdout:1/485: rmdir d0/dc/d57 39 2024-09-17T01:06:58.594 INFO:tasks.workunit.client.1.smithi143.stdout:9/391: creat d3/d39/f82 x:0 0 0 2024-09-17T01:06:58.595 INFO:tasks.workunit.client.1.smithi143.stdout:8/410: fdatasync d9/d12/d13/f4d 0 2024-09-17T01:06:58.596 INFO:tasks.workunit.client.1.smithi143.stdout:0/472: dread d3/d5/d8/d27/f1e [0,4194304] 0 2024-09-17T01:06:58.596 INFO:tasks.workunit.client.1.smithi143.stdout:4/375: getdents da/d3a 0 2024-09-17T01:06:58.597 INFO:tasks.workunit.client.1.smithi143.stdout:7/494: dread d4/d26/f76 [0,4194304] 0 2024-09-17T01:06:58.597 INFO:tasks.workunit.client.1.smithi143.stdout:2/414: write d0/f4a [4907562,95195] 0 2024-09-17T01:06:58.598 INFO:tasks.workunit.client.1.smithi143.stdout:6/378: creat d2/df/d20/d2c/d38/f72 x:0 0 0 2024-09-17T01:06:58.603 INFO:tasks.workunit.client.1.smithi143.stdout:6/379: rmdir d2/d17 39 2024-09-17T01:06:58.604 INFO:tasks.workunit.client.1.smithi143.stdout:4/376: write da/d3a/d3e/d42/f46 [567333,97567] 0 2024-09-17T01:06:58.605 INFO:tasks.workunit.client.1.smithi143.stdout:9/392: truncate d3/d39/d6a/d26/f69 128624 0 2024-09-17T01:06:58.607 INFO:tasks.workunit.client.1.smithi143.stdout:1/486: dread d0/d6/d43/d6a/df/d6e/d2/f3d [0,4194304] 0 2024-09-17T01:06:58.607 INFO:tasks.workunit.client.1.smithi143.stdout:3/365: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:06:58.607 INFO:tasks.workunit.client.1.smithi143.stdout:0/473: creat d3/d5/d8/d27/d8c/f9c x:0 0 0 2024-09-17T01:06:58.607 INFO:tasks.workunit.client.1.smithi143.stdout:5/430: dwrite d1/f14 [0,4194304] 0 2024-09-17T01:06:58.608 INFO:tasks.workunit.client.1.smithi143.stdout:6/380: stat d2/df/d40/d41 0 2024-09-17T01:06:58.608 INFO:tasks.workunit.client.1.smithi143.stdout:4/377: rmdir da/d68 39 2024-09-17T01:06:58.610 INFO:tasks.workunit.client.1.smithi143.stdout:7/495: getdents d4/d33 0 2024-09-17T01:06:58.612 INFO:tasks.workunit.client.1.smithi143.stdout:2/415: rename d0/d10/d58/d5a/d5b/d4c/d59/c75 to d0/d10/d58/c83 0 2024-09-17T01:06:58.612 INFO:tasks.workunit.client.1.smithi143.stdout:6/381: fsync d2/f6d 0 2024-09-17T01:06:58.613 INFO:tasks.workunit.client.1.smithi143.stdout:7/496: fdatasync d4/d33/d78/f87 0 2024-09-17T01:06:58.614 INFO:tasks.workunit.client.1.smithi143.stdout:8/411: write d9/d23/d32/f51 [4597392,113694] 0 2024-09-17T01:06:58.615 INFO:tasks.workunit.client.1.smithi143.stdout:4/378: chown da/d3a/d3e/d5e/f62 294 1 2024-09-17T01:06:58.615 INFO:tasks.workunit.client.1.smithi143.stdout:3/366: readlink d6/d1c/d33/d41/l53 0 2024-09-17T01:06:58.616 INFO:tasks.workunit.client.1.smithi143.stdout:2/416: write d0/d10/f16 [4203809,40217] 0 2024-09-17T01:06:58.617 INFO:tasks.workunit.client.1.smithi143.stdout:0/474: write d3/d5/d8/d21/f49 [759545,90617] 0 2024-09-17T01:06:58.617 INFO:tasks.workunit.client.1.smithi143.stdout:1/487: mkdir d0/d6/d43/d47/d88/da5 0 2024-09-17T01:06:58.617 INFO:tasks.workunit.client.1.smithi143.stdout:4/379: readlink da/l16 0 2024-09-17T01:06:58.618 INFO:tasks.workunit.client.1.smithi143.stdout:7/497: chown d4/d1f/f52 16 1 2024-09-17T01:06:58.619 INFO:tasks.workunit.client.1.smithi143.stdout:5/431: symlink d1/d46/df/d23/d4f/d7d/lab 0 2024-09-17T01:06:58.619 INFO:tasks.workunit.client.1.smithi143.stdout:2/417: chown d0/d44/d6a/f74 47 1 2024-09-17T01:06:58.619 INFO:tasks.workunit.client.1.smithi143.stdout:7/498: chown d4/d1f/d29 190583 1 2024-09-17T01:06:58.621 INFO:tasks.workunit.client.1.smithi143.stdout:2/418: write d0/ff [4100131,19538] 0 2024-09-17T01:06:58.623 INFO:tasks.workunit.client.1.smithi143.stdout:0/475: rmdir d3/d88 39 2024-09-17T01:06:58.625 INFO:tasks.workunit.client.1.smithi143.stdout:4/380: unlink da/d3a/d3e/d5e/f53 0 2024-09-17T01:06:58.625 INFO:tasks.workunit.client.1.smithi143.stdout:4/381: stat da/d3a/d3e 0 2024-09-17T01:06:58.626 INFO:tasks.workunit.client.1.smithi143.stdout:4/382: write da/f20 [2458649,11813] 0 2024-09-17T01:06:58.627 INFO:tasks.workunit.client.1.smithi143.stdout:3/367: creat d6/d1c/d33/d41/d2e/d30/f6f x:0 0 0 2024-09-17T01:06:58.628 INFO:tasks.workunit.client.1.smithi143.stdout:6/382: rename d2/d30/d45/d56/f6f to d2/d19/f73 0 2024-09-17T01:06:58.629 INFO:tasks.workunit.client.1.smithi143.stdout:3/368: truncate d6/d1c/d33/d41/d2e/d30/f6c 84156 0 2024-09-17T01:06:58.629 INFO:tasks.workunit.client.1.smithi143.stdout:5/432: symlink d1/d46/d9d/lac 0 2024-09-17T01:06:58.630 INFO:tasks.workunit.client.1.smithi143.stdout:2/419: dread d0/d2/d21/f3b [0,4194304] 0 2024-09-17T01:06:58.630 INFO:tasks.workunit.client.1.smithi143.stdout:9/393: link d3/c4a d3/d39/d42/d80/c83 0 2024-09-17T01:06:58.631 INFO:tasks.workunit.client.1.smithi143.stdout:0/476: creat d3/d68/f9d x:0 0 0 2024-09-17T01:06:58.632 INFO:tasks.workunit.client.1.smithi143.stdout:3/369: read d6/d1c/d33/d41/d2e/f47 [796801,63282] 0 2024-09-17T01:06:58.632 INFO:tasks.workunit.client.1.smithi143.stdout:1/488: rename d0/d6/d43/d6a/df/d6e/d2/f3d to d0/d6/d43/d6a/df/d6e/d2/fa6 0 2024-09-17T01:06:58.635 INFO:tasks.workunit.client.1.smithi143.stdout:7/499: mknod d4/d1f/d4a/d66/d86/c9c 0 2024-09-17T01:06:58.639 INFO:tasks.workunit.client.1.smithi143.stdout:8/412: getdents d9/de 0 2024-09-17T01:06:58.639 INFO:tasks.workunit.client.1.smithi143.stdout:2/420: mkdir d0/d2/d21/d84 0 2024-09-17T01:06:58.641 INFO:tasks.workunit.client.1.smithi143.stdout:7/500: unlink d4/l55 0 2024-09-17T01:06:58.643 INFO:tasks.workunit.client.1.smithi143.stdout:5/433: dwrite d1/d46/df/d23/f90 [0,4194304] 0 2024-09-17T01:06:58.643 INFO:tasks.workunit.client.1.smithi143.stdout:0/477: mknod d3/d88/d93/c9e 0 2024-09-17T01:06:58.645 INFO:tasks.workunit.client.1.smithi143.stdout:9/394: link d3/d39/d6a/d9/l1b d3/d16/d34/l84 0 2024-09-17T01:06:58.646 INFO:tasks.workunit.client.1.smithi143.stdout:8/413: mknod d9/d12/d4b/c9a 0 2024-09-17T01:06:58.648 INFO:tasks.workunit.client.1.smithi143.stdout:2/421: symlink d0/d10/d58/d5a/l85 0 2024-09-17T01:06:58.650 INFO:tasks.workunit.client.1.smithi143.stdout:6/383: write d2/fb [2453185,32707] 0 2024-09-17T01:06:58.651 INFO:tasks.workunit.client.1.smithi143.stdout:5/434: rmdir d1/d46/d9b 39 2024-09-17T01:06:58.652 INFO:tasks.workunit.client.1.smithi143.stdout:8/414: fdatasync d9/d12/d38/f3d 0 2024-09-17T01:06:58.652 INFO:tasks.workunit.client.1.smithi143.stdout:3/370: dwrite d6/f44 [0,4194304] 0 2024-09-17T01:06:58.654 INFO:tasks.workunit.client.1.smithi143.stdout:6/384: chown d2/df/d20/f54 4681297 1 2024-09-17T01:06:58.656 INFO:tasks.workunit.client.1.smithi143.stdout:4/383: dread f2 [0,4194304] 0 2024-09-17T01:06:58.657 INFO:tasks.workunit.client.1.smithi143.stdout:4/384: chown da/f1c 64833830 1 2024-09-17T01:06:58.658 INFO:tasks.workunit.client.1.smithi143.stdout:2/422: mkdir d0/d44/d7a/d86 0 2024-09-17T01:06:58.659 INFO:tasks.workunit.client.1.smithi143.stdout:7/501: dread d4/d26/f50 [0,4194304] 0 2024-09-17T01:06:58.659 INFO:tasks.workunit.client.1.smithi143.stdout:9/395: creat d3/d81/f85 x:0 0 0 2024-09-17T01:06:58.663 INFO:tasks.workunit.client.1.smithi143.stdout:1/489: truncate d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a 1070711 0 2024-09-17T01:06:58.664 INFO:tasks.workunit.client.1.smithi143.stdout:1/490: fsync d0/d6/d64/f80 0 2024-09-17T01:06:58.664 INFO:tasks.workunit.client.1.smithi143.stdout:3/371: rename d6/d1c/d4b/f50 to d6/d1c/d33/d41/d2b/f70 0 2024-09-17T01:06:58.670 INFO:tasks.workunit.client.1.smithi143.stdout:0/478: getdents d3/d5/d8/d21/d2e 0 2024-09-17T01:06:58.670 INFO:tasks.workunit.client.1.smithi143.stdout:6/385: mkdir d2/d64/d74 0 2024-09-17T01:06:58.671 INFO:tasks.workunit.client.1.smithi143.stdout:3/372: read d6/d1c/d33/d41/d42/f4c [1296993,78389] 0 2024-09-17T01:06:58.673 INFO:tasks.workunit.client.1.smithi143.stdout:7/502: getdents d4/d1f/d4a/d66/d86 0 2024-09-17T01:06:58.675 INFO:tasks.workunit.client.1.smithi143.stdout:4/385: rmdir da/d68/d61/d6a 0 2024-09-17T01:06:58.675 INFO:tasks.workunit.client.1.smithi143.stdout:7/503: truncate d4/d16/f42 3492094 0 2024-09-17T01:06:58.676 INFO:tasks.workunit.client.1.smithi143.stdout:0/479: mknod d3/d5/d8/d27/d31/d85/c9f 0 2024-09-17T01:06:58.677 INFO:tasks.workunit.client.1.smithi143.stdout:6/386: rename d2/d30/d45/d67 to d2/df/d20/d2c/d75 0 2024-09-17T01:06:58.678 INFO:tasks.workunit.client.1.smithi143.stdout:7/504: unlink d4/c19 0 2024-09-17T01:06:58.679 INFO:tasks.workunit.client.1.smithi143.stdout:4/386: write da/d3a/d40/f37 [1809573,69656] 0 2024-09-17T01:06:58.682 INFO:tasks.workunit.client.1.smithi143.stdout:8/415: truncate d9/d12/d4b/f37 1813133 0 2024-09-17T01:06:58.683 INFO:tasks.workunit.client.1.smithi143.stdout:4/387: readlink da/d3a/d40/l33 0 2024-09-17T01:06:58.684 INFO:tasks.workunit.client.1.smithi143.stdout:2/423: dwrite d0/d44/d7a/f7d [0,4194304] 0 2024-09-17T01:06:58.685 INFO:tasks.workunit.client.1.smithi143.stdout:0/480: mknod d3/d5/ca0 0 2024-09-17T01:06:58.685 INFO:tasks.workunit.client.1.smithi143.stdout:9/396: dread d3/d39/d6a/d9/f41 [0,4194304] 0 2024-09-17T01:06:58.688 INFO:tasks.workunit.client.1.smithi143.stdout:3/373: dwrite d6/d1c/d33/d41/d2e/d30/f6c [0,4194304] 0 2024-09-17T01:06:58.693 INFO:tasks.workunit.client.1.smithi143.stdout:6/387: rename d2/c3 to d2/d17/d6e/d26/d46/d66/c76 0 2024-09-17T01:06:58.697 INFO:tasks.workunit.client.1.smithi143.stdout:9/397: fdatasync d3/d39/d6a/fb 0 2024-09-17T01:06:58.700 INFO:tasks.workunit.client.1.smithi143.stdout:0/481: rename d3/d5/d8/d27/f2b to d3/d5/d8/d27/d31/d85/fa1 0 2024-09-17T01:06:58.700 INFO:tasks.workunit.client.1.smithi143.stdout:7/505: dwrite d4/d1f/f23 [4194304,4194304] 0 2024-09-17T01:06:58.702 INFO:tasks.workunit.client.1.smithi143.stdout:9/398: write d3/d39/d6a/f2a [4663585,46831] 0 2024-09-17T01:06:58.703 INFO:tasks.workunit.client.1.smithi143.stdout:8/416: write d9/d12/d38/f43 [3042480,35398] 0 2024-09-17T01:06:58.704 INFO:tasks.workunit.client.1.smithi143.stdout:2/424: dwrite d0/fc [0,4194304] 0 2024-09-17T01:06:58.704 INFO:tasks.workunit.client.1.smithi143.stdout:1/491: truncate d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a 701279 0 2024-09-17T01:06:58.708 INFO:tasks.workunit.client.1.smithi143.stdout:4/388: write da/d3a/d3e/d42/f43 [868053,6068] 0 2024-09-17T01:06:58.709 INFO:tasks.workunit.client.1.smithi143.stdout:7/506: truncate d4/d1f/f63 695270 0 2024-09-17T01:06:58.710 INFO:tasks.workunit.client.1.smithi143.stdout:9/399: write d3/d39/f72 [3729822,24578] 0 2024-09-17T01:06:58.710 INFO:tasks.workunit.client.1.smithi143.stdout:6/388: dwrite d2/fb [0,4194304] 0 2024-09-17T01:06:58.714 INFO:tasks.workunit.client.1.smithi143.stdout:8/417: write d9/d26/f3e [1243465,2186] 0 2024-09-17T01:06:58.716 INFO:tasks.workunit.client.1.smithi143.stdout:9/400: write d3/d16/d34/f4c [456375,11847] 0 2024-09-17T01:06:58.718 INFO:tasks.workunit.client.1.smithi143.stdout:7/507: mknod d4/d33/d78/c9d 0 2024-09-17T01:06:58.720 INFO:tasks.workunit.client.1.smithi143.stdout:2/425: mknod d0/d10/d58/d5a/d5b/c87 0 2024-09-17T01:06:58.721 INFO:tasks.workunit.client.1.smithi143.stdout:7/508: readlink d4/le 0 2024-09-17T01:06:58.724 INFO:tasks.workunit.client.1.smithi143.stdout:0/482: dwrite d3/d68/f70 [4194304,4194304] 0 2024-09-17T01:06:58.725 INFO:tasks.workunit.client.1.smithi143.stdout:9/401: readlink d3/d39/d6a/d9/l28 0 2024-09-17T01:06:58.729 INFO:tasks.workunit.client.1.smithi143.stdout:2/426: dread d0/d10/f34 [0,4194304] 0 2024-09-17T01:06:58.732 INFO:tasks.workunit.client.1.smithi143.stdout:4/389: dread da/d3a/d40/f37 [0,4194304] 0 2024-09-17T01:06:58.733 INFO:tasks.workunit.client.1.smithi143.stdout:2/427: symlink d0/d10/d58/d5a/d5b/d4c/d59/l88 0 2024-09-17T01:06:58.735 INFO:tasks.workunit.client.1.smithi143.stdout:9/402: dwrite d3/d39/f4f [0,4194304] 0 2024-09-17T01:06:58.735 INFO:tasks.workunit.client.1.smithi143.stdout:0/483: rename d3/d5/d8/d27/d31/d4c/f28 to d3/fa2 0 2024-09-17T01:06:58.738 INFO:tasks.workunit.client.1.smithi143.stdout:4/390: mkdir da/d75 0 2024-09-17T01:06:58.739 INFO:tasks.workunit.client.1.smithi143.stdout:9/403: chown d3/d39/d6a/d9/f27 115510930 1 2024-09-17T01:06:58.741 INFO:tasks.workunit.client.1.smithi143.stdout:0/484: symlink d3/d5/d8/d27/d31/d85/la3 0 2024-09-17T01:06:58.742 INFO:tasks.workunit.client.1.smithi143.stdout:6/389: truncate d2/df/d18/f21 1042953 0 2024-09-17T01:06:58.744 INFO:tasks.workunit.client.1.smithi143.stdout:4/391: rename da/d3a/d40/f3c to da/d6d/f76 0 2024-09-17T01:06:58.746 INFO:tasks.workunit.client.1.smithi143.stdout:8/418: dwrite d9/d12/d38/d58/f8e [0,4194304] 0 2024-09-17T01:06:58.746 INFO:tasks.workunit.client.1.smithi143.stdout:7/509: truncate d4/d1f/f3e 3522100 0 2024-09-17T01:06:58.746 INFO:tasks.workunit.client.1.smithi143.stdout:0/485: fsync d3/d5/d8/d27/f1e 0 2024-09-17T01:06:58.748 INFO:tasks.workunit.client.1.smithi143.stdout:6/390: creat d2/d17/f77 x:0 0 0 2024-09-17T01:06:58.748 INFO:tasks.workunit.client.1.smithi143.stdout:4/392: symlink da/d3a/d40/l77 0 2024-09-17T01:06:58.751 INFO:tasks.workunit.client.1.smithi143.stdout:8/419: mkdir d9/d12/d38/d58/d79/d9b 0 2024-09-17T01:06:58.753 INFO:tasks.workunit.client.1.smithi143.stdout:9/404: getdents d3/d39/d42 0 2024-09-17T01:06:58.754 INFO:tasks.workunit.client.1.smithi143.stdout:4/393: truncate da/d3a/d3e/d42/f46 1537308 0 2024-09-17T01:06:58.754 INFO:tasks.workunit.client.1.smithi143.stdout:7/510: mkdir d4/d1f/d4a/d9e 0 2024-09-17T01:06:58.755 INFO:tasks.workunit.client.1.smithi143.stdout:0/486: write d3/d5/d8/f13 [3482279,68117] 0 2024-09-17T01:06:58.756 INFO:tasks.workunit.client.1.smithi143.stdout:6/391: creat d2/d30/d45/d70/f78 x:0 0 0 2024-09-17T01:06:58.756 INFO:tasks.workunit.client.1.smithi143.stdout:8/420: mknod d9/d23/d48/d56/d66/c9c 0 2024-09-17T01:06:58.758 INFO:tasks.workunit.client.1.smithi143.stdout:9/405: creat d3/d16/f86 x:0 0 0 2024-09-17T01:06:58.758 INFO:tasks.workunit.client.1.smithi143.stdout:7/511: write d4/d1f/d4a/f96 [382784,129682] 0 2024-09-17T01:06:58.758 INFO:tasks.workunit.client.1.smithi143.stdout:8/421: readlink d9/d12/l34 0 2024-09-17T01:06:58.760 INFO:tasks.workunit.client.1.smithi143.stdout:0/487: write d3/d68/f6c [865409,56699] 0 2024-09-17T01:06:58.760 INFO:tasks.workunit.client.1.smithi143.stdout:1/492: dread d0/dc/f38 [0,4194304] 0 2024-09-17T01:06:58.760 INFO:tasks.workunit.client.1.smithi143.stdout:4/394: unlink da/fe 0 2024-09-17T01:06:58.765 INFO:tasks.workunit.client.1.smithi143.stdout:7/512: mkdir d4/d33/d4e/d9f 0 2024-09-17T01:06:58.771 INFO:tasks.workunit.client.1.smithi143.stdout:8/422: mkdir d9/d23/d48/d55/d57/d9d 0 2024-09-17T01:06:58.771 INFO:tasks.workunit.client.1.smithi143.stdout:9/406: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:06:58.771 INFO:tasks.workunit.client.1.smithi143.stdout:6/392: mkdir d2/d17/d6e/d26/d79 0 2024-09-17T01:06:58.772 INFO:tasks.workunit.client.1.smithi143.stdout:1/493: dread d0/dc/f38 [0,4194304] 0 2024-09-17T01:06:58.773 INFO:tasks.workunit.client.1.smithi143.stdout:4/395: rename da/d3a/d3e/d5e/l5c to da/d3a/d40/l78 0 2024-09-17T01:06:58.776 INFO:tasks.workunit.client.1.smithi143.stdout:6/393: fdatasync d2/d17/d3a/f3c 0 2024-09-17T01:06:58.776 INFO:tasks.workunit.client.1.smithi143.stdout:2/428: dread d0/f4a [0,4194304] 0 2024-09-17T01:06:58.776 INFO:tasks.workunit.client.1.smithi143.stdout:4/396: write da/f31 [605976,97478] 0 2024-09-17T01:06:58.776 INFO:tasks.workunit.client.1.smithi143.stdout:1/494: fdatasync d0/d6/d43/f67 0 2024-09-17T01:06:58.777 INFO:tasks.workunit.client.1.smithi143.stdout:9/407: fdatasync d3/d39/d6a/d26/f75 0 2024-09-17T01:06:58.777 INFO:tasks.workunit.client.1.smithi143.stdout:7/513: dread d4/d16/f1a [0,4194304] 0 2024-09-17T01:06:58.779 INFO:tasks.workunit.client.1.smithi143.stdout:2/429: fdatasync d0/d10/f33 0 2024-09-17T01:06:58.780 INFO:tasks.workunit.client.1.smithi143.stdout:4/397: chown da/f32 16107 1 2024-09-17T01:06:58.783 INFO:tasks.workunit.client.1.smithi143.stdout:1/495: truncate d0/dc/f83 942504 0 2024-09-17T01:06:58.783 INFO:tasks.workunit.client.1.smithi143.stdout:9/408: chown d3/l13 25234871 1 2024-09-17T01:06:58.784 INFO:tasks.workunit.client.1.smithi143.stdout:7/514: chown d4/f58 1 1 2024-09-17T01:06:58.785 INFO:tasks.workunit.client.1.smithi143.stdout:4/398: fsync da/f2d 0 2024-09-17T01:06:58.786 INFO:tasks.workunit.client.1.smithi143.stdout:8/423: dwrite d9/d23/d48/d56/d66/d7d/f93 [0,4194304] 0 2024-09-17T01:06:58.789 INFO:tasks.workunit.client.1.smithi143.stdout:1/496: rmdir d0/dc 39 2024-09-17T01:06:58.789 INFO:tasks.workunit.client.1.smithi143.stdout:4/399: chown da/d3a 173835635 1 2024-09-17T01:06:58.789 INFO:tasks.workunit.client.1.smithi143.stdout:9/409: unlink d3/d39/d6a/d9/c77 0 2024-09-17T01:06:58.791 INFO:tasks.workunit.client.1.smithi143.stdout:6/394: getdents d2/df/d18 0 2024-09-17T01:06:58.792 INFO:tasks.workunit.client.1.smithi143.stdout:2/430: dread d0/d2/d21/f27 [0,4194304] 0 2024-09-17T01:06:58.793 INFO:tasks.workunit.client.1.smithi143.stdout:4/400: creat da/d3a/f79 x:0 0 0 2024-09-17T01:06:58.794 INFO:tasks.workunit.client.1.smithi143.stdout:8/424: creat d9/d23/d48/d56/d66/f9e x:0 0 0 2024-09-17T01:06:58.796 INFO:tasks.workunit.client.1.smithi143.stdout:9/410: chown d3/d16/d3e/l65 66288070 1 2024-09-17T01:06:58.796 INFO:tasks.workunit.client.1.smithi143.stdout:7/515: creat d4/d1f/d4a/fa0 x:0 0 0 2024-09-17T01:06:58.797 INFO:tasks.workunit.client.1.smithi143.stdout:2/431: rmdir d0/d44/d6a 39 2024-09-17T01:06:58.798 INFO:tasks.workunit.client.1.smithi143.stdout:9/411: chown d3/d3d/l44 941966471 1 2024-09-17T01:06:58.799 INFO:tasks.workunit.client.1.smithi143.stdout:8/425: truncate d9/de/d53/d75/f88 885391 0 2024-09-17T01:06:58.799 INFO:tasks.workunit.client.1.smithi143.stdout:6/395: mknod d2/c7a 0 2024-09-17T01:06:58.800 INFO:tasks.workunit.client.1.smithi143.stdout:2/432: readlink d0/d2/l3 0 2024-09-17T01:06:58.801 INFO:tasks.workunit.client.1.smithi143.stdout:1/497: dwrite d0/d6/d43/d47/d72/f9e [0,4194304] 0 2024-09-17T01:06:58.804 INFO:tasks.workunit.client.1.smithi143.stdout:2/433: chown d0/d2/d21 1 1 2024-09-17T01:06:58.807 INFO:tasks.workunit.client.1.smithi143.stdout:0/488: dread d3/d68/f6c [0,4194304] 0 2024-09-17T01:06:58.812 INFO:tasks.workunit.client.1.smithi143.stdout:6/396: symlink d2/d30/l7b 0 2024-09-17T01:06:58.812 INFO:tasks.workunit.client.1.smithi143.stdout:4/401: chown da/d3a/l5a 166217577 1 2024-09-17T01:06:58.814 INFO:tasks.workunit.client.1.smithi143.stdout:9/412: rename d3/d16/d34/f36 to d3/d39/d6a/d9/f87 0 2024-09-17T01:06:58.814 INFO:tasks.workunit.client.1.smithi143.stdout:7/516: dwrite d4/d26/f76 [0,4194304] 0 2024-09-17T01:06:58.815 INFO:tasks.workunit.client.1.smithi143.stdout:1/498: getdents d0/d6/d99 0 2024-09-17T01:06:58.817 INFO:tasks.workunit.client.1.smithi143.stdout:0/489: write d3/d5/d8/d27/d31/d4c/f1d [2855094,67667] 0 2024-09-17T01:06:58.818 INFO:tasks.workunit.client.1.smithi143.stdout:8/426: dwrite d9/de/d53/f68 [4194304,4194304] 0 2024-09-17T01:06:58.819 INFO:tasks.workunit.client.1.smithi143.stdout:6/397: readlink d2/d17/d6e/le 0 2024-09-17T01:06:58.822 INFO:tasks.workunit.client.1.smithi143.stdout:2/434: truncate d0/d10/f16 843638 0 2024-09-17T01:06:58.824 INFO:tasks.workunit.client.1.smithi143.stdout:4/402: mknod da/d3a/d3e/c7a 0 2024-09-17T01:06:58.824 INFO:tasks.workunit.client.1.smithi143.stdout:2/435: fsync d0/d10/f33 0 2024-09-17T01:06:58.826 INFO:tasks.workunit.client.1.smithi143.stdout:6/398: mkdir d2/d30/d45/d4a/d5e/d7c 0 2024-09-17T01:06:58.828 INFO:tasks.workunit.client.1.smithi143.stdout:4/403: read da/d3a/d3e/d42/f4b [586224,40090] 0 2024-09-17T01:06:58.829 INFO:tasks.workunit.client.1.smithi143.stdout:0/490: rename d3/d5/d8/d27/d31/d48/d72/f95 to d3/d5/d8/d27/d31/d85/fa4 0 2024-09-17T01:06:58.831 INFO:tasks.workunit.client.1.smithi143.stdout:2/436: creat d0/d44/d7a/f89 x:0 0 0 2024-09-17T01:06:58.832 INFO:tasks.workunit.client.1.smithi143.stdout:6/399: mknod d2/df/d40/d41/c7d 0 2024-09-17T01:06:58.833 INFO:tasks.workunit.client.1.smithi143.stdout:8/427: rename d9/d2b/f85 to d9/d12/d38/f9f 0 2024-09-17T01:06:58.833 INFO:tasks.workunit.client.1.smithi143.stdout:3/374: sync 2024-09-17T01:06:58.833 INFO:tasks.workunit.client.1.smithi143.stdout:5/435: sync 2024-09-17T01:06:58.835 INFO:tasks.workunit.client.1.smithi143.stdout:4/404: creat da/d75/f7b x:0 0 0 2024-09-17T01:06:58.837 INFO:tasks.workunit.client.1.smithi143.stdout:7/517: dwrite d4/d33/f9a [0,4194304] 0 2024-09-17T01:06:58.838 INFO:tasks.workunit.client.1.smithi143.stdout:1/499: dread d0/d6/d43/d6a/df/d6e/f1d [0,4194304] 0 2024-09-17T01:06:58.842 INFO:tasks.workunit.client.1.smithi143.stdout:2/437: mknod d0/d10/d58/d5a/d5b/d4c/d71/c8a 0 2024-09-17T01:06:58.843 INFO:tasks.workunit.client.1.smithi143.stdout:5/436: chown d1/d46/d6e/c80 519411093 1 2024-09-17T01:06:58.845 INFO:tasks.workunit.client.1.smithi143.stdout:7/518: stat d4/d1f/d4a/f94 0 2024-09-17T01:06:58.846 INFO:tasks.workunit.client.1.smithi143.stdout:3/375: link d6/d1c/d4b/f67 d6/d1c/d33/d41/d42/f71 0 2024-09-17T01:06:58.849 INFO:tasks.workunit.client.1.smithi143.stdout:4/405: mkdir da/d3a/d7c 0 2024-09-17T01:06:58.850 INFO:tasks.workunit.client.1.smithi143.stdout:2/438: unlink d0/d44/d7a/f7d 0 2024-09-17T01:06:58.853 INFO:tasks.workunit.client.1.smithi143.stdout:8/428: dwrite d9/d12/d38/f3d [0,4194304] 0 2024-09-17T01:06:58.855 INFO:tasks.workunit.client.1.smithi143.stdout:7/519: symlink d4/d1f/la1 0 2024-09-17T01:06:58.858 INFO:tasks.workunit.client.1.smithi143.stdout:4/406: read da/d3a/d3e/d5e/f62 [711340,37339] 0 2024-09-17T01:06:58.859 INFO:tasks.workunit.client.1.smithi143.stdout:1/500: write d0/d6/f3a [536710,129825] 0 2024-09-17T01:06:58.862 INFO:tasks.workunit.client.1.smithi143.stdout:9/413: dread d3/d39/d6a/d9/f5c [0,4194304] 0 2024-09-17T01:06:58.862 INFO:tasks.workunit.client.1.smithi143.stdout:8/429: mknod d9/d12/d13/d7c/ca0 0 2024-09-17T01:06:58.864 INFO:tasks.workunit.client.1.smithi143.stdout:4/407: dread - da/d6d/f74 zero size 2024-09-17T01:06:58.866 INFO:tasks.workunit.client.1.smithi143.stdout:1/501: chown d0/d6/f3a 1 1 2024-09-17T01:06:58.868 INFO:tasks.workunit.client.1.smithi143.stdout:9/414: read d3/d16/d34/f5b [1594431,120909] 0 2024-09-17T01:06:58.869 INFO:tasks.workunit.client.1.smithi143.stdout:5/437: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:06:58.869 INFO:tasks.workunit.client.1.smithi143.stdout:8/430: chown d9/de/d53/f68 8 1 2024-09-17T01:06:58.870 INFO:tasks.workunit.client.1.smithi143.stdout:0/491: dwrite d3/d5/d8/d10/f25 [0,4194304] 0 2024-09-17T01:06:58.875 INFO:tasks.workunit.client.1.smithi143.stdout:8/431: chown d9/d12/d38/d58/d79 29303646 1 2024-09-17T01:06:58.875 INFO:tasks.workunit.client.1.smithi143.stdout:1/502: write d0/dc/d89/f95 [1019829,35162] 0 2024-09-17T01:06:58.877 INFO:tasks.workunit.client.1.smithi143.stdout:9/415: rmdir d3/d39 39 2024-09-17T01:06:58.877 INFO:tasks.workunit.client.1.smithi143.stdout:1/503: fsync d0/dc/d74/f8a 0 2024-09-17T01:06:58.880 INFO:tasks.workunit.client.1.smithi143.stdout:6/400: dread d2/d17/d3a/f51 [0,4194304] 0 2024-09-17T01:06:58.880 INFO:tasks.workunit.client.1.smithi143.stdout:4/408: dread da/d68/f5d [0,4194304] 0 2024-09-17T01:06:58.882 INFO:tasks.workunit.client.1.smithi143.stdout:6/401: write d2/df/d20/f61 [143376,46066] 0 2024-09-17T01:06:58.885 INFO:tasks.workunit.client.1.smithi143.stdout:9/416: mkdir d3/d16/d3e/d51/d88 0 2024-09-17T01:06:58.886 INFO:tasks.workunit.client.1.smithi143.stdout:9/417: chown d3/d3d 11141 1 2024-09-17T01:06:58.888 INFO:tasks.workunit.client.1.smithi143.stdout:7/520: truncate d4/d33/d4e/f5b 3014968 0 2024-09-17T01:06:58.889 INFO:tasks.workunit.client.1.smithi143.stdout:3/376: dwrite d6/d1c/d33/d41/d2e/d30/f32 [0,4194304] 0 2024-09-17T01:06:58.889 INFO:tasks.workunit.client.1.smithi143.stdout:0/492: dwrite d3/d5/d8/d21/f3e [0,4194304] 0 2024-09-17T01:06:58.889 INFO:tasks.workunit.client.1.smithi143.stdout:4/409: readlink da/l16 0 2024-09-17T01:06:58.889 INFO:tasks.workunit.client.1.smithi143.stdout:5/438: mkdir d1/d46/df/d23/d4f/d7d/d92/dad 0 2024-09-17T01:06:58.892 INFO:tasks.workunit.client.1.smithi143.stdout:1/504: symlink d0/dc/d57/la7 0 2024-09-17T01:06:58.893 INFO:tasks.workunit.client.1.smithi143.stdout:2/439: dread d0/d2/d21/d22/f3c [4194304,4194304] 0 2024-09-17T01:06:58.896 INFO:tasks.workunit.client.1.smithi143.stdout:4/410: write da/d3a/d40/f5b [86114,40832] 0 2024-09-17T01:06:58.896 INFO:tasks.workunit.client.1.smithi143.stdout:7/521: truncate d4/f10 237884 0 2024-09-17T01:06:58.897 INFO:tasks.workunit.client.1.smithi143.stdout:9/418: read d3/d39/d6a/d9/f60 [654976,61645] 0 2024-09-17T01:06:58.899 INFO:tasks.workunit.client.1.smithi143.stdout:9/419: fsync d3/d16/d34/f4c 0 2024-09-17T01:06:58.902 INFO:tasks.workunit.client.1.smithi143.stdout:6/402: dread d2/df/d20/d2c/d38/f39 [0,4194304] 0 2024-09-17T01:06:58.904 INFO:tasks.workunit.client.1.smithi143.stdout:1/505: creat d0/fa8 x:0 0 0 2024-09-17T01:06:58.904 INFO:tasks.workunit.client.1.smithi143.stdout:0/493: getdents d3/d14/d32 0 2024-09-17T01:06:58.904 INFO:tasks.workunit.client.1.smithi143.stdout:6/403: dread - d2/df/d20/d2c/d38/f72 zero size 2024-09-17T01:06:58.904 INFO:tasks.workunit.client.1.smithi143.stdout:8/432: truncate d9/f59 3304867 0 2024-09-17T01:06:58.906 INFO:tasks.workunit.client.1.smithi143.stdout:2/440: creat d0/d10/d58/d5a/d5b/d4c/d59/f8b x:0 0 0 2024-09-17T01:06:58.907 INFO:tasks.workunit.client.1.smithi143.stdout:8/433: write d9/d12/d38/f7f [176381,8203] 0 2024-09-17T01:06:58.910 INFO:tasks.workunit.client.1.smithi143.stdout:7/522: mkdir d4/d1f/d4a/d9e/da2 0 2024-09-17T01:06:58.912 INFO:tasks.workunit.client.1.smithi143.stdout:4/411: rename da/d3a/l4f to da/d3a/d40/l7d 0 2024-09-17T01:06:58.913 INFO:tasks.workunit.client.1.smithi143.stdout:9/420: rename d3/d16 to d3/d16/d3e/d51/d89 22 2024-09-17T01:06:58.914 INFO:tasks.workunit.client.1.smithi143.stdout:4/412: dread - da/d6d/f74 zero size 2024-09-17T01:06:58.914 INFO:tasks.workunit.client.1.smithi143.stdout:2/441: truncate d0/d10/d58/d5a/f5f 918060 0 2024-09-17T01:06:58.914 INFO:tasks.workunit.client.1.smithi143.stdout:3/377: truncate d6/d1c/d33/d41/f21 1361521 0 2024-09-17T01:06:58.915 INFO:tasks.workunit.client.1.smithi143.stdout:1/506: dwrite d0/dc/d57/f5d [0,4194304] 0 2024-09-17T01:06:58.916 INFO:tasks.workunit.client.1.smithi143.stdout:9/421: chown d3/d3d/l44 85565 1 2024-09-17T01:06:58.918 INFO:tasks.workunit.client.1.smithi143.stdout:7/523: mkdir d4/d16/d97/da3 0 2024-09-17T01:06:58.919 INFO:tasks.workunit.client.1.smithi143.stdout:6/404: getdents d2/d30/d45 0 2024-09-17T01:06:58.922 INFO:tasks.workunit.client.1.smithi143.stdout:3/378: fsync d6/d1c/d33/d41/d2e/f47 0 2024-09-17T01:06:58.923 INFO:tasks.workunit.client.1.smithi143.stdout:7/524: chown d4/f44 302394495 1 2024-09-17T01:06:58.928 INFO:tasks.workunit.client.1.smithi143.stdout:8/434: truncate d9/d26/f36 1144345 0 2024-09-17T01:06:58.928 INFO:tasks.workunit.client.1.smithi143.stdout:6/405: mkdir d2/d30/d45/d56/d7e 0 2024-09-17T01:06:58.933 INFO:tasks.workunit.client.1.smithi143.stdout:4/413: dwrite da/f20 [4194304,4194304] 0 2024-09-17T01:06:58.934 INFO:tasks.workunit.client.1.smithi143.stdout:7/525: mknod d4/ca4 0 2024-09-17T01:06:58.939 INFO:tasks.workunit.client.1.smithi143.stdout:7/526: chown d4/l59 67505600 1 2024-09-17T01:06:58.939 INFO:tasks.workunit.client.1.smithi143.stdout:8/435: write d9/d12/d38/f7f [112592,102597] 0 2024-09-17T01:06:58.940 INFO:tasks.workunit.client.1.smithi143.stdout:2/442: dwrite d0/d44/d7a/f89 [0,4194304] 0 2024-09-17T01:06:58.941 INFO:tasks.workunit.client.1.smithi143.stdout:1/507: dwrite d0/d6/d64/f80 [0,4194304] 0 2024-09-17T01:06:58.942 INFO:tasks.workunit.client.1.smithi143.stdout:6/406: write d2/df/d20/f5a [1015632,54333] 0 2024-09-17T01:06:58.947 INFO:tasks.workunit.client.1.smithi143.stdout:4/414: dread da/d3a/d40/f5b [0,4194304] 0 2024-09-17T01:06:58.947 INFO:tasks.workunit.client.1.smithi143.stdout:9/422: dwrite d3/d39/d6a/d26/f3c [0,4194304] 0 2024-09-17T01:06:58.950 INFO:tasks.workunit.client.1.smithi143.stdout:8/436: unlink d9/d23/d48/d56/d66/f9e 0 2024-09-17T01:06:58.951 INFO:tasks.workunit.client.1.smithi143.stdout:1/508: creat d0/dc/d74/d94/fa9 x:0 0 0 2024-09-17T01:06:58.951 INFO:tasks.workunit.client.1.smithi143.stdout:7/527: dread d4/d1f/f63 [0,4194304] 0 2024-09-17T01:06:58.953 INFO:tasks.workunit.client.1.smithi143.stdout:4/415: chown da/d3a/d40/f36 27507 1 2024-09-17T01:06:58.955 INFO:tasks.workunit.client.1.smithi143.stdout:7/528: dread - d4/d1f/f73 zero size 2024-09-17T01:06:58.955 INFO:tasks.workunit.client.1.smithi143.stdout:9/423: dread - d3/d39/d6a/d26/f5f zero size 2024-09-17T01:06:58.955 INFO:tasks.workunit.client.1.smithi143.stdout:3/379: dwrite d6/d1c/d33/d41/d2e/f61 [0,4194304] 0 2024-09-17T01:06:58.957 INFO:tasks.workunit.client.1.smithi143.stdout:8/437: write d9/fa [2461219,24848] 0 2024-09-17T01:06:58.958 INFO:tasks.workunit.client.1.smithi143.stdout:9/424: fsync d3/d39/d6a/d26/f69 0 2024-09-17T01:06:58.960 INFO:tasks.workunit.client.1.smithi143.stdout:6/407: rename d2/df/d40/f42 to d2/d17/d6e/d26/d46/d65/f7f 0 2024-09-17T01:06:58.961 INFO:tasks.workunit.client.1.smithi143.stdout:1/509: mknod d0/d6/d64/caa 0 2024-09-17T01:06:58.961 INFO:tasks.workunit.client.1.smithi143.stdout:4/416: mknod da/d68/c7e 0 2024-09-17T01:06:58.964 INFO:tasks.workunit.client.1.smithi143.stdout:6/408: dread - d2/d30/d45/f50 zero size 2024-09-17T01:06:58.965 INFO:tasks.workunit.client.1.smithi143.stdout:3/380: write d6/d1c/d33/d41/d2e/d30/f6c [2037109,5547] 0 2024-09-17T01:06:58.965 INFO:tasks.workunit.client.1.smithi143.stdout:8/438: unlink d9/d23/d48/d55/l8d 0 2024-09-17T01:06:58.969 INFO:tasks.workunit.client.1.smithi143.stdout:2/443: truncate d0/d44/d7a/f89 1309563 0 2024-09-17T01:06:58.969 INFO:tasks.workunit.client.1.smithi143.stdout:1/510: mkdir d0/d6/d43/d6a/df/d6e/d18/d2d/dab 0 2024-09-17T01:06:58.970 INFO:tasks.workunit.client.1.smithi143.stdout:7/529: dwrite d4/fd [0,4194304] 0 2024-09-17T01:06:58.971 INFO:tasks.workunit.client.1.smithi143.stdout:4/417: rename da/c29 to da/d68/c7f 0 2024-09-17T01:06:58.972 INFO:tasks.workunit.client.1.smithi143.stdout:7/530: fdatasync d4/d1f/d29/f64 0 2024-09-17T01:06:58.973 INFO:tasks.workunit.client.1.smithi143.stdout:2/444: fsync d0/d2/d21/f62 0 2024-09-17T01:06:58.975 INFO:tasks.workunit.client.1.smithi143.stdout:9/425: link d3/l32 d3/d39/d6a/l8a 0 2024-09-17T01:06:58.976 INFO:tasks.workunit.client.1.smithi143.stdout:8/439: creat d9/d23/d48/d55/d57/d9d/fa1 x:0 0 0 2024-09-17T01:06:58.976 INFO:tasks.workunit.client.1.smithi143.stdout:4/418: chown da/d3a/l5a 38326931 1 2024-09-17T01:06:58.979 INFO:tasks.workunit.client.1.smithi143.stdout:3/381: link d6/f58 d6/d1c/d33/f72 0 2024-09-17T01:06:58.981 INFO:tasks.workunit.client.1.smithi143.stdout:7/531: fsync d4/d1f/d29/d65/d5d/f51 0 2024-09-17T01:06:58.982 INFO:tasks.workunit.client.1.smithi143.stdout:4/419: mkdir da/d3a/d3e/d5e/d63/d80 0 2024-09-17T01:06:58.983 INFO:tasks.workunit.client.1.smithi143.stdout:7/532: chown d4/d33/f9a 26854 1 2024-09-17T01:06:58.984 INFO:tasks.workunit.client.1.smithi143.stdout:2/445: creat d0/d2/d21/d22/d24/f8c x:0 0 0 2024-09-17T01:06:58.985 INFO:tasks.workunit.client.1.smithi143.stdout:9/426: mkdir d3/d39/d42/d58/d5a/d5e/d8b 0 2024-09-17T01:06:58.985 INFO:tasks.workunit.client.1.smithi143.stdout:7/533: readlink d4/d16/l37 0 2024-09-17T01:06:58.985 INFO:tasks.workunit.client.1.smithi143.stdout:6/409: dwrite d2/df/d20/d2c/d75/f71 [0,4194304] 0 2024-09-17T01:06:58.986 INFO:tasks.workunit.client.1.smithi143.stdout:8/440: rename d9/d12/d13/d73/f90 to d9/d23/d4f/fa2 0 2024-09-17T01:06:58.988 INFO:tasks.workunit.client.1.smithi143.stdout:7/534: stat d4/d33/d4e/d9f 0 2024-09-17T01:06:58.990 INFO:tasks.workunit.client.1.smithi143.stdout:7/535: chown d4/d33/d78/f85 30 1 2024-09-17T01:06:58.992 INFO:tasks.workunit.client.1.smithi143.stdout:4/420: write da/f1b [5048188,99927] 0 2024-09-17T01:06:58.994 INFO:tasks.workunit.client.1.smithi143.stdout:3/382: dread d6/d1c/f2a [0,4194304] 0 2024-09-17T01:06:58.995 INFO:tasks.workunit.client.1.smithi143.stdout:7/536: dread d4/f82 [0,4194304] 0 2024-09-17T01:06:58.995 INFO:tasks.workunit.client.1.smithi143.stdout:9/427: dread d3/f15 [0,4194304] 0 2024-09-17T01:06:58.998 INFO:tasks.workunit.client.1.smithi143.stdout:4/421: dread da/d3a/d3e/d5e/f62 [0,4194304] 0 2024-09-17T01:06:58.998 INFO:tasks.workunit.client.1.smithi143.stdout:6/410: dread d2/df/d20/f54 [0,4194304] 0 2024-09-17T01:06:58.999 INFO:tasks.workunit.client.1.smithi143.stdout:6/411: write d2/d30/f57 [363581,85115] 0 2024-09-17T01:06:59.084 INFO:tasks.workunit.client.1.smithi143.stdout:2/446: mkdir d0/d2/d21/d84/d8d 0 2024-09-17T01:06:59.085 INFO:tasks.workunit.client.1.smithi143.stdout:8/441: symlink d9/la3 0 2024-09-17T01:06:59.086 INFO:tasks.workunit.client.1.smithi143.stdout:9/428: symlink d3/d39/d6a/l8c 0 2024-09-17T01:06:59.086 INFO:tasks.workunit.client.1.smithi143.stdout:7/537: rename d4/d16/c83 to d4/d1f/d4a/d66/ca5 0 2024-09-17T01:06:59.087 INFO:tasks.workunit.client.1.smithi143.stdout:6/412: creat d2/d17/d6e/d26/d46/f80 x:0 0 0 2024-09-17T01:06:59.088 INFO:tasks.workunit.client.1.smithi143.stdout:1/511: link d0/d6/d43/d6a/df/c13 d0/d6/d43/d6a/df/d6e/d2/d39/cac 0 2024-09-17T01:06:59.088 INFO:tasks.workunit.client.1.smithi143.stdout:7/538: truncate d4/d1f/d4a/fa0 607258 0 2024-09-17T01:06:59.090 INFO:tasks.workunit.client.1.smithi143.stdout:9/429: unlink d3/d16/d3e/d51/f78 0 2024-09-17T01:06:59.090 INFO:tasks.workunit.client.1.smithi143.stdout:1/512: fsync d0/d6/d43/f67 0 2024-09-17T01:06:59.090 INFO:tasks.workunit.client.1.smithi143.stdout:4/422: symlink da/l81 0 2024-09-17T01:06:59.091 INFO:tasks.workunit.client.1.smithi143.stdout:3/383: creat d6/f73 x:0 0 0 2024-09-17T01:06:59.094 INFO:tasks.workunit.client.1.smithi143.stdout:7/539: creat d4/d16/d97/fa6 x:0 0 0 2024-09-17T01:06:59.096 INFO:tasks.workunit.client.1.smithi143.stdout:8/442: getdents d9/d12/d38/d7a/d8f 0 2024-09-17T01:06:59.099 INFO:tasks.workunit.client.1.smithi143.stdout:7/540: mknod d4/d16/d97/ca7 0 2024-09-17T01:06:59.101 INFO:tasks.workunit.client.1.smithi143.stdout:2/447: dread d0/d2/f14 [0,4194304] 0 2024-09-17T01:06:59.102 INFO:tasks.workunit.client.1.smithi143.stdout:1/513: rename d0/d6/d43/d6a/df/d6e/d2/l37 to d0/dc/d57/d58/lad 0 2024-09-17T01:06:59.102 INFO:tasks.workunit.client.1.smithi143.stdout:9/430: dwrite d3/d39/f53 [0,4194304] 0 2024-09-17T01:06:59.105 INFO:tasks.workunit.client.1.smithi143.stdout:9/431: chown d3/d3d/l50 0 1 2024-09-17T01:06:59.105 INFO:tasks.workunit.client.1.smithi143.stdout:7/541: creat d4/d1f/d4a/d66/d86/fa8 x:0 0 0 2024-09-17T01:06:59.106 INFO:tasks.workunit.client.1.smithi143.stdout:8/443: dwrite d9/de/f6f [0,4194304] 0 2024-09-17T01:06:59.107 INFO:tasks.workunit.client.1.smithi143.stdout:9/432: dread - d3/d39/d6a/d9/f37 zero size 2024-09-17T01:06:59.109 INFO:tasks.workunit.client.1.smithi143.stdout:1/514: symlink d0/d6/d43/d6a/df/d6e/d2/d39/d6b/lae 0 2024-09-17T01:06:59.112 INFO:tasks.workunit.client.1.smithi143.stdout:1/515: readlink d0/d6/d43/d6a/df/l98 0 2024-09-17T01:06:59.112 INFO:tasks.workunit.client.1.smithi143.stdout:7/542: rename d4/ca to d4/d26/ca9 0 2024-09-17T01:06:59.113 INFO:tasks.workunit.client.1.smithi143.stdout:3/384: link d6/f58 d6/d1c/d33/d41/d2e/d30/f74 0 2024-09-17T01:06:59.115 INFO:tasks.workunit.client.1.smithi143.stdout:9/433: mknod d3/d16/d3e/d51/d52/c8d 0 2024-09-17T01:06:59.124 INFO:tasks.workunit.client.1.smithi143.stdout:8/444: dwrite d9/d12/d38/f64 [0,4194304] 0 2024-09-17T01:06:59.125 INFO:tasks.workunit.client.1.smithi143.stdout:2/448: dwrite d0/f4a [0,4194304] 0 2024-09-17T01:06:59.132 INFO:tasks.workunit.client.1.smithi143.stdout:2/449: chown d0/d2/d21/d22/d24 13 1 2024-09-17T01:06:59.132 INFO:tasks.workunit.client.1.smithi143.stdout:6/413: write d2/df/d20/f53 [680046,22605] 0 2024-09-17T01:06:59.134 INFO:tasks.workunit.client.1.smithi143.stdout:3/385: creat d6/d1c/d33/d3f/f75 x:0 0 0 2024-09-17T01:06:59.137 INFO:tasks.workunit.client.1.smithi143.stdout:9/434: chown d3/d16/c33 39404 1 2024-09-17T01:06:59.139 INFO:tasks.workunit.client.1.smithi143.stdout:8/445: symlink d9/de/d53/d75/la4 0 2024-09-17T01:06:59.140 INFO:tasks.workunit.client.1.smithi143.stdout:2/450: symlink d0/d10/d56/l8e 0 2024-09-17T01:06:59.143 INFO:tasks.workunit.client.1.smithi143.stdout:3/386: creat d6/d1c/d4b/f76 x:0 0 0 2024-09-17T01:06:59.147 INFO:tasks.workunit.client.1.smithi143.stdout:1/516: dwrite d0/d6/d43/d6a/df/d27/f2e [4194304,4194304] 0 2024-09-17T01:06:59.148 INFO:tasks.workunit.client.1.smithi143.stdout:9/435: mknod d3/d3d/c8e 0 2024-09-17T01:06:59.148 INFO:tasks.workunit.client.1.smithi143.stdout:4/423: dwrite da/d3a/d40/f27 [0,4194304] 0 2024-09-17T01:06:59.156 INFO:tasks.workunit.client.1.smithi143.stdout:3/387: creat d6/d1c/d33/d41/d2b/f77 x:0 0 0 2024-09-17T01:06:59.158 INFO:tasks.workunit.client.1.smithi143.stdout:9/436: rmdir d3/d16/d3e/d51 39 2024-09-17T01:06:59.161 INFO:tasks.workunit.client.1.smithi143.stdout:7/543: dwrite d4/f82 [0,4194304] 0 2024-09-17T01:06:59.165 INFO:tasks.workunit.client.1.smithi143.stdout:6/414: dwrite d2/d30/d45/d70/f78 [0,4194304] 0 2024-09-17T01:06:59.165 INFO:tasks.workunit.client.1.smithi143.stdout:8/446: rename d9/fc to d9/fa5 0 2024-09-17T01:06:59.166 INFO:tasks.workunit.client.1.smithi143.stdout:3/388: unlink d6/le 0 2024-09-17T01:06:59.168 INFO:tasks.workunit.client.1.smithi143.stdout:4/424: creat da/f82 x:0 0 0 2024-09-17T01:06:59.170 INFO:tasks.workunit.client.1.smithi143.stdout:2/451: dwrite d0/d2/d21/d22/f41 [0,4194304] 0 2024-09-17T01:06:59.172 INFO:tasks.workunit.client.1.smithi143.stdout:6/415: read d2/df/d20/d2c/d38/f39 [108697,91733] 0 2024-09-17T01:06:59.173 INFO:tasks.workunit.client.1.smithi143.stdout:2/452: fsync d0/ff 0 2024-09-17T01:06:59.175 INFO:tasks.workunit.client.1.smithi143.stdout:3/389: write d6/d1c/d33/d41/d2e/f61 [1039723,20856] 0 2024-09-17T01:06:59.176 INFO:tasks.workunit.client.1.smithi143.stdout:4/425: mknod da/d3a/c83 0 2024-09-17T01:06:59.181 INFO:tasks.workunit.client.1.smithi143.stdout:9/437: getdents d3/d39/d6a/d9/d74 0 2024-09-17T01:06:59.181 INFO:tasks.workunit.client.1.smithi143.stdout:1/517: dwrite d0/fa8 [0,4194304] 0 2024-09-17T01:06:59.183 INFO:tasks.workunit.client.1.smithi143.stdout:7/544: dread d4/fd [0,4194304] 0 2024-09-17T01:06:59.183 INFO:tasks.workunit.client.1.smithi143.stdout:3/390: dread - d6/d1c/d33/d3f/f75 zero size 2024-09-17T01:06:59.187 INFO:tasks.workunit.client.1.smithi143.stdout:2/453: creat d0/d10/f8f x:0 0 0 2024-09-17T01:06:59.188 INFO:tasks.workunit.client.1.smithi143.stdout:1/518: mkdir d0/d6/d43/d47/d68/d7b/daf 0 2024-09-17T01:06:59.189 INFO:tasks.workunit.client.1.smithi143.stdout:8/447: dwrite d9/de/d53/d75/f88 [0,4194304] 0 2024-09-17T01:06:59.191 INFO:tasks.workunit.client.1.smithi143.stdout:2/454: write d0/d2/d21/d22/f67 [1440373,72781] 0 2024-09-17T01:06:59.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/391: mknod d6/d1c/d4b/d57/c78 0 2024-09-17T01:06:59.193 INFO:tasks.workunit.client.1.smithi143.stdout:9/438: dread d3/d39/f4f [0,4194304] 0 2024-09-17T01:06:59.195 INFO:tasks.workunit.client.1.smithi143.stdout:8/448: rename d9/d12/d13/l83 to d9/d23/d48/d55/la6 0 2024-09-17T01:06:59.196 INFO:tasks.workunit.client.1.smithi143.stdout:7/545: getdents d4/d1f/d29 0 2024-09-17T01:06:59.198 INFO:tasks.workunit.client.1.smithi143.stdout:1/519: rename d0/d6/d43/d6a/df/d6e/d18/f59 to d0/d6/d43/d47/d68/d7b/fb0 0 2024-09-17T01:06:59.199 INFO:tasks.workunit.client.1.smithi143.stdout:9/439: symlink d3/d16/d3e/d51/d52/l8f 0 2024-09-17T01:06:59.199 INFO:tasks.workunit.client.1.smithi143.stdout:8/449: symlink d9/d12/d13/d73/la7 0 2024-09-17T01:06:59.200 INFO:tasks.workunit.client.1.smithi143.stdout:2/455: rename d0/d10/d58/d5a/d5b/d4c/c60 to d0/d10/d56/c90 0 2024-09-17T01:06:59.201 INFO:tasks.workunit.client.1.smithi143.stdout:1/520: unlink d0/d6/d43/d6a/f70 0 2024-09-17T01:06:59.202 INFO:tasks.workunit.client.1.smithi143.stdout:7/546: symlink d4/d1f/d98/laa 0 2024-09-17T01:06:59.202 INFO:tasks.workunit.client.1.smithi143.stdout:1/521: chown d0/d6/d43/f65 3478 1 2024-09-17T01:06:59.203 INFO:tasks.workunit.client.1.smithi143.stdout:8/450: chown d9/f59 26603 1 2024-09-17T01:06:59.203 INFO:tasks.workunit.client.1.smithi143.stdout:9/440: symlink d3/d16/d34/l90 0 2024-09-17T01:06:59.204 INFO:tasks.workunit.client.1.smithi143.stdout:9/441: chown d3/d3d/f70 325096 1 2024-09-17T01:06:59.204 INFO:tasks.workunit.client.1.smithi143.stdout:7/547: creat d4/d26/fab x:0 0 0 2024-09-17T01:06:59.206 INFO:tasks.workunit.client.1.smithi143.stdout:8/451: mknod d9/d12/d4b/d3f/ca8 0 2024-09-17T01:06:59.206 INFO:tasks.workunit.client.1.smithi143.stdout:2/456: mkdir d0/d44/d6a/d91 0 2024-09-17T01:06:59.207 INFO:tasks.workunit.client.1.smithi143.stdout:7/548: read d4/d16/f40 [70596,128827] 0 2024-09-17T01:06:59.207 INFO:tasks.workunit.client.1.smithi143.stdout:1/522: mkdir d0/d6/d43/d47/d88/da5/db1 0 2024-09-17T01:06:59.208 INFO:tasks.workunit.client.1.smithi143.stdout:9/442: rename d3/d39/d6a/f12 to d3/d39/d6a/f91 0 2024-09-17T01:06:59.208 INFO:tasks.workunit.client.1.smithi143.stdout:8/452: creat d9/d23/d48/d56/d66/fa9 x:0 0 0 2024-09-17T01:06:59.209 INFO:tasks.workunit.client.1.smithi143.stdout:2/457: mkdir d0/d10/d58/d5a/d5b/d4c/d92 0 2024-09-17T01:06:59.211 INFO:tasks.workunit.client.1.smithi143.stdout:9/443: write d3/d39/d6a/d26/f75 [1534573,24277] 0 2024-09-17T01:06:59.212 INFO:tasks.workunit.client.1.smithi143.stdout:8/453: chown d9/d23/d4f/c98 7564 1 2024-09-17T01:06:59.214 INFO:tasks.workunit.client.1.smithi143.stdout:2/458: symlink d0/d10/d56/l93 0 2024-09-17T01:06:59.215 INFO:tasks.workunit.client.1.smithi143.stdout:9/444: write d3/d81/f85 [790040,68983] 0 2024-09-17T01:06:59.216 INFO:tasks.workunit.client.1.smithi143.stdout:8/454: fdatasync d9/de/d53/d75/f88 0 2024-09-17T01:06:59.216 INFO:tasks.workunit.client.1.smithi143.stdout:3/392: read - d6/d1c/d33/d41/d42/f71 zero size 2024-09-17T01:06:59.220 INFO:tasks.workunit.client.1.smithi143.stdout:7/549: dwrite d4/f82 [4194304,4194304] 0 2024-09-17T01:06:59.224 INFO:tasks.workunit.client.1.smithi143.stdout:6/416: dwrite d2/df/d20/f54 [0,4194304] 0 2024-09-17T01:06:59.225 INFO:tasks.workunit.client.1.smithi143.stdout:7/550: creat d4/d33/d4e/fac x:0 0 0 2024-09-17T01:06:59.228 INFO:tasks.workunit.client.1.smithi143.stdout:6/417: mknod d2/d17/d6e/d26/d46/c81 0 2024-09-17T01:06:59.231 INFO:tasks.workunit.client.1.smithi143.stdout:9/445: getdents d3/d39 0 2024-09-17T01:06:59.233 INFO:tasks.workunit.client.1.smithi143.stdout:2/459: truncate d0/d2/fe 2556913 0 2024-09-17T01:06:59.235 INFO:tasks.workunit.client.1.smithi143.stdout:3/393: dwrite d6/d1c/d33/d41/d2b/f3d [0,4194304] 0 2024-09-17T01:06:59.238 INFO:tasks.workunit.client.1.smithi143.stdout:9/446: rmdir d3/d39/d42/d58/d5a/d5e/d8b 0 2024-09-17T01:06:59.240 INFO:tasks.workunit.client.1.smithi143.stdout:9/447: readlink d3/d16/d34/l90 0 2024-09-17T01:06:59.243 INFO:tasks.workunit.client.1.smithi143.stdout:9/448: chown d3/d39/d6a/f91 1318561971 1 2024-09-17T01:06:59.243 INFO:tasks.workunit.client.1.smithi143.stdout:7/551: dwrite d4/d1f/d29/d65/d5d/f51 [0,4194304] 0 2024-09-17T01:06:59.245 INFO:tasks.workunit.client.1.smithi143.stdout:9/449: chown d3/d16/d3e/d51/f63 0 1 2024-09-17T01:06:59.246 INFO:tasks.workunit.client.1.smithi143.stdout:6/418: fdatasync d2/df/d20/f54 0 2024-09-17T01:06:59.247 INFO:tasks.workunit.client.1.smithi143.stdout:7/552: mknod d4/d33/cad 0 2024-09-17T01:06:59.248 INFO:tasks.workunit.client.1.smithi143.stdout:3/394: dwrite d6/d1c/d33/d41/f16 [0,4194304] 0 2024-09-17T01:06:59.249 INFO:tasks.workunit.client.1.smithi143.stdout:7/553: readlink d4/d1f/d4a/l8c 0 2024-09-17T01:06:59.250 INFO:tasks.workunit.client.1.smithi143.stdout:3/395: dread - d6/d1c/d4b/f67 zero size 2024-09-17T01:06:59.253 INFO:tasks.workunit.client.1.smithi143.stdout:7/554: write d4/d1f/d4a/d66/f6a [718768,58256] 0 2024-09-17T01:06:59.255 INFO:tasks.workunit.client.1.smithi143.stdout:6/419: rename d2/d30/d45/d56/d7e to d2/df/d20/d2c/d82 0 2024-09-17T01:06:59.257 INFO:tasks.workunit.client.1.smithi143.stdout:3/396: mkdir d6/d1c/d33/d3f/d79 0 2024-09-17T01:06:59.257 INFO:tasks.workunit.client.1.smithi143.stdout:7/555: read d4/d16/f1d [14041,51187] 0 2024-09-17T01:06:59.257 INFO:tasks.workunit.client.1.smithi143.stdout:6/420: write d2/df/d20/f53 [1269150,93697] 0 2024-09-17T01:06:59.258 INFO:tasks.workunit.client.1.smithi143.stdout:8/455: dread d9/d12/d4b/f37 [0,4194304] 0 2024-09-17T01:06:59.259 INFO:tasks.workunit.client.1.smithi143.stdout:3/397: symlink d6/d1c/d4b/l7a 0 2024-09-17T01:06:59.262 INFO:tasks.workunit.client.1.smithi143.stdout:8/456: creat d9/d23/faa x:0 0 0 2024-09-17T01:06:59.262 INFO:tasks.workunit.client.1.smithi143.stdout:7/556: getdents d4/d16/d97 0 2024-09-17T01:06:59.263 INFO:tasks.workunit.client.1.smithi143.stdout:3/398: fsync d6/d1c/d33/d41/d2b/f45 0 2024-09-17T01:06:59.264 INFO:tasks.workunit.client.1.smithi143.stdout:8/457: write d9/de/f6f [3642213,32927] 0 2024-09-17T01:06:59.266 INFO:tasks.workunit.client.1.smithi143.stdout:3/399: write d6/d1c/d33/f38 [2978526,31721] 0 2024-09-17T01:06:59.266 INFO:tasks.workunit.client.1.smithi143.stdout:6/421: dwrite d2/df/d40/d41/f4c [0,4194304] 0 2024-09-17T01:06:59.266 INFO:tasks.workunit.client.1.smithi143.stdout:7/557: write d4/fd [4471566,82655] 0 2024-09-17T01:06:59.267 INFO:tasks.workunit.client.1.smithi143.stdout:7/558: chown l0 1841757701 1 2024-09-17T01:06:59.269 INFO:tasks.workunit.client.1.smithi143.stdout:3/400: truncate d6/f73 428078 0 2024-09-17T01:06:59.271 INFO:tasks.workunit.client.1.smithi143.stdout:7/559: creat d4/d26/fae x:0 0 0 2024-09-17T01:06:59.272 INFO:tasks.workunit.client.1.smithi143.stdout:9/450: truncate d3/d39/d6a/d9/f11 2508864 0 2024-09-17T01:06:59.274 INFO:tasks.workunit.client.1.smithi143.stdout:8/458: creat d9/fab x:0 0 0 2024-09-17T01:06:59.276 INFO:tasks.workunit.client.1.smithi143.stdout:3/401: mkdir d6/d1c/d33/d3f/d79/d7b 0 2024-09-17T01:06:59.278 INFO:tasks.workunit.client.1.smithi143.stdout:8/459: truncate d9/d84/f7e 679709 0 2024-09-17T01:06:59.279 INFO:tasks.workunit.client.1.smithi143.stdout:7/560: mknod d4/caf 0 2024-09-17T01:06:59.281 INFO:tasks.workunit.client.1.smithi143.stdout:7/561: read - d4/d1f/d29/d65/f99 zero size 2024-09-17T01:06:59.284 INFO:tasks.workunit.client.1.smithi143.stdout:7/562: rename d4/c6 to d4/d33/d4e/cb0 0 2024-09-17T01:06:59.286 INFO:tasks.workunit.client.1.smithi143.stdout:8/460: link d9/d12/d4b/d3f/f81 d9/d23/fac 0 2024-09-17T01:06:59.286 INFO:tasks.workunit.client.1.smithi143.stdout:3/402: write d6/d1c/f2a [2042640,33765] 0 2024-09-17T01:06:59.287 INFO:tasks.workunit.client.1.smithi143.stdout:8/461: stat d9/d2b/l44 0 2024-09-17T01:06:59.291 INFO:tasks.workunit.client.1.smithi143.stdout:6/422: dwrite d2/d17/f25 [0,4194304] 0 2024-09-17T01:06:59.293 INFO:tasks.workunit.client.1.smithi143.stdout:8/462: mknod d9/d23/d32/cad 0 2024-09-17T01:06:59.296 INFO:tasks.workunit.client.1.smithi143.stdout:6/423: write d2/d30/d45/d70/f78 [4618772,54133] 0 2024-09-17T01:06:59.297 INFO:tasks.workunit.client.1.smithi143.stdout:9/451: dread d3/d39/d42/f5d [0,4194304] 0 2024-09-17T01:06:59.298 INFO:tasks.workunit.client.1.smithi143.stdout:3/403: write d6/d1c/d33/d41/f28 [4748715,91317] 0 2024-09-17T01:06:59.300 INFO:tasks.workunit.client.1.smithi143.stdout:6/424: mknod d2/d64/c83 0 2024-09-17T01:06:59.301 INFO:tasks.workunit.client.1.smithi143.stdout:7/563: dwrite d4/d1f/d4a/d66/f75 [0,4194304] 0 2024-09-17T01:06:59.301 INFO:tasks.workunit.client.1.smithi143.stdout:9/452: chown d3/d39/d6a/d26/f75 5218 1 2024-09-17T01:06:59.302 INFO:tasks.workunit.client.1.smithi143.stdout:7/564: chown d4/l70 456548 1 2024-09-17T01:06:59.303 INFO:tasks.workunit.client.1.smithi143.stdout:8/463: rename d9/d23/fac to d9/d23/d48/fae 0 2024-09-17T01:06:59.306 INFO:tasks.workunit.client.1.smithi143.stdout:6/425: mkdir d2/d30/d84 0 2024-09-17T01:06:59.306 INFO:tasks.workunit.client.1.smithi143.stdout:8/464: dread - d9/d23/d4f/f6e zero size 2024-09-17T01:06:59.308 INFO:tasks.workunit.client.1.smithi143.stdout:3/404: mknod d6/d1c/d33/d41/d2e/d30/c7c 0 2024-09-17T01:06:59.311 INFO:tasks.workunit.client.1.smithi143.stdout:9/453: dwrite d3/d3d/d48/f59 [0,4194304] 0 2024-09-17T01:06:59.312 INFO:tasks.workunit.client.1.smithi143.stdout:6/426: creat d2/d17/d6e/d26/d46/d65/f85 x:0 0 0 2024-09-17T01:06:59.313 INFO:tasks.workunit.client.1.smithi143.stdout:3/405: creat d6/d1c/d33/d3f/f7d x:0 0 0 2024-09-17T01:06:59.317 INFO:tasks.workunit.client.1.smithi143.stdout:9/454: link d3/d39/d6a/d9/f37 d3/d3d/f92 0 2024-09-17T01:06:59.317 INFO:tasks.workunit.client.1.smithi143.stdout:3/406: chown d6/d1c/d33/d41/d2e/f61 325920 1 2024-09-17T01:06:59.319 INFO:tasks.workunit.client.1.smithi143.stdout:3/407: chown d6/d1c/d33/d5d 0 1 2024-09-17T01:06:59.320 INFO:tasks.workunit.client.1.smithi143.stdout:9/455: creat d3/d16/d34/f93 x:0 0 0 2024-09-17T01:06:59.320 INFO:tasks.workunit.client.1.smithi143.stdout:8/465: dwrite d9/d23/d48/d55/d57/d9d/fa1 [0,4194304] 0 2024-09-17T01:06:59.322 INFO:tasks.workunit.client.1.smithi143.stdout:3/408: stat d6/d1c/d33/d41/d2b/l49 0 2024-09-17T01:06:59.322 INFO:tasks.workunit.client.1.smithi143.stdout:6/427: dread d2/d30/d45/f4d [0,4194304] 0 2024-09-17T01:06:59.323 INFO:tasks.workunit.client.1.smithi143.stdout:9/456: dread - d3/d16/d3e/d51/f71 zero size 2024-09-17T01:06:59.323 INFO:tasks.workunit.client.1.smithi143.stdout:8/466: dread - d9/d23/d4f/f6e zero size 2024-09-17T01:06:59.325 INFO:tasks.workunit.client.1.smithi143.stdout:7/565: dread d4/f1b [4194304,4194304] 0 2024-09-17T01:06:59.326 INFO:tasks.workunit.client.1.smithi143.stdout:9/457: symlink d3/d39/d6a/d9/l94 0 2024-09-17T01:06:59.326 INFO:tasks.workunit.client.1.smithi143.stdout:6/428: creat d2/d64/d74/f86 x:0 0 0 2024-09-17T01:06:59.327 INFO:tasks.workunit.client.1.smithi143.stdout:3/409: mknod d6/d1c/d33/d41/d42/c7e 0 2024-09-17T01:06:59.327 INFO:tasks.workunit.client.1.smithi143.stdout:3/410: chown d6/d1c/d4b 390365 1 2024-09-17T01:06:59.328 INFO:tasks.workunit.client.1.smithi143.stdout:6/429: chown d2/df/d40/d41/f4c 817816 1 2024-09-17T01:06:59.329 INFO:tasks.workunit.client.1.smithi143.stdout:3/411: chown d6/l8 2192575 1 2024-09-17T01:06:59.329 INFO:tasks.workunit.client.1.smithi143.stdout:8/467: rename d9/d23/d48/d56/d66/d7d to d9/de/d53/d75/daf 0 2024-09-17T01:06:59.331 INFO:tasks.workunit.client.1.smithi143.stdout:7/566: write d4/d1f/d29/f81 [814886,12471] 0 2024-09-17T01:06:59.331 INFO:tasks.workunit.client.1.smithi143.stdout:9/458: mknod d3/d39/d6a/d9/c95 0 2024-09-17T01:06:59.331 INFO:tasks.workunit.client.1.smithi143.stdout:6/430: dread - d2/d17/d6e/d26/d46/d65/f85 zero size 2024-09-17T01:06:59.334 INFO:tasks.workunit.client.1.smithi143.stdout:7/567: fsync d4/d1f/d29/f71 0 2024-09-17T01:06:59.335 INFO:tasks.workunit.client.1.smithi143.stdout:9/459: write d3/d3d/f70 [431464,126336] 0 2024-09-17T01:06:59.335 INFO:tasks.workunit.client.1.smithi143.stdout:6/431: unlink d2/d17/d3a/f3c 0 2024-09-17T01:06:59.339 INFO:tasks.workunit.client.1.smithi143.stdout:7/568: mkdir d4/d1f/d29/d65/d5d/db1 0 2024-09-17T01:06:59.340 INFO:tasks.workunit.client.1.smithi143.stdout:6/432: write d2/d30/d45/f50 [156923,14847] 0 2024-09-17T01:06:59.340 INFO:tasks.workunit.client.1.smithi143.stdout:8/468: getdents d9/d12/d38/d58/d70 0 2024-09-17T01:06:59.340 INFO:tasks.workunit.client.1.smithi143.stdout:9/460: symlink d3/d39/d6a/l96 0 2024-09-17T01:06:59.341 INFO:tasks.workunit.client.1.smithi143.stdout:3/412: dwrite d6/d1c/d33/d41/d2e/d30/f69 [0,4194304] 0 2024-09-17T01:06:59.344 INFO:tasks.workunit.client.1.smithi143.stdout:3/413: chown d6/d1c/d4b/f67 11809137 1 2024-09-17T01:06:59.349 INFO:tasks.workunit.client.1.smithi143.stdout:3/414: creat d6/d1c/d33/d3f/f7f x:0 0 0 2024-09-17T01:06:59.350 INFO:tasks.workunit.client.1.smithi143.stdout:7/569: dread d4/fd [0,4194304] 0 2024-09-17T01:06:59.354 INFO:tasks.workunit.client.1.smithi143.stdout:9/461: dwrite d3/d39/d6a/d26/f3c [0,4194304] 0 2024-09-17T01:06:59.354 INFO:tasks.workunit.client.1.smithi143.stdout:7/570: symlink d4/d26/lb2 0 2024-09-17T01:06:59.354 INFO:tasks.workunit.client.1.smithi143.stdout:8/469: dread d9/de/f10 [0,4194304] 0 2024-09-17T01:06:59.355 INFO:tasks.workunit.client.1.smithi143.stdout:6/433: dwrite d2/d30/d45/d56/f60 [0,4194304] 0 2024-09-17T01:06:59.357 INFO:tasks.workunit.client.1.smithi143.stdout:8/470: fdatasync d9/de/d53/d75/f88 0 2024-09-17T01:06:59.358 INFO:tasks.workunit.client.1.smithi143.stdout:6/434: write d2/d17/d6e/d26/d46/f80 [189712,72516] 0 2024-09-17T01:06:59.358 INFO:tasks.workunit.client.1.smithi143.stdout:3/415: symlink d6/d1c/d33/d41/d42/l80 0 2024-09-17T01:06:59.360 INFO:tasks.workunit.client.1.smithi143.stdout:9/462: creat d3/d39/d6a/d9/d74/f97 x:0 0 0 2024-09-17T01:06:59.363 INFO:tasks.workunit.client.1.smithi143.stdout:6/435: write d2/df/d20/d2c/d75/f71 [2600960,64598] 0 2024-09-17T01:06:59.364 INFO:tasks.workunit.client.1.smithi143.stdout:3/416: read d6/f58 [325985,66569] 0 2024-09-17T01:06:59.364 INFO:tasks.workunit.client.1.smithi143.stdout:7/571: creat d4/d1f/d29/d65/d5d/db1/fb3 x:0 0 0 2024-09-17T01:06:59.366 INFO:tasks.workunit.client.1.smithi143.stdout:6/436: unlink d2/f5 0 2024-09-17T01:06:59.367 INFO:tasks.workunit.client.1.smithi143.stdout:3/417: write d6/d1c/f66 [359177,114854] 0 2024-09-17T01:06:59.368 INFO:tasks.workunit.client.1.smithi143.stdout:8/471: dwrite d9/d23/d32/f51 [4194304,4194304] 0 2024-09-17T01:06:59.373 INFO:tasks.workunit.client.1.smithi143.stdout:6/437: rename d2/d64 to d2/d30/d45/d70/d87 0 2024-09-17T01:06:59.377 INFO:tasks.workunit.client.1.smithi143.stdout:8/472: rename d9/d12/d38/d7a/f7b to d9/d23/d32/fb0 0 2024-09-17T01:06:59.378 INFO:tasks.workunit.client.1.smithi143.stdout:6/438: creat d2/d17/d6e/d26/d46/d66/f88 x:0 0 0 2024-09-17T01:06:59.379 INFO:tasks.workunit.client.1.smithi143.stdout:6/439: dread d2/d30/d45/f4d [0,4194304] 0 2024-09-17T01:06:59.383 INFO:tasks.workunit.client.1.smithi143.stdout:6/440: symlink d2/d17/d3a/l89 0 2024-09-17T01:06:59.384 INFO:tasks.workunit.client.1.smithi143.stdout:8/473: dwrite d9/d84/f7e [0,4194304] 0 2024-09-17T01:06:59.384 INFO:tasks.workunit.client.1.smithi143.stdout:6/441: dread - d2/d17/f77 zero size 2024-09-17T01:06:59.387 INFO:tasks.workunit.client.1.smithi143.stdout:6/442: creat d2/d19/f8a x:0 0 0 2024-09-17T01:06:59.388 INFO:tasks.workunit.client.1.smithi143.stdout:6/443: chown d2/df/f2e 656 1 2024-09-17T01:06:59.389 INFO:tasks.workunit.client.1.smithi143.stdout:8/474: link d9/de/d53/l54 d9/d84/lb1 0 2024-09-17T01:06:59.391 INFO:tasks.workunit.client.1.smithi143.stdout:7/572: dread d4/d26/f22 [0,4194304] 0 2024-09-17T01:06:59.393 INFO:tasks.workunit.client.1.smithi143.stdout:7/573: fsync d4/d1f/d29/d65/f7c 0 2024-09-17T01:06:59.393 INFO:tasks.workunit.client.1.smithi143.stdout:8/475: dread d9/d12/d4b/f37 [0,4194304] 0 2024-09-17T01:06:59.395 INFO:tasks.workunit.client.1.smithi143.stdout:8/476: read d9/d23/d48/f40 [107563,11026] 0 2024-09-17T01:06:59.395 INFO:tasks.workunit.client.1.smithi143.stdout:7/574: mknod d4/d1f/d4a/d66/cb4 0 2024-09-17T01:06:59.396 INFO:tasks.workunit.client.1.smithi143.stdout:6/444: dwrite d2/df/d20/d2c/f22 [0,4194304] 0 2024-09-17T01:06:59.396 INFO:tasks.workunit.client.1.smithi143.stdout:8/477: write d9/fa [2478533,13992] 0 2024-09-17T01:06:59.399 INFO:tasks.workunit.client.1.smithi143.stdout:8/478: chown d9/d12/d38/f3d 0 1 2024-09-17T01:06:59.401 INFO:tasks.workunit.client.1.smithi143.stdout:6/445: mknod d2/d17/d6e/d26/d79/c8b 0 2024-09-17T01:06:59.404 INFO:tasks.workunit.client.1.smithi143.stdout:8/479: link d9/d12/d4b/c8b d9/d12/d4b/cb2 0 2024-09-17T01:06:59.405 INFO:tasks.workunit.client.1.smithi143.stdout:6/446: rename d2/df/d20/f5a to d2/df/d40/d41/f8c 0 2024-09-17T01:06:59.407 INFO:tasks.workunit.client.1.smithi143.stdout:8/480: unlink d9/d84/l8a 0 2024-09-17T01:06:59.408 INFO:tasks.workunit.client.1.smithi143.stdout:7/575: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:06:59.410 INFO:tasks.workunit.client.1.smithi143.stdout:7/576: mkdir d4/d1f/d4a/d66/db5 0 2024-09-17T01:06:59.412 INFO:tasks.workunit.client.1.smithi143.stdout:8/481: getdents d9/d23/d32 0 2024-09-17T01:06:59.413 INFO:tasks.workunit.client.1.smithi143.stdout:7/577: mknod d4/d1f/d29/cb6 0 2024-09-17T01:06:59.413 INFO:tasks.workunit.client.1.smithi143.stdout:8/482: stat d9/d12/l34 0 2024-09-17T01:06:59.423 INFO:tasks.workunit.client.1.smithi143.stdout:5/439: sync 2024-09-17T01:06:59.423 INFO:tasks.workunit.client.1.smithi143.stdout:0/494: sync 2024-09-17T01:06:59.425 INFO:tasks.workunit.client.1.smithi143.stdout:7/578: dwrite d4/f1b [4194304,4194304] 0 2024-09-17T01:06:59.426 INFO:tasks.workunit.client.1.smithi143.stdout:0/495: readlink d3/d5/l6 0 2024-09-17T01:06:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:06:59 smithi103 ceph-mon[28156]: pgmap v10: 65 pgs: 65 active+clean; 764 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 81 MiB/s wr, 250 op/s 2024-09-17T01:06:59.427 INFO:tasks.workunit.client.1.smithi143.stdout:6/447: dwrite d2/d30/d45/f4d [0,4194304] 0 2024-09-17T01:06:59.428 INFO:tasks.workunit.client.1.smithi143.stdout:8/483: dwrite d9/d23/d4f/fa2 [0,4194304] 0 2024-09-17T01:06:59.429 INFO:tasks.workunit.client.1.smithi143.stdout:6/448: fdatasync d2/d17/f25 0 2024-09-17T01:06:59.430 INFO:tasks.workunit.client.1.smithi143.stdout:7/579: creat d4/fb7 x:0 0 0 2024-09-17T01:06:59.431 INFO:tasks.workunit.client.1.smithi143.stdout:8/484: truncate d9/d23/faa 525520 0 2024-09-17T01:06:59.434 INFO:tasks.workunit.client.1.smithi143.stdout:6/449: fdatasync d2/df/d20/d2c/d38/f72 0 2024-09-17T01:06:59.435 INFO:tasks.workunit.client.1.smithi143.stdout:7/580: creat d4/d1f/d4a/d66/d86/fb8 x:0 0 0 2024-09-17T01:06:59.436 INFO:tasks.workunit.client.1.smithi143.stdout:7/581: fsync d4/d1f/f30 0 2024-09-17T01:06:59.437 INFO:tasks.workunit.client.1.smithi143.stdout:5/440: link d1/d46/df/l73 d1/d46/df/d23/d4f/d7d/d92/dad/lae 0 2024-09-17T01:06:59.438 INFO:tasks.workunit.client.1.smithi143.stdout:0/496: getdents d3/d5/d8/d27/d31/d48 0 2024-09-17T01:06:59.439 INFO:tasks.workunit.client.1.smithi143.stdout:6/450: mkdir d2/d30/d45/d70/d87/d8d 0 2024-09-17T01:06:59.439 INFO:tasks.workunit.client.1.smithi143.stdout:0/497: chown d3/d14/d3d/f76 308875069 1 2024-09-17T01:06:59.441 INFO:tasks.workunit.client.1.smithi143.stdout:5/441: dread - d1/d46/f91 zero size 2024-09-17T01:06:59.442 INFO:tasks.workunit.client.1.smithi143.stdout:7/582: rename d4/d1f/d4a/d66/c7d to d4/d1f/d29/cb9 0 2024-09-17T01:06:59.443 INFO:tasks.workunit.client.1.smithi143.stdout:0/498: mknod d3/d14/d3d/ca5 0 2024-09-17T01:06:59.444 INFO:tasks.workunit.client.1.smithi143.stdout:8/485: getdents d9/d12/d13/d73 0 2024-09-17T01:06:59.445 INFO:tasks.workunit.client.1.smithi143.stdout:7/583: mknod d4/d1f/d29/d65/d5d/db1/cba 0 2024-09-17T01:06:59.446 INFO:tasks.workunit.client.1.smithi143.stdout:8/486: symlink d9/d12/lb3 0 2024-09-17T01:06:59.446 INFO:tasks.workunit.client.1.smithi143.stdout:0/499: mknod d3/d5/d8/d27/d31/d48/d8d/ca6 0 2024-09-17T01:06:59.447 INFO:tasks.workunit.client.1.smithi143.stdout:7/584: write d4/d26/f2d [573076,36879] 0 2024-09-17T01:06:59.449 INFO:tasks.workunit.client.1.smithi143.stdout:0/500: symlink d3/d14/la7 0 2024-09-17T01:06:59.449 INFO:tasks.workunit.client.1.smithi143.stdout:7/585: dread - d4/d1f/d29/d65/f99 zero size 2024-09-17T01:06:59.451 INFO:tasks.workunit.client.1.smithi143.stdout:7/586: fsync d4/f82 0 2024-09-17T01:06:59.451 INFO:tasks.workunit.client.1.smithi143.stdout:6/451: dwrite d2/d17/d6e/d26/d46/f80 [0,4194304] 0 2024-09-17T01:06:59.452 INFO:tasks.workunit.client.1.smithi143.stdout:0/501: read d3/d5/d8/d21/f3e [529488,121790] 0 2024-09-17T01:06:59.454 INFO:tasks.workunit.client.1.smithi143.stdout:6/452: write d2/df/f6b [290479,117127] 0 2024-09-17T01:06:59.455 INFO:tasks.workunit.client.1.smithi143.stdout:0/502: mkdir d3/d5/d35/da8 0 2024-09-17T01:06:59.457 INFO:tasks.workunit.client.1.smithi143.stdout:7/587: getdents d4/d1f/d4a/d9e 0 2024-09-17T01:06:59.458 INFO:tasks.workunit.client.1.smithi143.stdout:6/453: mkdir d2/d17/d3a/d47/d8e 0 2024-09-17T01:06:59.459 INFO:tasks.workunit.client.1.smithi143.stdout:7/588: chown d4/d1f/d29/d65/d5d/db1 606002277 1 2024-09-17T01:06:59.460 INFO:tasks.workunit.client.1.smithi143.stdout:7/589: chown d4/d16/d97/da3 2588 1 2024-09-17T01:06:59.462 INFO:tasks.workunit.client.1.smithi143.stdout:0/503: dwrite d3/d14/f61 [4194304,4194304] 0 2024-09-17T01:06:59.466 INFO:tasks.workunit.client.1.smithi143.stdout:7/590: dread d4/f18 [0,4194304] 0 2024-09-17T01:06:59.468 INFO:tasks.workunit.client.1.smithi143.stdout:7/591: readlink d4/d1f/d4a/l8c 0 2024-09-17T01:06:59.470 INFO:tasks.workunit.client.1.smithi143.stdout:0/504: write d3/d14/d3d/f5d [454824,29311] 0 2024-09-17T01:06:59.474 INFO:tasks.workunit.client.1.smithi143.stdout:0/505: creat d3/d14/fa9 x:0 0 0 2024-09-17T01:06:59.475 INFO:tasks.workunit.client.1.smithi143.stdout:7/592: dwrite d4/d16/f6d [0,4194304] 0 2024-09-17T01:06:59.476 INFO:tasks.workunit.client.1.smithi143.stdout:0/506: chown d3/d5/d8/d27/d31/l4d 430 1 2024-09-17T01:06:59.480 INFO:tasks.workunit.client.1.smithi143.stdout:0/507: fdatasync d3/d5/d8/d27/d31/d48/f5e 0 2024-09-17T01:06:59.482 INFO:tasks.workunit.client.1.smithi143.stdout:7/593: creat d4/fbb x:0 0 0 2024-09-17T01:06:59.482 INFO:tasks.workunit.client.1.smithi143.stdout:7/594: chown d4/d33 4948883 1 2024-09-17T01:06:59.486 INFO:tasks.workunit.client.1.smithi143.stdout:6/454: dread d2/df/f31 [0,4194304] 0 2024-09-17T01:06:59.490 INFO:tasks.workunit.client.1.smithi143.stdout:7/595: dread d4/d1f/f31 [0,4194304] 0 2024-09-17T01:06:59.491 INFO:tasks.workunit.client.1.smithi143.stdout:6/455: dread d2/d17/d6e/d26/d46/f80 [0,4194304] 0 2024-09-17T01:06:59.491 INFO:tasks.workunit.client.1.smithi143.stdout:6/456: readlink d2/df/d20/d2c/l4e 0 2024-09-17T01:06:59.492 INFO:tasks.workunit.client.1.smithi143.stdout:7/596: mknod d4/d33/d4e/cbc 0 2024-09-17T01:06:59.492 INFO:tasks.workunit.client.1.smithi143.stdout:7/597: write d4/d1f/f30 [6268769,115253] 0 2024-09-17T01:06:59.494 INFO:tasks.workunit.client.1.smithi143.stdout:7/598: mkdir d4/d16/dbd 0 2024-09-17T01:06:59.495 INFO:tasks.workunit.client.1.smithi143.stdout:7/599: write d4/d1f/f31 [935538,113233] 0 2024-09-17T01:06:59.496 INFO:tasks.workunit.client.1.smithi143.stdout:7/600: write d4/d16/f6d [837450,53067] 0 2024-09-17T01:06:59.501 INFO:tasks.workunit.client.1.smithi143.stdout:6/457: link d2/d17/d6e/d26/f32 d2/d30/d45/d4a/d5e/d7c/f8f 0 2024-09-17T01:06:59.501 INFO:tasks.workunit.client.1.smithi143.stdout:7/601: rmdir d4 39 2024-09-17T01:06:59.502 INFO:tasks.workunit.client.1.smithi143.stdout:6/458: read d2/df/d20/d2c/d38/f39 [187329,126760] 0 2024-09-17T01:06:59.503 INFO:tasks.workunit.client.1.smithi143.stdout:7/602: fsync d4/f18 0 2024-09-17T01:06:59.504 INFO:tasks.workunit.client.1.smithi143.stdout:6/459: chown d2/d17/d6e/d26/d46/f4b 1093873 1 2024-09-17T01:06:59.504 INFO:tasks.workunit.client.1.smithi143.stdout:7/603: write d4/d1f/f31 [1323886,26337] 0 2024-09-17T01:06:59.505 INFO:tasks.workunit.client.1.smithi143.stdout:7/604: dread - d4/d33/d78/f87 zero size 2024-09-17T01:06:59.505 INFO:tasks.workunit.client.1.smithi143.stdout:6/460: mknod d2/df/d20/d2c/d82/c90 0 2024-09-17T01:06:59.506 INFO:tasks.workunit.client.1.smithi143.stdout:7/605: chown d4/d33/d4e/c7e 23770926 1 2024-09-17T01:06:59.506 INFO:tasks.workunit.client.1.smithi143.stdout:6/461: write d2/d17/f25 [4862852,24657] 0 2024-09-17T01:06:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:06:59 smithi143 ceph-mon[35452]: pgmap v10: 65 pgs: 65 active+clean; 764 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 81 MiB/s wr, 250 op/s 2024-09-17T01:06:59.509 INFO:tasks.workunit.client.1.smithi143.stdout:7/606: getdents d4/d1f 0 2024-09-17T01:06:59.510 INFO:tasks.workunit.client.1.smithi143.stdout:6/462: dread d2/d19/f1b [4194304,4194304] 0 2024-09-17T01:06:59.513 INFO:tasks.workunit.client.1.smithi143.stdout:6/463: getdents d2/d30/d45/d70/d87 0 2024-09-17T01:06:59.515 INFO:tasks.workunit.client.1.smithi143.stdout:7/607: dwrite d4/d1f/d4a/f89 [4194304,4194304] 0 2024-09-17T01:06:59.518 INFO:tasks.workunit.client.1.smithi143.stdout:7/608: rename d4/d33/d4e/l72 to d4/d1f/d29/d65/d5d/db1/lbe 0 2024-09-17T01:06:59.520 INFO:tasks.workunit.client.1.smithi143.stdout:7/609: getdents d4/d1f/d4a/d9e/da2 0 2024-09-17T01:06:59.520 INFO:tasks.workunit.client.1.smithi143.stdout:6/464: dread d2/d30/f57 [0,4194304] 0 2024-09-17T01:06:59.521 INFO:tasks.workunit.client.1.smithi143.stdout:6/465: write d2/df/d20/d2c/d75/f71 [2696022,40146] 0 2024-09-17T01:06:59.522 INFO:tasks.workunit.client.1.smithi143.stdout:6/466: chown d2 248 1 2024-09-17T01:06:59.524 INFO:tasks.workunit.client.1.smithi143.stdout:6/467: readlink d2/df/d20/l4f 0 2024-09-17T01:06:59.524 INFO:tasks.workunit.client.1.smithi143.stdout:7/610: dread d4/d1f/d4a/d66/f6a [0,4194304] 0 2024-09-17T01:06:59.526 INFO:tasks.workunit.client.1.smithi143.stdout:7/611: creat d4/d16/d97/fbf x:0 0 0 2024-09-17T01:06:59.527 INFO:tasks.workunit.client.1.smithi143.stdout:7/612: chown d4/d33/d78/f91 43400 1 2024-09-17T01:06:59.528 INFO:tasks.workunit.client.1.smithi143.stdout:6/468: dread d2/d17/d6e/d26/d46/f80 [0,4194304] 0 2024-09-17T01:06:59.529 INFO:tasks.workunit.client.1.smithi143.stdout:7/613: creat d4/d1f/d29/d65/d5d/db1/fc0 x:0 0 0 2024-09-17T01:06:59.531 INFO:tasks.workunit.client.1.smithi143.stdout:7/614: chown d4/d1f/f30 900115 1 2024-09-17T01:06:59.531 INFO:tasks.workunit.client.1.smithi143.stdout:7/615: write d4/d16/d97/fbf [437590,64809] 0 2024-09-17T01:06:59.533 INFO:tasks.workunit.client.1.smithi143.stdout:7/616: write d4/d33/d78/f91 [441978,30601] 0 2024-09-17T01:06:59.536 INFO:tasks.workunit.client.1.smithi143.stdout:7/617: mkdir d4/d1f/d4a/dc1 0 2024-09-17T01:06:59.538 INFO:tasks.workunit.client.1.smithi143.stdout:7/618: creat d4/d1f/d4a/d66/fc2 x:0 0 0 2024-09-17T01:06:59.538 INFO:tasks.workunit.client.1.smithi143.stdout:6/469: write d2/d30/d45/d4a/d5e/d7c/f8f [168675,118984] 0 2024-09-17T01:06:59.539 INFO:tasks.workunit.client.1.smithi143.stdout:7/619: dread - d4/d26/fab zero size 2024-09-17T01:06:59.540 INFO:tasks.workunit.client.1.smithi143.stdout:6/470: creat d2/d30/d45/d4a/f91 x:0 0 0 2024-09-17T01:06:59.541 INFO:tasks.workunit.client.1.smithi143.stdout:7/620: truncate d4/d1f/f3e 1465222 0 2024-09-17T01:06:59.542 INFO:tasks.workunit.client.1.smithi143.stdout:6/471: mkdir d2/d19/d92 0 2024-09-17T01:06:59.549 INFO:tasks.workunit.client.1.smithi143.stdout:4/426: sync 2024-09-17T01:06:59.551 INFO:tasks.workunit.client.1.smithi143.stdout:4/427: dread da/d3a/d40/f5b [0,4194304] 0 2024-09-17T01:06:59.552 INFO:tasks.workunit.client.1.smithi143.stdout:7/621: dread d4/d33/f45 [0,4194304] 0 2024-09-17T01:06:59.554 INFO:tasks.workunit.client.1.smithi143.stdout:4/428: rename da/d3a/d3e/d42 to da/d3a/d40/d84 0 2024-09-17T01:06:59.556 INFO:tasks.workunit.client.1.smithi143.stdout:4/429: mknod da/d3a/d3e/d5e/c85 0 2024-09-17T01:06:59.558 INFO:tasks.workunit.client.1.smithi143.stdout:4/430: rename da/l81 to da/d68/l86 0 2024-09-17T01:06:59.560 INFO:tasks.workunit.client.1.smithi143.stdout:4/431: creat da/d68/f87 x:0 0 0 2024-09-17T01:06:59.561 INFO:tasks.workunit.client.1.smithi143.stdout:7/622: truncate f2 7887174 0 2024-09-17T01:06:59.563 INFO:tasks.workunit.client.1.smithi143.stdout:4/432: dread da/d3a/f3b [0,4194304] 0 2024-09-17T01:06:59.564 INFO:tasks.workunit.client.1.smithi143.stdout:4/433: stat da/d3a/d40/f5b 0 2024-09-17T01:06:59.565 INFO:tasks.workunit.client.1.smithi143.stdout:7/623: getdents d4/d1f/d29/d65/d5d 0 2024-09-17T01:06:59.565 INFO:tasks.workunit.client.1.smithi143.stdout:4/434: creat da/d75/f88 x:0 0 0 2024-09-17T01:06:59.611 INFO:tasks.workunit.client.1.smithi143.stdout:1/523: sync 2024-09-17T01:06:59.621 INFO:tasks.workunit.client.1.smithi143.stdout:7/624: write d4/d1f/d4a/fa0 [667074,119408] 0 2024-09-17T01:06:59.622 INFO:tasks.workunit.client.1.smithi143.stdout:4/435: write da/f2d [1803149,15997] 0 2024-09-17T01:06:59.623 INFO:tasks.workunit.client.1.smithi143.stdout:1/524: readlink d0/d6/d43/d6a/df/d6e/d18/d4d/l77 0 2024-09-17T01:06:59.623 INFO:tasks.workunit.client.1.smithi143.stdout:7/625: rmdir d4/d1f/d29/d65 39 2024-09-17T01:06:59.625 INFO:tasks.workunit.client.1.smithi143.stdout:1/525: mkdir d0/d6/d43/d6a/d52/db2 0 2024-09-17T01:06:59.627 INFO:tasks.workunit.client.1.smithi143.stdout:4/436: rmdir da/d68/d61 0 2024-09-17T01:06:59.628 INFO:tasks.workunit.client.1.smithi143.stdout:7/626: dread d4/d1f/d4a/d66/f75 [0,4194304] 0 2024-09-17T01:06:59.629 INFO:tasks.workunit.client.1.smithi143.stdout:4/437: truncate da/d68/f5d 4623887 0 2024-09-17T01:06:59.629 INFO:tasks.workunit.client.1.smithi143.stdout:1/526: write d0/d6/d43/d6a/df/d6e/d2/d39/f5e [1930674,80710] 0 2024-09-17T01:06:59.631 INFO:tasks.workunit.client.1.smithi143.stdout:4/438: mkdir da/d3a/d40/d89 0 2024-09-17T01:06:59.631 INFO:tasks.workunit.client.1.smithi143.stdout:1/527: mkdir d0/d6/d43/d6a/d52/db3 0 2024-09-17T01:06:59.632 INFO:tasks.workunit.client.1.smithi143.stdout:7/627: symlink d4/d16/d97/da3/lc3 0 2024-09-17T01:06:59.636 INFO:tasks.workunit.client.1.smithi143.stdout:7/628: rename d4/d1f/d4a/d66/l92 to d4/d1f/d4a/d9e/da2/lc4 0 2024-09-17T01:06:59.637 INFO:tasks.workunit.client.1.smithi143.stdout:7/629: write d4/d33/f45 [4248442,109625] 0 2024-09-17T01:06:59.638 INFO:tasks.workunit.client.1.smithi143.stdout:4/439: write da/d6d/f76 [823536,125181] 0 2024-09-17T01:06:59.638 INFO:tasks.workunit.client.1.smithi143.stdout:1/528: dread d0/d6/d43/d6a/df/d6e/d2/d39/f5e [0,4194304] 0 2024-09-17T01:06:59.640 INFO:tasks.workunit.client.1.smithi143.stdout:1/529: read d0/dc/f83 [924047,109964] 0 2024-09-17T01:06:59.642 INFO:tasks.workunit.client.1.smithi143.stdout:1/530: write d0/d6/d43/d6a/f48 [1144148,120752] 0 2024-09-17T01:06:59.644 INFO:tasks.workunit.client.1.smithi143.stdout:7/630: getdents d4/d1f/d4a/d66 0 2024-09-17T01:06:59.647 INFO:tasks.workunit.client.1.smithi143.stdout:7/631: link d4/d33/d4e/cbc d4/d26/cc5 0 2024-09-17T01:06:59.649 INFO:tasks.workunit.client.1.smithi143.stdout:7/632: mkdir d4/d1f/d29/d65/d5d/db1/dc6 0 2024-09-17T01:06:59.649 INFO:tasks.workunit.client.1.smithi143.stdout:1/531: dread d0/d6/f3a [0,4194304] 0 2024-09-17T01:06:59.652 INFO:tasks.workunit.client.1.smithi143.stdout:1/532: write d0/d6/d43/d6a/df/d6e/f1d [1057637,117336] 0 2024-09-17T01:06:59.652 INFO:tasks.workunit.client.1.smithi143.stdout:7/633: mknod d4/d33/d4e/d9f/cc7 0 2024-09-17T01:06:59.653 INFO:tasks.workunit.client.1.smithi143.stdout:1/533: fsync d0/d6/d43/d6a/f48 0 2024-09-17T01:06:59.653 INFO:tasks.workunit.client.1.smithi143.stdout:1/534: readlink d0/d6/l4c 0 2024-09-17T01:06:59.654 INFO:tasks.workunit.client.1.smithi143.stdout:1/535: stat d0/d6/d43/d47/d68/f73 0 2024-09-17T01:06:59.656 INFO:tasks.workunit.client.1.smithi143.stdout:1/536: mknod d0/d6/d43/d6a/d52/cb4 0 2024-09-17T01:06:59.660 INFO:tasks.workunit.client.1.smithi143.stdout:7/634: truncate d4/d1f/d4a/d66/f6c 3818609 0 2024-09-17T01:06:59.662 INFO:tasks.workunit.client.1.smithi143.stdout:7/635: symlink d4/d1f/d4a/d9e/lc8 0 2024-09-17T01:06:59.663 INFO:tasks.workunit.client.1.smithi143.stdout:7/636: write d4/d1f/d29/f81 [145128,30567] 0 2024-09-17T01:06:59.663 INFO:tasks.workunit.client.1.smithi143.stdout:7/637: chown d4/d33/c9b 4503007 1 2024-09-17T01:06:59.665 INFO:tasks.workunit.client.1.smithi143.stdout:7/638: creat d4/d16/dbd/fc9 x:0 0 0 2024-09-17T01:06:59.666 INFO:tasks.workunit.client.1.smithi143.stdout:7/639: chown d4/d16/d97/fa6 22968 1 2024-09-17T01:06:59.668 INFO:tasks.workunit.client.1.smithi143.stdout:7/640: creat d4/d33/d4e/d9f/fca x:0 0 0 2024-09-17T01:06:59.672 INFO:tasks.workunit.client.1.smithi143.stdout:1/537: dread d0/dc/d57/f5d [0,4194304] 0 2024-09-17T01:06:59.678 INFO:tasks.workunit.client.1.smithi143.stdout:7/641: truncate d4/d1f/d4a/d66/f6c 3740698 0 2024-09-17T01:06:59.680 INFO:tasks.workunit.client.1.smithi143.stdout:1/538: dwrite d0/d6/d43/d6a/df/d6e/d18/d2d/f51 [0,4194304] 0 2024-09-17T01:06:59.683 INFO:tasks.workunit.client.1.smithi143.stdout:1/539: symlink d0/d6/d43/d47/d72/lb5 0 2024-09-17T01:06:59.684 INFO:tasks.workunit.client.1.smithi143.stdout:1/540: chown d0/d6/d43/d6a/df/d6e/d18/f36 247 1 2024-09-17T01:06:59.686 INFO:tasks.workunit.client.1.smithi143.stdout:1/541: truncate d0/d6/d43/f67 695293 0 2024-09-17T01:06:59.687 INFO:tasks.workunit.client.1.smithi143.stdout:1/542: write d0/d6/d43/d6a/df/d6e/d18/f36 [743888,113684] 0 2024-09-17T01:06:59.693 INFO:tasks.workunit.client.1.smithi143.stdout:1/543: dwrite d0/d6/f3a [0,4194304] 0 2024-09-17T01:06:59.695 INFO:tasks.workunit.client.1.smithi143.stdout:1/544: unlink d0/l24 0 2024-09-17T01:06:59.698 INFO:tasks.workunit.client.1.smithi143.stdout:1/545: mkdir d0/d6/d43/d6a/d52/db2/db6 0 2024-09-17T01:06:59.701 INFO:tasks.workunit.client.1.smithi143.stdout:1/546: dread d0/d6/d43/d6a/df/d6e/f1d [0,4194304] 0 2024-09-17T01:06:59.741 INFO:tasks.workunit.client.1.smithi143.stdout:2/460: sync 2024-09-17T01:06:59.742 INFO:tasks.workunit.client.1.smithi143.stdout:2/461: dread - d0/d10/d58/d5a/d5b/d4c/d59/f8b zero size 2024-09-17T01:06:59.743 INFO:tasks.workunit.client.1.smithi143.stdout:1/547: read d0/d6/f1f [1887197,13831] 0 2024-09-17T01:06:59.745 INFO:tasks.workunit.client.1.smithi143.stdout:2/462: unlink d0/c1e 0 2024-09-17T01:06:59.747 INFO:tasks.workunit.client.1.smithi143.stdout:2/463: truncate d0/d10/f2e 34218 0 2024-09-17T01:06:59.748 INFO:tasks.workunit.client.1.smithi143.stdout:2/464: fsync d0/d2/d21/d22/d24/f8c 0 2024-09-17T01:06:59.748 INFO:tasks.workunit.client.1.smithi143.stdout:2/465: truncate d0/f6e 2253168 0 2024-09-17T01:06:59.750 INFO:tasks.workunit.client.1.smithi143.stdout:2/466: rmdir d0/d2 39 2024-09-17T01:06:59.752 INFO:tasks.workunit.client.1.smithi143.stdout:2/467: creat d0/d44/f94 x:0 0 0 2024-09-17T01:06:59.754 INFO:tasks.workunit.client.1.smithi143.stdout:2/468: write d0/d44/d6a/f74 [700400,93602] 0 2024-09-17T01:06:59.754 INFO:tasks.workunit.client.1.smithi143.stdout:1/548: dwrite d0/d6/f29 [0,4194304] 0 2024-09-17T01:06:59.755 INFO:tasks.workunit.client.1.smithi143.stdout:1/549: fsync d0/d6/d64/f80 0 2024-09-17T01:06:59.759 INFO:tasks.workunit.client.1.smithi143.stdout:2/469: getdents d0/d10/d58/d5a/d5b 0 2024-09-17T01:06:59.765 INFO:tasks.workunit.client.1.smithi143.stdout:1/550: dwrite d0/d6/d43/d6a/df/d6e/d2/d39/f5e [0,4194304] 0 2024-09-17T01:06:59.766 INFO:tasks.workunit.client.1.smithi143.stdout:2/470: dwrite d0/d10/d58/d5a/d5b/d4c/f6c [0,4194304] 0 2024-09-17T01:06:59.768 INFO:tasks.workunit.client.1.smithi143.stdout:1/551: mknod d0/d6/d43/d6d/cb7 0 2024-09-17T01:06:59.770 INFO:tasks.workunit.client.1.smithi143.stdout:2/471: read d0/d10/f47 [2256499,90478] 0 2024-09-17T01:06:59.770 INFO:tasks.workunit.client.1.smithi143.stdout:2/472: stat d0/d10 0 2024-09-17T01:06:59.771 INFO:tasks.workunit.client.1.smithi143.stdout:1/552: mknod d0/d6/d43/d47/d88/cb8 0 2024-09-17T01:06:59.772 INFO:tasks.workunit.client.1.smithi143.stdout:2/473: write d0/d10/f47 [590343,94507] 0 2024-09-17T01:06:59.778 INFO:tasks.workunit.client.1.smithi143.stdout:1/553: dwrite d0/d6/d43/d6a/df/d6e/d2/d39/f5e [0,4194304] 0 2024-09-17T01:06:59.780 INFO:tasks.workunit.client.1.smithi143.stdout:2/474: dwrite d0/d44/f46 [8388608,4194304] 0 2024-09-17T01:06:59.781 INFO:tasks.workunit.client.1.smithi143.stdout:1/554: rmdir d0/d6/d43/d47/d88 39 2024-09-17T01:06:59.782 INFO:tasks.workunit.client.1.smithi143.stdout:2/475: chown d0/d44 114 1 2024-09-17T01:06:59.782 INFO:tasks.workunit.client.1.smithi143.stdout:2/476: write d0/f4a [5861240,68713] 0 2024-09-17T01:06:59.783 INFO:tasks.workunit.client.1.smithi143.stdout:1/555: getdents d0/d6/d43/d6a/d52/db2/db6 0 2024-09-17T01:06:59.784 INFO:tasks.workunit.client.1.smithi143.stdout:1/556: write d0/dc/f82 [1229874,4440] 0 2024-09-17T01:06:59.784 INFO:tasks.workunit.client.1.smithi143.stdout:2/477: creat d0/d44/f95 x:0 0 0 2024-09-17T01:06:59.787 INFO:tasks.workunit.client.1.smithi143.stdout:2/478: creat d0/d2/d21/f96 x:0 0 0 2024-09-17T01:06:59.790 INFO:tasks.workunit.client.1.smithi143.stdout:1/557: dwrite d0/d6/d43/d47/d68/f92 [0,4194304] 0 2024-09-17T01:06:59.806 INFO:tasks.workunit.client.1.smithi143.stdout:2/479: dread d0/fc [0,4194304] 0 2024-09-17T01:06:59.809 INFO:tasks.workunit.client.1.smithi143.stdout:2/480: rename d0/d10/d58/d5a/d5b/d4c/d92 to d0/d44/d7a/d86/d97 0 2024-09-17T01:06:59.815 INFO:tasks.workunit.client.1.smithi143.stdout:2/481: dwrite d0/d44/f61 [0,4194304] 0 2024-09-17T01:06:59.819 INFO:tasks.workunit.client.1.smithi143.stdout:2/482: link d0/d2/d21/d22/l48 d0/d44/d7a/d86/d97/l98 0 2024-09-17T01:06:59.821 INFO:tasks.workunit.client.1.smithi143.stdout:2/483: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d99 0 2024-09-17T01:06:59.823 INFO:tasks.workunit.client.1.smithi143.stdout:2/484: creat d0/d10/d58/d5a/d5b/d4c/d59/f9a x:0 0 0 2024-09-17T01:06:59.830 INFO:tasks.workunit.client.1.smithi143.stdout:2/485: dread d0/ff [4194304,4194304] 0 2024-09-17T01:06:59.831 INFO:tasks.workunit.client.1.smithi143.stdout:2/486: truncate d0/d10/d58/d5a/d5b/d4c/f64 283502 0 2024-09-17T01:06:59.832 INFO:tasks.workunit.client.1.smithi143.stdout:2/487: chown d0/d2/d21/d22/d24/f73 162 1 2024-09-17T01:06:59.834 INFO:tasks.workunit.client.1.smithi143.stdout:2/488: creat d0/d10/d58/d5a/d5b/d4c/d77/f9b x:0 0 0 2024-09-17T01:06:59.835 INFO:tasks.workunit.client.1.smithi143.stdout:2/489: write d0/d44/d7a/f89 [2121457,64170] 0 2024-09-17T01:06:59.949 INFO:tasks.workunit.client.1.smithi143.stdout:9/463: sync 2024-09-17T01:06:59.949 INFO:tasks.workunit.client.1.smithi143.stdout:3/418: sync 2024-09-17T01:06:59.949 INFO:tasks.workunit.client.1.smithi143.stdout:9/464: fdatasync d3/d16/f86 0 2024-09-17T01:06:59.949 INFO:tasks.workunit.client.1.smithi143.stdout:3/419: truncate d6/f73 1241617 0 2024-09-17T01:06:59.950 INFO:tasks.workunit.client.1.smithi143.stdout:3/420: stat d6/d1c/d4b/d57/c78 0 2024-09-17T01:06:59.951 INFO:tasks.workunit.client.1.smithi143.stdout:9/465: fdatasync d3/d39/d6a/d9/f41 0 2024-09-17T01:06:59.953 INFO:tasks.workunit.client.1.smithi143.stdout:9/466: unlink d3/d39/d6a/l8c 0 2024-09-17T01:06:59.955 INFO:tasks.workunit.client.1.smithi143.stdout:9/467: creat d3/d39/d6a/d9/f98 x:0 0 0 2024-09-17T01:06:59.958 INFO:tasks.workunit.client.1.smithi143.stdout:9/468: rename d3/d16/d34 to d3/d39/d42/d58/d5a/d5e/d99 0 2024-09-17T01:06:59.959 INFO:tasks.workunit.client.1.smithi143.stdout:3/421: dwrite d6/d1c/d33/d41/d42/f63 [0,4194304] 0 2024-09-17T01:06:59.962 INFO:tasks.workunit.client.1.smithi143.stdout:9/469: unlink d3/d39/d6a/d9/c29 0 2024-09-17T01:06:59.965 INFO:tasks.workunit.client.1.smithi143.stdout:3/422: dread d6/d1c/d4d/f6d [0,4194304] 0 2024-09-17T01:06:59.967 INFO:tasks.workunit.client.1.smithi143.stdout:3/423: read d6/d1c/d33/d41/d42/f4c [657264,25863] 0 2024-09-17T01:06:59.968 INFO:tasks.workunit.client.1.smithi143.stdout:9/470: creat d3/d16/d3e/d51/d52/f9a x:0 0 0 2024-09-17T01:06:59.970 INFO:tasks.workunit.client.1.smithi143.stdout:9/471: mknod d3/d39/d6a/d9/c9b 0 2024-09-17T01:06:59.970 INFO:tasks.workunit.client.1.smithi143.stdout:3/424: fsync d6/fa 0 2024-09-17T01:06:59.971 INFO:tasks.workunit.client.1.smithi143.stdout:9/472: rmdir d3/d39/d42 39 2024-09-17T01:06:59.972 INFO:tasks.workunit.client.1.smithi143.stdout:3/425: write d6/d1c/d33/d41/f11 [3929474,34988] 0 2024-09-17T01:06:59.972 INFO:tasks.workunit.client.1.smithi143.stdout:9/473: mkdir d3/d81/d9c 0 2024-09-17T01:06:59.974 INFO:tasks.workunit.client.1.smithi143.stdout:3/426: chown d6/d1c/d33/d3f/d79/d7b 63633 1 2024-09-17T01:06:59.974 INFO:tasks.workunit.client.1.smithi143.stdout:9/474: write d3/d39/d6a/d9/f66 [136169,4060] 0 2024-09-17T01:06:59.977 INFO:tasks.workunit.client.1.smithi143.stdout:5/442: sync 2024-09-17T01:06:59.977 INFO:tasks.workunit.client.1.smithi143.stdout:8/487: sync 2024-09-17T01:06:59.977 INFO:tasks.workunit.client.1.smithi143.stdout:3/427: creat d6/d1c/d4b/d57/f81 x:0 0 0 2024-09-17T01:06:59.979 INFO:tasks.workunit.client.1.smithi143.stdout:3/428: dread - d6/d1c/d33/d41/d2b/f77 zero size 2024-09-17T01:06:59.981 INFO:tasks.workunit.client.1.smithi143.stdout:5/443: creat d1/d46/df/d53/d74/faf x:0 0 0 2024-09-17T01:06:59.982 INFO:tasks.workunit.client.1.smithi143.stdout:9/475: rename d3/d39/d6a/d26/f75 to d3/d39/d42/d58/d5a/d5e/d99/f9d 0 2024-09-17T01:06:59.983 INFO:tasks.workunit.client.1.smithi143.stdout:3/429: mkdir d6/d1c/d82 0 2024-09-17T01:06:59.987 INFO:tasks.workunit.client.1.smithi143.stdout:3/430: dread d6/f73 [0,4194304] 0 2024-09-17T01:06:59.987 INFO:tasks.workunit.client.1.smithi143.stdout:9/476: dread d3/d16/d3e/d51/f63 [0,4194304] 0 2024-09-17T01:06:59.988 INFO:tasks.workunit.client.1.smithi143.stdout:5/444: creat d1/d46/df/d23/fb0 x:0 0 0 2024-09-17T01:06:59.990 INFO:tasks.workunit.client.1.smithi143.stdout:8/488: dwrite d9/d12/d4b/f37 [0,4194304] 0 2024-09-17T01:06:59.991 INFO:tasks.workunit.client.1.smithi143.stdout:9/477: dread - d3/d39/d6a/d9/d74/f97 zero size 2024-09-17T01:06:59.994 INFO:tasks.workunit.client.1.smithi143.stdout:8/489: truncate d9/d23/d48/fae 874604 0 2024-09-17T01:06:59.995 INFO:tasks.workunit.client.1.smithi143.stdout:8/490: write d9/d12/d38/f43 [1235784,112141] 0 2024-09-17T01:06:59.996 INFO:tasks.workunit.client.1.smithi143.stdout:3/431: dwrite d6/d1c/d33/f38 [4194304,4194304] 0 2024-09-17T01:07:00.000 INFO:tasks.workunit.client.1.smithi143.stdout:3/432: read d6/f7 [2389905,103209] 0 2024-09-17T01:07:00.003 INFO:tasks.workunit.client.1.smithi143.stdout:9/478: dwrite d3/d16/f45 [0,4194304] 0 2024-09-17T01:07:00.005 INFO:tasks.workunit.client.1.smithi143.stdout:9/479: readlink d3/d3d/l44 0 2024-09-17T01:07:00.006 INFO:tasks.workunit.client.1.smithi143.stdout:3/433: mknod d6/d1c/d33/d41/d42/c83 0 2024-09-17T01:07:00.011 INFO:tasks.workunit.client.1.smithi143.stdout:9/480: symlink d3/d39/d42/d58/d5a/d5e/l9e 0 2024-09-17T01:07:00.013 INFO:tasks.workunit.client.1.smithi143.stdout:3/434: fsync d6/d1c/d33/d41/d42/f71 0 2024-09-17T01:07:00.014 INFO:tasks.workunit.client.1.smithi143.stdout:3/435: chown d6/d1c/d33/d41/f21 15109 1 2024-09-17T01:07:00.014 INFO:tasks.workunit.client.1.smithi143.stdout:9/481: creat d3/d39/d42/d58/f9f x:0 0 0 2024-09-17T01:07:00.016 INFO:tasks.workunit.client.1.smithi143.stdout:9/482: read - d3/d39/d6a/d9/f98 zero size 2024-09-17T01:07:00.018 INFO:tasks.workunit.client.1.smithi143.stdout:9/483: rmdir d3/d39/d42/d58/d5a 39 2024-09-17T01:07:00.022 INFO:tasks.workunit.client.1.smithi143.stdout:3/436: dwrite d6/d1c/d33/d41/f21 [0,4194304] 0 2024-09-17T01:07:00.027 INFO:tasks.workunit.client.1.smithi143.stdout:3/437: creat d6/d1c/d33/d41/f84 x:0 0 0 2024-09-17T01:07:00.029 INFO:tasks.workunit.client.1.smithi143.stdout:3/438: mknod d6/d1c/d33/d41/d60/c85 0 2024-09-17T01:07:00.031 INFO:tasks.workunit.client.1.smithi143.stdout:3/439: write d6/d1c/d33/d41/f1a [8537630,130264] 0 2024-09-17T01:07:00.036 INFO:tasks.workunit.client.1.smithi143.stdout:8/491: dread d9/d12/d4b/f41 [0,4194304] 0 2024-09-17T01:07:00.039 INFO:tasks.workunit.client.1.smithi143.stdout:3/440: dwrite d6/d1c/d4b/d57/f81 [0,4194304] 0 2024-09-17T01:07:00.041 INFO:tasks.workunit.client.1.smithi143.stdout:8/492: rename d9/d23/d48 to d9/d23/db4 0 2024-09-17T01:07:00.069 INFO:tasks.workunit.client.1.smithi143.stdout:0/508: sync 2024-09-17T01:07:00.069 INFO:tasks.workunit.client.1.smithi143.stdout:6/472: sync 2024-09-17T01:07:00.071 INFO:tasks.workunit.client.1.smithi143.stdout:6/473: write d2/d17/d6e/d26/f32 [748551,97712] 0 2024-09-17T01:07:00.075 INFO:tasks.workunit.client.1.smithi143.stdout:0/509: dwrite d3/d5/f84 [0,4194304] 0 2024-09-17T01:07:00.082 INFO:tasks.workunit.client.1.smithi143.stdout:8/493: creat d9/de/fb5 x:0 0 0 2024-09-17T01:07:00.084 INFO:tasks.workunit.client.1.smithi143.stdout:3/441: truncate d6/d1c/d33/d41/f11 2782486 0 2024-09-17T01:07:00.086 INFO:tasks.workunit.client.1.smithi143.stdout:3/442: dread - d6/d1c/d33/d41/d2b/f77 zero size 2024-09-17T01:07:00.086 INFO:tasks.workunit.client.1.smithi143.stdout:8/494: unlink d9/la3 0 2024-09-17T01:07:00.087 INFO:tasks.workunit.client.1.smithi143.stdout:6/474: symlink d2/d17/d3a/d47/d8e/l93 0 2024-09-17T01:07:00.087 INFO:tasks.workunit.client.1.smithi143.stdout:3/443: chown d6/d1c/d4d/f6d 1059848 1 2024-09-17T01:07:00.088 INFO:tasks.workunit.client.1.smithi143.stdout:8/495: creat d9/d26/fb6 x:0 0 0 2024-09-17T01:07:00.089 INFO:tasks.workunit.client.1.smithi143.stdout:9/484: dread d3/f15 [0,4194304] 0 2024-09-17T01:07:00.089 INFO:tasks.workunit.client.1.smithi143.stdout:6/475: creat d2/d17/d3a/d47/d8e/f94 x:0 0 0 2024-09-17T01:07:00.091 INFO:tasks.workunit.client.1.smithi143.stdout:6/476: write d2/df/d20/f54 [3247832,90685] 0 2024-09-17T01:07:00.092 INFO:tasks.workunit.client.1.smithi143.stdout:9/485: mkdir d3/d39/d42/d58/d5a/da0 0 2024-09-17T01:07:00.094 INFO:tasks.workunit.client.1.smithi143.stdout:3/444: write d6/fa [1550022,120839] 0 2024-09-17T01:07:00.096 INFO:tasks.workunit.client.1.smithi143.stdout:6/477: mkdir d2/d17/d3a/d47/d8e/d95 0 2024-09-17T01:07:00.097 INFO:tasks.workunit.client.1.smithi143.stdout:6/478: stat d2/d30/d45/d4a 0 2024-09-17T01:07:00.098 INFO:tasks.workunit.client.1.smithi143.stdout:6/479: truncate d2/d19/f8a 685221 0 2024-09-17T01:07:00.098 INFO:tasks.workunit.client.1.smithi143.stdout:3/445: getdents d6/d1c/d33/d3f/d79/d7b 0 2024-09-17T01:07:00.098 INFO:tasks.workunit.client.1.smithi143.stdout:6/480: fdatasync d2/d17/f77 0 2024-09-17T01:07:00.106 INFO:tasks.workunit.client.1.smithi143.stdout:6/481: dwrite d2/f6d [0,4194304] 0 2024-09-17T01:07:00.106 INFO:tasks.workunit.client.1.smithi143.stdout:3/446: dread d6/d1c/d33/d41/d42/f4c [0,4194304] 0 2024-09-17T01:07:00.109 INFO:tasks.workunit.client.1.smithi143.stdout:3/447: write d6/d1c/d33/d41/d2b/f77 [499710,53105] 0 2024-09-17T01:07:00.153 INFO:tasks.workunit.client.1.smithi143.stdout:7/642: sync 2024-09-17T01:07:00.153 INFO:tasks.workunit.client.1.smithi143.stdout:1/558: sync 2024-09-17T01:07:00.153 INFO:tasks.workunit.client.1.smithi143.stdout:5/445: sync 2024-09-17T01:07:00.153 INFO:tasks.workunit.client.1.smithi143.stdout:4/440: sync 2024-09-17T01:07:00.154 INFO:tasks.workunit.client.1.smithi143.stdout:2/490: sync 2024-09-17T01:07:00.154 INFO:tasks.workunit.client.1.smithi143.stdout:3/448: mkdir d6/d1c/d33/d41/d2e/d86 0 2024-09-17T01:07:00.157 INFO:tasks.workunit.client.1.smithi143.stdout:6/482: truncate d2/df/d20/f54 2777419 0 2024-09-17T01:07:00.158 INFO:tasks.workunit.client.1.smithi143.stdout:3/449: fsync d6/d1c/f66 0 2024-09-17T01:07:00.160 INFO:tasks.workunit.client.1.smithi143.stdout:2/491: truncate d0/f80 8511 0 2024-09-17T01:07:00.160 INFO:tasks.workunit.client.1.smithi143.stdout:9/486: dread d3/d39/d6a/d9/f6b [0,4194304] 0 2024-09-17T01:07:00.160 INFO:tasks.workunit.client.1.smithi143.stdout:1/559: chown d0/d6/d43/l93 0 1 2024-09-17T01:07:00.160 INFO:tasks.workunit.client.1.smithi143.stdout:7/643: dread - d4/d1f/d4a/d66/d86/fb8 zero size 2024-09-17T01:07:00.161 INFO:tasks.workunit.client.1.smithi143.stdout:4/441: unlink da/d3a/d3e/d5e/f57 0 2024-09-17T01:07:00.162 INFO:tasks.workunit.client.1.smithi143.stdout:6/483: symlink d2/d30/d45/d70/d87/d74/l96 0 2024-09-17T01:07:00.162 INFO:tasks.workunit.client.1.smithi143.stdout:4/442: fsync da/d3a/d40/f36 0 2024-09-17T01:07:00.163 INFO:tasks.workunit.client.1.smithi143.stdout:2/492: read d0/d10/f39 [231396,29277] 0 2024-09-17T01:07:00.163 INFO:tasks.workunit.client.1.smithi143.stdout:3/450: creat d6/d1c/d33/d41/d2e/f87 x:0 0 0 2024-09-17T01:07:00.163 INFO:tasks.workunit.client.1.smithi143.stdout:1/560: chown d0/d6/d43/d6a/df/d6e/d2/f2a 255971102 1 2024-09-17T01:07:00.166 INFO:tasks.workunit.client.1.smithi143.stdout:4/443: write da/d3a/f3b [1190898,72357] 0 2024-09-17T01:07:00.168 INFO:tasks.workunit.client.1.smithi143.stdout:2/493: write d0/ff [4876609,1202] 0 2024-09-17T01:07:00.169 INFO:tasks.workunit.client.1.smithi143.stdout:6/484: read d2/d30/d45/d4a/d5e/d7c/f8f [1349565,18252] 0 2024-09-17T01:07:00.171 INFO:tasks.workunit.client.1.smithi143.stdout:1/561: fsync d0/d6/d43/d6a/df/f1a 0 2024-09-17T01:07:00.171 INFO:tasks.workunit.client.1.smithi143.stdout:4/444: readlink da/l16 0 2024-09-17T01:07:00.173 INFO:tasks.workunit.client.1.smithi143.stdout:6/485: creat d2/d17/f97 x:0 0 0 2024-09-17T01:07:00.174 INFO:tasks.workunit.client.1.smithi143.stdout:9/487: dwrite d3/d39/d6a/f30 [0,4194304] 0 2024-09-17T01:07:00.175 INFO:tasks.workunit.client.1.smithi143.stdout:5/446: truncate d1/d46/df/d23/f90 94266 0 2024-09-17T01:07:00.176 INFO:tasks.workunit.client.1.smithi143.stdout:3/451: rename d6/d1c/d33/d41/l5f to d6/d1c/d33/d3f/d79/l88 0 2024-09-17T01:07:00.177 INFO:tasks.workunit.client.1.smithi143.stdout:7/644: dwrite d4/d1f/d4a/f57 [0,4194304] 0 2024-09-17T01:07:00.177 INFO:tasks.workunit.client.1.smithi143.stdout:9/488: write d3/d39/f72 [4087017,78098] 0 2024-09-17T01:07:00.178 INFO:tasks.workunit.client.1.smithi143.stdout:9/489: chown d3/d39 30175 1 2024-09-17T01:07:00.181 INFO:tasks.workunit.client.1.smithi143.stdout:6/486: fsync d2/df/d20/f53 0 2024-09-17T01:07:00.181 INFO:tasks.workunit.client.1.smithi143.stdout:1/562: mkdir d0/d6/d43/d47/d88/da5/db9 0 2024-09-17T01:07:00.184 INFO:tasks.workunit.client.1.smithi143.stdout:4/445: mkdir da/d3a/d3e/d4a/d8a 0 2024-09-17T01:07:00.187 INFO:tasks.workunit.client.1.smithi143.stdout:1/563: write d0/d6/d43/d6a/f48 [854886,98888] 0 2024-09-17T01:07:00.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/452: dwrite d6/d1c/d33/d41/f28 [4194304,4194304] 0 2024-09-17T01:07:00.193 INFO:tasks.workunit.client.1.smithi143.stdout:4/446: creat da/d75/f8b x:0 0 0 2024-09-17T01:07:00.193 INFO:tasks.workunit.client.1.smithi143.stdout:1/564: chown d0/d6/d43/d47/d72/c76 0 1 2024-09-17T01:07:00.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/453: fdatasync d6/d1c/f2a 0 2024-09-17T01:07:00.194 INFO:tasks.workunit.client.1.smithi143.stdout:6/487: rmdir d2 39 2024-09-17T01:07:00.195 INFO:tasks.workunit.client.1.smithi143.stdout:3/454: chown d6/d1c/d4b/l7a 13 1 2024-09-17T01:07:00.196 INFO:tasks.workunit.client.1.smithi143.stdout:4/447: mkdir da/d3a/d3e/d4a/d8c 0 2024-09-17T01:07:00.198 INFO:tasks.workunit.client.1.smithi143.stdout:7/645: rename d4/d33/d4e/l7f to d4/d1f/d4a/lcb 0 2024-09-17T01:07:00.198 INFO:tasks.workunit.client.1.smithi143.stdout:5/447: link d1/f3 d1/d46/df/d53/d74/d9a/fb1 0 2024-09-17T01:07:00.198 INFO:tasks.workunit.client.1.smithi143.stdout:1/565: write d0/d6/d43/d6a/df/d6e/d18/d2d/d78/f90 [664518,101412] 0 2024-09-17T01:07:00.199 INFO:tasks.workunit.client.1.smithi143.stdout:6/488: creat d2/d19/f98 x:0 0 0 2024-09-17T01:07:00.200 INFO:tasks.workunit.client.1.smithi143.stdout:3/455: mkdir d6/d1c/d33/d41/d2e/d86/d89 0 2024-09-17T01:07:00.200 INFO:tasks.workunit.client.1.smithi143.stdout:7/646: chown d4/f41 44622222 1 2024-09-17T01:07:00.202 INFO:tasks.workunit.client.1.smithi143.stdout:1/566: rmdir d0/d6/d43/d6d 39 2024-09-17T01:07:00.203 INFO:tasks.workunit.client.1.smithi143.stdout:5/448: rename d1/f2b to d1/d5e/fb2 0 2024-09-17T01:07:00.205 INFO:tasks.workunit.client.1.smithi143.stdout:6/489: rename d2/df/d40/d41/f8c to d2/df/d40/d41/d6c/f99 0 2024-09-17T01:07:00.207 INFO:tasks.workunit.client.1.smithi143.stdout:5/449: unlink d1/d46/df/d1f/f34 0 2024-09-17T01:07:00.207 INFO:tasks.workunit.client.1.smithi143.stdout:5/450: dread - d1/d46/df/d23/fb0 zero size 2024-09-17T01:07:00.210 INFO:tasks.workunit.client.1.smithi143.stdout:1/567: link d0/dc/f2c d0/dc/d57/fba 0 2024-09-17T01:07:00.210 INFO:tasks.workunit.client.1.smithi143.stdout:9/490: write d3/d39/d6a/d9/f2e [931299,70167] 0 2024-09-17T01:07:00.212 INFO:tasks.workunit.client.1.smithi143.stdout:1/568: dread - d0/d6/d43/d6a/df/d6e/d2/f28 zero size 2024-09-17T01:07:00.213 INFO:tasks.workunit.client.1.smithi143.stdout:3/456: truncate d6/d1c/d33/d41/f21 151733 0 2024-09-17T01:07:00.215 INFO:tasks.workunit.client.1.smithi143.stdout:9/491: fsync d3/d39/d6a/d9/f5c 0 2024-09-17T01:07:00.216 INFO:tasks.workunit.client.1.smithi143.stdout:1/569: truncate d0/d6/d43/d6a/df/d6e/d18/d2d/d78/f90 954101 0 2024-09-17T01:07:00.216 INFO:tasks.workunit.client.1.smithi143.stdout:5/451: rename d1/d46/df/d23/d4f/c1e to d1/d46/cb3 0 2024-09-17T01:07:00.216 INFO:tasks.workunit.client.1.smithi143.stdout:9/492: chown d3/d39/d6a/d9/l94 12 1 2024-09-17T01:07:00.217 INFO:tasks.workunit.client.1.smithi143.stdout:9/493: readlink d3/d39/d42/d58/l6e 0 2024-09-17T01:07:00.218 INFO:tasks.workunit.client.1.smithi143.stdout:4/448: truncate da/d68/f5d 1490628 0 2024-09-17T01:07:00.218 INFO:tasks.workunit.client.1.smithi143.stdout:9/494: chown d3/d16/d3e/d51/f63 13 1 2024-09-17T01:07:00.219 INFO:tasks.workunit.client.1.smithi143.stdout:3/457: truncate d6/d1c/f66 38850 0 2024-09-17T01:07:00.221 INFO:tasks.workunit.client.1.smithi143.stdout:3/458: truncate d6/d1c/d33/d41/d2e/f87 683333 0 2024-09-17T01:07:00.223 INFO:tasks.workunit.client.1.smithi143.stdout:4/449: mknod da/d3a/d3e/d4a/c8d 0 2024-09-17T01:07:00.224 INFO:tasks.workunit.client.1.smithi143.stdout:5/452: creat d1/d96/fb4 x:0 0 0 2024-09-17T01:07:00.226 INFO:tasks.workunit.client.1.smithi143.stdout:1/570: rename d0/d6/d43/d6a/df/d6e/d2/c86 to d0/d6/d43/d6a/df/d6e/d2/d39/d79/d96/cbb 0 2024-09-17T01:07:00.227 INFO:tasks.workunit.client.1.smithi143.stdout:6/490: truncate d2/d30/d45/d70/f78 2463974 0 2024-09-17T01:07:00.228 INFO:tasks.workunit.client.1.smithi143.stdout:6/491: fsync d2/d17/f77 0 2024-09-17T01:07:00.229 INFO:tasks.workunit.client.1.smithi143.stdout:9/495: rename d3/d16/d3e/d51/f71 to d3/d16/d3e/d51/d52/fa1 0 2024-09-17T01:07:00.231 INFO:tasks.workunit.client.1.smithi143.stdout:5/453: mknod d1/d46/df/cb5 0 2024-09-17T01:07:00.235 INFO:tasks.workunit.client.1.smithi143.stdout:1/571: creat d0/d6/d43/d6d/fbc x:0 0 0 2024-09-17T01:07:00.237 INFO:tasks.workunit.client.1.smithi143.stdout:6/492: symlink d2/d17/d6e/d26/d46/d65/l9a 0 2024-09-17T01:07:00.239 INFO:tasks.workunit.client.1.smithi143.stdout:6/493: chown d2/df/d20/d2c/f22 6120721 1 2024-09-17T01:07:00.242 INFO:tasks.workunit.client.1.smithi143.stdout:3/459: rename d6/d1c/d33/d41/f84 to d6/f8a 0 2024-09-17T01:07:00.242 INFO:tasks.workunit.client.1.smithi143.stdout:5/454: dwrite d1/d46/df/d53/f81 [0,4194304] 0 2024-09-17T01:07:00.243 INFO:tasks.workunit.client.1.smithi143.stdout:9/496: creat d3/d39/fa2 x:0 0 0 2024-09-17T01:07:00.243 INFO:tasks.workunit.client.1.smithi143.stdout:6/494: dread d2/df/d20/d2c/d38/f39 [0,4194304] 0 2024-09-17T01:07:00.246 INFO:tasks.workunit.client.1.smithi143.stdout:6/495: rmdir d2/d17/d3a 39 2024-09-17T01:07:00.247 INFO:tasks.workunit.client.1.smithi143.stdout:6/496: chown d2/d17/d6e/d26/d79 60811 1 2024-09-17T01:07:00.247 INFO:tasks.workunit.client.1.smithi143.stdout:5/455: truncate d1/d46/df/d1f/f30 941052 0 2024-09-17T01:07:00.252 INFO:tasks.workunit.client.1.smithi143.stdout:9/497: mknod d3/d16/ca3 0 2024-09-17T01:07:00.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/456: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:07:00.256 INFO:tasks.workunit.client.1.smithi143.stdout:4/450: rename da/d68/c7f to da/d3a/c8e 0 2024-09-17T01:07:00.259 INFO:tasks.workunit.client.1.smithi143.stdout:9/498: creat d3/d39/d42/d80/fa4 x:0 0 0 2024-09-17T01:07:00.259 INFO:tasks.workunit.client.1.smithi143.stdout:4/451: symlink da/d68/l8f 0 2024-09-17T01:07:00.261 INFO:tasks.workunit.client.1.smithi143.stdout:1/572: rename d0/d6/d43/d6a/df/d6e/d2/la3 to d0/d6/d43/d47/d88/lbd 0 2024-09-17T01:07:00.266 INFO:tasks.workunit.client.1.smithi143.stdout:9/499: creat d3/d39/d42/d58/fa5 x:0 0 0 2024-09-17T01:07:00.266 INFO:tasks.workunit.client.1.smithi143.stdout:3/460: dwrite d6/d1c/d33/d41/f11 [0,4194304] 0 2024-09-17T01:07:00.267 INFO:tasks.workunit.client.1.smithi143.stdout:1/573: mkdir d0/d6/d43/d6a/d8f/dbe 0 2024-09-17T01:07:00.272 INFO:tasks.workunit.client.1.smithi143.stdout:6/497: dwrite d2/d17/d3a/f51 [0,4194304] 0 2024-09-17T01:07:00.272 INFO:tasks.workunit.client.1.smithi143.stdout:1/574: chown d0/dc/d57/d58/c7e 21453259 1 2024-09-17T01:07:00.276 INFO:tasks.workunit.client.1.smithi143.stdout:5/457: dwrite d1/d46/df/d23/f26 [4194304,4194304] 0 2024-09-17T01:07:00.276 INFO:tasks.workunit.client.1.smithi143.stdout:6/498: stat d2/fb 0 2024-09-17T01:07:00.278 INFO:tasks.workunit.client.1.smithi143.stdout:4/452: dwrite da/f32 [0,4194304] 0 2024-09-17T01:07:00.280 INFO:tasks.workunit.client.1.smithi143.stdout:1/575: chown d0/d6/d43/d6a/df/d6e/d2/d39/d6b 25779 1 2024-09-17T01:07:00.281 INFO:tasks.workunit.client.1.smithi143.stdout:0/510: sync 2024-09-17T01:07:00.282 INFO:tasks.workunit.client.1.smithi143.stdout:4/453: mkdir da/d6d/d90 0 2024-09-17T01:07:00.284 INFO:tasks.workunit.client.1.smithi143.stdout:5/458: truncate d1/d46/df/d53/d74/faf 226793 0 2024-09-17T01:07:00.284 INFO:tasks.workunit.client.1.smithi143.stdout:6/499: creat d2/d30/d84/f9b x:0 0 0 2024-09-17T01:07:00.285 INFO:tasks.workunit.client.1.smithi143.stdout:1/576: write d0/d6/d43/d6a/d52/f6f [570798,57216] 0 2024-09-17T01:07:00.289 INFO:tasks.workunit.client.1.smithi143.stdout:0/511: mknod d3/d5/d8/d27/d31/d48/d72/caa 0 2024-09-17T01:07:00.290 INFO:tasks.workunit.client.1.smithi143.stdout:5/459: write d1/d46/df/d53/d74/fa7 [589352,7898] 0 2024-09-17T01:07:00.374 INFO:tasks.workunit.client.1.smithi143.stdout:8/496: sync 2024-09-17T01:07:00.374 INFO:tasks.workunit.client.1.smithi143.stdout:8/497: stat d9/f59 0 2024-09-17T01:07:00.412 INFO:tasks.workunit.client.1.smithi143.stdout:1/577: mkdir d0/d6/d43/d47/dbf 0 2024-09-17T01:07:00.413 INFO:tasks.workunit.client.1.smithi143.stdout:5/460: mknod d1/d46/df/d23/d4f/d7d/cb6 0 2024-09-17T01:07:00.420 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:00 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:00.421 INFO:tasks.workunit.client.1.smithi143.stdout:2/494: sync 2024-09-17T01:07:00.421 INFO:tasks.workunit.client.1.smithi143.stdout:7/647: sync 2024-09-17T01:07:00.422 INFO:tasks.workunit.client.1.smithi143.stdout:7/648: chown d4/d26/fae 427 1 2024-09-17T01:07:00.422 INFO:tasks.workunit.client.1.smithi143.stdout:7/649: dread - d4/f62 zero size 2024-09-17T01:07:00.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:00 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:00.436 INFO:tasks.workunit.client.1.smithi143.stdout:4/454: rmdir da/d3a/d40/d89 0 2024-09-17T01:07:00.442 INFO:tasks.workunit.client.1.smithi143.stdout:3/461: truncate d6/d1c/d33/d41/d42/f4f 2523651 0 2024-09-17T01:07:00.443 INFO:tasks.workunit.client.1.smithi143.stdout:9/500: dwrite d3/d39/d6a/d9/f11 [0,4194304] 0 2024-09-17T01:07:00.443 INFO:tasks.workunit.client.1.smithi143.stdout:8/498: link d9/d2b/f78 d9/d23/d32/fb7 0 2024-09-17T01:07:00.444 INFO:tasks.workunit.client.1.smithi143.stdout:5/461: mkdir d1/d46/d6e/db7 0 2024-09-17T01:07:00.444 INFO:tasks.workunit.client.1.smithi143.stdout:3/462: write d6/d1c/d33/d41/d2e/f61 [5235655,50169] 0 2024-09-17T01:07:00.445 INFO:tasks.workunit.client.1.smithi143.stdout:7/650: fdatasync d4/fd 0 2024-09-17T01:07:00.446 INFO:tasks.workunit.client.1.smithi143.stdout:7/651: fdatasync d4/f82 0 2024-09-17T01:07:00.448 INFO:tasks.workunit.client.1.smithi143.stdout:1/578: creat d0/d6/d99/fc0 x:0 0 0 2024-09-17T01:07:00.448 INFO:tasks.workunit.client.1.smithi143.stdout:7/652: truncate d4/f95 370077 0 2024-09-17T01:07:00.448 INFO:tasks.workunit.client.1.smithi143.stdout:6/500: truncate d2/d17/d3a/f51 1474877 0 2024-09-17T01:07:00.449 INFO:tasks.workunit.client.1.smithi143.stdout:0/512: truncate d3/d14/d3d/f5d 431394 0 2024-09-17T01:07:00.450 INFO:tasks.workunit.client.1.smithi143.stdout:9/501: creat d3/d81/fa6 x:0 0 0 2024-09-17T01:07:00.450 INFO:tasks.workunit.client.1.smithi143.stdout:6/501: chown d2/df 2721026 1 2024-09-17T01:07:00.451 INFO:tasks.workunit.client.1.smithi143.stdout:7/653: fdatasync d4/d16/d97/fbf 0 2024-09-17T01:07:00.451 INFO:tasks.workunit.client.1.smithi143.stdout:3/463: stat d6/d1c/d33/d41/d42/l59 0 2024-09-17T01:07:00.452 INFO:tasks.workunit.client.1.smithi143.stdout:4/455: mkdir da/d3a/d3e/d5e/d63/d80/d91 0 2024-09-17T01:07:00.452 INFO:tasks.workunit.client.1.smithi143.stdout:5/462: dread d1/d46/df/d53/f61 [0,4194304] 0 2024-09-17T01:07:00.454 INFO:tasks.workunit.client.1.smithi143.stdout:4/456: readlink da/d3a/d40/l33 0 2024-09-17T01:07:00.454 INFO:tasks.workunit.client.1.smithi143.stdout:2/495: rename d0/d2/d21/d22/d24/f8c to d0/f9c 0 2024-09-17T01:07:00.455 INFO:tasks.workunit.client.1.smithi143.stdout:4/457: fsync da/f82 0 2024-09-17T01:07:00.455 INFO:tasks.workunit.client.1.smithi143.stdout:1/579: unlink d0/d6/f3a 0 2024-09-17T01:07:00.459 INFO:tasks.workunit.client.1.smithi143.stdout:9/502: creat d3/d3d/d48/fa7 x:0 0 0 2024-09-17T01:07:00.459 INFO:tasks.workunit.client.1.smithi143.stdout:2/496: write d0/d10/f30 [2729352,95798] 0 2024-09-17T01:07:00.460 INFO:tasks.workunit.client.1.smithi143.stdout:5/463: readlink d1/d46/l2f 0 2024-09-17T01:07:00.460 INFO:tasks.workunit.client.1.smithi143.stdout:1/580: readlink d0/dc/d57/d58/l87 0 2024-09-17T01:07:00.460 INFO:tasks.workunit.client.1.smithi143.stdout:8/499: creat d9/d23/fb8 x:0 0 0 2024-09-17T01:07:00.461 INFO:tasks.workunit.client.1.smithi143.stdout:4/458: symlink da/d6d/l92 0 2024-09-17T01:07:00.462 INFO:tasks.workunit.client.1.smithi143.stdout:3/464: link d6/f44 d6/d1c/d33/d5d/f8b 0 2024-09-17T01:07:00.464 INFO:tasks.workunit.client.1.smithi143.stdout:5/464: rmdir d1/d96 39 2024-09-17T01:07:00.464 INFO:tasks.workunit.client.1.smithi143.stdout:8/500: chown f7 5 1 2024-09-17T01:07:00.465 INFO:tasks.workunit.client.1.smithi143.stdout:2/497: unlink d0/d10/f2e 0 2024-09-17T01:07:00.465 INFO:tasks.workunit.client.1.smithi143.stdout:6/502: dwrite d2/d30/d45/f50 [0,4194304] 0 2024-09-17T01:07:00.470 INFO:tasks.workunit.client.1.smithi143.stdout:7/654: dwrite d4/d1f/d29/f64 [0,4194304] 0 2024-09-17T01:07:00.474 INFO:tasks.workunit.client.1.smithi143.stdout:0/513: dwrite d3/fa2 [0,4194304] 0 2024-09-17T01:07:00.475 INFO:tasks.workunit.client.1.smithi143.stdout:7/655: stat d4/d16/f1d 0 2024-09-17T01:07:00.476 INFO:tasks.workunit.client.1.smithi143.stdout:8/501: truncate d9/d26/f3e 2054073 0 2024-09-17T01:07:00.480 INFO:tasks.workunit.client.1.smithi143.stdout:3/465: rename d6/f44 to d6/d1c/d33/d41/d60/f8c 0 2024-09-17T01:07:00.481 INFO:tasks.workunit.client.1.smithi143.stdout:5/465: mkdir d1/d46/df/d1f/d66/db8 0 2024-09-17T01:07:00.483 INFO:tasks.workunit.client.1.smithi143.stdout:6/503: truncate d2/df/d18/f21 1648094 0 2024-09-17T01:07:00.487 INFO:tasks.workunit.client.1.smithi143.stdout:0/514: fsync d3/d5/d8/d21/d2e/f50 0 2024-09-17T01:07:00.487 INFO:tasks.workunit.client.1.smithi143.stdout:5/466: fdatasync d1/d46/df/f36 0 2024-09-17T01:07:00.489 INFO:tasks.workunit.client.1.smithi143.stdout:3/466: dread d6/d1c/d33/d41/d2e/d30/f74 [0,4194304] 0 2024-09-17T01:07:00.490 INFO:tasks.workunit.client.1.smithi143.stdout:6/504: write d2/d30/d45/d4a/f91 [923655,103152] 0 2024-09-17T01:07:00.492 INFO:tasks.workunit.client.1.smithi143.stdout:9/503: dwrite d3/d39/d42/d58/d5a/d5e/d99/f5b [0,4194304] 0 2024-09-17T01:07:00.492 INFO:tasks.workunit.client.1.smithi143.stdout:5/467: read d1/d46/df/d53/f61 [670056,32837] 0 2024-09-17T01:07:00.493 INFO:tasks.workunit.client.1.smithi143.stdout:7/656: dwrite d4/d1f/f30 [0,4194304] 0 2024-09-17T01:07:00.495 INFO:tasks.workunit.client.1.smithi143.stdout:8/502: dread d9/d12/d4b/f41 [0,4194304] 0 2024-09-17T01:07:00.497 INFO:tasks.workunit.client.1.smithi143.stdout:6/505: fsync d2/d17/d6e/d26/d46/d65/f7f 0 2024-09-17T01:07:00.500 INFO:tasks.workunit.client.1.smithi143.stdout:5/468: fsync d1/d46/df/d53/f85 0 2024-09-17T01:07:00.500 INFO:tasks.workunit.client.1.smithi143.stdout:9/504: chown d3/d16/f86 107040 1 2024-09-17T01:07:00.500 INFO:tasks.workunit.client.1.smithi143.stdout:7/657: chown d4/d33/d78/f91 0 1 2024-09-17T01:07:00.502 INFO:tasks.workunit.client.1.smithi143.stdout:3/467: rmdir d6/d1c/d33/d41 39 2024-09-17T01:07:00.503 INFO:tasks.workunit.client.1.smithi143.stdout:4/459: dread da/f11 [0,4194304] 0 2024-09-17T01:07:00.504 INFO:tasks.workunit.client.1.smithi143.stdout:5/469: fdatasync d1/d46/df/d23/d4f/f20 0 2024-09-17T01:07:00.507 INFO:tasks.workunit.client.1.smithi143.stdout:7/658: mkdir d4/d26/dcc 0 2024-09-17T01:07:00.508 INFO:tasks.workunit.client.1.smithi143.stdout:5/470: dread - d1/d46/d6e/f7c zero size 2024-09-17T01:07:00.512 INFO:tasks.workunit.client.1.smithi143.stdout:0/515: dwrite d3/d5/d35/f89 [0,4194304] 0 2024-09-17T01:07:00.513 INFO:tasks.workunit.client.1.smithi143.stdout:4/460: creat da/d3a/d3e/d4a/d8a/f93 x:0 0 0 2024-09-17T01:07:00.513 INFO:tasks.workunit.client.1.smithi143.stdout:7/659: symlink d4/d16/d97/lcd 0 2024-09-17T01:07:00.515 INFO:tasks.workunit.client.1.smithi143.stdout:8/503: read d9/de/d53/f68 [6576549,127459] 0 2024-09-17T01:07:00.517 INFO:tasks.workunit.client.1.smithi143.stdout:4/461: write da/d3a/d40/f36 [4015116,91211] 0 2024-09-17T01:07:00.518 INFO:tasks.workunit.client.1.smithi143.stdout:0/516: mknod d3/d14/d3d/cab 0 2024-09-17T01:07:00.518 INFO:tasks.workunit.client.1.smithi143.stdout:8/504: fsync d9/d84/f5c 0 2024-09-17T01:07:00.520 INFO:tasks.workunit.client.1.smithi143.stdout:3/468: rename d6/d1c/d33/d41/d42/f63 to d6/d1c/d33/f8d 0 2024-09-17T01:07:00.521 INFO:tasks.workunit.client.1.smithi143.stdout:2/498: dwrite d0/d2/fe [0,4194304] 0 2024-09-17T01:07:00.525 INFO:tasks.workunit.client.1.smithi143.stdout:9/505: dwrite d3/d39/d6a/d9/f87 [0,4194304] 0 2024-09-17T01:07:00.526 INFO:tasks.workunit.client.1.smithi143.stdout:0/517: mknod d3/d5/cac 0 2024-09-17T01:07:00.527 INFO:tasks.workunit.client.1.smithi143.stdout:3/469: chown d6/d1c/d4b/d57/c78 132051474 1 2024-09-17T01:07:00.528 INFO:tasks.workunit.client.1.smithi143.stdout:9/506: chown d3/f8 35680 1 2024-09-17T01:07:00.532 INFO:tasks.workunit.client.1.smithi143.stdout:7/660: creat d4/d1f/d29/d65/d5d/db1/dc6/fce x:0 0 0 2024-09-17T01:07:00.533 INFO:tasks.workunit.client.1.smithi143.stdout:5/471: rename d1/d46/c52 to d1/d46/d9d/cb9 0 2024-09-17T01:07:00.535 INFO:tasks.workunit.client.1.smithi143.stdout:0/518: mknod d3/d88/cad 0 2024-09-17T01:07:00.535 INFO:tasks.workunit.client.1.smithi143.stdout:3/470: creat d6/d1c/d4b/f8e x:0 0 0 2024-09-17T01:07:00.536 INFO:tasks.workunit.client.1.smithi143.stdout:8/505: dwrite d9/de/fb5 [0,4194304] 0 2024-09-17T01:07:00.539 INFO:tasks.workunit.client.1.smithi143.stdout:8/506: readlink d9/d23/db4/d56/d66/l99 0 2024-09-17T01:07:00.539 INFO:tasks.workunit.client.1.smithi143.stdout:4/462: rename da/f82 to da/d3a/d40/d84/f94 0 2024-09-17T01:07:00.540 INFO:tasks.workunit.client.1.smithi143.stdout:0/519: rename d3/d5/d8/d21/d2e to d3/d5/d8/d21/d2e/dae 22 2024-09-17T01:07:00.540 INFO:tasks.workunit.client.1.smithi143.stdout:4/463: dread - da/f73 zero size 2024-09-17T01:07:00.541 INFO:tasks.workunit.client.1.smithi143.stdout:9/507: truncate d3/d16/f1d 4948599 0 2024-09-17T01:07:00.543 INFO:tasks.workunit.client.1.smithi143.stdout:9/508: write d3/d39/d42/d58/f9f [1027239,81085] 0 2024-09-17T01:07:00.544 INFO:tasks.workunit.client.1.smithi143.stdout:8/507: creat d9/d12/d38/d7a/fb9 x:0 0 0 2024-09-17T01:07:00.546 INFO:tasks.workunit.client.1.smithi143.stdout:9/509: dread - d3/d81/fa6 zero size 2024-09-17T01:07:00.546 INFO:tasks.workunit.client.1.smithi143.stdout:3/471: mknod d6/d1c/d33/d3f/d79/d7b/c8f 0 2024-09-17T01:07:00.546 INFO:tasks.workunit.client.1.smithi143.stdout:4/464: fsync da/d3a/f51 0 2024-09-17T01:07:00.547 INFO:tasks.workunit.client.1.smithi143.stdout:4/465: chown da/f11 1139 1 2024-09-17T01:07:00.548 INFO:tasks.workunit.client.1.smithi143.stdout:8/508: mkdir d9/d12/d38/dba 0 2024-09-17T01:07:00.550 INFO:tasks.workunit.client.1.smithi143.stdout:4/466: chown da/d3a/d40 4 1 2024-09-17T01:07:00.550 INFO:tasks.workunit.client.1.smithi143.stdout:9/510: rmdir d3/d39/d42/d80 39 2024-09-17T01:07:00.550 INFO:tasks.workunit.client.1.smithi143.stdout:0/520: dwrite d3/d5/f29 [0,4194304] 0 2024-09-17T01:07:00.552 INFO:tasks.workunit.client.1.smithi143.stdout:3/472: truncate d6/d1c/d4b/f76 119910 0 2024-09-17T01:07:00.554 INFO:tasks.workunit.client.1.smithi143.stdout:8/509: chown d9/d23/c5f 162 1 2024-09-17T01:07:00.554 INFO:tasks.workunit.client.1.smithi143.stdout:0/521: chown d3/d5/d8/d10/l23 31662 1 2024-09-17T01:07:00.555 INFO:tasks.workunit.client.1.smithi143.stdout:3/473: read d6/d1c/d33/d41/d2b/f3d [1819366,1876] 0 2024-09-17T01:07:00.560 INFO:tasks.workunit.client.1.smithi143.stdout:8/510: creat d9/d23/db4/d55/d57/fbb x:0 0 0 2024-09-17T01:07:00.563 INFO:tasks.workunit.client.1.smithi143.stdout:3/474: dread d6/d1c/d4b/f76 [0,4194304] 0 2024-09-17T01:07:00.563 INFO:tasks.workunit.client.1.smithi143.stdout:4/467: dwrite da/f2a [0,4194304] 0 2024-09-17T01:07:00.564 INFO:tasks.workunit.client.1.smithi143.stdout:0/522: mkdir d3/d5/d35/da8/daf 0 2024-09-17T01:07:00.566 INFO:tasks.workunit.client.1.smithi143.stdout:9/511: dwrite d3/d39/d6a/fb [0,4194304] 0 2024-09-17T01:07:00.567 INFO:tasks.workunit.client.1.smithi143.stdout:2/499: dread d0/d2/f2b [0,4194304] 0 2024-09-17T01:07:00.570 INFO:tasks.workunit.client.1.smithi143.stdout:0/523: dread - d3/d68/f78 zero size 2024-09-17T01:07:00.570 INFO:tasks.workunit.client.1.smithi143.stdout:2/500: stat d0/d2/d21/d22 0 2024-09-17T01:07:00.571 INFO:tasks.workunit.client.1.smithi143.stdout:8/511: creat d9/d12/d13/d73/fbc x:0 0 0 2024-09-17T01:07:00.572 INFO:tasks.workunit.client.1.smithi143.stdout:4/468: mknod da/d75/c95 0 2024-09-17T01:07:00.573 INFO:tasks.workunit.client.1.smithi143.stdout:9/512: readlink d3/d39/d6a/l8a 0 2024-09-17T01:07:00.574 INFO:tasks.workunit.client.1.smithi143.stdout:0/524: unlink d3/fa2 0 2024-09-17T01:07:00.574 INFO:tasks.workunit.client.1.smithi143.stdout:2/501: chown d0/d10/d58/d5a/d5b/d4c/f6c 172913597 1 2024-09-17T01:07:00.575 INFO:tasks.workunit.client.1.smithi143.stdout:5/472: dread d1/d46/df/d23/d4f/f20 [0,4194304] 0 2024-09-17T01:07:00.575 INFO:tasks.workunit.client.1.smithi143.stdout:4/469: read da/f20 [3329796,75465] 0 2024-09-17T01:07:00.575 INFO:tasks.workunit.client.1.smithi143.stdout:8/512: truncate d9/d12/d4b/f37 4639217 0 2024-09-17T01:07:00.578 INFO:tasks.workunit.client.1.smithi143.stdout:4/470: chown da/d6d/l92 213 1 2024-09-17T01:07:00.580 INFO:tasks.workunit.client.1.smithi143.stdout:8/513: creat d9/d23/d32/fbd x:0 0 0 2024-09-17T01:07:00.583 INFO:tasks.workunit.client.1.smithi143.stdout:2/502: rename d0/d2/d21/d22/d24 to d0/d10/d58/d5a/d5b/d4c/d71/d9d 0 2024-09-17T01:07:00.584 INFO:tasks.workunit.client.1.smithi143.stdout:9/513: link d3/d39/d42/d58/d5a/d5e/d99/f9d d3/d39/d6a/d9/fa8 0 2024-09-17T01:07:00.585 INFO:tasks.workunit.client.1.smithi143.stdout:5/473: truncate d1/d46/df/d23/f90 912242 0 2024-09-17T01:07:00.586 INFO:tasks.workunit.client.1.smithi143.stdout:3/475: write d6/f58 [1391457,70182] 0 2024-09-17T01:07:00.588 INFO:tasks.workunit.client.1.smithi143.stdout:3/476: read d6/d1c/d33/d41/d2e/d30/f74 [467540,112695] 0 2024-09-17T01:07:00.589 INFO:tasks.workunit.client.1.smithi143.stdout:9/514: creat d3/d16/fa9 x:0 0 0 2024-09-17T01:07:00.589 INFO:tasks.workunit.client.1.smithi143.stdout:3/477: chown d6/l55 1873 1 2024-09-17T01:07:00.591 INFO:tasks.workunit.client.1.smithi143.stdout:3/478: write d6/d1c/d33/d41/d2b/f3d [726057,56741] 0 2024-09-17T01:07:00.593 INFO:tasks.workunit.client.1.smithi143.stdout:9/515: creat d3/d3d/faa x:0 0 0 2024-09-17T01:07:00.593 INFO:tasks.workunit.client.1.smithi143.stdout:5/474: dread d1/d46/d6e/f78 [0,4194304] 0 2024-09-17T01:07:00.595 INFO:tasks.workunit.client.1.smithi143.stdout:3/479: unlink d6/d1c/d33/d41/c4a 0 2024-09-17T01:07:00.596 INFO:tasks.workunit.client.1.smithi143.stdout:9/516: stat d3/d16/l23 0 2024-09-17T01:07:00.596 INFO:tasks.workunit.client.1.smithi143.stdout:5/475: unlink d1/d46/d9d/la9 0 2024-09-17T01:07:00.599 INFO:tasks.workunit.client.1.smithi143.stdout:8/514: dread d9/f59 [0,4194304] 0 2024-09-17T01:07:00.599 INFO:tasks.workunit.client.1.smithi143.stdout:2/503: dread d0/d10/f34 [0,4194304] 0 2024-09-17T01:07:00.600 INFO:tasks.workunit.client.1.smithi143.stdout:9/517: mkdir d3/d39/d42/dab 0 2024-09-17T01:07:00.602 INFO:tasks.workunit.client.1.smithi143.stdout:8/515: creat d9/d12/d38/d7a/fbe x:0 0 0 2024-09-17T01:07:00.603 INFO:tasks.workunit.client.1.smithi143.stdout:0/525: dread d3/d5/d8/d21/d2e/f50 [0,4194304] 0 2024-09-17T01:07:00.604 INFO:tasks.workunit.client.1.smithi143.stdout:8/516: chown d9/d12/d13/d7c/f91 11695 1 2024-09-17T01:07:00.604 INFO:tasks.workunit.client.1.smithi143.stdout:4/471: dread da/d3a/d3e/d5e/f62 [0,4194304] 0 2024-09-17T01:07:00.604 INFO:tasks.workunit.client.1.smithi143.stdout:3/480: rename d6/d1c/d33/d41/f39 to d6/f90 0 2024-09-17T01:07:00.605 INFO:tasks.workunit.client.1.smithi143.stdout:8/517: dread - d9/d84/f5c zero size 2024-09-17T01:07:00.607 INFO:tasks.workunit.client.1.smithi143.stdout:3/481: rmdir d6/d1c/d33/d3f/d79/d7b 39 2024-09-17T01:07:00.608 INFO:tasks.workunit.client.1.smithi143.stdout:8/518: mkdir d9/d23/db4/d55/dbf 0 2024-09-17T01:07:00.609 INFO:tasks.workunit.client.1.smithi143.stdout:9/518: link d3/d3d/c8e d3/d16/cac 0 2024-09-17T01:07:00.610 INFO:tasks.workunit.client.1.smithi143.stdout:9/519: write d3/d39/f72 [901625,120003] 0 2024-09-17T01:07:00.610 INFO:tasks.workunit.client.1.smithi143.stdout:0/526: creat d3/fb0 x:0 0 0 2024-09-17T01:07:00.611 INFO:tasks.workunit.client.1.smithi143.stdout:9/520: fsync d3/d39/f4b 0 2024-09-17T01:07:00.611 INFO:tasks.workunit.client.1.smithi143.stdout:4/472: symlink da/d3a/d3e/d5e/d63/l96 0 2024-09-17T01:07:00.612 INFO:tasks.workunit.client.1.smithi143.stdout:9/521: fsync d3/d81/f85 0 2024-09-17T01:07:00.613 INFO:tasks.workunit.client.1.smithi143.stdout:2/504: rename d0/d10/f30 to d0/d44/f9e 0 2024-09-17T01:07:00.613 INFO:tasks.workunit.client.1.smithi143.stdout:4/473: read da/d3a/f3b [130151,15126] 0 2024-09-17T01:07:00.615 INFO:tasks.workunit.client.1.smithi143.stdout:3/482: chown d6/d1c/d4b/d57/l5a 25427843 1 2024-09-17T01:07:00.616 INFO:tasks.workunit.client.1.smithi143.stdout:4/474: chown da/d3a/d40/d84 0 1 2024-09-17T01:07:00.619 INFO:tasks.workunit.client.1.smithi143.stdout:5/476: truncate d1/d46/df/d1f/d66/f6c 3766996 0 2024-09-17T01:07:00.619 INFO:tasks.workunit.client.1.smithi143.stdout:2/505: fsync d0/d10/f34 0 2024-09-17T01:07:00.622 INFO:tasks.workunit.client.1.smithi143.stdout:3/483: creat d6/d1c/d33/d3f/d5c/f91 x:0 0 0 2024-09-17T01:07:00.622 INFO:tasks.workunit.client.1.smithi143.stdout:9/522: dwrite d3/d39/d6a/d9/f98 [0,4194304] 0 2024-09-17T01:07:00.626 INFO:tasks.workunit.client.1.smithi143.stdout:8/519: dread d9/d23/db4/d55/d57/d9d/fa1 [0,4194304] 0 2024-09-17T01:07:00.627 INFO:tasks.workunit.client.1.smithi143.stdout:4/475: rename da/d3a/d40/d84/c44 to da/d3a/d3e/d4a/c97 0 2024-09-17T01:07:00.627 INFO:tasks.workunit.client.1.smithi143.stdout:3/484: mknod d6/d1c/d33/d41/d2e/c92 0 2024-09-17T01:07:00.628 INFO:tasks.workunit.client.1.smithi143.stdout:2/506: dread d0/d10/f34 [0,4194304] 0 2024-09-17T01:07:00.629 INFO:tasks.workunit.client.1.smithi143.stdout:8/520: chown d9/de/d53/d75 15 1 2024-09-17T01:07:00.632 INFO:tasks.workunit.client.1.smithi143.stdout:4/476: write da/d3a/d3e/d5e/d63/f70 [5043255,98444] 0 2024-09-17T01:07:00.632 INFO:tasks.workunit.client.1.smithi143.stdout:8/521: fdatasync d9/f11 0 2024-09-17T01:07:00.633 INFO:tasks.workunit.client.1.smithi143.stdout:5/477: dread d1/d46/df/d23/f26 [4194304,4194304] 0 2024-09-17T01:07:00.633 INFO:tasks.workunit.client.1.smithi143.stdout:0/527: truncate d3/d5/d8/d27/d31/d4c/f45 3395566 0 2024-09-17T01:07:00.634 INFO:tasks.workunit.client.1.smithi143.stdout:9/523: rmdir d3/d39/d42/d58/d5a/da0 0 2024-09-17T01:07:00.635 INFO:tasks.workunit.client.1.smithi143.stdout:2/507: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d9f 0 2024-09-17T01:07:00.635 INFO:tasks.workunit.client.1.smithi143.stdout:5/478: chown d1/d46/df/d23/f6f 284672 1 2024-09-17T01:07:00.636 INFO:tasks.workunit.client.1.smithi143.stdout:2/508: dread - d0/d10/d58/f68 zero size 2024-09-17T01:07:00.636 INFO:tasks.workunit.client.1.smithi143.stdout:2/509: readlink d0/d2/l3 0 2024-09-17T01:07:00.637 INFO:tasks.workunit.client.1.smithi143.stdout:8/522: unlink d9/de/d53/d75/daf/f93 0 2024-09-17T01:07:00.638 INFO:tasks.workunit.client.1.smithi143.stdout:9/524: chown d3/d3d/c8e 55001 1 2024-09-17T01:07:00.639 INFO:tasks.workunit.client.1.smithi143.stdout:3/485: creat d6/d1c/d33/d41/f93 x:0 0 0 2024-09-17T01:07:00.641 INFO:tasks.workunit.client.1.smithi143.stdout:2/510: write d0/d2/f2b [1730226,13255] 0 2024-09-17T01:07:00.641 INFO:tasks.workunit.client.1.smithi143.stdout:0/528: creat d3/d68/d75/fb1 x:0 0 0 2024-09-17T01:07:00.642 INFO:tasks.workunit.client.1.smithi143.stdout:4/477: mknod da/d3a/d3e/d4a/d8c/c98 0 2024-09-17T01:07:00.643 INFO:tasks.workunit.client.1.smithi143.stdout:9/525: symlink d3/d81/d9c/lad 0 2024-09-17T01:07:00.647 INFO:tasks.workunit.client.1.smithi143.stdout:0/529: truncate d3/d14/fa9 627238 0 2024-09-17T01:07:00.650 INFO:tasks.workunit.client.1.smithi143.stdout:4/478: creat da/d3a/d3e/d4a/d8a/f99 x:0 0 0 2024-09-17T01:07:00.651 INFO:tasks.workunit.client.1.smithi143.stdout:5/479: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:07:00.655 INFO:tasks.workunit.client.1.smithi143.stdout:8/523: truncate d9/d12/d38/f9f 615412 0 2024-09-17T01:07:00.655 INFO:tasks.workunit.client.1.smithi143.stdout:3/486: dwrite d6/d1c/d33/d3f/d5c/f91 [0,4194304] 0 2024-09-17T01:07:00.655 INFO:tasks.workunit.client.1.smithi143.stdout:4/479: chown da/d3a/d40/d84/f69 28887179 1 2024-09-17T01:07:00.659 INFO:tasks.workunit.client.1.smithi143.stdout:2/511: dwrite d0/d10/f34 [0,4194304] 0 2024-09-17T01:07:00.662 INFO:tasks.workunit.client.1.smithi143.stdout:2/512: chown d0/d44/d7a/f89 227465 1 2024-09-17T01:07:00.666 INFO:tasks.workunit.client.1.smithi143.stdout:5/480: mknod d1/d46/d9b/cba 0 2024-09-17T01:07:00.667 INFO:tasks.workunit.client.1.smithi143.stdout:4/480: symlink da/l9a 0 2024-09-17T01:07:00.669 INFO:tasks.workunit.client.1.smithi143.stdout:3/487: symlink d6/d1c/d33/d41/d2b/l94 0 2024-09-17T01:07:00.669 INFO:tasks.workunit.client.1.smithi143.stdout:0/530: rename d3/d5/d8/d21/f30 to d3/d14/fb2 0 2024-09-17T01:07:00.671 INFO:tasks.workunit.client.1.smithi143.stdout:8/524: getdents d9/d12/d4b 0 2024-09-17T01:07:00.672 INFO:tasks.workunit.client.1.smithi143.stdout:4/481: mkdir da/d68/d9b 0 2024-09-17T01:07:00.673 INFO:tasks.workunit.client.1.smithi143.stdout:5/481: creat d1/d46/d6e/da0/fbb x:0 0 0 2024-09-17T01:07:00.675 INFO:tasks.workunit.client.1.smithi143.stdout:2/513: dwrite d0/d44/d7a/f89 [0,4194304] 0 2024-09-17T01:07:00.676 INFO:tasks.workunit.client.1.smithi143.stdout:3/488: rename d6/d1c/d33/d41/d2e/c3c to d6/c95 0 2024-09-17T01:07:00.679 INFO:tasks.workunit.client.1.smithi143.stdout:9/526: dread d3/d39/d42/f5d [0,4194304] 0 2024-09-17T01:07:00.680 INFO:tasks.workunit.client.1.smithi143.stdout:5/482: write d1/d46/df/d23/f26 [7637026,22326] 0 2024-09-17T01:07:00.680 INFO:tasks.workunit.client.1.smithi143.stdout:8/525: creat d9/d12/d38/dba/fc0 x:0 0 0 2024-09-17T01:07:00.681 INFO:tasks.workunit.client.1.smithi143.stdout:2/514: dread d0/f51 [0,4194304] 0 2024-09-17T01:07:00.685 INFO:tasks.workunit.client.1.smithi143.stdout:9/527: write d3/d16/d3e/f4d [945130,107120] 0 2024-09-17T01:07:00.685 INFO:tasks.workunit.client.1.smithi143.stdout:3/489: write d6/d1c/d4d/f6d [506732,44443] 0 2024-09-17T01:07:00.686 INFO:tasks.workunit.client.1.smithi143.stdout:0/531: dwrite d3/d68/f9d [0,4194304] 0 2024-09-17T01:07:00.687 INFO:tasks.workunit.client.1.smithi143.stdout:8/526: fsync f7 0 2024-09-17T01:07:00.690 INFO:tasks.workunit.client.1.smithi143.stdout:4/482: rename da/d3a/c47 to da/d68/d9b/c9c 0 2024-09-17T01:07:00.690 INFO:tasks.workunit.client.1.smithi143.stdout:9/528: dread - d3/d39/d42/d58/f76 zero size 2024-09-17T01:07:00.691 INFO:tasks.workunit.client.1.smithi143.stdout:3/490: chown d6/d1c/d33/d41/d60/f8c 22486790 1 2024-09-17T01:07:00.691 INFO:tasks.workunit.client.1.smithi143.stdout:0/532: readlink d3/d5/d8/d27/d31/d85/la3 0 2024-09-17T01:07:00.691 INFO:tasks.workunit.client.1.smithi143.stdout:5/483: rmdir d1/d46/df/d53 39 2024-09-17T01:07:00.691 INFO:tasks.workunit.client.1.smithi143.stdout:8/527: chown d9/de/d53/d75/daf 33 1 2024-09-17T01:07:00.692 INFO:tasks.workunit.client.1.smithi143.stdout:2/515: mknod d0/d10/ca0 0 2024-09-17T01:07:00.693 INFO:tasks.workunit.client.1.smithi143.stdout:2/516: dread - d0/f9c zero size 2024-09-17T01:07:00.694 INFO:tasks.workunit.client.1.smithi143.stdout:8/528: write d9/d23/db4/d56/f96 [218603,112932] 0 2024-09-17T01:07:00.695 INFO:tasks.workunit.client.1.smithi143.stdout:8/529: chown d9/d2b/c52 969407266 1 2024-09-17T01:07:00.697 INFO:tasks.workunit.client.1.smithi143.stdout:8/530: dread - d9/d12/d38/dba/fc0 zero size 2024-09-17T01:07:00.697 INFO:tasks.workunit.client.1.smithi143.stdout:3/491: creat d6/d68/f96 x:0 0 0 2024-09-17T01:07:00.700 INFO:tasks.workunit.client.1.smithi143.stdout:0/533: getdents d3/d5/d8/d21/d2e 0 2024-09-17T01:07:00.700 INFO:tasks.workunit.client.1.smithi143.stdout:8/531: rmdir d9/de/d53 39 2024-09-17T01:07:00.701 INFO:tasks.workunit.client.1.smithi143.stdout:3/492: mknod d6/d1c/d33/d41/d2b/c97 0 2024-09-17T01:07:00.702 INFO:tasks.workunit.client.1.smithi143.stdout:0/534: truncate d3/fb0 462098 0 2024-09-17T01:07:00.702 INFO:tasks.workunit.client.1.smithi143.stdout:2/517: creat d0/d10/d58/d5a/d5b/d4c/d71/d99/fa1 x:0 0 0 2024-09-17T01:07:00.703 INFO:tasks.workunit.client.1.smithi143.stdout:0/535: stat d3/d14/la7 0 2024-09-17T01:07:00.703 INFO:tasks.workunit.client.1.smithi143.stdout:3/493: symlink d6/d1c/d4b/d57/l98 0 2024-09-17T01:07:00.705 INFO:tasks.workunit.client.1.smithi143.stdout:5/484: write d1/d46/df/d1f/d66/f6c [1175147,118954] 0 2024-09-17T01:07:00.705 INFO:tasks.workunit.client.1.smithi143.stdout:0/536: mkdir d3/d5/d8/d10/db3 0 2024-09-17T01:07:00.707 INFO:tasks.workunit.client.1.smithi143.stdout:5/485: chown d1/d46/d9b/daa 60597774 1 2024-09-17T01:07:00.707 INFO:tasks.workunit.client.1.smithi143.stdout:2/518: getdents d0/d10/d56 0 2024-09-17T01:07:00.708 INFO:tasks.workunit.client.1.smithi143.stdout:2/519: readlink d0/l76 0 2024-09-17T01:07:00.709 INFO:tasks.workunit.client.1.smithi143.stdout:5/486: read - d1/d46/df/d23/fb0 zero size 2024-09-17T01:07:00.712 INFO:tasks.workunit.client.1.smithi143.stdout:5/487: write d1/d46/d6e/f78 [777774,14921] 0 2024-09-17T01:07:00.713 INFO:tasks.workunit.client.1.smithi143.stdout:3/494: dwrite d6/d1c/d33/d3f/d5c/f91 [0,4194304] 0 2024-09-17T01:07:00.716 INFO:tasks.workunit.client.1.smithi143.stdout:0/537: truncate d3/d5/f29 939038 0 2024-09-17T01:07:00.718 INFO:tasks.workunit.client.1.smithi143.stdout:3/495: symlink d6/d1c/d33/d41/d60/l99 0 2024-09-17T01:07:00.720 INFO:tasks.workunit.client.1.smithi143.stdout:5/488: write d1/d46/df/d53/f81 [1917194,15554] 0 2024-09-17T01:07:00.723 INFO:tasks.workunit.client.1.smithi143.stdout:8/532: dwrite d9/d26/f36 [0,4194304] 0 2024-09-17T01:07:00.725 INFO:tasks.workunit.client.1.smithi143.stdout:2/520: dwrite d0/d2/d21/d22/f28 [0,4194304] 0 2024-09-17T01:07:00.728 INFO:tasks.workunit.client.1.smithi143.stdout:8/533: stat d9/de/d53 0 2024-09-17T01:07:00.731 INFO:tasks.workunit.client.1.smithi143.stdout:8/534: symlink d9/d12/d13/lc1 0 2024-09-17T01:07:00.734 INFO:tasks.workunit.client.1.smithi143.stdout:8/535: write d9/d23/db4/d56/d66/fa9 [27709,16727] 0 2024-09-17T01:07:00.734 INFO:tasks.workunit.client.1.smithi143.stdout:2/521: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2 0 2024-09-17T01:07:00.735 INFO:tasks.workunit.client.1.smithi143.stdout:0/538: dread d3/d5/f29 [0,4194304] 0 2024-09-17T01:07:00.736 INFO:tasks.workunit.client.1.smithi143.stdout:0/539: stat d3/d14/la7 0 2024-09-17T01:07:00.739 INFO:tasks.workunit.client.1.smithi143.stdout:0/540: symlink d3/d5/d8/d27/d31/d4c/d65/lb4 0 2024-09-17T01:07:00.741 INFO:tasks.workunit.client.1.smithi143.stdout:2/522: dwrite d0/d2/f2b [0,4194304] 0 2024-09-17T01:07:00.741 INFO:tasks.workunit.client.1.smithi143.stdout:2/523: chown d0/d10/d58/d5a/d5b/d4c 1040815 1 2024-09-17T01:07:00.746 INFO:tasks.workunit.client.1.smithi143.stdout:2/524: symlink d0/d44/d6a/la3 0 2024-09-17T01:07:00.746 INFO:tasks.workunit.client.1.smithi143.stdout:0/541: creat d3/d5/d35/da8/daf/fb5 x:0 0 0 2024-09-17T01:07:00.746 INFO:tasks.workunit.client.1.smithi143.stdout:3/496: truncate d6/d1c/d33/d41/d2e/d30/f6c 3892362 0 2024-09-17T01:07:00.747 INFO:tasks.workunit.client.1.smithi143.stdout:0/542: chown d3/d14/d32/l66 26833097 1 2024-09-17T01:07:00.749 INFO:tasks.workunit.client.1.smithi143.stdout:2/525: creat d0/d10/d58/d5a/d5b/fa4 x:0 0 0 2024-09-17T01:07:00.750 INFO:tasks.workunit.client.1.smithi143.stdout:5/489: dread d1/d46/df/d53/d74/d9a/fb1 [0,4194304] 0 2024-09-17T01:07:00.754 INFO:tasks.workunit.client.1.smithi143.stdout:3/497: dwrite d6/f58 [0,4194304] 0 2024-09-17T01:07:00.761 INFO:tasks.workunit.client.1.smithi143.stdout:5/490: dwrite d1/d46/df/d53/f86 [0,4194304] 0 2024-09-17T01:07:00.768 INFO:tasks.workunit.client.1.smithi143.stdout:0/543: write d3/d5/d8/d10/f2a [4861657,115707] 0 2024-09-17T01:07:00.770 INFO:tasks.workunit.client.1.smithi143.stdout:8/536: dwrite d9/d2b/f78 [0,4194304] 0 2024-09-17T01:07:00.773 INFO:tasks.workunit.client.1.smithi143.stdout:2/526: rmdir d0/d10/d58/d5a/d5b/d4c/d71/d9d 39 2024-09-17T01:07:00.776 INFO:tasks.workunit.client.1.smithi143.stdout:8/537: creat d9/d23/db4/d55/d57/d9d/fc2 x:0 0 0 2024-09-17T01:07:00.776 INFO:tasks.workunit.client.1.smithi143.stdout:3/498: dwrite d6/d1c/d33/d41/d42/f71 [0,4194304] 0 2024-09-17T01:07:00.777 INFO:tasks.workunit.client.1.smithi143.stdout:8/538: dread - d9/d12/d4b/d3f/f94 zero size 2024-09-17T01:07:00.778 INFO:tasks.workunit.client.1.smithi143.stdout:2/527: creat d0/d44/d7a/fa5 x:0 0 0 2024-09-17T01:07:00.779 INFO:tasks.workunit.client.1.smithi143.stdout:2/528: chown d0 45340525 1 2024-09-17T01:07:00.784 INFO:tasks.workunit.client.1.smithi143.stdout:2/529: creat d0/d44/d6a/d91/fa6 x:0 0 0 2024-09-17T01:07:00.787 INFO:tasks.workunit.client.1.smithi143.stdout:2/530: creat d0/d44/d7a/d86/fa7 x:0 0 0 2024-09-17T01:07:00.787 INFO:tasks.workunit.client.1.smithi143.stdout:5/491: write d1/d46/df/d1f/f30 [1161329,45840] 0 2024-09-17T01:07:00.788 INFO:tasks.workunit.client.1.smithi143.stdout:2/531: write d0/d10/f1d [1670916,120049] 0 2024-09-17T01:07:00.790 INFO:tasks.workunit.client.1.smithi143.stdout:2/532: fsync d0/d2/d21/f27 0 2024-09-17T01:07:00.792 INFO:tasks.workunit.client.1.smithi143.stdout:5/492: truncate d1/d46/df/d23/d4f/f20 1404852 0 2024-09-17T01:07:00.792 INFO:tasks.workunit.client.1.smithi143.stdout:2/533: fdatasync d0/d2/d21/f3b 0 2024-09-17T01:07:00.793 INFO:tasks.workunit.client.1.smithi143.stdout:5/493: symlink d1/d46/d9b/lbc 0 2024-09-17T01:07:00.794 INFO:tasks.workunit.client.1.smithi143.stdout:2/534: unlink d0/ff 0 2024-09-17T01:07:00.795 INFO:tasks.workunit.client.1.smithi143.stdout:5/494: mknod d1/d46/d6e/da0/cbd 0 2024-09-17T01:07:00.795 INFO:tasks.workunit.client.1.smithi143.stdout:8/539: fsync d9/d23/db4/fae 0 2024-09-17T01:07:00.796 INFO:tasks.workunit.client.1.smithi143.stdout:8/540: chown d9/d12/d38/d7a 14627 1 2024-09-17T01:07:00.796 INFO:tasks.workunit.client.1.smithi143.stdout:2/535: creat d0/d44/d6a/fa8 x:0 0 0 2024-09-17T01:07:00.797 INFO:tasks.workunit.client.1.smithi143.stdout:8/541: chown d9/d12/d13/d73 1 1 2024-09-17T01:07:00.797 INFO:tasks.workunit.client.1.smithi143.stdout:2/536: chown d0/d10/c4b 440166716 1 2024-09-17T01:07:00.798 INFO:tasks.workunit.client.1.smithi143.stdout:3/499: truncate d6/d1c/d33/f38 6903721 0 2024-09-17T01:07:00.798 INFO:tasks.workunit.client.1.smithi143.stdout:5/495: stat d1/d96/ca5 0 2024-09-17T01:07:00.799 INFO:tasks.workunit.client.1.smithi143.stdout:8/542: stat c3 0 2024-09-17T01:07:00.800 INFO:tasks.workunit.client.1.smithi143.stdout:2/537: rmdir d0/d10/d58/d5a/d5b/d4c/d59 39 2024-09-17T01:07:00.801 INFO:tasks.workunit.client.1.smithi143.stdout:5/496: mknod d1/d46/d9b/cbe 0 2024-09-17T01:07:00.802 INFO:tasks.workunit.client.1.smithi143.stdout:8/543: fsync d9/de/f6f 0 2024-09-17T01:07:00.802 INFO:tasks.workunit.client.1.smithi143.stdout:2/538: mknod d0/d10/d58/ca9 0 2024-09-17T01:07:00.806 INFO:tasks.workunit.client.1.smithi143.stdout:3/500: creat d6/d1c/d33/d3f/d79/f9a x:0 0 0 2024-09-17T01:07:00.807 INFO:tasks.workunit.client.1.smithi143.stdout:2/539: creat d0/d2/faa x:0 0 0 2024-09-17T01:07:00.811 INFO:tasks.workunit.client.1.smithi143.stdout:3/501: mknod d6/d1c/d33/d41/d2e/d86/c9b 0 2024-09-17T01:07:00.814 INFO:tasks.workunit.client.1.smithi143.stdout:5/497: getdents d1/d46/d6e/da0 0 2024-09-17T01:07:00.814 INFO:tasks.workunit.client.1.smithi143.stdout:3/502: read d6/f73 [749223,56944] 0 2024-09-17T01:07:00.816 INFO:tasks.workunit.client.1.smithi143.stdout:3/503: fsync d6/d1c/d33/d3f/f7d 0 2024-09-17T01:07:00.816 INFO:tasks.workunit.client.1.smithi143.stdout:5/498: creat d1/d46/d6e/da0/fbf x:0 0 0 2024-09-17T01:07:00.817 INFO:tasks.workunit.client.1.smithi143.stdout:8/544: dwrite d9/f59 [0,4194304] 0 2024-09-17T01:07:00.818 INFO:tasks.workunit.client.1.smithi143.stdout:8/545: chown d9/d23/db4/d56 27381 1 2024-09-17T01:07:00.819 INFO:tasks.workunit.client.1.smithi143.stdout:5/499: truncate d1/d46/d6e/f7c 333887 0 2024-09-17T01:07:00.820 INFO:tasks.workunit.client.1.smithi143.stdout:3/504: fsync d6/d1c/d33/d41/d2b/f70 0 2024-09-17T01:07:00.822 INFO:tasks.workunit.client.1.smithi143.stdout:5/500: mknod d1/d46/df/d1f/d7a/cc0 0 2024-09-17T01:07:00.823 INFO:tasks.workunit.client.1.smithi143.stdout:3/505: write d6/d1c/d4b/f8e [235595,110885] 0 2024-09-17T01:07:00.823 INFO:tasks.workunit.client.1.smithi143.stdout:8/546: link d9/d12/d38/f3d d9/d23/d4f/fc3 0 2024-09-17T01:07:00.825 INFO:tasks.workunit.client.1.smithi143.stdout:5/501: readlink d1/d46/df/d1f/d66/l77 0 2024-09-17T01:07:00.829 INFO:tasks.workunit.client.1.smithi143.stdout:2/540: dwrite d0/f4a [4194304,4194304] 0 2024-09-17T01:07:00.835 INFO:tasks.workunit.client.1.smithi143.stdout:3/506: truncate d6/d1c/d33/d41/f1a 6325810 0 2024-09-17T01:07:00.836 INFO:tasks.workunit.client.1.smithi143.stdout:8/547: dwrite d9/de/fb5 [0,4194304] 0 2024-09-17T01:07:00.838 INFO:tasks.workunit.client.1.smithi143.stdout:5/502: dwrite d1/d46/df/d23/d4f/d7d/d92/f9e [0,4194304] 0 2024-09-17T01:07:00.838 INFO:tasks.workunit.client.1.smithi143.stdout:3/507: fsync d6/d1c/d33/d3f/f7d 0 2024-09-17T01:07:00.841 INFO:tasks.workunit.client.1.smithi143.stdout:2/541: dread d0/d10/d56/f66 [0,4194304] 0 2024-09-17T01:07:00.843 INFO:tasks.workunit.client.1.smithi143.stdout:8/548: symlink d9/d23/d4f/lc4 0 2024-09-17T01:07:00.848 INFO:tasks.workunit.client.1.smithi143.stdout:8/549: fdatasync d9/d23/db4/f6c 0 2024-09-17T01:07:00.849 INFO:tasks.workunit.client.1.smithi143.stdout:5/503: symlink d1/d46/df/d1f/lc1 0 2024-09-17T01:07:00.850 INFO:tasks.workunit.client.1.smithi143.stdout:2/542: write d0/d2/d21/f3b [479488,94187] 0 2024-09-17T01:07:00.850 INFO:tasks.workunit.client.1.smithi143.stdout:8/550: dread - d9/d12/d38/d7a/fb9 zero size 2024-09-17T01:07:00.850 INFO:tasks.workunit.client.1.smithi143.stdout:5/504: fsync d1/d46/df/d23/fb0 0 2024-09-17T01:07:00.851 INFO:tasks.workunit.client.1.smithi143.stdout:5/505: chown d1/d46/df 98470154 1 2024-09-17T01:07:00.853 INFO:tasks.workunit.client.1.smithi143.stdout:2/543: creat d0/d44/d6a/fab x:0 0 0 2024-09-17T01:07:00.854 INFO:tasks.workunit.client.1.smithi143.stdout:5/506: creat d1/d46/df/d23/d4f/d82/fc2 x:0 0 0 2024-09-17T01:07:00.857 INFO:tasks.workunit.client.1.smithi143.stdout:8/551: dwrite d9/de/f6f [0,4194304] 0 2024-09-17T01:07:00.857 INFO:tasks.workunit.client.1.smithi143.stdout:5/507: creat d1/d46/d6e/fc3 x:0 0 0 2024-09-17T01:07:00.859 INFO:tasks.workunit.client.1.smithi143.stdout:5/508: chown d1/d46/df/d53/d74 760 1 2024-09-17T01:07:00.859 INFO:tasks.workunit.client.1.smithi143.stdout:8/552: dread - d9/d12/d4b/d3f/f94 zero size 2024-09-17T01:07:00.861 INFO:tasks.workunit.client.1.smithi143.stdout:2/544: dwrite d0/d44/d6a/f74 [0,4194304] 0 2024-09-17T01:07:00.862 INFO:tasks.workunit.client.1.smithi143.stdout:5/509: rmdir d1/d46/df/d23/d4f/d7d/d92 39 2024-09-17T01:07:00.865 INFO:tasks.workunit.client.1.smithi143.stdout:5/510: fsync d1/d46/df/d23/d4f/d82/f6b 0 2024-09-17T01:07:00.868 INFO:tasks.workunit.client.1.smithi143.stdout:8/553: dwrite d9/de/d53/d75/f88 [0,4194304] 0 2024-09-17T01:07:00.872 INFO:tasks.workunit.client.1.smithi143.stdout:8/554: readlink d9/d23/l8c 0 2024-09-17T01:07:00.875 INFO:tasks.workunit.client.1.smithi143.stdout:5/511: rename d1/d46/df/d1f/d66/f6c to d1/d46/df/d53/d74/d9a/d9c/fc4 0 2024-09-17T01:07:00.900 INFO:tasks.workunit.client.1.smithi143.stdout:3/508: write d6/d1c/d33/d41/d2e/f47 [4184086,97740] 0 2024-09-17T01:07:00.902 INFO:tasks.workunit.client.1.smithi143.stdout:8/555: dread d9/d2b/f78 [0,4194304] 0 2024-09-17T01:07:00.905 INFO:tasks.workunit.client.1.smithi143.stdout:3/509: dread d6/d1c/d33/f72 [0,4194304] 0 2024-09-17T01:07:00.909 INFO:tasks.workunit.client.1.smithi143.stdout:3/510: rename d6/d1c/d33/d41/f93 to d6/d1c/f9c 0 2024-09-17T01:07:00.911 INFO:tasks.workunit.client.1.smithi143.stdout:8/556: dread d9/de/f21 [0,4194304] 0 2024-09-17T01:07:00.911 INFO:tasks.workunit.client.1.smithi143.stdout:5/512: dwrite d1/d46/df/d23/f41 [0,4194304] 0 2024-09-17T01:07:00.913 INFO:tasks.workunit.client.1.smithi143.stdout:8/557: write d9/d23/db4/d56/d66/fa9 [330862,99820] 0 2024-09-17T01:07:00.914 INFO:tasks.workunit.client.1.smithi143.stdout:5/513: read d1/d46/df/f76 [2164061,19856] 0 2024-09-17T01:07:00.917 INFO:tasks.workunit.client.1.smithi143.stdout:3/511: rename d6/d1c/d33/d41/d2b/f70 to d6/d1c/d4b/d57/f9d 0 2024-09-17T01:07:00.920 INFO:tasks.workunit.client.1.smithi143.stdout:8/558: write d9/de/f10 [1016751,26008] 0 2024-09-17T01:07:00.921 INFO:tasks.workunit.client.1.smithi143.stdout:8/559: dread - d9/fab zero size 2024-09-17T01:07:00.921 INFO:tasks.workunit.client.1.smithi143.stdout:3/512: creat d6/d1c/d33/d3f/d79/d7b/f9e x:0 0 0 2024-09-17T01:07:00.921 INFO:tasks.workunit.client.1.smithi143.stdout:8/560: dread - d9/d84/f5c zero size 2024-09-17T01:07:00.923 INFO:tasks.workunit.client.1.smithi143.stdout:8/561: symlink d9/d12/d38/d58/d70/lc5 0 2024-09-17T01:07:00.924 INFO:tasks.workunit.client.1.smithi143.stdout:3/513: unlink d6/c95 0 2024-09-17T01:07:00.925 INFO:tasks.workunit.client.1.smithi143.stdout:8/562: chown d9/de/lf 91 1 2024-09-17T01:07:00.930 INFO:tasks.workunit.client.1.smithi143.stdout:8/563: truncate d9/d12/d38/d58/d70/f71 1384890 0 2024-09-17T01:07:00.931 INFO:tasks.workunit.client.1.smithi143.stdout:8/564: write d9/d12/d13/d7c/f91 [95954,115919] 0 2024-09-17T01:07:00.932 INFO:tasks.workunit.client.1.smithi143.stdout:8/565: fdatasync d9/d23/db4/f6c 0 2024-09-17T01:07:00.934 INFO:tasks.workunit.client.1.smithi143.stdout:3/514: dwrite d6/d1c/d33/d41/d60/f8c [0,4194304] 0 2024-09-17T01:07:00.934 INFO:tasks.workunit.client.1.smithi143.stdout:8/566: write d9/d23/d32/fbd [237811,116298] 0 2024-09-17T01:07:00.935 INFO:tasks.workunit.client.1.smithi143.stdout:3/515: write d6/d68/f96 [598360,27591] 0 2024-09-17T01:07:00.937 INFO:tasks.workunit.client.1.smithi143.stdout:3/516: fdatasync d6/d1c/d33/d3f/f7f 0 2024-09-17T01:07:00.937 INFO:tasks.workunit.client.1.smithi143.stdout:8/567: creat d9/d23/db4/d55/dbf/fc6 x:0 0 0 2024-09-17T01:07:00.939 INFO:tasks.workunit.client.1.smithi143.stdout:8/568: symlink d9/d23/d32/lc7 0 2024-09-17T01:07:00.940 INFO:tasks.workunit.client.1.smithi143.stdout:3/517: symlink d6/d1c/d4b/d57/l9f 0 2024-09-17T01:07:00.941 INFO:tasks.workunit.client.1.smithi143.stdout:8/569: dread - d9/d23/db4/d55/d57/d9d/fc2 zero size 2024-09-17T01:07:00.942 INFO:tasks.workunit.client.1.smithi143.stdout:8/570: truncate d9/d12/d38/d7a/d8f/f92 150082 0 2024-09-17T01:07:00.945 INFO:tasks.workunit.client.1.smithi143.stdout:8/571: symlink d9/d23/db4/d55/d57/d9d/lc8 0 2024-09-17T01:07:00.946 INFO:tasks.workunit.client.1.smithi143.stdout:3/518: truncate d6/d1c/d33/d41/d2e/d30/f6c 148076 0 2024-09-17T01:07:00.946 INFO:tasks.workunit.client.1.smithi143.stdout:3/519: fdatasync d6/fa 0 2024-09-17T01:07:00.948 INFO:tasks.workunit.client.1.smithi143.stdout:3/520: creat d6/d1c/d4b/d57/fa0 x:0 0 0 2024-09-17T01:07:00.948 INFO:tasks.workunit.client.1.smithi143.stdout:8/572: dread d9/d23/d32/fb7 [0,4194304] 0 2024-09-17T01:07:00.950 INFO:tasks.workunit.client.1.smithi143.stdout:8/573: mknod d9/d12/d13/cc9 0 2024-09-17T01:07:00.950 INFO:tasks.workunit.client.1.smithi143.stdout:6/506: sync 2024-09-17T01:07:00.951 INFO:tasks.workunit.client.1.smithi143.stdout:1/581: sync 2024-09-17T01:07:00.951 INFO:tasks.workunit.client.1.smithi143.stdout:7/661: sync 2024-09-17T01:07:00.952 INFO:tasks.workunit.client.1.smithi143.stdout:1/582: readlink d0/d6/d43/d6a/df/l98 0 2024-09-17T01:07:00.953 INFO:tasks.workunit.client.1.smithi143.stdout:8/574: getdents d9/d12/d38/d58/d79 0 2024-09-17T01:07:00.954 INFO:tasks.workunit.client.1.smithi143.stdout:6/507: creat d2/d17/d6e/d26/d46/d65/f9c x:0 0 0 2024-09-17T01:07:00.955 INFO:tasks.workunit.client.1.smithi143.stdout:8/575: mknod d9/d23/db4/d55/d57/d9d/cca 0 2024-09-17T01:07:00.955 INFO:tasks.workunit.client.1.smithi143.stdout:7/662: getdents d4/d26 0 2024-09-17T01:07:00.956 INFO:tasks.workunit.client.1.smithi143.stdout:6/508: symlink d2/df/d20/d2c/d75/l9d 0 2024-09-17T01:07:00.957 INFO:tasks.workunit.client.1.smithi143.stdout:1/583: dread d0/d6/d43/d6a/d52/f6f [0,4194304] 0 2024-09-17T01:07:00.957 INFO:tasks.workunit.client.1.smithi143.stdout:8/576: write d9/d23/d4f/fa2 [3468653,23949] 0 2024-09-17T01:07:00.962 INFO:tasks.workunit.client.1.smithi143.stdout:1/584: rename d0/fa8 to d0/d6/d43/d6a/fc1 0 2024-09-17T01:07:00.966 INFO:tasks.workunit.client.1.smithi143.stdout:1/585: write d0/d6/d64/f80 [1491612,113575] 0 2024-09-17T01:07:00.966 INFO:tasks.workunit.client.1.smithi143.stdout:7/663: dwrite d4/d1f/d4a/f94 [4194304,4194304] 0 2024-09-17T01:07:00.968 INFO:tasks.workunit.client.1.smithi143.stdout:7/664: dread - d4/d1f/d4a/d66/d86/fa8 zero size 2024-09-17T01:07:00.968 INFO:tasks.workunit.client.1.smithi143.stdout:1/586: chown d0/d6/d43/d6a/df/d27/f84 15117437 1 2024-09-17T01:07:00.970 INFO:tasks.workunit.client.1.smithi143.stdout:7/665: read d4/d1f/f63 [129478,25750] 0 2024-09-17T01:07:00.971 INFO:tasks.workunit.client.1.smithi143.stdout:3/521: dread d6/d1c/d33/d41/f1a [4194304,4194304] 0 2024-09-17T01:07:00.975 INFO:tasks.workunit.client.1.smithi143.stdout:6/509: dwrite d2/df/d20/f54 [0,4194304] 0 2024-09-17T01:07:00.975 INFO:tasks.workunit.client.1.smithi143.stdout:3/522: truncate d6/d1c/d33/d3f/d79/f9a 156731 0 2024-09-17T01:07:00.976 INFO:tasks.workunit.client.1.smithi143.stdout:7/666: rename d4/d1f/d4a/d66/cb4 to d4/d1f/d29/d65/d5d/db1/ccf 0 2024-09-17T01:07:00.979 INFO:tasks.workunit.client.1.smithi143.stdout:6/510: symlink d2/l9e 0 2024-09-17T01:07:00.979 INFO:tasks.workunit.client.1.smithi143.stdout:3/523: write d6/d1c/d4b/d57/f9d [831478,84625] 0 2024-09-17T01:07:00.981 INFO:tasks.workunit.client.1.smithi143.stdout:1/587: dwrite d0/d6/d43/d6a/df/d6e/d2/f2a [0,4194304] 0 2024-09-17T01:07:00.983 INFO:tasks.workunit.client.1.smithi143.stdout:7/667: link d4/d26/f2b d4/fd0 0 2024-09-17T01:07:00.984 INFO:tasks.workunit.client.1.smithi143.stdout:3/524: rename d6/d1c/d33/d41/d60 to d6/d1c/d33/d3f/d5c/da1 0 2024-09-17T01:07:00.985 INFO:tasks.workunit.client.1.smithi143.stdout:1/588: mkdir d0/dc/d57/dc2 0 2024-09-17T01:07:00.985 INFO:tasks.workunit.client.1.smithi143.stdout:1/589: stat d0/d6/d43/d47/d68 0 2024-09-17T01:07:00.989 INFO:tasks.workunit.client.1.smithi143.stdout:1/590: mkdir d0/d6/d43/d6a/df/d6e/d18/d2d/dc3 0 2024-09-17T01:07:00.990 INFO:tasks.workunit.client.1.smithi143.stdout:1/591: chown d0/d6/d43/d6a/df/d6e/d2/f5b 0 1 2024-09-17T01:07:00.991 INFO:tasks.workunit.client.1.smithi143.stdout:1/592: truncate d0/dc/f82 1695427 0 2024-09-17T01:07:00.993 INFO:tasks.workunit.client.1.smithi143.stdout:1/593: rmdir d0/d6/d43/d47 39 2024-09-17T01:07:00.995 INFO:tasks.workunit.client.1.smithi143.stdout:1/594: symlink d0/d6/d43/d6a/d8f/dbe/lc4 0 2024-09-17T01:07:00.996 INFO:tasks.workunit.client.1.smithi143.stdout:3/525: write d6/d1c/d33/f38 [3378194,57519] 0 2024-09-17T01:07:01.004 INFO:tasks.workunit.client.1.smithi143.stdout:3/526: dread d6/d1c/f2a [0,4194304] 0 2024-09-17T01:07:01.006 INFO:tasks.workunit.client.1.smithi143.stdout:3/527: symlink d6/d1c/d33/d5d/la2 0 2024-09-17T01:07:01.007 INFO:tasks.workunit.client.1.smithi143.stdout:3/528: chown d6/d1c/d33/d41/d42/l52 17 1 2024-09-17T01:07:01.009 INFO:tasks.workunit.client.1.smithi143.stdout:3/529: mknod d6/d1c/d33/d3f/d5c/da1/ca3 0 2024-09-17T01:07:01.009 INFO:tasks.workunit.client.1.smithi143.stdout:3/530: chown d6/d1c/d33/d41/f11 1478891 1 2024-09-17T01:07:01.010 INFO:tasks.workunit.client.1.smithi143.stdout:3/531: mkdir d6/d1c/d4d/da4 0 2024-09-17T01:07:01.013 INFO:tasks.workunit.client.1.smithi143.stdout:3/532: link d6/d1c/d33/d41/d2b/l94 d6/d1c/d4d/la5 0 2024-09-17T01:07:01.015 INFO:tasks.workunit.client.1.smithi143.stdout:3/533: creat d6/d1c/d33/d41/d2e/d86/d89/fa6 x:0 0 0 2024-09-17T01:07:01.017 INFO:tasks.workunit.client.1.smithi143.stdout:3/534: unlink d6/d1c/d33/d41/d42/f71 0 2024-09-17T01:07:01.019 INFO:tasks.workunit.client.1.smithi143.stdout:3/535: creat d6/d1c/d33/d41/d2e/d86/d89/fa7 x:0 0 0 2024-09-17T01:07:01.023 INFO:tasks.workunit.client.1.smithi143.stdout:3/536: link d6/d1c/d33/d3f/d79/l88 d6/d1c/d4b/la8 0 2024-09-17T01:07:01.023 INFO:tasks.workunit.client.1.smithi143.stdout:3/537: fsync d6/d1c/d33/f38 0 2024-09-17T01:07:01.025 INFO:tasks.workunit.client.1.smithi143.stdout:3/538: chown d6/d1c/d33/d41/d2e/d30/f74 3 1 2024-09-17T01:07:01.025 INFO:tasks.workunit.client.1.smithi143.stdout:1/595: dread d0/d6/d43/d6a/df/d6e/d2/f56 [0,4194304] 0 2024-09-17T01:07:01.025 INFO:tasks.workunit.client.1.smithi143.stdout:1/596: chown d0/dc/d57/la7 1 1 2024-09-17T01:07:01.026 INFO:tasks.workunit.client.1.smithi143.stdout:3/539: creat d6/d1c/d4b/fa9 x:0 0 0 2024-09-17T01:07:01.027 INFO:tasks.workunit.client.1.smithi143.stdout:1/597: stat d0/d6/d43/d6a/df/d6e/d2/d39/d6b/lae 0 2024-09-17T01:07:01.027 INFO:tasks.workunit.client.1.smithi143.stdout:3/540: read - d6/d1c/d33/d3f/f75 zero size 2024-09-17T01:07:01.028 INFO:tasks.workunit.client.1.smithi143.stdout:1/598: mknod d0/d6/d43/d6a/d52/db2/cc5 0 2024-09-17T01:07:01.029 INFO:tasks.workunit.client.1.smithi143.stdout:3/541: mknod d6/d1c/d33/d41/d2e/d86/d89/caa 0 2024-09-17T01:07:01.030 INFO:tasks.workunit.client.1.smithi143.stdout:1/599: chown d0/dc/f2c 55664684 1 2024-09-17T01:07:01.032 INFO:tasks.workunit.client.1.smithi143.stdout:9/529: sync 2024-09-17T01:07:01.032 INFO:tasks.workunit.client.1.smithi143.stdout:4/483: sync 2024-09-17T01:07:01.032 INFO:tasks.workunit.client.1.smithi143.stdout:0/544: sync 2024-09-17T01:07:01.035 INFO:tasks.workunit.client.1.smithi143.stdout:1/600: dread d0/d6/d43/d6a/df/d6e/d2/f2a [0,4194304] 0 2024-09-17T01:07:01.036 INFO:tasks.workunit.client.1.smithi143.stdout:9/530: symlink d3/d39/d42/d58/d5a/d5e/lae 0 2024-09-17T01:07:01.038 INFO:tasks.workunit.client.1.smithi143.stdout:4/484: dread da/d3a/d40/d84/f4b [0,4194304] 0 2024-09-17T01:07:01.039 INFO:tasks.workunit.client.1.smithi143.stdout:4/485: stat da/d3a/d40/f27 0 2024-09-17T01:07:01.040 INFO:tasks.workunit.client.1.smithi143.stdout:4/486: write da/d6d/f76 [2024398,87537] 0 2024-09-17T01:07:01.042 INFO:tasks.workunit.client.1.smithi143.stdout:9/531: creat d3/d39/d42/d58/d5a/d5e/d99/faf x:0 0 0 2024-09-17T01:07:01.042 INFO:tasks.workunit.client.1.smithi143.stdout:4/487: read da/d3a/d3e/d5e/d63/f70 [1742916,69895] 0 2024-09-17T01:07:01.043 INFO:tasks.workunit.client.1.smithi143.stdout:9/532: fdatasync d3/d81/fa6 0 2024-09-17T01:07:01.044 INFO:tasks.workunit.client.1.smithi143.stdout:0/545: getdents d3/d14/d3d 0 2024-09-17T01:07:01.047 INFO:tasks.workunit.client.1.smithi143.stdout:3/542: truncate d6/d1c/d33/d41/d2b/f3d 224595 0 2024-09-17T01:07:01.048 INFO:tasks.workunit.client.1.smithi143.stdout:9/533: mknod d3/d3d/cb0 0 2024-09-17T01:07:01.048 INFO:tasks.workunit.client.1.smithi143.stdout:1/601: write d0/dc/f83 [1867518,4254] 0 2024-09-17T01:07:01.049 INFO:tasks.workunit.client.1.smithi143.stdout:9/534: write d3/d16/f45 [766998,59205] 0 2024-09-17T01:07:01.049 INFO:tasks.workunit.client.1.smithi143.stdout:4/488: truncate da/d3a/d40/f34 3348251 0 2024-09-17T01:07:01.050 INFO:tasks.workunit.client.1.smithi143.stdout:3/543: mkdir d6/d1c/d4b/dab 0 2024-09-17T01:07:01.052 INFO:tasks.workunit.client.1.smithi143.stdout:9/535: dread - d3/d39/d6a/d9/d74/f97 zero size 2024-09-17T01:07:01.052 INFO:tasks.workunit.client.1.smithi143.stdout:4/489: fdatasync da/d68/f87 0 2024-09-17T01:07:01.054 INFO:tasks.workunit.client.1.smithi143.stdout:3/544: creat d6/d68/fac x:0 0 0 2024-09-17T01:07:01.057 INFO:tasks.workunit.client.1.smithi143.stdout:0/546: write d3/d5/d8/d27/d31/d85/fa1 [2363626,68377] 0 2024-09-17T01:07:01.057 INFO:tasks.workunit.client.1.smithi143.stdout:4/490: read da/d3a/d40/f37 [1459710,107977] 0 2024-09-17T01:07:01.058 INFO:tasks.workunit.client.1.smithi143.stdout:9/536: symlink d3/d16/d3e/d51/d52/lb1 0 2024-09-17T01:07:01.086 INFO:tasks.workunit.client.1.smithi143.stdout:3/545: symlink d6/lad 0 2024-09-17T01:07:01.087 INFO:tasks.workunit.client.1.smithi143.stdout:4/491: write da/f11 [918914,39077] 0 2024-09-17T01:07:01.090 INFO:tasks.workunit.client.1.smithi143.stdout:3/546: mknod d6/d1c/d4b/dab/cae 0 2024-09-17T01:07:01.090 INFO:tasks.workunit.client.1.smithi143.stdout:4/492: dread - da/d3a/f59 zero size 2024-09-17T01:07:01.091 INFO:tasks.workunit.client.1.smithi143.stdout:3/547: mknod d6/d1c/d4d/caf 0 2024-09-17T01:07:01.092 INFO:tasks.workunit.client.1.smithi143.stdout:4/493: write da/d3a/d40/f37 [2749959,3411] 0 2024-09-17T01:07:01.092 INFO:tasks.workunit.client.1.smithi143.stdout:3/548: stat d6/d1c/d33/d3f/d5c/da1/c85 0 2024-09-17T01:07:01.095 INFO:tasks.workunit.client.1.smithi143.stdout:4/494: chown da/d3a/d40/d84/c45 834 1 2024-09-17T01:07:01.096 INFO:tasks.workunit.client.1.smithi143.stdout:3/549: dread d6/d1c/d4b/f76 [0,4194304] 0 2024-09-17T01:07:01.097 INFO:tasks.workunit.client.1.smithi143.stdout:4/495: chown da/d3a/f3b 1362 1 2024-09-17T01:07:01.098 INFO:tasks.workunit.client.1.smithi143.stdout:3/550: dread - d6/d1c/d4b/d57/fa0 zero size 2024-09-17T01:07:01.099 INFO:tasks.workunit.client.1.smithi143.stdout:4/496: readlink da/d3a/d40/l2b 0 2024-09-17T01:07:01.100 INFO:tasks.workunit.client.1.smithi143.stdout:9/537: dread d3/d3d/f43 [0,4194304] 0 2024-09-17T01:07:01.100 INFO:tasks.workunit.client.1.smithi143.stdout:0/547: dwrite d3/d5/d8/d21/f3e [4194304,4194304] 0 2024-09-17T01:07:01.102 INFO:tasks.workunit.client.1.smithi143.stdout:9/538: dread - d3/d39/d42/d58/d5a/d5e/d99/f93 zero size 2024-09-17T01:07:01.103 INFO:tasks.workunit.client.1.smithi143.stdout:4/497: write f2 [2706986,13531] 0 2024-09-17T01:07:01.107 INFO:tasks.workunit.client.1.smithi143.stdout:3/551: rename d6/d1c/f9c to d6/d1c/d33/d41/d2e/d86/d89/fb0 0 2024-09-17T01:07:01.108 INFO:tasks.workunit.client.1.smithi143.stdout:4/498: fdatasync da/d3a/d40/d84/f94 0 2024-09-17T01:07:01.111 INFO:tasks.workunit.client.1.smithi143.stdout:3/552: write d6/d1c/d33/d41/d2e/f87 [1572113,91356] 0 2024-09-17T01:07:01.111 INFO:tasks.workunit.client.1.smithi143.stdout:0/548: link d3/d5/d8/d27/d31/d4c/c87 d3/d68/cb6 0 2024-09-17T01:07:01.112 INFO:tasks.workunit.client.1.smithi143.stdout:3/553: dread - d6/d1c/d33/d3f/d79/d7b/f9e zero size 2024-09-17T01:07:01.113 INFO:tasks.workunit.client.1.smithi143.stdout:9/539: link d3/d39/d6a/d9/f66 d3/d39/d42/d58/d5a/d5e/fb2 0 2024-09-17T01:07:01.114 INFO:tasks.workunit.client.1.smithi143.stdout:9/540: write d3/d81/fa6 [330534,66957] 0 2024-09-17T01:07:01.115 INFO:tasks.workunit.client.1.smithi143.stdout:4/499: rmdir da/d3a/d3e/d5e/d63/d80/d91 0 2024-09-17T01:07:01.117 INFO:tasks.workunit.client.1.smithi143.stdout:0/549: dread d3/d5/d8/d21/f47 [0,4194304] 0 2024-09-17T01:07:01.118 INFO:tasks.workunit.client.1.smithi143.stdout:4/500: rename da/d3a/d40/l60 to da/d3a/d3e/d5e/d63/d80/l9d 0 2024-09-17T01:07:01.119 INFO:tasks.workunit.client.1.smithi143.stdout:9/541: dread d3/d39/d42/d58/d5a/d5e/d99/f5b [0,4194304] 0 2024-09-17T01:07:01.120 INFO:tasks.workunit.client.1.smithi143.stdout:0/550: creat d3/d88/fb7 x:0 0 0 2024-09-17T01:07:01.121 INFO:tasks.workunit.client.1.smithi143.stdout:9/542: chown d3/d16/d3e/f4d 0 1 2024-09-17T01:07:01.121 INFO:tasks.workunit.client.1.smithi143.stdout:4/501: mkdir da/d3a/d3e/d72/d9e 0 2024-09-17T01:07:01.124 INFO:tasks.workunit.client.1.smithi143.stdout:9/543: dread d3/d3d/f43 [0,4194304] 0 2024-09-17T01:07:01.126 INFO:tasks.workunit.client.1.smithi143.stdout:4/502: dread da/d3a/f3b [0,4194304] 0 2024-09-17T01:07:01.127 INFO:tasks.workunit.client.1.smithi143.stdout:0/551: dwrite d3/d5/f41 [0,4194304] 0 2024-09-17T01:07:01.129 INFO:tasks.workunit.client.1.smithi143.stdout:9/544: getdents d3/d39 0 2024-09-17T01:07:01.131 INFO:tasks.workunit.client.1.smithi143.stdout:4/503: creat da/d3a/d3e/d4a/d8c/f9f x:0 0 0 2024-09-17T01:07:01.132 INFO:tasks.workunit.client.1.smithi143.stdout:2/545: sync 2024-09-17T01:07:01.132 INFO:tasks.workunit.client.1.smithi143.stdout:5/514: sync 2024-09-17T01:07:01.132 INFO:tasks.workunit.client.1.smithi143.stdout:4/504: write da/d6d/f76 [5231112,48755] 0 2024-09-17T01:07:01.132 INFO:tasks.workunit.client.1.smithi143.stdout:0/552: creat d3/fb8 x:0 0 0 2024-09-17T01:07:01.133 INFO:tasks.workunit.client.1.smithi143.stdout:5/515: write d1/d46/df/d53/d74/faf [422518,94893] 0 2024-09-17T01:07:01.137 INFO:tasks.workunit.client.1.smithi143.stdout:4/505: creat da/d3a/d3e/d4a/d8c/fa0 x:0 0 0 2024-09-17T01:07:01.137 INFO:tasks.workunit.client.1.smithi143.stdout:3/554: dread d6/d1c/d33/d41/d2e/d30/f32 [0,4194304] 0 2024-09-17T01:07:01.138 INFO:tasks.workunit.client.1.smithi143.stdout:4/506: fsync da/f1c 0 2024-09-17T01:07:01.139 INFO:tasks.workunit.client.1.smithi143.stdout:5/516: mkdir d1/d46/df/d1f/d66/db8/dc5 0 2024-09-17T01:07:01.140 INFO:tasks.workunit.client.1.smithi143.stdout:4/507: dread - da/d75/f88 zero size 2024-09-17T01:07:01.141 INFO:tasks.workunit.client.1.smithi143.stdout:4/508: readlink da/d3a/d40/l78 0 2024-09-17T01:07:01.141 INFO:tasks.workunit.client.1.smithi143.stdout:5/517: write d1/d46/df/d53/d74/faf [1462755,118275] 0 2024-09-17T01:07:01.142 INFO:tasks.workunit.client.1.smithi143.stdout:4/509: dread - da/d3a/d3e/d4a/d8a/f99 zero size 2024-09-17T01:07:01.142 INFO:tasks.workunit.client.1.smithi143.stdout:3/555: mkdir d6/d1c/d82/db1 0 2024-09-17T01:07:01.143 INFO:tasks.workunit.client.1.smithi143.stdout:5/518: chown d1/d46/df/d23/d4f/c39 31922 1 2024-09-17T01:07:01.144 INFO:tasks.workunit.client.1.smithi143.stdout:0/553: link d3/d5/d8/d27/d31/d4c/c4a d3/d5/d8/d27/d31/d48/d62/cb9 0 2024-09-17T01:07:01.145 INFO:tasks.workunit.client.1.smithi143.stdout:5/519: rmdir d1/d46/df/d53/d74/d9a/d9c 39 2024-09-17T01:07:01.146 INFO:tasks.workunit.client.1.smithi143.stdout:0/554: mkdir d3/d5/d8/d21/d9b/dba 0 2024-09-17T01:07:01.146 INFO:tasks.workunit.client.1.smithi143.stdout:3/556: read d6/d1c/d33/d41/d2e/d30/f6c [84633,90720] 0 2024-09-17T01:07:01.147 INFO:tasks.workunit.client.1.smithi143.stdout:0/555: readlink d3/d5/d8/d27/l15 0 2024-09-17T01:07:01.148 INFO:tasks.workunit.client.1.smithi143.stdout:3/557: readlink d6/d1c/d33/d41/l65 0 2024-09-17T01:07:01.148 INFO:tasks.workunit.client.1.smithi143.stdout:0/556: mknod d3/d5/d8/d27/d8c/cbb 0 2024-09-17T01:07:01.150 INFO:tasks.workunit.client.1.smithi143.stdout:3/558: getdents d6/d1c/d4d 0 2024-09-17T01:07:01.222 INFO:tasks.workunit.client.1.smithi143.stdout:0/557: dread d3/d5/d8/d27/d31/d48/f5e [0,4194304] 0 2024-09-17T01:07:01.226 INFO:tasks.workunit.client.1.smithi143.stdout:3/559: dread d6/d1c/d33/d41/f21 [0,4194304] 0 2024-09-17T01:07:01.228 INFO:tasks.workunit.client.1.smithi143.stdout:3/560: mknod d6/d1c/d82/cb2 0 2024-09-17T01:07:01.230 INFO:tasks.workunit.client.1.smithi143.stdout:3/561: mknod d6/cb3 0 2024-09-17T01:07:01.234 INFO:tasks.workunit.client.1.smithi143.stdout:5/520: dread d1/d46/df/d23/f4e [0,4194304] 0 2024-09-17T01:07:01.237 INFO:tasks.workunit.client.1.smithi143.stdout:5/521: creat d1/d46/df/d53/d74/d9a/d9c/fc6 x:0 0 0 2024-09-17T01:07:01.239 INFO:tasks.workunit.client.1.smithi143.stdout:5/522: unlink d1/d46/df/d23/f90 0 2024-09-17T01:07:01.240 INFO:tasks.workunit.client.1.smithi143.stdout:0/558: dread d3/d5/f84 [0,4194304] 0 2024-09-17T01:07:01.242 INFO:tasks.workunit.client.1.smithi143.stdout:5/523: mkdir d1/d46/df/d53/d74/dc7 0 2024-09-17T01:07:01.242 INFO:tasks.workunit.client.1.smithi143.stdout:0/559: read d3/d14/f61 [1015199,48612] 0 2024-09-17T01:07:01.247 INFO:tasks.workunit.client.1.smithi143.stdout:5/524: dwrite d1/d46/df/d23/fb0 [0,4194304] 0 2024-09-17T01:07:01.249 INFO:tasks.workunit.client.1.smithi143.stdout:0/560: truncate d3/d68/f70 2825746 0 2024-09-17T01:07:01.250 INFO:tasks.workunit.client.1.smithi143.stdout:5/525: creat d1/d46/df/d53/d74/d9a/d9c/fc8 x:0 0 0 2024-09-17T01:07:01.267 INFO:tasks.workunit.client.1.smithi143.stdout:0/561: truncate d3/d5/d8/d21/f42 2819793 0 2024-09-17T01:07:01.267 INFO:tasks.workunit.client.1.smithi143.stdout:5/526: dread d1/d46/df/d23/d4f/f1d [4194304,4194304] 0 2024-09-17T01:07:01.269 INFO:tasks.workunit.client.1.smithi143.stdout:5/527: mknod d1/d46/df/d1f/d66/d70/cc9 0 2024-09-17T01:07:01.270 INFO:tasks.workunit.client.1.smithi143.stdout:0/562: symlink d3/d5/d8/d10/db3/lbc 0 2024-09-17T01:07:01.271 INFO:tasks.workunit.client.1.smithi143.stdout:0/563: write d3/d5/d8/d10/f3a [236610,67925] 0 2024-09-17T01:07:01.276 INFO:tasks.workunit.client.1.smithi143.stdout:5/528: dwrite d1/d46/f79 [0,4194304] 0 2024-09-17T01:07:01.279 INFO:tasks.workunit.client.1.smithi143.stdout:0/564: read d3/d5/d8/d21/f42 [1423866,7013] 0 2024-09-17T01:07:01.281 INFO:tasks.workunit.client.1.smithi143.stdout:0/565: fdatasync d3/d68/f9d 0 2024-09-17T01:07:01.281 INFO:tasks.workunit.client.1.smithi143.stdout:5/529: rmdir d1/d46/df/d23/d4f/d7d/d92 39 2024-09-17T01:07:01.282 INFO:tasks.workunit.client.1.smithi143.stdout:0/566: chown d3/d5/d8/d27/d31/d4c/f1d 12701 1 2024-09-17T01:07:01.285 INFO:tasks.workunit.client.1.smithi143.stdout:0/567: symlink d3/d5/d8/d27/d8c/lbd 0 2024-09-17T01:07:01.286 INFO:tasks.workunit.client.1.smithi143.stdout:0/568: write d3/d88/d93/f98 [302235,9607] 0 2024-09-17T01:07:01.286 INFO:tasks.workunit.client.1.smithi143.stdout:5/530: getdents d1/d46/df/d23/d4f/d7d/d92 0 2024-09-17T01:07:01.288 INFO:tasks.workunit.client.1.smithi143.stdout:0/569: symlink d3/d5/d8/d21/d9b/lbe 0 2024-09-17T01:07:01.289 INFO:tasks.workunit.client.1.smithi143.stdout:0/570: chown d3/d5/d8/d21/d9b/dba 614 1 2024-09-17T01:07:01.290 INFO:tasks.workunit.client.1.smithi143.stdout:5/531: rename d1/d46/df/d23/l47 to d1/d46/df/d53/d74/d9a/d9c/lca 0 2024-09-17T01:07:01.291 INFO:tasks.workunit.client.1.smithi143.stdout:5/532: truncate d1/d46/d6e/fc3 419125 0 2024-09-17T01:07:01.293 INFO:tasks.workunit.client.1.smithi143.stdout:5/533: creat d1/fcb x:0 0 0 2024-09-17T01:07:01.354 INFO:tasks.workunit.client.1.smithi143.stdout:6/511: sync 2024-09-17T01:07:01.354 INFO:tasks.workunit.client.1.smithi143.stdout:8/577: sync 2024-09-17T01:07:01.354 INFO:tasks.workunit.client.1.smithi143.stdout:7/668: sync 2024-09-17T01:07:01.356 INFO:tasks.workunit.client.1.smithi143.stdout:7/669: mkdir d4/d1f/d4a/d9e/dd1 0 2024-09-17T01:07:01.361 INFO:tasks.workunit.client.1.smithi143.stdout:8/578: dwrite d9/d26/f3e [0,4194304] 0 2024-09-17T01:07:01.361 INFO:tasks.workunit.client.1.smithi143.stdout:6/512: truncate d2/d30/d45/d56/f60 2757496 0 2024-09-17T01:07:01.362 INFO:tasks.workunit.client.1.smithi143.stdout:8/579: chown d9/d2b 1 1 2024-09-17T01:07:01.363 INFO:tasks.workunit.client.1.smithi143.stdout:7/670: dwrite d4/d26/f76 [0,4194304] 0 2024-09-17T01:07:01.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:01 smithi103 ceph-mon[28156]: pgmap v11: 65 pgs: 65 active+clean; 764 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 81 MiB/s wr, 250 op/s 2024-09-17T01:07:01.427 INFO:tasks.workunit.client.1.smithi143.stdout:9/545: sync 2024-09-17T01:07:01.427 INFO:tasks.workunit.client.1.smithi143.stdout:1/602: sync 2024-09-17T01:07:01.428 INFO:tasks.workunit.client.1.smithi143.stdout:7/671: creat d4/d26/dcc/fd2 x:0 0 0 2024-09-17T01:07:01.431 INFO:tasks.workunit.client.1.smithi143.stdout:6/513: dwrite d2/d30/d45/f50 [0,4194304] 0 2024-09-17T01:07:01.435 INFO:tasks.workunit.client.1.smithi143.stdout:9/546: truncate d3/d39/d6a/d26/f3c 535338 0 2024-09-17T01:07:01.437 INFO:tasks.workunit.client.1.smithi143.stdout:6/514: chown d2/d17/d6e/d26/d46/d66/f88 1614 1 2024-09-17T01:07:01.438 INFO:tasks.workunit.client.1.smithi143.stdout:7/672: dwrite d4/d26/dcc/fd2 [0,4194304] 0 2024-09-17T01:07:01.440 INFO:tasks.workunit.client.1.smithi143.stdout:7/673: write d4/f82 [5412139,62268] 0 2024-09-17T01:07:01.441 INFO:tasks.workunit.client.1.smithi143.stdout:1/603: truncate d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a 1577012 0 2024-09-17T01:07:01.442 INFO:tasks.workunit.client.1.smithi143.stdout:7/674: write d4/d26/f76 [2892959,19627] 0 2024-09-17T01:07:01.442 INFO:tasks.workunit.client.1.smithi143.stdout:9/547: mkdir d3/d16/d3e/d51/d52/db3 0 2024-09-17T01:07:01.447 INFO:tasks.workunit.client.1.smithi143.stdout:1/604: creat d0/da1/fc6 x:0 0 0 2024-09-17T01:07:01.448 INFO:tasks.workunit.client.1.smithi143.stdout:7/675: creat d4/d1f/d29/d65/d5d/db1/fd3 x:0 0 0 2024-09-17T01:07:01.448 INFO:tasks.workunit.client.1.smithi143.stdout:1/605: truncate d0/dc/f38 8592409 0 2024-09-17T01:07:01.450 INFO:tasks.workunit.client.1.smithi143.stdout:1/606: dread d0/d6/d43/f67 [0,4194304] 0 2024-09-17T01:07:01.454 INFO:tasks.workunit.client.1.smithi143.stdout:1/607: creat d0/d6/d43/d47/d72/fc7 x:0 0 0 2024-09-17T01:07:01.457 INFO:tasks.workunit.client.1.smithi143.stdout:1/608: getdents d0/d6/d43/d6a/df/d6e/d2 0 2024-09-17T01:07:01.458 INFO:tasks.workunit.client.0.smithi103.stdout:2/7: sync 2024-09-17T01:07:01.459 INFO:tasks.workunit.client.1.smithi143.stdout:1/609: symlink d0/d6/d43/d6a/df/d6e/d18/d2d/dab/lc8 0 2024-09-17T01:07:01.461 INFO:tasks.workunit.client.1.smithi143.stdout:1/610: write d0/d6/d43/d47/d68/d7b/f9f [4589167,25304] 0 2024-09-17T01:07:01.461 INFO:tasks.workunit.client.0.smithi103.stdout:2/8: creat f0 x:0 0 0 2024-09-17T01:07:01.461 INFO:tasks.workunit.client.0.smithi103.stdout:2/9: dread - f0 zero size 2024-09-17T01:07:01.463 INFO:tasks.workunit.client.0.smithi103.stdout:2/10: mknod c1 0 2024-09-17T01:07:01.467 INFO:tasks.workunit.client.0.smithi103.stdout:2/11: symlink l2 0 2024-09-17T01:07:01.467 INFO:tasks.workunit.client.0.smithi103.stdout:2/12: readlink l2 0 2024-09-17T01:07:01.469 INFO:tasks.workunit.client.0.smithi103.stdout:2/13: creat f3 x:0 0 0 2024-09-17T01:07:01.473 INFO:tasks.workunit.client.0.smithi103.stdout:2/14: link f3 f4 0 2024-09-17T01:07:01.473 INFO:tasks.workunit.client.1.smithi143.stdout:9/548: dread d3/f8 [0,4194304] 0 2024-09-17T01:07:01.475 INFO:tasks.workunit.client.0.smithi103.stdout:2/15: creat f5 x:0 0 0 2024-09-17T01:07:01.476 INFO:tasks.workunit.client.1.smithi143.stdout:7/676: dread d4/f82 [4194304,4194304] 0 2024-09-17T01:07:01.477 INFO:tasks.workunit.client.1.smithi143.stdout:9/549: rename d3/d16/fa9 to d3/d39/d42/d58/d5a/d5e/fb4 0 2024-09-17T01:07:01.478 INFO:tasks.workunit.client.0.smithi103.stdout:2/16: write f3 [996848,48155] 0 2024-09-17T01:07:01.479 INFO:tasks.workunit.client.1.smithi143.stdout:7/677: mknod d4/d1f/d4a/d66/d86/cd4 0 2024-09-17T01:07:01.480 INFO:tasks.workunit.client.0.smithi103.stdout:2/17: mkdir d6 0 2024-09-17T01:07:01.481 INFO:tasks.workunit.client.1.smithi143.stdout:7/678: dread - d4/d1f/d29/f71 zero size 2024-09-17T01:07:01.482 INFO:tasks.workunit.client.1.smithi143.stdout:9/550: dread d3/d39/d42/d58/d5a/d5e/d99/f5b [0,4194304] 0 2024-09-17T01:07:01.482 INFO:tasks.workunit.client.1.smithi143.stdout:7/679: write d4/d16/d97/fbf [160015,242] 0 2024-09-17T01:07:01.484 INFO:tasks.workunit.client.1.smithi143.stdout:7/680: fdatasync d4/fd0 0 2024-09-17T01:07:01.487 INFO:tasks.workunit.client.1.smithi143.stdout:1/611: dread d0/d6/d43/d6a/f42 [0,4194304] 0 2024-09-17T01:07:01.489 INFO:tasks.workunit.client.1.smithi143.stdout:7/681: symlink d4/d1f/d4a/ld5 0 2024-09-17T01:07:01.490 INFO:tasks.workunit.client.1.smithi143.stdout:1/612: creat d0/d6/d43/d6a/d8f/fc9 x:0 0 0 2024-09-17T01:07:01.491 INFO:tasks.workunit.client.0.smithi103.stdout:2/18: dwrite f4 [0,4194304] 0 2024-09-17T01:07:01.493 INFO:tasks.workunit.client.1.smithi143.stdout:7/682: rename d4/d26/cc5 to d4/d33/cd6 0 2024-09-17T01:07:01.493 INFO:tasks.workunit.client.1.smithi143.stdout:1/613: mkdir d0/dc/dca 0 2024-09-17T01:07:01.495 INFO:tasks.workunit.client.1.smithi143.stdout:9/551: dwrite d3/d39/d6a/d9/f37 [0,4194304] 0 2024-09-17T01:07:01.499 INFO:tasks.workunit.client.0.smithi103.stdout:2/19: link f3 d6/f7 0 2024-09-17T01:07:01.500 INFO:tasks.workunit.client.1.smithi143.stdout:7/683: truncate d4/d1f/d29/d65/d5d/f51 3021050 0 2024-09-17T01:07:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:01 smithi143 ceph-mon[35452]: pgmap v11: 65 pgs: 65 active+clean; 764 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 81 MiB/s wr, 250 op/s 2024-09-17T01:07:01.508 INFO:tasks.workunit.client.1.smithi143.stdout:9/552: getdents d3/d16/d3e/d51 0 2024-09-17T01:07:01.509 INFO:tasks.workunit.client.1.smithi143.stdout:7/684: link d4/d1f/f68 d4/d33/fd7 0 2024-09-17T01:07:01.512 INFO:tasks.workunit.client.1.smithi143.stdout:9/553: creat d3/d39/d6a/d26/fb5 x:0 0 0 2024-09-17T01:07:01.513 INFO:tasks.workunit.client.0.smithi103.stdout:2/20: fdatasync f4 0 2024-09-17T01:07:01.513 INFO:tasks.workunit.client.0.smithi103.stdout:2/21: fsync f3 0 2024-09-17T01:07:01.515 INFO:tasks.workunit.client.1.smithi143.stdout:9/554: creat d3/d39/d42/d58/d5a/fb6 x:0 0 0 2024-09-17T01:07:01.515 INFO:tasks.workunit.client.1.smithi143.stdout:7/685: dwrite d4/f44 [0,4194304] 0 2024-09-17T01:07:01.517 INFO:tasks.workunit.client.0.smithi103.stdout:2/22: creat d6/f8 x:0 0 0 2024-09-17T01:07:01.518 INFO:tasks.workunit.client.1.smithi143.stdout:1/614: truncate d0/d6/d43/d6a/df/d27/f2e 6362820 0 2024-09-17T01:07:01.518 INFO:tasks.workunit.client.1.smithi143.stdout:9/555: truncate d3/d39/d6a/fc 1862365 0 2024-09-17T01:07:01.521 INFO:tasks.workunit.client.0.smithi103.stdout:2/23: rename f3 to d6/f9 0 2024-09-17T01:07:01.522 INFO:tasks.workunit.client.1.smithi143.stdout:4/510: sync 2024-09-17T01:07:01.522 INFO:tasks.workunit.client.1.smithi143.stdout:2/546: sync 2024-09-17T01:07:01.523 INFO:tasks.workunit.client.1.smithi143.stdout:1/615: unlink d0/d6/d43/d6a/df/d6e/f1d 0 2024-09-17T01:07:01.524 INFO:tasks.workunit.client.1.smithi143.stdout:1/616: chown d0/d6/d43/d6a/d52/db2 878 1 2024-09-17T01:07:01.526 INFO:tasks.workunit.client.0.smithi103.stdout:2/24: mkdir d6/da 0 2024-09-17T01:07:01.526 INFO:tasks.workunit.client.0.smithi103.stdout:9/64: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:8/8: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:8/9: write - no filename 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:0/50: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:3/50: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:5/0: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:5/1: readlink - no filename 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:5/2: link - no file 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:4/17: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:1/51: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:2/25: dread - f0 zero size 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:7/75: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:6/13: sync 2024-09-17T01:07:01.527 INFO:tasks.workunit.client.0.smithi103.stdout:5/3: chown . 91073935 1 2024-09-17T01:07:01.528 INFO:tasks.workunit.client.1.smithi143.stdout:9/556: mkdir d3/d16/d3e/d51/db7 0 2024-09-17T01:07:01.528 INFO:tasks.workunit.client.1.smithi143.stdout:9/557: fsync d3/d3d/d48/f59 0 2024-09-17T01:07:01.528 INFO:tasks.workunit.client.0.smithi103.stdout:3/51: chown d3/cb 2354 1 2024-09-17T01:07:01.531 INFO:tasks.workunit.client.0.smithi103.stdout:6/14: rmdir d3 39 2024-09-17T01:07:01.533 INFO:tasks.workunit.client.1.smithi143.stdout:4/511: mkdir da/d3a/d3e/d72/d9e/da1 0 2024-09-17T01:07:01.534 INFO:tasks.workunit.client.1.smithi143.stdout:4/512: dread - da/f73 zero size 2024-09-17T01:07:01.537 INFO:tasks.workunit.client.0.smithi103.stdout:7/76: dread - d4/d11/f19 zero size 2024-09-17T01:07:01.537 INFO:tasks.workunit.client.1.smithi143.stdout:7/686: dread d4/d1f/d29/d65/f7c [0,4194304] 0 2024-09-17T01:07:01.538 INFO:tasks.workunit.client.1.smithi143.stdout:7/687: chown d4/d16/dbd/fc9 38718062 1 2024-09-17T01:07:01.538 INFO:tasks.workunit.client.0.smithi103.stdout:3/52: mknod d3/c11 0 2024-09-17T01:07:01.539 INFO:tasks.workunit.client.1.smithi143.stdout:7/688: chown d4/d1f/d29/d65/d5d 1 1 2024-09-17T01:07:01.539 INFO:tasks.workunit.client.0.smithi103.stdout:3/53: chown d3/f7 1756218 1 2024-09-17T01:07:01.540 INFO:tasks.workunit.client.1.smithi143.stdout:7/689: write d4/d1f/d29/d65/f7c [1193334,30290] 0 2024-09-17T01:07:01.541 INFO:tasks.workunit.client.1.smithi143.stdout:7/690: write d4/d1f/f73 [917994,25327] 0 2024-09-17T01:07:01.541 INFO:tasks.workunit.client.1.smithi143.stdout:7/691: chown d4/d26 2195 1 2024-09-17T01:07:01.543 INFO:tasks.workunit.client.0.smithi103.stdout:2/26: dwrite d6/f8 [0,4194304] 0 2024-09-17T01:07:01.544 INFO:tasks.workunit.client.0.smithi103.stdout:4/18: dwrite f3 [0,4194304] 0 2024-09-17T01:07:01.545 INFO:tasks.workunit.client.0.smithi103.stdout:4/19: stat f3 0 2024-09-17T01:07:01.545 INFO:tasks.workunit.client.1.smithi143.stdout:2/547: getdents d0 0 2024-09-17T01:07:01.546 INFO:tasks.workunit.client.0.smithi103.stdout:4/20: truncate f3 5198100 0 2024-09-17T01:07:01.546 INFO:tasks.workunit.client.1.smithi143.stdout:2/548: truncate d0/d2/faa 316413 0 2024-09-17T01:07:01.548 INFO:tasks.workunit.client.1.smithi143.stdout:4/513: rename da/f1d to da/d3a/d3e/d5e/fa2 0 2024-09-17T01:07:01.549 INFO:tasks.workunit.client.1.smithi143.stdout:4/514: write da/d3a/d40/f27 [414677,106874] 0 2024-09-17T01:07:01.550 INFO:tasks.workunit.client.0.smithi103.stdout:1/52: write d2/f6 [2978405,112506] 0 2024-09-17T01:07:01.555 INFO:tasks.workunit.client.0.smithi103.stdout:1/53: dread d2/f6 [0,4194304] 0 2024-09-17T01:07:01.557 INFO:tasks.workunit.client.0.smithi103.stdout:5/4: creat f0 x:0 0 0 2024-09-17T01:07:01.559 INFO:tasks.workunit.client.1.smithi143.stdout:7/692: creat d4/d1f/d4a/d66/d86/fd8 x:0 0 0 2024-09-17T01:07:01.560 INFO:tasks.workunit.client.1.smithi143.stdout:2/549: unlink d0/c53 0 2024-09-17T01:07:01.562 INFO:tasks.workunit.client.0.smithi103.stdout:3/54: symlink d3/l12 0 2024-09-17T01:07:01.563 INFO:tasks.workunit.client.1.smithi143.stdout:4/515: chown da/d3a/d40/d84/c52 8293526 1 2024-09-17T01:07:01.563 INFO:tasks.workunit.client.1.smithi143.stdout:4/516: chown da/d68/c7e 1 1 2024-09-17T01:07:01.564 INFO:tasks.workunit.client.1.smithi143.stdout:4/517: write da/d3a/f51 [287391,121953] 0 2024-09-17T01:07:01.565 INFO:tasks.workunit.client.1.smithi143.stdout:4/518: chown da/d3a/d40/l6c 227620 1 2024-09-17T01:07:01.566 INFO:tasks.workunit.client.1.smithi143.stdout:4/519: chown da/d3a/d3e/d5e/f62 75 1 2024-09-17T01:07:01.567 INFO:tasks.workunit.client.0.smithi103.stdout:8/10: rmdir d0/d1 0 2024-09-17T01:07:01.567 INFO:tasks.workunit.client.0.smithi103.stdout:8/11: dread - no filename 2024-09-17T01:07:01.567 INFO:tasks.workunit.client.0.smithi103.stdout:8/12: dread - no filename 2024-09-17T01:07:01.568 INFO:tasks.workunit.client.1.smithi143.stdout:7/693: write d4/d1f/f30 [7506576,22702] 0 2024-09-17T01:07:01.569 INFO:tasks.workunit.client.1.smithi143.stdout:9/558: link d3/d16/l2f d3/d39/d6a/lb8 0 2024-09-17T01:07:01.570 INFO:tasks.workunit.client.1.smithi143.stdout:7/694: write d4/d1f/d4a/d66/d86/fd8 [944378,115143] 0 2024-09-17T01:07:01.572 INFO:tasks.workunit.client.0.smithi103.stdout:6/15: truncate d3/f4 81418 0 2024-09-17T01:07:01.574 INFO:tasks.workunit.client.0.smithi103.stdout:1/54: creat d2/ff x:0 0 0 2024-09-17T01:07:01.575 INFO:tasks.workunit.client.1.smithi143.stdout:4/520: mkdir da/d3a/d3e/d72/da3 0 2024-09-17T01:07:01.575 INFO:tasks.workunit.client.1.smithi143.stdout:4/521: chown da/d3a/f59 460 1 2024-09-17T01:07:01.577 INFO:tasks.workunit.client.0.smithi103.stdout:5/5: symlink l1 0 2024-09-17T01:07:01.577 INFO:tasks.workunit.client.0.smithi103.stdout:5/6: rmdir - no directory 2024-09-17T01:07:01.577 INFO:tasks.workunit.client.0.smithi103.stdout:5/7: rmdir - no directory 2024-09-17T01:07:01.578 INFO:tasks.workunit.client.0.smithi103.stdout:2/27: dwrite d6/f8 [4194304,4194304] 0 2024-09-17T01:07:01.579 INFO:tasks.workunit.client.0.smithi103.stdout:5/8: chown l1 31 1 2024-09-17T01:07:01.582 INFO:tasks.workunit.client.0.smithi103.stdout:8/13: mkdir d0/d2 0 2024-09-17T01:07:01.582 INFO:tasks.workunit.client.0.smithi103.stdout:8/14: unlink - no file 2024-09-17T01:07:01.582 INFO:tasks.workunit.client.0.smithi103.stdout:8/15: fdatasync - no filename 2024-09-17T01:07:01.582 INFO:tasks.workunit.client.0.smithi103.stdout:5/9: write f0 [112605,81217] 0 2024-09-17T01:07:01.583 INFO:tasks.workunit.client.1.smithi143.stdout:2/550: chown d0/d44/f46 4280354 1 2024-09-17T01:07:01.584 INFO:tasks.workunit.client.1.smithi143.stdout:1/617: truncate d0/d6/d43/d6a/df/d27/f2e 4061156 0 2024-09-17T01:07:01.586 INFO:tasks.workunit.client.0.smithi103.stdout:1/55: dwrite d2/ff [0,4194304] 0 2024-09-17T01:07:01.588 INFO:tasks.workunit.client.1.smithi143.stdout:7/695: creat d4/d1f/d4a/dc1/fd9 x:0 0 0 2024-09-17T01:07:01.589 INFO:tasks.workunit.client.0.smithi103.stdout:5/10: dread f0 [0,4194304] 0 2024-09-17T01:07:01.589 INFO:tasks.workunit.client.0.smithi103.stdout:1/56: chown d2/d7/la 300331 1 2024-09-17T01:07:01.589 INFO:tasks.workunit.client.0.smithi103.stdout:7/77: dwrite d4/f5 [0,4194304] 0 2024-09-17T01:07:01.592 INFO:tasks.workunit.client.0.smithi103.stdout:7/78: chown d4/d10/l1b 217558 1 2024-09-17T01:07:01.592 INFO:tasks.workunit.client.1.smithi143.stdout:0/571: sync 2024-09-17T01:07:01.592 INFO:tasks.workunit.client.1.smithi143.stdout:3/562: sync 2024-09-17T01:07:01.594 INFO:tasks.workunit.client.1.smithi143.stdout:0/572: write d3/d5/d8/d21/d2e/f91 [4841146,114115] 0 2024-09-17T01:07:01.596 INFO:tasks.workunit.client.1.smithi143.stdout:0/573: read d3/d5/f29 [930913,11133] 0 2024-09-17T01:07:01.598 INFO:tasks.workunit.client.0.smithi103.stdout:2/28: write d6/f7 [34570,12045] 0 2024-09-17T01:07:01.598 INFO:tasks.workunit.client.0.smithi103.stdout:6/16: dread f1 [0,4194304] 0 2024-09-17T01:07:01.599 INFO:tasks.workunit.client.0.smithi103.stdout:2/29: stat l2 0 2024-09-17T01:07:01.601 INFO:tasks.workunit.client.1.smithi143.stdout:7/696: mknod d4/d1f/d4a/d9e/cda 0 2024-09-17T01:07:01.603 INFO:tasks.workunit.client.0.smithi103.stdout:8/16: mkdir d0/d3 0 2024-09-17T01:07:01.603 INFO:tasks.workunit.client.1.smithi143.stdout:9/559: link d3/d39/d6a/d26/l35 d3/d39/d42/d58/d5a/d5e/lb9 0 2024-09-17T01:07:01.605 INFO:tasks.workunit.client.1.smithi143.stdout:3/563: creat d6/d1c/d33/d3f/fb4 x:0 0 0 2024-09-17T01:07:01.605 INFO:tasks.workunit.client.0.smithi103.stdout:2/30: dread d6/f7 [0,4194304] 0 2024-09-17T01:07:01.606 INFO:tasks.workunit.client.1.smithi143.stdout:3/564: chown d6/cb3 39 1 2024-09-17T01:07:01.606 INFO:tasks.workunit.client.0.smithi103.stdout:2/31: write f5 [507576,119679] 0 2024-09-17T01:07:01.607 INFO:tasks.workunit.client.1.smithi143.stdout:3/565: write d6/d1c/d33/d3f/d79/f9a [1181117,45687] 0 2024-09-17T01:07:01.608 INFO:tasks.workunit.client.0.smithi103.stdout:7/79: mknod d4/d11/c21 0 2024-09-17T01:07:01.608 INFO:tasks.workunit.client.1.smithi143.stdout:3/566: truncate d6/fa 4137391 0 2024-09-17T01:07:01.611 INFO:tasks.workunit.client.1.smithi143.stdout:1/618: mknod d0/dc/d57/ccb 0 2024-09-17T01:07:01.612 INFO:tasks.workunit.client.1.smithi143.stdout:3/567: dread d6/f58 [0,4194304] 0 2024-09-17T01:07:01.614 INFO:tasks.workunit.client.1.smithi143.stdout:4/522: dread da/d3a/d40/f34 [0,4194304] 0 2024-09-17T01:07:01.614 INFO:tasks.workunit.client.1.smithi143.stdout:9/560: readlink d3/d16/l2f 0 2024-09-17T01:07:01.615 INFO:tasks.workunit.client.1.smithi143.stdout:4/523: write da/d75/f88 [296117,36192] 0 2024-09-17T01:07:01.617 INFO:tasks.workunit.client.1.smithi143.stdout:2/551: symlink d0/d10/d58/d5a/d5b/d4c/lac 0 2024-09-17T01:07:01.618 INFO:tasks.workunit.client.1.smithi143.stdout:2/552: stat d0/d10/d58/d5a/d5b/d4c/d77/f9b 0 2024-09-17T01:07:01.619 INFO:tasks.workunit.client.1.smithi143.stdout:0/574: mknod d3/d5/cbf 0 2024-09-17T01:07:01.621 INFO:tasks.workunit.client.1.smithi143.stdout:7/697: mkdir d4/d1f/d4a/ddb 0 2024-09-17T01:07:01.622 INFO:tasks.workunit.client.1.smithi143.stdout:7/698: read - d4/d16/d97/fa6 zero size 2024-09-17T01:07:01.622 INFO:tasks.workunit.client.0.smithi103.stdout:4/21: getdents . 0 2024-09-17T01:07:01.622 INFO:tasks.workunit.client.1.smithi143.stdout:7/699: write d4/d1f/d4a/fa0 [975036,1493] 0 2024-09-17T01:07:01.625 INFO:tasks.workunit.client.1.smithi143.stdout:1/619: dread d0/d6/d43/d6a/df/d6e/d18/f3e [0,4194304] 0 2024-09-17T01:07:01.625 INFO:tasks.workunit.client.0.smithi103.stdout:7/80: symlink d4/l22 0 2024-09-17T01:07:01.626 INFO:tasks.workunit.client.1.smithi143.stdout:1/620: write d0/d6/d43/d6d/fbc [347245,75258] 0 2024-09-17T01:07:01.627 INFO:tasks.workunit.client.0.smithi103.stdout:3/55: getdents d3 0 2024-09-17T01:07:01.628 INFO:tasks.workunit.client.1.smithi143.stdout:4/524: creat da/d6d/fa4 x:0 0 0 2024-09-17T01:07:01.629 INFO:tasks.workunit.client.1.smithi143.stdout:4/525: write da/d3a/d40/d84/f43 [60629,105569] 0 2024-09-17T01:07:01.631 INFO:tasks.workunit.client.1.smithi143.stdout:9/561: rename d3/d39/d6a/lb8 to d3/d39/d42/d58/d5a/d5e/lba 0 2024-09-17T01:07:01.632 INFO:tasks.workunit.client.1.smithi143.stdout:9/562: read - d3/d39/d42/d58/d5a/fb6 zero size 2024-09-17T01:07:01.633 INFO:tasks.workunit.client.0.smithi103.stdout:7/81: dwrite d4/f5 [0,4194304] 0 2024-09-17T01:07:01.634 INFO:tasks.workunit.client.1.smithi143.stdout:1/621: dread d0/dc/d89/f95 [0,4194304] 0 2024-09-17T01:07:01.635 INFO:tasks.workunit.client.1.smithi143.stdout:5/534: sync 2024-09-17T01:07:01.635 INFO:tasks.workunit.client.1.smithi143.stdout:6/515: sync 2024-09-17T01:07:01.635 INFO:tasks.workunit.client.1.smithi143.stdout:8/580: sync 2024-09-17T01:07:01.636 INFO:tasks.workunit.client.1.smithi143.stdout:0/575: rmdir d3/d68 39 2024-09-17T01:07:01.641 INFO:tasks.workunit.client.1.smithi143.stdout:7/700: truncate d4/d1f/f63 432941 0 2024-09-17T01:07:01.642 INFO:tasks.workunit.client.0.smithi103.stdout:4/22: creat f5 x:0 0 0 2024-09-17T01:07:01.643 INFO:tasks.workunit.client.0.smithi103.stdout:5/11: link l1 l2 0 2024-09-17T01:07:01.648 INFO:tasks.workunit.client.1.smithi143.stdout:2/553: dread d0/d2/fe [0,4194304] 0 2024-09-17T01:07:01.648 INFO:tasks.workunit.client.0.smithi103.stdout:4/23: dread f3 [0,4194304] 0 2024-09-17T01:07:01.650 INFO:tasks.workunit.client.1.smithi143.stdout:4/526: rename da/d3a/d3e/d4a/d8a/f93 to da/d3a/d3e/d72/da3/fa5 0 2024-09-17T01:07:01.650 INFO:tasks.workunit.client.0.smithi103.stdout:4/24: write f5 [836053,11819] 0 2024-09-17T01:07:01.652 INFO:tasks.workunit.client.0.smithi103.stdout:6/17: dwrite f2 [0,4194304] 0 2024-09-17T01:07:01.657 INFO:tasks.workunit.client.0.smithi103.stdout:8/17: rmdir d0/d2 0 2024-09-17T01:07:01.657 INFO:tasks.workunit.client.0.smithi103.stdout:8/18: dwrite - no filename 2024-09-17T01:07:01.657 INFO:tasks.workunit.client.0.smithi103.stdout:8/19: readlink - no filename 2024-09-17T01:07:01.658 INFO:tasks.workunit.client.0.smithi103.stdout:8/20: dread - no filename 2024-09-17T01:07:01.658 INFO:tasks.workunit.client.0.smithi103.stdout:8/21: truncate - no filename 2024-09-17T01:07:01.661 INFO:tasks.workunit.client.1.smithi143.stdout:8/581: symlink d9/d23/db4/d55/d57/d9d/lcb 0 2024-09-17T01:07:01.661 INFO:tasks.workunit.client.0.smithi103.stdout:4/25: dwrite f3 [0,4194304] 0 2024-09-17T01:07:01.662 INFO:tasks.workunit.client.0.smithi103.stdout:5/12: fsync f0 0 2024-09-17T01:07:01.664 INFO:tasks.workunit.client.1.smithi143.stdout:6/516: fsync d2/d17/d3a/f51 0 2024-09-17T01:07:01.666 INFO:tasks.workunit.client.0.smithi103.stdout:1/57: getdents d2/d7 0 2024-09-17T01:07:01.667 INFO:tasks.workunit.client.1.smithi143.stdout:0/576: symlink d3/d5/d8/d27/d31/d4c/d65/lc0 0 2024-09-17T01:07:01.667 INFO:tasks.workunit.client.0.smithi103.stdout:3/56: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:07:01.668 INFO:tasks.workunit.client.1.smithi143.stdout:0/577: stat d3/d5/d8/d27/d31/d48/c67 0 2024-09-17T01:07:01.669 INFO:tasks.workunit.client.1.smithi143.stdout:0/578: write d3/d5/d8/d27/f1e [262549,114722] 0 2024-09-17T01:07:01.670 INFO:tasks.workunit.client.1.smithi143.stdout:0/579: readlink d3/d5/d8/d10/l2f 0 2024-09-17T01:07:01.670 INFO:tasks.workunit.client.1.smithi143.stdout:7/701: creat d4/d33/d4e/fdc x:0 0 0 2024-09-17T01:07:01.671 INFO:tasks.workunit.client.1.smithi143.stdout:0/580: fsync d3/d5/d8/d21/f47 0 2024-09-17T01:07:01.672 INFO:tasks.workunit.client.1.smithi143.stdout:7/702: fdatasync d4/d16/f17 0 2024-09-17T01:07:01.673 INFO:tasks.workunit.client.1.smithi143.stdout:0/581: chown d3/d5/d8/d10/f25 3961563 1 2024-09-17T01:07:01.673 INFO:tasks.workunit.client.0.smithi103.stdout:6/18: fsync f2 0 2024-09-17T01:07:01.674 INFO:tasks.workunit.client.1.smithi143.stdout:0/582: stat d3/d5/d8/d21 0 2024-09-17T01:07:01.674 INFO:tasks.workunit.client.0.smithi103.stdout:7/82: dwrite d4/fd [0,4194304] 0 2024-09-17T01:07:01.674 INFO:tasks.workunit.client.0.smithi103.stdout:6/19: rename d3 to d3/d7 22 2024-09-17T01:07:01.675 INFO:tasks.workunit.client.0.smithi103.stdout:7/83: fsync d4/f5 0 2024-09-17T01:07:01.676 INFO:tasks.workunit.client.1.smithi143.stdout:3/568: creat d6/d1c/d33/fb5 x:0 0 0 2024-09-17T01:07:01.679 INFO:tasks.workunit.client.0.smithi103.stdout:8/22: mkdir d0/d4 0 2024-09-17T01:07:01.679 INFO:tasks.workunit.client.0.smithi103.stdout:8/23: write - no filename 2024-09-17T01:07:01.679 INFO:tasks.workunit.client.0.smithi103.stdout:8/24: dread - no filename 2024-09-17T01:07:01.679 INFO:tasks.workunit.client.0.smithi103.stdout:8/25: write - no filename 2024-09-17T01:07:01.681 INFO:tasks.workunit.client.0.smithi103.stdout:4/26: write f3 [255431,111911] 0 2024-09-17T01:07:01.682 INFO:tasks.workunit.client.1.smithi143.stdout:3/569: dread d6/d1c/d33/d41/d2e/d30/f6c [0,4194304] 0 2024-09-17T01:07:01.683 INFO:tasks.workunit.client.1.smithi143.stdout:3/570: chown d6/d1c/d4b/l56 58 1 2024-09-17T01:07:01.683 INFO:tasks.workunit.client.0.smithi103.stdout:5/13: fdatasync f0 0 2024-09-17T01:07:01.684 INFO:tasks.workunit.client.0.smithi103.stdout:3/57: symlink d3/l13 0 2024-09-17T01:07:01.685 INFO:tasks.workunit.client.0.smithi103.stdout:1/58: mknod d2/d7/c10 0 2024-09-17T01:07:01.691 INFO:tasks.workunit.client.0.smithi103.stdout:5/14: creat f3 x:0 0 0 2024-09-17T01:07:01.692 INFO:tasks.workunit.client.1.smithi143.stdout:2/554: fdatasync d0/f9c 0 2024-09-17T01:07:01.692 INFO:tasks.workunit.client.0.smithi103.stdout:5/15: fsync f0 0 2024-09-17T01:07:01.694 INFO:tasks.workunit.client.0.smithi103.stdout:3/58: creat d3/f14 x:0 0 0 2024-09-17T01:07:01.696 INFO:tasks.workunit.client.1.smithi143.stdout:5/535: creat d1/d46/df/d23/fcc x:0 0 0 2024-09-17T01:07:01.697 INFO:tasks.workunit.client.1.smithi143.stdout:9/563: truncate d3/f8 1173106 0 2024-09-17T01:07:01.697 INFO:tasks.workunit.client.1.smithi143.stdout:5/536: readlink d1/d46/df/d1f/d9f/la8 0 2024-09-17T01:07:01.698 INFO:tasks.workunit.client.1.smithi143.stdout:9/564: fsync d3/d39/f4b 0 2024-09-17T01:07:01.698 INFO:tasks.workunit.client.1.smithi143.stdout:5/537: fdatasync d1/d46/d6e/da0/fbf 0 2024-09-17T01:07:01.699 INFO:tasks.workunit.client.1.smithi143.stdout:6/517: symlink d2/d17/l9f 0 2024-09-17T01:07:01.701 INFO:tasks.workunit.client.1.smithi143.stdout:7/703: mknod d4/d1f/d4a/d66/db5/cdd 0 2024-09-17T01:07:01.701 INFO:tasks.workunit.client.0.smithi103.stdout:5/16: creat f4 x:0 0 0 2024-09-17T01:07:01.702 INFO:tasks.workunit.client.0.smithi103.stdout:5/17: chown l2 6116 1 2024-09-17T01:07:01.702 INFO:tasks.workunit.client.1.smithi143.stdout:0/583: write d3/d5/d8/d21/f42 [896550,22562] 0 2024-09-17T01:07:01.703 INFO:tasks.workunit.client.0.smithi103.stdout:3/59: creat d3/f15 x:0 0 0 2024-09-17T01:07:01.703 INFO:tasks.workunit.client.0.smithi103.stdout:5/18: dread f0 [0,4194304] 0 2024-09-17T01:07:01.704 INFO:tasks.workunit.client.0.smithi103.stdout:5/19: truncate f3 34559 0 2024-09-17T01:07:01.705 INFO:tasks.workunit.client.1.smithi143.stdout:1/622: rename d0/d6/d43/d47/d88/da5/db9 to d0/d6/d43/dcc 0 2024-09-17T01:07:01.705 INFO:tasks.workunit.client.1.smithi143.stdout:3/571: dread d6/d1c/d33/d41/f1a [0,4194304] 0 2024-09-17T01:07:01.707 INFO:tasks.workunit.client.0.smithi103.stdout:6/20: rmdir d3/d6 0 2024-09-17T01:07:01.707 INFO:tasks.workunit.client.1.smithi143.stdout:3/572: chown d6/d1c/l6e 11630318 1 2024-09-17T01:07:01.708 INFO:tasks.workunit.client.1.smithi143.stdout:9/565: dread d3/d39/d42/d58/d5a/d5e/d99/f9d [0,4194304] 0 2024-09-17T01:07:01.708 INFO:tasks.workunit.client.0.smithi103.stdout:6/21: read d3/f4 [3096221,70409] 0 2024-09-17T01:07:01.711 INFO:tasks.workunit.client.0.smithi103.stdout:6/22: dread f2 [0,4194304] 0 2024-09-17T01:07:01.712 INFO:tasks.workunit.client.0.smithi103.stdout:3/60: mkdir d3/d16 0 2024-09-17T01:07:01.712 INFO:tasks.workunit.client.0.smithi103.stdout:4/27: fsync f3 0 2024-09-17T01:07:01.714 INFO:tasks.workunit.client.0.smithi103.stdout:4/28: write f3 [3692351,31823] 0 2024-09-17T01:07:01.714 INFO:tasks.workunit.client.1.smithi143.stdout:5/538: unlink d1/d46/df/d23/f4a 0 2024-09-17T01:07:01.716 INFO:tasks.workunit.client.0.smithi103.stdout:5/20: symlink l5 0 2024-09-17T01:07:01.717 INFO:tasks.workunit.client.1.smithi143.stdout:6/518: creat d2/df/d18/fa0 x:0 0 0 2024-09-17T01:07:01.719 INFO:tasks.workunit.client.0.smithi103.stdout:7/84: getdents d4 0 2024-09-17T01:07:01.721 INFO:tasks.workunit.client.0.smithi103.stdout:6/23: dread d3/f4 [0,4194304] 0 2024-09-17T01:07:01.722 INFO:tasks.workunit.client.0.smithi103.stdout:7/85: truncate d4/d11/f18 1048246 0 2024-09-17T01:07:01.723 INFO:tasks.workunit.client.0.smithi103.stdout:4/29: dwrite f5 [0,4194304] 0 2024-09-17T01:07:01.723 INFO:tasks.workunit.client.1.smithi143.stdout:0/584: creat d3/d14/d3d/fc1 x:0 0 0 2024-09-17T01:07:01.724 INFO:tasks.workunit.client.0.smithi103.stdout:5/21: mkdir d6 0 2024-09-17T01:07:01.725 INFO:tasks.workunit.client.0.smithi103.stdout:5/22: fsync f0 0 2024-09-17T01:07:01.726 INFO:tasks.workunit.client.0.smithi103.stdout:3/61: mknod d3/d16/c17 0 2024-09-17T01:07:01.728 INFO:tasks.workunit.client.1.smithi143.stdout:2/555: rename d0/d2/c25 to d0/d2/d21/d84/cad 0 2024-09-17T01:07:01.732 INFO:tasks.workunit.client.1.smithi143.stdout:4/527: getdents da/d3a/d3e/d72 0 2024-09-17T01:07:01.733 INFO:tasks.workunit.client.1.smithi143.stdout:3/573: unlink d6/d1c/d33/f8d 0 2024-09-17T01:07:01.733 INFO:tasks.workunit.client.1.smithi143.stdout:8/582: link d9/d12/d38/f9f d9/d2b/fcc 0 2024-09-17T01:07:01.735 INFO:tasks.workunit.client.0.smithi103.stdout:5/23: symlink d6/l7 0 2024-09-17T01:07:01.736 INFO:tasks.workunit.client.1.smithi143.stdout:6/519: creat d2/d17/d6e/d26/d46/d65/fa1 x:0 0 0 2024-09-17T01:07:01.738 INFO:tasks.workunit.client.0.smithi103.stdout:5/24: creat d6/f8 x:0 0 0 2024-09-17T01:07:01.739 INFO:tasks.workunit.client.1.smithi143.stdout:0/585: creat d3/d5/d8/d10/fc2 x:0 0 0 2024-09-17T01:07:01.740 INFO:tasks.workunit.client.1.smithi143.stdout:6/520: dread d2/d30/d45/f50 [0,4194304] 0 2024-09-17T01:07:01.740 INFO:tasks.workunit.client.1.smithi143.stdout:0/586: fsync d3/d5/d8/d21/f3e 0 2024-09-17T01:07:01.741 INFO:tasks.workunit.client.1.smithi143.stdout:7/704: link d4/d1f/d4a/d66/d86/fd8 d4/d33/d4e/d9f/fde 0 2024-09-17T01:07:01.741 INFO:tasks.workunit.client.0.smithi103.stdout:5/25: creat d6/f9 x:0 0 0 2024-09-17T01:07:01.741 INFO:tasks.workunit.client.0.smithi103.stdout:5/26: readlink l2 0 2024-09-17T01:07:01.742 INFO:tasks.workunit.client.1.smithi143.stdout:6/521: write d2/df/d20/d2c/d38/f72 [252358,78993] 0 2024-09-17T01:07:01.745 INFO:tasks.workunit.client.0.smithi103.stdout:5/27: mknod d6/ca 0 2024-09-17T01:07:01.746 INFO:tasks.workunit.client.1.smithi143.stdout:3/574: truncate d6/f73 2143108 0 2024-09-17T01:07:01.747 INFO:tasks.workunit.client.1.smithi143.stdout:5/539: creat d1/d46/d6e/db7/fcd x:0 0 0 2024-09-17T01:07:01.753 INFO:tasks.workunit.client.0.smithi103.stdout:7/86: dwrite d4/d10/f15 [0,4194304] 0 2024-09-17T01:07:01.755 INFO:tasks.workunit.client.0.smithi103.stdout:4/30: dwrite f5 [4194304,4194304] 0 2024-09-17T01:07:01.758 INFO:tasks.workunit.client.0.smithi103.stdout:3/62: dwrite d3/fd [4194304,4194304] 0 2024-09-17T01:07:01.759 INFO:tasks.workunit.client.0.smithi103.stdout:7/87: creat d4/d11/f23 x:0 0 0 2024-09-17T01:07:01.760 INFO:tasks.workunit.client.0.smithi103.stdout:4/31: readlink l4 0 2024-09-17T01:07:01.762 INFO:tasks.workunit.client.1.smithi143.stdout:8/583: creat d9/d23/db4/d55/dbf/fcd x:0 0 0 2024-09-17T01:07:01.764 INFO:tasks.workunit.client.1.smithi143.stdout:7/705: dwrite d4/d26/fab [0,4194304] 0 2024-09-17T01:07:01.764 INFO:tasks.workunit.client.0.smithi103.stdout:4/32: rename l1 to l6 0 2024-09-17T01:07:01.764 INFO:tasks.workunit.client.1.smithi143.stdout:6/522: creat d2/d30/d45/d70/d87/fa2 x:0 0 0 2024-09-17T01:07:01.766 INFO:tasks.workunit.client.1.smithi143.stdout:4/528: mknod da/d3a/d7c/ca6 0 2024-09-17T01:07:01.766 INFO:tasks.workunit.client.1.smithi143.stdout:8/584: dread - d9/d26/fb6 zero size 2024-09-17T01:07:01.767 INFO:tasks.workunit.client.1.smithi143.stdout:3/575: chown d6/d1c/d33/d41/f21 3861 1 2024-09-17T01:07:01.768 INFO:tasks.workunit.client.1.smithi143.stdout:9/566: rename d3/d39/d6a/d9/l1b to d3/d16/lbb 0 2024-09-17T01:07:01.769 INFO:tasks.workunit.client.0.smithi103.stdout:3/63: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:07:01.770 INFO:tasks.workunit.client.1.smithi143.stdout:2/556: link d0/d44/l6f d0/d10/d56/lae 0 2024-09-17T01:07:01.770 INFO:tasks.workunit.client.1.smithi143.stdout:1/623: link d0/d6/d43/d6a/df/f8c d0/d6/d43/d47/d88/da5/db1/fcd 0 2024-09-17T01:07:01.773 INFO:tasks.workunit.client.1.smithi143.stdout:5/540: symlink d1/d46/d6e/db7/lce 0 2024-09-17T01:07:01.773 INFO:tasks.workunit.client.1.smithi143.stdout:2/557: write d0/d2/f2b [1296018,43365] 0 2024-09-17T01:07:01.774 INFO:tasks.workunit.client.0.smithi103.stdout:3/64: symlink d3/l18 0 2024-09-17T01:07:01.774 INFO:tasks.workunit.client.0.smithi103.stdout:3/65: dread - d3/f14 zero size 2024-09-17T01:07:01.777 INFO:tasks.workunit.client.1.smithi143.stdout:6/523: mkdir d2/d30/d45/d4a/da3 0 2024-09-17T01:07:01.778 INFO:tasks.workunit.client.0.smithi103.stdout:7/88: write d4/d11/f19 [242993,86790] 0 2024-09-17T01:07:01.778 INFO:tasks.workunit.client.0.smithi103.stdout:7/89: chown d4/d10/c16 2671002 1 2024-09-17T01:07:01.780 INFO:tasks.workunit.client.1.smithi143.stdout:8/585: readlink d9/d84/lb1 0 2024-09-17T01:07:01.784 INFO:tasks.workunit.client.0.smithi103.stdout:7/90: read d4/fb [7569345,63125] 0 2024-09-17T01:07:01.785 INFO:tasks.workunit.client.1.smithi143.stdout:4/529: symlink da/d3a/d3e/d4a/la7 0 2024-09-17T01:07:01.785 INFO:tasks.workunit.client.1.smithi143.stdout:5/541: dread d1/d46/df/d53/d74/d9a/fb1 [0,4194304] 0 2024-09-17T01:07:01.785 INFO:tasks.workunit.client.1.smithi143.stdout:9/567: creat d3/d39/d42/d58/d5a/fbc x:0 0 0 2024-09-17T01:07:01.785 INFO:tasks.workunit.client.0.smithi103.stdout:7/91: rename d4/d10/c16 to d4/d11/c24 0 2024-09-17T01:07:01.785 INFO:tasks.workunit.client.0.smithi103.stdout:7/92: dread - d4/d11/f23 zero size 2024-09-17T01:07:01.788 INFO:tasks.workunit.client.1.smithi143.stdout:7/706: getdents d4/d1f/d4a/d9e/dd1 0 2024-09-17T01:07:01.788 INFO:tasks.workunit.client.1.smithi143.stdout:6/524: creat d2/df/fa4 x:0 0 0 2024-09-17T01:07:01.789 INFO:tasks.workunit.client.1.smithi143.stdout:2/558: creat d0/d10/d58/d5a/d5b/d4c/d71/d99/faf x:0 0 0 2024-09-17T01:07:01.790 INFO:tasks.workunit.client.1.smithi143.stdout:8/586: creat d9/d12/d38/d58/fce x:0 0 0 2024-09-17T01:07:01.790 INFO:tasks.workunit.client.1.smithi143.stdout:5/542: dread - d1/d46/df/d53/d74/d9a/d9c/fc8 zero size 2024-09-17T01:07:01.791 INFO:tasks.workunit.client.1.smithi143.stdout:4/530: mkdir da/d3a/d3e/d72/da3/da8 0 2024-09-17T01:07:01.792 INFO:tasks.workunit.client.1.smithi143.stdout:7/707: creat d4/d33/d4e/d9f/fdf x:0 0 0 2024-09-17T01:07:01.792 INFO:tasks.workunit.client.1.smithi143.stdout:3/576: dread d6/d1c/d4b/f67 [0,4194304] 0 2024-09-17T01:07:01.793 INFO:tasks.workunit.client.1.smithi143.stdout:8/587: stat d9/d12/d13/d73/la7 0 2024-09-17T01:07:01.793 INFO:tasks.workunit.client.0.smithi103.stdout:7/93: dwrite d4/f1a [0,4194304] 0 2024-09-17T01:07:01.794 INFO:tasks.workunit.client.1.smithi143.stdout:7/708: chown d4/f82 190 1 2024-09-17T01:07:01.795 INFO:tasks.workunit.client.1.smithi143.stdout:5/543: chown d1/d46/df/d53/d74/d9a/d9c/fc6 4221350 1 2024-09-17T01:07:01.795 INFO:tasks.workunit.client.1.smithi143.stdout:9/568: rename d3/d39/d42/d58/d5a/d5e/d99/f4c to d3/d16/d3e/d51/d52/fbd 0 2024-09-17T01:07:01.797 INFO:tasks.workunit.client.0.smithi103.stdout:7/94: creat d4/d10/f25 x:0 0 0 2024-09-17T01:07:01.797 INFO:tasks.workunit.client.1.smithi143.stdout:3/577: fsync d6/d1c/d33/d3f/d5c/da1/f8c 0 2024-09-17T01:07:01.802 INFO:tasks.workunit.client.1.smithi143.stdout:1/624: link d0/d6/d43/d6a/df/f8c d0/fce 0 2024-09-17T01:07:01.804 INFO:tasks.workunit.client.1.smithi143.stdout:7/709: dread d4/d1f/f8b [0,4194304] 0 2024-09-17T01:07:01.804 INFO:tasks.workunit.client.1.smithi143.stdout:3/578: fsync d6/d68/fac 0 2024-09-17T01:07:01.807 INFO:tasks.workunit.client.1.smithi143.stdout:8/588: creat d9/fcf x:0 0 0 2024-09-17T01:07:01.808 INFO:tasks.workunit.client.0.smithi103.stdout:4/33: getdents . 0 2024-09-17T01:07:01.809 INFO:tasks.workunit.client.1.smithi143.stdout:2/559: dwrite d0/d44/d7a/f89 [4194304,4194304] 0 2024-09-17T01:07:01.811 INFO:tasks.workunit.client.1.smithi143.stdout:7/710: rmdir d4/d1f/d29 39 2024-09-17T01:07:01.812 INFO:tasks.workunit.client.1.smithi143.stdout:8/589: chown d9/d23/d32/lc7 11 1 2024-09-17T01:07:01.814 INFO:tasks.workunit.client.1.smithi143.stdout:3/579: creat d6/d1c/d33/d41/d2e/d30/fb6 x:0 0 0 2024-09-17T01:07:01.816 INFO:tasks.workunit.client.0.smithi103.stdout:4/34: dwrite f5 [8388608,4194304] 0 2024-09-17T01:07:01.817 INFO:tasks.workunit.client.0.smithi103.stdout:4/35: write f3 [3696051,762] 0 2024-09-17T01:07:01.817 INFO:tasks.workunit.client.1.smithi143.stdout:5/544: rename d1/d46/df/d1f/d66/db8 to d1/d46/df/d23/d4f/d7d/dcf 0 2024-09-17T01:07:01.818 INFO:tasks.workunit.client.1.smithi143.stdout:9/569: dwrite d3/d39/d42/d58/d5a/fbc [0,4194304] 0 2024-09-17T01:07:01.820 INFO:tasks.workunit.client.1.smithi143.stdout:3/580: rmdir d6/d1c/d33/d5d 39 2024-09-17T01:07:01.821 INFO:tasks.workunit.client.0.smithi103.stdout:4/36: creat f7 x:0 0 0 2024-09-17T01:07:01.822 INFO:tasks.workunit.client.0.smithi103.stdout:4/37: stat f7 0 2024-09-17T01:07:01.825 INFO:tasks.workunit.client.0.smithi103.stdout:4/38: write f3 [2190752,102584] 0 2024-09-17T01:07:01.826 INFO:tasks.workunit.client.0.smithi103.stdout:4/39: write f7 [823618,46381] 0 2024-09-17T01:07:01.827 INFO:tasks.workunit.client.1.smithi143.stdout:8/590: creat d9/d23/fd0 x:0 0 0 2024-09-17T01:07:01.828 INFO:tasks.workunit.client.0.smithi103.stdout:3/66: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:07:01.833 INFO:tasks.workunit.client.0.smithi103.stdout:4/40: creat f8 x:0 0 0 2024-09-17T01:07:01.835 INFO:tasks.workunit.client.0.smithi103.stdout:3/67: mknod d3/d16/c19 0 2024-09-17T01:07:01.836 INFO:tasks.workunit.client.0.smithi103.stdout:3/68: readlink d3/l18 0 2024-09-17T01:07:01.839 INFO:tasks.workunit.client.1.smithi143.stdout:2/560: getdents d0/d10/d58/d5a/d5b/d4c/d71/d99 0 2024-09-17T01:07:01.840 INFO:tasks.workunit.client.1.smithi143.stdout:8/591: dread d9/d23/d32/fb0 [0,4194304] 0 2024-09-17T01:07:01.841 INFO:tasks.workunit.client.1.smithi143.stdout:2/561: dread - d0/d44/d7a/d86/fa7 zero size 2024-09-17T01:07:01.842 INFO:tasks.workunit.client.1.smithi143.stdout:3/581: creat d6/d1c/d33/d41/d42/fb7 x:0 0 0 2024-09-17T01:07:01.843 INFO:tasks.workunit.client.1.smithi143.stdout:5/545: link d1/d46/df/d23/d4f/d82/c8c d1/d46/df/cd0 0 2024-09-17T01:07:01.845 INFO:tasks.workunit.client.1.smithi143.stdout:5/546: dread - d1/d46/df/d23/d4f/d82/fc2 zero size 2024-09-17T01:07:01.847 INFO:tasks.workunit.client.1.smithi143.stdout:2/562: mkdir d0/d2/db0 0 2024-09-17T01:07:01.847 INFO:tasks.workunit.client.1.smithi143.stdout:4/531: dwrite da/f20 [4194304,4194304] 0 2024-09-17T01:07:01.848 INFO:tasks.workunit.client.1.smithi143.stdout:8/592: mknod d9/d12/d38/d58/d79/d9b/cd1 0 2024-09-17T01:07:01.850 INFO:tasks.workunit.client.1.smithi143.stdout:5/547: fsync d1/d46/f22 0 2024-09-17T01:07:01.851 INFO:tasks.workunit.client.1.smithi143.stdout:8/593: write d9/de/fb5 [521297,79326] 0 2024-09-17T01:07:01.851 INFO:tasks.workunit.client.1.smithi143.stdout:4/532: symlink da/d3a/d3e/d72/da3/la9 0 2024-09-17T01:07:01.852 INFO:tasks.workunit.client.1.smithi143.stdout:5/548: write d1/d46/f79 [1227720,1545] 0 2024-09-17T01:07:01.853 INFO:tasks.workunit.client.1.smithi143.stdout:2/563: creat d0/d2/d21/d84/d8d/fb1 x:0 0 0 2024-09-17T01:07:01.853 INFO:tasks.workunit.client.1.smithi143.stdout:4/533: write da/f54 [339767,25455] 0 2024-09-17T01:07:01.855 INFO:tasks.workunit.client.1.smithi143.stdout:4/534: readlink da/d3a/d40/l41 0 2024-09-17T01:07:01.856 INFO:tasks.workunit.client.1.smithi143.stdout:3/582: getdents d6/d1c/d33/d41/d2e 0 2024-09-17T01:07:01.858 INFO:tasks.workunit.client.0.smithi103.stdout:4/41: getdents . 0 2024-09-17T01:07:01.859 INFO:tasks.workunit.client.0.smithi103.stdout:4/42: chown f7 13524 1 2024-09-17T01:07:01.860 INFO:tasks.workunit.client.1.smithi143.stdout:8/594: mkdir d9/d12/d38/d58/d70/dd2 0 2024-09-17T01:07:01.864 INFO:tasks.workunit.client.1.smithi143.stdout:4/535: truncate da/f1b 2127716 0 2024-09-17T01:07:01.867 INFO:tasks.workunit.client.1.smithi143.stdout:5/549: dwrite d1/fcb [0,4194304] 0 2024-09-17T01:07:01.867 INFO:tasks.workunit.client.1.smithi143.stdout:7/711: dwrite d4/d33/fd7 [0,4194304] 0 2024-09-17T01:07:01.869 INFO:tasks.workunit.client.0.smithi103.stdout:4/43: dwrite f8 [0,4194304] 0 2024-09-17T01:07:01.869 INFO:tasks.workunit.client.1.smithi143.stdout:8/595: chown d9/d12/d38/d58/d79/d9b/cd1 513434 1 2024-09-17T01:07:01.870 INFO:tasks.workunit.client.1.smithi143.stdout:4/536: read da/d3a/d40/f34 [2024399,81499] 0 2024-09-17T01:07:01.870 INFO:tasks.workunit.client.0.smithi103.stdout:3/69: dwrite d3/fe [0,4194304] 0 2024-09-17T01:07:01.878 INFO:tasks.workunit.client.1.smithi143.stdout:5/550: symlink d1/d46/df/d53/ld1 0 2024-09-17T01:07:01.879 INFO:tasks.workunit.client.1.smithi143.stdout:3/583: dwrite d6/f8a [0,4194304] 0 2024-09-17T01:07:01.879 INFO:tasks.workunit.client.1.smithi143.stdout:4/537: rmdir da/d3a 39 2024-09-17T01:07:01.882 INFO:tasks.workunit.client.1.smithi143.stdout:8/596: unlink d9/d12/c14 0 2024-09-17T01:07:01.885 INFO:tasks.workunit.client.1.smithi143.stdout:4/538: write da/d6d/fa4 [111837,58935] 0 2024-09-17T01:07:01.885 INFO:tasks.workunit.client.1.smithi143.stdout:3/584: creat d6/d68/fb8 x:0 0 0 2024-09-17T01:07:01.886 INFO:tasks.workunit.client.0.smithi103.stdout:4/44: dread f7 [0,4194304] 0 2024-09-17T01:07:01.888 INFO:tasks.workunit.client.1.smithi143.stdout:8/597: write d9/d26/fb6 [194022,108230] 0 2024-09-17T01:07:01.888 INFO:tasks.workunit.client.0.smithi103.stdout:4/45: mkdir d9 0 2024-09-17T01:07:01.891 INFO:tasks.workunit.client.1.smithi143.stdout:7/712: dread d4/d1f/f68 [0,4194304] 0 2024-09-17T01:07:01.894 INFO:tasks.workunit.client.1.smithi143.stdout:3/585: read d6/f8a [2914726,15264] 0 2024-09-17T01:07:01.896 INFO:tasks.workunit.client.1.smithi143.stdout:8/598: symlink d9/d12/d38/d58/d79/ld3 0 2024-09-17T01:07:01.897 INFO:tasks.workunit.client.1.smithi143.stdout:4/539: mkdir da/d3a/d40/daa 0 2024-09-17T01:07:01.898 INFO:tasks.workunit.client.1.smithi143.stdout:3/586: chown d6/d1c/d4d/f6d 3158445 1 2024-09-17T01:07:01.898 INFO:tasks.workunit.client.1.smithi143.stdout:7/713: truncate d4/d1f/d29/d65/d5d/db1/fb3 555236 0 2024-09-17T01:07:01.899 INFO:tasks.workunit.client.1.smithi143.stdout:8/599: symlink d9/d23/db4/ld4 0 2024-09-17T01:07:01.899 INFO:tasks.workunit.client.1.smithi143.stdout:4/540: write da/d3a/d40/d84/f94 [899361,128823] 0 2024-09-17T01:07:01.900 INFO:tasks.workunit.client.1.smithi143.stdout:8/600: chown d9/d23/d4f/lc4 1157 1 2024-09-17T01:07:01.901 INFO:tasks.workunit.client.1.smithi143.stdout:7/714: chown d4/d1f/d4a/d66/fc2 1 1 2024-09-17T01:07:01.902 INFO:tasks.workunit.client.1.smithi143.stdout:4/541: mknod da/d68/cab 0 2024-09-17T01:07:01.902 INFO:tasks.workunit.client.1.smithi143.stdout:4/542: fdatasync da/f54 0 2024-09-17T01:07:01.903 INFO:tasks.workunit.client.1.smithi143.stdout:3/587: rename d6/d1c/f34 to d6/d1c/d33/d3f/fb9 0 2024-09-17T01:07:01.904 INFO:tasks.workunit.client.1.smithi143.stdout:7/715: symlink d4/d1f/d29/le0 0 2024-09-17T01:07:01.906 INFO:tasks.workunit.client.1.smithi143.stdout:3/588: creat d6/d1c/d33/d5d/fba x:0 0 0 2024-09-17T01:07:01.907 INFO:tasks.workunit.client.1.smithi143.stdout:7/716: creat d4/d1f/d29/d65/d5d/fe1 x:0 0 0 2024-09-17T01:07:01.907 INFO:tasks.workunit.client.1.smithi143.stdout:4/543: link da/d3a/d3e/d5e/d63/l6e da/d3a/d3e/d72/da3/lac 0 2024-09-17T01:07:01.908 INFO:tasks.workunit.client.1.smithi143.stdout:7/717: dread - d4/d33/d78/f87 zero size 2024-09-17T01:07:01.909 INFO:tasks.workunit.client.1.smithi143.stdout:7/718: fsync d4/d1f/d4a/d66/fc2 0 2024-09-17T01:07:01.912 INFO:tasks.workunit.client.0.smithi103.stdout:4/46: fsync f8 0 2024-09-17T01:07:01.912 INFO:tasks.workunit.client.0.smithi103.stdout:3/70: fsync d3/fe 0 2024-09-17T01:07:01.913 INFO:tasks.workunit.client.0.smithi103.stdout:4/47: fsync f3 0 2024-09-17T01:07:01.915 INFO:tasks.workunit.client.0.smithi103.stdout:3/71: creat d3/d16/f1a x:0 0 0 2024-09-17T01:07:01.916 INFO:tasks.workunit.client.0.smithi103.stdout:3/72: readlink d3/l18 0 2024-09-17T01:07:01.916 INFO:tasks.workunit.client.1.smithi143.stdout:7/719: link d4/d1f/d4a/d66/db5/cdd d4/d1f/d4a/dc1/ce2 0 2024-09-17T01:07:01.917 INFO:tasks.workunit.client.0.smithi103.stdout:3/73: fdatasync d3/f8 0 2024-09-17T01:07:01.917 INFO:tasks.workunit.client.0.smithi103.stdout:4/48: dread f3 [0,4194304] 0 2024-09-17T01:07:01.918 INFO:tasks.workunit.client.0.smithi103.stdout:4/49: write f3 [2333028,34208] 0 2024-09-17T01:07:01.920 INFO:tasks.workunit.client.0.smithi103.stdout:3/74: mkdir d3/d16/d1b 0 2024-09-17T01:07:01.923 INFO:tasks.workunit.client.1.smithi143.stdout:5/551: dwrite d1/f3f [0,4194304] 0 2024-09-17T01:07:01.923 INFO:tasks.workunit.client.0.smithi103.stdout:4/50: dread f3 [0,4194304] 0 2024-09-17T01:07:01.926 INFO:tasks.workunit.client.0.smithi103.stdout:3/75: rename d3/fe to d3/f1c 0 2024-09-17T01:07:01.927 INFO:tasks.workunit.client.0.smithi103.stdout:4/51: dread f5 [8388608,4194304] 0 2024-09-17T01:07:01.928 INFO:tasks.workunit.client.0.smithi103.stdout:4/52: write f8 [2117428,101819] 0 2024-09-17T01:07:01.929 INFO:tasks.workunit.client.1.smithi143.stdout:3/589: dread - d6/d1c/d33/d3f/fb9 zero size 2024-09-17T01:07:01.929 INFO:tasks.workunit.client.1.smithi143.stdout:5/552: creat d1/d96/fd2 x:0 0 0 2024-09-17T01:07:01.930 INFO:tasks.workunit.client.0.smithi103.stdout:4/53: dread f7 [0,4194304] 0 2024-09-17T01:07:01.931 INFO:tasks.workunit.client.0.smithi103.stdout:3/76: creat d3/f1d x:0 0 0 2024-09-17T01:07:01.931 INFO:tasks.workunit.client.0.smithi103.stdout:3/77: fdatasync d3/f14 0 2024-09-17T01:07:01.932 INFO:tasks.workunit.client.0.smithi103.stdout:3/78: truncate d3/f1d 667835 0 2024-09-17T01:07:01.932 INFO:tasks.workunit.client.0.smithi103.stdout:3/79: chown d3/fd 1348 1 2024-09-17T01:07:01.933 INFO:tasks.workunit.client.1.smithi143.stdout:4/544: dread da/f20 [0,4194304] 0 2024-09-17T01:07:01.933 INFO:tasks.workunit.client.1.smithi143.stdout:5/553: unlink d1/d46/df/d1f/d7a/cc0 0 2024-09-17T01:07:01.935 INFO:tasks.workunit.client.1.smithi143.stdout:3/590: unlink d6/d68/fac 0 2024-09-17T01:07:01.936 INFO:tasks.workunit.client.0.smithi103.stdout:3/80: unlink d3/d16/c17 0 2024-09-17T01:07:01.938 INFO:tasks.workunit.client.0.smithi103.stdout:4/54: mkdir d9/da 0 2024-09-17T01:07:01.938 INFO:tasks.workunit.client.0.smithi103.stdout:4/55: chown d9 60428190 1 2024-09-17T01:07:01.938 INFO:tasks.workunit.client.0.smithi103.stdout:4/56: truncate f7 1148460 0 2024-09-17T01:07:01.939 INFO:tasks.workunit.client.0.smithi103.stdout:3/81: creat d3/f1e x:0 0 0 2024-09-17T01:07:01.940 INFO:tasks.workunit.client.0.smithi103.stdout:3/82: chown d3/d16/d1b 946 1 2024-09-17T01:07:01.940 INFO:tasks.workunit.client.1.smithi143.stdout:5/554: creat d1/d46/df/d53/d74/d9a/d9c/fd3 x:0 0 0 2024-09-17T01:07:01.941 INFO:tasks.workunit.client.1.smithi143.stdout:3/591: rename d6/d1c/d4d/c4e to d6/d1c/d82/cbb 0 2024-09-17T01:07:01.943 INFO:tasks.workunit.client.1.smithi143.stdout:4/545: mknod da/d3a/d3e/cad 0 2024-09-17T01:07:01.944 INFO:tasks.workunit.client.1.smithi143.stdout:3/592: write d6/d68/f96 [97142,112908] 0 2024-09-17T01:07:01.944 INFO:tasks.workunit.client.1.smithi143.stdout:7/720: dwrite d4/d26/f61 [0,4194304] 0 2024-09-17T01:07:01.945 INFO:tasks.workunit.client.0.smithi103.stdout:4/57: mkdir d9/da/db 0 2024-09-17T01:07:01.946 INFO:tasks.workunit.client.0.smithi103.stdout:3/83: symlink d3/d16/d1b/l1f 0 2024-09-17T01:07:01.946 INFO:tasks.workunit.client.1.smithi143.stdout:3/593: write d6/d1c/d33/d41/d2e/f61 [5064638,31215] 0 2024-09-17T01:07:01.947 INFO:tasks.workunit.client.0.smithi103.stdout:3/84: fsync d3/f1d 0 2024-09-17T01:07:01.952 INFO:tasks.workunit.client.0.smithi103.stdout:3/85: mknod d3/c20 0 2024-09-17T01:07:01.954 INFO:tasks.workunit.client.0.smithi103.stdout:4/58: unlink l4 0 2024-09-17T01:07:01.956 INFO:tasks.workunit.client.1.smithi143.stdout:3/594: rename d6/d1c/d33/d41/d2e/d86/d89/fb0 to d6/d1c/d33/d3f/fbc 0 2024-09-17T01:07:01.959 INFO:tasks.workunit.client.0.smithi103.stdout:3/86: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:07:01.959 INFO:tasks.workunit.client.1.smithi143.stdout:5/555: dread d1/f2 [0,4194304] 0 2024-09-17T01:07:01.960 INFO:tasks.workunit.client.1.smithi143.stdout:7/721: fdatasync d4/d1f/d4a/d66/f6c 0 2024-09-17T01:07:01.960 INFO:tasks.workunit.client.0.smithi103.stdout:4/59: fsync f5 0 2024-09-17T01:07:01.960 INFO:tasks.workunit.client.0.smithi103.stdout:3/87: readlink d3/l4 0 2024-09-17T01:07:01.961 INFO:tasks.workunit.client.0.smithi103.stdout:4/60: read f3 [1341622,10161] 0 2024-09-17T01:07:01.965 INFO:tasks.workunit.client.0.smithi103.stdout:4/61: mkdir d9/dc 0 2024-09-17T01:07:01.966 INFO:tasks.workunit.client.1.smithi143.stdout:5/556: rename d1/d46/df/c11 to d1/d46/d9b/cd4 0 2024-09-17T01:07:01.970 INFO:tasks.workunit.client.0.smithi103.stdout:4/62: creat d9/fd x:0 0 0 2024-09-17T01:07:01.972 INFO:tasks.workunit.client.1.smithi143.stdout:5/557: creat d1/d46/df/d23/d4f/d7d/dcf/fd5 x:0 0 0 2024-09-17T01:07:01.972 INFO:tasks.workunit.client.0.smithi103.stdout:4/63: dread f7 [0,4194304] 0 2024-09-17T01:07:01.975 INFO:tasks.workunit.client.1.smithi143.stdout:5/558: creat d1/d96/fd6 x:0 0 0 2024-09-17T01:07:01.975 INFO:tasks.workunit.client.1.smithi143.stdout:4/546: write da/d3a/d3e/d5e/fa2 [1592878,57473] 0 2024-09-17T01:07:01.976 INFO:tasks.workunit.client.0.smithi103.stdout:4/64: link f7 d9/fe 0 2024-09-17T01:07:01.976 INFO:tasks.workunit.client.1.smithi143.stdout:4/547: rmdir da/d68/d9b 39 2024-09-17T01:07:01.977 INFO:tasks.workunit.client.1.smithi143.stdout:3/595: write d6/d1c/d33/d41/d2e/d30/f6c [704864,125209] 0 2024-09-17T01:07:01.979 INFO:tasks.workunit.client.0.smithi103.stdout:4/65: mkdir d9/dc/df 0 2024-09-17T01:07:01.981 INFO:tasks.workunit.client.0.smithi103.stdout:3/88: truncate d3/f9 2624706 0 2024-09-17T01:07:01.982 INFO:tasks.workunit.client.0.smithi103.stdout:3/89: chown d3/d16/f1a 4936 1 2024-09-17T01:07:01.982 INFO:tasks.workunit.client.0.smithi103.stdout:4/66: rename d9/da to d9/d10 0 2024-09-17T01:07:01.983 INFO:tasks.workunit.client.0.smithi103.stdout:3/90: write d3/f14 [1034497,123149] 0 2024-09-17T01:07:01.983 INFO:tasks.workunit.client.1.smithi143.stdout:7/722: write d4/d1f/f63 [1354254,55281] 0 2024-09-17T01:07:01.983 INFO:tasks.workunit.client.0.smithi103.stdout:4/67: read d9/fe [415421,121799] 0 2024-09-17T01:07:01.984 INFO:tasks.workunit.client.0.smithi103.stdout:3/91: fsync d3/fd 0 2024-09-17T01:07:01.985 INFO:tasks.workunit.client.1.smithi143.stdout:5/559: dread d1/d46/df/d23/d4f/f20 [0,4194304] 0 2024-09-17T01:07:01.989 INFO:tasks.workunit.client.1.smithi143.stdout:4/548: rename da/c21 to da/d3a/d3e/d72/da3/cae 0 2024-09-17T01:07:01.989 INFO:tasks.workunit.client.1.smithi143.stdout:4/549: truncate da/f1c 1072595 0 2024-09-17T01:07:01.991 INFO:tasks.workunit.client.1.smithi143.stdout:7/723: dwrite d4/d1f/d4a/d66/fc2 [0,4194304] 0 2024-09-17T01:07:01.991 INFO:tasks.workunit.client.1.smithi143.stdout:5/560: mkdir d1/d46/df/d53/d74/d9a/dd7 0 2024-09-17T01:07:01.992 INFO:tasks.workunit.client.0.smithi103.stdout:3/92: dwrite d3/f1e [0,4194304] 0 2024-09-17T01:07:01.993 INFO:tasks.workunit.client.1.smithi143.stdout:5/561: write d1/fcb [1176896,129217] 0 2024-09-17T01:07:01.994 INFO:tasks.workunit.client.1.smithi143.stdout:4/550: rename da/d3a/d40/l33 to da/d3a/d3e/d4a/d8a/laf 0 2024-09-17T01:07:01.995 INFO:tasks.workunit.client.0.smithi103.stdout:3/93: mknod d3/d16/c21 0 2024-09-17T01:07:01.996 INFO:tasks.workunit.client.1.smithi143.stdout:4/551: write da/d6d/fa4 [107549,128553] 0 2024-09-17T01:07:01.998 INFO:tasks.workunit.client.1.smithi143.stdout:4/552: write da/d3a/d3e/d4a/d8c/f9f [544709,44241] 0 2024-09-17T01:07:01.999 INFO:tasks.workunit.client.1.smithi143.stdout:7/724: mknod d4/d1f/d4a/d66/d86/ce3 0 2024-09-17T01:07:02.003 INFO:tasks.workunit.client.1.smithi143.stdout:3/596: write d6/d1c/f66 [813743,88530] 0 2024-09-17T01:07:02.004 INFO:tasks.workunit.client.0.smithi103.stdout:3/94: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:07:02.006 INFO:tasks.workunit.client.0.smithi103.stdout:4/68: truncate d9/fe 975314 0 2024-09-17T01:07:02.006 INFO:tasks.workunit.client.1.smithi143.stdout:3/597: write d6/d1c/d33/d5d/fba [104934,103084] 0 2024-09-17T01:07:02.010 INFO:tasks.workunit.client.0.smithi103.stdout:3/95: unlink d3/f1e 0 2024-09-17T01:07:02.011 INFO:tasks.workunit.client.1.smithi143.stdout:5/562: link d1/d46/df/d23/c67 d1/d46/df/d23/d4f/d7d/d92/cd8 0 2024-09-17T01:07:02.011 INFO:tasks.workunit.client.1.smithi143.stdout:4/553: dwrite da/d3a/d3e/d72/da3/fa5 [0,4194304] 0 2024-09-17T01:07:02.015 INFO:tasks.workunit.client.1.smithi143.stdout:7/725: rename d4/d33 to d4/d1f/d4a/de4 0 2024-09-17T01:07:02.018 INFO:tasks.workunit.client.0.smithi103.stdout:9/65: sync 2024-09-17T01:07:02.019 INFO:tasks.workunit.client.1.smithi143.stdout:5/563: dwrite d1/d46/df/d53/f81 [0,4194304] 0 2024-09-17T01:07:02.021 INFO:tasks.workunit.client.1.smithi143.stdout:4/554: symlink da/d3a/d3e/d5e/lb0 0 2024-09-17T01:07:02.024 INFO:tasks.workunit.client.1.smithi143.stdout:7/726: mkdir d4/d1f/d4a/de4/d78/de5 0 2024-09-17T01:07:02.025 INFO:tasks.workunit.client.1.smithi143.stdout:7/727: stat d4/d26/f8a 0 2024-09-17T01:07:02.025 INFO:tasks.workunit.client.0.smithi103.stdout:9/66: read f5 [1555315,128842] 0 2024-09-17T01:07:02.025 INFO:tasks.workunit.client.1.smithi143.stdout:3/598: symlink d6/d1c/d82/db1/lbd 0 2024-09-17T01:07:02.026 INFO:tasks.workunit.client.1.smithi143.stdout:7/728: write d4/d16/d97/fbf [424124,82894] 0 2024-09-17T01:07:02.033 INFO:tasks.workunit.client.0.smithi103.stdout:9/67: dread - d7/dd/f16 zero size 2024-09-17T01:07:02.034 INFO:tasks.workunit.client.1.smithi143.stdout:3/599: symlink d6/d1c/d4b/lbe 0 2024-09-17T01:07:02.041 INFO:tasks.workunit.client.1.smithi143.stdout:7/729: dwrite d4/d1f/f80 [4194304,4194304] 0 2024-09-17T01:07:02.041 INFO:tasks.workunit.client.0.smithi103.stdout:4/69: truncate f8 2675906 0 2024-09-17T01:07:02.042 INFO:tasks.workunit.client.0.smithi103.stdout:4/70: symlink d9/dc/l11 0 2024-09-17T01:07:02.045 INFO:tasks.workunit.client.0.smithi103.stdout:4/71: write f3 [1419205,113955] 0 2024-09-17T01:07:02.047 INFO:tasks.workunit.client.0.smithi103.stdout:4/72: chown l6 87 1 2024-09-17T01:07:02.047 INFO:tasks.workunit.client.0.smithi103.stdout:9/68: write f5 [1393171,110532] 0 2024-09-17T01:07:02.048 INFO:tasks.workunit.client.1.smithi143.stdout:7/730: dread d4/d1f/f30 [4194304,4194304] 0 2024-09-17T01:07:02.052 INFO:tasks.workunit.client.0.smithi103.stdout:3/96: write d3/f9 [2502799,62324] 0 2024-09-17T01:07:02.053 INFO:tasks.workunit.client.1.smithi143.stdout:4/555: dread da/d3a/d40/d84/f69 [0,4194304] 0 2024-09-17T01:07:02.053 INFO:tasks.workunit.client.0.smithi103.stdout:3/97: fdatasync d3/d16/f1a 0 2024-09-17T01:07:02.053 INFO:tasks.workunit.client.1.smithi143.stdout:7/731: symlink d4/d1f/d4a/d9e/le6 0 2024-09-17T01:07:02.054 INFO:tasks.workunit.client.0.smithi103.stdout:3/98: write d3/f9 [997531,119357] 0 2024-09-17T01:07:02.057 INFO:tasks.workunit.client.0.smithi103.stdout:9/69: link d7/dd/d11/f12 d7/f18 0 2024-09-17T01:07:02.058 INFO:tasks.workunit.client.1.smithi143.stdout:4/556: mknod da/d3a/d3e/d4a/d8c/cb1 0 2024-09-17T01:07:02.059 INFO:tasks.workunit.client.1.smithi143.stdout:4/557: chown da/d3a/d40/f5b 60201267 1 2024-09-17T01:07:02.060 INFO:tasks.workunit.client.1.smithi143.stdout:7/732: fdatasync d4/d1f/f28 0 2024-09-17T01:07:02.061 INFO:tasks.workunit.client.0.smithi103.stdout:4/73: dread f8 [0,4194304] 0 2024-09-17T01:07:02.062 INFO:tasks.workunit.client.0.smithi103.stdout:3/99: mkdir d3/d16/d22 0 2024-09-17T01:07:02.064 INFO:tasks.workunit.client.0.smithi103.stdout:9/70: creat d7/f19 x:0 0 0 2024-09-17T01:07:02.064 INFO:tasks.workunit.client.1.smithi143.stdout:4/558: dwrite da/f2d [0,4194304] 0 2024-09-17T01:07:02.065 INFO:tasks.workunit.client.1.smithi143.stdout:4/559: readlink da/d3a/l5a 0 2024-09-17T01:07:02.066 INFO:tasks.workunit.client.0.smithi103.stdout:9/71: mknod d7/c1a 0 2024-09-17T01:07:02.067 INFO:tasks.workunit.client.0.smithi103.stdout:4/74: creat d9/d10/db/f12 x:0 0 0 2024-09-17T01:07:02.068 INFO:tasks.workunit.client.1.smithi143.stdout:7/733: mkdir d4/d1f/d4a/ddb/de7 0 2024-09-17T01:07:02.068 INFO:tasks.workunit.client.0.smithi103.stdout:9/72: rmdir d7/dd 39 2024-09-17T01:07:02.069 INFO:tasks.workunit.client.1.smithi143.stdout:4/560: mknod da/d3a/d40/d84/cb2 0 2024-09-17T01:07:02.071 INFO:tasks.workunit.client.1.smithi143.stdout:7/734: creat d4/d26/dcc/fe8 x:0 0 0 2024-09-17T01:07:02.074 INFO:tasks.workunit.client.0.smithi103.stdout:4/75: unlink d9/fe 0 2024-09-17T01:07:02.075 INFO:tasks.workunit.client.0.smithi103.stdout:9/73: mknod d7/dd/d11/c1b 0 2024-09-17T01:07:02.077 INFO:tasks.workunit.client.0.smithi103.stdout:9/74: creat d7/dd/f1c x:0 0 0 2024-09-17T01:07:02.078 INFO:tasks.workunit.client.1.smithi143.stdout:7/735: dwrite d4/d16/d97/fa6 [0,4194304] 0 2024-09-17T01:07:02.078 INFO:tasks.workunit.client.0.smithi103.stdout:4/76: chown f7 321374 1 2024-09-17T01:07:02.079 INFO:tasks.workunit.client.1.smithi143.stdout:7/736: chown d4/d1f/d4a/de4/d78/c9d 12256444 1 2024-09-17T01:07:02.079 INFO:tasks.workunit.client.1.smithi143.stdout:7/737: dread - d4/f62 zero size 2024-09-17T01:07:02.081 INFO:tasks.workunit.client.1.smithi143.stdout:7/738: read d4/d26/dcc/fd2 [261417,123959] 0 2024-09-17T01:07:02.084 INFO:tasks.workunit.client.1.smithi143.stdout:7/739: creat d4/d1f/d4a/d66/db5/fe9 x:0 0 0 2024-09-17T01:07:02.086 INFO:tasks.workunit.client.1.smithi143.stdout:4/561: write da/f32 [1508630,84272] 0 2024-09-17T01:07:02.088 INFO:tasks.workunit.client.1.smithi143.stdout:4/562: write da/d3a/d3e/d5e/fa2 [416116,130758] 0 2024-09-17T01:07:02.090 INFO:tasks.workunit.client.1.smithi143.stdout:4/563: symlink da/d6d/lb3 0 2024-09-17T01:07:02.092 INFO:tasks.workunit.client.1.smithi143.stdout:4/564: symlink da/d3a/d3e/d4a/d8c/lb4 0 2024-09-17T01:07:02.092 INFO:tasks.workunit.client.1.smithi143.stdout:4/565: chown da/d3a/d40/d84/f4b 64298 1 2024-09-17T01:07:02.094 INFO:tasks.workunit.client.1.smithi143.stdout:4/566: symlink da/d3a/d40/daa/lb5 0 2024-09-17T01:07:02.095 INFO:tasks.workunit.client.1.smithi143.stdout:7/740: dread d4/d26/f8a [0,4194304] 0 2024-09-17T01:07:02.098 INFO:tasks.workunit.client.1.smithi143.stdout:4/567: dread da/d3a/d40/d84/f94 [0,4194304] 0 2024-09-17T01:07:02.100 INFO:tasks.workunit.client.1.smithi143.stdout:4/568: read da/f54 [598612,68330] 0 2024-09-17T01:07:02.103 INFO:tasks.workunit.client.1.smithi143.stdout:4/569: mkdir da/d3a/d40/d84/db6 0 2024-09-17T01:07:02.104 INFO:tasks.workunit.client.1.smithi143.stdout:4/570: truncate da/d75/f7b 237712 0 2024-09-17T01:07:02.105 INFO:tasks.workunit.client.1.smithi143.stdout:4/571: truncate da/f1c 1724202 0 2024-09-17T01:07:02.108 INFO:tasks.workunit.client.1.smithi143.stdout:4/572: creat da/d3a/d3e/fb7 x:0 0 0 2024-09-17T01:07:02.110 INFO:tasks.workunit.client.1.smithi143.stdout:4/573: creat da/d3a/d3e/d4a/d8a/fb8 x:0 0 0 2024-09-17T01:07:02.111 INFO:tasks.workunit.client.1.smithi143.stdout:4/574: creat da/d3a/d3e/d5e/d63/fb9 x:0 0 0 2024-09-17T01:07:02.113 INFO:tasks.workunit.client.1.smithi143.stdout:4/575: unlink da/d3a/d3e/d5e/f62 0 2024-09-17T01:07:02.115 INFO:tasks.workunit.client.1.smithi143.stdout:4/576: creat da/d6d/d90/fba x:0 0 0 2024-09-17T01:07:02.117 INFO:tasks.workunit.client.1.smithi143.stdout:4/577: creat da/d3a/d3e/d72/d9e/fbb x:0 0 0 2024-09-17T01:07:02.119 INFO:tasks.workunit.client.1.smithi143.stdout:4/578: mknod da/d3a/d3e/d4a/cbc 0 2024-09-17T01:07:02.119 INFO:tasks.workunit.client.1.smithi143.stdout:4/579: truncate da/d75/f7b 717648 0 2024-09-17T01:07:02.124 INFO:tasks.workunit.client.1.smithi143.stdout:4/580: dwrite da/f20 [4194304,4194304] 0 2024-09-17T01:07:02.126 INFO:tasks.workunit.client.1.smithi143.stdout:4/581: creat da/d3a/d3e/d4a/d8c/fbd x:0 0 0 2024-09-17T01:07:02.127 INFO:tasks.workunit.client.1.smithi143.stdout:4/582: write da/d3a/f79 [459725,86624] 0 2024-09-17T01:07:02.129 INFO:tasks.workunit.client.1.smithi143.stdout:4/583: dread - da/d3a/d3e/d4a/d8a/f99 zero size 2024-09-17T01:07:02.131 INFO:tasks.workunit.client.1.smithi143.stdout:4/584: symlink da/d3a/d40/lbe 0 2024-09-17T01:07:02.134 INFO:tasks.workunit.client.1.smithi143.stdout:4/585: unlink da/f2d 0 2024-09-17T01:07:02.135 INFO:tasks.workunit.client.1.smithi143.stdout:4/586: read da/f20 [6119496,61715] 0 2024-09-17T01:07:02.139 INFO:tasks.workunit.client.1.smithi143.stdout:4/587: dread da/d3a/d3e/d72/da3/fa5 [0,4194304] 0 2024-09-17T01:07:02.140 INFO:tasks.workunit.client.1.smithi143.stdout:4/588: write da/d3a/d3e/fb7 [872065,18749] 0 2024-09-17T01:07:02.141 INFO:tasks.workunit.client.1.smithi143.stdout:4/589: dread - da/d3a/d3e/d4a/d8c/fa0 zero size 2024-09-17T01:07:02.145 INFO:tasks.workunit.client.1.smithi143.stdout:4/590: link da/d3a/d40/c38 da/d6d/d90/cbf 0 2024-09-17T01:07:02.148 INFO:tasks.workunit.client.1.smithi143.stdout:4/591: mkdir da/d3a/d3e/d72/da3/dc0 0 2024-09-17T01:07:02.149 INFO:tasks.workunit.client.1.smithi143.stdout:4/592: write da/f1c [779847,81864] 0 2024-09-17T01:07:02.149 INFO:tasks.workunit.client.0.smithi103.stdout:9/75: symlink d7/dd/l1d 0 2024-09-17T01:07:02.150 INFO:tasks.workunit.client.0.smithi103.stdout:4/77: mknod d9/dc/df/c13 0 2024-09-17T01:07:02.152 INFO:tasks.workunit.client.0.smithi103.stdout:4/78: creat d9/d10/f14 x:0 0 0 2024-09-17T01:07:02.154 INFO:tasks.workunit.client.1.smithi143.stdout:4/593: dwrite da/d3a/d40/f5b [0,4194304] 0 2024-09-17T01:07:02.155 INFO:tasks.workunit.client.0.smithi103.stdout:4/79: write d9/fd [653116,106982] 0 2024-09-17T01:07:02.156 INFO:tasks.workunit.client.1.smithi143.stdout:4/594: chown da/d3a 0 1 2024-09-17T01:07:02.157 INFO:tasks.workunit.client.1.smithi143.stdout:4/595: fsync da/d6d/f76 0 2024-09-17T01:07:02.157 INFO:tasks.workunit.client.0.smithi103.stdout:9/76: dwrite d7/dd/f1c [0,4194304] 0 2024-09-17T01:07:02.159 INFO:tasks.workunit.client.0.smithi103.stdout:4/80: rmdir d9/d10/db 39 2024-09-17T01:07:02.159 INFO:tasks.workunit.client.1.smithi143.stdout:4/596: write da/d68/f87 [929833,42715] 0 2024-09-17T01:07:02.162 INFO:tasks.workunit.client.0.smithi103.stdout:9/77: stat d7/dd/d11/f12 0 2024-09-17T01:07:02.163 INFO:tasks.workunit.client.0.smithi103.stdout:9/78: fsync d7/f19 0 2024-09-17T01:07:02.164 INFO:tasks.workunit.client.1.smithi143.stdout:4/597: creat da/d3a/d40/d84/db6/fc1 x:0 0 0 2024-09-17T01:07:02.165 INFO:tasks.workunit.client.1.smithi143.stdout:4/598: write da/d6d/fa4 [1147287,70994] 0 2024-09-17T01:07:02.168 INFO:tasks.workunit.client.0.smithi103.stdout:9/79: dread d7/dd/f1c [0,4194304] 0 2024-09-17T01:07:02.169 INFO:tasks.workunit.client.0.smithi103.stdout:9/80: stat d7/dd/d11/c13 0 2024-09-17T01:07:02.169 INFO:tasks.workunit.client.1.smithi143.stdout:4/599: getdents da/d3a/d3e/d72/da3/dc0 0 2024-09-17T01:07:02.170 INFO:tasks.workunit.client.0.smithi103.stdout:9/81: mknod d7/dd/d11/c1e 0 2024-09-17T01:07:02.173 INFO:tasks.workunit.client.1.smithi143.stdout:4/600: creat da/d3a/d3e/d72/da3/dc0/fc2 x:0 0 0 2024-09-17T01:07:02.173 INFO:tasks.workunit.client.1.smithi143.stdout:0/587: sync 2024-09-17T01:07:02.177 INFO:tasks.workunit.client.1.smithi143.stdout:4/601: mkdir da/d3a/d40/daa/dc3 0 2024-09-17T01:07:02.178 INFO:tasks.workunit.client.1.smithi143.stdout:4/602: creat da/d3a/d3e/d72/d9e/fc4 x:0 0 0 2024-09-17T01:07:02.180 INFO:tasks.workunit.client.1.smithi143.stdout:0/588: rename d3/d5/d8/d21/d9b/lbe to d3/d68/d8f/lc3 0 2024-09-17T01:07:02.183 INFO:tasks.workunit.client.0.smithi103.stdout:9/82: dwrite d7/dd/d11/fb [0,4194304] 0 2024-09-17T01:07:02.185 INFO:tasks.workunit.client.1.smithi143.stdout:4/603: dwrite da/d6d/f76 [0,4194304] 0 2024-09-17T01:07:02.187 INFO:tasks.workunit.client.0.smithi103.stdout:9/83: getdents d7/dd/d11 0 2024-09-17T01:07:02.188 INFO:tasks.workunit.client.0.smithi103.stdout:9/84: readlink d7/l15 0 2024-09-17T01:07:02.189 INFO:tasks.workunit.client.1.smithi143.stdout:0/589: dwrite d3/d14/d3d/f76 [0,4194304] 0 2024-09-17T01:07:02.189 INFO:tasks.workunit.client.0.smithi103.stdout:9/85: chown d7/fc 1019 1 2024-09-17T01:07:02.191 INFO:tasks.workunit.client.1.smithi143.stdout:0/590: chown d3/d5/d6b/f90 2411 1 2024-09-17T01:07:02.191 INFO:tasks.workunit.client.0.smithi103.stdout:9/86: creat d7/dd/d11/f1f x:0 0 0 2024-09-17T01:07:02.196 INFO:tasks.workunit.client.1.smithi143.stdout:4/604: creat da/d3a/d3e/d72/da3/dc0/fc5 x:0 0 0 2024-09-17T01:07:02.198 INFO:tasks.workunit.client.1.smithi143.stdout:4/605: write da/d6d/d90/fba [984927,5709] 0 2024-09-17T01:07:02.198 INFO:tasks.workunit.client.1.smithi143.stdout:0/591: unlink d3/d5/d8/d21/c33 0 2024-09-17T01:07:02.199 INFO:tasks.workunit.client.1.smithi143.stdout:0/592: dread - d3/d88/fb7 zero size 2024-09-17T01:07:02.203 INFO:tasks.workunit.client.1.smithi143.stdout:4/606: dread da/d3a/d3e/d72/da3/fa5 [0,4194304] 0 2024-09-17T01:07:02.203 INFO:tasks.workunit.client.1.smithi143.stdout:0/593: mkdir d3/d88/d93/dc4 0 2024-09-17T01:07:02.205 INFO:tasks.workunit.client.1.smithi143.stdout:4/607: symlink da/d3a/d40/d84/db6/lc6 0 2024-09-17T01:07:02.208 INFO:tasks.workunit.client.1.smithi143.stdout:4/608: mknod da/d6d/d90/cc7 0 2024-09-17T01:07:02.210 INFO:tasks.workunit.client.1.smithi143.stdout:0/594: link d3/d14/d32/c96 d3/d14/cc5 0 2024-09-17T01:07:02.213 INFO:tasks.workunit.client.1.smithi143.stdout:4/609: link da/d3a/d3e/d5e/d63/d80/l9d da/d3a/d40/lc8 0 2024-09-17T01:07:02.214 INFO:tasks.workunit.client.1.smithi143.stdout:0/595: getdents d3/d14/d32 0 2024-09-17T01:07:02.214 INFO:tasks.workunit.client.1.smithi143.stdout:4/610: dread - da/d6d/f74 zero size 2024-09-17T01:07:02.217 INFO:tasks.workunit.client.0.smithi103.stdout:9/87: write d7/dd/d11/fa [1955569,90810] 0 2024-09-17T01:07:02.217 INFO:tasks.workunit.client.1.smithi143.stdout:4/611: rename da/f73 to da/d3a/d40/d84/db6/fc9 0 2024-09-17T01:07:02.218 INFO:tasks.workunit.client.0.smithi103.stdout:9/88: readlink d7/dd/l17 0 2024-09-17T01:07:02.219 INFO:tasks.workunit.client.1.smithi143.stdout:4/612: mkdir da/d6d/dca 0 2024-09-17T01:07:02.220 INFO:tasks.workunit.client.0.smithi103.stdout:9/89: mkdir d7/dd/d11/d20 0 2024-09-17T01:07:02.222 INFO:tasks.workunit.client.0.smithi103.stdout:9/90: mkdir d7/dd/d11/d21 0 2024-09-17T01:07:02.224 INFO:tasks.workunit.client.1.smithi143.stdout:4/613: mknod da/d68/d9b/ccb 0 2024-09-17T01:07:02.225 INFO:tasks.workunit.client.0.smithi103.stdout:9/91: unlink d7/dd/d11/c1b 0 2024-09-17T01:07:02.232 INFO:tasks.workunit.client.1.smithi143.stdout:0/596: write d3/d5/d8/d27/d31/d4c/f45 [2294051,3077] 0 2024-09-17T01:07:02.235 INFO:tasks.workunit.client.1.smithi143.stdout:0/597: write d3/d68/f70 [490209,119272] 0 2024-09-17T01:07:02.235 INFO:tasks.workunit.client.0.smithi103.stdout:9/92: getdents d7/dd/d11 0 2024-09-17T01:07:02.236 INFO:tasks.workunit.client.1.smithi143.stdout:4/614: dwrite da/f54 [0,4194304] 0 2024-09-17T01:07:02.238 INFO:tasks.workunit.client.1.smithi143.stdout:4/615: truncate da/d3a/d40/f39 4630828 0 2024-09-17T01:07:02.248 INFO:tasks.workunit.client.1.smithi143.stdout:0/598: creat d3/d5/d35/fc6 x:0 0 0 2024-09-17T01:07:02.249 INFO:tasks.workunit.client.1.smithi143.stdout:0/599: dread - d3/d5/d8/d27/d8c/f9c zero size 2024-09-17T01:07:02.252 INFO:tasks.workunit.client.1.smithi143.stdout:0/600: creat d3/d5/d8/d58/fc7 x:0 0 0 2024-09-17T01:07:02.254 INFO:tasks.workunit.client.1.smithi143.stdout:0/601: mknod d3/d5/d8/d27/d31/cc8 0 2024-09-17T01:07:02.256 INFO:tasks.workunit.client.1.smithi143.stdout:0/602: dread d3/d14/fb2 [0,4194304] 0 2024-09-17T01:07:02.257 INFO:tasks.workunit.client.1.smithi143.stdout:0/603: fdatasync d3/d68/f6c 0 2024-09-17T01:07:02.261 INFO:tasks.workunit.client.1.smithi143.stdout:4/616: dwrite da/d68/f5d [0,4194304] 0 2024-09-17T01:07:02.263 INFO:tasks.workunit.client.1.smithi143.stdout:0/604: rename d3/d5/d8/d21/c8a to d3/d5/d8/d58/cc9 0 2024-09-17T01:07:02.267 INFO:tasks.workunit.client.1.smithi143.stdout:4/617: rename da/d3a/d3e/d4a/c6b to da/d3a/d3e/d5e/ccc 0 2024-09-17T01:07:02.268 INFO:tasks.workunit.client.1.smithi143.stdout:4/618: write da/f31 [1476873,104639] 0 2024-09-17T01:07:02.275 INFO:tasks.workunit.client.1.smithi143.stdout:4/619: dwrite da/d6d/d90/fba [0,4194304] 0 2024-09-17T01:07:02.278 INFO:tasks.workunit.client.1.smithi143.stdout:4/620: mkdir da/d3a/d40/daa/dc3/dcd 0 2024-09-17T01:07:02.279 INFO:tasks.workunit.client.1.smithi143.stdout:4/621: readlink da/d3a/d40/l3d 0 2024-09-17T01:07:02.280 INFO:tasks.workunit.client.1.smithi143.stdout:4/622: read - da/d3a/d3e/d4a/d8a/fb8 zero size 2024-09-17T01:07:02.281 INFO:tasks.workunit.client.1.smithi143.stdout:4/623: fdatasync da/d3a/d3e/d72/d9e/fc4 0 2024-09-17T01:07:02.283 INFO:tasks.workunit.client.1.smithi143.stdout:4/624: creat da/d3a/d3e/d72/d9e/fce x:0 0 0 2024-09-17T01:07:02.284 INFO:tasks.workunit.client.1.smithi143.stdout:4/625: readlink da/d3a/d3e/d4a/la7 0 2024-09-17T01:07:02.290 INFO:tasks.workunit.client.1.smithi143.stdout:4/626: dwrite da/d3a/f79 [0,4194304] 0 2024-09-17T01:07:02.293 INFO:tasks.workunit.client.1.smithi143.stdout:4/627: creat da/d3a/d7c/fcf x:0 0 0 2024-09-17T01:07:02.324 INFO:tasks.workunit.client.1.smithi143.stdout:6/525: sync 2024-09-17T01:07:02.331 INFO:tasks.workunit.client.1.smithi143.stdout:6/526: dwrite d2/d17/d6e/d26/d46/d66/f88 [0,4194304] 0 2024-09-17T01:07:02.369 INFO:tasks.workunit.client.1.smithi143.stdout:6/527: mkdir d2/d30/d45/d70/da5 0 2024-09-17T01:07:02.371 INFO:tasks.workunit.client.1.smithi143.stdout:6/528: symlink d2/df/d20/d2c/d75/la6 0 2024-09-17T01:07:02.410 INFO:tasks.workunit.client.0.smithi103.stdout:0/51: sync 2024-09-17T01:07:02.412 INFO:tasks.workunit.client.0.smithi103.stdout:0/52: mkdir dd/df 0 2024-09-17T01:07:02.414 INFO:tasks.workunit.client.0.smithi103.stdout:0/53: mkdir dd/d10 0 2024-09-17T01:07:02.416 INFO:tasks.workunit.client.0.smithi103.stdout:0/54: truncate fc 166739 0 2024-09-17T01:07:02.421 INFO:tasks.workunit.client.1.smithi143.stdout:9/570: sync 2024-09-17T01:07:02.421 INFO:tasks.workunit.client.1.smithi143.stdout:1/625: sync 2024-09-17T01:07:02.423 INFO:tasks.workunit.client.1.smithi143.stdout:9/571: chown d3/d39/d42/d58/fa5 3283425 1 2024-09-17T01:07:02.423 INFO:tasks.workunit.client.1.smithi143.stdout:1/626: read d0/d6/d64/f80 [2052421,125] 0 2024-09-17T01:07:02.428 INFO:tasks.workunit.client.1.smithi143.stdout:1/627: creat d0/d6/d43/d6d/d8b/fcf x:0 0 0 2024-09-17T01:07:02.430 INFO:tasks.workunit.client.1.smithi143.stdout:9/572: dwrite d3/d3d/d48/fa7 [0,4194304] 0 2024-09-17T01:07:02.431 INFO:tasks.workunit.client.1.smithi143.stdout:1/628: mkdir d0/d6/d43/d6d/d8b/dd0 0 2024-09-17T01:07:02.434 INFO:tasks.workunit.client.1.smithi143.stdout:1/629: write d0/d6/d43/d6a/df/d6e/d2/fa6 [977150,51709] 0 2024-09-17T01:07:02.439 INFO:tasks.workunit.client.1.smithi143.stdout:9/573: link d3/d39/d6a/d26/l35 d3/d39/d42/d80/lbe 0 2024-09-17T01:07:02.440 INFO:tasks.workunit.client.1.smithi143.stdout:1/630: creat d0/d6/d43/d6a/df/d6e/d2/d39/d6b/d9d/fd1 x:0 0 0 2024-09-17T01:07:02.441 INFO:tasks.workunit.client.1.smithi143.stdout:9/574: mkdir d3/d39/d42/d58/dbf 0 2024-09-17T01:07:02.442 INFO:tasks.workunit.client.1.smithi143.stdout:9/575: write d3/d16/f45 [1490933,113467] 0 2024-09-17T01:07:02.444 INFO:tasks.workunit.client.1.smithi143.stdout:1/631: symlink d0/dc/d57/dc2/ld2 0 2024-09-17T01:07:02.451 INFO:tasks.workunit.client.1.smithi143.stdout:6/529: dwrite d2/df/d20/d2c/d38/f39 [0,4194304] 0 2024-09-17T01:07:02.454 INFO:tasks.workunit.client.1.smithi143.stdout:9/576: dwrite d3/d3d/f43 [0,4194304] 0 2024-09-17T01:07:02.455 INFO:tasks.workunit.client.1.smithi143.stdout:1/632: mkdir d0/d6/d43/d47/dd3 0 2024-09-17T01:07:02.458 INFO:tasks.workunit.client.1.smithi143.stdout:9/577: rmdir d3/d39 39 2024-09-17T01:07:02.460 INFO:tasks.workunit.client.1.smithi143.stdout:1/633: getdents d0/d6/d43/d6d/d8b/dd0 0 2024-09-17T01:07:02.466 INFO:tasks.workunit.client.1.smithi143.stdout:9/578: rename d3/d39/d6a/d9/l28 to d3/d39/d42/d58/dbf/lc0 0 2024-09-17T01:07:02.467 INFO:tasks.workunit.client.1.smithi143.stdout:1/634: symlink d0/d6/d43/d47/d68/d7b/daf/ld4 0 2024-09-17T01:07:02.468 INFO:tasks.workunit.client.1.smithi143.stdout:9/579: creat d3/d16/d3e/d51/d52/fc1 x:0 0 0 2024-09-17T01:07:02.470 INFO:tasks.workunit.client.1.smithi143.stdout:9/580: readlink d3/d39/d42/d58/d5a/d5e/lb9 0 2024-09-17T01:07:02.474 INFO:tasks.workunit.client.0.smithi103.stdout:0/55: write fc [1136590,22694] 0 2024-09-17T01:07:02.474 INFO:tasks.workunit.client.1.smithi143.stdout:6/530: write d2/fa [1141296,59472] 0 2024-09-17T01:07:02.476 INFO:tasks.workunit.client.1.smithi143.stdout:1/635: write d0/dc/d57/fba [2191708,92501] 0 2024-09-17T01:07:02.477 INFO:tasks.workunit.client.0.smithi103.stdout:0/56: truncate f6 3921957 0 2024-09-17T01:07:02.478 INFO:tasks.workunit.client.0.smithi103.stdout:2/32: sync 2024-09-17T01:07:02.479 INFO:tasks.workunit.client.1.smithi143.stdout:9/581: dwrite d3/d39/d6a/d26/f69 [0,4194304] 0 2024-09-17T01:07:02.479 INFO:tasks.workunit.client.0.smithi103.stdout:2/33: write d6/f8 [2121271,118387] 0 2024-09-17T01:07:02.481 INFO:tasks.workunit.client.1.smithi143.stdout:9/582: readlink l2 0 2024-09-17T01:07:02.482 INFO:tasks.workunit.client.1.smithi143.stdout:1/636: truncate d0/d6/d43/d6a/df/d6e/d2/f28 1035332 0 2024-09-17T01:07:02.486 INFO:tasks.workunit.client.1.smithi143.stdout:6/531: rename d2/d30/d45/d4a/d5e/d7c/f8f to d2/d17/d6e/fa7 0 2024-09-17T01:07:02.488 INFO:tasks.workunit.client.1.smithi143.stdout:9/583: symlink d3/d3d/d48/lc2 0 2024-09-17T01:07:02.490 INFO:tasks.workunit.client.1.smithi143.stdout:6/532: mkdir d2/df/d18/da8 0 2024-09-17T01:07:02.492 INFO:tasks.workunit.client.1.smithi143.stdout:1/637: unlink d0/d6/d43/d6a/df/d27/f2e 0 2024-09-17T01:07:02.493 INFO:tasks.workunit.client.1.smithi143.stdout:6/533: chown d2/df/d20/f61 287896852 1 2024-09-17T01:07:02.493 INFO:tasks.workunit.client.0.smithi103.stdout:2/34: write d6/f7 [2771474,7832] 0 2024-09-17T01:07:02.494 INFO:tasks.workunit.client.1.smithi143.stdout:1/638: truncate d0/dc/d74/d94/f9a 1094519 0 2024-09-17T01:07:02.494 INFO:tasks.workunit.client.0.smithi103.stdout:2/35: readlink l2 0 2024-09-17T01:07:02.494 INFO:tasks.workunit.client.0.smithi103.stdout:0/57: dwrite f5 [0,4194304] 0 2024-09-17T01:07:02.497 INFO:tasks.workunit.client.1.smithi143.stdout:1/639: mknod d0/d6/d43/d6d/d8b/cd5 0 2024-09-17T01:07:02.497 INFO:tasks.workunit.client.0.smithi103.stdout:2/36: unlink c1 0 2024-09-17T01:07:02.498 INFO:tasks.workunit.client.0.smithi103.stdout:0/58: symlink dd/l11 0 2024-09-17T01:07:02.498 INFO:tasks.workunit.client.0.smithi103.stdout:0/59: chown f8 17365 1 2024-09-17T01:07:02.499 INFO:tasks.workunit.client.1.smithi143.stdout:1/640: mknod d0/d6/d43/d6d/d8b/cd6 0 2024-09-17T01:07:02.499 INFO:tasks.workunit.client.0.smithi103.stdout:2/37: fdatasync f4 0 2024-09-17T01:07:02.500 INFO:tasks.workunit.client.0.smithi103.stdout:2/38: read f4 [1545000,34951] 0 2024-09-17T01:07:02.501 INFO:tasks.workunit.client.0.smithi103.stdout:0/60: rename lb to dd/df/l12 0 2024-09-17T01:07:02.505 INFO:tasks.workunit.client.1.smithi143.stdout:8/601: sync 2024-09-17T01:07:02.506 INFO:tasks.workunit.client.1.smithi143.stdout:2/564: sync 2024-09-17T01:07:02.506 INFO:tasks.workunit.client.1.smithi143.stdout:5/564: sync 2024-09-17T01:07:02.506 INFO:tasks.workunit.client.1.smithi143.stdout:3/600: sync 2024-09-17T01:07:02.511 INFO:tasks.workunit.client.0.smithi103.stdout:2/39: truncate f4 1605531 0 2024-09-17T01:07:02.512 INFO:tasks.workunit.client.0.smithi103.stdout:0/61: rmdir dd/d10 0 2024-09-17T01:07:02.514 INFO:tasks.workunit.client.0.smithi103.stdout:2/40: creat d6/fb x:0 0 0 2024-09-17T01:07:02.515 INFO:tasks.workunit.client.0.smithi103.stdout:2/41: read f5 [546775,87088] 0 2024-09-17T01:07:02.515 INFO:tasks.workunit.client.0.smithi103.stdout:0/62: creat dd/df/f13 x:0 0 0 2024-09-17T01:07:02.517 INFO:tasks.workunit.client.1.smithi143.stdout:5/565: fdatasync d1/d46/df/d53/d74/d9a/d9c/fd3 0 2024-09-17T01:07:02.517 INFO:tasks.workunit.client.1.smithi143.stdout:1/641: creat d0/dc/fd7 x:0 0 0 2024-09-17T01:07:02.518 INFO:tasks.workunit.client.0.smithi103.stdout:2/42: mknod d6/da/cc 0 2024-09-17T01:07:02.519 INFO:tasks.workunit.client.1.smithi143.stdout:8/602: dread d9/d12/d38/f7f [0,4194304] 0 2024-09-17T01:07:02.519 INFO:tasks.workunit.client.1.smithi143.stdout:9/584: dread d3/d3d/d48/f59 [0,4194304] 0 2024-09-17T01:07:02.521 INFO:tasks.workunit.client.1.smithi143.stdout:2/565: link d0/d10/c4b d0/d10/d58/d5a/cb2 0 2024-09-17T01:07:02.522 INFO:tasks.workunit.client.0.smithi103.stdout:0/63: dwrite fc [0,4194304] 0 2024-09-17T01:07:02.522 INFO:tasks.workunit.client.1.smithi143.stdout:1/642: mkdir d0/d6/d43/d47/dd8 0 2024-09-17T01:07:02.527 INFO:tasks.workunit.client.1.smithi143.stdout:1/643: write d0/d6/f1f [2753515,95658] 0 2024-09-17T01:07:02.528 INFO:tasks.workunit.client.0.smithi103.stdout:0/64: truncate f6 4615331 0 2024-09-17T01:07:02.530 INFO:tasks.workunit.client.1.smithi143.stdout:8/603: symlink d9/d12/ld5 0 2024-09-17T01:07:02.537 INFO:tasks.workunit.client.1.smithi143.stdout:8/604: mknod d9/d23/db4/d56/d66/cd6 0 2024-09-17T01:07:02.538 INFO:tasks.workunit.client.1.smithi143.stdout:3/601: truncate d6/d1c/d33/d3f/d79/f9a 451475 0 2024-09-17T01:07:02.539 INFO:tasks.workunit.client.1.smithi143.stdout:9/585: rmdir d3/d16/d3e/d51/d88 0 2024-09-17T01:07:02.541 INFO:tasks.workunit.client.1.smithi143.stdout:2/566: creat d0/d10/d58/d5a/d5b/d4c/fb3 x:0 0 0 2024-09-17T01:07:02.542 INFO:tasks.workunit.client.1.smithi143.stdout:5/566: dread d1/d46/df/d23/f26 [0,4194304] 0 2024-09-17T01:07:02.542 INFO:tasks.workunit.client.1.smithi143.stdout:8/605: mkdir d9/d12/d38/d58/dd7 0 2024-09-17T01:07:02.544 INFO:tasks.workunit.client.1.smithi143.stdout:2/567: unlink d0/d44/d6a/l7b 0 2024-09-17T01:07:02.548 INFO:tasks.workunit.client.0.smithi103.stdout:0/65: truncate fc 4002398 0 2024-09-17T01:07:02.548 INFO:tasks.workunit.client.0.smithi103.stdout:0/66: readlink l9 0 2024-09-17T01:07:02.548 INFO:tasks.workunit.client.0.smithi103.stdout:0/67: fdatasync f5 0 2024-09-17T01:07:02.548 INFO:tasks.workunit.client.1.smithi143.stdout:5/567: mknod d1/d46/df/d23/d4f/d7d/d92/cd9 0 2024-09-17T01:07:02.551 INFO:tasks.workunit.client.0.smithi103.stdout:0/68: creat dd/f14 x:0 0 0 2024-09-17T01:07:02.552 INFO:tasks.workunit.client.1.smithi143.stdout:9/586: dread d3/d16/d3e/d51/f63 [0,4194304] 0 2024-09-17T01:07:02.552 INFO:tasks.workunit.client.0.smithi103.stdout:0/69: creat dd/f15 x:0 0 0 2024-09-17T01:07:02.553 INFO:tasks.workunit.client.1.smithi143.stdout:3/602: dwrite d6/d1c/d4b/f8e [0,4194304] 0 2024-09-17T01:07:02.553 INFO:tasks.workunit.client.1.smithi143.stdout:1/644: dread d0/d6/d43/d47/d68/d7b/f9f [0,4194304] 0 2024-09-17T01:07:02.553 INFO:tasks.workunit.client.0.smithi103.stdout:0/70: truncate dd/f15 720131 0 2024-09-17T01:07:02.555 INFO:tasks.workunit.client.1.smithi143.stdout:5/568: write d1/d46/df/d23/f72 [1465486,43021] 0 2024-09-17T01:07:02.556 INFO:tasks.workunit.client.0.smithi103.stdout:0/71: rename dd/ce to dd/c16 0 2024-09-17T01:07:02.556 INFO:tasks.workunit.client.0.smithi103.stdout:0/72: stat dd/l11 0 2024-09-17T01:07:02.557 INFO:tasks.workunit.client.0.smithi103.stdout:0/73: fsync f5 0 2024-09-17T01:07:02.558 INFO:tasks.workunit.client.1.smithi143.stdout:1/645: fdatasync d0/d6/f5f 0 2024-09-17T01:07:02.559 INFO:tasks.workunit.client.1.smithi143.stdout:3/603: fdatasync d6/d1c/f2a 0 2024-09-17T01:07:02.560 INFO:tasks.workunit.client.1.smithi143.stdout:3/604: stat d6/d1c/d33/fb5 0 2024-09-17T01:07:02.562 INFO:tasks.workunit.client.1.smithi143.stdout:3/605: dread - d6/d1c/d33/d3f/f7f zero size 2024-09-17T01:07:02.562 INFO:tasks.workunit.client.1.smithi143.stdout:9/587: rename d3/d16 to d3/d39/d6a/dc3 0 2024-09-17T01:07:02.564 INFO:tasks.workunit.client.1.smithi143.stdout:3/606: write d6/d1c/d33/d3f/d5c/da1/f8c [557802,59111] 0 2024-09-17T01:07:02.567 INFO:tasks.workunit.client.1.smithi143.stdout:1/646: fsync d0/d6/d43/d6a/df/d6e/d2/f2a 0 2024-09-17T01:07:02.568 INFO:tasks.workunit.client.1.smithi143.stdout:2/568: getdents d0/d10/d58/d5a/d5b/d4c/d77 0 2024-09-17T01:07:02.570 INFO:tasks.workunit.client.1.smithi143.stdout:5/569: mknod d1/d46/df/d23/d4f/d7d/dcf/dc5/cda 0 2024-09-17T01:07:02.573 INFO:tasks.workunit.client.1.smithi143.stdout:9/588: dwrite d3/d39/d42/d58/d5a/fb6 [0,4194304] 0 2024-09-17T01:07:02.573 INFO:tasks.workunit.client.0.smithi103.stdout:0/74: write f6 [4486090,82484] 0 2024-09-17T01:07:02.576 INFO:tasks.workunit.client.1.smithi143.stdout:5/570: fdatasync d1/d46/d6e/db7/fcd 0 2024-09-17T01:07:02.576 INFO:tasks.workunit.client.1.smithi143.stdout:1/647: creat d0/d6/d43/d47/d88/fd9 x:0 0 0 2024-09-17T01:07:02.577 INFO:tasks.workunit.client.1.smithi143.stdout:8/606: dread d9/d12/d38/f43 [0,4194304] 0 2024-09-17T01:07:02.577 INFO:tasks.workunit.client.0.smithi103.stdout:0/75: mknod dd/c17 0 2024-09-17T01:07:02.578 INFO:tasks.workunit.client.0.smithi103.stdout:0/76: chown f5 7717 1 2024-09-17T01:07:02.578 INFO:tasks.workunit.client.1.smithi143.stdout:1/648: chown d0/d6/d43/d6d/d8b 5471 1 2024-09-17T01:07:02.580 INFO:tasks.workunit.client.1.smithi143.stdout:3/607: link d6/f73 d6/d1c/d33/d3f/fbf 0 2024-09-17T01:07:02.581 INFO:tasks.workunit.client.0.smithi103.stdout:0/77: write fc [2946927,93522] 0 2024-09-17T01:07:02.582 INFO:tasks.workunit.client.0.smithi103.stdout:0/78: chown dd/l11 80587 1 2024-09-17T01:07:02.583 INFO:tasks.workunit.client.1.smithi143.stdout:2/569: dwrite d0/d2/d21/d22/f41 [0,4194304] 0 2024-09-17T01:07:02.583 INFO:tasks.workunit.client.1.smithi143.stdout:8/607: symlink d9/d23/d4f/ld8 0 2024-09-17T01:07:02.584 INFO:tasks.workunit.client.0.smithi103.stdout:0/79: creat dd/df/f18 x:0 0 0 2024-09-17T01:07:02.586 INFO:tasks.workunit.client.1.smithi143.stdout:2/570: write d0/d10/d58/d5a/f5f [779593,40998] 0 2024-09-17T01:07:02.586 INFO:tasks.workunit.client.1.smithi143.stdout:8/608: rmdir d9/d23 39 2024-09-17T01:07:02.586 INFO:tasks.workunit.client.0.smithi103.stdout:0/80: creat dd/df/f19 x:0 0 0 2024-09-17T01:07:02.586 INFO:tasks.workunit.client.0.smithi103.stdout:0/81: dread - dd/f14 zero size 2024-09-17T01:07:02.587 INFO:tasks.workunit.client.1.smithi143.stdout:5/571: creat d1/d46/df/fdb x:0 0 0 2024-09-17T01:07:02.587 INFO:tasks.workunit.client.1.smithi143.stdout:2/571: fsync d0/d2/d21/f49 0 2024-09-17T01:07:02.590 INFO:tasks.workunit.client.1.smithi143.stdout:9/589: rename d3/d39/d6a/d9/f37 to d3/d39/d42/fc4 0 2024-09-17T01:07:02.590 INFO:tasks.workunit.client.0.smithi103.stdout:0/82: mknod dd/c1a 0 2024-09-17T01:07:02.593 INFO:tasks.workunit.client.1.smithi143.stdout:8/609: symlink d9/de/d53/d75/daf/ld9 0 2024-09-17T01:07:02.595 INFO:tasks.workunit.client.1.smithi143.stdout:2/572: rmdir d0/d2/d21/d84/d8d 39 2024-09-17T01:07:02.596 INFO:tasks.workunit.client.1.smithi143.stdout:8/610: mkdir d9/d12/d38/d58/dda 0 2024-09-17T01:07:02.599 INFO:tasks.workunit.client.1.smithi143.stdout:8/611: write d9/de/d53/f68 [2425456,110084] 0 2024-09-17T01:07:02.604 INFO:tasks.workunit.client.1.smithi143.stdout:8/612: creat d9/d12/d38/dba/fdb x:0 0 0 2024-09-17T01:07:02.605 INFO:tasks.workunit.client.1.smithi143.stdout:2/573: dwrite d0/d2/d21/d22/f3c [0,4194304] 0 2024-09-17T01:07:02.606 INFO:tasks.workunit.client.1.smithi143.stdout:8/613: dread - d9/d23/fd0 zero size 2024-09-17T01:07:02.608 INFO:tasks.workunit.client.1.smithi143.stdout:3/608: write d6/d1c/d33/d41/d2b/f3d [324734,79001] 0 2024-09-17T01:07:02.611 INFO:tasks.workunit.client.1.smithi143.stdout:3/609: write d6/d1c/d33/d3f/d5c/da1/f8c [905855,68985] 0 2024-09-17T01:07:02.611 INFO:tasks.workunit.client.1.smithi143.stdout:9/590: dread d3/d39/d6a/dc3/f45 [0,4194304] 0 2024-09-17T01:07:02.611 INFO:tasks.workunit.client.1.smithi143.stdout:8/614: creat d9/d12/fdc x:0 0 0 2024-09-17T01:07:02.613 INFO:tasks.workunit.client.1.smithi143.stdout:3/610: readlink d6/d1c/d33/d41/d2b/l49 0 2024-09-17T01:07:02.613 INFO:tasks.workunit.client.1.smithi143.stdout:2/574: getdents d0/d2/d21 0 2024-09-17T01:07:02.618 INFO:tasks.workunit.client.1.smithi143.stdout:3/611: unlink d6/d1c/d33/d41/d2b/f77 0 2024-09-17T01:07:02.620 INFO:tasks.workunit.client.1.smithi143.stdout:8/615: getdents d9/d12/d38/d58/dd7 0 2024-09-17T01:07:02.623 INFO:tasks.workunit.client.1.smithi143.stdout:2/575: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/fb4 x:0 0 0 2024-09-17T01:07:02.624 INFO:tasks.workunit.client.1.smithi143.stdout:5/572: dwrite d1/d46/df/d23/d4f/d7d/f98 [0,4194304] 0 2024-09-17T01:07:02.628 INFO:tasks.workunit.client.1.smithi143.stdout:9/591: dwrite d3/d39/d6a/d9/f49 [0,4194304] 0 2024-09-17T01:07:02.629 INFO:tasks.workunit.client.1.smithi143.stdout:8/616: rename d9/d23/db4/f76 to d9/d23/d4f/fdd 0 2024-09-17T01:07:02.630 INFO:tasks.workunit.client.1.smithi143.stdout:8/617: write d9/d26/f3e [3936270,5023] 0 2024-09-17T01:07:02.632 INFO:tasks.workunit.client.1.smithi143.stdout:2/576: mknod d0/d44/cb5 0 2024-09-17T01:07:02.637 INFO:tasks.workunit.client.1.smithi143.stdout:5/573: creat d1/d46/df/d23/d4f/d7d/d92/dad/fdc x:0 0 0 2024-09-17T01:07:02.639 INFO:tasks.workunit.client.1.smithi143.stdout:2/577: symlink d0/d10/d58/d5a/d5b/d4c/d71/lb6 0 2024-09-17T01:07:02.640 INFO:tasks.workunit.client.1.smithi143.stdout:5/574: stat d1/d46/df/d23/d4f/d7d/d92/dad/lae 0 2024-09-17T01:07:02.640 INFO:tasks.workunit.client.1.smithi143.stdout:9/592: getdents d3/d39/d42/d58/dbf 0 2024-09-17T01:07:02.641 INFO:tasks.workunit.client.1.smithi143.stdout:9/593: stat d3/d39/d42/fc4 0 2024-09-17T01:07:02.642 INFO:tasks.workunit.client.1.smithi143.stdout:2/578: creat d0/d10/d56/fb7 x:0 0 0 2024-09-17T01:07:02.644 INFO:tasks.workunit.client.1.smithi143.stdout:9/594: write d3/d39/d6a/d26/fb5 [856109,123199] 0 2024-09-17T01:07:02.644 INFO:tasks.workunit.client.1.smithi143.stdout:5/575: mkdir d1/d46/d9b/daa/ddd 0 2024-09-17T01:07:02.648 INFO:tasks.workunit.client.1.smithi143.stdout:3/612: dread d6/d1c/d4b/d57/f81 [0,4194304] 0 2024-09-17T01:07:02.649 INFO:tasks.workunit.client.1.smithi143.stdout:9/595: getdents d3/d39/d42/dab 0 2024-09-17T01:07:02.651 INFO:tasks.workunit.client.1.smithi143.stdout:5/576: link d1/d46/df/d23/d4f/d7d/cb6 d1/d46/d9d/cde 0 2024-09-17T01:07:02.652 INFO:tasks.workunit.client.1.smithi143.stdout:9/596: stat d3/c40 0 2024-09-17T01:07:02.653 INFO:tasks.workunit.client.1.smithi143.stdout:3/613: creat d6/d1c/d33/d5d/fc0 x:0 0 0 2024-09-17T01:07:02.654 INFO:tasks.workunit.client.1.smithi143.stdout:5/577: readlink d1/d46/df/d1f/d9f/la8 0 2024-09-17T01:07:02.656 INFO:tasks.workunit.client.1.smithi143.stdout:9/597: write d3/d39/d6a/d26/fb5 [1796544,73074] 0 2024-09-17T01:07:02.658 INFO:tasks.workunit.client.1.smithi143.stdout:2/579: dwrite d0/f6e [0,4194304] 0 2024-09-17T01:07:02.659 INFO:tasks.workunit.client.1.smithi143.stdout:5/578: chown d1/d46/df/d23/d4f/d82/f64 12425 1 2024-09-17T01:07:02.660 INFO:tasks.workunit.client.1.smithi143.stdout:5/579: fdatasync d1/d46/f79 0 2024-09-17T01:07:02.661 INFO:tasks.workunit.client.1.smithi143.stdout:9/598: mkdir d3/d39/d42/d58/d5a/d5e/d99/dc5 0 2024-09-17T01:07:02.666 INFO:tasks.workunit.client.1.smithi143.stdout:5/580: creat d1/d46/df/d23/d4f/d7d/d92/fdf x:0 0 0 2024-09-17T01:07:02.666 INFO:tasks.workunit.client.1.smithi143.stdout:2/580: creat d0/d2/d21/d84/d8d/fb8 x:0 0 0 2024-09-17T01:07:02.667 INFO:tasks.workunit.client.1.smithi143.stdout:8/618: dread d9/d23/db4/f6c [4194304,4194304] 0 2024-09-17T01:07:02.669 INFO:tasks.workunit.client.1.smithi143.stdout:5/581: rmdir d1/d46/d9d 39 2024-09-17T01:07:02.671 INFO:tasks.workunit.client.1.smithi143.stdout:0/605: sync 2024-09-17T01:07:02.671 INFO:tasks.workunit.client.1.smithi143.stdout:4/628: sync 2024-09-17T01:07:02.671 INFO:tasks.workunit.client.1.smithi143.stdout:7/741: sync 2024-09-17T01:07:02.672 INFO:tasks.workunit.client.1.smithi143.stdout:8/619: rename d9 to d9/d12/d38/d7a/d8f/dde 22 2024-09-17T01:07:02.675 INFO:tasks.workunit.client.0.smithi103.stdout:3/100: sync 2024-09-17T01:07:02.675 INFO:tasks.workunit.client.0.smithi103.stdout:7/95: sync 2024-09-17T01:07:02.675 INFO:tasks.workunit.client.0.smithi103.stdout:5/28: sync 2024-09-17T01:07:02.675 INFO:tasks.workunit.client.0.smithi103.stdout:4/81: sync 2024-09-17T01:07:02.676 INFO:tasks.workunit.client.0.smithi103.stdout:8/26: sync 2024-09-17T01:07:02.676 INFO:tasks.workunit.client.0.smithi103.stdout:9/93: sync 2024-09-17T01:07:02.676 INFO:tasks.workunit.client.0.smithi103.stdout:6/24: sync 2024-09-17T01:07:02.676 INFO:tasks.workunit.client.0.smithi103.stdout:1/59: sync 2024-09-17T01:07:02.676 INFO:tasks.workunit.client.0.smithi103.stdout:8/27: dwrite - no filename 2024-09-17T01:07:02.676 INFO:tasks.workunit.client.1.smithi143.stdout:3/614: dwrite d6/f73 [0,4194304] 0 2024-09-17T01:07:02.677 INFO:tasks.workunit.client.0.smithi103.stdout:3/101: chown d3/c10 42 1 2024-09-17T01:07:02.678 INFO:tasks.workunit.client.0.smithi103.stdout:3/102: fsync d3/f15 0 2024-09-17T01:07:02.678 INFO:tasks.workunit.client.0.smithi103.stdout:5/29: mkdir d6/db 0 2024-09-17T01:07:02.679 INFO:tasks.workunit.client.0.smithi103.stdout:6/25: mknod d3/c8 0 2024-09-17T01:07:02.679 INFO:tasks.workunit.client.0.smithi103.stdout:3/103: stat d3/d16/f1a 0 2024-09-17T01:07:02.681 INFO:tasks.workunit.client.1.smithi143.stdout:9/599: dwrite d3/d39/d42/d58/d5a/d5e/d99/f5b [4194304,4194304] 0 2024-09-17T01:07:02.681 INFO:tasks.workunit.client.1.smithi143.stdout:8/620: creat d9/d12/d4b/fdf x:0 0 0 2024-09-17T01:07:02.684 INFO:tasks.workunit.client.0.smithi103.stdout:4/82: fsync f7 0 2024-09-17T01:07:02.684 INFO:tasks.workunit.client.1.smithi143.stdout:2/581: rename d0/d10/f16 to d0/d2/d21/d84/d8d/fb9 0 2024-09-17T01:07:02.685 INFO:tasks.workunit.client.0.smithi103.stdout:7/96: dwrite d4/f5 [0,4194304] 0 2024-09-17T01:07:02.687 INFO:tasks.workunit.client.0.smithi103.stdout:7/97: write d4/d11/f19 [1233667,36753] 0 2024-09-17T01:07:02.687 INFO:tasks.workunit.client.0.smithi103.stdout:9/94: truncate d7/dd/f16 247835 0 2024-09-17T01:07:02.688 INFO:tasks.workunit.client.1.smithi143.stdout:0/606: write d3/d5/d8/d21/f26 [3959077,59159] 0 2024-09-17T01:07:02.691 INFO:tasks.workunit.client.0.smithi103.stdout:1/60: creat d2/de/f11 x:0 0 0 2024-09-17T01:07:02.692 INFO:tasks.workunit.client.0.smithi103.stdout:3/104: unlink d3/l13 0 2024-09-17T01:07:02.693 INFO:tasks.workunit.client.0.smithi103.stdout:3/105: chown d3/c10 384 1 2024-09-17T01:07:02.693 INFO:tasks.workunit.client.0.smithi103.stdout:6/26: truncate f1 364678 0 2024-09-17T01:07:02.693 INFO:tasks.workunit.client.1.smithi143.stdout:5/582: symlink d1/d46/df/d53/d74/d9a/d9c/le0 0 2024-09-17T01:07:02.694 INFO:tasks.workunit.client.1.smithi143.stdout:2/582: write d0/f9c [478271,68008] 0 2024-09-17T01:07:02.694 INFO:tasks.workunit.client.0.smithi103.stdout:4/83: symlink d9/dc/l15 0 2024-09-17T01:07:02.695 INFO:tasks.workunit.client.1.smithi143.stdout:5/583: readlink d1/d46/df/l5a 0 2024-09-17T01:07:02.696 INFO:tasks.workunit.client.0.smithi103.stdout:5/30: symlink d6/db/lc 0 2024-09-17T01:07:02.697 INFO:tasks.workunit.client.0.smithi103.stdout:1/61: mknod d2/c12 0 2024-09-17T01:07:02.701 INFO:tasks.workunit.client.1.smithi143.stdout:9/600: unlink d3/d39/d42/d58/d5a/d5e/fb2 0 2024-09-17T01:07:02.702 INFO:tasks.workunit.client.1.smithi143.stdout:7/742: dwrite d4/d1f/d4a/de4/fd7 [0,4194304] 0 2024-09-17T01:07:02.702 INFO:tasks.workunit.client.0.smithi103.stdout:9/95: rename d7/dd/f1c to d7/f22 0 2024-09-17T01:07:02.703 INFO:tasks.workunit.client.1.smithi143.stdout:4/629: dwrite da/d3a/d40/f27 [0,4194304] 0 2024-09-17T01:07:02.704 INFO:tasks.workunit.client.0.smithi103.stdout:1/62: dread d2/fb [0,4194304] 0 2024-09-17T01:07:02.705 INFO:tasks.workunit.client.1.smithi143.stdout:5/584: mkdir d1/d46/df/d53/de1 0 2024-09-17T01:07:02.705 INFO:tasks.workunit.client.0.smithi103.stdout:3/106: rename d3/l5 to d3/d16/l23 0 2024-09-17T01:07:02.708 INFO:tasks.workunit.client.1.smithi143.stdout:7/743: symlink d4/d1f/d4a/d66/d86/lea 0 2024-09-17T01:07:02.710 INFO:tasks.workunit.client.1.smithi143.stdout:7/744: chown d4/f62 14596487 1 2024-09-17T01:07:02.747 INFO:tasks.workunit.client.1.smithi143.stdout:0/607: dread d3/d14/d32/f38 [0,4194304] 0 2024-09-17T01:07:02.765 INFO:tasks.workunit.client.1.smithi143.stdout:1/649: sync 2024-09-17T01:07:02.765 INFO:tasks.workunit.client.1.smithi143.stdout:6/534: sync 2024-09-17T01:07:02.770 INFO:tasks.workunit.client.1.smithi143.stdout:1/650: dwrite d0/dc/f82 [0,4194304] 0 2024-09-17T01:07:02.788 INFO:tasks.workunit.client.0.smithi103.stdout:1/63: mknod d2/d7/c13 0 2024-09-17T01:07:02.790 INFO:tasks.workunit.client.1.smithi143.stdout:2/583: link d0/d2/f14 d0/d10/fba 0 2024-09-17T01:07:02.792 INFO:tasks.workunit.client.1.smithi143.stdout:5/585: mkdir d1/d46/df/d1f/d66/d70/de2 0 2024-09-17T01:07:02.793 INFO:tasks.workunit.client.1.smithi143.stdout:5/586: read - d1/d46/df/d23/d4f/d7d/d92/dad/fdc zero size 2024-09-17T01:07:02.795 INFO:tasks.workunit.client.1.smithi143.stdout:7/745: mknod d4/d1f/d29/d65/ceb 0 2024-09-17T01:07:02.796 INFO:tasks.workunit.client.0.smithi103.stdout:3/107: dwrite d3/f1c [0,4194304] 0 2024-09-17T01:07:02.797 INFO:tasks.workunit.client.0.smithi103.stdout:4/84: rename d9/d10/db to d9/d16 0 2024-09-17T01:07:02.797 INFO:tasks.workunit.client.0.smithi103.stdout:3/108: write d3/f14 [1758187,3165] 0 2024-09-17T01:07:02.798 INFO:tasks.workunit.client.0.smithi103.stdout:3/109: chown d3/c10 420 1 2024-09-17T01:07:02.799 INFO:tasks.workunit.client.1.smithi143.stdout:8/621: write d9/d26/f74 [961365,21323] 0 2024-09-17T01:07:02.803 INFO:tasks.workunit.client.1.smithi143.stdout:1/651: chown d0/dc/d57/d58/lad 101 1 2024-09-17T01:07:02.808 INFO:tasks.workunit.client.0.smithi103.stdout:6/27: dread f1 [0,4194304] 0 2024-09-17T01:07:02.809 INFO:tasks.workunit.client.0.smithi103.stdout:7/98: write d4/d10/f1d [727681,23018] 0 2024-09-17T01:07:02.810 INFO:tasks.workunit.client.0.smithi103.stdout:3/110: dwrite d3/f14 [0,4194304] 0 2024-09-17T01:07:02.810 INFO:tasks.workunit.client.0.smithi103.stdout:4/85: dwrite d9/fd [0,4194304] 0 2024-09-17T01:07:02.812 INFO:tasks.workunit.client.0.smithi103.stdout:7/99: write d4/d10/f15 [1837757,87087] 0 2024-09-17T01:07:02.812 INFO:tasks.workunit.client.0.smithi103.stdout:4/86: dread - d9/d10/f14 zero size 2024-09-17T01:07:02.813 INFO:tasks.workunit.client.1.smithi143.stdout:7/746: mknod d4/d1f/d4a/d66/d86/cec 0 2024-09-17T01:07:02.817 INFO:tasks.workunit.client.0.smithi103.stdout:6/28: creat d3/f9 x:0 0 0 2024-09-17T01:07:02.822 INFO:tasks.workunit.client.0.smithi103.stdout:9/96: unlink d7/f22 0 2024-09-17T01:07:02.822 INFO:tasks.workunit.client.0.smithi103.stdout:3/111: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:07:02.823 INFO:tasks.workunit.client.1.smithi143.stdout:1/652: mknod d0/d6/d43/d6a/df/d6e/d2/d39/d6b/cda 0 2024-09-17T01:07:02.824 INFO:tasks.workunit.client.0.smithi103.stdout:7/100: dread d4/d10/f15 [0,4194304] 0 2024-09-17T01:07:02.826 INFO:tasks.workunit.client.0.smithi103.stdout:6/29: dread d3/f4 [0,4194304] 0 2024-09-17T01:07:02.826 INFO:tasks.workunit.client.1.smithi143.stdout:9/601: link d3/c40 d3/d39/d6a/d9/cc6 0 2024-09-17T01:07:02.826 INFO:tasks.workunit.client.0.smithi103.stdout:6/30: chown f2 4664883 1 2024-09-17T01:07:02.827 INFO:tasks.workunit.client.1.smithi143.stdout:9/602: chown d3/d39/d42/f54 7 1 2024-09-17T01:07:02.829 INFO:tasks.workunit.client.0.smithi103.stdout:9/97: creat d7/dd/f23 x:0 0 0 2024-09-17T01:07:02.830 INFO:tasks.workunit.client.1.smithi143.stdout:9/603: write d3/d39/d42/d80/fa4 [531112,41101] 0 2024-09-17T01:07:02.831 INFO:tasks.workunit.client.0.smithi103.stdout:1/64: write d2/f6 [1168318,29942] 0 2024-09-17T01:07:02.832 INFO:tasks.workunit.client.1.smithi143.stdout:7/747: unlink d4/d1f/d29/f79 0 2024-09-17T01:07:02.837 INFO:tasks.workunit.client.1.smithi143.stdout:7/748: rmdir d4/d16 39 2024-09-17T01:07:02.837 INFO:tasks.workunit.client.1.smithi143.stdout:2/584: dwrite d0/fc [0,4194304] 0 2024-09-17T01:07:02.840 INFO:tasks.workunit.client.1.smithi143.stdout:1/653: dread d0/dc/f83 [0,4194304] 0 2024-09-17T01:07:02.841 INFO:tasks.workunit.client.1.smithi143.stdout:2/585: chown d0/d2/d21/d22/f2d 29430322 1 2024-09-17T01:07:02.841 INFO:tasks.workunit.client.1.smithi143.stdout:6/535: rename d2/f1f to d2/d17/d6e/d26/fa9 0 2024-09-17T01:07:02.842 INFO:tasks.workunit.client.1.smithi143.stdout:4/630: truncate da/d3a/d3e/d72/da3/fa5 2393518 0 2024-09-17T01:07:02.843 INFO:tasks.workunit.client.1.smithi143.stdout:6/536: dread - d2/d17/d6e/d26/d46/d65/fa1 zero size 2024-09-17T01:07:02.843 INFO:tasks.workunit.client.0.smithi103.stdout:6/31: dwrite f1 [0,4194304] 0 2024-09-17T01:07:02.844 INFO:tasks.workunit.client.1.smithi143.stdout:4/631: write da/f11 [3704648,37151] 0 2024-09-17T01:07:02.846 INFO:tasks.workunit.client.1.smithi143.stdout:3/615: sync 2024-09-17T01:07:02.849 INFO:tasks.workunit.client.0.smithi103.stdout:4/87: rename l6 to d9/d10/l17 0 2024-09-17T01:07:02.851 INFO:tasks.workunit.client.0.smithi103.stdout:4/88: write f3 [4651608,83293] 0 2024-09-17T01:07:02.852 INFO:tasks.workunit.client.1.smithi143.stdout:4/632: dread da/d3a/d3e/d4a/d8c/f9f [0,4194304] 0 2024-09-17T01:07:02.854 INFO:tasks.workunit.client.1.smithi143.stdout:8/622: rename d9/d26/f74 to d9/de/d53/fe0 0 2024-09-17T01:07:02.854 INFO:tasks.workunit.client.0.smithi103.stdout:9/98: creat d7/dd/d11/d21/f24 x:0 0 0 2024-09-17T01:07:02.854 INFO:tasks.workunit.client.0.smithi103.stdout:1/65: dwrite d2/d7/fc [4194304,4194304] 0 2024-09-17T01:07:02.855 INFO:tasks.workunit.client.1.smithi143.stdout:9/604: creat d3/d39/d42/d58/d5a/d5e/d99/dc5/fc7 x:0 0 0 2024-09-17T01:07:02.856 INFO:tasks.workunit.client.0.smithi103.stdout:1/66: truncate d2/de/f11 810876 0 2024-09-17T01:07:02.857 INFO:tasks.workunit.client.1.smithi143.stdout:8/623: chown d9/d23/d32/l39 2 1 2024-09-17T01:07:02.857 INFO:tasks.workunit.client.0.smithi103.stdout:7/101: link d4/le d4/d11/l26 0 2024-09-17T01:07:02.857 INFO:tasks.workunit.client.1.smithi143.stdout:2/586: dread d0/d2/fe [0,4194304] 0 2024-09-17T01:07:02.858 INFO:tasks.workunit.client.0.smithi103.stdout:6/32: symlink d3/la 0 2024-09-17T01:07:02.859 INFO:tasks.workunit.client.0.smithi103.stdout:6/33: write d3/f9 [347784,105206] 0 2024-09-17T01:07:02.860 INFO:tasks.workunit.client.1.smithi143.stdout:1/654: symlink d0/dc/ldb 0 2024-09-17T01:07:02.864 INFO:tasks.workunit.client.0.smithi103.stdout:4/89: creat d9/dc/f18 x:0 0 0 2024-09-17T01:07:02.867 INFO:tasks.workunit.client.1.smithi143.stdout:4/633: unlink da/d6d/d90/cc7 0 2024-09-17T01:07:02.868 INFO:tasks.workunit.client.0.smithi103.stdout:9/99: mknod d7/dd/c25 0 2024-09-17T01:07:02.869 INFO:tasks.workunit.client.1.smithi143.stdout:4/634: write da/d3a/d3e/d72/d9e/fce [399888,117779] 0 2024-09-17T01:07:02.869 INFO:tasks.workunit.client.0.smithi103.stdout:6/34: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:07:02.871 INFO:tasks.workunit.client.0.smithi103.stdout:9/100: stat d7/fc 0 2024-09-17T01:07:02.871 INFO:tasks.workunit.client.0.smithi103.stdout:6/35: readlink d3/la 0 2024-09-17T01:07:02.871 INFO:tasks.workunit.client.0.smithi103.stdout:9/101: fsync d7/dd/d11/fb 0 2024-09-17T01:07:02.872 INFO:tasks.workunit.client.1.smithi143.stdout:6/537: link d2/df/f31 d2/d30/d84/faa 0 2024-09-17T01:07:02.875 INFO:tasks.workunit.client.1.smithi143.stdout:9/605: mknod d3/d39/d42/d58/d5a/d5e/d99/cc8 0 2024-09-17T01:07:02.876 INFO:tasks.workunit.client.0.smithi103.stdout:4/90: rename d9 to d9/d10/d19 22 2024-09-17T01:07:02.880 INFO:tasks.workunit.client.1.smithi143.stdout:8/624: rename d9/d23/d32/l39 to d9/d12/d38/d7a/d8f/le1 0 2024-09-17T01:07:02.882 INFO:tasks.workunit.client.1.smithi143.stdout:7/749: dread d4/f18 [0,4194304] 0 2024-09-17T01:07:02.882 INFO:tasks.workunit.client.1.smithi143.stdout:8/625: write d9/d23/d32/fbd [1105249,13939] 0 2024-09-17T01:07:02.883 INFO:tasks.workunit.client.0.smithi103.stdout:9/102: creat d7/dd/d11/d21/f26 x:0 0 0 2024-09-17T01:07:02.883 INFO:tasks.workunit.client.1.smithi143.stdout:1/655: creat d0/d6/d43/d47/d68/fdc x:0 0 0 2024-09-17T01:07:02.884 INFO:tasks.workunit.client.0.smithi103.stdout:9/103: dread - d7/dd/f23 zero size 2024-09-17T01:07:02.884 INFO:tasks.workunit.client.1.smithi143.stdout:8/626: readlink d9/d12/d38/d58/d79/ld3 0 2024-09-17T01:07:02.884 INFO:tasks.workunit.client.1.smithi143.stdout:8/627: fdatasync d9/d12/d38/f43 0 2024-09-17T01:07:02.885 INFO:tasks.workunit.client.0.smithi103.stdout:1/67: fdatasync d2/d7/fc 0 2024-09-17T01:07:02.885 INFO:tasks.workunit.client.0.smithi103.stdout:4/91: fsync f8 0 2024-09-17T01:07:02.890 INFO:tasks.workunit.client.1.smithi143.stdout:6/538: mknod d2/d17/d6e/d26/d79/cab 0 2024-09-17T01:07:02.891 INFO:tasks.workunit.client.1.smithi143.stdout:6/539: write d2/d17/d6e/d26/d46/d65/f7f [4820770,102428] 0 2024-09-17T01:07:02.894 INFO:tasks.workunit.client.1.smithi143.stdout:2/587: fsync d0/d10/d58/d5a/d5b/f45 0 2024-09-17T01:07:02.897 INFO:tasks.workunit.client.1.smithi143.stdout:0/608: sync 2024-09-17T01:07:02.897 INFO:tasks.workunit.client.1.smithi143.stdout:6/540: dread d2/d19/f73 [0,4194304] 0 2024-09-17T01:07:02.898 INFO:tasks.workunit.client.0.smithi103.stdout:6/36: link d3/c8 d3/cb 0 2024-09-17T01:07:02.899 INFO:tasks.workunit.client.1.smithi143.stdout:6/541: fsync d2/df/d20/f54 0 2024-09-17T01:07:02.899 INFO:tasks.workunit.client.1.smithi143.stdout:9/606: dwrite d3/d39/d6a/f30 [4194304,4194304] 0 2024-09-17T01:07:02.899 INFO:tasks.workunit.client.1.smithi143.stdout:7/750: unlink d4/f41 0 2024-09-17T01:07:02.901 INFO:tasks.workunit.client.1.smithi143.stdout:9/607: dread - d3/d39/d42/d58/d5a/f62 zero size 2024-09-17T01:07:02.901 INFO:tasks.workunit.client.1.smithi143.stdout:1/656: mkdir d0/dc/d57/d58/ddd 0 2024-09-17T01:07:02.902 INFO:tasks.workunit.client.0.smithi103.stdout:6/37: write d3/f9 [3872902,20753] 0 2024-09-17T01:07:02.903 INFO:tasks.workunit.client.1.smithi143.stdout:0/609: dread d3/d14/fa9 [0,4194304] 0 2024-09-17T01:07:02.905 INFO:tasks.workunit.client.1.smithi143.stdout:3/616: link d6/l1d d6/d1c/d4b/lc1 0 2024-09-17T01:07:02.908 INFO:tasks.workunit.client.1.smithi143.stdout:4/635: mkdir da/d3a/d40/d84/dd0 0 2024-09-17T01:07:02.908 INFO:tasks.workunit.client.0.smithi103.stdout:6/38: creat d3/fc x:0 0 0 2024-09-17T01:07:02.909 INFO:tasks.workunit.client.0.smithi103.stdout:9/104: write d7/f18 [844941,64007] 0 2024-09-17T01:07:02.909 INFO:tasks.workunit.client.0.smithi103.stdout:6/39: stat f1 0 2024-09-17T01:07:02.911 INFO:tasks.workunit.client.1.smithi143.stdout:1/657: dread d0/dc/f82 [0,4194304] 0 2024-09-17T01:07:02.912 INFO:tasks.workunit.client.1.smithi143.stdout:2/588: dread d0/d10/fba [0,4194304] 0 2024-09-17T01:07:02.913 INFO:tasks.workunit.client.0.smithi103.stdout:6/40: symlink d3/ld 0 2024-09-17T01:07:02.915 INFO:tasks.workunit.client.0.smithi103.stdout:4/92: write f7 [1976645,21324] 0 2024-09-17T01:07:02.916 INFO:tasks.workunit.client.0.smithi103.stdout:9/105: symlink d7/dd/d11/d21/l27 0 2024-09-17T01:07:02.919 INFO:tasks.workunit.client.0.smithi103.stdout:6/41: creat d3/fe x:0 0 0 2024-09-17T01:07:02.921 INFO:tasks.workunit.client.0.smithi103.stdout:6/42: fdatasync f1 0 2024-09-17T01:07:02.921 INFO:tasks.workunit.client.0.smithi103.stdout:1/68: dwrite d2/f4 [4194304,4194304] 0 2024-09-17T01:07:02.931 INFO:tasks.workunit.client.0.smithi103.stdout:9/106: dwrite d7/dd/d11/d21/f24 [0,4194304] 0 2024-09-17T01:07:02.933 INFO:tasks.workunit.client.1.smithi143.stdout:3/617: creat d6/d1c/d4b/dab/fc2 x:0 0 0 2024-09-17T01:07:02.934 INFO:tasks.workunit.client.0.smithi103.stdout:1/69: creat d2/de/f14 x:0 0 0 2024-09-17T01:07:02.938 INFO:tasks.workunit.client.0.smithi103.stdout:6/43: rmdir d3 39 2024-09-17T01:07:02.941 INFO:tasks.workunit.client.1.smithi143.stdout:5/587: sync 2024-09-17T01:07:02.941 INFO:tasks.workunit.client.1.smithi143.stdout:2/589: creat d0/d2/d21/d84/d8d/fbb x:0 0 0 2024-09-17T01:07:02.941 INFO:tasks.workunit.client.0.smithi103.stdout:9/107: symlink d7/dd/d11/d21/l28 0 2024-09-17T01:07:02.941 INFO:tasks.workunit.client.0.smithi103.stdout:4/93: write f8 [2113261,49507] 0 2024-09-17T01:07:02.942 INFO:tasks.workunit.client.1.smithi143.stdout:5/588: stat d1/d46/df/d1f/d66/c75 0 2024-09-17T01:07:02.942 INFO:tasks.workunit.client.0.smithi103.stdout:1/70: mknod d2/d7/c15 0 2024-09-17T01:07:02.942 INFO:tasks.workunit.client.1.smithi143.stdout:1/658: rename d0/d6/d43/d6a/df/d27/l33 to d0/d6/d43/d6d/d8b/dd0/lde 0 2024-09-17T01:07:02.943 INFO:tasks.workunit.client.1.smithi143.stdout:1/659: stat d0/d6/d43/d6a/df/l15 0 2024-09-17T01:07:02.944 INFO:tasks.workunit.client.1.smithi143.stdout:6/542: mknod d2/d17/d6e/cac 0 2024-09-17T01:07:02.944 INFO:tasks.workunit.client.0.smithi103.stdout:1/71: write d2/fb [176511,29209] 0 2024-09-17T01:07:02.945 INFO:tasks.workunit.client.1.smithi143.stdout:7/751: fdatasync d4/f10 0 2024-09-17T01:07:02.945 INFO:tasks.workunit.client.0.smithi103.stdout:6/44: write d3/fe [796535,79209] 0 2024-09-17T01:07:02.945 INFO:tasks.workunit.client.1.smithi143.stdout:7/752: chown d4/l59 233299243 1 2024-09-17T01:07:02.951 INFO:tasks.workunit.client.0.smithi103.stdout:1/72: mkdir d2/d16 0 2024-09-17T01:07:02.952 INFO:tasks.workunit.client.1.smithi143.stdout:8/628: truncate d9/de/f97 777525 0 2024-09-17T01:07:02.953 INFO:tasks.workunit.client.1.smithi143.stdout:8/629: dread - d9/d23/fd0 zero size 2024-09-17T01:07:02.953 INFO:tasks.workunit.client.0.smithi103.stdout:1/73: chown d2/de/f14 23916 1 2024-09-17T01:07:02.954 INFO:tasks.workunit.client.1.smithi143.stdout:8/630: write d9/de/f6f [4147155,5214] 0 2024-09-17T01:07:02.954 INFO:tasks.workunit.client.1.smithi143.stdout:3/618: creat d6/d1c/d82/db1/fc3 x:0 0 0 2024-09-17T01:07:02.955 INFO:tasks.workunit.client.0.smithi103.stdout:9/108: rmdir d7/dd/d11/d21 39 2024-09-17T01:07:02.955 INFO:tasks.workunit.client.0.smithi103.stdout:6/45: dwrite f2 [0,4194304] 0 2024-09-17T01:07:02.955 INFO:tasks.workunit.client.1.smithi143.stdout:3/619: chown d6/d1c/d33/d41/d2e/d86 586438 1 2024-09-17T01:07:02.956 INFO:tasks.workunit.client.0.smithi103.stdout:1/74: write d2/f6 [2780113,19514] 0 2024-09-17T01:07:02.958 INFO:tasks.workunit.client.0.smithi103.stdout:1/75: truncate d2/de/f11 1154509 0 2024-09-17T01:07:02.960 INFO:tasks.workunit.client.1.smithi143.stdout:0/610: link d3/d68/f70 d3/d5/d8/d27/d31/d48/d62/fca 0 2024-09-17T01:07:02.961 INFO:tasks.workunit.client.1.smithi143.stdout:8/631: dwrite d9/d12/d13/f4d [0,4194304] 0 2024-09-17T01:07:02.966 INFO:tasks.workunit.client.0.smithi103.stdout:6/46: creat d3/ff x:0 0 0 2024-09-17T01:07:02.967 INFO:tasks.workunit.client.0.smithi103.stdout:1/76: dwrite d2/fb [0,4194304] 0 2024-09-17T01:07:02.967 INFO:tasks.workunit.client.1.smithi143.stdout:5/589: chown d1/d46/l2f 68 1 2024-09-17T01:07:02.969 INFO:tasks.workunit.client.0.smithi103.stdout:6/47: fdatasync d3/fe 0 2024-09-17T01:07:02.970 INFO:tasks.workunit.client.0.smithi103.stdout:6/48: write f1 [2881483,21042] 0 2024-09-17T01:07:02.972 INFO:tasks.workunit.client.1.smithi143.stdout:3/620: dread d6/d1c/d33/d41/d42/f4c [0,4194304] 0 2024-09-17T01:07:02.973 INFO:tasks.workunit.client.0.smithi103.stdout:9/109: chown d7/dd/d11/d21/l28 5 1 2024-09-17T01:07:02.974 INFO:tasks.workunit.client.0.smithi103.stdout:4/94: truncate d9/fd 589835 0 2024-09-17T01:07:02.977 INFO:tasks.workunit.client.1.smithi143.stdout:1/660: fsync d0/d6/d43/d47/d68/d7b/fb0 0 2024-09-17T01:07:02.979 INFO:tasks.workunit.client.0.smithi103.stdout:1/77: mknod d2/c17 0 2024-09-17T01:07:02.979 INFO:tasks.workunit.client.1.smithi143.stdout:9/608: creat d3/fc9 x:0 0 0 2024-09-17T01:07:02.980 INFO:tasks.workunit.client.0.smithi103.stdout:6/49: mknod d3/c10 0 2024-09-17T01:07:02.984 INFO:tasks.workunit.client.0.smithi103.stdout:9/110: dwrite d7/dd/d11/f1f [0,4194304] 0 2024-09-17T01:07:02.985 INFO:tasks.workunit.client.1.smithi143.stdout:4/636: link da/d3a/d3e/l4e da/d3a/d3e/d72/d9e/ld1 0 2024-09-17T01:07:02.986 INFO:tasks.workunit.client.0.smithi103.stdout:6/50: truncate d3/ff 514256 0 2024-09-17T01:07:02.986 INFO:tasks.workunit.client.0.smithi103.stdout:4/95: symlink d9/d16/l1a 0 2024-09-17T01:07:02.987 INFO:tasks.workunit.client.0.smithi103.stdout:4/96: readlink d9/dc/l11 0 2024-09-17T01:07:02.989 INFO:tasks.workunit.client.0.smithi103.stdout:4/97: dread - d9/d10/f14 zero size 2024-09-17T01:07:02.990 INFO:tasks.workunit.client.0.smithi103.stdout:6/51: creat d3/f11 x:0 0 0 2024-09-17T01:07:02.990 INFO:tasks.workunit.client.1.smithi143.stdout:9/609: creat d3/d39/d6a/d9/d74/fca x:0 0 0 2024-09-17T01:07:02.991 INFO:tasks.workunit.client.0.smithi103.stdout:4/98: fsync f7 0 2024-09-17T01:07:02.992 INFO:tasks.workunit.client.0.smithi103.stdout:1/78: dwrite d2/de/f11 [0,4194304] 0 2024-09-17T01:07:02.993 INFO:tasks.workunit.client.1.smithi143.stdout:8/632: mkdir d9/d23/de2 0 2024-09-17T01:07:02.996 INFO:tasks.workunit.client.0.smithi103.stdout:6/52: dread f2 [0,4194304] 0 2024-09-17T01:07:02.996 INFO:tasks.workunit.client.1.smithi143.stdout:5/590: mkdir d1/d46/df/d1f/d66/d70/de2/de3 0 2024-09-17T01:07:02.997 INFO:tasks.workunit.client.0.smithi103.stdout:6/53: fdatasync d3/ff 0 2024-09-17T01:07:02.997 INFO:tasks.workunit.client.1.smithi143.stdout:5/591: chown d1/d46/df/d1f/c2e 10609868 1 2024-09-17T01:07:02.998 INFO:tasks.workunit.client.0.smithi103.stdout:0/83: sync 2024-09-17T01:07:02.998 INFO:tasks.workunit.client.0.smithi103.stdout:2/43: sync 2024-09-17T01:07:03.000 INFO:tasks.workunit.client.0.smithi103.stdout:2/44: chown f5 6 1 2024-09-17T01:07:03.001 INFO:tasks.workunit.client.0.smithi103.stdout:9/111: mknod d7/dd/d11/d20/c29 0 2024-09-17T01:07:03.002 INFO:tasks.workunit.client.0.smithi103.stdout:9/112: stat d7/dd/d11/c13 0 2024-09-17T01:07:03.003 INFO:tasks.workunit.client.1.smithi143.stdout:4/637: symlink da/d3a/d3e/d5e/ld2 0 2024-09-17T01:07:03.004 INFO:tasks.workunit.client.0.smithi103.stdout:4/99: mkdir d9/dc/df/d1b 0 2024-09-17T01:07:03.006 INFO:tasks.workunit.client.0.smithi103.stdout:4/100: write f7 [1453110,113643] 0 2024-09-17T01:07:03.008 INFO:tasks.workunit.client.0.smithi103.stdout:0/84: dwrite dd/df/f13 [0,4194304] 0 2024-09-17T01:07:03.009 INFO:tasks.workunit.client.1.smithi143.stdout:2/590: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/fbc x:0 0 0 2024-09-17T01:07:03.012 INFO:tasks.workunit.client.1.smithi143.stdout:6/543: rename d2/d19/d92 to d2/d17/d6e/dad 0 2024-09-17T01:07:03.017 INFO:tasks.workunit.client.1.smithi143.stdout:3/621: write d6/d1c/d4b/f76 [965499,27771] 0 2024-09-17T01:07:03.017 INFO:tasks.workunit.client.0.smithi103.stdout:0/85: dread f6 [4194304,4194304] 0 2024-09-17T01:07:03.018 INFO:tasks.workunit.client.1.smithi143.stdout:9/610: creat d3/d39/d42/d58/d5a/d5e/d99/fcb x:0 0 0 2024-09-17T01:07:03.019 INFO:tasks.workunit.client.0.smithi103.stdout:4/101: symlink d9/d16/l1c 0 2024-09-17T01:07:03.020 INFO:tasks.workunit.client.1.smithi143.stdout:8/633: creat d9/d23/db4/d56/d66/fe3 x:0 0 0 2024-09-17T01:07:03.020 INFO:tasks.workunit.client.0.smithi103.stdout:2/45: dread d6/f9 [0,4194304] 0 2024-09-17T01:07:03.020 INFO:tasks.workunit.client.0.smithi103.stdout:4/102: readlink d9/d16/l1c 0 2024-09-17T01:07:03.023 INFO:tasks.workunit.client.1.smithi143.stdout:6/544: dread d2/df/f2e [0,4194304] 0 2024-09-17T01:07:03.023 INFO:tasks.workunit.client.1.smithi143.stdout:5/592: chown d1/d5e/fb2 1792163 1 2024-09-17T01:07:03.023 INFO:tasks.workunit.client.0.smithi103.stdout:6/54: dwrite d3/f4 [4194304,4194304] 0 2024-09-17T01:07:03.024 INFO:tasks.workunit.client.1.smithi143.stdout:6/545: fdatasync d2/df/fa4 0 2024-09-17T01:07:03.025 INFO:tasks.workunit.client.1.smithi143.stdout:0/611: fdatasync d3/d5/d8/d27/d31/d4c/f79 0 2024-09-17T01:07:03.025 INFO:tasks.workunit.client.1.smithi143.stdout:8/634: dread d9/d12/d13/f4d [0,4194304] 0 2024-09-17T01:07:03.026 INFO:tasks.workunit.client.1.smithi143.stdout:8/635: chown d9/de/f21 2663582 1 2024-09-17T01:07:03.033 INFO:tasks.workunit.client.1.smithi143.stdout:3/622: symlink d6/d1c/d4d/lc4 0 2024-09-17T01:07:03.033 INFO:tasks.workunit.client.1.smithi143.stdout:6/546: dread d2/d17/d6e/fa7 [0,4194304] 0 2024-09-17T01:07:03.035 INFO:tasks.workunit.client.0.smithi103.stdout:4/103: dwrite d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:03.036 INFO:tasks.workunit.client.1.smithi143.stdout:9/611: mknod d3/d39/d42/d58/d5a/d5e/d99/dc5/ccc 0 2024-09-17T01:07:03.038 INFO:tasks.workunit.client.1.smithi143.stdout:6/547: read d2/d19/f1b [1509546,80421] 0 2024-09-17T01:07:03.040 INFO:tasks.workunit.client.1.smithi143.stdout:6/548: write d2/d17/f25 [3457927,43998] 0 2024-09-17T01:07:03.041 INFO:tasks.workunit.client.0.smithi103.stdout:6/55: link d3/c5 d3/c12 0 2024-09-17T01:07:03.042 INFO:tasks.workunit.client.1.smithi143.stdout:9/612: dwrite d3/d39/f4b [0,4194304] 0 2024-09-17T01:07:03.044 INFO:tasks.workunit.client.0.smithi103.stdout:6/56: write d3/f11 [104936,17698] 0 2024-09-17T01:07:03.045 INFO:tasks.workunit.client.1.smithi143.stdout:9/613: dread - d3/d39/d6a/dc3/d3e/d51/d52/fc1 zero size 2024-09-17T01:07:03.045 INFO:tasks.workunit.client.0.smithi103.stdout:0/86: write f3 [5624191,50314] 0 2024-09-17T01:07:03.047 INFO:tasks.workunit.client.1.smithi143.stdout:8/636: symlink d9/de/d53/d75/daf/le4 0 2024-09-17T01:07:03.049 INFO:tasks.workunit.client.0.smithi103.stdout:4/104: rmdir d9/dc/df/d1b 0 2024-09-17T01:07:03.050 INFO:tasks.workunit.client.1.smithi143.stdout:6/549: dwrite d2/df/d20/d2c/d75/f71 [0,4194304] 0 2024-09-17T01:07:03.053 INFO:tasks.workunit.client.1.smithi143.stdout:7/753: rename d4/d1f/f73 to d4/d1f/d29/d65/d5d/db1/dc6/fed 0 2024-09-17T01:07:03.055 INFO:tasks.workunit.client.1.smithi143.stdout:1/661: getdents d0/d6/d43/d6a/df/d6e/d18/d4d 0 2024-09-17T01:07:03.058 INFO:tasks.workunit.client.0.smithi103.stdout:0/87: mkdir dd/df/d1b 0 2024-09-17T01:07:03.059 INFO:tasks.workunit.client.1.smithi143.stdout:3/623: unlink d6/d1c/d33/d41/d2e/f47 0 2024-09-17T01:07:03.062 INFO:tasks.workunit.client.0.smithi103.stdout:4/105: dwrite f7 [0,4194304] 0 2024-09-17T01:07:03.062 INFO:tasks.workunit.client.0.smithi103.stdout:6/57: unlink d3/c5 0 2024-09-17T01:07:03.063 INFO:tasks.workunit.client.0.smithi103.stdout:0/88: mkdir dd/d1c 0 2024-09-17T01:07:03.064 INFO:tasks.workunit.client.1.smithi143.stdout:5/593: symlink d1/d46/df/le4 0 2024-09-17T01:07:03.065 INFO:tasks.workunit.client.0.smithi103.stdout:6/58: mknod d3/c13 0 2024-09-17T01:07:03.066 INFO:tasks.workunit.client.1.smithi143.stdout:5/594: truncate d1/d46/df/d23/d4f/d82/fc2 577478 0 2024-09-17T01:07:03.071 INFO:tasks.workunit.client.0.smithi103.stdout:4/106: truncate d9/fd 689635 0 2024-09-17T01:07:03.072 INFO:tasks.workunit.client.1.smithi143.stdout:2/591: creat d0/d10/d58/d5a/d5b/d4c/fbd x:0 0 0 2024-09-17T01:07:03.073 INFO:tasks.workunit.client.1.smithi143.stdout:2/592: write d0/d10/f47 [922970,31354] 0 2024-09-17T01:07:03.073 INFO:tasks.workunit.client.0.smithi103.stdout:0/89: creat dd/d1c/f1d x:0 0 0 2024-09-17T01:07:03.075 INFO:tasks.workunit.client.0.smithi103.stdout:6/59: rename d3/c8 to d3/c14 0 2024-09-17T01:07:03.075 INFO:tasks.workunit.client.0.smithi103.stdout:6/60: fdatasync d3/fc 0 2024-09-17T01:07:03.078 INFO:tasks.workunit.client.1.smithi143.stdout:8/637: rename d9/d12/c2e to d9/d23/db4/d55/dbf/ce5 0 2024-09-17T01:07:03.078 INFO:tasks.workunit.client.0.smithi103.stdout:0/90: symlink dd/d1c/l1e 0 2024-09-17T01:07:03.079 INFO:tasks.workunit.client.0.smithi103.stdout:6/61: symlink d3/l15 0 2024-09-17T01:07:03.080 INFO:tasks.workunit.client.1.smithi143.stdout:3/624: mknod d6/d1c/d33/d3f/d5c/cc5 0 2024-09-17T01:07:03.080 INFO:tasks.workunit.client.0.smithi103.stdout:4/107: mknod d9/d10/c1d 0 2024-09-17T01:07:03.081 INFO:tasks.workunit.client.0.smithi103.stdout:4/108: chown d9/d16/l1c 56691967 1 2024-09-17T01:07:03.081 INFO:tasks.workunit.client.0.smithi103.stdout:0/91: creat dd/d1c/f1f x:0 0 0 2024-09-17T01:07:03.081 INFO:tasks.workunit.client.0.smithi103.stdout:0/92: readlink l9 0 2024-09-17T01:07:03.082 INFO:tasks.workunit.client.1.smithi143.stdout:4/638: getdents da/d3a/d7c 0 2024-09-17T01:07:03.082 INFO:tasks.workunit.client.0.smithi103.stdout:4/109: write d9/d16/f12 [744082,123080] 0 2024-09-17T01:07:03.083 INFO:tasks.workunit.client.0.smithi103.stdout:6/62: mkdir d3/d16 0 2024-09-17T01:07:03.085 INFO:tasks.workunit.client.0.smithi103.stdout:0/93: write dd/d1c/f1f [652404,42351] 0 2024-09-17T01:07:03.086 INFO:tasks.workunit.client.1.smithi143.stdout:2/593: rmdir d0/d44/d7a 39 2024-09-17T01:07:03.089 INFO:tasks.workunit.client.1.smithi143.stdout:3/625: dwrite d6/d1c/d33/d41/d2b/f3d [0,4194304] 0 2024-09-17T01:07:03.090 INFO:tasks.workunit.client.1.smithi143.stdout:5/595: dread d1/d5e/fb2 [0,4194304] 0 2024-09-17T01:07:03.090 INFO:tasks.workunit.client.1.smithi143.stdout:8/638: mknod d9/d12/d38/dba/ce6 0 2024-09-17T01:07:03.091 INFO:tasks.workunit.client.0.smithi103.stdout:6/63: dread f1 [0,4194304] 0 2024-09-17T01:07:03.092 INFO:tasks.workunit.client.0.smithi103.stdout:4/110: creat d9/d16/f1e x:0 0 0 2024-09-17T01:07:03.093 INFO:tasks.workunit.client.0.smithi103.stdout:6/64: readlink d3/ld 0 2024-09-17T01:07:03.094 INFO:tasks.workunit.client.1.smithi143.stdout:0/612: getdents d3/d5/d8/d27/d31/d85 0 2024-09-17T01:07:03.094 INFO:tasks.workunit.client.1.smithi143.stdout:5/596: write d1/d96/fd2 [549034,97828] 0 2024-09-17T01:07:03.095 INFO:tasks.workunit.client.0.smithi103.stdout:0/94: dwrite dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:03.095 INFO:tasks.workunit.client.1.smithi143.stdout:4/639: dwrite da/d3a/d3e/d72/d9e/fce [0,4194304] 0 2024-09-17T01:07:03.102 INFO:tasks.workunit.client.1.smithi143.stdout:7/754: dread d4/fd0 [0,4194304] 0 2024-09-17T01:07:03.102 INFO:tasks.workunit.client.1.smithi143.stdout:2/594: dwrite d0/d10/d58/d5a/d5b/d4c/d71/d9d/fbc [0,4194304] 0 2024-09-17T01:07:03.103 INFO:tasks.workunit.client.0.smithi103.stdout:6/65: write f1 [2868878,19589] 0 2024-09-17T01:07:03.108 INFO:tasks.workunit.client.1.smithi143.stdout:5/597: dwrite d1/d46/df/d23/f72 [0,4194304] 0 2024-09-17T01:07:03.108 INFO:tasks.workunit.client.1.smithi143.stdout:6/550: rename d2/df/d18/f21 to d2/d30/d45/d70/d87/fae 0 2024-09-17T01:07:03.110 INFO:tasks.workunit.client.1.smithi143.stdout:8/639: symlink d9/d12/d13/d73/le7 0 2024-09-17T01:07:03.111 INFO:tasks.workunit.client.1.smithi143.stdout:6/551: chown d2/d17/d6e/d26/d79 463278 1 2024-09-17T01:07:03.112 INFO:tasks.workunit.client.1.smithi143.stdout:8/640: chown d9/d12/d38 9230 1 2024-09-17T01:07:03.114 INFO:tasks.workunit.client.1.smithi143.stdout:9/614: getdents d3/d39/d6a/d26 0 2024-09-17T01:07:03.115 INFO:tasks.workunit.client.1.smithi143.stdout:9/615: write d3/d39/d6a/d9/f87 [4924648,127432] 0 2024-09-17T01:07:03.118 INFO:tasks.workunit.client.1.smithi143.stdout:0/613: mkdir d3/d5/d35/da8/daf/dcb 0 2024-09-17T01:07:03.118 INFO:tasks.workunit.client.1.smithi143.stdout:9/616: dread - d3/d39/d6a/d9/d74/fca zero size 2024-09-17T01:07:03.119 INFO:tasks.workunit.client.1.smithi143.stdout:0/614: stat d3/d5/d35/da8/daf 0 2024-09-17T01:07:03.121 INFO:tasks.workunit.client.1.smithi143.stdout:4/640: creat da/d3a/d3e/d72/d9e/fd3 x:0 0 0 2024-09-17T01:07:03.123 INFO:tasks.workunit.client.0.smithi103.stdout:4/111: rename f8 to d9/d10/f1f 0 2024-09-17T01:07:03.123 INFO:tasks.workunit.client.0.smithi103.stdout:4/112: readlink d9/d16/l1c 0 2024-09-17T01:07:03.125 INFO:tasks.workunit.client.1.smithi143.stdout:2/595: creat d0/d10/d56/fbe x:0 0 0 2024-09-17T01:07:03.127 INFO:tasks.workunit.client.1.smithi143.stdout:7/755: creat d4/d1f/d29/d65/fee x:0 0 0 2024-09-17T01:07:03.127 INFO:tasks.workunit.client.1.smithi143.stdout:2/596: chown d0/d10/f47 483 1 2024-09-17T01:07:03.127 INFO:tasks.workunit.client.1.smithi143.stdout:9/617: dwrite d3/d39/d6a/dc3/d3e/d51/d52/fc1 [0,4194304] 0 2024-09-17T01:07:03.128 INFO:tasks.workunit.client.1.smithi143.stdout:7/756: readlink d4/d1f/d29/d65/d5d/l5a 0 2024-09-17T01:07:03.129 INFO:tasks.workunit.client.0.smithi103.stdout:4/113: creat d9/dc/df/f20 x:0 0 0 2024-09-17T01:07:03.129 INFO:tasks.workunit.client.0.smithi103.stdout:4/114: readlink d9/d16/l1a 0 2024-09-17T01:07:03.130 INFO:tasks.workunit.client.0.smithi103.stdout:0/95: getdents dd/df 0 2024-09-17T01:07:03.131 INFO:tasks.workunit.client.1.smithi143.stdout:7/757: dread - d4/d1f/d4a/d66/d86/fb8 zero size 2024-09-17T01:07:03.131 INFO:tasks.workunit.client.1.smithi143.stdout:3/626: mkdir d6/d1c/d33/d3f/d79/dc6 0 2024-09-17T01:07:03.133 INFO:tasks.workunit.client.1.smithi143.stdout:3/627: truncate d6/d1c/d33/d3f/f7d 953999 0 2024-09-17T01:07:03.133 INFO:tasks.workunit.client.1.smithi143.stdout:0/615: dread d3/d14/d3d/f5d [0,4194304] 0 2024-09-17T01:07:03.134 INFO:tasks.workunit.client.1.smithi143.stdout:6/552: mkdir d2/df/d20/d2c/d75/daf 0 2024-09-17T01:07:03.135 INFO:tasks.workunit.client.1.smithi143.stdout:3/628: chown d6/d1c/d33/d3f/f7d 185398883 1 2024-09-17T01:07:03.135 INFO:tasks.workunit.client.1.smithi143.stdout:0/616: stat d3/d5/d8/d27/d31/d48/d72/caa 0 2024-09-17T01:07:03.138 INFO:tasks.workunit.client.0.smithi103.stdout:0/96: dwrite f3 [0,4194304] 0 2024-09-17T01:07:03.139 INFO:tasks.workunit.client.0.smithi103.stdout:4/115: link f7 d9/f21 0 2024-09-17T01:07:03.145 INFO:tasks.workunit.client.1.smithi143.stdout:4/641: creat da/d3a/d40/daa/dc3/fd4 x:0 0 0 2024-09-17T01:07:03.146 INFO:tasks.workunit.client.1.smithi143.stdout:9/618: fsync d3/d39/d42/d58/d5a/d5e/d99/f67 0 2024-09-17T01:07:03.146 INFO:tasks.workunit.client.1.smithi143.stdout:5/598: symlink d1/d46/le5 0 2024-09-17T01:07:03.150 INFO:tasks.workunit.client.0.smithi103.stdout:0/97: dwrite dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:03.152 INFO:tasks.workunit.client.0.smithi103.stdout:4/116: dwrite d9/d16/f1e [0,4194304] 0 2024-09-17T01:07:03.153 INFO:tasks.workunit.client.1.smithi143.stdout:9/619: dread d3/d3d/d48/f59 [0,4194304] 0 2024-09-17T01:07:03.155 INFO:tasks.workunit.client.1.smithi143.stdout:1/662: rename d0/dc/d57/f7d to d0/d6/d43/d47/fdf 0 2024-09-17T01:07:03.155 INFO:tasks.workunit.client.1.smithi143.stdout:8/641: creat d9/d23/fe8 x:0 0 0 2024-09-17T01:07:03.161 INFO:tasks.workunit.client.1.smithi143.stdout:2/597: creat d0/d2/d21/d84/fbf x:0 0 0 2024-09-17T01:07:03.164 INFO:tasks.workunit.client.0.smithi103.stdout:4/117: symlink d9/d10/l22 0 2024-09-17T01:07:03.167 INFO:tasks.workunit.client.1.smithi143.stdout:6/553: dwrite d2/df/d20/f34 [0,4194304] 0 2024-09-17T01:07:03.168 INFO:tasks.workunit.client.0.smithi103.stdout:4/118: mkdir d9/d16/d23 0 2024-09-17T01:07:03.169 INFO:tasks.workunit.client.0.smithi103.stdout:6/66: mkdir d3/d17 0 2024-09-17T01:07:03.170 INFO:tasks.workunit.client.1.smithi143.stdout:9/620: creat d3/d39/d42/d58/dbf/fcd x:0 0 0 2024-09-17T01:07:03.171 INFO:tasks.workunit.client.1.smithi143.stdout:9/621: readlink l0 0 2024-09-17T01:07:03.172 INFO:tasks.workunit.client.1.smithi143.stdout:1/663: dread d0/d6/d43/f67 [0,4194304] 0 2024-09-17T01:07:03.175 INFO:tasks.workunit.client.1.smithi143.stdout:3/629: dread d6/f58 [0,4194304] 0 2024-09-17T01:07:03.175 INFO:tasks.workunit.client.1.smithi143.stdout:8/642: rename d9/d84/l5a to d9/d12/d4b/d3f/le9 0 2024-09-17T01:07:03.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:03 smithi103 ceph-mon[28156]: pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 35 MiB/s rd, 174 MiB/s wr, 421 op/s 2024-09-17T01:07:03.177 INFO:tasks.workunit.client.0.smithi103.stdout:4/119: dwrite d9/d16/f12 [0,4194304] 0 2024-09-17T01:07:03.180 INFO:tasks.workunit.client.0.smithi103.stdout:6/67: dread d3/f4 [4194304,4194304] 0 2024-09-17T01:07:03.180 INFO:tasks.workunit.client.1.smithi143.stdout:7/758: link d4/d16/f17 d4/d1f/d4a/de4/d78/de5/fef 0 2024-09-17T01:07:03.181 INFO:tasks.workunit.client.1.smithi143.stdout:1/664: dwrite d0/d6/d43/d6a/d8f/fc9 [0,4194304] 0 2024-09-17T01:07:03.182 INFO:tasks.workunit.client.0.smithi103.stdout:4/120: fsync d9/d10/f1f 0 2024-09-17T01:07:03.182 INFO:tasks.workunit.client.1.smithi143.stdout:1/665: chown d0/dc/d57/d58/ddd 1587783473 1 2024-09-17T01:07:03.183 INFO:tasks.workunit.client.1.smithi143.stdout:9/622: write d3/d39/f53 [4207141,24558] 0 2024-09-17T01:07:03.186 INFO:tasks.workunit.client.1.smithi143.stdout:6/554: mkdir d2/d17/d6e/db0 0 2024-09-17T01:07:03.186 INFO:tasks.workunit.client.1.smithi143.stdout:6/555: fsync d2/d17/f77 0 2024-09-17T01:07:03.187 INFO:tasks.workunit.client.0.smithi103.stdout:4/121: creat d9/d16/f24 x:0 0 0 2024-09-17T01:07:03.188 INFO:tasks.workunit.client.0.smithi103.stdout:4/122: chown d9/d16/f24 368336945 1 2024-09-17T01:07:03.191 INFO:tasks.workunit.client.1.smithi143.stdout:7/759: symlink d4/d1f/d29/d65/d5d/db1/dc6/lf0 0 2024-09-17T01:07:03.193 INFO:tasks.workunit.client.1.smithi143.stdout:7/760: dread - d4/d1f/d4a/de4/d4e/fdc zero size 2024-09-17T01:07:03.193 INFO:tasks.workunit.client.0.smithi103.stdout:4/123: creat d9/dc/df/f25 x:0 0 0 2024-09-17T01:07:03.194 INFO:tasks.workunit.client.0.smithi103.stdout:4/124: stat d9/d16 0 2024-09-17T01:07:03.194 INFO:tasks.workunit.client.1.smithi143.stdout:8/643: mkdir d9/d12/d38/d58/dda/dea 0 2024-09-17T01:07:03.195 INFO:tasks.workunit.client.1.smithi143.stdout:2/598: dread d0/d44/f9e [0,4194304] 0 2024-09-17T01:07:03.196 INFO:tasks.workunit.client.0.smithi103.stdout:4/125: mknod d9/c26 0 2024-09-17T01:07:03.197 INFO:tasks.workunit.client.1.smithi143.stdout:0/617: truncate d3/d5/d8/d10/f2a 3483885 0 2024-09-17T01:07:03.199 INFO:tasks.workunit.client.1.smithi143.stdout:1/666: unlink d0/d6/d43/d6a/df/c13 0 2024-09-17T01:07:03.200 INFO:tasks.workunit.client.1.smithi143.stdout:7/761: creat d4/d16/dbd/ff1 x:0 0 0 2024-09-17T01:07:03.201 INFO:tasks.workunit.client.0.smithi103.stdout:0/98: dwrite f6 [0,4194304] 0 2024-09-17T01:07:03.201 INFO:tasks.workunit.client.1.smithi143.stdout:0/618: truncate d3/d5/d35/da8/daf/fb5 50244 0 2024-09-17T01:07:03.201 INFO:tasks.workunit.client.1.smithi143.stdout:9/623: dwrite d3/d39/d42/f5d [0,4194304] 0 2024-09-17T01:07:03.203 INFO:tasks.workunit.client.1.smithi143.stdout:8/644: unlink d9/d12/d38/c50 0 2024-09-17T01:07:03.203 INFO:tasks.workunit.client.1.smithi143.stdout:7/762: write d4/d1f/d4a/f94 [5378811,115292] 0 2024-09-17T01:07:03.207 INFO:tasks.workunit.client.1.smithi143.stdout:8/645: readlink d9/d23/db4/d55/d57/l69 0 2024-09-17T01:07:03.209 INFO:tasks.workunit.client.0.smithi103.stdout:0/99: creat dd/f20 x:0 0 0 2024-09-17T01:07:03.210 INFO:tasks.workunit.client.1.smithi143.stdout:1/667: dread d0/d6/d43/d6a/d8f/fc9 [0,4194304] 0 2024-09-17T01:07:03.211 INFO:tasks.workunit.client.0.smithi103.stdout:4/126: link d9/c26 d9/dc/df/c27 0 2024-09-17T01:07:03.212 INFO:tasks.workunit.client.1.smithi143.stdout:4/642: truncate da/d68/f5d 322034 0 2024-09-17T01:07:03.216 INFO:tasks.workunit.client.1.smithi143.stdout:5/599: truncate d1/d46/df/d23/f26 7241441 0 2024-09-17T01:07:03.216 INFO:tasks.workunit.client.1.smithi143.stdout:9/624: dread d3/f15 [0,4194304] 0 2024-09-17T01:07:03.220 INFO:tasks.workunit.client.0.smithi103.stdout:4/127: truncate d9/fd 78105 0 2024-09-17T01:07:03.220 INFO:tasks.workunit.client.1.smithi143.stdout:8/646: creat d9/d12/d4b/feb x:0 0 0 2024-09-17T01:07:03.221 INFO:tasks.workunit.client.1.smithi143.stdout:2/599: mknod d0/cc0 0 2024-09-17T01:07:03.223 INFO:tasks.workunit.client.0.smithi103.stdout:4/128: unlink f7 0 2024-09-17T01:07:03.223 INFO:tasks.workunit.client.1.smithi143.stdout:4/643: dread da/d6d/fa4 [0,4194304] 0 2024-09-17T01:07:03.224 INFO:tasks.workunit.client.0.smithi103.stdout:4/129: write d9/d16/f1e [585103,14066] 0 2024-09-17T01:07:03.224 INFO:tasks.workunit.client.0.smithi103.stdout:0/100: getdents dd/d1c 0 2024-09-17T01:07:03.225 INFO:tasks.workunit.client.0.smithi103.stdout:4/130: write d9/d16/f12 [3920302,75235] 0 2024-09-17T01:07:03.230 INFO:tasks.workunit.client.1.smithi143.stdout:0/619: write d3/d5/d8/d27/d31/d4c/f6d [323948,61180] 0 2024-09-17T01:07:03.230 INFO:tasks.workunit.client.1.smithi143.stdout:6/556: write d2/d30/d45/d56/f60 [3731029,79264] 0 2024-09-17T01:07:03.238 INFO:tasks.workunit.client.1.smithi143.stdout:9/625: creat d3/d39/d42/d58/d5a/d5e/fce x:0 0 0 2024-09-17T01:07:03.240 INFO:tasks.workunit.client.1.smithi143.stdout:8/647: creat d9/d26/fec x:0 0 0 2024-09-17T01:07:03.240 INFO:tasks.workunit.client.1.smithi143.stdout:7/763: dread d4/d1f/d4a/f94 [0,4194304] 0 2024-09-17T01:07:03.241 INFO:tasks.workunit.client.1.smithi143.stdout:4/644: mkdir da/d3a/d3e/d5e/dd5 0 2024-09-17T01:07:03.242 INFO:tasks.workunit.client.1.smithi143.stdout:1/668: fdatasync d0/fce 0 2024-09-17T01:07:03.243 INFO:tasks.workunit.client.1.smithi143.stdout:8/648: readlink d9/de/d53/l54 0 2024-09-17T01:07:03.244 INFO:tasks.workunit.client.1.smithi143.stdout:4/645: write da/f31 [382578,101700] 0 2024-09-17T01:07:03.244 INFO:tasks.workunit.client.1.smithi143.stdout:7/764: chown d4/d1f/d29/f34 191533601 1 2024-09-17T01:07:03.245 INFO:tasks.workunit.client.1.smithi143.stdout:8/649: stat d9/d23/d32/lc7 0 2024-09-17T01:07:03.246 INFO:tasks.workunit.client.1.smithi143.stdout:6/557: creat d2/d30/d84/fb1 x:0 0 0 2024-09-17T01:07:03.247 INFO:tasks.workunit.client.1.smithi143.stdout:1/669: write d0/d6/f1f [1617614,28600] 0 2024-09-17T01:07:03.249 INFO:tasks.workunit.client.1.smithi143.stdout:8/650: chown d9/d2b/f78 0 1 2024-09-17T01:07:03.249 INFO:tasks.workunit.client.1.smithi143.stdout:5/600: dwrite d1/d46/d6e/f8d [0,4194304] 0 2024-09-17T01:07:03.252 INFO:tasks.workunit.client.1.smithi143.stdout:6/558: write d2/d30/d45/d56/f60 [3038095,430] 0 2024-09-17T01:07:03.253 INFO:tasks.workunit.client.1.smithi143.stdout:8/651: write d9/d12/d38/dba/fc0 [185940,52452] 0 2024-09-17T01:07:03.254 INFO:tasks.workunit.client.1.smithi143.stdout:6/559: write d2/fa [54443,98994] 0 2024-09-17T01:07:03.256 INFO:tasks.workunit.client.0.smithi103.stdout:8/28: sync 2024-09-17T01:07:03.257 INFO:tasks.workunit.client.1.smithi143.stdout:4/646: dwrite da/d3a/d3e/d5e/d63/fb9 [0,4194304] 0 2024-09-17T01:07:03.264 INFO:tasks.workunit.client.1.smithi143.stdout:4/647: dwrite da/f54 [0,4194304] 0 2024-09-17T01:07:03.285 INFO:tasks.workunit.client.0.smithi103.stdout:8/29: mkdir d0/d5 0 2024-09-17T01:07:03.285 INFO:tasks.workunit.client.0.smithi103.stdout:8/30: dread - no filename 2024-09-17T01:07:03.287 INFO:tasks.workunit.client.0.smithi103.stdout:0/101: dwrite dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:03.287 INFO:tasks.workunit.client.0.smithi103.stdout:0/102: dread - dd/f14 zero size 2024-09-17T01:07:03.288 INFO:tasks.workunit.client.0.smithi103.stdout:0/103: chown c2 5 1 2024-09-17T01:07:03.413 INFO:tasks.workunit.client.1.smithi143.stdout:3/630: sync 2024-09-17T01:07:03.414 INFO:tasks.workunit.client.1.smithi143.stdout:3/631: fdatasync d6/fa 0 2024-09-17T01:07:03.444 INFO:tasks.workunit.client.1.smithi143.stdout:0/620: mknod d3/d5/d8/d27/d31/d48/d8d/ccc 0 2024-09-17T01:07:03.445 INFO:tasks.workunit.client.0.smithi103.stdout:8/31: rename d0/d4 to d0/d6 0 2024-09-17T01:07:03.446 INFO:tasks.workunit.client.0.smithi103.stdout:0/104: creat dd/df/f21 x:0 0 0 2024-09-17T01:07:03.452 INFO:tasks.workunit.client.0.smithi103.stdout:8/32: creat d0/d5/f7 x:0 0 0 2024-09-17T01:07:03.453 INFO:tasks.workunit.client.0.smithi103.stdout:0/105: mknod dd/df/d1b/c22 0 2024-09-17T01:07:03.454 INFO:tasks.workunit.client.0.smithi103.stdout:0/106: dread - dd/df/f19 zero size 2024-09-17T01:07:03.454 INFO:tasks.workunit.client.0.smithi103.stdout:0/107: write dd/f20 [998144,3927] 0 2024-09-17T01:07:03.455 INFO:tasks.workunit.client.0.smithi103.stdout:8/33: unlink d0/d5/f7 0 2024-09-17T01:07:03.455 INFO:tasks.workunit.client.0.smithi103.stdout:8/34: truncate - no filename 2024-09-17T01:07:03.456 INFO:tasks.workunit.client.0.smithi103.stdout:0/108: truncate dd/f15 1641729 0 2024-09-17T01:07:03.459 INFO:tasks.workunit.client.0.smithi103.stdout:8/35: creat d0/f8 x:0 0 0 2024-09-17T01:07:03.460 INFO:tasks.workunit.client.1.smithi143.stdout:1/670: mkdir d0/d6/d43/d47/d68/d7b/de0 0 2024-09-17T01:07:03.460 INFO:tasks.workunit.client.0.smithi103.stdout:0/109: dread fc [0,4194304] 0 2024-09-17T01:07:03.462 INFO:tasks.workunit.client.0.smithi103.stdout:4/131: getdents d9 0 2024-09-17T01:07:03.464 INFO:tasks.workunit.client.0.smithi103.stdout:5/31: sync 2024-09-17T01:07:03.464 INFO:tasks.workunit.client.0.smithi103.stdout:0/110: creat dd/f23 x:0 0 0 2024-09-17T01:07:03.466 INFO:tasks.workunit.client.0.smithi103.stdout:5/32: write f0 [821132,40986] 0 2024-09-17T01:07:03.469 INFO:tasks.workunit.client.0.smithi103.stdout:4/132: dwrite d9/d10/f1f [0,4194304] 0 2024-09-17T01:07:03.472 INFO:tasks.workunit.client.1.smithi143.stdout:6/560: unlink d2/df/d20/f53 0 2024-09-17T01:07:03.472 INFO:tasks.workunit.client.1.smithi143.stdout:6/561: chown d2/df/d40/c49 851256 1 2024-09-17T01:07:03.474 INFO:tasks.workunit.client.0.smithi103.stdout:0/111: rmdir dd/df 39 2024-09-17T01:07:03.475 INFO:tasks.workunit.client.0.smithi103.stdout:0/112: read f3 [4303951,53465] 0 2024-09-17T01:07:03.476 INFO:tasks.workunit.client.0.smithi103.stdout:5/33: creat d6/db/fd x:0 0 0 2024-09-17T01:07:03.476 INFO:tasks.workunit.client.0.smithi103.stdout:0/113: chown dd/l11 1250285 1 2024-09-17T01:07:03.478 INFO:tasks.workunit.client.1.smithi143.stdout:4/648: creat da/d6d/fd6 x:0 0 0 2024-09-17T01:07:03.478 INFO:tasks.workunit.client.0.smithi103.stdout:5/34: dread f3 [0,4194304] 0 2024-09-17T01:07:03.479 INFO:tasks.workunit.client.1.smithi143.stdout:4/649: dread - da/d3a/d7c/fcf zero size 2024-09-17T01:07:03.479 INFO:tasks.workunit.client.0.smithi103.stdout:5/35: stat d6/l7 0 2024-09-17T01:07:03.479 INFO:tasks.workunit.client.0.smithi103.stdout:4/133: unlink d9/d10/l22 0 2024-09-17T01:07:03.479 INFO:tasks.workunit.client.0.smithi103.stdout:5/36: write f0 [520054,34435] 0 2024-09-17T01:07:03.480 INFO:tasks.workunit.client.1.smithi143.stdout:4/650: dread - da/d3a/d40/d84/db6/fc9 zero size 2024-09-17T01:07:03.480 INFO:tasks.workunit.client.0.smithi103.stdout:5/37: write d6/f9 [854016,31149] 0 2024-09-17T01:07:03.482 INFO:tasks.workunit.client.0.smithi103.stdout:8/36: getdents d0 0 2024-09-17T01:07:03.486 INFO:tasks.workunit.client.1.smithi143.stdout:9/626: mknod d3/d39/d42/dab/ccf 0 2024-09-17T01:07:03.486 INFO:tasks.workunit.client.1.smithi143.stdout:0/621: read d3/d5/d8/d10/f2a [1915267,48978] 0 2024-09-17T01:07:03.487 INFO:tasks.workunit.client.1.smithi143.stdout:9/627: truncate d3/d39/f4f 4937937 0 2024-09-17T01:07:03.489 INFO:tasks.workunit.client.1.smithi143.stdout:2/600: creat d0/d10/d58/d5a/d5b/d4c/d71/d9f/fc1 x:0 0 0 2024-09-17T01:07:03.489 INFO:tasks.workunit.client.1.smithi143.stdout:4/651: dread da/d3a/d40/f37 [0,4194304] 0 2024-09-17T01:07:03.492 INFO:tasks.workunit.client.1.smithi143.stdout:1/671: rmdir d0/dc/d74/d94 39 2024-09-17T01:07:03.494 INFO:tasks.workunit.client.0.smithi103.stdout:5/38: mknod d6/ce 0 2024-09-17T01:07:03.494 INFO:tasks.workunit.client.1.smithi143.stdout:1/672: stat d0/d6/d43/d6a/df/d6e/d18/f3e 0 2024-09-17T01:07:03.495 INFO:tasks.workunit.client.1.smithi143.stdout:5/601: creat d1/d46/df/d53/d74/dc7/fe6 x:0 0 0 2024-09-17T01:07:03.496 INFO:tasks.workunit.client.0.smithi103.stdout:8/37: creat d0/d5/f9 x:0 0 0 2024-09-17T01:07:03.496 INFO:tasks.workunit.client.0.smithi103.stdout:8/38: chown d0 6 1 2024-09-17T01:07:03.496 INFO:tasks.workunit.client.1.smithi143.stdout:2/601: dwrite d0/d10/d58/d5a/d5b/d4c/d71/d9f/fc1 [0,4194304] 0 2024-09-17T01:07:03.501 INFO:tasks.workunit.client.0.smithi103.stdout:5/39: fsync f3 0 2024-09-17T01:07:03.502 INFO:tasks.workunit.client.1.smithi143.stdout:0/622: dread d3/d68/f6c [0,4194304] 0 2024-09-17T01:07:03.504 INFO:tasks.workunit.client.1.smithi143.stdout:7/765: rename d4/d16/d97/fa6 to d4/d1f/ff2 0 2024-09-17T01:07:03.505 INFO:tasks.workunit.client.1.smithi143.stdout:7/766: dread - d4/d1f/d29/d65/d5d/db1/fd3 zero size 2024-09-17T01:07:03.505 INFO:tasks.workunit.client.0.smithi103.stdout:8/39: creat d0/fa x:0 0 0 2024-09-17T01:07:03.506 INFO:tasks.workunit.client.1.smithi143.stdout:7/767: write d4/f95 [255434,84831] 0 2024-09-17T01:07:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:03 smithi143 ceph-mon[35452]: pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 35 MiB/s rd, 174 MiB/s wr, 421 op/s 2024-09-17T01:07:03.512 INFO:tasks.workunit.client.0.smithi103.stdout:4/134: creat d9/d10/f28 x:0 0 0 2024-09-17T01:07:03.512 INFO:tasks.workunit.client.0.smithi103.stdout:4/135: chown d9/d10/f28 3919959 1 2024-09-17T01:07:03.513 INFO:tasks.workunit.client.0.smithi103.stdout:4/136: truncate d9/d10/f28 672346 0 2024-09-17T01:07:03.514 INFO:tasks.workunit.client.0.smithi103.stdout:5/40: symlink d6/db/lf 0 2024-09-17T01:07:03.516 INFO:tasks.workunit.client.0.smithi103.stdout:4/137: dread d9/d10/f28 [0,4194304] 0 2024-09-17T01:07:03.516 INFO:tasks.workunit.client.0.smithi103.stdout:0/114: link fc dd/df/f24 0 2024-09-17T01:07:03.518 INFO:tasks.workunit.client.1.smithi143.stdout:5/602: rename d1/d46/df/d1f/d7a/l94 to d1/d46/df/d1f/d7a/le7 0 2024-09-17T01:07:03.518 INFO:tasks.workunit.client.0.smithi103.stdout:4/138: dread d9/d10/f28 [0,4194304] 0 2024-09-17T01:07:03.520 INFO:tasks.workunit.client.1.smithi143.stdout:6/562: creat d2/d17/d3a/d47/d8e/d95/fb2 x:0 0 0 2024-09-17T01:07:03.521 INFO:tasks.workunit.client.0.smithi103.stdout:8/40: unlink d0/fa 0 2024-09-17T01:07:03.527 INFO:tasks.workunit.client.1.smithi143.stdout:4/652: creat da/d3a/d40/d84/dd0/fd7 x:0 0 0 2024-09-17T01:07:03.528 INFO:tasks.workunit.client.0.smithi103.stdout:8/41: mknod d0/d5/cb 0 2024-09-17T01:07:03.529 INFO:tasks.workunit.client.0.smithi103.stdout:8/42: truncate d0/d5/f9 111016 0 2024-09-17T01:07:03.529 INFO:tasks.workunit.client.1.smithi143.stdout:8/652: getdents d9/d12/d38/d58/d70 0 2024-09-17T01:07:03.530 INFO:tasks.workunit.client.0.smithi103.stdout:8/43: chown d0/d5/f9 2882 1 2024-09-17T01:07:03.530 INFO:tasks.workunit.client.0.smithi103.stdout:8/44: chown d0/d3 95 1 2024-09-17T01:07:03.530 INFO:tasks.workunit.client.1.smithi143.stdout:8/653: write d9/d12/d38/d7a/fb9 [434542,116767] 0 2024-09-17T01:07:03.531 INFO:tasks.workunit.client.0.smithi103.stdout:0/115: link f5 dd/df/f25 0 2024-09-17T01:07:03.531 INFO:tasks.workunit.client.0.smithi103.stdout:8/45: write d0/f8 [178456,5270] 0 2024-09-17T01:07:03.531 INFO:tasks.workunit.client.1.smithi143.stdout:2/602: fdatasync d0/d2/fb 0 2024-09-17T01:07:03.533 INFO:tasks.workunit.client.0.smithi103.stdout:4/139: fdatasync d9/f21 0 2024-09-17T01:07:03.533 INFO:tasks.workunit.client.1.smithi143.stdout:0/623: write d3/d5/d8/d27/f82 [484531,44849] 0 2024-09-17T01:07:03.534 INFO:tasks.workunit.client.0.smithi103.stdout:5/41: link l2 d6/db/l10 0 2024-09-17T01:07:03.535 INFO:tasks.workunit.client.0.smithi103.stdout:5/42: dread - f4 zero size 2024-09-17T01:07:03.535 INFO:tasks.workunit.client.1.smithi143.stdout:5/603: mknod d1/d46/d9b/ce8 0 2024-09-17T01:07:03.536 INFO:tasks.workunit.client.1.smithi143.stdout:7/768: write d4/f8f [1176678,39006] 0 2024-09-17T01:07:03.539 INFO:tasks.workunit.client.0.smithi103.stdout:8/46: rename d0/d5 to d0/d6/dc 0 2024-09-17T01:07:03.540 INFO:tasks.workunit.client.1.smithi143.stdout:9/628: creat d3/fd0 x:0 0 0 2024-09-17T01:07:03.540 INFO:tasks.workunit.client.0.smithi103.stdout:8/47: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:03.543 INFO:tasks.workunit.client.0.smithi103.stdout:4/140: symlink d9/d16/l29 0 2024-09-17T01:07:03.544 INFO:tasks.workunit.client.0.smithi103.stdout:5/43: mkdir d6/d11 0 2024-09-17T01:07:03.544 INFO:tasks.workunit.client.1.smithi143.stdout:4/653: creat da/d3a/d3e/d72/d9e/fd8 x:0 0 0 2024-09-17T01:07:03.546 INFO:tasks.workunit.client.1.smithi143.stdout:8/654: creat d9/d12/d13/fed x:0 0 0 2024-09-17T01:07:03.547 INFO:tasks.workunit.client.0.smithi103.stdout:8/48: dwrite d0/f8 [0,4194304] 0 2024-09-17T01:07:03.549 INFO:tasks.workunit.client.1.smithi143.stdout:2/603: rmdir d0/d10/d58/d5a/d5b/d4c/d71/d9d 39 2024-09-17T01:07:03.551 INFO:tasks.workunit.client.0.smithi103.stdout:4/141: fdatasync f5 0 2024-09-17T01:07:03.556 INFO:tasks.workunit.client.1.smithi143.stdout:0/624: rename d3/d14/d3d to d3/d5/d35/da8/dcd 0 2024-09-17T01:07:03.557 INFO:tasks.workunit.client.0.smithi103.stdout:0/116: write fc [150625,99693] 0 2024-09-17T01:07:03.557 INFO:tasks.workunit.client.1.smithi143.stdout:0/625: write d3/d5/f34 [3464944,120118] 0 2024-09-17T01:07:03.557 INFO:tasks.workunit.client.1.smithi143.stdout:3/632: sync 2024-09-17T01:07:03.558 INFO:tasks.workunit.client.0.smithi103.stdout:5/44: rename d6/ce to d6/d11/c12 0 2024-09-17T01:07:03.559 INFO:tasks.workunit.client.1.smithi143.stdout:7/769: mkdir d4/d1f/d4a/d66/db5/df3 0 2024-09-17T01:07:03.561 INFO:tasks.workunit.client.0.smithi103.stdout:8/49: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:03.562 INFO:tasks.workunit.client.0.smithi103.stdout:8/50: chown d0/f8 12103561 1 2024-09-17T01:07:03.564 INFO:tasks.workunit.client.1.smithi143.stdout:8/655: mkdir d9/d12/d13/d73/dee 0 2024-09-17T01:07:03.566 INFO:tasks.workunit.client.1.smithi143.stdout:3/633: dwrite d6/d1c/d33/d41/d42/fb7 [0,4194304] 0 2024-09-17T01:07:03.567 INFO:tasks.workunit.client.0.smithi103.stdout:5/45: mkdir d6/d11/d13 0 2024-09-17T01:07:03.568 INFO:tasks.workunit.client.1.smithi143.stdout:1/673: dwrite d0/d6/d43/d6a/df/d6e/d2/d39/d79/f7a [0,4194304] 0 2024-09-17T01:07:03.569 INFO:tasks.workunit.client.1.smithi143.stdout:5/604: write d1/d46/df/d23/d4f/d82/f6b [697802,18762] 0 2024-09-17T01:07:03.570 INFO:tasks.workunit.client.1.smithi143.stdout:9/629: rename d3/d39/d6a/l8a to d3/d39/d42/d58/d5a/d5e/d99/ld1 0 2024-09-17T01:07:03.575 INFO:tasks.workunit.client.1.smithi143.stdout:4/654: unlink da/d3a/d3e/d5e/d63/l6e 0 2024-09-17T01:07:03.578 INFO:tasks.workunit.client.1.smithi143.stdout:6/563: mkdir d2/df/d20/d2c/d82/db3 0 2024-09-17T01:07:03.580 INFO:tasks.workunit.client.1.smithi143.stdout:0/626: dwrite d3/d14/d32/f38 [0,4194304] 0 2024-09-17T01:07:03.581 INFO:tasks.workunit.client.1.smithi143.stdout:6/564: chown d2/df/d20/f61 12 1 2024-09-17T01:07:03.583 INFO:tasks.workunit.client.1.smithi143.stdout:2/604: creat d0/d44/d6a/fc2 x:0 0 0 2024-09-17T01:07:03.584 INFO:tasks.workunit.client.0.smithi103.stdout:5/46: unlink l2 0 2024-09-17T01:07:03.584 INFO:tasks.workunit.client.1.smithi143.stdout:8/656: dread f7 [0,4194304] 0 2024-09-17T01:07:03.584 INFO:tasks.workunit.client.0.smithi103.stdout:4/142: write d9/fd [975090,106155] 0 2024-09-17T01:07:03.585 INFO:tasks.workunit.client.0.smithi103.stdout:5/47: chown d6/db 43 1 2024-09-17T01:07:03.585 INFO:tasks.workunit.client.1.smithi143.stdout:8/657: readlink d9/d23/db4/d55/l63 0 2024-09-17T01:07:03.585 INFO:tasks.workunit.client.0.smithi103.stdout:5/48: chown d6/l7 502 1 2024-09-17T01:07:03.585 INFO:tasks.workunit.client.0.smithi103.stdout:4/143: chown d9/dc/df/f20 25754908 1 2024-09-17T01:07:03.586 INFO:tasks.workunit.client.0.smithi103.stdout:5/49: write f3 [253931,35913] 0 2024-09-17T01:07:03.587 INFO:tasks.workunit.client.1.smithi143.stdout:3/634: dread d6/d1c/d33/d41/f11 [0,4194304] 0 2024-09-17T01:07:03.588 INFO:tasks.workunit.client.0.smithi103.stdout:0/117: getdents dd/df/d1b 0 2024-09-17T01:07:03.590 INFO:tasks.workunit.client.1.smithi143.stdout:5/605: dread d1/d46/f79 [0,4194304] 0 2024-09-17T01:07:03.591 INFO:tasks.workunit.client.1.smithi143.stdout:7/770: rename d4/d1f/d4a/f89 to d4/d16/d97/ff4 0 2024-09-17T01:07:03.592 INFO:tasks.workunit.client.1.smithi143.stdout:7/771: fdatasync d4/d1f/d4a/de4/d4e/d9f/fca 0 2024-09-17T01:07:03.594 INFO:tasks.workunit.client.0.smithi103.stdout:5/50: dwrite f3 [0,4194304] 0 2024-09-17T01:07:03.595 INFO:tasks.workunit.client.0.smithi103.stdout:0/118: creat dd/df/f26 x:0 0 0 2024-09-17T01:07:03.597 INFO:tasks.workunit.client.0.smithi103.stdout:8/51: truncate d0/f8 2045492 0 2024-09-17T01:07:03.597 INFO:tasks.workunit.client.0.smithi103.stdout:4/144: mkdir d9/d16/d23/d2a 0 2024-09-17T01:07:03.599 INFO:tasks.workunit.client.0.smithi103.stdout:4/145: write d9/d16/f24 [539562,5900] 0 2024-09-17T01:07:03.600 INFO:tasks.workunit.client.0.smithi103.stdout:4/146: dread - d9/d10/f14 zero size 2024-09-17T01:07:03.600 INFO:tasks.workunit.client.0.smithi103.stdout:5/51: dread f3 [0,4194304] 0 2024-09-17T01:07:03.602 INFO:tasks.workunit.client.0.smithi103.stdout:4/147: fsync d9/fd 0 2024-09-17T01:07:03.602 INFO:tasks.workunit.client.0.smithi103.stdout:0/119: dread dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:03.603 INFO:tasks.workunit.client.0.smithi103.stdout:8/52: mknod d0/d6/dc/cd 0 2024-09-17T01:07:03.610 INFO:tasks.workunit.client.0.smithi103.stdout:4/148: mkdir d9/d16/d23/d2b 0 2024-09-17T01:07:03.611 INFO:tasks.workunit.client.0.smithi103.stdout:0/120: symlink dd/df/d1b/l27 0 2024-09-17T01:07:03.611 INFO:tasks.workunit.client.0.smithi103.stdout:8/53: rmdir d0/d6/dc 39 2024-09-17T01:07:03.612 INFO:tasks.workunit.client.0.smithi103.stdout:0/121: fsync dd/df/f24 0 2024-09-17T01:07:03.612 INFO:tasks.workunit.client.0.smithi103.stdout:4/149: creat d9/dc/df/f2c x:0 0 0 2024-09-17T01:07:03.613 INFO:tasks.workunit.client.0.smithi103.stdout:3/112: sync 2024-09-17T01:07:03.614 INFO:tasks.workunit.client.0.smithi103.stdout:4/150: write d9/dc/df/f20 [52619,96037] 0 2024-09-17T01:07:03.615 INFO:tasks.workunit.client.0.smithi103.stdout:3/113: write d3/f15 [4124452,101290] 0 2024-09-17T01:07:03.700 INFO:tasks.workunit.client.1.smithi143.stdout:9/630: creat d3/d81/d9c/fd2 x:0 0 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:5/606: unlink d1/d46/df/f45 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:9/631: chown d3/d39/d42/d58/d5a/d5e/lae 1280231994 1 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:7/772: write d4/d16/f17 [9262468,100707] 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:4/655: link da/f11 da/d3a/d3e/d4a/fd9 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:4/656: dread - da/d6d/fd6 zero size 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:4/657: chown da/d3a/d40/d84/cb2 4 1 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:0/627: symlink d3/d5/d8/d27/d31/lce 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:0/628: chown d3 57801 1 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:4/658: write da/d3a/d3e/d5e/d63/fb9 [4632103,25777] 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:4/659: write da/d6d/fd6 [957377,112525] 0 2024-09-17T01:07:03.701 INFO:tasks.workunit.client.1.smithi143.stdout:1/674: creat d0/d6/d43/d6a/df/fe1 x:0 0 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:3/635: dread d6/d1c/d33/d41/d2e/f61 [0,4194304] 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:0/629: rmdir d3/d5/d8/d10 39 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:0/630: write d3/d5/d8/d21/f3e [2130163,117927] 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:8/658: truncate d9/de/d53/d75/f88 1246732 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:8/659: chown d9/d23/d4f/fa2 205 1 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:1/675: dwrite d0/d6/d43/d6a/fc1 [0,4194304] 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:9/632: write d3/d39/d6a/d9/f5c [573642,45925] 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:9/633: chown d3/d39/d42/d58/d5a/fbc 919165 1 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:5/607: rename d1/d46/df/d23/d4f/d7d/d92/dad to d1/d46/df/d1f/de9 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:6/565: write d2/d30/d45/d70/d87/fae [2034906,4446] 0 2024-09-17T01:07:03.702 INFO:tasks.workunit.client.1.smithi143.stdout:4/660: rename da/d3a/d40/f34 to da/d3a/d40/daa/dc3/dcd/fda 0 2024-09-17T01:07:03.704 INFO:tasks.workunit.client.1.smithi143.stdout:5/608: mkdir d1/d46/df/d1f/d66/d70/dea 0 2024-09-17T01:07:03.704 INFO:tasks.workunit.client.1.smithi143.stdout:7/773: dwrite d4/d1f/f3e [0,4194304] 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:8/54: truncate d0/d6/dc/f9 161964 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:4/151: chown d9/dc/df 27 1 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:0/122: dread dd/df/f13 [0,4194304] 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:4/152: write d9/d10/f1f [1073624,117754] 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:0/123: creat dd/d1c/f28 x:0 0 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:3/114: link d3/d16/c21 d3/d16/d1b/c24 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:4/153: dwrite d9/d16/f24 [0,4194304] 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:3/115: truncate d3/f9 3463129 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:8/55: dwrite d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:4/154: mkdir d9/d2d 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:3/116: write d3/f8 [3710935,121041] 0 2024-09-17T01:07:03.705 INFO:tasks.workunit.client.0.smithi103.stdout:4/155: chown d9/d16/l29 236 1 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/56: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:3/117: dwrite d3/fd [0,4194304] 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/57: getdents d0/d6/dc 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:3/118: write d3/f9 [2516122,102330] 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:3/119: truncate d3/fd 8643167 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:4/156: dwrite d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/58: creat d0/d6/fe x:0 0 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/59: dread - d0/d6/fe zero size 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/60: chown d0/d6/fe 128 1 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/61: fdatasync d0/d6/fe 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/62: chown d0 119 1 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/63: write d0/d6/fe [542669,67928] 0 2024-09-17T01:07:03.706 INFO:tasks.workunit.client.0.smithi103.stdout:4/157: rename d9/d16/f24 to d9/d16/d23/f2e 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/120: link d3/cf d3/d16/d22/c25 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/121: creat d3/d16/d22/f26 x:0 0 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/122: chown d3/f1c 21 1 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/123: creat d3/f27 x:0 0 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/124: creat d3/d16/d1b/f28 x:0 0 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/125: symlink d3/d16/l29 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:8/64: truncate d0/d6/dc/f9 822264 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:4/158: dwrite f5 [8388608,4194304] 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:3/126: symlink d3/d16/l2a 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:4/159: creat d9/dc/f2f x:0 0 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:4/160: readlink d9/d16/l1c 0 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:4/161: dread - d9/dc/f2f zero size 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:8/65: chown d0/d6/dc/f9 8004994 1 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:8/66: rename d0/d3 to d0/d3/df 22 2024-09-17T01:07:03.707 INFO:tasks.workunit.client.0.smithi103.stdout:4/162: write d9/fd [592222,19028] 0 2024-09-17T01:07:03.708 INFO:tasks.workunit.client.0.smithi103.stdout:3/127: link d3/f7 d3/d16/f2b 0 2024-09-17T01:07:03.708 INFO:tasks.workunit.client.0.smithi103.stdout:3/128: fdatasync d3/f15 0 2024-09-17T01:07:03.709 INFO:tasks.workunit.client.0.smithi103.stdout:4/163: unlink d9/dc/df/c13 0 2024-09-17T01:07:03.714 INFO:tasks.workunit.client.1.smithi143.stdout:0/631: rename d3/d5/d35/da8/dcd/f8e to d3/d5/d8/d27/d31/d85/fcf 0 2024-09-17T01:07:03.716 INFO:tasks.workunit.client.0.smithi103.stdout:3/129: mkdir d3/d16/d1b/d2c 0 2024-09-17T01:07:03.716 INFO:tasks.workunit.client.0.smithi103.stdout:3/130: fsync d3/f8 0 2024-09-17T01:07:03.717 INFO:tasks.workunit.client.0.smithi103.stdout:3/131: fsync d3/f14 0 2024-09-17T01:07:03.722 INFO:tasks.workunit.client.1.smithi143.stdout:8/660: rmdir d9/d23/de2 0 2024-09-17T01:07:03.724 INFO:tasks.workunit.client.0.smithi103.stdout:8/67: creat d0/d6/f10 x:0 0 0 2024-09-17T01:07:03.725 INFO:tasks.workunit.client.1.smithi143.stdout:3/636: getdents d6/d1c/d33/d41/d2e/d86/d89 0 2024-09-17T01:07:03.726 INFO:tasks.workunit.client.1.smithi143.stdout:6/566: stat d2/d17/d6e/d26/d46/d66/c76 0 2024-09-17T01:07:03.727 INFO:tasks.workunit.client.1.smithi143.stdout:6/567: write d2/df/d18/fa0 [865042,93076] 0 2024-09-17T01:07:03.729 INFO:tasks.workunit.client.1.smithi143.stdout:1/676: rename d0/d6/d43/d6a/df/d6e/d2/d39 to d0/d6/d43/d6d/d8b/dd0/de2 0 2024-09-17T01:07:03.731 INFO:tasks.workunit.client.1.smithi143.stdout:5/609: dwrite d1/d46/df/f62 [0,4194304] 0 2024-09-17T01:07:03.731 INFO:tasks.workunit.client.0.smithi103.stdout:4/164: symlink d9/l30 0 2024-09-17T01:07:03.732 INFO:tasks.workunit.client.1.smithi143.stdout:0/632: dread d3/d14/fa9 [0,4194304] 0 2024-09-17T01:07:03.734 INFO:tasks.workunit.client.0.smithi103.stdout:8/68: rename d0/d6/fe to d0/d6/dc/f11 0 2024-09-17T01:07:03.735 INFO:tasks.workunit.client.1.smithi143.stdout:8/661: creat d9/d12/d4b/d3f/fef x:0 0 0 2024-09-17T01:07:03.737 INFO:tasks.workunit.client.1.smithi143.stdout:7/774: creat d4/d1f/d4a/d9e/dd1/ff5 x:0 0 0 2024-09-17T01:07:03.738 INFO:tasks.workunit.client.1.smithi143.stdout:1/677: dwrite d0/d6/d43/d47/d88/da5/db1/fcd [0,4194304] 0 2024-09-17T01:07:03.738 INFO:tasks.workunit.client.1.smithi143.stdout:7/775: write d4/d26/f76 [4888935,45323] 0 2024-09-17T01:07:03.742 INFO:tasks.workunit.client.0.smithi103.stdout:8/69: rename d0/d3 to d0/d6/dc/d12 0 2024-09-17T01:07:03.743 INFO:tasks.workunit.client.1.smithi143.stdout:9/634: rename l0 to d3/d39/d6a/d9/ld3 0 2024-09-17T01:07:03.744 INFO:tasks.workunit.client.0.smithi103.stdout:4/165: fdatasync d9/d10/f28 0 2024-09-17T01:07:03.747 INFO:tasks.workunit.client.1.smithi143.stdout:5/610: chown d1/d46/cb3 11021 1 2024-09-17T01:07:03.747 INFO:tasks.workunit.client.0.smithi103.stdout:3/132: getdents d3 0 2024-09-17T01:07:03.749 INFO:tasks.workunit.client.1.smithi143.stdout:4/661: mknod da/d3a/d3e/d72/da3/dc0/cdb 0 2024-09-17T01:07:03.752 INFO:tasks.workunit.client.1.smithi143.stdout:2/605: sync 2024-09-17T01:07:03.753 INFO:tasks.workunit.client.0.smithi103.stdout:8/70: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:03.754 INFO:tasks.workunit.client.0.smithi103.stdout:4/166: dwrite f3 [4194304,4194304] 0 2024-09-17T01:07:03.755 INFO:tasks.workunit.client.1.smithi143.stdout:8/662: mknod d9/d2b/cf0 0 2024-09-17T01:07:03.761 INFO:tasks.workunit.client.1.smithi143.stdout:8/663: dwrite d9/d23/db4/d55/d57/fbb [0,4194304] 0 2024-09-17T01:07:03.761 INFO:tasks.workunit.client.1.smithi143.stdout:1/678: write d0/d6/d43/d6a/df/d27/f84 [1027901,117258] 0 2024-09-17T01:07:03.761 INFO:tasks.workunit.client.0.smithi103.stdout:8/71: symlink d0/l13 0 2024-09-17T01:07:03.762 INFO:tasks.workunit.client.0.smithi103.stdout:4/167: dwrite d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:03.763 INFO:tasks.workunit.client.0.smithi103.stdout:8/72: chown d0/d6/dc/cd 667300 1 2024-09-17T01:07:03.765 INFO:tasks.workunit.client.1.smithi143.stdout:8/664: truncate d9/d12/d4b/d3f/fef 873266 0 2024-09-17T01:07:03.765 INFO:tasks.workunit.client.1.smithi143.stdout:1/679: write d0/d6/d43/d6d/d8b/dd0/de2/d79/f7a [3571307,42330] 0 2024-09-17T01:07:03.767 INFO:tasks.workunit.client.1.smithi143.stdout:6/568: dwrite d2/df/f2e [0,4194304] 0 2024-09-17T01:07:03.769 INFO:tasks.workunit.client.1.smithi143.stdout:3/637: rename d6/l8 to d6/d1c/d4b/dab/lc7 0 2024-09-17T01:07:03.770 INFO:tasks.workunit.client.1.smithi143.stdout:9/635: symlink d3/d39/d6a/ld4 0 2024-09-17T01:07:03.771 INFO:tasks.workunit.client.0.smithi103.stdout:8/73: mknod d0/d6/c14 0 2024-09-17T01:07:03.771 INFO:tasks.workunit.client.0.smithi103.stdout:4/168: dwrite d9/d16/f1e [0,4194304] 0 2024-09-17T01:07:03.772 INFO:tasks.workunit.client.1.smithi143.stdout:5/611: symlink d1/d46/df/d23/d4f/d7d/dcf/leb 0 2024-09-17T01:07:03.772 INFO:tasks.workunit.client.1.smithi143.stdout:4/662: rmdir da/d3a/d40/daa 39 2024-09-17T01:07:03.773 INFO:tasks.workunit.client.0.smithi103.stdout:4/169: rename d9/dc to d9/dc/d31 22 2024-09-17T01:07:03.775 INFO:tasks.workunit.client.1.smithi143.stdout:2/606: creat d0/d10/d58/d5a/d5b/d4c/d77/fc3 x:0 0 0 2024-09-17T01:07:03.776 INFO:tasks.workunit.client.0.smithi103.stdout:4/170: rmdir d9/d16/d23 39 2024-09-17T01:07:03.778 INFO:tasks.workunit.client.0.smithi103.stdout:8/74: mknod d0/d6/c15 0 2024-09-17T01:07:03.780 INFO:tasks.workunit.client.1.smithi143.stdout:3/638: mknod d6/d1c/d4b/d57/cc8 0 2024-09-17T01:07:03.780 INFO:tasks.workunit.client.0.smithi103.stdout:8/75: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:03.784 INFO:tasks.workunit.client.0.smithi103.stdout:4/171: mkdir d9/d16/d23/d32 0 2024-09-17T01:07:03.784 INFO:tasks.workunit.client.1.smithi143.stdout:6/569: mkdir d2/d30/db4 0 2024-09-17T01:07:03.785 INFO:tasks.workunit.client.1.smithi143.stdout:1/680: chown d0/dc/d74/d94/fa9 10 1 2024-09-17T01:07:03.785 INFO:tasks.workunit.client.1.smithi143.stdout:5/612: dwrite d1/d46/df/d23/d4f/d82/f6b [0,4194304] 0 2024-09-17T01:07:03.786 INFO:tasks.workunit.client.0.smithi103.stdout:3/133: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:07:03.786 INFO:tasks.workunit.client.1.smithi143.stdout:4/663: dwrite da/d3a/d3e/d5e/fa2 [0,4194304] 0 2024-09-17T01:07:03.786 INFO:tasks.workunit.client.1.smithi143.stdout:8/665: unlink d9/d23/db4/f40 0 2024-09-17T01:07:03.788 INFO:tasks.workunit.client.0.smithi103.stdout:4/172: mknod d9/d2d/c33 0 2024-09-17T01:07:03.788 INFO:tasks.workunit.client.1.smithi143.stdout:1/681: write d0/d6/d43/d6a/df/d27/f84 [378325,53826] 0 2024-09-17T01:07:03.788 INFO:tasks.workunit.client.1.smithi143.stdout:8/666: dread - d9/fab zero size 2024-09-17T01:07:03.790 INFO:tasks.workunit.client.1.smithi143.stdout:9/636: creat d3/d81/fd5 x:0 0 0 2024-09-17T01:07:03.791 INFO:tasks.workunit.client.1.smithi143.stdout:2/607: mkdir d0/d44/d6a/d91/dc4 0 2024-09-17T01:07:03.791 INFO:tasks.workunit.client.0.smithi103.stdout:8/76: getdents d0/d6/dc 0 2024-09-17T01:07:03.792 INFO:tasks.workunit.client.0.smithi103.stdout:3/134: getdents d3/d16/d1b/d2c 0 2024-09-17T01:07:03.792 INFO:tasks.workunit.client.0.smithi103.stdout:4/173: mknod d9/c34 0 2024-09-17T01:07:03.794 INFO:tasks.workunit.client.1.smithi143.stdout:6/570: chown d2/d30/d45/d70/d87/d74/f86 27640 1 2024-09-17T01:07:03.794 INFO:tasks.workunit.client.1.smithi143.stdout:1/682: chown d0/d6/d43/d6a/d52/f6f 60209 1 2024-09-17T01:07:03.795 INFO:tasks.workunit.client.1.smithi143.stdout:8/667: creat d9/d12/d38/d58/d70/ff1 x:0 0 0 2024-09-17T01:07:03.795 INFO:tasks.workunit.client.0.smithi103.stdout:3/135: rmdir d3/d16/d1b 39 2024-09-17T01:07:03.798 INFO:tasks.workunit.client.0.smithi103.stdout:4/174: chown d9/dc/df/c27 761 1 2024-09-17T01:07:03.798 INFO:tasks.workunit.client.1.smithi143.stdout:5/613: creat d1/d46/df/d53/d74/d9a/d9c/fec x:0 0 0 2024-09-17T01:07:03.801 INFO:tasks.workunit.client.0.smithi103.stdout:4/175: creat d9/dc/f35 x:0 0 0 2024-09-17T01:07:03.801 INFO:tasks.workunit.client.1.smithi143.stdout:3/639: rename d6/d1c/f2a to d6/d1c/d33/d41/d42/fc9 0 2024-09-17T01:07:03.802 INFO:tasks.workunit.client.0.smithi103.stdout:4/176: truncate d9/dc/df/f2c 67291 0 2024-09-17T01:07:03.803 INFO:tasks.workunit.client.0.smithi103.stdout:4/177: write d9/d10/f14 [32735,104598] 0 2024-09-17T01:07:03.804 INFO:tasks.workunit.client.1.smithi143.stdout:5/614: dread - d1/d46/d6e/db7/fcd zero size 2024-09-17T01:07:03.805 INFO:tasks.workunit.client.0.smithi103.stdout:3/136: creat d3/d16/f2d x:0 0 0 2024-09-17T01:07:03.808 INFO:tasks.workunit.client.1.smithi143.stdout:2/608: dwrite d0/d44/d6a/d91/fa6 [0,4194304] 0 2024-09-17T01:07:03.808 INFO:tasks.workunit.client.1.smithi143.stdout:4/664: dwrite da/d3a/d40/d84/f43 [0,4194304] 0 2024-09-17T01:07:03.811 INFO:tasks.workunit.client.0.smithi103.stdout:4/178: dread d9/d10/f14 [0,4194304] 0 2024-09-17T01:07:03.811 INFO:tasks.workunit.client.1.smithi143.stdout:0/633: truncate d3/d14/f61 7751992 0 2024-09-17T01:07:03.812 INFO:tasks.workunit.client.0.smithi103.stdout:3/137: dwrite d3/f14 [4194304,4194304] 0 2024-09-17T01:07:03.814 INFO:tasks.workunit.client.1.smithi143.stdout:1/683: dwrite d0/dc/d57/f5d [0,4194304] 0 2024-09-17T01:07:03.815 INFO:tasks.workunit.client.1.smithi143.stdout:6/571: link d2/d17/d3a/f51 d2/d17/d3a/d47/fb5 0 2024-09-17T01:07:03.817 INFO:tasks.workunit.client.1.smithi143.stdout:8/668: rmdir d9/d12/d38/d58/d70/dd2 0 2024-09-17T01:07:03.819 INFO:tasks.workunit.client.0.smithi103.stdout:3/138: dread d3/fd [0,4194304] 0 2024-09-17T01:07:03.822 INFO:tasks.workunit.client.1.smithi143.stdout:9/637: creat d3/d39/d6a/dc3/d3e/fd6 x:0 0 0 2024-09-17T01:07:03.823 INFO:tasks.workunit.client.0.smithi103.stdout:4/179: fdatasync d9/d10/f14 0 2024-09-17T01:07:03.823 INFO:tasks.workunit.client.1.smithi143.stdout:8/669: dwrite d9/d12/d13/f33 [0,4194304] 0 2024-09-17T01:07:03.824 INFO:tasks.workunit.client.0.smithi103.stdout:4/180: write d9/dc/df/f25 [4527679,79876] 0 2024-09-17T01:07:03.827 INFO:tasks.workunit.client.0.smithi103.stdout:3/139: mknod d3/c2e 0 2024-09-17T01:07:03.830 INFO:tasks.workunit.client.1.smithi143.stdout:7/776: truncate d4/d1f/d4a/f94 6340652 0 2024-09-17T01:07:03.831 INFO:tasks.workunit.client.0.smithi103.stdout:3/140: mknod d3/c2f 0 2024-09-17T01:07:03.833 INFO:tasks.workunit.client.1.smithi143.stdout:6/572: creat d2/df/d20/d2c/d38/fb6 x:0 0 0 2024-09-17T01:07:03.834 INFO:tasks.workunit.client.0.smithi103.stdout:4/181: dwrite d9/dc/df/f20 [0,4194304] 0 2024-09-17T01:07:03.835 INFO:tasks.workunit.client.0.smithi103.stdout:3/141: write d3/d16/d1b/f28 [851701,21621] 0 2024-09-17T01:07:03.836 INFO:tasks.workunit.client.1.smithi143.stdout:8/670: mkdir d9/de/d53/d75/daf/df2 0 2024-09-17T01:07:03.837 INFO:tasks.workunit.client.1.smithi143.stdout:0/634: read d3/d5/d35/da8/dcd/f54 [215751,128143] 0 2024-09-17T01:07:03.837 INFO:tasks.workunit.client.0.smithi103.stdout:3/142: write d3/d16/f1a [779637,54820] 0 2024-09-17T01:07:03.838 INFO:tasks.workunit.client.1.smithi143.stdout:3/640: link d6/d1c/d33/d41/d2e/d86/d89/fa6 d6/d1c/d33/d3f/d5c/da1/fca 0 2024-09-17T01:07:03.839 INFO:tasks.workunit.client.1.smithi143.stdout:1/684: dread d0/d6/d43/f65 [0,4194304] 0 2024-09-17T01:07:03.839 INFO:tasks.workunit.client.1.smithi143.stdout:1/685: readlink d0/d6/d43/l93 0 2024-09-17T01:07:03.841 INFO:tasks.workunit.client.1.smithi143.stdout:9/638: truncate d3/d39/d42/d58/d5a/d5e/f7d 352044 0 2024-09-17T01:07:03.842 INFO:tasks.workunit.client.1.smithi143.stdout:2/609: mkdir d0/d10/d58/d5a/d5b/d4c/d71/dc5 0 2024-09-17T01:07:03.842 INFO:tasks.workunit.client.1.smithi143.stdout:2/610: readlink d0/d2/l3f 0 2024-09-17T01:07:03.843 INFO:tasks.workunit.client.0.smithi103.stdout:4/182: mkdir d9/d16/d36 0 2024-09-17T01:07:03.844 INFO:tasks.workunit.client.1.smithi143.stdout:5/615: creat d1/d46/fed x:0 0 0 2024-09-17T01:07:03.846 INFO:tasks.workunit.client.0.smithi103.stdout:3/143: dwrite d3/f1d [0,4194304] 0 2024-09-17T01:07:03.847 INFO:tasks.workunit.client.1.smithi143.stdout:0/635: mkdir d3/d68/d75/dd0 0 2024-09-17T01:07:03.848 INFO:tasks.workunit.client.1.smithi143.stdout:1/686: creat d0/d6/d43/d47/d72/fe3 x:0 0 0 2024-09-17T01:07:03.849 INFO:tasks.workunit.client.1.smithi143.stdout:9/639: mknod d3/d39/d6a/d9/d74/cd7 0 2024-09-17T01:07:03.851 INFO:tasks.workunit.client.0.smithi103.stdout:3/144: symlink d3/d16/d22/l30 0 2024-09-17T01:07:03.851 INFO:tasks.workunit.client.0.smithi103.stdout:4/183: creat d9/d16/f37 x:0 0 0 2024-09-17T01:07:03.852 INFO:tasks.workunit.client.1.smithi143.stdout:4/665: dread da/f2a [0,4194304] 0 2024-09-17T01:07:03.852 INFO:tasks.workunit.client.0.smithi103.stdout:4/184: chown f3 3 1 2024-09-17T01:07:03.853 INFO:tasks.workunit.client.0.smithi103.stdout:4/185: write d9/dc/f35 [562316,53006] 0 2024-09-17T01:07:03.854 INFO:tasks.workunit.client.1.smithi143.stdout:8/671: creat d9/d12/d13/d73/dee/ff3 x:0 0 0 2024-09-17T01:07:03.854 INFO:tasks.workunit.client.0.smithi103.stdout:3/145: mknod d3/c31 0 2024-09-17T01:07:03.855 INFO:tasks.workunit.client.1.smithi143.stdout:1/687: chown d0/d6/d43/d6a/d52/db2/cc5 0 1 2024-09-17T01:07:03.857 INFO:tasks.workunit.client.1.smithi143.stdout:6/573: dwrite d2/d17/d6e/d26/d46/f80 [0,4194304] 0 2024-09-17T01:07:03.858 INFO:tasks.workunit.client.1.smithi143.stdout:4/666: write da/d3a/f51 [1247322,93890] 0 2024-09-17T01:07:03.858 INFO:tasks.workunit.client.1.smithi143.stdout:0/636: rmdir d3/d68 39 2024-09-17T01:07:03.862 INFO:tasks.workunit.client.0.smithi103.stdout:3/146: dwrite d3/f14 [0,4194304] 0 2024-09-17T01:07:03.863 INFO:tasks.workunit.client.1.smithi143.stdout:5/616: creat d1/d46/df/d53/de1/fee x:0 0 0 2024-09-17T01:07:03.866 INFO:tasks.workunit.client.1.smithi143.stdout:8/672: chown d9/f11 68862948 1 2024-09-17T01:07:03.867 INFO:tasks.workunit.client.1.smithi143.stdout:5/617: chown d1/d46/l2f 3172193 1 2024-09-17T01:07:03.867 INFO:tasks.workunit.client.1.smithi143.stdout:9/640: dwrite d3/fd0 [0,4194304] 0 2024-09-17T01:07:03.869 INFO:tasks.workunit.client.1.smithi143.stdout:5/618: chown d1/d46/df/d53/d74/d9a/d9c/fc8 6 1 2024-09-17T01:07:03.872 INFO:tasks.workunit.client.1.smithi143.stdout:0/637: rmdir d3/d5/d8/d27/d31/d48 39 2024-09-17T01:07:03.873 INFO:tasks.workunit.client.0.smithi103.stdout:3/147: read d3/d16/f1a [314188,68860] 0 2024-09-17T01:07:03.874 INFO:tasks.workunit.client.1.smithi143.stdout:2/611: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fc6 x:0 0 0 2024-09-17T01:07:03.876 INFO:tasks.workunit.client.1.smithi143.stdout:4/667: creat da/d3a/d3e/d4a/d8a/fdc x:0 0 0 2024-09-17T01:07:03.877 INFO:tasks.workunit.client.1.smithi143.stdout:4/668: read da/d3a/d40/d84/f94 [369499,98792] 0 2024-09-17T01:07:03.878 INFO:tasks.workunit.client.0.smithi103.stdout:3/148: mknod d3/d16/d22/c32 0 2024-09-17T01:07:03.879 INFO:tasks.workunit.client.0.smithi103.stdout:3/149: dread - d3/d16/d22/f26 zero size 2024-09-17T01:07:03.881 INFO:tasks.workunit.client.1.smithi143.stdout:6/574: mknod d2/d17/d6e/d26/cb7 0 2024-09-17T01:07:03.882 INFO:tasks.workunit.client.1.smithi143.stdout:5/619: readlink d1/d46/l15 0 2024-09-17T01:07:03.882 INFO:tasks.workunit.client.1.smithi143.stdout:3/641: dread d6/f90 [0,4194304] 0 2024-09-17T01:07:03.883 INFO:tasks.workunit.client.1.smithi143.stdout:3/642: fdatasync d6/d1c/d33/d5d/fba 0 2024-09-17T01:07:03.884 INFO:tasks.workunit.client.0.smithi103.stdout:3/150: symlink d3/l33 0 2024-09-17T01:07:03.885 INFO:tasks.workunit.client.1.smithi143.stdout:1/688: link d0/dc/d57/fba d0/d6/d43/d6a/d52/db2/db6/fe4 0 2024-09-17T01:07:03.887 INFO:tasks.workunit.client.1.smithi143.stdout:2/612: mkdir d0/d44/d6a/d91/dc7 0 2024-09-17T01:07:03.888 INFO:tasks.workunit.client.0.smithi103.stdout:3/151: mkdir d3/d16/d1b/d2c/d34 0 2024-09-17T01:07:03.889 INFO:tasks.workunit.client.0.smithi103.stdout:3/152: fsync d3/f8 0 2024-09-17T01:07:03.889 INFO:tasks.workunit.client.0.smithi103.stdout:3/153: readlink d3/l12 0 2024-09-17T01:07:03.890 INFO:tasks.workunit.client.0.smithi103.stdout:3/154: readlink d3/d16/d1b/l1f 0 2024-09-17T01:07:03.890 INFO:tasks.workunit.client.1.smithi143.stdout:4/669: mkdir da/d68/d9b/ddd 0 2024-09-17T01:07:03.893 INFO:tasks.workunit.client.1.smithi143.stdout:9/641: symlink d3/d39/d6a/dc3/d3e/ld8 0 2024-09-17T01:07:03.896 INFO:tasks.workunit.client.0.smithi103.stdout:3/155: rename d3/d16/d1b/f28 to d3/d16/d22/f35 0 2024-09-17T01:07:03.900 INFO:tasks.workunit.client.0.smithi103.stdout:3/156: mkdir d3/d16/d1b/d36 0 2024-09-17T01:07:03.903 INFO:tasks.workunit.client.1.smithi143.stdout:0/638: creat d3/d5/d8/d21/d9b/dba/fd1 x:0 0 0 2024-09-17T01:07:03.903 INFO:tasks.workunit.client.1.smithi143.stdout:0/639: chown d3/d5/d8/d27/d8c/cbb 333394 1 2024-09-17T01:07:03.909 INFO:tasks.workunit.client.1.smithi143.stdout:8/673: rename d9/d23/d4f to d9/d12/df4 0 2024-09-17T01:07:03.910 INFO:tasks.workunit.client.1.smithi143.stdout:8/674: chown d9/d12/d13/lc1 242793727 1 2024-09-17T01:07:03.910 INFO:tasks.workunit.client.1.smithi143.stdout:4/670: mkdir da/d3a/d3e/d72/d9e/dde 0 2024-09-17T01:07:03.911 INFO:tasks.workunit.client.1.smithi143.stdout:7/777: truncate d4/d26/f2d 722823 0 2024-09-17T01:07:03.912 INFO:tasks.workunit.client.1.smithi143.stdout:6/575: mknod d2/d30/d45/d70/d87/d8d/cb8 0 2024-09-17T01:07:03.912 INFO:tasks.workunit.client.1.smithi143.stdout:7/778: truncate d4/d1f/f68 4383763 0 2024-09-17T01:07:03.915 INFO:tasks.workunit.client.1.smithi143.stdout:1/689: creat d0/d6/d43/d47/dd8/fe5 x:0 0 0 2024-09-17T01:07:03.916 INFO:tasks.workunit.client.1.smithi143.stdout:1/690: dread - d0/d6/d43/d47/dd8/fe5 zero size 2024-09-17T01:07:03.917 INFO:tasks.workunit.client.1.smithi143.stdout:0/640: unlink d3/d5/d8/l53 0 2024-09-17T01:07:03.919 INFO:tasks.workunit.client.1.smithi143.stdout:8/675: unlink d9/d12/d4b/feb 0 2024-09-17T01:07:03.922 INFO:tasks.workunit.client.1.smithi143.stdout:8/676: dread d9/d23/d32/fb0 [0,4194304] 0 2024-09-17T01:07:03.923 INFO:tasks.workunit.client.0.smithi103.stdout:4/186: dwrite d9/d10/f28 [0,4194304] 0 2024-09-17T01:07:03.923 INFO:tasks.workunit.client.1.smithi143.stdout:0/641: dread d3/d14/fb2 [0,4194304] 0 2024-09-17T01:07:03.926 INFO:tasks.workunit.client.0.smithi103.stdout:4/187: dread d9/d16/d23/f2e [0,4194304] 0 2024-09-17T01:07:03.927 INFO:tasks.workunit.client.1.smithi143.stdout:1/691: truncate d0/d6/d43/d6a/df/d6e/d2/f5b 110704 0 2024-09-17T01:07:03.928 INFO:tasks.workunit.client.0.smithi103.stdout:4/188: rmdir d9/d16/d23 39 2024-09-17T01:07:03.929 INFO:tasks.workunit.client.0.smithi103.stdout:4/189: write d9/dc/f2f [494918,47572] 0 2024-09-17T01:07:03.931 INFO:tasks.workunit.client.0.smithi103.stdout:4/190: write d9/d16/f1e [1447519,65539] 0 2024-09-17T01:07:03.932 INFO:tasks.workunit.client.1.smithi143.stdout:7/779: mkdir d4/d1f/d98/df6 0 2024-09-17T01:07:03.933 INFO:tasks.workunit.client.1.smithi143.stdout:9/642: link d3/d39/d42/d58/d5a/d5e/d99/c3b d3/d39/d6a/dc3/d3e/d51/d52/cd9 0 2024-09-17T01:07:03.938 INFO:tasks.workunit.client.1.smithi143.stdout:3/643: link d6/d1c/d33/d41/f21 d6/d1c/d33/d41/d2e/d86/fcb 0 2024-09-17T01:07:03.939 INFO:tasks.workunit.client.0.smithi103.stdout:4/191: mkdir d9/d16/d38 0 2024-09-17T01:07:03.942 INFO:tasks.workunit.client.0.smithi103.stdout:4/192: rename d9/dc/f35 to d9/d2d/f39 0 2024-09-17T01:07:03.943 INFO:tasks.workunit.client.1.smithi143.stdout:5/620: dwrite d1/d46/df/d53/f56 [0,4194304] 0 2024-09-17T01:07:03.944 INFO:tasks.workunit.client.1.smithi143.stdout:2/613: write d0/d2/d21/d22/f2d [661679,29482] 0 2024-09-17T01:07:03.944 INFO:tasks.workunit.client.0.smithi103.stdout:3/157: truncate d3/fd 4339911 0 2024-09-17T01:07:03.945 INFO:tasks.workunit.client.1.smithi143.stdout:3/644: dread d6/d1c/d33/d41/d2e/d30/f74 [0,4194304] 0 2024-09-17T01:07:03.948 INFO:tasks.workunit.client.0.smithi103.stdout:3/158: symlink d3/l37 0 2024-09-17T01:07:03.950 INFO:tasks.workunit.client.1.smithi143.stdout:6/576: link d2/d17/d3a/d47/d8e/l93 d2/df/d18/lb9 0 2024-09-17T01:07:03.951 INFO:tasks.workunit.client.0.smithi103.stdout:3/159: symlink d3/d16/d1b/l38 0 2024-09-17T01:07:03.952 INFO:tasks.workunit.client.1.smithi143.stdout:5/621: dwrite d1/d46/f91 [0,4194304] 0 2024-09-17T01:07:03.952 INFO:tasks.workunit.client.1.smithi143.stdout:5/622: chown d1/d46/df/d1f/d66/d70 37 1 2024-09-17T01:07:03.953 INFO:tasks.workunit.client.1.smithi143.stdout:7/780: mkdir d4/d1f/d4a/ddb/de7/df7 0 2024-09-17T01:07:03.956 INFO:tasks.workunit.client.0.smithi103.stdout:4/193: link d9/dc/df/f2c d9/f3a 0 2024-09-17T01:07:03.958 INFO:tasks.workunit.client.1.smithi143.stdout:1/692: rename d0/l35 to d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/le6 0 2024-09-17T01:07:03.959 INFO:tasks.workunit.client.0.smithi103.stdout:3/160: dwrite d3/f15 [4194304,4194304] 0 2024-09-17T01:07:03.960 INFO:tasks.workunit.client.1.smithi143.stdout:5/623: dread d1/d46/df/d53/d74/fa7 [0,4194304] 0 2024-09-17T01:07:03.961 INFO:tasks.workunit.client.1.smithi143.stdout:5/624: write d1/d46/df/d53/d74/dc7/fe6 [905865,86041] 0 2024-09-17T01:07:03.963 INFO:tasks.workunit.client.0.smithi103.stdout:1/79: sync 2024-09-17T01:07:03.963 INFO:tasks.workunit.client.0.smithi103.stdout:9/113: sync 2024-09-17T01:07:03.963 INFO:tasks.workunit.client.0.smithi103.stdout:7/102: sync 2024-09-17T01:07:03.963 INFO:tasks.workunit.client.0.smithi103.stdout:6/68: sync 2024-09-17T01:07:03.963 INFO:tasks.workunit.client.0.smithi103.stdout:2/46: sync 2024-09-17T01:07:03.965 INFO:tasks.workunit.client.1.smithi143.stdout:4/671: truncate da/d6d/fd6 94682 0 2024-09-17T01:07:03.966 INFO:tasks.workunit.client.1.smithi143.stdout:2/614: write d0/d10/d58/d5a/d5b/d4c/d59/f8b [75218,27684] 0 2024-09-17T01:07:03.968 INFO:tasks.workunit.client.0.smithi103.stdout:4/194: dwrite d9/d10/f28 [0,4194304] 0 2024-09-17T01:07:03.968 INFO:tasks.workunit.client.0.smithi103.stdout:9/114: chown d7/dd/d11/d21/l28 12 1 2024-09-17T01:07:03.968 INFO:tasks.workunit.client.1.smithi143.stdout:3/645: dread d6/f8a [0,4194304] 0 2024-09-17T01:07:03.969 INFO:tasks.workunit.client.1.smithi143.stdout:8/677: write f7 [787881,45542] 0 2024-09-17T01:07:03.969 INFO:tasks.workunit.client.0.smithi103.stdout:7/103: chown d4/d10/f1d 663497236 1 2024-09-17T01:07:03.970 INFO:tasks.workunit.client.1.smithi143.stdout:6/577: unlink d2/df/d18/fa0 0 2024-09-17T01:07:03.982 INFO:tasks.workunit.client.0.smithi103.stdout:7/104: unlink d4/c6 0 2024-09-17T01:07:03.984 INFO:tasks.workunit.client.0.smithi103.stdout:7/105: dread d4/d11/f18 [0,4194304] 0 2024-09-17T01:07:03.985 INFO:tasks.workunit.client.0.smithi103.stdout:7/106: readlink d4/lc 0 2024-09-17T01:07:03.985 INFO:tasks.workunit.client.0.smithi103.stdout:7/107: stat d4/d10/l1b 0 2024-09-17T01:07:03.986 INFO:tasks.workunit.client.1.smithi143.stdout:3/646: dread - d6/d1c/d33/f5e zero size 2024-09-17T01:07:03.989 INFO:tasks.workunit.client.0.smithi103.stdout:7/108: dread d4/f1a [0,4194304] 0 2024-09-17T01:07:03.992 INFO:tasks.workunit.client.0.smithi103.stdout:1/80: dread d2/f4 [0,4194304] 0 2024-09-17T01:07:03.993 INFO:tasks.workunit.client.1.smithi143.stdout:7/781: rename d4/d1f/c56 to d4/d1f/d4a/d66/cf8 0 2024-09-17T01:07:03.995 INFO:tasks.workunit.client.1.smithi143.stdout:9/643: link d3/d39/d6a/fc d3/d81/d9c/fda 0 2024-09-17T01:07:03.997 INFO:tasks.workunit.client.0.smithi103.stdout:5/52: sync 2024-09-17T01:07:03.997 INFO:tasks.workunit.client.0.smithi103.stdout:5/53: fsync f4 0 2024-09-17T01:07:03.998 INFO:tasks.workunit.client.0.smithi103.stdout:6/69: rename f2 to d3/f18 0 2024-09-17T01:07:04.000 INFO:tasks.workunit.client.1.smithi143.stdout:9/644: dwrite d3/d39/d6a/d9/d74/fca [0,4194304] 0 2024-09-17T01:07:04.004 INFO:tasks.workunit.client.1.smithi143.stdout:2/615: creat d0/d44/d7a/d86/d97/fc8 x:0 0 0 2024-09-17T01:07:04.005 INFO:tasks.workunit.client.1.smithi143.stdout:2/616: chown d0 6 1 2024-09-17T01:07:04.005 INFO:tasks.workunit.client.1.smithi143.stdout:2/617: dread - d0/d10/f8f zero size 2024-09-17T01:07:04.006 INFO:tasks.workunit.client.1.smithi143.stdout:3/647: creat d6/d1c/d82/fcc x:0 0 0 2024-09-17T01:07:04.008 INFO:tasks.workunit.client.0.smithi103.stdout:3/161: getdents d3/d16/d22 0 2024-09-17T01:07:04.009 INFO:tasks.workunit.client.1.smithi143.stdout:6/578: mkdir d2/df/d18/d69/dba 0 2024-09-17T01:07:04.010 INFO:tasks.workunit.client.0.smithi103.stdout:7/109: symlink d4/d11/l27 0 2024-09-17T01:07:04.014 INFO:tasks.workunit.client.0.smithi103.stdout:3/162: dwrite d3/f1d [0,4194304] 0 2024-09-17T01:07:04.016 INFO:tasks.workunit.client.0.smithi103.stdout:3/163: readlink d3/l12 0 2024-09-17T01:07:04.016 INFO:tasks.workunit.client.1.smithi143.stdout:1/693: rename d0/d6/d43/d47/d88/da5/db1/fcd to d0/d6/d43/d6a/df/d6e/d18/fe7 0 2024-09-17T01:07:04.019 INFO:tasks.workunit.client.1.smithi143.stdout:4/672: creat da/d3a/d3e/fdf x:0 0 0 2024-09-17T01:07:04.019 INFO:tasks.workunit.client.0.smithi103.stdout:6/70: chown d3/fe 762 1 2024-09-17T01:07:04.020 INFO:tasks.workunit.client.0.smithi103.stdout:0/124: sync 2024-09-17T01:07:04.020 INFO:tasks.workunit.client.0.smithi103.stdout:8/77: sync 2024-09-17T01:07:04.020 INFO:tasks.workunit.client.1.smithi143.stdout:4/673: fdatasync da/d3a/d3e/fb7 0 2024-09-17T01:07:04.021 INFO:tasks.workunit.client.1.smithi143.stdout:9/645: symlink d3/d39/d42/d58/d5a/ldb 0 2024-09-17T01:07:04.023 INFO:tasks.workunit.client.0.smithi103.stdout:4/195: rename d9/dc/l15 to d9/d16/d23/d2b/l3b 0 2024-09-17T01:07:04.023 INFO:tasks.workunit.client.1.smithi143.stdout:9/646: truncate d3/d39/d6a/dc3/d3e/d51/d52/fbd 746269 0 2024-09-17T01:07:04.024 INFO:tasks.workunit.client.1.smithi143.stdout:2/618: symlink d0/d10/d58/d5a/d5b/d4c/d71/d9f/lc9 0 2024-09-17T01:07:04.026 INFO:tasks.workunit.client.1.smithi143.stdout:2/619: write d0/d10/d58/d5a/d5b/d4c/d71/d99/faf [422330,83762] 0 2024-09-17T01:07:04.027 INFO:tasks.workunit.client.0.smithi103.stdout:9/115: link d7/dd/d11/d21/f24 d7/f2a 0 2024-09-17T01:07:04.028 INFO:tasks.workunit.client.1.smithi143.stdout:9/647: read d3/d39/d6a/d9/f41 [1774777,48936] 0 2024-09-17T01:07:04.029 INFO:tasks.workunit.client.1.smithi143.stdout:3/648: dread d6/d1c/d33/d3f/fbf [0,4194304] 0 2024-09-17T01:07:04.031 INFO:tasks.workunit.client.1.smithi143.stdout:3/649: write d6/d1c/d33/d3f/f75 [632483,1989] 0 2024-09-17T01:07:04.035 INFO:tasks.workunit.client.0.smithi103.stdout:7/110: rename d4/d11/c1e to d4/d11/c28 0 2024-09-17T01:07:04.036 INFO:tasks.workunit.client.0.smithi103.stdout:7/111: truncate d4/d10/f25 480085 0 2024-09-17T01:07:04.036 INFO:tasks.workunit.client.0.smithi103.stdout:2/47: getdents d6/da 0 2024-09-17T01:07:04.040 INFO:tasks.workunit.client.0.smithi103.stdout:2/48: chown d6/da/cc 10020658 1 2024-09-17T01:07:04.041 INFO:tasks.workunit.client.0.smithi103.stdout:1/81: mkdir d2/d16/d18 0 2024-09-17T01:07:04.041 INFO:tasks.workunit.client.0.smithi103.stdout:2/49: dread f4 [0,4194304] 0 2024-09-17T01:07:04.041 INFO:tasks.workunit.client.0.smithi103.stdout:1/82: dread - d2/de/f14 zero size 2024-09-17T01:07:04.047 INFO:tasks.workunit.client.0.smithi103.stdout:2/50: dwrite d6/fb [0,4194304] 0 2024-09-17T01:07:04.048 INFO:tasks.workunit.client.0.smithi103.stdout:0/125: mkdir dd/d1c/d29 0 2024-09-17T01:07:04.051 INFO:tasks.workunit.client.1.smithi143.stdout:3/650: dread d6/d1c/d33/d41/d42/fc9 [0,4194304] 0 2024-09-17T01:07:04.052 INFO:tasks.workunit.client.0.smithi103.stdout:9/116: symlink d7/dd/d11/d21/l2b 0 2024-09-17T01:07:04.056 INFO:tasks.workunit.client.1.smithi143.stdout:6/579: creat d2/d17/d6e/fbb x:0 0 0 2024-09-17T01:07:04.059 INFO:tasks.workunit.client.1.smithi143.stdout:8/678: rename d9/d12/d38/f43 to d9/d12/ff5 0 2024-09-17T01:07:04.063 INFO:tasks.workunit.client.1.smithi143.stdout:3/651: symlink d6/d1c/d4b/lcd 0 2024-09-17T01:07:04.064 INFO:tasks.workunit.client.0.smithi103.stdout:0/126: fdatasync f8 0 2024-09-17T01:07:04.065 INFO:tasks.workunit.client.1.smithi143.stdout:1/694: write d0/d6/d43/f44 [1898611,14426] 0 2024-09-17T01:07:04.067 INFO:tasks.workunit.client.0.smithi103.stdout:3/164: rename d3/cf to d3/d16/d22/c39 0 2024-09-17T01:07:04.069 INFO:tasks.workunit.client.0.smithi103.stdout:9/117: fsync f0 0 2024-09-17T01:07:04.070 INFO:tasks.workunit.client.0.smithi103.stdout:7/112: dwrite d4/f7 [0,4194304] 0 2024-09-17T01:07:04.071 INFO:tasks.workunit.client.0.smithi103.stdout:9/118: chown d7/dd/d11/c13 2 1 2024-09-17T01:07:04.072 INFO:tasks.workunit.client.0.smithi103.stdout:9/119: write d7/fc [2955434,121113] 0 2024-09-17T01:07:04.073 INFO:tasks.workunit.client.0.smithi103.stdout:1/83: link d2/fb d2/d7/f19 0 2024-09-17T01:07:04.074 INFO:tasks.workunit.client.0.smithi103.stdout:9/120: write d7/dd/d11/fb [3082454,69758] 0 2024-09-17T01:07:04.075 INFO:tasks.workunit.client.1.smithi143.stdout:7/782: rename d4/d1f/d4a/de4/f45 to d4/d16/d97/ff9 0 2024-09-17T01:07:04.077 INFO:tasks.workunit.client.0.smithi103.stdout:5/54: link d6/db/l10 d6/d11/d13/l14 0 2024-09-17T01:07:04.078 INFO:tasks.workunit.client.1.smithi143.stdout:3/652: rmdir d6/d1c/d33/d41/d2b 39 2024-09-17T01:07:04.079 INFO:tasks.workunit.client.0.smithi103.stdout:6/71: symlink d3/d16/l19 0 2024-09-17T01:07:04.079 INFO:tasks.workunit.client.1.smithi143.stdout:1/695: mkdir d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/de8 0 2024-09-17T01:07:04.080 INFO:tasks.workunit.client.0.smithi103.stdout:8/78: creat d0/d6/f16 x:0 0 0 2024-09-17T01:07:04.081 INFO:tasks.workunit.client.1.smithi143.stdout:4/674: getdents da/d3a/d3e/d4a 0 2024-09-17T01:07:04.081 INFO:tasks.workunit.client.1.smithi143.stdout:4/675: dread - da/d3a/d3e/d4a/d8a/fb8 zero size 2024-09-17T01:07:04.082 INFO:tasks.workunit.client.1.smithi143.stdout:6/580: mkdir d2/d30/db4/dbc 0 2024-09-17T01:07:04.083 INFO:tasks.workunit.client.1.smithi143.stdout:4/676: dread - da/d3a/d3e/d4a/d8a/f99 zero size 2024-09-17T01:07:04.083 INFO:tasks.workunit.client.0.smithi103.stdout:0/127: creat dd/df/d1b/f2a x:0 0 0 2024-09-17T01:07:04.083 INFO:tasks.workunit.client.1.smithi143.stdout:4/677: dread - da/d3a/d3e/d72/d9e/fc4 zero size 2024-09-17T01:07:04.085 INFO:tasks.workunit.client.0.smithi103.stdout:4/196: rename d9/d16/d23/f2e to d9/d16/d23/d2b/f3c 0 2024-09-17T01:07:04.085 INFO:tasks.workunit.client.1.smithi143.stdout:4/678: write da/d6d/f74 [354425,123996] 0 2024-09-17T01:07:04.086 INFO:tasks.workunit.client.0.smithi103.stdout:3/165: symlink d3/d16/d1b/d2c/l3a 0 2024-09-17T01:07:04.088 INFO:tasks.workunit.client.1.smithi143.stdout:3/653: unlink d6/cb3 0 2024-09-17T01:07:04.089 INFO:tasks.workunit.client.0.smithi103.stdout:7/113: symlink d4/d10/l29 0 2024-09-17T01:07:04.089 INFO:tasks.workunit.client.1.smithi143.stdout:3/654: read d6/f8a [86556,122211] 0 2024-09-17T01:07:04.090 INFO:tasks.workunit.client.1.smithi143.stdout:4/679: dwrite da/d3a/d40/d84/f43 [0,4194304] 0 2024-09-17T01:07:04.090 INFO:tasks.workunit.client.1.smithi143.stdout:1/696: creat d0/d6/d43/d6a/d52/db2/fe9 x:0 0 0 2024-09-17T01:07:04.091 INFO:tasks.workunit.client.0.smithi103.stdout:9/121: fdatasync d7/dd/d11/d21/f24 0 2024-09-17T01:07:04.091 INFO:tasks.workunit.client.1.smithi143.stdout:1/697: chown d0/d6/d43/l93 5046320 1 2024-09-17T01:07:04.097 INFO:tasks.workunit.client.1.smithi143.stdout:1/698: dwrite d0/d6/d43/d6a/df/d6e/d18/f36 [0,4194304] 0 2024-09-17T01:07:04.099 INFO:tasks.workunit.client.1.smithi143.stdout:7/783: write d4/d1f/d29/d65/d5d/f51 [1715145,39638] 0 2024-09-17T01:07:04.100 INFO:tasks.workunit.client.0.smithi103.stdout:0/128: symlink dd/df/d1b/l2b 0 2024-09-17T01:07:04.100 INFO:tasks.workunit.client.1.smithi143.stdout:7/784: fsync d4/d16/f6d 0 2024-09-17T01:07:04.101 INFO:tasks.workunit.client.1.smithi143.stdout:7/785: stat d4/fd 0 2024-09-17T01:07:04.103 INFO:tasks.workunit.client.1.smithi143.stdout:7/786: write d4/d16/dbd/ff1 [723647,40571] 0 2024-09-17T01:07:04.105 INFO:tasks.workunit.client.1.smithi143.stdout:7/787: read d4/d26/f50 [612930,126554] 0 2024-09-17T01:07:04.108 INFO:tasks.workunit.client.0.smithi103.stdout:8/79: write d0/d6/dc/f9 [49051,68223] 0 2024-09-17T01:07:04.108 INFO:tasks.workunit.client.0.smithi103.stdout:0/129: dwrite dd/df/f26 [0,4194304] 0 2024-09-17T01:07:04.108 INFO:tasks.workunit.client.1.smithi143.stdout:8/679: getdents d9/d23/db4/d56 0 2024-09-17T01:07:04.109 INFO:tasks.workunit.client.0.smithi103.stdout:0/130: chown dd 15163897 1 2024-09-17T01:07:04.109 INFO:tasks.workunit.client.0.smithi103.stdout:8/80: dread - d0/d6/f16 zero size 2024-09-17T01:07:04.113 INFO:tasks.workunit.client.0.smithi103.stdout:7/114: creat d4/d11/f2a x:0 0 0 2024-09-17T01:07:04.114 INFO:tasks.workunit.client.1.smithi143.stdout:3/655: creat d6/d1c/d33/d41/d2b/fce x:0 0 0 2024-09-17T01:07:04.115 INFO:tasks.workunit.client.0.smithi103.stdout:0/131: dread fc [0,4194304] 0 2024-09-17T01:07:04.115 INFO:tasks.workunit.client.0.smithi103.stdout:9/122: rmdir d7/dd 39 2024-09-17T01:07:04.115 INFO:tasks.workunit.client.1.smithi143.stdout:1/699: dwrite d0/d6/d43/d6a/df/d6e/d2/f56 [0,4194304] 0 2024-09-17T01:07:04.116 INFO:tasks.workunit.client.1.smithi143.stdout:8/680: dread d9/d23/db4/d56/d66/fa9 [0,4194304] 0 2024-09-17T01:07:04.116 INFO:tasks.workunit.client.1.smithi143.stdout:7/788: write d4/d1f/ff2 [4436820,67050] 0 2024-09-17T01:07:04.116 INFO:tasks.workunit.client.0.smithi103.stdout:0/132: write dd/f15 [1434048,27190] 0 2024-09-17T01:07:04.116 INFO:tasks.workunit.client.0.smithi103.stdout:5/55: symlink d6/d11/d13/l15 0 2024-09-17T01:07:04.117 INFO:tasks.workunit.client.0.smithi103.stdout:0/133: chown dd/df/d1b 5692 1 2024-09-17T01:07:04.118 INFO:tasks.workunit.client.0.smithi103.stdout:5/56: dread - d6/db/fd zero size 2024-09-17T01:07:04.118 INFO:tasks.workunit.client.1.smithi143.stdout:9/648: rename d3/d39/d42/d58/d5a/d5e/d99/c3b to d3/d39/d42/cdc 0 2024-09-17T01:07:04.119 INFO:tasks.workunit.client.1.smithi143.stdout:1/700: chown d0/d6/d43/d6a/df/d6e/d2/f28 1398 1 2024-09-17T01:07:04.120 INFO:tasks.workunit.client.0.smithi103.stdout:6/72: rename d3/l15 to d3/d17/l1a 0 2024-09-17T01:07:04.122 INFO:tasks.workunit.client.1.smithi143.stdout:1/701: read d0/d6/d43/d6a/df/d6e/d18/f3e [2634445,46134] 0 2024-09-17T01:07:04.123 INFO:tasks.workunit.client.1.smithi143.stdout:9/649: fsync d3/d39/d6a/dc3/d3e/d51/d52/f9a 0 2024-09-17T01:07:04.124 INFO:tasks.workunit.client.1.smithi143.stdout:8/681: creat d9/d12/df4/ff6 x:0 0 0 2024-09-17T01:07:04.125 INFO:tasks.workunit.client.1.smithi143.stdout:9/650: write d3/d39/d42/d58/f76 [66469,69400] 0 2024-09-17T01:07:04.125 INFO:tasks.workunit.client.1.smithi143.stdout:8/682: chown d9/d23/faa 28905048 1 2024-09-17T01:07:04.126 INFO:tasks.workunit.client.1.smithi143.stdout:7/789: mkdir d4/d1f/d29/d65/d5d/db1/dc6/dfa 0 2024-09-17T01:07:04.130 INFO:tasks.workunit.client.1.smithi143.stdout:3/656: symlink d6/d1c/d33/lcf 0 2024-09-17T01:07:04.135 INFO:tasks.workunit.client.1.smithi143.stdout:9/651: mkdir d3/d39/d42/dab/ddd 0 2024-09-17T01:07:04.135 INFO:tasks.workunit.client.1.smithi143.stdout:9/652: chown d3/d39/d6a/ce 227 1 2024-09-17T01:07:04.136 INFO:tasks.workunit.client.0.smithi103.stdout:0/134: creat dd/df/d1b/f2c x:0 0 0 2024-09-17T01:07:04.137 INFO:tasks.workunit.client.1.smithi143.stdout:7/790: creat d4/d26/ffb x:0 0 0 2024-09-17T01:07:04.139 INFO:tasks.workunit.client.1.smithi143.stdout:3/657: chown d6/d1c/d4b/d57/l5a 4556 1 2024-09-17T01:07:04.140 INFO:tasks.workunit.client.0.smithi103.stdout:6/73: truncate d3/f11 890429 0 2024-09-17T01:07:04.140 INFO:tasks.workunit.client.1.smithi143.stdout:7/791: dread - d4/d1f/d4a/d66/d86/fa8 zero size 2024-09-17T01:07:04.141 INFO:tasks.workunit.client.0.smithi103.stdout:6/74: write f1 [429872,39229] 0 2024-09-17T01:07:04.142 INFO:tasks.workunit.client.1.smithi143.stdout:6/581: rename d2/d30/d45/d4a to d2/d17/d6e/d26/dbd 0 2024-09-17T01:07:04.142 INFO:tasks.workunit.client.1.smithi143.stdout:3/658: write d6/d1c/d33/d3f/f75 [551170,48523] 0 2024-09-17T01:07:04.142 INFO:tasks.workunit.client.0.smithi103.stdout:4/197: creat d9/f3d x:0 0 0 2024-09-17T01:07:04.143 INFO:tasks.workunit.client.0.smithi103.stdout:4/198: chown d9/d10/f1f 219656 1 2024-09-17T01:07:04.143 INFO:tasks.workunit.client.1.smithi143.stdout:9/653: dwrite d3/d39/d42/f54 [0,4194304] 0 2024-09-17T01:07:04.144 INFO:tasks.workunit.client.1.smithi143.stdout:7/792: chown d4/d1f/d4a/de4/d4e/d9f/fde 2763333 1 2024-09-17T01:07:04.146 INFO:tasks.workunit.client.1.smithi143.stdout:1/702: write d0/d6/d43/d6a/f42 [4446164,127692] 0 2024-09-17T01:07:04.146 INFO:tasks.workunit.client.1.smithi143.stdout:3/659: fdatasync d6/d1c/d33/d3f/fb4 0 2024-09-17T01:07:04.146 INFO:tasks.workunit.client.1.smithi143.stdout:6/582: chown d2/d17/d6e/d26/dbd/f91 2 1 2024-09-17T01:07:04.148 INFO:tasks.workunit.client.0.smithi103.stdout:9/123: creat d7/dd/f2c x:0 0 0 2024-09-17T01:07:04.149 INFO:tasks.workunit.client.1.smithi143.stdout:6/583: write d2/d30/d45/d70/d87/fa2 [948834,84780] 0 2024-09-17T01:07:04.150 INFO:tasks.workunit.client.0.smithi103.stdout:9/124: dread - d7/f19 zero size 2024-09-17T01:07:04.151 INFO:tasks.workunit.client.0.smithi103.stdout:4/199: dwrite d9/dc/df/f20 [0,4194304] 0 2024-09-17T01:07:04.152 INFO:tasks.workunit.client.0.smithi103.stdout:9/125: chown d7/dd/d11/d21/l28 0 1 2024-09-17T01:07:04.153 INFO:tasks.workunit.client.1.smithi143.stdout:8/683: creat d9/d12/ff7 x:0 0 0 2024-09-17T01:07:04.153 INFO:tasks.workunit.client.1.smithi143.stdout:1/703: dwrite d0/d6/d43/d6a/df/d6e/d18/f36 [0,4194304] 0 2024-09-17T01:07:04.154 INFO:tasks.workunit.client.1.smithi143.stdout:8/684: write d9/f59 [2688742,124343] 0 2024-09-17T01:07:04.155 INFO:tasks.workunit.client.0.smithi103.stdout:0/135: symlink dd/d1c/l2d 0 2024-09-17T01:07:04.161 INFO:tasks.workunit.client.0.smithi103.stdout:6/75: read d3/ff [284179,45582] 0 2024-09-17T01:07:04.161 INFO:tasks.workunit.client.0.smithi103.stdout:0/136: dread dd/df/f24 [0,4194304] 0 2024-09-17T01:07:04.162 INFO:tasks.workunit.client.1.smithi143.stdout:7/793: dwrite d4/d1f/d29/d65/d5d/db1/dc6/fed [0,4194304] 0 2024-09-17T01:07:04.163 INFO:tasks.workunit.client.0.smithi103.stdout:3/166: getdents d3/d16/d22 0 2024-09-17T01:07:04.163 INFO:tasks.workunit.client.0.smithi103.stdout:7/115: write d4/fa [580247,100025] 0 2024-09-17T01:07:04.164 INFO:tasks.workunit.client.0.smithi103.stdout:7/116: dread - d4/d11/f2a zero size 2024-09-17T01:07:04.164 INFO:tasks.workunit.client.1.smithi143.stdout:4/680: rename da/d3a/d3e/d72/da3/cae to da/d3a/d3e/d5e/d63/ce0 0 2024-09-17T01:07:04.165 INFO:tasks.workunit.client.0.smithi103.stdout:8/81: getdents d0/d6/dc 0 2024-09-17T01:07:04.166 INFO:tasks.workunit.client.1.smithi143.stdout:6/584: mknod d2/d30/db4/cbe 0 2024-09-17T01:07:04.167 INFO:tasks.workunit.client.0.smithi103.stdout:4/200: symlink d9/d16/d23/d2b/l3e 0 2024-09-17T01:07:04.167 INFO:tasks.workunit.client.1.smithi143.stdout:4/681: write da/d3a/d3e/fdf [975580,130321] 0 2024-09-17T01:07:04.168 INFO:tasks.workunit.client.0.smithi103.stdout:3/167: dread d3/f9 [0,4194304] 0 2024-09-17T01:07:04.169 INFO:tasks.workunit.client.1.smithi143.stdout:4/682: write da/d3a/d3e/d72/da3/dc0/fc2 [909084,28401] 0 2024-09-17T01:07:04.169 INFO:tasks.workunit.client.1.smithi143.stdout:8/685: mknod d9/d23/db4/d56/cf8 0 2024-09-17T01:07:04.170 INFO:tasks.workunit.client.1.smithi143.stdout:8/686: chown d9/d12/d38/dba 7019 1 2024-09-17T01:07:04.170 INFO:tasks.workunit.client.0.smithi103.stdout:6/76: unlink d3/fe 0 2024-09-17T01:07:04.171 INFO:tasks.workunit.client.1.smithi143.stdout:3/660: symlink d6/d1c/d33/d3f/d79/dc6/ld0 0 2024-09-17T01:07:04.171 INFO:tasks.workunit.client.0.smithi103.stdout:0/137: creat dd/df/d1b/f2e x:0 0 0 2024-09-17T01:07:04.174 INFO:tasks.workunit.client.0.smithi103.stdout:7/117: mkdir d4/d11/d2b 0 2024-09-17T01:07:04.177 INFO:tasks.workunit.client.0.smithi103.stdout:5/57: getdents d6 0 2024-09-17T01:07:04.178 INFO:tasks.workunit.client.1.smithi143.stdout:6/585: dread d2/d19/f73 [0,4194304] 0 2024-09-17T01:07:04.178 INFO:tasks.workunit.client.0.smithi103.stdout:9/126: mkdir d7/d2d 0 2024-09-17T01:07:04.179 INFO:tasks.workunit.client.1.smithi143.stdout:6/586: dread - d2/d17/d3a/d47/d8e/d95/fb2 zero size 2024-09-17T01:07:04.180 INFO:tasks.workunit.client.1.smithi143.stdout:3/661: mkdir d6/d1c/d4d/dd1 0 2024-09-17T01:07:04.181 INFO:tasks.workunit.client.0.smithi103.stdout:5/58: dread d6/f9 [0,4194304] 0 2024-09-17T01:07:04.181 INFO:tasks.workunit.client.1.smithi143.stdout:9/654: link d3/d39/d42/d58/d5a/d5e/l9e d3/d39/d42/d58/d5a/d5e/lde 0 2024-09-17T01:07:04.182 INFO:tasks.workunit.client.0.smithi103.stdout:6/77: rmdir d3/d17 39 2024-09-17T01:07:04.182 INFO:tasks.workunit.client.0.smithi103.stdout:4/201: fsync d9/dc/df/f20 0 2024-09-17T01:07:04.183 INFO:tasks.workunit.client.1.smithi143.stdout:4/683: mkdir da/d3a/de1 0 2024-09-17T01:07:04.184 INFO:tasks.workunit.client.1.smithi143.stdout:3/662: truncate d6/d1c/d33/d3f/fbc 527142 0 2024-09-17T01:07:04.185 INFO:tasks.workunit.client.1.smithi143.stdout:7/794: dread d4/d16/f1d [0,4194304] 0 2024-09-17T01:07:04.186 INFO:tasks.workunit.client.0.smithi103.stdout:9/127: dwrite d7/fc [4194304,4194304] 0 2024-09-17T01:07:04.187 INFO:tasks.workunit.client.1.smithi143.stdout:6/587: dwrite d2/d19/f8a [0,4194304] 0 2024-09-17T01:07:04.188 INFO:tasks.workunit.client.0.smithi103.stdout:7/118: unlink d4/d11/l27 0 2024-09-17T01:07:04.191 INFO:tasks.workunit.client.1.smithi143.stdout:9/655: unlink d3/d3d/f92 0 2024-09-17T01:07:04.196 INFO:tasks.workunit.client.1.smithi143.stdout:3/663: mknod d6/d1c/d4b/dab/cd2 0 2024-09-17T01:07:04.198 INFO:tasks.workunit.client.1.smithi143.stdout:7/795: dwrite d4/f44 [0,4194304] 0 2024-09-17T01:07:04.199 INFO:tasks.workunit.client.0.smithi103.stdout:3/168: symlink d3/d16/d1b/d36/l3b 0 2024-09-17T01:07:04.200 INFO:tasks.workunit.client.1.smithi143.stdout:8/687: dread d9/de/fb5 [0,4194304] 0 2024-09-17T01:07:04.200 INFO:tasks.workunit.client.1.smithi143.stdout:3/664: write d6/d1c/d33/d41/d2e/d30/f69 [1947973,81746] 0 2024-09-17T01:07:04.201 INFO:tasks.workunit.client.1.smithi143.stdout:6/588: symlink d2/df/d40/d41/lbf 0 2024-09-17T01:07:04.202 INFO:tasks.workunit.client.0.smithi103.stdout:5/59: symlink d6/d11/d13/l16 0 2024-09-17T01:07:04.204 INFO:tasks.workunit.client.1.smithi143.stdout:6/589: dread - d2/d17/d6e/d26/d46/d65/f9c zero size 2024-09-17T01:07:04.204 INFO:tasks.workunit.client.1.smithi143.stdout:3/665: chown d6/d1c/d33/d41/d2e/d30/f32 6830376 1 2024-09-17T01:07:04.209 INFO:tasks.workunit.client.1.smithi143.stdout:9/656: creat d3/d39/d6a/dc3/d3e/d51/db7/fdf x:0 0 0 2024-09-17T01:07:04.212 INFO:tasks.workunit.client.0.smithi103.stdout:6/78: dwrite d3/f18 [0,4194304] 0 2024-09-17T01:07:04.213 INFO:tasks.workunit.client.1.smithi143.stdout:8/688: creat d9/de/d53/d75/ff9 x:0 0 0 2024-09-17T01:07:04.213 INFO:tasks.workunit.client.1.smithi143.stdout:1/704: truncate d0/dc/d74/d94/f9a 16302 0 2024-09-17T01:07:04.214 INFO:tasks.workunit.client.1.smithi143.stdout:9/657: dwrite d3/d39/d6a/d9/f6b [0,4194304] 0 2024-09-17T01:07:04.215 INFO:tasks.workunit.client.0.smithi103.stdout:7/119: rmdir d4/d10 39 2024-09-17T01:07:04.215 INFO:tasks.workunit.client.0.smithi103.stdout:7/120: stat d4/d11/f18 0 2024-09-17T01:07:04.216 INFO:tasks.workunit.client.1.smithi143.stdout:1/705: chown d0/d6/d43/d6a/df/d6e/d18/d4d/l77 458431 1 2024-09-17T01:07:04.218 INFO:tasks.workunit.client.1.smithi143.stdout:6/590: unlink d2/d17/l9f 0 2024-09-17T01:07:04.219 INFO:tasks.workunit.client.0.smithi103.stdout:9/128: rmdir d7 39 2024-09-17T01:07:04.221 INFO:tasks.workunit.client.1.smithi143.stdout:8/689: dwrite d9/fcf [0,4194304] 0 2024-09-17T01:07:04.223 INFO:tasks.workunit.client.1.smithi143.stdout:7/796: mknod d4/d1f/d29/d65/d5d/db1/dc6/dfa/cfc 0 2024-09-17T01:07:04.225 INFO:tasks.workunit.client.0.smithi103.stdout:3/169: rename d3/d16/d22 to d3/d16/d1b/d3c 0 2024-09-17T01:07:04.227 INFO:tasks.workunit.client.0.smithi103.stdout:5/60: read d6/f9 [557468,29421] 0 2024-09-17T01:07:04.229 INFO:tasks.workunit.client.1.smithi143.stdout:9/658: mknod d3/d81/ce0 0 2024-09-17T01:07:04.230 INFO:tasks.workunit.client.1.smithi143.stdout:8/690: dread d9/fa5 [0,4194304] 0 2024-09-17T01:07:04.231 INFO:tasks.workunit.client.1.smithi143.stdout:8/691: readlink d9/d12/ld5 0 2024-09-17T01:07:04.231 INFO:tasks.workunit.client.0.smithi103.stdout:8/82: write d0/f8 [1241829,32966] 0 2024-09-17T01:07:04.232 INFO:tasks.workunit.client.1.smithi143.stdout:8/692: write d9/d23/db4/d55/dbf/fcd [428947,11503] 0 2024-09-17T01:07:04.233 INFO:tasks.workunit.client.0.smithi103.stdout:4/202: mkdir d9/d16/d38/d3f 0 2024-09-17T01:07:04.236 INFO:tasks.workunit.client.0.smithi103.stdout:6/79: readlink d3/ld 0 2024-09-17T01:07:04.236 INFO:tasks.workunit.client.0.smithi103.stdout:3/170: dwrite d3/f15 [8388608,4194304] 0 2024-09-17T01:07:04.236 INFO:tasks.workunit.client.0.smithi103.stdout:4/203: write d9/d16/f37 [478115,100951] 0 2024-09-17T01:07:04.244 INFO:tasks.workunit.client.0.smithi103.stdout:6/80: dwrite f1 [0,4194304] 0 2024-09-17T01:07:04.245 INFO:tasks.workunit.client.1.smithi143.stdout:1/706: dread d0/dc/d57/fba [0,4194304] 0 2024-09-17T01:07:04.248 INFO:tasks.workunit.client.1.smithi143.stdout:8/693: rename d9/d23/db4/d56 to d9/de/d53/d75/dfa 0 2024-09-17T01:07:04.250 INFO:tasks.workunit.client.0.smithi103.stdout:5/61: mkdir d6/d11/d13/d17 0 2024-09-17T01:07:04.253 INFO:tasks.workunit.client.0.smithi103.stdout:0/138: getdents dd 0 2024-09-17T01:07:04.255 INFO:tasks.workunit.client.1.smithi143.stdout:3/666: dwrite d6/d1c/d33/d41/f1a [4194304,4194304] 0 2024-09-17T01:07:04.256 INFO:tasks.workunit.client.0.smithi103.stdout:8/83: rename d0/d6/c14 to d0/d6/dc/d12/c17 0 2024-09-17T01:07:04.257 INFO:tasks.workunit.client.0.smithi103.stdout:8/84: rename d0/d6 to d0/d6/dc/d18 22 2024-09-17T01:07:04.258 INFO:tasks.workunit.client.0.smithi103.stdout:8/85: write d0/d6/f16 [166382,10730] 0 2024-09-17T01:07:04.265 INFO:tasks.workunit.client.0.smithi103.stdout:9/129: dread d7/dd/f16 [0,4194304] 0 2024-09-17T01:07:04.265 INFO:tasks.workunit.client.0.smithi103.stdout:6/81: creat d3/d16/f1b x:0 0 0 2024-09-17T01:07:04.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/62: creat d6/d11/f18 x:0 0 0 2024-09-17T01:07:04.268 INFO:tasks.workunit.client.0.smithi103.stdout:0/139: mknod dd/df/d1b/c2f 0 2024-09-17T01:07:04.269 INFO:tasks.workunit.client.0.smithi103.stdout:6/82: dread d3/f11 [0,4194304] 0 2024-09-17T01:07:04.270 INFO:tasks.workunit.client.0.smithi103.stdout:8/86: rmdir d0/d6/dc/d12 39 2024-09-17T01:07:04.270 INFO:tasks.workunit.client.0.smithi103.stdout:0/140: stat dd/df/d1b/f2c 0 2024-09-17T01:07:04.272 INFO:tasks.workunit.client.0.smithi103.stdout:7/121: link d4/d11/f23 d4/d10/f2c 0 2024-09-17T01:07:04.274 INFO:tasks.workunit.client.0.smithi103.stdout:5/63: dwrite d6/d11/f18 [0,4194304] 0 2024-09-17T01:07:04.275 INFO:tasks.workunit.client.0.smithi103.stdout:5/64: stat d6/d11/d13/l15 0 2024-09-17T01:07:04.275 INFO:tasks.workunit.client.0.smithi103.stdout:9/130: rmdir d7/dd/d11/d20 39 2024-09-17T01:07:04.277 INFO:tasks.workunit.client.0.smithi103.stdout:6/83: mknod d3/d16/c1c 0 2024-09-17T01:07:04.278 INFO:tasks.workunit.client.0.smithi103.stdout:8/87: symlink d0/l19 0 2024-09-17T01:07:04.281 INFO:tasks.workunit.client.0.smithi103.stdout:4/204: link d9/d10/c1d d9/d16/d23/d32/c40 0 2024-09-17T01:07:04.282 INFO:tasks.workunit.client.0.smithi103.stdout:4/205: chown d9/d10/f28 1420788328 1 2024-09-17T01:07:04.285 INFO:tasks.workunit.client.0.smithi103.stdout:5/65: symlink d6/d11/l19 0 2024-09-17T01:07:04.286 INFO:tasks.workunit.client.0.smithi103.stdout:5/66: chown d6/d11/f18 31923935 1 2024-09-17T01:07:04.286 INFO:tasks.workunit.client.0.smithi103.stdout:5/67: chown d6/d11/l19 23 1 2024-09-17T01:07:04.288 INFO:tasks.workunit.client.0.smithi103.stdout:5/68: write d6/db/fd [747233,8257] 0 2024-09-17T01:07:04.288 INFO:tasks.workunit.client.0.smithi103.stdout:9/131: symlink d7/dd/d11/d21/l2e 0 2024-09-17T01:07:04.289 INFO:tasks.workunit.client.0.smithi103.stdout:6/84: chown d3/la 7938623 1 2024-09-17T01:07:04.291 INFO:tasks.workunit.client.0.smithi103.stdout:8/88: mknod d0/c1a 0 2024-09-17T01:07:04.295 INFO:tasks.workunit.client.0.smithi103.stdout:0/141: symlink dd/d1c/d29/l30 0 2024-09-17T01:07:04.296 INFO:tasks.workunit.client.0.smithi103.stdout:0/142: truncate dd/d1c/f28 905920 0 2024-09-17T01:07:04.296 INFO:tasks.workunit.client.0.smithi103.stdout:0/143: dread - dd/f23 zero size 2024-09-17T01:07:04.297 INFO:tasks.workunit.client.0.smithi103.stdout:7/122: symlink d4/d11/d2b/l2d 0 2024-09-17T01:07:04.297 INFO:tasks.workunit.client.1.smithi143.stdout:6/591: fdatasync d2/fb 0 2024-09-17T01:07:04.298 INFO:tasks.workunit.client.1.smithi143.stdout:7/797: mknod d4/d1f/d4a/d66/db5/df3/cfd 0 2024-09-17T01:07:04.300 INFO:tasks.workunit.client.0.smithi103.stdout:9/132: creat d7/dd/f2f x:0 0 0 2024-09-17T01:07:04.300 INFO:tasks.workunit.client.0.smithi103.stdout:0/144: dread dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:04.303 INFO:tasks.workunit.client.1.smithi143.stdout:7/798: dwrite d4/fd0 [0,4194304] 0 2024-09-17T01:07:04.304 INFO:tasks.workunit.client.1.smithi143.stdout:0/642: sync 2024-09-17T01:07:04.304 INFO:tasks.workunit.client.1.smithi143.stdout:5/625: sync 2024-09-17T01:07:04.304 INFO:tasks.workunit.client.1.smithi143.stdout:2/620: sync 2024-09-17T01:07:04.304 INFO:tasks.workunit.client.1.smithi143.stdout:1/707: unlink d0/d6/d43/d47/d68/d7b/f9f 0 2024-09-17T01:07:04.305 INFO:tasks.workunit.client.1.smithi143.stdout:2/621: chown d0/d44/f94 2 1 2024-09-17T01:07:04.306 INFO:tasks.workunit.client.1.smithi143.stdout:8/694: rmdir d9/d2b 39 2024-09-17T01:07:04.307 INFO:tasks.workunit.client.0.smithi103.stdout:0/145: dwrite dd/d1c/f28 [0,4194304] 0 2024-09-17T01:07:04.307 INFO:tasks.workunit.client.1.smithi143.stdout:0/643: truncate d3/d5/d8/d21/d9b/dba/fd1 163782 0 2024-09-17T01:07:04.307 INFO:tasks.workunit.client.0.smithi103.stdout:0/146: stat dd/d1c/d29/l30 0 2024-09-17T01:07:04.308 INFO:tasks.workunit.client.0.smithi103.stdout:3/171: link d3/d16/f2b d3/d16/f3d 0 2024-09-17T01:07:04.308 INFO:tasks.workunit.client.1.smithi143.stdout:8/695: dread - d9/d23/db4/d55/dbf/fc6 zero size 2024-09-17T01:07:04.313 INFO:tasks.workunit.client.1.smithi143.stdout:0/644: dwrite d3/d5/d8/d27/f82 [0,4194304] 0 2024-09-17T01:07:04.314 INFO:tasks.workunit.client.1.smithi143.stdout:6/592: mknod d2/d30/d45/d70/d87/d8d/cc0 0 2024-09-17T01:07:04.315 INFO:tasks.workunit.client.1.smithi143.stdout:6/593: chown d2/df/d20/d2c/d38/f72 9981 1 2024-09-17T01:07:04.317 INFO:tasks.workunit.client.1.smithi143.stdout:9/659: creat d3/d39/d6a/dc3/d3e/fe1 x:0 0 0 2024-09-17T01:07:04.318 INFO:tasks.workunit.client.1.smithi143.stdout:6/594: read d2/df/d20/f54 [3305192,16934] 0 2024-09-17T01:07:04.319 INFO:tasks.workunit.client.1.smithi143.stdout:9/660: write d3/d39/d42/d58/d5a/d5e/d99/fcb [506715,8568] 0 2024-09-17T01:07:04.319 INFO:tasks.workunit.client.1.smithi143.stdout:9/661: readlink d3/d81/d9c/lad 0 2024-09-17T01:07:04.321 INFO:tasks.workunit.client.1.smithi143.stdout:5/626: creat d1/d96/fef x:0 0 0 2024-09-17T01:07:04.330 INFO:tasks.workunit.client.1.smithi143.stdout:4/684: sync 2024-09-17T01:07:04.331 INFO:tasks.workunit.client.1.smithi143.stdout:4/685: write da/d3a/f79 [1761340,76960] 0 2024-09-17T01:07:04.340 INFO:tasks.workunit.client.0.smithi103.stdout:8/89: rename d0/d6/dc/cb to d0/d6/dc/d12/c1b 0 2024-09-17T01:07:04.342 INFO:tasks.workunit.client.0.smithi103.stdout:0/147: symlink dd/d1c/l31 0 2024-09-17T01:07:04.343 INFO:tasks.workunit.client.1.smithi143.stdout:3/667: symlink d6/ld3 0 2024-09-17T01:07:04.343 INFO:tasks.workunit.client.0.smithi103.stdout:3/172: write d3/d16/f1a [318268,10091] 0 2024-09-17T01:07:04.349 INFO:tasks.workunit.client.0.smithi103.stdout:3/173: dwrite d3/d16/f2d [0,4194304] 0 2024-09-17T01:07:04.394 INFO:tasks.workunit.client.1.smithi143.stdout:8/696: creat d9/de/d53/ffb x:0 0 0 2024-09-17T01:07:04.394 INFO:tasks.workunit.client.1.smithi143.stdout:8/697: readlink d9/de/d53/d75/daf/ld9 0 2024-09-17T01:07:04.395 INFO:tasks.workunit.client.1.smithi143.stdout:8/698: chown d9/de/fb5 58 1 2024-09-17T01:07:04.396 INFO:tasks.workunit.client.1.smithi143.stdout:8/699: truncate d9/d12/d4b/fdf 18163 0 2024-09-17T01:07:04.397 INFO:tasks.workunit.client.0.smithi103.stdout:9/133: symlink d7/dd/d11/d20/l30 0 2024-09-17T01:07:04.399 INFO:tasks.workunit.client.0.smithi103.stdout:5/69: rmdir d6/d11/d13/d17 0 2024-09-17T01:07:04.400 INFO:tasks.workunit.client.1.smithi143.stdout:7/799: mknod d4/cfe 0 2024-09-17T01:07:04.403 INFO:tasks.workunit.client.1.smithi143.stdout:1/708: symlink d0/dc/dca/lea 0 2024-09-17T01:07:04.404 INFO:tasks.workunit.client.0.smithi103.stdout:6/85: truncate d3/f18 4594561 0 2024-09-17T01:07:04.405 INFO:tasks.workunit.client.1.smithi143.stdout:1/709: chown d0/d6/d43/d6a/df/d27/c4a 717 1 2024-09-17T01:07:04.406 INFO:tasks.workunit.client.0.smithi103.stdout:5/70: dwrite f4 [0,4194304] 0 2024-09-17T01:07:04.407 INFO:tasks.workunit.client.1.smithi143.stdout:5/627: creat d1/d46/df/d1f/d66/ff0 x:0 0 0 2024-09-17T01:07:04.408 INFO:tasks.workunit.client.1.smithi143.stdout:0/645: dread d3/d5/d8/d27/d31/d48/d62/fca [0,4194304] 0 2024-09-17T01:07:04.408 INFO:tasks.workunit.client.0.smithi103.stdout:3/174: mknod d3/d16/d1b/d36/c3e 0 2024-09-17T01:07:04.408 INFO:tasks.workunit.client.0.smithi103.stdout:0/148: dread f8 [0,4194304] 0 2024-09-17T01:07:04.410 INFO:tasks.workunit.client.0.smithi103.stdout:3/175: chown d3/d16/d1b/l1f 940777451 1 2024-09-17T01:07:04.410 INFO:tasks.workunit.client.0.smithi103.stdout:4/206: getdents d9/dc/df 0 2024-09-17T01:07:04.411 INFO:tasks.workunit.client.0.smithi103.stdout:5/71: dread f0 [0,4194304] 0 2024-09-17T01:07:04.416 INFO:tasks.workunit.client.0.smithi103.stdout:9/134: dread d7/dd/d11/d21/f24 [0,4194304] 0 2024-09-17T01:07:04.416 INFO:tasks.workunit.client.1.smithi143.stdout:3/668: creat d6/d1c/d33/d41/d2b/fd4 x:0 0 0 2024-09-17T01:07:04.420 INFO:tasks.workunit.client.1.smithi143.stdout:8/700: rename d9/d12/d38/d58/f8e to d9/d12/d38/d58/dda/dea/ffc 0 2024-09-17T01:07:04.420 INFO:tasks.workunit.client.1.smithi143.stdout:9/662: dwrite d3/d39/d6a/f2a [0,4194304] 0 2024-09-17T01:07:04.421 INFO:tasks.workunit.client.0.smithi103.stdout:0/149: creat dd/df/d1b/f32 x:0 0 0 2024-09-17T01:07:04.425 INFO:tasks.workunit.client.0.smithi103.stdout:0/150: dread dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:04.427 INFO:tasks.workunit.client.0.smithi103.stdout:5/72: creat d6/d11/f1a x:0 0 0 2024-09-17T01:07:04.428 INFO:tasks.workunit.client.0.smithi103.stdout:5/73: stat d6/d11/d13 0 2024-09-17T01:07:04.429 INFO:tasks.workunit.client.0.smithi103.stdout:8/90: creat d0/d6/f1c x:0 0 0 2024-09-17T01:07:04.431 INFO:tasks.workunit.client.1.smithi143.stdout:2/622: creat d0/fca x:0 0 0 2024-09-17T01:07:04.432 INFO:tasks.workunit.client.1.smithi143.stdout:2/623: readlink d0/d2/l3 0 2024-09-17T01:07:04.433 INFO:tasks.workunit.client.0.smithi103.stdout:6/86: symlink d3/l1d 0 2024-09-17T01:07:04.436 INFO:tasks.workunit.client.1.smithi143.stdout:5/628: dread d1/d5e/f65 [0,4194304] 0 2024-09-17T01:07:04.438 INFO:tasks.workunit.client.1.smithi143.stdout:7/800: write d4/d26/f8a [1524852,76745] 0 2024-09-17T01:07:04.438 INFO:tasks.workunit.client.0.smithi103.stdout:3/176: truncate d3/d16/f3d 2148269 0 2024-09-17T01:07:04.438 INFO:tasks.workunit.client.1.smithi143.stdout:9/663: dread d3/d3d/d48/fa7 [0,4194304] 0 2024-09-17T01:07:04.439 INFO:tasks.workunit.client.0.smithi103.stdout:0/151: creat dd/d1c/d29/f33 x:0 0 0 2024-09-17T01:07:04.441 INFO:tasks.workunit.client.1.smithi143.stdout:3/669: dwrite d6/f90 [4194304,4194304] 0 2024-09-17T01:07:04.442 INFO:tasks.workunit.client.0.smithi103.stdout:5/74: unlink l1 0 2024-09-17T01:07:04.442 INFO:tasks.workunit.client.1.smithi143.stdout:9/664: write d3/d39/d42/d58/d5a/d5e/d99/f93 [6055,9928] 0 2024-09-17T01:07:04.444 INFO:tasks.workunit.client.1.smithi143.stdout:1/710: rename d0/d6/d43/d6a/df/d6e/d18/d2d to d0/d6/d43/d47/dbf/deb 0 2024-09-17T01:07:04.446 INFO:tasks.workunit.client.0.smithi103.stdout:6/87: creat d3/d16/f1e x:0 0 0 2024-09-17T01:07:04.446 INFO:tasks.workunit.client.0.smithi103.stdout:6/88: chown d3/l1d 4645655 1 2024-09-17T01:07:04.447 INFO:tasks.workunit.client.1.smithi143.stdout:4/686: dwrite da/d3a/d3e/d72/da3/fa5 [0,4194304] 0 2024-09-17T01:07:04.449 INFO:tasks.workunit.client.1.smithi143.stdout:6/595: getdents d2/d30/db4 0 2024-09-17T01:07:04.450 INFO:tasks.workunit.client.0.smithi103.stdout:3/177: mknod d3/d16/d1b/d36/c3f 0 2024-09-17T01:07:04.450 INFO:tasks.workunit.client.0.smithi103.stdout:3/178: stat d3/f1d 0 2024-09-17T01:07:04.454 INFO:tasks.workunit.client.0.smithi103.stdout:0/152: mknod dd/d1c/c34 0 2024-09-17T01:07:04.459 INFO:tasks.workunit.client.1.smithi143.stdout:7/801: creat d4/d1f/d4a/d9e/da2/fff x:0 0 0 2024-09-17T01:07:04.461 INFO:tasks.workunit.client.0.smithi103.stdout:0/153: dwrite dd/df/f26 [0,4194304] 0 2024-09-17T01:07:04.461 INFO:tasks.workunit.client.0.smithi103.stdout:9/135: rename d7/dd/l17 to d7/l31 0 2024-09-17T01:07:04.463 INFO:tasks.workunit.client.0.smithi103.stdout:0/154: dread - dd/df/f19 zero size 2024-09-17T01:07:04.464 INFO:tasks.workunit.client.0.smithi103.stdout:9/136: write d7/dd/f23 [375935,23147] 0 2024-09-17T01:07:04.464 INFO:tasks.workunit.client.0.smithi103.stdout:4/207: getdents d9/d16/d23 0 2024-09-17T01:07:04.464 INFO:tasks.workunit.client.0.smithi103.stdout:9/137: fsync f5 0 2024-09-17T01:07:04.465 INFO:tasks.workunit.client.0.smithi103.stdout:9/138: fdatasync d7/dd/d11/d21/f26 0 2024-09-17T01:07:04.467 INFO:tasks.workunit.client.0.smithi103.stdout:6/89: chown d3/cb 70005032 1 2024-09-17T01:07:04.469 INFO:tasks.workunit.client.0.smithi103.stdout:8/91: creat d0/d6/f1d x:0 0 0 2024-09-17T01:07:04.470 INFO:tasks.workunit.client.0.smithi103.stdout:8/92: fsync d0/d6/f16 0 2024-09-17T01:07:04.471 INFO:tasks.workunit.client.0.smithi103.stdout:8/93: read d0/d6/f16 [107869,55417] 0 2024-09-17T01:07:04.472 INFO:tasks.workunit.client.0.smithi103.stdout:8/94: dread - d0/d6/f10 zero size 2024-09-17T01:07:04.474 INFO:tasks.workunit.client.0.smithi103.stdout:5/75: rename f3 to d6/f1b 0 2024-09-17T01:07:04.474 INFO:tasks.workunit.client.0.smithi103.stdout:3/179: rmdir d3/d16 39 2024-09-17T01:07:04.477 INFO:tasks.workunit.client.1.smithi143.stdout:2/624: creat d0/d10/d58/d5a/d5b/d4c/d71/dc5/fcb x:0 0 0 2024-09-17T01:07:04.478 INFO:tasks.workunit.client.0.smithi103.stdout:0/155: mknod dd/df/d1b/c35 0 2024-09-17T01:07:04.478 INFO:tasks.workunit.client.0.smithi103.stdout:0/156: truncate f5 4709705 0 2024-09-17T01:07:04.479 INFO:tasks.workunit.client.1.smithi143.stdout:6/596: mkdir d2/d30/dc1 0 2024-09-17T01:07:04.479 INFO:tasks.workunit.client.1.smithi143.stdout:6/597: chown d2/d17/d3a/l89 8 1 2024-09-17T01:07:04.481 INFO:tasks.workunit.client.1.smithi143.stdout:7/802: creat d4/d26/f100 x:0 0 0 2024-09-17T01:07:04.482 INFO:tasks.workunit.client.1.smithi143.stdout:7/803: readlink d4/d1f/d29/le0 0 2024-09-17T01:07:04.484 INFO:tasks.workunit.client.1.smithi143.stdout:8/701: dwrite d9/d2b/fcc [0,4194304] 0 2024-09-17T01:07:04.485 INFO:tasks.workunit.client.0.smithi103.stdout:5/76: creat d6/d11/d13/f1c x:0 0 0 2024-09-17T01:07:04.488 INFO:tasks.workunit.client.0.smithi103.stdout:9/139: symlink d7/d2d/l32 0 2024-09-17T01:07:04.488 INFO:tasks.workunit.client.1.smithi143.stdout:8/702: truncate d9/d12/d38/d7a/d8f/f92 488616 0 2024-09-17T01:07:04.489 INFO:tasks.workunit.client.0.smithi103.stdout:9/140: write d7/f18 [1328065,96089] 0 2024-09-17T01:07:04.489 INFO:tasks.workunit.client.1.smithi143.stdout:7/804: dwrite d4/d1f/d4a/d66/fc2 [4194304,4194304] 0 2024-09-17T01:07:04.490 INFO:tasks.workunit.client.1.smithi143.stdout:7/805: chown d4/d1f/d4a/de4/d4e/c7e 109 1 2024-09-17T01:07:04.491 INFO:tasks.workunit.client.1.smithi143.stdout:7/806: write d4/d1f/d4a/dc1/fd9 [658284,41365] 0 2024-09-17T01:07:04.492 INFO:tasks.workunit.client.0.smithi103.stdout:0/157: rename dd/f23 to dd/f36 0 2024-09-17T01:07:04.493 INFO:tasks.workunit.client.0.smithi103.stdout:6/90: unlink d3/c12 0 2024-09-17T01:07:04.494 INFO:tasks.workunit.client.1.smithi143.stdout:2/625: write d0/d44/f9e [3715839,120658] 0 2024-09-17T01:07:04.496 INFO:tasks.workunit.client.0.smithi103.stdout:8/95: symlink d0/d6/dc/l1e 0 2024-09-17T01:07:04.497 INFO:tasks.workunit.client.1.smithi143.stdout:2/626: fsync d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fc6 0 2024-09-17T01:07:04.497 INFO:tasks.workunit.client.1.smithi143.stdout:5/629: creat d1/d46/df/d1f/ff1 x:0 0 0 2024-09-17T01:07:04.498 INFO:tasks.workunit.client.0.smithi103.stdout:8/96: fsync d0/d6/dc/f9 0 2024-09-17T01:07:04.498 INFO:tasks.workunit.client.1.smithi143.stdout:3/670: truncate d6/d1c/d33/d41/d2b/f3d 1154469 0 2024-09-17T01:07:04.499 INFO:tasks.workunit.client.1.smithi143.stdout:2/627: write d0/d10/d58/d5a/d5b/d4c/d59/f9a [175409,120532] 0 2024-09-17T01:07:04.500 INFO:tasks.workunit.client.0.smithi103.stdout:8/97: fsync d0/d6/f1d 0 2024-09-17T01:07:04.502 INFO:tasks.workunit.client.0.smithi103.stdout:3/180: creat d3/d16/d1b/d3c/f40 x:0 0 0 2024-09-17T01:07:04.502 INFO:tasks.workunit.client.0.smithi103.stdout:6/91: dwrite d3/ff [0,4194304] 0 2024-09-17T01:07:04.503 INFO:tasks.workunit.client.1.smithi143.stdout:9/665: creat d3/d39/d42/d58/fe2 x:0 0 0 2024-09-17T01:07:04.506 INFO:tasks.workunit.client.1.smithi143.stdout:0/646: rename d3/d5/d8/d21/d2e/c6f to d3/cd2 0 2024-09-17T01:07:04.507 INFO:tasks.workunit.client.0.smithi103.stdout:9/141: creat d7/dd/d11/d21/f33 x:0 0 0 2024-09-17T01:07:04.510 INFO:tasks.workunit.client.0.smithi103.stdout:3/181: dwrite d3/f27 [0,4194304] 0 2024-09-17T01:07:04.519 INFO:tasks.workunit.client.1.smithi143.stdout:3/671: mknod d6/d1c/d33/d5d/cd5 0 2024-09-17T01:07:04.522 INFO:tasks.workunit.client.1.smithi143.stdout:2/628: creat d0/d10/d58/d5a/d5b/d4c/d77/fcc x:0 0 0 2024-09-17T01:07:04.522 INFO:tasks.workunit.client.0.smithi103.stdout:5/77: dread d6/db/fd [0,4194304] 0 2024-09-17T01:07:04.523 INFO:tasks.workunit.client.0.smithi103.stdout:6/92: creat d3/d16/f1f x:0 0 0 2024-09-17T01:07:04.524 INFO:tasks.workunit.client.1.smithi143.stdout:2/629: read d0/d10/f47 [2566694,27855] 0 2024-09-17T01:07:04.526 INFO:tasks.workunit.client.1.smithi143.stdout:8/703: rename d9/de/d53/d75/dfa/d66/fe3 to d9/d12/d38/d58/dda/dea/ffd 0 2024-09-17T01:07:04.527 INFO:tasks.workunit.client.1.smithi143.stdout:6/598: write d2/df/d20/f5b [351413,76608] 0 2024-09-17T01:07:04.531 INFO:tasks.workunit.client.1.smithi143.stdout:2/630: dwrite d0/d2/d21/d84/d8d/fb1 [0,4194304] 0 2024-09-17T01:07:04.533 INFO:tasks.workunit.client.1.smithi143.stdout:2/631: write d0/fca [28540,72463] 0 2024-09-17T01:07:04.535 INFO:tasks.workunit.client.1.smithi143.stdout:8/704: dwrite d9/d12/d4b/d3f/f94 [0,4194304] 0 2024-09-17T01:07:04.537 INFO:tasks.workunit.client.1.smithi143.stdout:8/705: truncate d9/d23/fd0 361835 0 2024-09-17T01:07:04.537 INFO:tasks.workunit.client.1.smithi143.stdout:8/706: chown d9/d12/d38/d58/dda/dea 12272017 1 2024-09-17T01:07:04.538 INFO:tasks.workunit.client.1.smithi143.stdout:8/707: fsync d9/d12/d38/d58/fce 0 2024-09-17T01:07:04.573 INFO:tasks.workunit.client.1.smithi143.stdout:4/687: sync 2024-09-17T01:07:04.600 INFO:tasks.workunit.client.1.smithi143.stdout:0/647: creat d3/d5/d8/d21/d2e/fd3 x:0 0 0 2024-09-17T01:07:04.601 INFO:tasks.workunit.client.1.smithi143.stdout:1/711: getdents d0 0 2024-09-17T01:07:04.601 INFO:tasks.workunit.client.1.smithi143.stdout:5/630: write d1/d46/df/d23/f2a [867493,71180] 0 2024-09-17T01:07:04.602 INFO:tasks.workunit.client.0.smithi103.stdout:3/182: creat d3/d16/d1b/d2c/f41 x:0 0 0 2024-09-17T01:07:04.605 INFO:tasks.workunit.client.0.smithi103.stdout:8/98: link d0/d6/f10 d0/d6/dc/d12/f1f 0 2024-09-17T01:07:04.607 INFO:tasks.workunit.client.0.smithi103.stdout:8/99: write d0/f8 [885949,38597] 0 2024-09-17T01:07:04.608 INFO:tasks.workunit.client.1.smithi143.stdout:0/648: dread d3/d5/f34 [0,4194304] 0 2024-09-17T01:07:04.608 INFO:tasks.workunit.client.1.smithi143.stdout:3/672: creat d6/d1c/d33/d41/d2e/d30/fd6 x:0 0 0 2024-09-17T01:07:04.608 INFO:tasks.workunit.client.1.smithi143.stdout:0/649: chown d3/d5/d8/d27/d8c 21185060 1 2024-09-17T01:07:04.610 INFO:tasks.workunit.client.1.smithi143.stdout:7/807: write f2 [6399453,2276] 0 2024-09-17T01:07:04.611 INFO:tasks.workunit.client.1.smithi143.stdout:9/666: mkdir d3/d3d/de3 0 2024-09-17T01:07:04.612 INFO:tasks.workunit.client.0.smithi103.stdout:3/183: creat d3/d16/d1b/d2c/f42 x:0 0 0 2024-09-17T01:07:04.612 INFO:tasks.workunit.client.1.smithi143.stdout:9/667: chown d3/d39/d6a/d9/d74/cd7 756954382 1 2024-09-17T01:07:04.612 INFO:tasks.workunit.client.0.smithi103.stdout:9/142: dwrite d7/dd/f16 [0,4194304] 0 2024-09-17T01:07:04.615 INFO:tasks.workunit.client.0.smithi103.stdout:3/184: write d3/d16/d1b/d3c/f26 [653942,46108] 0 2024-09-17T01:07:04.615 INFO:tasks.workunit.client.1.smithi143.stdout:6/599: creat d2/d17/d3a/fc2 x:0 0 0 2024-09-17T01:07:04.616 INFO:tasks.workunit.client.0.smithi103.stdout:6/93: mknod d3/c20 0 2024-09-17T01:07:04.618 INFO:tasks.workunit.client.1.smithi143.stdout:2/632: creat d0/d44/d7a/d86/d97/fcd x:0 0 0 2024-09-17T01:07:04.619 INFO:tasks.workunit.client.0.smithi103.stdout:9/143: dread d7/dd/f16 [0,4194304] 0 2024-09-17T01:07:04.619 INFO:tasks.workunit.client.0.smithi103.stdout:8/100: unlink d0/d6/f16 0 2024-09-17T01:07:04.622 INFO:tasks.workunit.client.1.smithi143.stdout:8/708: rename d9/d12/d4b/d3f to d9/d23/db4/d55/dfe 0 2024-09-17T01:07:04.622 INFO:tasks.workunit.client.0.smithi103.stdout:5/78: link d6/d11/f18 d6/d11/f1d 0 2024-09-17T01:07:04.624 INFO:tasks.workunit.client.1.smithi143.stdout:4/688: creat da/d3a/d3e/d72/d9e/fe2 x:0 0 0 2024-09-17T01:07:04.625 INFO:tasks.workunit.client.1.smithi143.stdout:6/600: dwrite d2/df/fa4 [0,4194304] 0 2024-09-17T01:07:04.626 INFO:tasks.workunit.client.0.smithi103.stdout:5/79: dread f4 [0,4194304] 0 2024-09-17T01:07:04.626 INFO:tasks.workunit.client.1.smithi143.stdout:0/650: dread d3/d5/d8/d27/f4b [0,4194304] 0 2024-09-17T01:07:04.627 INFO:tasks.workunit.client.1.smithi143.stdout:7/808: dread d4/d16/f6d [0,4194304] 0 2024-09-17T01:07:04.628 INFO:tasks.workunit.client.0.smithi103.stdout:0/158: link dd/f15 dd/df/d1b/f37 0 2024-09-17T01:07:04.629 INFO:tasks.workunit.client.1.smithi143.stdout:4/689: truncate da/d3a/d3e/d72/d9e/fbb 710383 0 2024-09-17T01:07:04.629 INFO:tasks.workunit.client.0.smithi103.stdout:0/159: write dd/df/f24 [1364456,47715] 0 2024-09-17T01:07:04.630 INFO:tasks.workunit.client.1.smithi143.stdout:4/690: write da/d3a/f59 [451011,119698] 0 2024-09-17T01:07:04.631 INFO:tasks.workunit.client.1.smithi143.stdout:4/691: fdatasync da/d3a/d3e/d72/da3/fa5 0 2024-09-17T01:07:04.632 INFO:tasks.workunit.client.1.smithi143.stdout:1/712: fdatasync d0/d6/d43/d6d/d8b/dd0/de2/d79/f7a 0 2024-09-17T01:07:04.632 INFO:tasks.workunit.client.1.smithi143.stdout:4/692: fdatasync da/d68/f87 0 2024-09-17T01:07:04.639 INFO:tasks.workunit.client.0.smithi103.stdout:8/101: mknod d0/c20 0 2024-09-17T01:07:04.640 INFO:tasks.workunit.client.0.smithi103.stdout:8/102: chown d0/f8 13138 1 2024-09-17T01:07:04.640 INFO:tasks.workunit.client.0.smithi103.stdout:8/103: stat d0/c1a 0 2024-09-17T01:07:04.641 INFO:tasks.workunit.client.0.smithi103.stdout:8/104: write d0/d6/f1d [985094,52710] 0 2024-09-17T01:07:04.642 INFO:tasks.workunit.client.1.smithi143.stdout:9/668: rmdir d3/d39/d6a/dc3 39 2024-09-17T01:07:04.645 INFO:tasks.workunit.client.0.smithi103.stdout:5/80: unlink d6/f8 0 2024-09-17T01:07:04.648 INFO:tasks.workunit.client.1.smithi143.stdout:9/669: dread d3/d39/d6a/d26/f3c [0,4194304] 0 2024-09-17T01:07:04.649 INFO:tasks.workunit.client.1.smithi143.stdout:8/709: mknod d9/d23/db4/cff 0 2024-09-17T01:07:04.649 INFO:tasks.workunit.client.1.smithi143.stdout:9/670: readlink d3/d39/d42/d58/d5a/d5e/lae 0 2024-09-17T01:07:04.650 INFO:tasks.workunit.client.0.smithi103.stdout:3/185: mknod d3/c43 0 2024-09-17T01:07:04.652 INFO:tasks.workunit.client.1.smithi143.stdout:0/651: dread d3/d5/d35/da8/dcd/f54 [0,4194304] 0 2024-09-17T01:07:04.652 INFO:tasks.workunit.client.0.smithi103.stdout:6/94: unlink d3/fc 0 2024-09-17T01:07:04.656 INFO:tasks.workunit.client.1.smithi143.stdout:7/809: mknod d4/d1f/d4a/d9e/c101 0 2024-09-17T01:07:04.656 INFO:tasks.workunit.client.0.smithi103.stdout:5/81: truncate f0 1893460 0 2024-09-17T01:07:04.658 INFO:tasks.workunit.client.1.smithi143.stdout:0/652: dwrite d3/d5/d8/d21/d9b/dba/fd1 [0,4194304] 0 2024-09-17T01:07:04.658 INFO:tasks.workunit.client.0.smithi103.stdout:0/160: unlink dd/d1c/l1e 0 2024-09-17T01:07:04.659 INFO:tasks.workunit.client.0.smithi103.stdout:0/161: chown dd/df/l12 382556 1 2024-09-17T01:07:04.660 INFO:tasks.workunit.client.1.smithi143.stdout:4/693: rename da/d3a/d3e/d72/d9e/fd3 to da/d3a/d3e/d72/d9e/fe3 0 2024-09-17T01:07:04.661 INFO:tasks.workunit.client.0.smithi103.stdout:3/186: rmdir d3/d16/d1b/d36 39 2024-09-17T01:07:04.662 INFO:tasks.workunit.client.0.smithi103.stdout:3/187: dread - d3/d16/d1b/d2c/f41 zero size 2024-09-17T01:07:04.666 INFO:tasks.workunit.client.1.smithi143.stdout:2/633: symlink d0/d10/d58/d79/lce 0 2024-09-17T01:07:04.667 INFO:tasks.workunit.client.0.smithi103.stdout:9/144: rename d7/dd/d11/d21/l27 to d7/l34 0 2024-09-17T01:07:04.669 INFO:tasks.workunit.client.1.smithi143.stdout:1/713: dread d0/d6/d43/d47/d72/f9e [0,4194304] 0 2024-09-17T01:07:04.669 INFO:tasks.workunit.client.0.smithi103.stdout:9/145: fsync d7/dd/d11/fa 0 2024-09-17T01:07:04.669 INFO:tasks.workunit.client.0.smithi103.stdout:8/105: mknod d0/d6/c21 0 2024-09-17T01:07:04.670 INFO:tasks.workunit.client.0.smithi103.stdout:9/146: fsync d7/dd/d11/fb 0 2024-09-17T01:07:04.670 INFO:tasks.workunit.client.1.smithi143.stdout:6/601: creat d2/d30/d45/d70/da5/fc3 x:0 0 0 2024-09-17T01:07:04.671 INFO:tasks.workunit.client.0.smithi103.stdout:8/106: write d0/d6/dc/f9 [124485,13855] 0 2024-09-17T01:07:04.672 INFO:tasks.workunit.client.0.smithi103.stdout:6/95: truncate d3/f4 5488841 0 2024-09-17T01:07:04.674 INFO:tasks.workunit.client.0.smithi103.stdout:0/162: rename dd/d1c/d29 to dd/df/d38 0 2024-09-17T01:07:04.677 INFO:tasks.workunit.client.1.smithi143.stdout:5/631: creat d1/d46/df/d23/d4f/d7d/ff2 x:0 0 0 2024-09-17T01:07:04.679 INFO:tasks.workunit.client.1.smithi143.stdout:4/694: dread da/d3a/d40/f27 [0,4194304] 0 2024-09-17T01:07:04.680 INFO:tasks.workunit.client.1.smithi143.stdout:0/653: mknod d3/d5/d8/d27/d31/d48/d8d/cd4 0 2024-09-17T01:07:04.681 INFO:tasks.workunit.client.0.smithi103.stdout:5/82: write d6/d11/f1d [2556544,66262] 0 2024-09-17T01:07:04.682 INFO:tasks.workunit.client.1.smithi143.stdout:0/654: chown d3/d5/d8/c11 1410 1 2024-09-17T01:07:04.682 INFO:tasks.workunit.client.0.smithi103.stdout:3/188: mkdir d3/d44 0 2024-09-17T01:07:04.682 INFO:tasks.workunit.client.0.smithi103.stdout:3/189: fdatasync d3/f1d 0 2024-09-17T01:07:04.683 INFO:tasks.workunit.client.0.smithi103.stdout:3/190: stat d3/f27 0 2024-09-17T01:07:04.683 INFO:tasks.workunit.client.0.smithi103.stdout:3/191: fsync d3/f1c 0 2024-09-17T01:07:04.684 INFO:tasks.workunit.client.1.smithi143.stdout:0/655: write d3/d5/d8/d27/f1e [5162589,26346] 0 2024-09-17T01:07:04.684 INFO:tasks.workunit.client.0.smithi103.stdout:9/147: creat d7/dd/d11/d20/f35 x:0 0 0 2024-09-17T01:07:04.684 INFO:tasks.workunit.client.0.smithi103.stdout:9/148: stat d7/l15 0 2024-09-17T01:07:04.686 INFO:tasks.workunit.client.1.smithi143.stdout:4/695: dwrite da/d3a/f79 [4194304,4194304] 0 2024-09-17T01:07:04.686 INFO:tasks.workunit.client.0.smithi103.stdout:6/96: rmdir d3/d16 39 2024-09-17T01:07:04.691 INFO:tasks.workunit.client.1.smithi143.stdout:8/710: rename d9/d12/d4b/cb2 to d9/d12/d38/c100 0 2024-09-17T01:07:04.693 INFO:tasks.workunit.client.1.smithi143.stdout:9/671: chown d3/d39/d6a/dc3/f1d 1713958711 1 2024-09-17T01:07:04.693 INFO:tasks.workunit.client.1.smithi143.stdout:1/714: mkdir d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/dec 0 2024-09-17T01:07:04.694 INFO:tasks.workunit.client.0.smithi103.stdout:5/83: creat d6/f1e x:0 0 0 2024-09-17T01:07:04.695 INFO:tasks.workunit.client.1.smithi143.stdout:9/672: chown d3/d81/ce0 18 1 2024-09-17T01:07:04.696 INFO:tasks.workunit.client.1.smithi143.stdout:4/696: dwrite da/d6d/f74 [0,4194304] 0 2024-09-17T01:07:04.697 INFO:tasks.workunit.client.0.smithi103.stdout:3/192: stat d3/fd 0 2024-09-17T01:07:04.697 INFO:tasks.workunit.client.1.smithi143.stdout:5/632: dread d1/d46/df/d53/d74/fa7 [0,4194304] 0 2024-09-17T01:07:04.698 INFO:tasks.workunit.client.1.smithi143.stdout:8/711: truncate d9/d12/d38/d58/fce 68380 0 2024-09-17T01:07:04.698 INFO:tasks.workunit.client.0.smithi103.stdout:0/163: dwrite dd/f36 [0,4194304] 0 2024-09-17T01:07:04.699 INFO:tasks.workunit.client.1.smithi143.stdout:3/673: getdents d6/d1c/d33/d3f/d5c 0 2024-09-17T01:07:04.700 INFO:tasks.workunit.client.0.smithi103.stdout:6/97: unlink d3/l1d 0 2024-09-17T01:07:04.701 INFO:tasks.workunit.client.1.smithi143.stdout:8/712: fsync d9/d12/d13/d7c/f91 0 2024-09-17T01:07:04.701 INFO:tasks.workunit.client.1.smithi143.stdout:2/634: mkdir d0/dcf 0 2024-09-17T01:07:04.703 INFO:tasks.workunit.client.1.smithi143.stdout:3/674: chown d6/d1c/d4b/l7a 1 1 2024-09-17T01:07:04.703 INFO:tasks.workunit.client.1.smithi143.stdout:6/602: rename d2/d17/d6e/d26/d79/cab to d2/d19/cc4 0 2024-09-17T01:07:04.704 INFO:tasks.workunit.client.0.smithi103.stdout:9/149: mknod d7/c36 0 2024-09-17T01:07:04.707 INFO:tasks.workunit.client.1.smithi143.stdout:1/715: creat d0/d6/d43/d6a/d52/db2/fed x:0 0 0 2024-09-17T01:07:04.707 INFO:tasks.workunit.client.0.smithi103.stdout:6/98: read d3/f9 [3303347,105373] 0 2024-09-17T01:07:04.709 INFO:tasks.workunit.client.1.smithi143.stdout:0/656: dread d3/d5/d35/da8/dcd/f83 [0,4194304] 0 2024-09-17T01:07:04.709 INFO:tasks.workunit.client.0.smithi103.stdout:8/107: link d0/d6/dc/f9 d0/d6/f22 0 2024-09-17T01:07:04.711 INFO:tasks.workunit.client.1.smithi143.stdout:5/633: mknod d1/d46/df/d1f/d7a/cf3 0 2024-09-17T01:07:04.712 INFO:tasks.workunit.client.0.smithi103.stdout:5/84: mknod d6/db/c1f 0 2024-09-17T01:07:04.712 INFO:tasks.workunit.client.1.smithi143.stdout:9/673: dwrite d3/d39/d6a/d9/f2e [0,4194304] 0 2024-09-17T01:07:04.712 INFO:tasks.workunit.client.1.smithi143.stdout:3/675: truncate d6/d1c/d4b/fa9 886075 0 2024-09-17T01:07:04.713 INFO:tasks.workunit.client.0.smithi103.stdout:9/150: creat d7/d2d/f37 x:0 0 0 2024-09-17T01:07:04.715 INFO:tasks.workunit.client.1.smithi143.stdout:2/635: rmdir d0/d44 39 2024-09-17T01:07:04.717 INFO:tasks.workunit.client.1.smithi143.stdout:8/713: dwrite f7 [0,4194304] 0 2024-09-17T01:07:04.718 INFO:tasks.workunit.client.0.smithi103.stdout:0/164: rename dd/f20 to dd/df/f39 0 2024-09-17T01:07:04.719 INFO:tasks.workunit.client.0.smithi103.stdout:0/165: readlink dd/df/l12 0 2024-09-17T01:07:04.719 INFO:tasks.workunit.client.1.smithi143.stdout:1/716: fsync d0/dc/d74/d94/fa9 0 2024-09-17T01:07:04.720 INFO:tasks.workunit.client.1.smithi143.stdout:2/636: fdatasync d0/d2/d21/d22/f41 0 2024-09-17T01:07:04.721 INFO:tasks.workunit.client.1.smithi143.stdout:0/657: fsync d3/d5/f84 0 2024-09-17T01:07:04.722 INFO:tasks.workunit.client.0.smithi103.stdout:5/85: mknod d6/d11/c20 0 2024-09-17T01:07:04.722 INFO:tasks.workunit.client.1.smithi143.stdout:5/634: creat d1/d46/d9b/ff4 x:0 0 0 2024-09-17T01:07:04.722 INFO:tasks.workunit.client.0.smithi103.stdout:5/86: chown d6/d11/f1d 1215 1 2024-09-17T01:07:04.723 INFO:tasks.workunit.client.1.smithi143.stdout:3/676: rmdir d6/d1c/d82/db1 39 2024-09-17T01:07:04.724 INFO:tasks.workunit.client.1.smithi143.stdout:7/810: dwrite d4/d1f/f52 [0,4194304] 0 2024-09-17T01:07:04.724 INFO:tasks.workunit.client.1.smithi143.stdout:1/717: write d0/d6/d43/d6d/d8b/fcf [350275,76212] 0 2024-09-17T01:07:04.725 INFO:tasks.workunit.client.1.smithi143.stdout:5/635: chown d1/d46/df/d23/d4f/d7d/dcf 418 1 2024-09-17T01:07:04.726 INFO:tasks.workunit.client.1.smithi143.stdout:6/603: symlink d2/d17/d6e/d26/d46/lc5 0 2024-09-17T01:07:04.726 INFO:tasks.workunit.client.1.smithi143.stdout:3/677: dread - d6/d1c/d33/d5d/fc0 zero size 2024-09-17T01:07:04.728 INFO:tasks.workunit.client.1.smithi143.stdout:5/636: write d1/d46/df/d23/fb0 [3078067,39730] 0 2024-09-17T01:07:04.728 INFO:tasks.workunit.client.1.smithi143.stdout:9/674: creat d3/d39/d42/d58/d5a/d5e/fe4 x:0 0 0 2024-09-17T01:07:04.728 INFO:tasks.workunit.client.1.smithi143.stdout:7/811: fdatasync d4/d1f/d29/d65/d5d/fe1 0 2024-09-17T01:07:04.728 INFO:tasks.workunit.client.0.smithi103.stdout:0/166: creat dd/df/f3a x:0 0 0 2024-09-17T01:07:04.729 INFO:tasks.workunit.client.0.smithi103.stdout:6/99: mkdir d3/d16/d21 0 2024-09-17T01:07:04.730 INFO:tasks.workunit.client.0.smithi103.stdout:8/108: mknod d0/d6/c23 0 2024-09-17T01:07:04.738 INFO:tasks.workunit.client.0.smithi103.stdout:5/87: dwrite d6/f1b [0,4194304] 0 2024-09-17T01:07:04.743 INFO:tasks.workunit.client.0.smithi103.stdout:5/88: creat d6/d11/d13/f21 x:0 0 0 2024-09-17T01:07:04.744 INFO:tasks.workunit.client.0.smithi103.stdout:0/167: creat dd/f3b x:0 0 0 2024-09-17T01:07:04.746 INFO:tasks.workunit.client.0.smithi103.stdout:6/100: link d3/la d3/d16/l22 0 2024-09-17T01:07:04.752 INFO:tasks.workunit.client.0.smithi103.stdout:5/89: rename d6/db/l10 to d6/d11/l22 0 2024-09-17T01:07:04.752 INFO:tasks.workunit.client.0.smithi103.stdout:6/101: dwrite f1 [0,4194304] 0 2024-09-17T01:07:04.752 INFO:tasks.workunit.client.0.smithi103.stdout:5/90: dread - d6/d11/d13/f1c zero size 2024-09-17T01:07:04.754 INFO:tasks.workunit.client.0.smithi103.stdout:0/168: link dd/f15 dd/df/d1b/f3c 0 2024-09-17T01:07:04.759 INFO:tasks.workunit.client.0.smithi103.stdout:3/193: truncate d3/f14 4637402 0 2024-09-17T01:07:04.760 INFO:tasks.workunit.client.0.smithi103.stdout:0/169: creat dd/df/f3d x:0 0 0 2024-09-17T01:07:04.766 INFO:tasks.workunit.client.0.smithi103.stdout:3/194: creat d3/d16/d1b/f45 x:0 0 0 2024-09-17T01:07:04.772 INFO:tasks.workunit.client.0.smithi103.stdout:0/170: dread dd/df/d1b/f37 [0,4194304] 0 2024-09-17T01:07:04.774 INFO:tasks.workunit.client.0.smithi103.stdout:6/102: write d3/f4 [1194065,37128] 0 2024-09-17T01:07:04.776 INFO:tasks.workunit.client.0.smithi103.stdout:0/171: dread - dd/df/d1b/f32 zero size 2024-09-17T01:07:04.777 INFO:tasks.workunit.client.0.smithi103.stdout:3/195: dwrite d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:04.781 INFO:tasks.workunit.client.0.smithi103.stdout:6/103: readlink d3/d16/l22 0 2024-09-17T01:07:04.781 INFO:tasks.workunit.client.0.smithi103.stdout:8/109: dwrite d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:04.783 INFO:tasks.workunit.client.0.smithi103.stdout:0/172: rmdir dd/df 39 2024-09-17T01:07:04.784 INFO:tasks.workunit.client.0.smithi103.stdout:5/91: dwrite d6/db/fd [0,4194304] 0 2024-09-17T01:07:04.786 INFO:tasks.workunit.client.0.smithi103.stdout:6/104: read d3/f9 [2939108,8019] 0 2024-09-17T01:07:04.787 INFO:tasks.workunit.client.0.smithi103.stdout:6/105: chown d3/la 0 1 2024-09-17T01:07:04.787 INFO:tasks.workunit.client.0.smithi103.stdout:8/110: symlink d0/d6/dc/d12/l24 0 2024-09-17T01:07:04.788 INFO:tasks.workunit.client.0.smithi103.stdout:5/92: stat d6/db/lf 0 2024-09-17T01:07:04.790 INFO:tasks.workunit.client.0.smithi103.stdout:3/196: creat d3/d16/d1b/f46 x:0 0 0 2024-09-17T01:07:04.791 INFO:tasks.workunit.client.1.smithi143.stdout:6/604: fdatasync d2/d30/d84/fb1 0 2024-09-17T01:07:04.795 INFO:tasks.workunit.client.0.smithi103.stdout:8/111: mkdir d0/d6/dc/d12/d25 0 2024-09-17T01:07:04.796 INFO:tasks.workunit.client.1.smithi143.stdout:1/718: unlink d0/d6/d43/d6a/d8f/fc9 0 2024-09-17T01:07:04.796 INFO:tasks.workunit.client.0.smithi103.stdout:3/197: dread d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:04.797 INFO:tasks.workunit.client.0.smithi103.stdout:6/106: symlink d3/l23 0 2024-09-17T01:07:04.798 INFO:tasks.workunit.client.1.smithi143.stdout:2/637: write d0/d44/f61 [388589,86867] 0 2024-09-17T01:07:04.798 INFO:tasks.workunit.client.0.smithi103.stdout:0/173: creat dd/f3e x:0 0 0 2024-09-17T01:07:04.799 INFO:tasks.workunit.client.1.smithi143.stdout:6/605: write d2/d30/d45/f4d [1482300,62059] 0 2024-09-17T01:07:04.800 INFO:tasks.workunit.client.0.smithi103.stdout:5/93: rename d6/d11/l22 to d6/d11/l23 0 2024-09-17T01:07:04.801 INFO:tasks.workunit.client.1.smithi143.stdout:4/697: write da/d6d/fa4 [1429248,35897] 0 2024-09-17T01:07:04.802 INFO:tasks.workunit.client.0.smithi103.stdout:8/112: creat d0/d6/dc/d12/f26 x:0 0 0 2024-09-17T01:07:04.805 INFO:tasks.workunit.client.0.smithi103.stdout:5/94: symlink d6/l24 0 2024-09-17T01:07:04.806 INFO:tasks.workunit.client.0.smithi103.stdout:6/107: symlink d3/l24 0 2024-09-17T01:07:04.806 INFO:tasks.workunit.client.1.smithi143.stdout:7/812: creat d4/d16/f102 x:0 0 0 2024-09-17T01:07:04.807 INFO:tasks.workunit.client.1.smithi143.stdout:5/637: creat d1/d96/ff5 x:0 0 0 2024-09-17T01:07:04.807 INFO:tasks.workunit.client.1.smithi143.stdout:9/675: dwrite d3/fd0 [4194304,4194304] 0 2024-09-17T01:07:04.808 INFO:tasks.workunit.client.1.smithi143.stdout:3/678: dwrite d6/d1c/d33/d3f/d5c/da1/f8c [4194304,4194304] 0 2024-09-17T01:07:04.808 INFO:tasks.workunit.client.0.smithi103.stdout:8/113: rename d0/f8 to d0/d6/dc/d12/d25/f27 0 2024-09-17T01:07:04.809 INFO:tasks.workunit.client.1.smithi143.stdout:8/714: dwrite d9/d12/d4b/f41 [0,4194304] 0 2024-09-17T01:07:04.809 INFO:tasks.workunit.client.1.smithi143.stdout:2/638: symlink d0/d2/ld0 0 2024-09-17T01:07:04.811 INFO:tasks.workunit.client.0.smithi103.stdout:5/95: chown d6/d11/c12 104020 1 2024-09-17T01:07:04.811 INFO:tasks.workunit.client.1.smithi143.stdout:1/719: write d0/d6/d43/d47/fdf [2077276,83389] 0 2024-09-17T01:07:04.814 INFO:tasks.workunit.client.1.smithi143.stdout:4/698: mknod da/d3a/d3e/d72/d9e/da1/ce4 0 2024-09-17T01:07:04.815 INFO:tasks.workunit.client.0.smithi103.stdout:8/114: creat d0/f28 x:0 0 0 2024-09-17T01:07:04.817 INFO:tasks.workunit.client.0.smithi103.stdout:8/115: write d0/d6/dc/d12/f1f [1451395,103665] 0 2024-09-17T01:07:04.818 INFO:tasks.workunit.client.1.smithi143.stdout:6/606: symlink d2/d17/d6e/d26/lc6 0 2024-09-17T01:07:04.818 INFO:tasks.workunit.client.1.smithi143.stdout:3/679: write d6/d1c/d4b/d57/fa0 [762864,101475] 0 2024-09-17T01:07:04.819 INFO:tasks.workunit.client.0.smithi103.stdout:8/116: truncate d0/d6/f1c 327244 0 2024-09-17T01:07:04.821 INFO:tasks.workunit.client.0.smithi103.stdout:8/117: truncate d0/d6/f1d 1250082 0 2024-09-17T01:07:04.822 INFO:tasks.workunit.client.1.smithi143.stdout:3/680: stat d6/d1c/d33/d3f/d79/d7b/c8f 0 2024-09-17T01:07:04.823 INFO:tasks.workunit.client.0.smithi103.stdout:5/96: mknod d6/d11/d13/c25 0 2024-09-17T01:07:04.824 INFO:tasks.workunit.client.1.smithi143.stdout:9/676: dread d3/d39/d42/f54 [0,4194304] 0 2024-09-17T01:07:04.825 INFO:tasks.workunit.client.1.smithi143.stdout:7/813: symlink d4/d1f/d4a/d9e/da2/l103 0 2024-09-17T01:07:04.826 INFO:tasks.workunit.client.0.smithi103.stdout:6/108: mkdir d3/d25 0 2024-09-17T01:07:04.828 INFO:tasks.workunit.client.1.smithi143.stdout:7/814: readlink d4/d1f/d4a/l8d 0 2024-09-17T01:07:04.830 INFO:tasks.workunit.client.1.smithi143.stdout:4/699: dwrite da/d3a/d3e/d4a/d8c/fbd [0,4194304] 0 2024-09-17T01:07:04.830 INFO:tasks.workunit.client.1.smithi143.stdout:6/607: dwrite d2/d30/d45/f4d [0,4194304] 0 2024-09-17T01:07:04.830 INFO:tasks.workunit.client.0.smithi103.stdout:0/174: getdents dd 0 2024-09-17T01:07:04.830 INFO:tasks.workunit.client.1.smithi143.stdout:7/815: read d4/d26/f2b [1483030,109342] 0 2024-09-17T01:07:04.833 INFO:tasks.workunit.client.1.smithi143.stdout:2/639: unlink d0/d10/d58/d5a/d5b/d4c/d71/dc5/fcb 0 2024-09-17T01:07:04.834 INFO:tasks.workunit.client.0.smithi103.stdout:5/97: rename d6/d11/f18 to d6/d11/f26 0 2024-09-17T01:07:04.838 INFO:tasks.workunit.client.1.smithi143.stdout:2/640: readlink d0/d10/d58/d5a/d5b/d4c/d59/l88 0 2024-09-17T01:07:04.838 INFO:tasks.workunit.client.0.smithi103.stdout:3/198: truncate d3/d16/d1b/d3c/f35 16444 0 2024-09-17T01:07:04.839 INFO:tasks.workunit.client.1.smithi143.stdout:2/641: write d0/d44/f94 [154024,100239] 0 2024-09-17T01:07:04.841 INFO:tasks.workunit.client.0.smithi103.stdout:3/199: write d3/d16/d1b/d3c/f40 [109480,12590] 0 2024-09-17T01:07:04.841 INFO:tasks.workunit.client.1.smithi143.stdout:2/642: chown d0/d10/d58/d5a/d5b/d4c/d71/d99/faf 1004577436 1 2024-09-17T01:07:04.843 INFO:tasks.workunit.client.0.smithi103.stdout:5/98: dwrite d6/f1e [0,4194304] 0 2024-09-17T01:07:04.843 INFO:tasks.workunit.client.1.smithi143.stdout:7/816: dwrite d4/d1f/f3e [0,4194304] 0 2024-09-17T01:07:04.843 INFO:tasks.workunit.client.1.smithi143.stdout:5/638: creat d1/d46/df/d1f/ff6 x:0 0 0 2024-09-17T01:07:04.844 INFO:tasks.workunit.client.0.smithi103.stdout:5/99: fdatasync d6/f1b 0 2024-09-17T01:07:04.845 INFO:tasks.workunit.client.0.smithi103.stdout:5/100: write d6/f1b [3355869,54937] 0 2024-09-17T01:07:04.846 INFO:tasks.workunit.client.0.smithi103.stdout:5/101: chown d6/d11/d13/l16 8730854 1 2024-09-17T01:07:04.847 INFO:tasks.workunit.client.1.smithi143.stdout:7/817: truncate d4/d1f/d29/d65/d5d/db1/dc6/fce 967211 0 2024-09-17T01:07:04.854 INFO:tasks.workunit.client.1.smithi143.stdout:4/700: readlink da/d3a/d3e/d72/da3/lac 0 2024-09-17T01:07:04.856 INFO:tasks.workunit.client.0.smithi103.stdout:8/118: rename d0/l13 to d0/d6/dc/l29 0 2024-09-17T01:07:04.858 INFO:tasks.workunit.client.0.smithi103.stdout:8/119: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:04.858 INFO:tasks.workunit.client.0.smithi103.stdout:5/102: readlink d6/d11/d13/l14 0 2024-09-17T01:07:04.860 INFO:tasks.workunit.client.0.smithi103.stdout:8/120: write d0/d6/dc/d12/f1f [707453,100537] 0 2024-09-17T01:07:04.862 INFO:tasks.workunit.client.0.smithi103.stdout:0/175: link c2 dd/d1c/c3f 0 2024-09-17T01:07:04.863 INFO:tasks.workunit.client.0.smithi103.stdout:0/176: fsync dd/f3b 0 2024-09-17T01:07:04.864 INFO:tasks.workunit.client.1.smithi143.stdout:3/681: rename d6/d1c/d33/d41/d42/f4f to d6/d1c/d4d/da4/fd7 0 2024-09-17T01:07:04.865 INFO:tasks.workunit.client.0.smithi103.stdout:8/121: dread d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:04.865 INFO:tasks.workunit.client.0.smithi103.stdout:3/200: mknod d3/d16/c47 0 2024-09-17T01:07:04.865 INFO:tasks.workunit.client.0.smithi103.stdout:8/122: fsync d0/d6/f1d 0 2024-09-17T01:07:04.866 INFO:tasks.workunit.client.1.smithi143.stdout:7/818: mkdir d4/d16/dbd/d104 0 2024-09-17T01:07:04.866 INFO:tasks.workunit.client.0.smithi103.stdout:2/51: sync 2024-09-17T01:07:04.866 INFO:tasks.workunit.client.0.smithi103.stdout:7/123: sync 2024-09-17T01:07:04.867 INFO:tasks.workunit.client.0.smithi103.stdout:9/151: sync 2024-09-17T01:07:04.867 INFO:tasks.workunit.client.0.smithi103.stdout:1/84: sync 2024-09-17T01:07:04.867 INFO:tasks.workunit.client.0.smithi103.stdout:4/208: sync 2024-09-17T01:07:04.867 INFO:tasks.workunit.client.1.smithi143.stdout:7/819: readlink d4/d1f/d4a/d9e/le6 0 2024-09-17T01:07:04.867 INFO:tasks.workunit.client.1.smithi143.stdout:9/677: mknod d3/d39/d6a/dc3/d3e/ce5 0 2024-09-17T01:07:04.868 INFO:tasks.workunit.client.1.smithi143.stdout:1/720: link d0/d6/d43/d47/d72/f9e d0/fee 0 2024-09-17T01:07:04.868 INFO:tasks.workunit.client.1.smithi143.stdout:7/820: truncate d4/fb7 229443 0 2024-09-17T01:07:04.869 INFO:tasks.workunit.client.1.smithi143.stdout:7/821: chown d4/d1f/d29 440 1 2024-09-17T01:07:04.869 INFO:tasks.workunit.client.0.smithi103.stdout:9/152: write d7/dd/f2c [6583,20906] 0 2024-09-17T01:07:04.871 INFO:tasks.workunit.client.1.smithi143.stdout:4/701: fdatasync da/d3a/d40/f27 0 2024-09-17T01:07:04.872 INFO:tasks.workunit.client.0.smithi103.stdout:6/109: getdents d3 0 2024-09-17T01:07:04.873 INFO:tasks.workunit.client.0.smithi103.stdout:3/201: dread d3/f1d [0,4194304] 0 2024-09-17T01:07:04.873 INFO:tasks.workunit.client.1.smithi143.stdout:6/608: rename d2 to d2/d17/dc7 22 2024-09-17T01:07:04.874 INFO:tasks.workunit.client.0.smithi103.stdout:4/209: dread f5 [8388608,4194304] 0 2024-09-17T01:07:04.875 INFO:tasks.workunit.client.0.smithi103.stdout:0/177: rmdir dd/df/d1b 39 2024-09-17T01:07:04.875 INFO:tasks.workunit.client.1.smithi143.stdout:9/678: dread d3/d39/d42/d58/d5a/d5e/d99/f9d [0,4194304] 0 2024-09-17T01:07:04.875 INFO:tasks.workunit.client.1.smithi143.stdout:7/822: dread d4/d1f/d4a/dc1/fd9 [0,4194304] 0 2024-09-17T01:07:04.875 INFO:tasks.workunit.client.0.smithi103.stdout:4/210: truncate d9/d2d/f39 1426052 0 2024-09-17T01:07:04.875 INFO:tasks.workunit.client.0.smithi103.stdout:0/178: truncate dd/df/f25 5453143 0 2024-09-17T01:07:04.876 INFO:tasks.workunit.client.1.smithi143.stdout:3/682: symlink d6/d1c/d33/d41/d2e/d86/ld8 0 2024-09-17T01:07:04.876 INFO:tasks.workunit.client.1.smithi143.stdout:9/679: stat d3/d39/d42/d80/fa4 0 2024-09-17T01:07:04.879 INFO:tasks.workunit.client.1.smithi143.stdout:8/715: truncate d9/d23/d32/f51 3106976 0 2024-09-17T01:07:04.880 INFO:tasks.workunit.client.0.smithi103.stdout:2/52: mkdir d6/da/dd 0 2024-09-17T01:07:04.882 INFO:tasks.workunit.client.0.smithi103.stdout:1/85: creat d2/f1a x:0 0 0 2024-09-17T01:07:04.882 INFO:tasks.workunit.client.0.smithi103.stdout:0/179: dwrite dd/df/f18 [0,4194304] 0 2024-09-17T01:07:04.884 INFO:tasks.workunit.client.0.smithi103.stdout:7/124: creat d4/d10/f2e x:0 0 0 2024-09-17T01:07:04.886 INFO:tasks.workunit.client.1.smithi143.stdout:5/639: rename d1/d46/df/f76 to d1/d46/d9b/daa/ff7 0 2024-09-17T01:07:04.891 INFO:tasks.workunit.client.0.smithi103.stdout:9/153: dread d7/dd/d11/f10 [0,4194304] 0 2024-09-17T01:07:04.892 INFO:tasks.workunit.client.0.smithi103.stdout:9/154: chown d7/c36 68 1 2024-09-17T01:07:04.893 INFO:tasks.workunit.client.0.smithi103.stdout:3/202: fdatasync d3/f9 0 2024-09-17T01:07:04.893 INFO:tasks.workunit.client.0.smithi103.stdout:9/155: readlink d7/dd/l1d 0 2024-09-17T01:07:04.894 INFO:tasks.workunit.client.0.smithi103.stdout:4/211: chown d9/d16/d23/d2b/l3b 51500107 1 2024-09-17T01:07:04.894 INFO:tasks.workunit.client.1.smithi143.stdout:6/609: rename d2/d17/d6e/d26/fa9 to d2/d30/dc1/fc8 0 2024-09-17T01:07:04.895 INFO:tasks.workunit.client.1.smithi143.stdout:5/640: stat d1/d46/df/d23/d4f/d7d/cb6 0 2024-09-17T01:07:04.897 INFO:tasks.workunit.client.0.smithi103.stdout:3/203: dread d3/d16/f1a [0,4194304] 0 2024-09-17T01:07:04.897 INFO:tasks.workunit.client.1.smithi143.stdout:5/641: write d1/d46/df/d1f/de9/fdc [1032153,43404] 0 2024-09-17T01:07:04.903 INFO:tasks.workunit.client.1.smithi143.stdout:4/702: creat da/d3a/d40/fe5 x:0 0 0 2024-09-17T01:07:04.903 INFO:tasks.workunit.client.0.smithi103.stdout:1/86: dread d2/fb [0,4194304] 0 2024-09-17T01:07:04.903 INFO:tasks.workunit.client.1.smithi143.stdout:4/703: chown da/d68/c7e 688384504 1 2024-09-17T01:07:04.904 INFO:tasks.workunit.client.0.smithi103.stdout:2/53: creat d6/da/fe x:0 0 0 2024-09-17T01:07:04.904 INFO:tasks.workunit.client.0.smithi103.stdout:2/54: fdatasync f0 0 2024-09-17T01:07:04.905 INFO:tasks.workunit.client.0.smithi103.stdout:1/87: write d2/ff [2895948,113364] 0 2024-09-17T01:07:04.905 INFO:tasks.workunit.client.0.smithi103.stdout:2/55: readlink l2 0 2024-09-17T01:07:04.906 INFO:tasks.workunit.client.0.smithi103.stdout:2/56: chown d6/da/dd 0 1 2024-09-17T01:07:04.907 INFO:tasks.workunit.client.0.smithi103.stdout:2/57: fsync d6/f8 0 2024-09-17T01:07:04.908 INFO:tasks.workunit.client.1.smithi143.stdout:7/823: rename d4/d1f/d29/d65/f99 to d4/d1f/d4a/d66/db5/f105 0 2024-09-17T01:07:04.912 INFO:tasks.workunit.client.0.smithi103.stdout:5/103: creat d6/db/f27 x:0 0 0 2024-09-17T01:07:04.913 INFO:tasks.workunit.client.1.smithi143.stdout:5/642: unlink d1/d46/df/d1f/c2e 0 2024-09-17T01:07:04.914 INFO:tasks.workunit.client.0.smithi103.stdout:6/110: getdents d3/d25 0 2024-09-17T01:07:04.914 INFO:tasks.workunit.client.1.smithi143.stdout:1/721: write d0/d6/d43/f65 [1044301,99932] 0 2024-09-17T01:07:04.914 INFO:tasks.workunit.client.1.smithi143.stdout:5/643: write d1/d46/fed [505231,105524] 0 2024-09-17T01:07:04.917 INFO:tasks.workunit.client.0.smithi103.stdout:9/156: creat d7/dd/f38 x:0 0 0 2024-09-17T01:07:04.919 INFO:tasks.workunit.client.0.smithi103.stdout:9/157: truncate d7/dd/f23 855002 0 2024-09-17T01:07:04.920 INFO:tasks.workunit.client.1.smithi143.stdout:6/610: creat d2/df/d18/da8/fc9 x:0 0 0 2024-09-17T01:07:04.921 INFO:tasks.workunit.client.0.smithi103.stdout:3/204: fdatasync d3/f9 0 2024-09-17T01:07:04.925 INFO:tasks.workunit.client.0.smithi103.stdout:9/158: dwrite d7/dd/d11/d20/f35 [0,4194304] 0 2024-09-17T01:07:04.929 INFO:tasks.workunit.client.0.smithi103.stdout:1/88: write d2/fb [3892954,55211] 0 2024-09-17T01:07:04.931 INFO:tasks.workunit.client.0.smithi103.stdout:2/58: unlink d6/f9 0 2024-09-17T01:07:04.932 INFO:tasks.workunit.client.0.smithi103.stdout:1/89: read d2/de/f11 [1574714,115162] 0 2024-09-17T01:07:04.933 INFO:tasks.workunit.client.0.smithi103.stdout:3/205: dwrite d3/d16/d1b/f46 [0,4194304] 0 2024-09-17T01:07:04.934 INFO:tasks.workunit.client.0.smithi103.stdout:5/104: mkdir d6/d28 0 2024-09-17T01:07:04.937 INFO:tasks.workunit.client.0.smithi103.stdout:4/212: symlink d9/d16/d38/d3f/l41 0 2024-09-17T01:07:04.938 INFO:tasks.workunit.client.0.smithi103.stdout:8/123: getdents d0 0 2024-09-17T01:07:04.941 INFO:tasks.workunit.client.0.smithi103.stdout:9/159: dwrite d7/d2d/f37 [0,4194304] 0 2024-09-17T01:07:04.943 INFO:tasks.workunit.client.0.smithi103.stdout:5/105: write d6/db/fd [4823186,24369] 0 2024-09-17T01:07:04.944 INFO:tasks.workunit.client.0.smithi103.stdout:4/213: chown d9/d16/d38/d3f/l41 248529872 1 2024-09-17T01:07:04.946 INFO:tasks.workunit.client.0.smithi103.stdout:9/160: stat d7/dd 0 2024-09-17T01:07:04.946 INFO:tasks.workunit.client.0.smithi103.stdout:7/125: truncate d4/d10/f25 103325 0 2024-09-17T01:07:04.947 INFO:tasks.workunit.client.0.smithi103.stdout:8/124: chown d0/d6/dc/d12/f26 639799606 1 2024-09-17T01:07:04.948 INFO:tasks.workunit.client.0.smithi103.stdout:7/126: chown d4/d11/c21 1 1 2024-09-17T01:07:04.949 INFO:tasks.workunit.client.0.smithi103.stdout:7/127: chown d4/d11/d2b 25 1 2024-09-17T01:07:04.949 INFO:tasks.workunit.client.0.smithi103.stdout:1/90: rmdir d2/d7 39 2024-09-17T01:07:04.949 INFO:tasks.workunit.client.0.smithi103.stdout:2/59: dwrite d6/fb [0,4194304] 0 2024-09-17T01:07:04.952 INFO:tasks.workunit.client.0.smithi103.stdout:6/111: mkdir d3/d25/d26 0 2024-09-17T01:07:04.953 INFO:tasks.workunit.client.0.smithi103.stdout:0/180: getdents dd 0 2024-09-17T01:07:04.954 INFO:tasks.workunit.client.0.smithi103.stdout:7/128: truncate d4/d11/f2a 1002009 0 2024-09-17T01:07:04.954 INFO:tasks.workunit.client.0.smithi103.stdout:7/129: readlink d4/lc 0 2024-09-17T01:07:04.958 INFO:tasks.workunit.client.0.smithi103.stdout:4/214: dread d9/fd [0,4194304] 0 2024-09-17T01:07:04.963 INFO:tasks.workunit.client.0.smithi103.stdout:9/161: rename d7/l15 to d7/dd/l39 0 2024-09-17T01:07:04.964 INFO:tasks.workunit.client.0.smithi103.stdout:3/206: creat d3/d16/d1b/d2c/d34/f48 x:0 0 0 2024-09-17T01:07:04.966 INFO:tasks.workunit.client.0.smithi103.stdout:5/106: dwrite d6/d11/f26 [0,4194304] 0 2024-09-17T01:07:04.969 INFO:tasks.workunit.client.0.smithi103.stdout:8/125: rename d0/d6/c15 to d0/c2a 0 2024-09-17T01:07:04.971 INFO:tasks.workunit.client.0.smithi103.stdout:9/162: truncate d7/dd/d11/d21/f33 194316 0 2024-09-17T01:07:04.972 INFO:tasks.workunit.client.0.smithi103.stdout:4/215: mkdir d9/d16/d36/d42 0 2024-09-17T01:07:04.973 INFO:tasks.workunit.client.0.smithi103.stdout:3/207: dread d3/f7 [0,4194304] 0 2024-09-17T01:07:04.975 INFO:tasks.workunit.client.0.smithi103.stdout:2/60: mkdir d6/da/dd/df 0 2024-09-17T01:07:04.975 INFO:tasks.workunit.client.0.smithi103.stdout:1/91: dwrite d2/d7/f19 [0,4194304] 0 2024-09-17T01:07:04.976 INFO:tasks.workunit.client.0.smithi103.stdout:4/216: stat d9/dc/df/f20 0 2024-09-17T01:07:04.976 INFO:tasks.workunit.client.0.smithi103.stdout:6/112: link d3/d16/l19 d3/d16/d21/l27 0 2024-09-17T01:07:04.978 INFO:tasks.workunit.client.0.smithi103.stdout:9/163: symlink d7/d2d/l3a 0 2024-09-17T01:07:04.979 INFO:tasks.workunit.client.0.smithi103.stdout:9/164: chown d7/dd 86 1 2024-09-17T01:07:04.979 INFO:tasks.workunit.client.0.smithi103.stdout:5/107: mknod d6/d28/c29 0 2024-09-17T01:07:04.981 INFO:tasks.workunit.client.0.smithi103.stdout:6/113: creat d3/f28 x:0 0 0 2024-09-17T01:07:04.982 INFO:tasks.workunit.client.0.smithi103.stdout:1/92: rmdir d2/d7 39 2024-09-17T01:07:04.984 INFO:tasks.workunit.client.0.smithi103.stdout:2/61: symlink d6/da/dd/l10 0 2024-09-17T01:07:04.985 INFO:tasks.workunit.client.0.smithi103.stdout:2/62: write d6/f8 [5061985,126267] 0 2024-09-17T01:07:04.986 INFO:tasks.workunit.client.0.smithi103.stdout:7/130: getdents d4/d11 0 2024-09-17T01:07:04.986 INFO:tasks.workunit.client.0.smithi103.stdout:2/63: fsync d6/da/fe 0 2024-09-17T01:07:04.989 INFO:tasks.workunit.client.0.smithi103.stdout:5/108: rmdir d6/d11 39 2024-09-17T01:07:04.991 INFO:tasks.workunit.client.1.smithi143.stdout:0/658: sync 2024-09-17T01:07:04.991 INFO:tasks.workunit.client.0.smithi103.stdout:3/208: symlink d3/d16/d1b/d36/l49 0 2024-09-17T01:07:04.992 INFO:tasks.workunit.client.0.smithi103.stdout:3/209: chown d3/f27 2 1 2024-09-17T01:07:04.993 INFO:tasks.workunit.client.0.smithi103.stdout:2/64: dwrite d6/f8 [4194304,4194304] 0 2024-09-17T01:07:04.993 INFO:tasks.workunit.client.1.smithi143.stdout:3/683: getdents d6/d1c/d33/d41/d42 0 2024-09-17T01:07:04.994 INFO:tasks.workunit.client.1.smithi143.stdout:1/722: mknod d0/d6/d43/d6a/d52/cef 0 2024-09-17T01:07:04.995 INFO:tasks.workunit.client.0.smithi103.stdout:6/114: creat d3/d25/f29 x:0 0 0 2024-09-17T01:07:04.995 INFO:tasks.workunit.client.0.smithi103.stdout:1/93: creat d2/de/f1b x:0 0 0 2024-09-17T01:07:04.995 INFO:tasks.workunit.client.1.smithi143.stdout:7/824: unlink d4/d1f/d4a/d66/db5/cdd 0 2024-09-17T01:07:04.996 INFO:tasks.workunit.client.1.smithi143.stdout:3/684: fdatasync d6/f73 0 2024-09-17T01:07:04.999 INFO:tasks.workunit.client.1.smithi143.stdout:3/685: dread - d6/d1c/d33/f5e zero size 2024-09-17T01:07:05.002 INFO:tasks.workunit.client.0.smithi103.stdout:7/131: rename d4/d10/f15 to d4/d11/d2b/f2f 0 2024-09-17T01:07:05.002 INFO:tasks.workunit.client.1.smithi143.stdout:5/644: dwrite d1/d46/df/f25 [0,4194304] 0 2024-09-17T01:07:05.004 INFO:tasks.workunit.client.1.smithi143.stdout:0/659: dread d3/d5/d8/d27/d31/d4c/f1d [0,4194304] 0 2024-09-17T01:07:05.005 INFO:tasks.workunit.client.1.smithi143.stdout:5/645: fsync d1/d46/df/d23/d4f/d82/fc2 0 2024-09-17T01:07:05.005 INFO:tasks.workunit.client.1.smithi143.stdout:0/660: stat d3/d5/d8/d27/d8c/lbd 0 2024-09-17T01:07:05.006 INFO:tasks.workunit.client.1.smithi143.stdout:3/686: dread d6/d1c/f66 [0,4194304] 0 2024-09-17T01:07:05.006 INFO:tasks.workunit.client.1.smithi143.stdout:5/646: readlink d1/d46/df/d53/ld1 0 2024-09-17T01:07:05.007 INFO:tasks.workunit.client.0.smithi103.stdout:5/109: readlink d6/d11/d13/l14 0 2024-09-17T01:07:05.008 INFO:tasks.workunit.client.1.smithi143.stdout:3/687: read d6/d1c/d33/d41/f11 [1365021,49614] 0 2024-09-17T01:07:05.009 INFO:tasks.workunit.client.0.smithi103.stdout:5/110: write d6/f1e [3648065,125322] 0 2024-09-17T01:07:05.010 INFO:tasks.workunit.client.1.smithi143.stdout:4/704: getdents da/d6d/d90 0 2024-09-17T01:07:05.012 INFO:tasks.workunit.client.1.smithi143.stdout:7/825: mkdir d4/d1f/d4a/d66/db5/df3/d106 0 2024-09-17T01:07:05.015 INFO:tasks.workunit.client.0.smithi103.stdout:8/126: getdents d0 0 2024-09-17T01:07:05.016 INFO:tasks.workunit.client.1.smithi143.stdout:7/826: chown d4/d1f/d4a/d9e/da2/l103 357831 1 2024-09-17T01:07:05.016 INFO:tasks.workunit.client.1.smithi143.stdout:0/661: dwrite d3/d88/d93/f98 [0,4194304] 0 2024-09-17T01:07:05.016 INFO:tasks.workunit.client.0.smithi103.stdout:6/115: creat d3/d17/f2a x:0 0 0 2024-09-17T01:07:05.017 INFO:tasks.workunit.client.1.smithi143.stdout:5/647: dwrite d1/d46/df/fdb [0,4194304] 0 2024-09-17T01:07:05.017 INFO:tasks.workunit.client.0.smithi103.stdout:6/116: write d3/d16/f1b [10894,56539] 0 2024-09-17T01:07:05.018 INFO:tasks.workunit.client.0.smithi103.stdout:9/165: creat d7/f3b x:0 0 0 2024-09-17T01:07:05.018 INFO:tasks.workunit.client.0.smithi103.stdout:6/117: chown d3/f9 187 1 2024-09-17T01:07:05.018 INFO:tasks.workunit.client.1.smithi143.stdout:6/611: creat d2/d17/d6e/d26/d46/fca x:0 0 0 2024-09-17T01:07:05.020 INFO:tasks.workunit.client.1.smithi143.stdout:7/827: dread - d4/d1f/d4a/d9e/da2/fff zero size 2024-09-17T01:07:05.020 INFO:tasks.workunit.client.1.smithi143.stdout:4/705: stat da/d68/f5d 0 2024-09-17T01:07:05.020 INFO:tasks.workunit.client.1.smithi143.stdout:5/648: stat d1/d46/df/le4 0 2024-09-17T01:07:05.021 INFO:tasks.workunit.client.1.smithi143.stdout:6/612: readlink d2/df/d20/d2c/d75/l9d 0 2024-09-17T01:07:05.021 INFO:tasks.workunit.client.1.smithi143.stdout:7/828: fdatasync d4/d16/f6d 0 2024-09-17T01:07:05.021 INFO:tasks.workunit.client.0.smithi103.stdout:4/217: getdents d9/dc 0 2024-09-17T01:07:05.022 INFO:tasks.workunit.client.1.smithi143.stdout:3/688: rmdir d6/d1c/d4b/dab 39 2024-09-17T01:07:05.022 INFO:tasks.workunit.client.0.smithi103.stdout:5/111: symlink d6/d28/l2a 0 2024-09-17T01:07:05.023 INFO:tasks.workunit.client.0.smithi103.stdout:4/218: read d9/dc/df/f2c [31598,87844] 0 2024-09-17T01:07:05.024 INFO:tasks.workunit.client.1.smithi143.stdout:0/662: fdatasync d3/d5/fc 0 2024-09-17T01:07:05.025 INFO:tasks.workunit.client.0.smithi103.stdout:2/65: getdents d6/da/dd/df 0 2024-09-17T01:07:05.026 INFO:tasks.workunit.client.0.smithi103.stdout:2/66: readlink d6/da/dd/l10 0 2024-09-17T01:07:05.027 INFO:tasks.workunit.client.1.smithi143.stdout:6/613: read d2/d17/d6e/d26/d46/f80 [3598248,62823] 0 2024-09-17T01:07:05.028 INFO:tasks.workunit.client.1.smithi143.stdout:3/689: fdatasync d6/f7 0 2024-09-17T01:07:05.029 INFO:tasks.workunit.client.0.smithi103.stdout:1/94: mkdir d2/d1c 0 2024-09-17T01:07:05.030 INFO:tasks.workunit.client.1.smithi143.stdout:6/614: write d2/d17/f25 [3076346,93807] 0 2024-09-17T01:07:05.032 INFO:tasks.workunit.client.1.smithi143.stdout:6/615: dread - d2/df/d20/d2c/d38/fb6 zero size 2024-09-17T01:07:05.032 INFO:tasks.workunit.client.1.smithi143.stdout:7/829: dwrite d4/f95 [0,4194304] 0 2024-09-17T01:07:05.032 INFO:tasks.workunit.client.1.smithi143.stdout:5/649: mknod d1/d46/df/d23/d4f/d82/cf8 0 2024-09-17T01:07:05.033 INFO:tasks.workunit.client.0.smithi103.stdout:7/132: mknod d4/c30 0 2024-09-17T01:07:05.035 INFO:tasks.workunit.client.1.smithi143.stdout:5/650: write d1/d46/df/d1f/de9/fdc [1565648,83164] 0 2024-09-17T01:07:05.036 INFO:tasks.workunit.client.0.smithi103.stdout:5/112: creat d6/d11/f2b x:0 0 0 2024-09-17T01:07:05.038 INFO:tasks.workunit.client.1.smithi143.stdout:5/651: write d1/d46/df/d23/d4f/d7d/d92/fdf [967979,84781] 0 2024-09-17T01:07:05.038 INFO:tasks.workunit.client.0.smithi103.stdout:4/219: unlink d9/d16/d23/d2b/l3b 0 2024-09-17T01:07:05.040 INFO:tasks.workunit.client.1.smithi143.stdout:5/652: write d1/d46/df/d1f/de9/fdc [1312021,92192] 0 2024-09-17T01:07:05.040 INFO:tasks.workunit.client.0.smithi103.stdout:2/67: write f0 [604899,64455] 0 2024-09-17T01:07:05.043 INFO:tasks.workunit.client.0.smithi103.stdout:3/210: write d3/f14 [2296622,120346] 0 2024-09-17T01:07:05.047 INFO:tasks.workunit.client.0.smithi103.stdout:7/133: mknod d4/d11/d2b/c31 0 2024-09-17T01:07:05.047 INFO:tasks.workunit.client.0.smithi103.stdout:6/118: write d3/f9 [3130182,42287] 0 2024-09-17T01:07:05.048 INFO:tasks.workunit.client.0.smithi103.stdout:7/134: write d4/fa [1574430,129157] 0 2024-09-17T01:07:05.050 INFO:tasks.workunit.client.1.smithi143.stdout:6/616: creat d2/df/d20/d2c/d75/daf/fcb x:0 0 0 2024-09-17T01:07:05.052 INFO:tasks.workunit.client.1.smithi143.stdout:5/653: creat d1/d46/df/d53/ff9 x:0 0 0 2024-09-17T01:07:05.053 INFO:tasks.workunit.client.0.smithi103.stdout:4/220: chown d9/d16/d23/d32/c40 4538255 1 2024-09-17T01:07:05.053 INFO:tasks.workunit.client.1.smithi143.stdout:7/830: mkdir d4/d1f/d4a/d66/db5/df3/d106/d107 0 2024-09-17T01:07:05.054 INFO:tasks.workunit.client.0.smithi103.stdout:8/127: creat d0/d6/f2b x:0 0 0 2024-09-17T01:07:05.055 INFO:tasks.workunit.client.1.smithi143.stdout:0/663: dwrite d3/d5/d8/d27/f4b [0,4194304] 0 2024-09-17T01:07:05.055 INFO:tasks.workunit.client.1.smithi143.stdout:7/831: fsync d4/d1f/d29/f71 0 2024-09-17T01:07:05.056 INFO:tasks.workunit.client.1.smithi143.stdout:3/690: creat d6/d1c/d4b/fd9 x:0 0 0 2024-09-17T01:07:05.057 INFO:tasks.workunit.client.0.smithi103.stdout:2/68: rename d6/da/cc to d6/c11 0 2024-09-17T01:07:05.059 INFO:tasks.workunit.client.0.smithi103.stdout:2/69: write d6/da/fe [115404,125483] 0 2024-09-17T01:07:05.060 INFO:tasks.workunit.client.1.smithi143.stdout:3/691: truncate d6/d1c/d33/d3f/d79/d7b/f9e 625388 0 2024-09-17T01:07:05.060 INFO:tasks.workunit.client.1.smithi143.stdout:0/664: chown d3/d68 30 1 2024-09-17T01:07:05.061 INFO:tasks.workunit.client.0.smithi103.stdout:8/128: dwrite d0/d6/dc/d12/f1f [0,4194304] 0 2024-09-17T01:07:05.061 INFO:tasks.workunit.client.1.smithi143.stdout:3/692: readlink d6/d1c/d33/d3f/d79/l88 0 2024-09-17T01:07:05.063 INFO:tasks.workunit.client.0.smithi103.stdout:9/166: link d7/dd/d11/d21/f33 d7/f3c 0 2024-09-17T01:07:05.064 INFO:tasks.workunit.client.0.smithi103.stdout:9/167: truncate d7/f18 1594620 0 2024-09-17T01:07:05.065 INFO:tasks.workunit.client.0.smithi103.stdout:9/168: read d7/dd/d11/f10 [3772990,49262] 0 2024-09-17T01:07:05.068 INFO:tasks.workunit.client.0.smithi103.stdout:7/135: mkdir d4/d10/d32 0 2024-09-17T01:07:05.068 INFO:tasks.workunit.client.0.smithi103.stdout:5/113: mkdir d6/d2c 0 2024-09-17T01:07:05.069 INFO:tasks.workunit.client.1.smithi143.stdout:0/665: creat d3/d5/d8/d10/db3/fd5 x:0 0 0 2024-09-17T01:07:05.070 INFO:tasks.workunit.client.0.smithi103.stdout:1/95: link d2/de/f14 d2/d7/f1d 0 2024-09-17T01:07:05.071 INFO:tasks.workunit.client.1.smithi143.stdout:0/666: fsync d3/d5/d8/d27/f1e 0 2024-09-17T01:07:05.073 INFO:tasks.workunit.client.1.smithi143.stdout:0/667: stat d3/d5/d35 0 2024-09-17T01:07:05.073 INFO:tasks.workunit.client.0.smithi103.stdout:3/211: creat d3/d44/f4a x:0 0 0 2024-09-17T01:07:05.076 INFO:tasks.workunit.client.1.smithi143.stdout:0/668: creat d3/d14/d32/fd6 x:0 0 0 2024-09-17T01:07:05.083 INFO:tasks.workunit.client.1.smithi143.stdout:7/832: write d4/d16/f1a [2672181,95808] 0 2024-09-17T01:07:05.083 INFO:tasks.workunit.client.0.smithi103.stdout:2/70: write f5 [1431768,54817] 0 2024-09-17T01:07:05.084 INFO:tasks.workunit.client.0.smithi103.stdout:7/136: symlink d4/l33 0 2024-09-17T01:07:05.084 INFO:tasks.workunit.client.1.smithi143.stdout:0/669: dwrite d3/d5/f41 [0,4194304] 0 2024-09-17T01:07:05.086 INFO:tasks.workunit.client.0.smithi103.stdout:1/96: creat d2/d1c/f1e x:0 0 0 2024-09-17T01:07:05.086 INFO:tasks.workunit.client.0.smithi103.stdout:3/212: mknod d3/d16/c4b 0 2024-09-17T01:07:05.087 INFO:tasks.workunit.client.1.smithi143.stdout:5/654: dread d1/f14 [0,4194304] 0 2024-09-17T01:07:05.088 INFO:tasks.workunit.client.0.smithi103.stdout:1/97: read d2/d7/f19 [2997857,89710] 0 2024-09-17T01:07:05.088 INFO:tasks.workunit.client.0.smithi103.stdout:3/213: write d3/f8 [2760075,120674] 0 2024-09-17T01:07:05.089 INFO:tasks.workunit.client.1.smithi143.stdout:5/655: chown d1/d46/df/d53/c8a 519 1 2024-09-17T01:07:05.089 INFO:tasks.workunit.client.0.smithi103.stdout:8/129: rename d0/f28 to d0/d6/dc/f2c 0 2024-09-17T01:07:05.090 INFO:tasks.workunit.client.0.smithi103.stdout:2/71: dread d6/fb [0,4194304] 0 2024-09-17T01:07:05.091 INFO:tasks.workunit.client.1.smithi143.stdout:0/670: symlink d3/d5/d8/d27/d31/d48/ld7 0 2024-09-17T01:07:05.091 INFO:tasks.workunit.client.1.smithi143.stdout:6/617: dread d2/d17/d6e/f3e [4194304,4194304] 0 2024-09-17T01:07:05.092 INFO:tasks.workunit.client.0.smithi103.stdout:8/130: dread - d0/d6/f2b zero size 2024-09-17T01:07:05.092 INFO:tasks.workunit.client.0.smithi103.stdout:1/98: truncate d2/f6 5186804 0 2024-09-17T01:07:05.093 INFO:tasks.workunit.client.0.smithi103.stdout:9/169: rmdir d7/dd/d11/d21 39 2024-09-17T01:07:05.095 INFO:tasks.workunit.client.1.smithi143.stdout:3/693: dread d6/d1c/d33/d3f/d5c/f91 [0,4194304] 0 2024-09-17T01:07:05.095 INFO:tasks.workunit.client.1.smithi143.stdout:7/833: rename d4/d26/dcc/fd2 to d4/d1f/d29/d65/d5d/db1/dc6/dfa/f108 0 2024-09-17T01:07:05.096 INFO:tasks.workunit.client.1.smithi143.stdout:7/834: write d4/d26/dcc/fe8 [674825,24095] 0 2024-09-17T01:07:05.098 INFO:tasks.workunit.client.0.smithi103.stdout:4/221: dread d9/f21 [0,4194304] 0 2024-09-17T01:07:05.100 INFO:tasks.workunit.client.0.smithi103.stdout:7/137: dread d4/fd [0,4194304] 0 2024-09-17T01:07:05.101 INFO:tasks.workunit.client.0.smithi103.stdout:7/138: write d4/f5 [486126,66456] 0 2024-09-17T01:07:05.102 INFO:tasks.workunit.client.1.smithi143.stdout:0/671: chown d3/d5/d8/d27/d31/d4c/c87 194315 1 2024-09-17T01:07:05.104 INFO:tasks.workunit.client.0.smithi103.stdout:2/72: stat d6/f7 0 2024-09-17T01:07:05.104 INFO:tasks.workunit.client.1.smithi143.stdout:3/694: symlink d6/d1c/d33/d3f/d5c/lda 0 2024-09-17T01:07:05.111 INFO:tasks.workunit.client.0.smithi103.stdout:1/99: mkdir d2/de/d1f 0 2024-09-17T01:07:05.112 INFO:tasks.workunit.client.0.smithi103.stdout:5/114: dwrite d6/f9 [0,4194304] 0 2024-09-17T01:07:05.112 INFO:tasks.workunit.client.0.smithi103.stdout:1/100: dread - d2/d1c/f1e zero size 2024-09-17T01:07:05.112 INFO:tasks.workunit.client.0.smithi103.stdout:8/131: mkdir d0/d6/dc/d12/d2d 0 2024-09-17T01:07:05.114 INFO:tasks.workunit.client.1.smithi143.stdout:3/695: rmdir d6/d1c/d33 39 2024-09-17T01:07:05.119 INFO:tasks.workunit.client.0.smithi103.stdout:4/222: symlink d9/d16/d23/l43 0 2024-09-17T01:07:05.119 INFO:tasks.workunit.client.1.smithi143.stdout:7/835: link d4/d1f/d4a/d66/d86/fb8 d4/d1f/d4a/d66/d86/f109 0 2024-09-17T01:07:05.120 INFO:tasks.workunit.client.0.smithi103.stdout:4/223: fsync d9/dc/f18 0 2024-09-17T01:07:05.123 INFO:tasks.workunit.client.0.smithi103.stdout:9/170: dread d7/dd/d11/fb [0,4194304] 0 2024-09-17T01:07:05.124 INFO:tasks.workunit.client.1.smithi143.stdout:0/672: creat d3/d5/d8/d27/d31/d4c/d65/fd8 x:0 0 0 2024-09-17T01:07:05.124 INFO:tasks.workunit.client.0.smithi103.stdout:9/171: readlink d7/dd/d11/d20/l30 0 2024-09-17T01:07:05.125 INFO:tasks.workunit.client.0.smithi103.stdout:2/73: rmdir d6/da 39 2024-09-17T01:07:05.127 INFO:tasks.workunit.client.1.smithi143.stdout:2/643: sync 2024-09-17T01:07:05.129 INFO:tasks.workunit.client.1.smithi143.stdout:5/656: getdents d1/d46/df/d1f/d9f 0 2024-09-17T01:07:05.129 INFO:tasks.workunit.client.1.smithi143.stdout:3/696: read d6/d1c/d4d/da4/fd7 [89472,40699] 0 2024-09-17T01:07:05.131 INFO:tasks.workunit.client.1.smithi143.stdout:6/618: write d2/f6d [1573550,122436] 0 2024-09-17T01:07:05.131 INFO:tasks.workunit.client.1.smithi143.stdout:7/836: mknod d4/d1f/d4a/d66/d86/c10a 0 2024-09-17T01:07:05.134 INFO:tasks.workunit.client.1.smithi143.stdout:0/673: write d3/d5/d35/da8/dcd/f76 [2754580,42654] 0 2024-09-17T01:07:05.135 INFO:tasks.workunit.client.0.smithi103.stdout:1/101: mkdir d2/d1c/d20 0 2024-09-17T01:07:05.139 INFO:tasks.workunit.client.1.smithi143.stdout:5/657: creat d1/d46/d6e/da0/ffa x:0 0 0 2024-09-17T01:07:05.142 INFO:tasks.workunit.client.1.smithi143.stdout:3/697: dread - d6/d1c/d33/d3f/fb4 zero size 2024-09-17T01:07:05.146 INFO:tasks.workunit.client.1.smithi143.stdout:6/619: mkdir d2/df/d40/dcc 0 2024-09-17T01:07:05.146 INFO:tasks.workunit.client.1.smithi143.stdout:7/837: creat d4/d1f/d29/d65/d5d/db1/dc6/dfa/f10b x:0 0 0 2024-09-17T01:07:05.148 INFO:tasks.workunit.client.1.smithi143.stdout:0/674: creat d3/d5/d8/d27/d31/d48/fd9 x:0 0 0 2024-09-17T01:07:05.150 INFO:tasks.workunit.client.1.smithi143.stdout:2/644: symlink d0/dcf/ld1 0 2024-09-17T01:07:05.150 INFO:tasks.workunit.client.0.smithi103.stdout:3/214: link d3/d16/d1b/d2c/l3a d3/d16/d1b/d3c/l4c 0 2024-09-17T01:07:05.151 INFO:tasks.workunit.client.1.smithi143.stdout:2/645: dread - d0/d10/d58/d5a/d5b/d4c/fbd zero size 2024-09-17T01:07:05.152 INFO:tasks.workunit.client.1.smithi143.stdout:5/658: chown d1/d46/df/d1f/d7a/l89 13 1 2024-09-17T01:07:05.153 INFO:tasks.workunit.client.0.smithi103.stdout:5/115: mknod d6/c2d 0 2024-09-17T01:07:05.153 INFO:tasks.workunit.client.0.smithi103.stdout:3/215: read - d3/d16/d1b/d2c/f42 zero size 2024-09-17T01:07:05.153 INFO:tasks.workunit.client.0.smithi103.stdout:9/172: dread d7/fc [0,4194304] 0 2024-09-17T01:07:05.155 INFO:tasks.workunit.client.0.smithi103.stdout:9/173: write d7/dd/d11/fb [1005207,36930] 0 2024-09-17T01:07:05.155 INFO:tasks.workunit.client.0.smithi103.stdout:8/132: rename d0/d6/dc/d12/c1b to d0/d6/dc/d12/d2d/c2e 0 2024-09-17T01:07:05.156 INFO:tasks.workunit.client.1.smithi143.stdout:6/620: creat d2/d30/d45/d70/fcd x:0 0 0 2024-09-17T01:07:05.159 INFO:tasks.workunit.client.1.smithi143.stdout:7/838: rename d4/f11 to d4/d16/dbd/f10c 0 2024-09-17T01:07:05.160 INFO:tasks.workunit.client.1.smithi143.stdout:7/839: fdatasync d4/d1f/d4a/de4/d78/f91 0 2024-09-17T01:07:05.160 INFO:tasks.workunit.client.1.smithi143.stdout:0/675: chown d3/d5/d8/d21/l6e 0 1 2024-09-17T01:07:05.161 INFO:tasks.workunit.client.1.smithi143.stdout:7/840: readlink d4/d1f/d4a/l8c 0 2024-09-17T01:07:05.163 INFO:tasks.workunit.client.0.smithi103.stdout:7/139: truncate d4/f5 619799 0 2024-09-17T01:07:05.164 INFO:tasks.workunit.client.1.smithi143.stdout:5/659: symlink d1/d5e/lfb 0 2024-09-17T01:07:05.165 INFO:tasks.workunit.client.1.smithi143.stdout:5/660: fdatasync d1/d46/df/d53/d74/d9a/d9c/fc6 0 2024-09-17T01:07:05.165 INFO:tasks.workunit.client.0.smithi103.stdout:3/216: mknod d3/d16/d1b/d3c/c4d 0 2024-09-17T01:07:05.167 INFO:tasks.workunit.client.1.smithi143.stdout:3/698: write d6/d1c/d33/d41/d2e/d86/fcb [983674,65760] 0 2024-09-17T01:07:05.171 INFO:tasks.workunit.client.0.smithi103.stdout:4/224: truncate d9/d10/f28 3140291 0 2024-09-17T01:07:05.172 INFO:tasks.workunit.client.1.smithi143.stdout:0/676: mkdir d3/d5/d8/d21/d2e/dda 0 2024-09-17T01:07:05.173 INFO:tasks.workunit.client.1.smithi143.stdout:0/677: chown d3/d5/d35 2121538 1 2024-09-17T01:07:05.173 INFO:tasks.workunit.client.0.smithi103.stdout:3/217: dwrite d3/d16/d1b/d2c/f41 [0,4194304] 0 2024-09-17T01:07:05.173 INFO:tasks.workunit.client.0.smithi103.stdout:8/133: symlink d0/d6/dc/d12/d2d/l2f 0 2024-09-17T01:07:05.175 INFO:tasks.workunit.client.1.smithi143.stdout:7/841: creat d4/d1f/d4a/ddb/f10d x:0 0 0 2024-09-17T01:07:05.176 INFO:tasks.workunit.client.1.smithi143.stdout:7/842: readlink d4/d1f/d4a/l8c 0 2024-09-17T01:07:05.178 INFO:tasks.workunit.client.0.smithi103.stdout:2/74: creat d6/f12 x:0 0 0 2024-09-17T01:07:05.178 INFO:tasks.workunit.client.0.smithi103.stdout:3/218: dread d3/f1d [0,4194304] 0 2024-09-17T01:07:05.178 INFO:tasks.workunit.client.0.smithi103.stdout:9/174: dread d7/dd/d11/f1f [0,4194304] 0 2024-09-17T01:07:05.179 INFO:tasks.workunit.client.0.smithi103.stdout:3/219: readlink d3/l18 0 2024-09-17T01:07:05.179 INFO:tasks.workunit.client.1.smithi143.stdout:2/646: dwrite d0/d2/d21/f62 [0,4194304] 0 2024-09-17T01:07:05.180 INFO:tasks.workunit.client.0.smithi103.stdout:3/220: fdatasync d3/d16/d1b/f46 0 2024-09-17T01:07:05.181 INFO:tasks.workunit.client.1.smithi143.stdout:5/661: symlink d1/d46/d6e/db7/lfc 0 2024-09-17T01:07:05.185 INFO:tasks.workunit.client.1.smithi143.stdout:0/678: rmdir d3/d5/d8/d27/d8c 39 2024-09-17T01:07:05.185 INFO:tasks.workunit.client.0.smithi103.stdout:4/225: fdatasync d9/f21 0 2024-09-17T01:07:05.188 INFO:tasks.workunit.client.1.smithi143.stdout:6/621: dwrite d2/d17/d6e/d26/d46/f4b [4194304,4194304] 0 2024-09-17T01:07:05.190 INFO:tasks.workunit.client.1.smithi143.stdout:6/622: fdatasync d2/df/d20/d2c/d75/daf/fcb 0 2024-09-17T01:07:05.192 INFO:tasks.workunit.client.1.smithi143.stdout:7/843: rename d4/c4f to d4/d1f/d29/d65/d5d/db1/dc6/c10e 0 2024-09-17T01:07:05.194 INFO:tasks.workunit.client.0.smithi103.stdout:9/175: fdatasync d7/f2a 0 2024-09-17T01:07:05.196 INFO:tasks.workunit.client.1.smithi143.stdout:3/699: truncate d6/d1c/d33/d41/d2e/d30/f32 5021039 0 2024-09-17T01:07:05.198 INFO:tasks.workunit.client.1.smithi143.stdout:3/700: stat d6/d1c/d4d/da4 0 2024-09-17T01:07:05.199 INFO:tasks.workunit.client.0.smithi103.stdout:1/102: rename d2/d7/la to d2/l21 0 2024-09-17T01:07:05.200 INFO:tasks.workunit.client.1.smithi143.stdout:6/623: dwrite d2/d17/d3a/fc2 [0,4194304] 0 2024-09-17T01:07:05.200 INFO:tasks.workunit.client.0.smithi103.stdout:5/116: dwrite f0 [0,4194304] 0 2024-09-17T01:07:05.201 INFO:tasks.workunit.client.1.smithi143.stdout:3/701: dread - d6/d1c/d33/d41/d2e/d86/d89/fa7 zero size 2024-09-17T01:07:05.202 INFO:tasks.workunit.client.1.smithi143.stdout:7/844: dread d4/d16/f6d [0,4194304] 0 2024-09-17T01:07:05.202 INFO:tasks.workunit.client.1.smithi143.stdout:9/680: sync 2024-09-17T01:07:05.202 INFO:tasks.workunit.client.1.smithi143.stdout:8/716: sync 2024-09-17T01:07:05.204 INFO:tasks.workunit.client.0.smithi103.stdout:2/75: mknod d6/c13 0 2024-09-17T01:07:05.204 INFO:tasks.workunit.client.0.smithi103.stdout:2/76: chown f0 15721 1 2024-09-17T01:07:05.214 INFO:tasks.workunit.client.1.smithi143.stdout:8/717: symlink d9/d12/d13/l101 0 2024-09-17T01:07:05.215 INFO:tasks.workunit.client.0.smithi103.stdout:8/134: write d0/d6/f1d [1460584,50917] 0 2024-09-17T01:07:05.215 INFO:tasks.workunit.client.1.smithi143.stdout:3/702: creat d6/d1c/d33/d3f/d5c/da1/fdb x:0 0 0 2024-09-17T01:07:05.220 INFO:tasks.workunit.client.0.smithi103.stdout:1/103: unlink d2/d7/ld 0 2024-09-17T01:07:05.222 INFO:tasks.workunit.client.1.smithi143.stdout:2/647: getdents d0/d10/d58/d5a/d5b/d4c/d71/d9d 0 2024-09-17T01:07:05.222 INFO:tasks.workunit.client.0.smithi103.stdout:3/221: creat d3/d16/d1b/f4e x:0 0 0 2024-09-17T01:07:05.223 INFO:tasks.workunit.client.0.smithi103.stdout:4/226: truncate d9/f21 371121 0 2024-09-17T01:07:05.225 INFO:tasks.workunit.client.0.smithi103.stdout:5/117: symlink d6/d2c/l2e 0 2024-09-17T01:07:05.227 INFO:tasks.workunit.client.1.smithi143.stdout:5/662: truncate d1/d46/df/f1b 2823717 0 2024-09-17T01:07:05.227 INFO:tasks.workunit.client.1.smithi143.stdout:3/703: write d6/d1c/d4b/d57/f81 [590555,2572] 0 2024-09-17T01:07:05.227 INFO:tasks.workunit.client.0.smithi103.stdout:8/135: write d0/d6/dc/f2c [43377,107655] 0 2024-09-17T01:07:05.228 INFO:tasks.workunit.client.1.smithi143.stdout:0/679: dwrite d3/d5/f52 [0,4194304] 0 2024-09-17T01:07:05.228 INFO:tasks.workunit.client.0.smithi103.stdout:8/136: fdatasync d0/d6/f2b 0 2024-09-17T01:07:05.230 INFO:tasks.workunit.client.0.smithi103.stdout:2/77: rename d6/da/fe to d6/da/f14 0 2024-09-17T01:07:05.231 INFO:tasks.workunit.client.1.smithi143.stdout:7/845: mkdir d4/d1f/d4a/dc1/d10f 0 2024-09-17T01:07:05.231 INFO:tasks.workunit.client.1.smithi143.stdout:9/681: dwrite d3/d39/d42/fc4 [0,4194304] 0 2024-09-17T01:07:05.231 INFO:tasks.workunit.client.1.smithi143.stdout:6/624: write d2/d17/d6e/f3e [996229,80469] 0 2024-09-17T01:07:05.235 INFO:tasks.workunit.client.1.smithi143.stdout:2/648: truncate d0/d2/d21/d22/f52 862819 0 2024-09-17T01:07:05.236 INFO:tasks.workunit.client.0.smithi103.stdout:1/104: write d2/de/f11 [4963553,49388] 0 2024-09-17T01:07:05.236 INFO:tasks.workunit.client.0.smithi103.stdout:1/105: chown d2/f8 4800 1 2024-09-17T01:07:05.237 INFO:tasks.workunit.client.0.smithi103.stdout:3/222: truncate d3/d16/f2b 1065874 0 2024-09-17T01:07:05.238 INFO:tasks.workunit.client.0.smithi103.stdout:4/227: fdatasync d9/d2d/f39 0 2024-09-17T01:07:05.244 INFO:tasks.workunit.client.0.smithi103.stdout:3/223: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:07:05.247 INFO:tasks.workunit.client.1.smithi143.stdout:1/723: sync 2024-09-17T01:07:05.247 INFO:tasks.workunit.client.1.smithi143.stdout:4/706: sync 2024-09-17T01:07:05.248 INFO:tasks.workunit.client.1.smithi143.stdout:0/680: mkdir d3/d68/d8f/ddb 0 2024-09-17T01:07:05.249 INFO:tasks.workunit.client.0.smithi103.stdout:2/78: rmdir d6/da 39 2024-09-17T01:07:05.249 INFO:tasks.workunit.client.1.smithi143.stdout:5/663: dread d1/d46/df/d53/d74/faf [0,4194304] 0 2024-09-17T01:07:05.250 INFO:tasks.workunit.client.1.smithi143.stdout:4/707: chown da/d3a/d40/d84 28306896 1 2024-09-17T01:07:05.251 INFO:tasks.workunit.client.0.smithi103.stdout:9/176: link d7/d2d/l32 d7/l3d 0 2024-09-17T01:07:05.251 INFO:tasks.workunit.client.1.smithi143.stdout:0/681: chown d3/d5/d35/da8/dcd/f83 22640109 1 2024-09-17T01:07:05.251 INFO:tasks.workunit.client.1.smithi143.stdout:1/724: chown d0/d6/d43/d6a/df/d6e/d18/f36 0 1 2024-09-17T01:07:05.252 INFO:tasks.workunit.client.0.smithi103.stdout:9/177: write d7/f19 [378930,74163] 0 2024-09-17T01:07:05.252 INFO:tasks.workunit.client.1.smithi143.stdout:4/708: write da/d3a/d40/f39 [2600551,68840] 0 2024-09-17T01:07:05.253 INFO:tasks.workunit.client.1.smithi143.stdout:5/664: readlink d1/d46/df/d1f/d7a/l89 0 2024-09-17T01:07:05.253 INFO:tasks.workunit.client.0.smithi103.stdout:9/178: chown d7/dd/c14 7625 1 2024-09-17T01:07:05.254 INFO:tasks.workunit.client.1.smithi143.stdout:5/665: truncate d1/d96/ff5 818495 0 2024-09-17T01:07:05.255 INFO:tasks.workunit.client.0.smithi103.stdout:1/106: symlink d2/d7/l22 0 2024-09-17T01:07:05.255 INFO:tasks.workunit.client.0.smithi103.stdout:9/179: write d7/dd/f38 [64046,40381] 0 2024-09-17T01:07:05.255 INFO:tasks.workunit.client.0.smithi103.stdout:9/180: fsync f5 0 2024-09-17T01:07:05.258 INFO:tasks.workunit.client.1.smithi143.stdout:8/718: truncate d9/d2b/f78 1128377 0 2024-09-17T01:07:05.259 INFO:tasks.workunit.client.0.smithi103.stdout:5/118: link d6/f1b d6/d11/f2f 0 2024-09-17T01:07:05.260 INFO:tasks.workunit.client.1.smithi143.stdout:4/709: dwrite da/d3a/d40/d84/db6/fc1 [0,4194304] 0 2024-09-17T01:07:05.261 INFO:tasks.workunit.client.1.smithi143.stdout:4/710: readlink da/d3a/d40/l7d 0 2024-09-17T01:07:05.267 INFO:tasks.workunit.client.0.smithi103.stdout:1/107: rename d2/d7/l22 to d2/d7/l23 0 2024-09-17T01:07:05.269 INFO:tasks.workunit.client.0.smithi103.stdout:4/228: unlink d9/d10/f28 0 2024-09-17T01:07:05.271 INFO:tasks.workunit.client.0.smithi103.stdout:4/229: write d9/d16/f37 [582778,81797] 0 2024-09-17T01:07:05.271 INFO:tasks.workunit.client.0.smithi103.stdout:5/119: mkdir d6/d11/d30 0 2024-09-17T01:07:05.276 INFO:tasks.workunit.client.0.smithi103.stdout:8/137: rename d0/d6/dc/d12 to d0/d6/dc/d30 0 2024-09-17T01:07:05.276 INFO:tasks.workunit.client.0.smithi103.stdout:8/138: chown d0/d6/dc/d30/d25/f27 6587 1 2024-09-17T01:07:05.282 INFO:tasks.workunit.client.0.smithi103.stdout:9/181: rename d7/dd/d11/d21/f24 to d7/dd/d11/d21/f3e 0 2024-09-17T01:07:05.284 INFO:tasks.workunit.client.0.smithi103.stdout:8/139: dwrite d0/d6/dc/f2c [0,4194304] 0 2024-09-17T01:07:05.290 INFO:tasks.workunit.client.0.smithi103.stdout:5/120: creat d6/d11/d13/f31 x:0 0 0 2024-09-17T01:07:05.294 INFO:tasks.workunit.client.0.smithi103.stdout:5/121: dread d6/f9 [0,4194304] 0 2024-09-17T01:07:05.298 INFO:tasks.workunit.client.0.smithi103.stdout:9/182: fdatasync f0 0 2024-09-17T01:07:05.301 INFO:tasks.workunit.client.0.smithi103.stdout:9/183: write d7/dd/d11/fb [2455698,90993] 0 2024-09-17T01:07:05.301 INFO:tasks.workunit.client.0.smithi103.stdout:1/108: symlink d2/de/d1f/l24 0 2024-09-17T01:07:05.302 INFO:tasks.workunit.client.0.smithi103.stdout:2/79: write f4 [1971780,124209] 0 2024-09-17T01:07:05.308 INFO:tasks.workunit.client.0.smithi103.stdout:3/224: getdents d3/d16/d1b/d2c 0 2024-09-17T01:07:05.309 INFO:tasks.workunit.client.0.smithi103.stdout:5/122: mkdir d6/d2c/d32 0 2024-09-17T01:07:05.310 INFO:tasks.workunit.client.0.smithi103.stdout:5/123: write d6/d11/f2b [70221,69165] 0 2024-09-17T01:07:05.312 INFO:tasks.workunit.client.0.smithi103.stdout:5/124: truncate d6/db/f27 769339 0 2024-09-17T01:07:05.314 INFO:tasks.workunit.client.0.smithi103.stdout:8/140: unlink d0/d6/dc/d30/c17 0 2024-09-17T01:07:05.317 INFO:tasks.workunit.client.0.smithi103.stdout:1/109: creat d2/d16/f25 x:0 0 0 2024-09-17T01:07:05.318 INFO:tasks.workunit.client.0.smithi103.stdout:1/110: dread - d2/de/f1b zero size 2024-09-17T01:07:05.319 INFO:tasks.workunit.client.0.smithi103.stdout:9/184: rmdir d7/dd/d11/d21 39 2024-09-17T01:07:05.323 INFO:tasks.workunit.client.0.smithi103.stdout:3/225: rmdir d3/d16 39 2024-09-17T01:07:05.326 INFO:tasks.workunit.client.0.smithi103.stdout:8/141: symlink d0/d6/dc/d30/d25/l31 0 2024-09-17T01:07:05.327 INFO:tasks.workunit.client.0.smithi103.stdout:8/142: readlink d0/d6/dc/d30/l24 0 2024-09-17T01:07:05.329 INFO:tasks.workunit.client.0.smithi103.stdout:2/80: creat d6/da/f15 x:0 0 0 2024-09-17T01:07:05.329 INFO:tasks.workunit.client.0.smithi103.stdout:8/143: write d0/d6/dc/d30/f1f [1810702,121903] 0 2024-09-17T01:07:05.332 INFO:tasks.workunit.client.0.smithi103.stdout:8/144: chown d0/d6/dc/cd 927487 1 2024-09-17T01:07:05.334 INFO:tasks.workunit.client.0.smithi103.stdout:1/111: dread d2/ff [0,4194304] 0 2024-09-17T01:07:05.334 INFO:tasks.workunit.client.0.smithi103.stdout:4/230: getdents d9/d10 0 2024-09-17T01:07:05.336 INFO:tasks.workunit.client.0.smithi103.stdout:1/112: chown d2/c17 8816 1 2024-09-17T01:07:05.338 INFO:tasks.workunit.client.0.smithi103.stdout:5/125: creat d6/d2c/d32/f33 x:0 0 0 2024-09-17T01:07:05.339 INFO:tasks.workunit.client.1.smithi143.stdout:3/704: rename d6/d1c/d4b/dab to d6/d1c/d33/d41/d2e/d86/ddc 0 2024-09-17T01:07:05.340 INFO:tasks.workunit.client.0.smithi103.stdout:2/81: dwrite d6/f8 [0,4194304] 0 2024-09-17T01:07:05.342 INFO:tasks.workunit.client.1.smithi143.stdout:0/682: creat d3/d68/fdc x:0 0 0 2024-09-17T01:07:05.344 INFO:tasks.workunit.client.0.smithi103.stdout:9/185: rename d7/dd/d11/d20/f35 to d7/dd/d11/d21/f3f 0 2024-09-17T01:07:05.345 INFO:tasks.workunit.client.0.smithi103.stdout:8/145: dread d0/d6/dc/d30/d25/f27 [0,4194304] 0 2024-09-17T01:07:05.347 INFO:tasks.workunit.client.1.smithi143.stdout:2/649: mkdir d0/d10/d58/d5a/d5b/d4c/d71/dd2 0 2024-09-17T01:07:05.347 INFO:tasks.workunit.client.0.smithi103.stdout:9/186: dread d7/f3c [0,4194304] 0 2024-09-17T01:07:05.348 INFO:tasks.workunit.client.0.smithi103.stdout:3/226: creat d3/d16/d1b/d3c/f4f x:0 0 0 2024-09-17T01:07:05.349 INFO:tasks.workunit.client.0.smithi103.stdout:9/187: chown d7/dd/d11/d21/l2e 721385 1 2024-09-17T01:07:05.349 INFO:tasks.workunit.client.0.smithi103.stdout:1/113: fdatasync d2/d7/f19 0 2024-09-17T01:07:05.350 INFO:tasks.workunit.client.1.smithi143.stdout:5/666: mkdir d1/d46/df/d23/d4f/d7d/d92/dfd 0 2024-09-17T01:07:05.351 INFO:tasks.workunit.client.1.smithi143.stdout:5/667: write d1/d46/df/d23/d4f/d82/fc2 [895615,32890] 0 2024-09-17T01:07:05.356 INFO:tasks.workunit.client.0.smithi103.stdout:2/82: rename f0 to d6/da/dd/df/f16 0 2024-09-17T01:07:05.359 INFO:tasks.workunit.client.0.smithi103.stdout:8/146: mkdir d0/d6/dc/d30/d2d/d32 0 2024-09-17T01:07:05.363 INFO:tasks.workunit.client.1.smithi143.stdout:7/846: rename d4/d1f/f28 to d4/d1f/d4a/de4/d78/f110 0 2024-09-17T01:07:05.364 INFO:tasks.workunit.client.0.smithi103.stdout:2/83: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:07:05.364 INFO:tasks.workunit.client.0.smithi103.stdout:2/84: fsync d6/da/f15 0 2024-09-17T01:07:05.368 INFO:tasks.workunit.client.1.smithi143.stdout:0/683: truncate d3/d5/d6b/f90 736671 0 2024-09-17T01:07:05.371 INFO:tasks.workunit.client.1.smithi143.stdout:1/725: dread d0/dc/d74/f8a [0,4194304] 0 2024-09-17T01:07:05.374 INFO:tasks.workunit.client.0.smithi103.stdout:1/114: dwrite d2/f8 [0,4194304] 0 2024-09-17T01:07:05.379 INFO:tasks.workunit.client.0.smithi103.stdout:8/147: unlink d0/d6/f2b 0 2024-09-17T01:07:05.380 INFO:tasks.workunit.client.0.smithi103.stdout:8/148: chown d0/d6/dc/d30/d2d/d32 4464 1 2024-09-17T01:07:05.381 INFO:tasks.workunit.client.0.smithi103.stdout:8/149: truncate d0/d6/f1d 1518803 0 2024-09-17T01:07:05.383 INFO:tasks.workunit.client.1.smithi143.stdout:9/682: rename d3/d39/d6a/d26/f5f to d3/d39/d6a/d9/d74/fe6 0 2024-09-17T01:07:05.384 INFO:tasks.workunit.client.0.smithi103.stdout:3/227: truncate d3/f7 1033765 0 2024-09-17T01:07:05.386 INFO:tasks.workunit.client.1.smithi143.stdout:6/625: getdents d2/df 0 2024-09-17T01:07:05.387 INFO:tasks.workunit.client.1.smithi143.stdout:7/847: truncate d4/d1f/d4a/d66/f75 1248529 0 2024-09-17T01:07:05.388 INFO:tasks.workunit.client.1.smithi143.stdout:5/668: dwrite d1/d46/df/d53/d74/fa7 [0,4194304] 0 2024-09-17T01:07:05.388 INFO:tasks.workunit.client.1.smithi143.stdout:6/626: write d2/d17/d6e/d26/d46/d65/f7f [4029541,39688] 0 2024-09-17T01:07:05.389 INFO:tasks.workunit.client.0.smithi103.stdout:5/126: creat d6/db/f34 x:0 0 0 2024-09-17T01:07:05.392 INFO:tasks.workunit.client.0.smithi103.stdout:4/231: getdents d9/d16/d38 0 2024-09-17T01:07:05.393 INFO:tasks.workunit.client.0.smithi103.stdout:1/115: chown d2/l21 16969457 1 2024-09-17T01:07:05.394 INFO:tasks.workunit.client.1.smithi143.stdout:2/650: mknod d0/d10/d58/d5a/d5b/d4c/d71/cd3 0 2024-09-17T01:07:05.398 INFO:tasks.workunit.client.0.smithi103.stdout:8/150: symlink d0/d6/dc/d30/d25/l33 0 2024-09-17T01:07:05.398 INFO:tasks.workunit.client.1.smithi143.stdout:3/705: truncate d6/d1c/d33/d41/f1a 2303343 0 2024-09-17T01:07:05.400 INFO:tasks.workunit.client.1.smithi143.stdout:8/719: link d9/d23/db4/d55/d57/d9d/lcb d9/d23/d32/l102 0 2024-09-17T01:07:05.402 INFO:tasks.workunit.client.0.smithi103.stdout:2/85: dwrite d6/da/dd/df/f16 [0,4194304] 0 2024-09-17T01:07:05.402 INFO:tasks.workunit.client.0.smithi103.stdout:8/151: fdatasync d0/d6/dc/f2c 0 2024-09-17T01:07:05.404 INFO:tasks.workunit.client.0.smithi103.stdout:5/127: dwrite d6/db/f27 [0,4194304] 0 2024-09-17T01:07:05.404 INFO:tasks.workunit.client.0.smithi103.stdout:1/116: truncate d2/f1a 689960 0 2024-09-17T01:07:05.404 INFO:tasks.workunit.client.0.smithi103.stdout:3/228: dread d3/d16/f1a [0,4194304] 0 2024-09-17T01:07:05.406 INFO:tasks.workunit.client.1.smithi143.stdout:0/684: dwrite d3/d5/d8/d27/f6a [0,4194304] 0 2024-09-17T01:07:05.407 INFO:tasks.workunit.client.0.smithi103.stdout:4/232: fdatasync d9/d16/d23/d2b/f3c 0 2024-09-17T01:07:05.410 INFO:tasks.workunit.client.0.smithi103.stdout:4/233: read d9/f3a [16383,70133] 0 2024-09-17T01:07:05.419 INFO:tasks.workunit.client.0.smithi103.stdout:1/117: dwrite d2/d7/f19 [0,4194304] 0 2024-09-17T01:07:05.419 INFO:tasks.workunit.client.0.smithi103.stdout:9/188: getdents d7 0 2024-09-17T01:07:05.419 INFO:tasks.workunit.client.0.smithi103.stdout:9/189: chown d7/d2d 982114 1 2024-09-17T01:07:05.420 INFO:tasks.workunit.client.1.smithi143.stdout:5/669: creat d1/d46/d9b/ffe x:0 0 0 2024-09-17T01:07:05.421 INFO:tasks.workunit.client.1.smithi143.stdout:6/627: rename d2/d17/d3a/l89 to d2/df/d40/d41/lce 0 2024-09-17T01:07:05.421 INFO:tasks.workunit.client.0.smithi103.stdout:9/190: dread d7/dd/d11/d21/f33 [0,4194304] 0 2024-09-17T01:07:05.421 INFO:tasks.workunit.client.0.smithi103.stdout:2/86: rmdir d6/da/dd/df 39 2024-09-17T01:07:05.423 INFO:tasks.workunit.client.0.smithi103.stdout:5/128: write f4 [1922864,76664] 0 2024-09-17T01:07:05.425 INFO:tasks.workunit.client.1.smithi143.stdout:1/726: mkdir d0/da1/df0 0 2024-09-17T01:07:05.425 INFO:tasks.workunit.client.0.smithi103.stdout:5/129: chown d6/f1b 20519679 1 2024-09-17T01:07:05.426 INFO:tasks.workunit.client.1.smithi143.stdout:1/727: chown d0/d6/d43/d6a/df/d6e/d2/d3c 35 1 2024-09-17T01:07:05.426 INFO:tasks.workunit.client.0.smithi103.stdout:5/130: dread - d6/db/f34 zero size 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 164 MiB/s wr, 283 op/s 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:05.428 INFO:tasks.workunit.client.1.smithi143.stdout:3/706: unlink d6/d1c/d82/cb2 0 2024-09-17T01:07:05.429 INFO:tasks.workunit.client.1.smithi143.stdout:3/707: truncate d6/d1c/d33/d5d/fba 894745 0 2024-09-17T01:07:05.430 INFO:tasks.workunit.client.1.smithi143.stdout:8/720: symlink d9/d12/df4/l103 0 2024-09-17T01:07:05.431 INFO:tasks.workunit.client.1.smithi143.stdout:8/721: write d9/d12/ff7 [812239,14330] 0 2024-09-17T01:07:05.431 INFO:tasks.workunit.client.1.smithi143.stdout:3/708: write d6/d1c/d33/d3f/d5c/da1/f8c [1498147,101283] 0 2024-09-17T01:07:05.431 INFO:tasks.workunit.client.1.smithi143.stdout:4/711: getdents da/d68 0 2024-09-17T01:07:05.433 INFO:tasks.workunit.client.1.smithi143.stdout:4/712: fdatasync da/d3a/d40/d84/dd0/fd7 0 2024-09-17T01:07:05.433 INFO:tasks.workunit.client.0.smithi103.stdout:9/191: rmdir d7/dd/d11 39 2024-09-17T01:07:05.434 INFO:tasks.workunit.client.1.smithi143.stdout:4/713: write da/d3a/d3e/d72/d9e/fbb [1740581,109256] 0 2024-09-17T01:07:05.435 INFO:tasks.workunit.client.1.smithi143.stdout:9/683: mknod d3/d39/d6a/dc3/ce7 0 2024-09-17T01:07:05.437 INFO:tasks.workunit.client.0.smithi103.stdout:2/87: mkdir d6/da/d17 0 2024-09-17T01:07:05.439 INFO:tasks.workunit.client.1.smithi143.stdout:7/848: symlink d4/d1f/d29/l111 0 2024-09-17T01:07:05.439 INFO:tasks.workunit.client.0.smithi103.stdout:5/131: readlink d6/db/lc 0 2024-09-17T01:07:05.442 INFO:tasks.workunit.client.1.smithi143.stdout:5/670: mkdir d1/d96/dff 0 2024-09-17T01:07:05.444 INFO:tasks.workunit.client.0.smithi103.stdout:9/192: write d7/dd/f16 [2189365,70166] 0 2024-09-17T01:07:05.446 INFO:tasks.workunit.client.1.smithi143.stdout:2/651: truncate d0/d10/d58/d5a/d5b/d4c/d71/d9d/f36 844054 0 2024-09-17T01:07:05.446 INFO:tasks.workunit.client.0.smithi103.stdout:2/88: write f4 [1800307,17535] 0 2024-09-17T01:07:05.447 INFO:tasks.workunit.client.0.smithi103.stdout:3/229: link d3/d16/d1b/l38 d3/d44/l50 0 2024-09-17T01:07:05.447 INFO:tasks.workunit.client.0.smithi103.stdout:5/132: dwrite d6/d11/d13/f31 [0,4194304] 0 2024-09-17T01:07:05.448 INFO:tasks.workunit.client.0.smithi103.stdout:4/234: write d9/f3a [969210,112699] 0 2024-09-17T01:07:05.451 INFO:tasks.workunit.client.0.smithi103.stdout:1/118: write d2/de/f14 [496418,125109] 0 2024-09-17T01:07:05.451 INFO:tasks.workunit.client.0.smithi103.stdout:4/235: read d9/dc/f18 [3200701,25763] 0 2024-09-17T01:07:05.453 INFO:tasks.workunit.client.1.smithi143.stdout:8/722: mkdir d9/d12/d38/d7a/d104 0 2024-09-17T01:07:05.456 INFO:tasks.workunit.client.1.smithi143.stdout:8/723: dread d9/d23/db4/fae [0,4194304] 0 2024-09-17T01:07:05.457 INFO:tasks.workunit.client.1.smithi143.stdout:4/714: creat da/d3a/d3e/d5e/fe6 x:0 0 0 2024-09-17T01:07:05.458 INFO:tasks.workunit.client.0.smithi103.stdout:5/133: rename d6/f1b to d6/d2c/f35 0 2024-09-17T01:07:05.460 INFO:tasks.workunit.client.0.smithi103.stdout:5/134: write d6/d11/d13/f21 [804590,72842] 0 2024-09-17T01:07:05.460 INFO:tasks.workunit.client.0.smithi103.stdout:3/230: mknod d3/d16/d1b/d3c/c51 0 2024-09-17T01:07:05.460 INFO:tasks.workunit.client.0.smithi103.stdout:5/135: chown d6/d11 45895 1 2024-09-17T01:07:05.462 INFO:tasks.workunit.client.0.smithi103.stdout:3/231: truncate d3/d16/f2d 4546823 0 2024-09-17T01:07:05.462 INFO:tasks.workunit.client.0.smithi103.stdout:9/193: symlink d7/dd/d11/d20/l40 0 2024-09-17T01:07:05.463 INFO:tasks.workunit.client.0.smithi103.stdout:3/232: stat d3/d16/d1b/d3c/c4d 0 2024-09-17T01:07:05.463 INFO:tasks.workunit.client.1.smithi143.stdout:7/849: fsync d4/d1f/d4a/de4/d4e/d9f/fde 0 2024-09-17T01:07:05.464 INFO:tasks.workunit.client.1.smithi143.stdout:3/709: write d6/d1c/d4b/f67 [1428272,36705] 0 2024-09-17T01:07:05.464 INFO:tasks.workunit.client.0.smithi103.stdout:1/119: mknod d2/de/c26 0 2024-09-17T01:07:05.465 INFO:tasks.workunit.client.1.smithi143.stdout:7/850: readlink d4/d16/d97/da3/lc3 0 2024-09-17T01:07:05.465 INFO:tasks.workunit.client.1.smithi143.stdout:3/710: readlink d6/d1c/d33/d5d/la2 0 2024-09-17T01:07:05.465 INFO:tasks.workunit.client.0.smithi103.stdout:1/120: chown d2/f8 11922 1 2024-09-17T01:07:05.466 INFO:tasks.workunit.client.1.smithi143.stdout:3/711: chown d6/d1c/l6e 1460 1 2024-09-17T01:07:05.466 INFO:tasks.workunit.client.0.smithi103.stdout:1/121: fsync d2/f1a 0 2024-09-17T01:07:05.466 INFO:tasks.workunit.client.1.smithi143.stdout:3/712: write d6/d1c/d33/d3f/f75 [927363,9376] 0 2024-09-17T01:07:05.467 INFO:tasks.workunit.client.0.smithi103.stdout:1/122: chown c0 33015963 1 2024-09-17T01:07:05.467 INFO:tasks.workunit.client.1.smithi143.stdout:3/713: readlink d6/d1c/d4b/l7a 0 2024-09-17T01:07:05.468 INFO:tasks.workunit.client.0.smithi103.stdout:5/136: mknod d6/d2c/c36 0 2024-09-17T01:07:05.469 INFO:tasks.workunit.client.1.smithi143.stdout:1/728: creat d0/d6/d43/d47/dbf/deb/dc3/ff1 x:0 0 0 2024-09-17T01:07:05.469 INFO:tasks.workunit.client.1.smithi143.stdout:1/729: chown d0/d6/d43/d47/d72 3638 1 2024-09-17T01:07:05.471 INFO:tasks.workunit.client.1.smithi143.stdout:2/652: creat d0/d2/d21/d22/fd4 x:0 0 0 2024-09-17T01:07:05.473 INFO:tasks.workunit.client.0.smithi103.stdout:1/123: dwrite d2/d16/f25 [0,4194304] 0 2024-09-17T01:07:05.475 INFO:tasks.workunit.client.0.smithi103.stdout:2/89: creat d6/f18 x:0 0 0 2024-09-17T01:07:05.475 INFO:tasks.workunit.client.0.smithi103.stdout:2/90: stat d6/f18 0 2024-09-17T01:07:05.480 INFO:tasks.workunit.client.1.smithi143.stdout:9/684: mknod d3/d39/d6a/ce8 0 2024-09-17T01:07:05.480 INFO:tasks.workunit.client.1.smithi143.stdout:9/685: dread d3/d39/d42/d58/d5a/d5e/d99/f9d [0,4194304] 0 2024-09-17T01:07:05.481 INFO:tasks.workunit.client.0.smithi103.stdout:4/236: truncate d9/d16/f37 160207 0 2024-09-17T01:07:05.481 INFO:tasks.workunit.client.0.smithi103.stdout:9/194: symlink d7/dd/l41 0 2024-09-17T01:07:05.481 INFO:tasks.workunit.client.0.smithi103.stdout:4/237: read d9/f3a [80068,97769] 0 2024-09-17T01:07:05.482 INFO:tasks.workunit.client.1.smithi143.stdout:0/685: creat d3/d5/d8/d27/d31/fdd x:0 0 0 2024-09-17T01:07:05.482 INFO:tasks.workunit.client.0.smithi103.stdout:9/195: chown d7/dd/l41 7032804 1 2024-09-17T01:07:05.485 INFO:tasks.workunit.client.1.smithi143.stdout:6/628: creat d2/fcf x:0 0 0 2024-09-17T01:07:05.488 INFO:tasks.workunit.client.0.smithi103.stdout:3/233: dread d3/f1c [0,4194304] 0 2024-09-17T01:07:05.489 INFO:tasks.workunit.client.1.smithi143.stdout:5/671: mkdir d1/d46/df/d23/d4f/d7d/d100 0 2024-09-17T01:07:05.490 INFO:tasks.workunit.client.1.smithi143.stdout:3/714: creat d6/d1c/d4b/d57/fdd x:0 0 0 2024-09-17T01:07:05.491 INFO:tasks.workunit.client.0.smithi103.stdout:5/137: dwrite d6/d11/f2f [0,4194304] 0 2024-09-17T01:07:05.494 INFO:tasks.workunit.client.0.smithi103.stdout:9/196: symlink d7/dd/l42 0 2024-09-17T01:07:05.496 INFO:tasks.workunit.client.0.smithi103.stdout:5/138: truncate d6/d11/d13/f1c 184384 0 2024-09-17T01:07:05.496 INFO:tasks.workunit.client.0.smithi103.stdout:2/91: rename d6/da/f15 to d6/f19 0 2024-09-17T01:07:05.498 INFO:tasks.workunit.client.0.smithi103.stdout:3/234: dwrite d3/f1c [0,4194304] 0 2024-09-17T01:07:05.499 INFO:tasks.workunit.client.0.smithi103.stdout:5/139: chown d6/d11/d13/l14 0 1 2024-09-17T01:07:05.499 INFO:tasks.workunit.client.0.smithi103.stdout:2/92: chown d6/c13 7660 1 2024-09-17T01:07:05.500 INFO:tasks.workunit.client.1.smithi143.stdout:9/686: unlink d3/fd0 0 2024-09-17T01:07:05.500 INFO:tasks.workunit.client.0.smithi103.stdout:1/124: dread d2/d7/fc [4194304,4194304] 0 2024-09-17T01:07:05.501 INFO:tasks.workunit.client.0.smithi103.stdout:2/93: chown d6/fb 207143400 1 2024-09-17T01:07:05.503 INFO:tasks.workunit.client.1.smithi143.stdout:0/686: unlink d3/d5/d8/d10/fc2 0 2024-09-17T01:07:05.506 INFO:tasks.workunit.client.1.smithi143.stdout:0/687: write d3/d5/d8/d58/fc7 [413713,95404] 0 2024-09-17T01:07:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 164 MiB/s wr, 283 op/s 2024-09-17T01:07:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:05.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:05.509 INFO:tasks.workunit.client.1.smithi143.stdout:9/687: dwrite d3/d3d/f43 [0,4194304] 0 2024-09-17T01:07:05.509 INFO:tasks.workunit.client.0.smithi103.stdout:9/197: dread d7/dd/d11/d21/f3e [0,4194304] 0 2024-09-17T01:07:05.510 INFO:tasks.workunit.client.0.smithi103.stdout:5/140: creat d6/d2c/f37 x:0 0 0 2024-09-17T01:07:05.510 INFO:tasks.workunit.client.1.smithi143.stdout:9/688: fsync d3/d39/d6a/dc3/d3e/d51/db7/fdf 0 2024-09-17T01:07:05.511 INFO:tasks.workunit.client.0.smithi103.stdout:9/198: stat d7/f3b 0 2024-09-17T01:07:05.511 INFO:tasks.workunit.client.0.smithi103.stdout:5/141: readlink d6/l24 0 2024-09-17T01:07:05.512 INFO:tasks.workunit.client.0.smithi103.stdout:9/199: dread d7/dd/f38 [0,4194304] 0 2024-09-17T01:07:05.513 INFO:tasks.workunit.client.1.smithi143.stdout:3/715: unlink d6/d1c/d4b/fa9 0 2024-09-17T01:07:05.514 INFO:tasks.workunit.client.0.smithi103.stdout:1/125: creat d2/de/d1f/f27 x:0 0 0 2024-09-17T01:07:05.516 INFO:tasks.workunit.client.1.smithi143.stdout:1/730: dread d0/d6/d43/d47/dbf/deb/f51 [0,4194304] 0 2024-09-17T01:07:05.516 INFO:tasks.workunit.client.1.smithi143.stdout:2/653: mknod d0/d44/d6a/d91/dc7/cd5 0 2024-09-17T01:07:05.518 INFO:tasks.workunit.client.1.smithi143.stdout:8/724: link d9/d12/d13/cc9 d9/d12/d38/d58/d79/c105 0 2024-09-17T01:07:05.518 INFO:tasks.workunit.client.0.smithi103.stdout:2/94: write d6/fb [2703619,114143] 0 2024-09-17T01:07:05.518 INFO:tasks.workunit.client.1.smithi143.stdout:1/731: chown d0/d6/d43/d6a/d52/db2/db6 4 1 2024-09-17T01:07:05.519 INFO:tasks.workunit.client.0.smithi103.stdout:3/235: mknod d3/d16/c52 0 2024-09-17T01:07:05.519 INFO:tasks.workunit.client.1.smithi143.stdout:5/672: dwrite d1/d46/df/d53/d74/faf [0,4194304] 0 2024-09-17T01:07:05.520 INFO:tasks.workunit.client.1.smithi143.stdout:1/732: dread - d0/d6/d43/d47/d72/fc7 zero size 2024-09-17T01:07:05.523 INFO:tasks.workunit.client.0.smithi103.stdout:2/95: dread d6/f12 [0,4194304] 0 2024-09-17T01:07:05.523 INFO:tasks.workunit.client.1.smithi143.stdout:8/725: read d9/fcf [2176047,120281] 0 2024-09-17T01:07:05.524 INFO:tasks.workunit.client.0.smithi103.stdout:2/96: write f4 [978422,103711] 0 2024-09-17T01:07:05.528 INFO:tasks.workunit.client.0.smithi103.stdout:1/126: mkdir d2/d1c/d28 0 2024-09-17T01:07:05.530 INFO:tasks.workunit.client.1.smithi143.stdout:8/726: dwrite d9/fcf [0,4194304] 0 2024-09-17T01:07:05.531 INFO:tasks.workunit.client.1.smithi143.stdout:8/727: stat c3 0 2024-09-17T01:07:05.534 INFO:tasks.workunit.client.0.smithi103.stdout:3/236: creat d3/d16/d1b/d3c/f53 x:0 0 0 2024-09-17T01:07:05.534 INFO:tasks.workunit.client.1.smithi143.stdout:9/689: symlink d3/d39/d6a/dc3/d3e/d51/d52/le9 0 2024-09-17T01:07:05.535 INFO:tasks.workunit.client.0.smithi103.stdout:3/237: stat d3/d16/d1b/d36/c3e 0 2024-09-17T01:07:05.538 INFO:tasks.workunit.client.1.smithi143.stdout:3/716: unlink d6/f73 0 2024-09-17T01:07:05.538 INFO:tasks.workunit.client.0.smithi103.stdout:0/181: sync 2024-09-17T01:07:05.539 INFO:tasks.workunit.client.1.smithi143.stdout:3/717: dread - d6/d1c/d4b/fd9 zero size 2024-09-17T01:07:05.540 INFO:tasks.workunit.client.0.smithi103.stdout:9/200: write d7/f2a [2875403,14893] 0 2024-09-17T01:07:05.540 INFO:tasks.workunit.client.1.smithi143.stdout:3/718: dread - d6/d1c/d33/d41/d2e/d86/d89/fa6 zero size 2024-09-17T01:07:05.541 INFO:tasks.workunit.client.0.smithi103.stdout:4/238: truncate d9/d16/f37 1110640 0 2024-09-17T01:07:05.541 INFO:tasks.workunit.client.0.smithi103.stdout:4/239: stat d9/fd 0 2024-09-17T01:07:05.542 INFO:tasks.workunit.client.0.smithi103.stdout:4/240: fdatasync d9/d2d/f39 0 2024-09-17T01:07:05.543 INFO:tasks.workunit.client.1.smithi143.stdout:2/654: read d0/f42 [1568403,83196] 0 2024-09-17T01:07:05.544 INFO:tasks.workunit.client.0.smithi103.stdout:4/241: write d9/d10/f1f [2587067,112327] 0 2024-09-17T01:07:05.545 INFO:tasks.workunit.client.1.smithi143.stdout:4/715: rename da/d3a/d3e/l4e to da/d3a/d40/le7 0 2024-09-17T01:07:05.547 INFO:tasks.workunit.client.1.smithi143.stdout:5/673: unlink d1/d46/df/d53/d74/faf 0 2024-09-17T01:07:05.549 INFO:tasks.workunit.client.0.smithi103.stdout:2/97: dwrite d6/f19 [0,4194304] 0 2024-09-17T01:07:05.551 INFO:tasks.workunit.client.0.smithi103.stdout:3/238: mknod d3/d16/d1b/d2c/d34/c54 0 2024-09-17T01:07:05.554 INFO:tasks.workunit.client.1.smithi143.stdout:0/688: unlink d3/d14/cc5 0 2024-09-17T01:07:05.554 INFO:tasks.workunit.client.0.smithi103.stdout:3/239: dread d3/f27 [0,4194304] 0 2024-09-17T01:07:05.557 INFO:tasks.workunit.client.0.smithi103.stdout:9/201: unlink d7/l31 0 2024-09-17T01:07:05.558 INFO:tasks.workunit.client.1.smithi143.stdout:7/851: rmdir d4/d1f/d4a/dc1/d10f 0 2024-09-17T01:07:05.559 INFO:tasks.workunit.client.1.smithi143.stdout:7/852: chown d4/fb7 82708 1 2024-09-17T01:07:05.561 INFO:tasks.workunit.client.0.smithi103.stdout:1/127: creat d2/d1c/d28/f29 x:0 0 0 2024-09-17T01:07:05.561 INFO:tasks.workunit.client.1.smithi143.stdout:8/728: write d9/d23/d32/fb0 [742788,129502] 0 2024-09-17T01:07:05.562 INFO:tasks.workunit.client.1.smithi143.stdout:8/729: chown d9/d23/d32/l82 24236 1 2024-09-17T01:07:05.562 INFO:tasks.workunit.client.1.smithi143.stdout:9/690: mknod d3/d39/cea 0 2024-09-17T01:07:05.563 INFO:tasks.workunit.client.1.smithi143.stdout:8/730: truncate d9/d12/d38/d7a/d8f/f92 671893 0 2024-09-17T01:07:05.564 INFO:tasks.workunit.client.0.smithi103.stdout:5/142: getdents d6/d28 0 2024-09-17T01:07:05.565 INFO:tasks.workunit.client.1.smithi143.stdout:8/731: write d9/d23/db4/f6c [8126311,73092] 0 2024-09-17T01:07:05.566 INFO:tasks.workunit.client.1.smithi143.stdout:8/732: write d9/d12/d38/dba/fdb [103261,96012] 0 2024-09-17T01:07:05.566 INFO:tasks.workunit.client.0.smithi103.stdout:2/98: chown d6/c11 39 1 2024-09-17T01:07:05.569 INFO:tasks.workunit.client.0.smithi103.stdout:0/182: mknod dd/df/c40 0 2024-09-17T01:07:05.569 INFO:tasks.workunit.client.0.smithi103.stdout:0/183: readlink dd/df/l12 0 2024-09-17T01:07:05.571 INFO:tasks.workunit.client.1.smithi143.stdout:3/719: rename d6/c25 to d6/d1c/d4d/dd1/cde 0 2024-09-17T01:07:05.573 INFO:tasks.workunit.client.0.smithi103.stdout:3/240: symlink d3/d16/d1b/d36/l55 0 2024-09-17T01:07:05.573 INFO:tasks.workunit.client.1.smithi143.stdout:4/716: mknod da/d6d/d90/ce8 0 2024-09-17T01:07:05.575 INFO:tasks.workunit.client.1.smithi143.stdout:4/717: read da/d3a/d3e/d72/d9e/fbb [1085116,81788] 0 2024-09-17T01:07:05.576 INFO:tasks.workunit.client.1.smithi143.stdout:5/674: fdatasync d1/d46/df/d1f/f16 0 2024-09-17T01:07:05.576 INFO:tasks.workunit.client.1.smithi143.stdout:4/718: write da/d3a/d3e/fb7 [426981,14876] 0 2024-09-17T01:07:05.577 INFO:tasks.workunit.client.1.smithi143.stdout:1/733: unlink d0/d6/d43/d47/dbf/deb/l61 0 2024-09-17T01:07:05.577 INFO:tasks.workunit.client.1.smithi143.stdout:4/719: chown da/d3a/d3e/fdf 1 1 2024-09-17T01:07:05.579 INFO:tasks.workunit.client.0.smithi103.stdout:5/143: unlink d6/d11/c20 0 2024-09-17T01:07:05.580 INFO:tasks.workunit.client.1.smithi143.stdout:6/629: getdents d2/df/d40/d41/d6c 0 2024-09-17T01:07:05.580 INFO:tasks.workunit.client.0.smithi103.stdout:5/144: chown d6/d11/f2b 815207 1 2024-09-17T01:07:05.581 INFO:tasks.workunit.client.0.smithi103.stdout:1/128: dwrite d2/f4 [4194304,4194304] 0 2024-09-17T01:07:05.581 INFO:tasks.workunit.client.1.smithi143.stdout:4/720: dread da/f1c [0,4194304] 0 2024-09-17T01:07:05.585 INFO:tasks.workunit.client.1.smithi143.stdout:0/689: chown d3/d5/d8/d27/d8c/f9c 506 1 2024-09-17T01:07:05.585 INFO:tasks.workunit.client.0.smithi103.stdout:3/241: mknod d3/d16/d1b/d2c/d34/c56 0 2024-09-17T01:07:05.587 INFO:tasks.workunit.client.1.smithi143.stdout:7/853: unlink d4/caf 0 2024-09-17T01:07:05.590 INFO:tasks.workunit.client.0.smithi103.stdout:5/145: mkdir d6/d2c/d38 0 2024-09-17T01:07:05.591 INFO:tasks.workunit.client.0.smithi103.stdout:0/184: dwrite dd/df/d1b/f32 [0,4194304] 0 2024-09-17T01:07:05.591 INFO:tasks.workunit.client.0.smithi103.stdout:5/146: readlink d6/d11/l19 0 2024-09-17T01:07:05.592 INFO:tasks.workunit.client.1.smithi143.stdout:8/733: mknod d9/de/d53/d75/daf/c106 0 2024-09-17T01:07:05.593 INFO:tasks.workunit.client.0.smithi103.stdout:5/147: write d6/d2c/f37 [715946,125639] 0 2024-09-17T01:07:05.593 INFO:tasks.workunit.client.1.smithi143.stdout:2/655: mkdir d0/d44/dd6 0 2024-09-17T01:07:05.593 INFO:tasks.workunit.client.0.smithi103.stdout:1/129: creat d2/d16/f2a x:0 0 0 2024-09-17T01:07:05.596 INFO:tasks.workunit.client.0.smithi103.stdout:5/148: write d6/d11/d13/f21 [1590269,100624] 0 2024-09-17T01:07:05.598 INFO:tasks.workunit.client.0.smithi103.stdout:1/130: dread d2/f4 [4194304,4194304] 0 2024-09-17T01:07:05.602 INFO:tasks.workunit.client.1.smithi143.stdout:6/630: rmdir d2/d30/d45/d70/d87/d8d 39 2024-09-17T01:07:05.603 INFO:tasks.workunit.client.1.smithi143.stdout:6/631: readlink d2/d17/d6e/d26/d46/lc5 0 2024-09-17T01:07:05.603 INFO:tasks.workunit.client.1.smithi143.stdout:6/632: stat d2/df/d40/d41/d6c/f99 0 2024-09-17T01:07:05.604 INFO:tasks.workunit.client.1.smithi143.stdout:6/633: fdatasync d2/df/d20/d2c/d38/f39 0 2024-09-17T01:07:05.604 INFO:tasks.workunit.client.0.smithi103.stdout:3/242: creat d3/f57 x:0 0 0 2024-09-17T01:07:05.605 INFO:tasks.workunit.client.1.smithi143.stdout:6/634: truncate d2/d17/d6e/d26/f32 1811573 0 2024-09-17T01:07:05.606 INFO:tasks.workunit.client.0.smithi103.stdout:5/149: rename d6/f9 to d6/d28/f39 0 2024-09-17T01:07:05.607 INFO:tasks.workunit.client.1.smithi143.stdout:7/854: symlink d4/d1f/d4a/de4/d4e/d9f/l112 0 2024-09-17T01:07:05.608 INFO:tasks.workunit.client.1.smithi143.stdout:7/855: dread - d4/d1f/d4a/d66/d86/fb8 zero size 2024-09-17T01:07:05.608 INFO:tasks.workunit.client.0.smithi103.stdout:1/131: mknod d2/d16/c2b 0 2024-09-17T01:07:05.608 INFO:tasks.workunit.client.1.smithi143.stdout:8/734: creat d9/d12/d38/d58/d70/f107 x:0 0 0 2024-09-17T01:07:05.613 INFO:tasks.workunit.client.0.smithi103.stdout:0/185: write dd/df/f25 [4240206,44191] 0 2024-09-17T01:07:05.614 INFO:tasks.workunit.client.0.smithi103.stdout:9/202: getdents d7/dd/d11 0 2024-09-17T01:07:05.615 INFO:tasks.workunit.client.0.smithi103.stdout:5/150: dwrite d6/d11/f1d [0,4194304] 0 2024-09-17T01:07:05.616 INFO:tasks.workunit.client.1.smithi143.stdout:3/720: dwrite d6/d1c/d33/d3f/fb4 [0,4194304] 0 2024-09-17T01:07:05.617 INFO:tasks.workunit.client.1.smithi143.stdout:5/675: mkdir d1/d46/df/d53/d74/d9a/d101 0 2024-09-17T01:07:05.618 INFO:tasks.workunit.client.0.smithi103.stdout:5/151: read d6/d11/f2f [4045365,95237] 0 2024-09-17T01:07:05.620 INFO:tasks.workunit.client.0.smithi103.stdout:1/132: dwrite d2/d16/f2a [0,4194304] 0 2024-09-17T01:07:05.624 INFO:tasks.workunit.client.1.smithi143.stdout:1/734: dwrite d0/d6/d43/d47/d68/f73 [0,4194304] 0 2024-09-17T01:07:05.626 INFO:tasks.workunit.client.0.smithi103.stdout:1/133: chown d2/d1c/d28/f29 1296 1 2024-09-17T01:07:05.627 INFO:tasks.workunit.client.0.smithi103.stdout:5/152: unlink d6/d11/d13/l14 0 2024-09-17T01:07:05.628 INFO:tasks.workunit.client.1.smithi143.stdout:6/635: mkdir d2/d17/d3a/d47/dd0 0 2024-09-17T01:07:05.629 INFO:tasks.workunit.client.0.smithi103.stdout:3/243: write d3/fd [1666204,25664] 0 2024-09-17T01:07:05.630 INFO:tasks.workunit.client.0.smithi103.stdout:1/134: dread - d2/de/f1b zero size 2024-09-17T01:07:05.630 INFO:tasks.workunit.client.0.smithi103.stdout:0/186: dwrite dd/df/d38/f33 [0,4194304] 0 2024-09-17T01:07:05.634 INFO:tasks.workunit.client.0.smithi103.stdout:1/135: write d2/f8 [2532166,85028] 0 2024-09-17T01:07:05.635 INFO:tasks.workunit.client.0.smithi103.stdout:0/187: truncate dd/df/f24 4522647 0 2024-09-17T01:07:05.635 INFO:tasks.workunit.client.1.smithi143.stdout:2/656: dwrite d0/d10/d58/d5a/d5b/f45 [0,4194304] 0 2024-09-17T01:07:05.637 INFO:tasks.workunit.client.1.smithi143.stdout:7/856: rmdir d4 39 2024-09-17T01:07:05.637 INFO:tasks.workunit.client.0.smithi103.stdout:9/203: dwrite d7/fc [0,4194304] 0 2024-09-17T01:07:05.641 INFO:tasks.workunit.client.1.smithi143.stdout:8/735: mkdir d9/d23/db4/d55/d57/d108 0 2024-09-17T01:07:05.644 INFO:tasks.workunit.client.0.smithi103.stdout:3/244: creat d3/d16/d1b/d2c/f58 x:0 0 0 2024-09-17T01:07:05.645 INFO:tasks.workunit.client.1.smithi143.stdout:6/636: dwrite d2/d30/d84/fb1 [0,4194304] 0 2024-09-17T01:07:05.645 INFO:tasks.workunit.client.0.smithi103.stdout:1/136: dread d2/d16/f2a [0,4194304] 0 2024-09-17T01:07:05.645 INFO:tasks.workunit.client.0.smithi103.stdout:0/188: rmdir dd/df/d1b 39 2024-09-17T01:07:05.651 INFO:tasks.workunit.client.1.smithi143.stdout:3/721: creat d6/d1c/d33/d41/d2e/d86/ddc/fdf x:0 0 0 2024-09-17T01:07:05.651 INFO:tasks.workunit.client.1.smithi143.stdout:2/657: dwrite d0/d2/d21/f62 [0,4194304] 0 2024-09-17T01:07:05.653 INFO:tasks.workunit.client.1.smithi143.stdout:3/722: readlink d6/d1c/d4b/d57/l5a 0 2024-09-17T01:07:05.654 INFO:tasks.workunit.client.0.smithi103.stdout:1/137: creat d2/de/d1f/f2c x:0 0 0 2024-09-17T01:07:05.654 INFO:tasks.workunit.client.1.smithi143.stdout:1/735: creat d0/d6/d43/d47/d68/d7b/daf/ff2 x:0 0 0 2024-09-17T01:07:05.655 INFO:tasks.workunit.client.1.smithi143.stdout:9/691: symlink d3/d39/d6a/dc3/d3e/d51/d52/db3/leb 0 2024-09-17T01:07:05.656 INFO:tasks.workunit.client.0.smithi103.stdout:1/138: write d2/de/f1b [412911,21787] 0 2024-09-17T01:07:05.657 INFO:tasks.workunit.client.1.smithi143.stdout:1/736: stat d0/d6/d43/d6a/df/d27/c4a 0 2024-09-17T01:07:05.658 INFO:tasks.workunit.client.1.smithi143.stdout:7/857: read d4/fd [386650,37784] 0 2024-09-17T01:07:05.659 INFO:tasks.workunit.client.1.smithi143.stdout:8/736: mkdir d9/d12/d38/d7a/d109 0 2024-09-17T01:07:05.659 INFO:tasks.workunit.client.1.smithi143.stdout:1/737: write d0/d6/d43/d6a/df/f8c [3937702,29270] 0 2024-09-17T01:07:05.659 INFO:tasks.workunit.client.0.smithi103.stdout:3/245: creat d3/f59 x:0 0 0 2024-09-17T01:07:05.660 INFO:tasks.workunit.client.0.smithi103.stdout:3/246: fdatasync d3/f1c 0 2024-09-17T01:07:05.662 INFO:tasks.workunit.client.0.smithi103.stdout:9/204: getdents d7/dd/d11/d20 0 2024-09-17T01:07:05.663 INFO:tasks.workunit.client.1.smithi143.stdout:4/721: rename da/d3a/d3e/d5e/ccc to da/d3a/d40/ce9 0 2024-09-17T01:07:05.665 INFO:tasks.workunit.client.0.smithi103.stdout:0/189: creat dd/df/f41 x:0 0 0 2024-09-17T01:07:05.666 INFO:tasks.workunit.client.1.smithi143.stdout:0/690: getdents d3/d68/d8f 0 2024-09-17T01:07:05.668 INFO:tasks.workunit.client.1.smithi143.stdout:3/723: dread - d6/d1c/d33/d3f/d5c/da1/fdb zero size 2024-09-17T01:07:05.669 INFO:tasks.workunit.client.1.smithi143.stdout:9/692: creat d3/d39/d6a/dc3/d3e/d51/db7/fec x:0 0 0 2024-09-17T01:07:05.670 INFO:tasks.workunit.client.1.smithi143.stdout:7/858: mkdir d4/d1f/d29/d65/d5d/d113 0 2024-09-17T01:07:05.672 INFO:tasks.workunit.client.0.smithi103.stdout:0/190: creat dd/f42 x:0 0 0 2024-09-17T01:07:05.673 INFO:tasks.workunit.client.0.smithi103.stdout:0/191: fdatasync dd/df/f3a 0 2024-09-17T01:07:05.674 INFO:tasks.workunit.client.1.smithi143.stdout:7/859: dread - d4/d1f/d4a/de4/d4e/d9f/fdf zero size 2024-09-17T01:07:05.674 INFO:tasks.workunit.client.1.smithi143.stdout:6/637: creat d2/d30/db4/dbc/fd1 x:0 0 0 2024-09-17T01:07:05.675 INFO:tasks.workunit.client.1.smithi143.stdout:2/658: rename d0/f42 to d0/d10/d58/d5a/fd7 0 2024-09-17T01:07:05.676 INFO:tasks.workunit.client.0.smithi103.stdout:3/247: truncate d3/f1d 2686138 0 2024-09-17T01:07:05.677 INFO:tasks.workunit.client.1.smithi143.stdout:3/724: dwrite d6/d1c/d33/d41/d2b/fd4 [0,4194304] 0 2024-09-17T01:07:05.678 INFO:tasks.workunit.client.0.smithi103.stdout:3/248: truncate d3/d16/d1b/d3c/f53 576514 0 2024-09-17T01:07:05.678 INFO:tasks.workunit.client.0.smithi103.stdout:9/205: fsync d7/f3c 0 2024-09-17T01:07:05.679 INFO:tasks.workunit.client.1.smithi143.stdout:2/659: write d0/d2/d21/d84/d8d/fb1 [2477081,45581] 0 2024-09-17T01:07:05.683 INFO:tasks.workunit.client.1.smithi143.stdout:9/693: read d3/d81/d9c/fda [554770,42328] 0 2024-09-17T01:07:05.684 INFO:tasks.workunit.client.0.smithi103.stdout:3/249: mknod d3/d16/d1b/d3c/c5a 0 2024-09-17T01:07:05.685 INFO:tasks.workunit.client.1.smithi143.stdout:5/676: write d1/d46/f48 [4025435,99773] 0 2024-09-17T01:07:05.688 INFO:tasks.workunit.client.1.smithi143.stdout:6/638: mkdir d2/d17/d3a/dd2 0 2024-09-17T01:07:05.690 INFO:tasks.workunit.client.1.smithi143.stdout:1/738: rename d0/dc/d57/fba to d0/d6/d43/d6d/d8b/dd0/de2/d6b/d9d/ff3 0 2024-09-17T01:07:05.692 INFO:tasks.workunit.client.1.smithi143.stdout:7/860: mkdir d4/d1f/d4a/d66/db5/df3/d106/d114 0 2024-09-17T01:07:05.692 INFO:tasks.workunit.client.0.smithi103.stdout:3/250: symlink d3/d16/l5b 0 2024-09-17T01:07:05.696 INFO:tasks.workunit.client.0.smithi103.stdout:3/251: mkdir d3/d16/d1b/d2c/d5c 0 2024-09-17T01:07:05.697 INFO:tasks.workunit.client.0.smithi103.stdout:1/139: truncate d2/de/f11 4754426 0 2024-09-17T01:07:05.703 INFO:tasks.workunit.client.1.smithi143.stdout:9/694: mkdir d3/d39/d6a/d9/ded 0 2024-09-17T01:07:05.704 INFO:tasks.workunit.client.1.smithi143.stdout:6/639: mknod d2/d30/db4/cd3 0 2024-09-17T01:07:05.705 INFO:tasks.workunit.client.1.smithi143.stdout:1/739: creat d0/dc/d57/dc2/ff4 x:0 0 0 2024-09-17T01:07:05.706 INFO:tasks.workunit.client.1.smithi143.stdout:8/737: truncate d9/d23/db4/f6c 2156437 0 2024-09-17T01:07:05.707 INFO:tasks.workunit.client.1.smithi143.stdout:4/722: rename da/d3a/d40/c2f to da/d3a/d40/cea 0 2024-09-17T01:07:05.709 INFO:tasks.workunit.client.1.smithi143.stdout:2/660: unlink d0/f9c 0 2024-09-17T01:07:05.710 INFO:tasks.workunit.client.1.smithi143.stdout:0/691: dwrite d3/d5/f34 [0,4194304] 0 2024-09-17T01:07:05.711 INFO:tasks.workunit.client.1.smithi143.stdout:0/692: fsync d3/fb8 0 2024-09-17T01:07:05.711 INFO:tasks.workunit.client.1.smithi143.stdout:9/695: chown d3/d39/d42/d58/d5a/d5e/d99/l90 728 1 2024-09-17T01:07:05.714 INFO:tasks.workunit.client.1.smithi143.stdout:1/740: creat d0/d6/d43/d47/dd8/ff5 x:0 0 0 2024-09-17T01:07:05.715 INFO:tasks.workunit.client.1.smithi143.stdout:8/738: read d9/d23/d32/fb7 [275762,66632] 0 2024-09-17T01:07:05.715 INFO:tasks.workunit.client.1.smithi143.stdout:8/739: chown d9/d12/c1b 7821 1 2024-09-17T01:07:05.717 INFO:tasks.workunit.client.1.smithi143.stdout:4/723: creat da/d68/d9b/feb x:0 0 0 2024-09-17T01:07:05.718 INFO:tasks.workunit.client.1.smithi143.stdout:6/640: mknod d2/d17/d3a/dd2/cd4 0 2024-09-17T01:07:05.720 INFO:tasks.workunit.client.1.smithi143.stdout:2/661: rename d0/d2/f2b to d0/d2/d21/d84/d8d/fd8 0 2024-09-17T01:07:05.723 INFO:tasks.workunit.client.1.smithi143.stdout:0/693: mkdir d3/d14/d32/dde 0 2024-09-17T01:07:05.724 INFO:tasks.workunit.client.1.smithi143.stdout:0/694: readlink d3/d68/d8f/lc3 0 2024-09-17T01:07:05.724 INFO:tasks.workunit.client.1.smithi143.stdout:0/695: stat d3/d14 0 2024-09-17T01:07:05.725 INFO:tasks.workunit.client.1.smithi143.stdout:3/725: truncate d6/f58 288175 0 2024-09-17T01:07:05.725 INFO:tasks.workunit.client.1.smithi143.stdout:1/741: symlink d0/dc/d57/d58/lf6 0 2024-09-17T01:07:05.727 INFO:tasks.workunit.client.1.smithi143.stdout:4/724: creat da/d3a/d3e/d5e/d63/d80/fec x:0 0 0 2024-09-17T01:07:05.728 INFO:tasks.workunit.client.1.smithi143.stdout:5/677: write d1/f59 [37771,96179] 0 2024-09-17T01:07:05.728 INFO:tasks.workunit.client.1.smithi143.stdout:4/725: readlink l8 0 2024-09-17T01:07:05.729 INFO:tasks.workunit.client.1.smithi143.stdout:6/641: symlink d2/d17/d3a/dd2/ld5 0 2024-09-17T01:07:05.730 INFO:tasks.workunit.client.0.smithi103.stdout:0/192: getdents dd/df/d1b 0 2024-09-17T01:07:05.731 INFO:tasks.workunit.client.1.smithi143.stdout:2/662: chown d0/d44/l6f 69952 1 2024-09-17T01:07:05.732 INFO:tasks.workunit.client.0.smithi103.stdout:0/193: chown dd/d1c/f28 252 1 2024-09-17T01:07:05.733 INFO:tasks.workunit.client.1.smithi143.stdout:7/861: getdents d4/d1f 0 2024-09-17T01:07:05.735 INFO:tasks.workunit.client.1.smithi143.stdout:1/742: dwrite d0/d6/d43/d6a/df/d6e/d2/f56 [4194304,4194304] 0 2024-09-17T01:07:05.735 INFO:tasks.workunit.client.0.smithi103.stdout:1/140: dread d2/d7/f19 [0,4194304] 0 2024-09-17T01:07:05.736 INFO:tasks.workunit.client.1.smithi143.stdout:8/740: symlink d9/d23/l10a 0 2024-09-17T01:07:05.736 INFO:tasks.workunit.client.1.smithi143.stdout:2/663: stat d0/d10/d58/d5a/f5f 0 2024-09-17T01:07:05.737 INFO:tasks.workunit.client.0.smithi103.stdout:1/141: chown d2/d16/c2b 8871210 1 2024-09-17T01:07:05.737 INFO:tasks.workunit.client.0.smithi103.stdout:9/206: dwrite f0 [0,4194304] 0 2024-09-17T01:07:05.738 INFO:tasks.workunit.client.0.smithi103.stdout:9/207: stat d7/dd/l41 0 2024-09-17T01:07:05.739 INFO:tasks.workunit.client.0.smithi103.stdout:3/252: rename d3/d16/d1b/d3c/c25 to d3/d16/d1b/d36/c5d 0 2024-09-17T01:07:05.741 INFO:tasks.workunit.client.1.smithi143.stdout:9/696: dread d3/d39/d42/d58/d5a/d5e/d99/f5b [4194304,4194304] 0 2024-09-17T01:07:05.744 INFO:tasks.workunit.client.0.smithi103.stdout:0/194: mkdir dd/d43 0 2024-09-17T01:07:05.746 INFO:tasks.workunit.client.1.smithi143.stdout:4/726: mkdir da/d3a/d7c/ded 0 2024-09-17T01:07:05.747 INFO:tasks.workunit.client.0.smithi103.stdout:1/142: dwrite d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:05.748 INFO:tasks.workunit.client.0.smithi103.stdout:1/143: truncate d2/ff 4428131 0 2024-09-17T01:07:05.749 INFO:tasks.workunit.client.1.smithi143.stdout:5/678: dread d1/d46/f22 [0,4194304] 0 2024-09-17T01:07:05.753 INFO:tasks.workunit.client.0.smithi103.stdout:0/195: mknod dd/df/d1b/c44 0 2024-09-17T01:07:05.754 INFO:tasks.workunit.client.1.smithi143.stdout:0/696: write d3/d5/d8/d21/f42 [171983,119297] 0 2024-09-17T01:07:05.754 INFO:tasks.workunit.client.1.smithi143.stdout:4/727: write da/d3a/d3e/d4a/d8c/fbd [3119192,96202] 0 2024-09-17T01:07:05.754 INFO:tasks.workunit.client.1.smithi143.stdout:9/697: dwrite d3/d39/d42/d58/f9f [0,4194304] 0 2024-09-17T01:07:05.755 INFO:tasks.workunit.client.0.smithi103.stdout:0/196: stat dd/df/f26 0 2024-09-17T01:07:05.756 INFO:tasks.workunit.client.0.smithi103.stdout:9/208: mkdir d7/d43 0 2024-09-17T01:07:05.756 INFO:tasks.workunit.client.0.smithi103.stdout:0/197: chown dd/df/f13 14 1 2024-09-17T01:07:05.756 INFO:tasks.workunit.client.0.smithi103.stdout:1/144: symlink d2/d1c/d28/l2d 0 2024-09-17T01:07:05.756 INFO:tasks.workunit.client.0.smithi103.stdout:0/198: dread - dd/df/f19 zero size 2024-09-17T01:07:05.757 INFO:tasks.workunit.client.1.smithi143.stdout:4/728: readlink da/d68/l55 0 2024-09-17T01:07:05.757 INFO:tasks.workunit.client.1.smithi143.stdout:1/743: rename d0/d6/c30 to d0/d6/d43/d47/dbf/deb/d78/cf7 0 2024-09-17T01:07:05.764 INFO:tasks.workunit.client.1.smithi143.stdout:6/642: mknod d2/d17/cd6 0 2024-09-17T01:07:05.765 INFO:tasks.workunit.client.0.smithi103.stdout:1/145: write d2/d7/f19 [3377870,52488] 0 2024-09-17T01:07:05.767 INFO:tasks.workunit.client.0.smithi103.stdout:9/209: creat d7/dd/d11/d20/f44 x:0 0 0 2024-09-17T01:07:05.768 INFO:tasks.workunit.client.0.smithi103.stdout:9/210: readlink l3 0 2024-09-17T01:07:05.770 INFO:tasks.workunit.client.0.smithi103.stdout:1/146: creat d2/d1c/d20/f2e x:0 0 0 2024-09-17T01:07:05.770 INFO:tasks.workunit.client.1.smithi143.stdout:7/862: mknod d4/d1f/d29/d65/d5d/d113/c115 0 2024-09-17T01:07:05.771 INFO:tasks.workunit.client.0.smithi103.stdout:1/147: write d2/d7/f1d [832561,96432] 0 2024-09-17T01:07:05.771 INFO:tasks.workunit.client.0.smithi103.stdout:9/211: unlink d7/dd/d11/d21/l2e 0 2024-09-17T01:07:05.772 INFO:tasks.workunit.client.1.smithi143.stdout:2/664: dwrite d0/d2/fe [0,4194304] 0 2024-09-17T01:07:05.773 INFO:tasks.workunit.client.1.smithi143.stdout:6/643: write d2/df/d20/d2c/d75/f71 [2043472,119363] 0 2024-09-17T01:07:05.774 INFO:tasks.workunit.client.0.smithi103.stdout:1/148: mknod d2/d1c/d28/c2f 0 2024-09-17T01:07:05.774 INFO:tasks.workunit.client.0.smithi103.stdout:1/149: chown d2/d1c 19980791 1 2024-09-17T01:07:05.777 INFO:tasks.workunit.client.1.smithi143.stdout:4/729: dwrite da/f31 [0,4194304] 0 2024-09-17T01:07:05.778 INFO:tasks.workunit.client.0.smithi103.stdout:9/212: symlink d7/d2d/l45 0 2024-09-17T01:07:05.779 INFO:tasks.workunit.client.1.smithi143.stdout:0/697: dwrite d3/d5/d8/d27/f6a [0,4194304] 0 2024-09-17T01:07:05.781 INFO:tasks.workunit.client.1.smithi143.stdout:9/698: rmdir d3/d39/d42/d58/d5a/d5e 39 2024-09-17T01:07:05.781 INFO:tasks.workunit.client.0.smithi103.stdout:1/150: dwrite d2/d16/f25 [0,4194304] 0 2024-09-17T01:07:05.783 INFO:tasks.workunit.client.1.smithi143.stdout:0/698: chown d3/d5/d8/d21/d2e/f50 10249164 1 2024-09-17T01:07:05.783 INFO:tasks.workunit.client.1.smithi143.stdout:5/679: mkdir d1/d46/df/d23/d4f/d7d/d102 0 2024-09-17T01:07:05.785 INFO:tasks.workunit.client.0.smithi103.stdout:9/213: rename d7/c1a to d7/dd/d11/c46 0 2024-09-17T01:07:05.785 INFO:tasks.workunit.client.0.smithi103.stdout:9/214: rename d7/d2d to d7/d2d/d47 22 2024-09-17T01:07:05.788 INFO:tasks.workunit.client.0.smithi103.stdout:1/151: creat d2/d16/f30 x:0 0 0 2024-09-17T01:07:05.789 INFO:tasks.workunit.client.1.smithi143.stdout:2/665: dwrite d0/d10/d58/d5a/d5b/d4c/d77/fcc [0,4194304] 0 2024-09-17T01:07:05.790 INFO:tasks.workunit.client.1.smithi143.stdout:3/726: link d6/d1c/d82/db1/fc3 d6/d1c/d33/d3f/fe0 0 2024-09-17T01:07:05.792 INFO:tasks.workunit.client.0.smithi103.stdout:1/152: dread d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:05.793 INFO:tasks.workunit.client.1.smithi143.stdout:9/699: readlink d3/d39/d42/d80/lbe 0 2024-09-17T01:07:05.794 INFO:tasks.workunit.client.0.smithi103.stdout:1/153: write d2/de/d1f/f27 [802837,48545] 0 2024-09-17T01:07:05.797 INFO:tasks.workunit.client.1.smithi143.stdout:5/680: symlink d1/d46/d6e/da0/l103 0 2024-09-17T01:07:05.798 INFO:tasks.workunit.client.1.smithi143.stdout:2/666: symlink d0/d10/d58/d5a/d5b/d4c/d71/d9d/ld9 0 2024-09-17T01:07:05.798 INFO:tasks.workunit.client.0.smithi103.stdout:1/154: mkdir d2/d31 0 2024-09-17T01:07:05.800 INFO:tasks.workunit.client.1.smithi143.stdout:7/863: creat d4/f116 x:0 0 0 2024-09-17T01:07:05.802 INFO:tasks.workunit.client.1.smithi143.stdout:7/864: stat d4/d26/ca9 0 2024-09-17T01:07:05.803 INFO:tasks.workunit.client.0.smithi103.stdout:1/155: dread d2/d7/f19 [0,4194304] 0 2024-09-17T01:07:05.804 INFO:tasks.workunit.client.1.smithi143.stdout:4/730: rename da/d75/f88 to da/d3a/d3e/fee 0 2024-09-17T01:07:05.804 INFO:tasks.workunit.client.1.smithi143.stdout:4/731: chown da/d3a/d3e/d4a/d8a/fb8 1791 1 2024-09-17T01:07:05.805 INFO:tasks.workunit.client.1.smithi143.stdout:3/727: symlink d6/d1c/d4b/d57/le1 0 2024-09-17T01:07:05.808 INFO:tasks.workunit.client.1.smithi143.stdout:1/744: getdents d0/d6 0 2024-09-17T01:07:05.809 INFO:tasks.workunit.client.1.smithi143.stdout:4/732: dread da/f31 [0,4194304] 0 2024-09-17T01:07:05.810 INFO:tasks.workunit.client.0.smithi103.stdout:3/253: truncate d3/d16/d1b/d2c/f41 3856885 0 2024-09-17T01:07:05.810 INFO:tasks.workunit.client.1.smithi143.stdout:0/699: creat d3/d5/d8/d27/d31/fdf x:0 0 0 2024-09-17T01:07:05.811 INFO:tasks.workunit.client.1.smithi143.stdout:4/733: chown da/d3a/d3e/d72/d9e/fce 433596 1 2024-09-17T01:07:05.811 INFO:tasks.workunit.client.1.smithi143.stdout:4/734: stat da/d3a/d3e/d5e/d63 0 2024-09-17T01:07:05.812 INFO:tasks.workunit.client.1.smithi143.stdout:4/735: dread - da/d3a/d3e/d4a/d8c/fa0 zero size 2024-09-17T01:07:05.813 INFO:tasks.workunit.client.0.smithi103.stdout:3/254: dread d3/f27 [0,4194304] 0 2024-09-17T01:07:05.813 INFO:tasks.workunit.client.1.smithi143.stdout:7/865: mkdir d4/d16/d97/da3/d117 0 2024-09-17T01:07:05.814 INFO:tasks.workunit.client.1.smithi143.stdout:3/728: rmdir d6/d1c/d33/d3f 39 2024-09-17T01:07:05.816 INFO:tasks.workunit.client.1.smithi143.stdout:2/667: mkdir d0/d44/d6a/d91/dc4/dda 0 2024-09-17T01:07:05.817 INFO:tasks.workunit.client.1.smithi143.stdout:1/745: unlink d0/d6/d43/d47/dbf/deb/la2 0 2024-09-17T01:07:05.817 INFO:tasks.workunit.client.1.smithi143.stdout:7/866: dread d4/d16/f1d [0,4194304] 0 2024-09-17T01:07:05.818 INFO:tasks.workunit.client.1.smithi143.stdout:1/746: write d0/d6/d43/d47/dd8/ff5 [945857,24097] 0 2024-09-17T01:07:05.819 INFO:tasks.workunit.client.1.smithi143.stdout:0/700: creat d3/d5/d8/d10/db3/fe0 x:0 0 0 2024-09-17T01:07:05.819 INFO:tasks.workunit.client.1.smithi143.stdout:1/747: readlink d0/dc/ldb 0 2024-09-17T01:07:05.819 INFO:tasks.workunit.client.1.smithi143.stdout:8/741: truncate d9/de/d53/f68 3281496 0 2024-09-17T01:07:05.820 INFO:tasks.workunit.client.1.smithi143.stdout:4/736: write da/f2a [1464645,68183] 0 2024-09-17T01:07:05.822 INFO:tasks.workunit.client.0.smithi103.stdout:1/156: rmdir d2/d1c 39 2024-09-17T01:07:05.822 INFO:tasks.workunit.client.1.smithi143.stdout:1/748: write d0/d6/d43/d6a/d52/db2/fed [377652,77658] 0 2024-09-17T01:07:05.823 INFO:tasks.workunit.client.0.smithi103.stdout:1/157: creat d2/d16/f32 x:0 0 0 2024-09-17T01:07:05.824 INFO:tasks.workunit.client.1.smithi143.stdout:4/737: write da/d3a/d3e/d4a/d8a/fb8 [349641,93305] 0 2024-09-17T01:07:05.824 INFO:tasks.workunit.client.1.smithi143.stdout:8/742: mkdir d9/de/d53/d75/daf/d10b 0 2024-09-17T01:07:05.825 INFO:tasks.workunit.client.1.smithi143.stdout:7/867: write d4/f82 [6876588,38580] 0 2024-09-17T01:07:05.826 INFO:tasks.workunit.client.0.smithi103.stdout:1/158: write d2/f8 [3081111,32287] 0 2024-09-17T01:07:05.827 INFO:tasks.workunit.client.0.smithi103.stdout:1/159: read d2/ff [734930,119977] 0 2024-09-17T01:07:05.828 INFO:tasks.workunit.client.0.smithi103.stdout:9/215: rename d7/dd to d7/d43/d48 0 2024-09-17T01:07:05.829 INFO:tasks.workunit.client.1.smithi143.stdout:2/668: creat d0/d44/dd6/fdb x:0 0 0 2024-09-17T01:07:05.831 INFO:tasks.workunit.client.0.smithi103.stdout:1/160: fsync d2/f4 0 2024-09-17T01:07:05.831 INFO:tasks.workunit.client.1.smithi143.stdout:3/729: creat d6/d1c/d33/fe2 x:0 0 0 2024-09-17T01:07:05.834 INFO:tasks.workunit.client.1.smithi143.stdout:4/738: dwrite da/d3a/f79 [4194304,4194304] 0 2024-09-17T01:07:05.835 INFO:tasks.workunit.client.1.smithi143.stdout:7/868: dwrite d4/d26/ffb [0,4194304] 0 2024-09-17T01:07:05.836 INFO:tasks.workunit.client.1.smithi143.stdout:4/739: chown da/d3a/d40/d84/c52 407 1 2024-09-17T01:07:05.838 INFO:tasks.workunit.client.0.smithi103.stdout:1/161: dread d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:05.842 INFO:tasks.workunit.client.1.smithi143.stdout:3/730: dread d6/d1c/d4b/d57/fa0 [0,4194304] 0 2024-09-17T01:07:05.844 INFO:tasks.workunit.client.0.smithi103.stdout:1/162: dread d2/d7/f19 [0,4194304] 0 2024-09-17T01:07:05.844 INFO:tasks.workunit.client.1.smithi143.stdout:2/669: write d0/d2/d21/d22/f28 [4580856,55785] 0 2024-09-17T01:07:05.845 INFO:tasks.workunit.client.0.smithi103.stdout:1/163: dread - d2/de/d1f/f2c zero size 2024-09-17T01:07:05.848 INFO:tasks.workunit.client.1.smithi143.stdout:7/869: mknod d4/d26/dcc/c118 0 2024-09-17T01:07:05.849 INFO:tasks.workunit.client.1.smithi143.stdout:9/700: dwrite d3/d39/d6a/d9/d74/fe6 [0,4194304] 0 2024-09-17T01:07:05.849 INFO:tasks.workunit.client.0.smithi103.stdout:1/164: mkdir d2/d1c/d20/d33 0 2024-09-17T01:07:05.849 INFO:tasks.workunit.client.1.smithi143.stdout:7/870: write d4/f18 [461192,66567] 0 2024-09-17T01:07:05.854 INFO:tasks.workunit.client.1.smithi143.stdout:4/740: mknod da/d3a/d40/d84/dd0/cef 0 2024-09-17T01:07:05.854 INFO:tasks.workunit.client.1.smithi143.stdout:8/743: rmdir d9/de/d53 39 2024-09-17T01:07:05.857 INFO:tasks.workunit.client.1.smithi143.stdout:8/744: write d9/d12/d38/d7a/d8f/f92 [771423,35198] 0 2024-09-17T01:07:05.858 INFO:tasks.workunit.client.1.smithi143.stdout:8/745: fsync d9/d12/d13/fed 0 2024-09-17T01:07:05.861 INFO:tasks.workunit.client.1.smithi143.stdout:1/749: write d0/dc/d74/d94/f9a [956285,73637] 0 2024-09-17T01:07:05.861 INFO:tasks.workunit.client.1.smithi143.stdout:3/731: fdatasync d6/d1c/d33/f72 0 2024-09-17T01:07:05.861 INFO:tasks.workunit.client.0.smithi103.stdout:9/216: truncate d7/f2a 2276877 0 2024-09-17T01:07:05.862 INFO:tasks.workunit.client.0.smithi103.stdout:9/217: fdatasync d7/d43/d48/d11/d21/f26 0 2024-09-17T01:07:05.863 INFO:tasks.workunit.client.0.smithi103.stdout:7/140: sync 2024-09-17T01:07:05.863 INFO:tasks.workunit.client.0.smithi103.stdout:6/119: sync 2024-09-17T01:07:05.864 INFO:tasks.workunit.client.0.smithi103.stdout:6/120: write f1 [2325920,62035] 0 2024-09-17T01:07:05.864 INFO:tasks.workunit.client.1.smithi143.stdout:2/670: rename d0/f6e to d0/d10/d58/d5a/d5b/d4c/d71/dc5/fdc 0 2024-09-17T01:07:05.864 INFO:tasks.workunit.client.1.smithi143.stdout:2/671: stat d0/d2/d21/f62 0 2024-09-17T01:07:05.865 INFO:tasks.workunit.client.0.smithi103.stdout:6/121: stat d3/c10 0 2024-09-17T01:07:05.865 INFO:tasks.workunit.client.1.smithi143.stdout:9/701: mknod d3/d39/d42/d58/d5a/d5e/d99/cee 0 2024-09-17T01:07:05.866 INFO:tasks.workunit.client.1.smithi143.stdout:4/741: mkdir da/d3a/d40/df0 0 2024-09-17T01:07:05.867 INFO:tasks.workunit.client.1.smithi143.stdout:4/742: write da/d3a/d3e/d4a/d8c/fbd [4560720,39303] 0 2024-09-17T01:07:05.872 INFO:tasks.workunit.client.1.smithi143.stdout:1/750: creat d0/da1/ff8 x:0 0 0 2024-09-17T01:07:05.873 INFO:tasks.workunit.client.0.smithi103.stdout:6/122: dwrite d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:05.874 INFO:tasks.workunit.client.0.smithi103.stdout:6/123: chown d3/la 5 1 2024-09-17T01:07:05.874 INFO:tasks.workunit.client.1.smithi143.stdout:9/702: unlink d3/d39/d42/d80/fa4 0 2024-09-17T01:07:05.875 INFO:tasks.workunit.client.1.smithi143.stdout:1/751: dread d0/d6/d43/d6d/d8b/fcf [0,4194304] 0 2024-09-17T01:07:05.876 INFO:tasks.workunit.client.1.smithi143.stdout:2/672: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fdd x:0 0 0 2024-09-17T01:07:05.876 INFO:tasks.workunit.client.0.smithi103.stdout:6/124: read f1 [1671428,34817] 0 2024-09-17T01:07:05.876 INFO:tasks.workunit.client.0.smithi103.stdout:9/218: dwrite d7/f3b [0,4194304] 0 2024-09-17T01:07:05.877 INFO:tasks.workunit.client.0.smithi103.stdout:6/125: write d3/d16/f1b [118038,61699] 0 2024-09-17T01:07:05.880 INFO:tasks.workunit.client.1.smithi143.stdout:4/743: mkdir da/d3a/d3e/d72/da3/dc0/df1 0 2024-09-17T01:07:05.881 INFO:tasks.workunit.client.0.smithi103.stdout:1/165: truncate d2/fb 1919421 0 2024-09-17T01:07:05.882 INFO:tasks.workunit.client.1.smithi143.stdout:4/744: write da/d3a/d3e/fdf [38880,42048] 0 2024-09-17T01:07:05.883 INFO:tasks.workunit.client.1.smithi143.stdout:4/745: stat da/d3a/d3e/d4a/d8c/f9f 0 2024-09-17T01:07:05.883 INFO:tasks.workunit.client.1.smithi143.stdout:7/871: getdents d4/d1f/d4a/de4/d78/de5 0 2024-09-17T01:07:05.884 INFO:tasks.workunit.client.0.smithi103.stdout:9/219: dread d7/f3c [0,4194304] 0 2024-09-17T01:07:05.888 INFO:tasks.workunit.client.0.smithi103.stdout:6/126: dwrite d3/d25/f29 [0,4194304] 0 2024-09-17T01:07:05.892 INFO:tasks.workunit.client.0.smithi103.stdout:9/220: mknod d7/d43/c49 0 2024-09-17T01:07:05.893 INFO:tasks.workunit.client.1.smithi143.stdout:7/872: dwrite d4/d16/d97/fbf [0,4194304] 0 2024-09-17T01:07:05.893 INFO:tasks.workunit.client.0.smithi103.stdout:1/166: dwrite d2/d1c/f1e [0,4194304] 0 2024-09-17T01:07:05.896 INFO:tasks.workunit.client.0.smithi103.stdout:1/167: read - d2/de/d1f/f2c zero size 2024-09-17T01:07:05.897 INFO:tasks.workunit.client.1.smithi143.stdout:9/703: mkdir d3/d39/d6a/d9/d74/def 0 2024-09-17T01:07:05.898 INFO:tasks.workunit.client.0.smithi103.stdout:1/168: chown c0 4 1 2024-09-17T01:07:05.900 INFO:tasks.workunit.client.0.smithi103.stdout:6/127: dwrite d3/f4 [4194304,4194304] 0 2024-09-17T01:07:05.910 INFO:tasks.workunit.client.1.smithi143.stdout:4/746: rename da/d3a/de1 to da/d3a/d40/d84/db6/df2 0 2024-09-17T01:07:05.912 INFO:tasks.workunit.client.1.smithi143.stdout:8/746: dwrite d9/f11 [0,4194304] 0 2024-09-17T01:07:05.913 INFO:tasks.workunit.client.0.smithi103.stdout:7/141: dwrite d4/d11/f23 [0,4194304] 0 2024-09-17T01:07:05.914 INFO:tasks.workunit.client.0.smithi103.stdout:6/128: dread d3/f9 [0,4194304] 0 2024-09-17T01:07:05.914 INFO:tasks.workunit.client.1.smithi143.stdout:1/752: fsync d0/fee 0 2024-09-17T01:07:05.915 INFO:tasks.workunit.client.0.smithi103.stdout:6/129: write d3/f4 [8180490,53536] 0 2024-09-17T01:07:05.917 INFO:tasks.workunit.client.1.smithi143.stdout:1/753: truncate d0/d6/d43/d6a/d52/db2/db6/fe4 4477897 0 2024-09-17T01:07:05.919 INFO:tasks.workunit.client.1.smithi143.stdout:1/754: write d0/dc/d74/d94/f9a [690320,94217] 0 2024-09-17T01:07:05.919 INFO:tasks.workunit.client.0.smithi103.stdout:6/130: write d3/d16/f1e [127071,63546] 0 2024-09-17T01:07:05.920 INFO:tasks.workunit.client.0.smithi103.stdout:6/131: chown d3/d16/c1c 65676280 1 2024-09-17T01:07:05.921 INFO:tasks.workunit.client.1.smithi143.stdout:1/755: chown d0/dc/c7c 515146 1 2024-09-17T01:07:05.926 INFO:tasks.workunit.client.1.smithi143.stdout:7/873: rename d4/d26/fae to d4/d16/d97/f119 0 2024-09-17T01:07:05.927 INFO:tasks.workunit.client.0.smithi103.stdout:6/132: dwrite d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:05.928 INFO:tasks.workunit.client.1.smithi143.stdout:8/747: fsync d9/d23/d32/fb7 0 2024-09-17T01:07:05.930 INFO:tasks.workunit.client.1.smithi143.stdout:2/673: write d0/d10/f33 [1482539,13106] 0 2024-09-17T01:07:05.931 INFO:tasks.workunit.client.0.smithi103.stdout:6/133: creat d3/f2b x:0 0 0 2024-09-17T01:07:05.931 INFO:tasks.workunit.client.0.smithi103.stdout:7/142: dread d4/fa [0,4194304] 0 2024-09-17T01:07:05.932 INFO:tasks.workunit.client.1.smithi143.stdout:1/756: mkdir d0/d6/d43/d47/dbf/deb/df9 0 2024-09-17T01:07:05.933 INFO:tasks.workunit.client.1.smithi143.stdout:4/747: unlink da/c10 0 2024-09-17T01:07:05.934 INFO:tasks.workunit.client.0.smithi103.stdout:7/143: write d4/fa [2743304,106898] 0 2024-09-17T01:07:05.935 INFO:tasks.workunit.client.1.smithi143.stdout:9/704: rename d3/d3d/f43 to d3/d39/d42/d58/d5a/d5e/d99/ff0 0 2024-09-17T01:07:05.937 INFO:tasks.workunit.client.1.smithi143.stdout:7/874: symlink d4/d16/d97/da3/l11a 0 2024-09-17T01:07:05.938 INFO:tasks.workunit.client.1.smithi143.stdout:1/757: write d0/d6/d43/d47/d72/fc7 [560808,98568] 0 2024-09-17T01:07:05.942 INFO:tasks.workunit.client.1.smithi143.stdout:2/674: dwrite d0/d2/d21/f49 [4194304,4194304] 0 2024-09-17T01:07:05.942 INFO:tasks.workunit.client.1.smithi143.stdout:1/758: read d0/dc/d74/f8a [81499,54825] 0 2024-09-17T01:07:05.942 INFO:tasks.workunit.client.1.smithi143.stdout:9/705: dread d3/d39/d6a/d9/fa8 [0,4194304] 0 2024-09-17T01:07:05.943 INFO:tasks.workunit.client.1.smithi143.stdout:8/748: rename d9/d12/d38/d58/d70/f71 to d9/d23/db4/d55/d57/f10c 0 2024-09-17T01:07:05.946 INFO:tasks.workunit.client.1.smithi143.stdout:7/875: fsync d4/d1f/d29/d65/d5d/f51 0 2024-09-17T01:07:05.947 INFO:tasks.workunit.client.1.smithi143.stdout:1/759: fsync d0/d6/d43/f67 0 2024-09-17T01:07:05.948 INFO:tasks.workunit.client.1.smithi143.stdout:7/876: write d4/d1f/d4a/fa0 [30817,15213] 0 2024-09-17T01:07:05.949 INFO:tasks.workunit.client.1.smithi143.stdout:8/749: mkdir d9/d12/d38/d58/d79/d10d 0 2024-09-17T01:07:05.950 INFO:tasks.workunit.client.1.smithi143.stdout:2/675: rename d0/d10/d58/d5a/d5b/d4c/d71/l7e to d0/d10/d58/d5a/d5b/d4c/d71/dd2/lde 0 2024-09-17T01:07:05.952 INFO:tasks.workunit.client.1.smithi143.stdout:4/748: getdents da/d3a/d40/d84 0 2024-09-17T01:07:05.953 INFO:tasks.workunit.client.0.smithi103.stdout:1/169: write d2/f6 [2840641,75028] 0 2024-09-17T01:07:05.953 INFO:tasks.workunit.client.1.smithi143.stdout:1/760: symlink d0/dc/d57/dc2/lfa 0 2024-09-17T01:07:05.954 INFO:tasks.workunit.client.0.smithi103.stdout:1/170: write d2/d7/fc [1878611,83724] 0 2024-09-17T01:07:05.955 INFO:tasks.workunit.client.0.smithi103.stdout:1/171: stat d2/d1c/d20 0 2024-09-17T01:07:05.955 INFO:tasks.workunit.client.1.smithi143.stdout:7/877: symlink d4/d1f/d4a/de4/d78/de5/l11b 0 2024-09-17T01:07:05.958 INFO:tasks.workunit.client.1.smithi143.stdout:2/676: chown d0/fc 306 1 2024-09-17T01:07:05.959 INFO:tasks.workunit.client.0.smithi103.stdout:1/172: dread d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:05.959 INFO:tasks.workunit.client.1.smithi143.stdout:2/677: write d0/d44/d7a/f89 [4151600,26324] 0 2024-09-17T01:07:05.960 INFO:tasks.workunit.client.0.smithi103.stdout:1/173: write d2/f4 [986627,43422] 0 2024-09-17T01:07:05.960 INFO:tasks.workunit.client.1.smithi143.stdout:2/678: read d0/d2/d21/d22/f2d [1743800,8487] 0 2024-09-17T01:07:05.961 INFO:tasks.workunit.client.1.smithi143.stdout:8/750: creat d9/d23/db4/d55/d57/d108/f10e x:0 0 0 2024-09-17T01:07:05.964 INFO:tasks.workunit.client.0.smithi103.stdout:1/174: unlink c0 0 2024-09-17T01:07:05.965 INFO:tasks.workunit.client.0.smithi103.stdout:1/175: write d2/f1a [488283,51788] 0 2024-09-17T01:07:05.965 INFO:tasks.workunit.client.0.smithi103.stdout:7/144: write d4/f1a [4804607,44065] 0 2024-09-17T01:07:05.966 INFO:tasks.workunit.client.0.smithi103.stdout:7/145: stat d4/l1c 0 2024-09-17T01:07:05.972 INFO:tasks.workunit.client.0.smithi103.stdout:1/176: dwrite d2/f1a [0,4194304] 0 2024-09-17T01:07:05.973 INFO:tasks.workunit.client.0.smithi103.stdout:1/177: chown d2/d16/d18 7799241 1 2024-09-17T01:07:05.978 INFO:tasks.workunit.client.0.smithi103.stdout:7/146: dwrite d4/d11/f18 [0,4194304] 0 2024-09-17T01:07:05.984 INFO:tasks.workunit.client.0.smithi103.stdout:1/178: dwrite d2/de/d1f/f2c [0,4194304] 0 2024-09-17T01:07:05.988 INFO:tasks.workunit.client.0.smithi103.stdout:7/147: dwrite d4/d11/f18 [0,4194304] 0 2024-09-17T01:07:05.991 INFO:tasks.workunit.client.0.smithi103.stdout:7/148: mkdir d4/d11/d34 0 2024-09-17T01:07:05.992 INFO:tasks.workunit.client.0.smithi103.stdout:7/149: fdatasync d4/f7 0 2024-09-17T01:07:05.993 INFO:tasks.workunit.client.0.smithi103.stdout:7/150: write d4/d11/f2a [1869712,60049] 0 2024-09-17T01:07:06.002 INFO:tasks.workunit.client.0.smithi103.stdout:1/179: truncate d2/ff 2393720 0 2024-09-17T01:07:06.004 INFO:tasks.workunit.client.0.smithi103.stdout:7/151: dread d4/d11/f19 [0,4194304] 0 2024-09-17T01:07:06.005 INFO:tasks.workunit.client.0.smithi103.stdout:1/180: unlink d2/d16/f25 0 2024-09-17T01:07:06.010 INFO:tasks.workunit.client.0.smithi103.stdout:1/181: dwrite d2/d7/f19 [0,4194304] 0 2024-09-17T01:07:06.017 INFO:tasks.workunit.client.0.smithi103.stdout:1/182: rename d2/ff to d2/de/d1f/f34 0 2024-09-17T01:07:06.019 INFO:tasks.workunit.client.0.smithi103.stdout:1/183: chown d2/c12 1945906 1 2024-09-17T01:07:06.019 INFO:tasks.workunit.client.0.smithi103.stdout:1/184: write d2/f4 [956888,71317] 0 2024-09-17T01:07:06.019 INFO:tasks.workunit.client.0.smithi103.stdout:7/152: dwrite d4/fb [4194304,4194304] 0 2024-09-17T01:07:06.021 INFO:tasks.workunit.client.0.smithi103.stdout:7/153: truncate d4/d10/f1d 1379618 0 2024-09-17T01:07:06.022 INFO:tasks.workunit.client.0.smithi103.stdout:1/185: creat d2/d31/f35 x:0 0 0 2024-09-17T01:07:06.023 INFO:tasks.workunit.client.0.smithi103.stdout:1/186: write d2/de/f1b [328967,125676] 0 2024-09-17T01:07:06.028 INFO:tasks.workunit.client.0.smithi103.stdout:7/154: dwrite d4/d11/f18 [0,4194304] 0 2024-09-17T01:07:06.032 INFO:tasks.workunit.client.0.smithi103.stdout:1/187: dwrite d2/de/f14 [0,4194304] 0 2024-09-17T01:07:06.036 INFO:tasks.workunit.client.0.smithi103.stdout:1/188: creat d2/f36 x:0 0 0 2024-09-17T01:07:06.036 INFO:tasks.workunit.client.0.smithi103.stdout:1/189: stat d2/d7/c13 0 2024-09-17T01:07:06.044 INFO:tasks.workunit.client.0.smithi103.stdout:1/190: dwrite d2/f36 [0,4194304] 0 2024-09-17T01:07:06.048 INFO:tasks.workunit.client.0.smithi103.stdout:7/155: dwrite d4/d10/f25 [0,4194304] 0 2024-09-17T01:07:06.052 INFO:tasks.workunit.client.0.smithi103.stdout:1/191: dread d2/de/d1f/f27 [0,4194304] 0 2024-09-17T01:07:06.054 INFO:tasks.workunit.client.0.smithi103.stdout:8/152: sync 2024-09-17T01:07:06.059 INFO:tasks.workunit.client.0.smithi103.stdout:1/192: dwrite d2/d16/f30 [0,4194304] 0 2024-09-17T01:07:06.062 INFO:tasks.workunit.client.0.smithi103.stdout:1/193: creat d2/d7/f37 x:0 0 0 2024-09-17T01:07:06.063 INFO:tasks.workunit.client.1.smithi143.stdout:4/749: unlink da/d3a/d40/d84/c45 0 2024-09-17T01:07:06.063 INFO:tasks.workunit.client.0.smithi103.stdout:1/194: write d2/d7/f37 [902101,58694] 0 2024-09-17T01:07:06.064 INFO:tasks.workunit.client.0.smithi103.stdout:1/195: dread - d2/d31/f35 zero size 2024-09-17T01:07:06.064 INFO:tasks.workunit.client.1.smithi143.stdout:9/706: rename d3/d39/d6a/d9/f98 to d3/d39/d6a/dc3/d3e/ff1 0 2024-09-17T01:07:06.066 INFO:tasks.workunit.client.1.smithi143.stdout:9/707: chown d3/d3d/d48/lc2 13399677 1 2024-09-17T01:07:06.068 INFO:tasks.workunit.client.0.smithi103.stdout:1/196: rename d2/de/d1f/f2c to d2/d1c/f38 0 2024-09-17T01:07:06.068 INFO:tasks.workunit.client.1.smithi143.stdout:1/761: link d0/d6/d43/d6a/d52/l91 d0/d6/d43/d6d/d8b/dd0/lfb 0 2024-09-17T01:07:06.068 INFO:tasks.workunit.client.1.smithi143.stdout:2/679: dwrite d0/d10/d58/d5a/d5b/d4c/d59/f9a [0,4194304] 0 2024-09-17T01:07:06.069 INFO:tasks.workunit.client.0.smithi103.stdout:1/197: truncate d2/d31/f35 496590 0 2024-09-17T01:07:06.070 INFO:tasks.workunit.client.1.smithi143.stdout:1/762: stat d0/d6/d43/d6a/fc1 0 2024-09-17T01:07:06.070 INFO:tasks.workunit.client.0.smithi103.stdout:1/198: read d2/d16/f2a [2328244,29656] 0 2024-09-17T01:07:06.070 INFO:tasks.workunit.client.1.smithi143.stdout:8/751: rename d9/d12/d13/c67 to d9/d12/d38/d7a/d8f/c10f 0 2024-09-17T01:07:06.071 INFO:tasks.workunit.client.1.smithi143.stdout:1/763: stat d0/d6/d43/d6a/df/d6e/d2/fa6 0 2024-09-17T01:07:06.073 INFO:tasks.workunit.client.0.smithi103.stdout:8/153: write d0/d6/f22 [1539759,95490] 0 2024-09-17T01:07:06.075 INFO:tasks.workunit.client.0.smithi103.stdout:1/199: creat d2/d1c/d20/f39 x:0 0 0 2024-09-17T01:07:06.080 INFO:tasks.workunit.client.0.smithi103.stdout:7/156: dwrite d4/f5 [0,4194304] 0 2024-09-17T01:07:06.081 INFO:tasks.workunit.client.1.smithi143.stdout:8/752: creat d9/d12/d38/d7a/f110 x:0 0 0 2024-09-17T01:07:06.082 INFO:tasks.workunit.client.1.smithi143.stdout:1/764: creat d0/d6/d43/d47/d68/d7b/daf/ffc x:0 0 0 2024-09-17T01:07:06.083 INFO:tasks.workunit.client.0.smithi103.stdout:7/157: dread d4/d11/f19 [0,4194304] 0 2024-09-17T01:07:06.083 INFO:tasks.workunit.client.1.smithi143.stdout:1/765: truncate d0/da1/ff8 870270 0 2024-09-17T01:07:06.084 INFO:tasks.workunit.client.0.smithi103.stdout:1/200: symlink d2/d16/l3a 0 2024-09-17T01:07:06.088 INFO:tasks.workunit.client.0.smithi103.stdout:8/154: mkdir d0/d6/dc/d30/d2d/d32/d34 0 2024-09-17T01:07:06.088 INFO:tasks.workunit.client.0.smithi103.stdout:8/155: stat d0/d6/dc/d30/d25 0 2024-09-17T01:07:06.092 INFO:tasks.workunit.client.1.smithi143.stdout:8/753: creat d9/d12/df4/f111 x:0 0 0 2024-09-17T01:07:06.092 INFO:tasks.workunit.client.1.smithi143.stdout:1/766: rename d0/d6/d43/l93 to d0/d6/d43/d47/dd3/lfd 0 2024-09-17T01:07:06.093 INFO:tasks.workunit.client.0.smithi103.stdout:1/201: creat d2/de/d1f/f3b x:0 0 0 2024-09-17T01:07:06.093 INFO:tasks.workunit.client.1.smithi143.stdout:1/767: read d0/d6/d43/d6a/df/d6e/d2/f56 [4931186,117926] 0 2024-09-17T01:07:06.093 INFO:tasks.workunit.client.1.smithi143.stdout:9/708: creat d3/d39/d42/d58/ff2 x:0 0 0 2024-09-17T01:07:06.095 INFO:tasks.workunit.client.1.smithi143.stdout:9/709: read d3/d39/d42/d58/d5a/d5e/d99/ff0 [16524,115854] 0 2024-09-17T01:07:06.098 INFO:tasks.workunit.client.1.smithi143.stdout:1/768: mkdir d0/d6/d43/d6d/d8b/dfe 0 2024-09-17T01:07:06.098 INFO:tasks.workunit.client.1.smithi143.stdout:9/710: write d3/d39/d42/d58/d5a/d5e/fce [265162,96765] 0 2024-09-17T01:07:06.099 INFO:tasks.workunit.client.0.smithi103.stdout:1/202: dwrite d2/d16/f2a [0,4194304] 0 2024-09-17T01:07:06.099 INFO:tasks.workunit.client.1.smithi143.stdout:2/680: dwrite d0/d2/d21/f32 [8388608,4194304] 0 2024-09-17T01:07:06.101 INFO:tasks.workunit.client.1.smithi143.stdout:4/750: creat da/d3a/d40/ff3 x:0 0 0 2024-09-17T01:07:06.102 INFO:tasks.workunit.client.1.smithi143.stdout:6/644: sync 2024-09-17T01:07:06.103 INFO:tasks.workunit.client.0.smithi103.stdout:1/203: readlink d2/d7/l9 0 2024-09-17T01:07:06.105 INFO:tasks.workunit.client.1.smithi143.stdout:1/769: fsync d0/d6/d43/d47/d68/f92 0 2024-09-17T01:07:06.106 INFO:tasks.workunit.client.0.smithi103.stdout:8/156: dread d0/d6/f22 [0,4194304] 0 2024-09-17T01:07:06.108 INFO:tasks.workunit.client.1.smithi143.stdout:2/681: mkdir d0/d44/d6a/d91/ddf 0 2024-09-17T01:07:06.108 INFO:tasks.workunit.client.0.smithi103.stdout:8/157: write d0/d6/f1d [2554272,24453] 0 2024-09-17T01:07:06.108 INFO:tasks.workunit.client.1.smithi143.stdout:8/754: dread d9/f59 [0,4194304] 0 2024-09-17T01:07:06.109 INFO:tasks.workunit.client.1.smithi143.stdout:4/751: fsync da/d3a/d40/d84/db6/fc1 0 2024-09-17T01:07:06.110 INFO:tasks.workunit.client.0.smithi103.stdout:1/204: creat d2/d1c/d20/d33/f3c x:0 0 0 2024-09-17T01:07:06.112 INFO:tasks.workunit.client.0.smithi103.stdout:7/158: dread d4/d11/d2b/f2f [0,4194304] 0 2024-09-17T01:07:06.113 INFO:tasks.workunit.client.0.smithi103.stdout:7/159: fsync d4/f5 0 2024-09-17T01:07:06.115 INFO:tasks.workunit.client.1.smithi143.stdout:1/770: symlink d0/d6/d43/d6a/d52/lff 0 2024-09-17T01:07:06.117 INFO:tasks.workunit.client.1.smithi143.stdout:8/755: chown d9/de/d53/d75/daf/c106 291 1 2024-09-17T01:07:06.117 INFO:tasks.workunit.client.0.smithi103.stdout:7/160: dread d4/d10/f25 [0,4194304] 0 2024-09-17T01:07:06.120 INFO:tasks.workunit.client.0.smithi103.stdout:8/158: creat d0/d6/dc/f35 x:0 0 0 2024-09-17T01:07:06.122 INFO:tasks.workunit.client.0.smithi103.stdout:7/161: creat d4/d10/f35 x:0 0 0 2024-09-17T01:07:06.125 INFO:tasks.workunit.client.1.smithi143.stdout:8/756: mkdir d9/d12/d38/d58/d79/d112 0 2024-09-17T01:07:06.126 INFO:tasks.workunit.client.1.smithi143.stdout:8/757: chown d9/d12/d13/d73 426917734 1 2024-09-17T01:07:06.126 INFO:tasks.workunit.client.1.smithi143.stdout:8/758: read - d9/fab zero size 2024-09-17T01:07:06.127 INFO:tasks.workunit.client.1.smithi143.stdout:9/711: getdents d3/d39/d42/d58 0 2024-09-17T01:07:06.128 INFO:tasks.workunit.client.0.smithi103.stdout:8/159: creat d0/d6/f36 x:0 0 0 2024-09-17T01:07:06.129 INFO:tasks.workunit.client.1.smithi143.stdout:1/771: dread d0/dc/d89/f95 [0,4194304] 0 2024-09-17T01:07:06.133 INFO:tasks.workunit.client.1.smithi143.stdout:8/759: unlink d9/de/d53/ffb 0 2024-09-17T01:07:06.134 INFO:tasks.workunit.client.1.smithi143.stdout:8/760: chown d9/d2b 11065 1 2024-09-17T01:07:06.134 INFO:tasks.workunit.client.0.smithi103.stdout:8/160: symlink d0/d6/dc/d30/d2d/d32/l37 0 2024-09-17T01:07:06.135 INFO:tasks.workunit.client.1.smithi143.stdout:8/761: fsync d9/d12/ff7 0 2024-09-17T01:07:06.135 INFO:tasks.workunit.client.1.smithi143.stdout:6/645: getdents d2/d17/d6e 0 2024-09-17T01:07:06.136 INFO:tasks.workunit.client.0.smithi103.stdout:8/161: readlink d0/d6/dc/l29 0 2024-09-17T01:07:06.138 INFO:tasks.workunit.client.0.smithi103.stdout:1/205: truncate d2/de/d1f/f27 821973 0 2024-09-17T01:07:06.140 INFO:tasks.workunit.client.1.smithi143.stdout:8/762: creat d9/d23/db4/d55/f113 x:0 0 0 2024-09-17T01:07:06.142 INFO:tasks.workunit.client.1.smithi143.stdout:9/712: truncate d3/d3d/d48/f59 4143320 0 2024-09-17T01:07:06.144 INFO:tasks.workunit.client.1.smithi143.stdout:6/646: mknod d2/df/cd7 0 2024-09-17T01:07:06.144 INFO:tasks.workunit.client.1.smithi143.stdout:4/752: dread da/d3a/d3e/d5e/fa2 [0,4194304] 0 2024-09-17T01:07:06.147 INFO:tasks.workunit.client.1.smithi143.stdout:6/647: symlink d2/df/d18/d69/ld8 0 2024-09-17T01:07:06.148 INFO:tasks.workunit.client.1.smithi143.stdout:4/753: write da/d3a/d40/fe5 [986983,130201] 0 2024-09-17T01:07:06.153 INFO:tasks.workunit.client.1.smithi143.stdout:6/648: truncate d2/d19/f98 734006 0 2024-09-17T01:07:06.153 INFO:tasks.workunit.client.1.smithi143.stdout:9/713: dwrite d3/d39/d42/d58/fe2 [0,4194304] 0 2024-09-17T01:07:06.154 INFO:tasks.workunit.client.1.smithi143.stdout:4/754: creat da/d3a/d3e/d72/ff4 x:0 0 0 2024-09-17T01:07:06.155 INFO:tasks.workunit.client.1.smithi143.stdout:1/772: truncate d0/d6/d43/d6d/d8b/dd0/de2/d6b/d9d/ff3 2393806 0 2024-09-17T01:07:06.156 INFO:tasks.workunit.client.1.smithi143.stdout:2/682: dwrite d0/d2/d21/d84/d8d/fb9 [0,4194304] 0 2024-09-17T01:07:06.159 INFO:tasks.workunit.client.1.smithi143.stdout:6/649: chown d2/d30/d45/d70/d87/fae 303 1 2024-09-17T01:07:06.161 INFO:tasks.workunit.client.1.smithi143.stdout:2/683: creat d0/d10/d56/fe0 x:0 0 0 2024-09-17T01:07:06.161 INFO:tasks.workunit.client.1.smithi143.stdout:4/755: write da/d3a/d40/daa/dc3/fd4 [191442,69395] 0 2024-09-17T01:07:06.163 INFO:tasks.workunit.client.1.smithi143.stdout:6/650: readlink d2/df/d20/d2c/l4e 0 2024-09-17T01:07:06.166 INFO:tasks.workunit.client.1.smithi143.stdout:8/763: dwrite d9/d2b/f78 [0,4194304] 0 2024-09-17T01:07:06.167 INFO:tasks.workunit.client.1.smithi143.stdout:8/764: write d9/d23/fd0 [493199,30277] 0 2024-09-17T01:07:06.169 INFO:tasks.workunit.client.0.smithi103.stdout:8/162: dwrite d0/d6/dc/d30/f26 [0,4194304] 0 2024-09-17T01:07:06.172 INFO:tasks.workunit.client.1.smithi143.stdout:9/714: rename d3/d39/d42/d58/d5a/d5e to d3/d39/d42/d80/df3 0 2024-09-17T01:07:06.173 INFO:tasks.workunit.client.0.smithi103.stdout:1/206: dwrite d2/f6 [0,4194304] 0 2024-09-17T01:07:06.173 INFO:tasks.workunit.client.1.smithi143.stdout:2/684: creat d0/d10/d58/d5a/d5b/d4c/d77/fe1 x:0 0 0 2024-09-17T01:07:06.174 INFO:tasks.workunit.client.1.smithi143.stdout:2/685: chown d0/d44/d7a/d86/d97/fcd 6547839 1 2024-09-17T01:07:06.175 INFO:tasks.workunit.client.1.smithi143.stdout:6/651: rmdir d2/d17/d6e/d26/d46/d65 39 2024-09-17T01:07:06.178 INFO:tasks.workunit.client.0.smithi103.stdout:1/207: creat d2/d16/f3d x:0 0 0 2024-09-17T01:07:06.182 INFO:tasks.workunit.client.0.smithi103.stdout:8/163: mknod d0/d6/dc/c38 0 2024-09-17T01:07:06.182 INFO:tasks.workunit.client.0.smithi103.stdout:8/164: chown d0/c2a 14 1 2024-09-17T01:07:06.184 INFO:tasks.workunit.client.0.smithi103.stdout:1/208: mknod d2/d1c/c3e 0 2024-09-17T01:07:06.186 INFO:tasks.workunit.client.1.smithi143.stdout:8/765: creat d9/d23/db4/d55/dfe/f114 x:0 0 0 2024-09-17T01:07:06.189 INFO:tasks.workunit.client.0.smithi103.stdout:1/209: symlink d2/d1c/l3f 0 2024-09-17T01:07:06.190 INFO:tasks.workunit.client.1.smithi143.stdout:1/773: creat d0/d6/d43/d6d/d8b/dd0/de2/f100 x:0 0 0 2024-09-17T01:07:06.192 INFO:tasks.workunit.client.1.smithi143.stdout:2/686: symlink d0/d44/d6a/d91/dc4/le2 0 2024-09-17T01:07:06.192 INFO:tasks.workunit.client.1.smithi143.stdout:0/701: sync 2024-09-17T01:07:06.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/732: sync 2024-09-17T01:07:06.193 INFO:tasks.workunit.client.1.smithi143.stdout:5/681: sync 2024-09-17T01:07:06.194 INFO:tasks.workunit.client.0.smithi103.stdout:8/165: creat d0/d6/f39 x:0 0 0 2024-09-17T01:07:06.195 INFO:tasks.workunit.client.0.smithi103.stdout:8/166: stat d0/d6/dc/d30/d25/l31 0 2024-09-17T01:07:06.196 INFO:tasks.workunit.client.1.smithi143.stdout:4/756: truncate da/d6d/fd6 676505 0 2024-09-17T01:07:06.196 INFO:tasks.workunit.client.1.smithi143.stdout:4/757: readlink da/d3a/d3e/d4a/d8c/lb4 0 2024-09-17T01:07:06.197 INFO:tasks.workunit.client.1.smithi143.stdout:4/758: stat da/d3a/d40/d84/db6/fc9 0 2024-09-17T01:07:06.199 INFO:tasks.workunit.client.0.smithi103.stdout:8/167: dread d0/d6/dc/d30/f26 [0,4194304] 0 2024-09-17T01:07:06.200 INFO:tasks.workunit.client.0.smithi103.stdout:1/210: getdents d2/d7 0 2024-09-17T01:07:06.201 INFO:tasks.workunit.client.1.smithi143.stdout:2/687: rmdir d0/d2/d21/d84 39 2024-09-17T01:07:06.202 INFO:tasks.workunit.client.0.smithi103.stdout:1/211: write d2/f8 [2500245,116152] 0 2024-09-17T01:07:06.202 INFO:tasks.workunit.client.0.smithi103.stdout:1/212: stat d2/d1c/d20/d33/f3c 0 2024-09-17T01:07:06.203 INFO:tasks.workunit.client.1.smithi143.stdout:9/715: dwrite d3/d39/f4f [4194304,4194304] 0 2024-09-17T01:07:06.204 INFO:tasks.workunit.client.1.smithi143.stdout:5/682: unlink d1/d46/df/d53/l8f 0 2024-09-17T01:07:06.205 INFO:tasks.workunit.client.0.smithi103.stdout:8/168: read d0/d6/dc/d30/f1f [3966691,23564] 0 2024-09-17T01:07:06.207 INFO:tasks.workunit.client.1.smithi143.stdout:0/702: rename d3/lb to d3/d88/le1 0 2024-09-17T01:07:06.210 INFO:tasks.workunit.client.0.smithi103.stdout:1/213: rename d2/f4 to d2/d16/f40 0 2024-09-17T01:07:06.212 INFO:tasks.workunit.client.1.smithi143.stdout:6/652: truncate d2/d30/d45/d70/f78 1596699 0 2024-09-17T01:07:06.213 INFO:tasks.workunit.client.0.smithi103.stdout:1/214: truncate d2/d1c/d20/d33/f3c 262527 0 2024-09-17T01:07:06.215 INFO:tasks.workunit.client.1.smithi143.stdout:4/759: symlink da/d3a/d40/daa/lf5 0 2024-09-17T01:07:06.217 INFO:tasks.workunit.client.1.smithi143.stdout:1/774: mknod d0/d6/d43/d47/dbf/deb/df9/c101 0 2024-09-17T01:07:06.218 INFO:tasks.workunit.client.0.smithi103.stdout:1/215: mknod d2/d1c/d28/c41 0 2024-09-17T01:07:06.218 INFO:tasks.workunit.client.1.smithi143.stdout:3/733: stat d6/d1c/d33/d3f/f7f 0 2024-09-17T01:07:06.219 INFO:tasks.workunit.client.1.smithi143.stdout:3/734: dread - d6/d1c/d33/d3f/d5c/da1/fca zero size 2024-09-17T01:07:06.220 INFO:tasks.workunit.client.1.smithi143.stdout:3/735: chown d6/d1c/d33/d41/d42/fc9 880792 1 2024-09-17T01:07:06.220 INFO:tasks.workunit.client.1.smithi143.stdout:2/688: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fe3 x:0 0 0 2024-09-17T01:07:06.221 INFO:tasks.workunit.client.0.smithi103.stdout:8/169: rename d0/d6/dc/l1e to d0/d6/dc/l3a 0 2024-09-17T01:07:06.223 INFO:tasks.workunit.client.0.smithi103.stdout:1/216: rename d2/d1c/d28/l2d to d2/d1c/d20/d33/l42 0 2024-09-17T01:07:06.225 INFO:tasks.workunit.client.1.smithi143.stdout:6/653: fsync d2/d30/d84/faa 0 2024-09-17T01:07:06.225 INFO:tasks.workunit.client.1.smithi143.stdout:6/654: chown d2/df/d18/da8 2 1 2024-09-17T01:07:06.226 INFO:tasks.workunit.client.1.smithi143.stdout:8/766: creat d9/d12/f115 x:0 0 0 2024-09-17T01:07:06.226 INFO:tasks.workunit.client.1.smithi143.stdout:4/760: rmdir da/d3a/d3e/d72/d9e/da1 39 2024-09-17T01:07:06.227 INFO:tasks.workunit.client.1.smithi143.stdout:6/655: read d2/d19/f8a [2046497,18987] 0 2024-09-17T01:07:06.227 INFO:tasks.workunit.client.1.smithi143.stdout:1/775: symlink d0/d6/d43/d6a/df/d6e/l102 0 2024-09-17T01:07:06.228 INFO:tasks.workunit.client.1.smithi143.stdout:5/683: dread d1/d46/df/d23/d4f/f6a [0,4194304] 0 2024-09-17T01:07:06.232 INFO:tasks.workunit.client.1.smithi143.stdout:9/716: mkdir d3/d3d/de3/df4 0 2024-09-17T01:07:06.233 INFO:tasks.workunit.client.0.smithi103.stdout:8/170: getdents d0/d6 0 2024-09-17T01:07:06.236 INFO:tasks.workunit.client.1.smithi143.stdout:3/736: write d6/d1c/d33/d3f/f75 [430499,112924] 0 2024-09-17T01:07:06.236 INFO:tasks.workunit.client.0.smithi103.stdout:1/217: link d2/c12 d2/d1c/d20/c43 0 2024-09-17T01:07:06.237 INFO:tasks.workunit.client.1.smithi143.stdout:2/689: creat d0/d44/d6a/fe4 x:0 0 0 2024-09-17T01:07:06.239 INFO:tasks.workunit.client.1.smithi143.stdout:2/690: write d0/d10/d56/fb7 [294257,104192] 0 2024-09-17T01:07:06.240 INFO:tasks.workunit.client.0.smithi103.stdout:8/171: dread d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:06.241 INFO:tasks.workunit.client.1.smithi143.stdout:0/703: symlink d3/d5/d8/d27/le2 0 2024-09-17T01:07:06.243 INFO:tasks.workunit.client.1.smithi143.stdout:7/878: sync 2024-09-17T01:07:06.243 INFO:tasks.workunit.client.0.smithi103.stdout:1/218: dread d2/de/d1f/f34 [0,4194304] 0 2024-09-17T01:07:06.246 INFO:tasks.workunit.client.0.smithi103.stdout:8/172: fsync d0/d6/dc/f11 0 2024-09-17T01:07:06.246 INFO:tasks.workunit.client.0.smithi103.stdout:8/173: stat d0/c2a 0 2024-09-17T01:07:06.248 INFO:tasks.workunit.client.0.smithi103.stdout:8/174: truncate d0/d6/dc/f35 970747 0 2024-09-17T01:07:06.248 INFO:tasks.workunit.client.0.smithi103.stdout:1/219: chown d2/de/d1f/f27 737 1 2024-09-17T01:07:06.255 INFO:tasks.workunit.client.0.smithi103.stdout:8/175: dwrite d0/d6/f36 [0,4194304] 0 2024-09-17T01:07:06.256 INFO:tasks.workunit.client.1.smithi143.stdout:1/776: creat d0/d6/d64/f103 x:0 0 0 2024-09-17T01:07:06.257 INFO:tasks.workunit.client.1.smithi143.stdout:6/656: creat d2/df/d20/d2c/d75/fd9 x:0 0 0 2024-09-17T01:07:06.257 INFO:tasks.workunit.client.1.smithi143.stdout:3/737: mknod d6/d1c/d33/d3f/d5c/da1/ce3 0 2024-09-17T01:07:06.258 INFO:tasks.workunit.client.1.smithi143.stdout:2/691: symlink d0/d10/d58/d5a/d5b/d4c/d71/dd2/le5 0 2024-09-17T01:07:06.258 INFO:tasks.workunit.client.1.smithi143.stdout:0/704: rmdir d3/d5/d35/da8/daf 39 2024-09-17T01:07:06.258 INFO:tasks.workunit.client.0.smithi103.stdout:1/220: dwrite d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:06.259 INFO:tasks.workunit.client.1.smithi143.stdout:7/879: creat d4/d1f/d29/d65/d5d/db1/f11c x:0 0 0 2024-09-17T01:07:06.260 INFO:tasks.workunit.client.0.smithi103.stdout:8/176: readlink d0/d6/dc/l3a 0 2024-09-17T01:07:06.261 INFO:tasks.workunit.client.1.smithi143.stdout:1/777: write d0/d6/d43/d6a/df/d6e/d2/fa6 [683492,75958] 0 2024-09-17T01:07:06.265 INFO:tasks.workunit.client.0.smithi103.stdout:8/177: write d0/d6/dc/d30/d25/f27 [228536,120367] 0 2024-09-17T01:07:06.266 INFO:tasks.workunit.client.0.smithi103.stdout:8/178: readlink d0/d6/dc/d30/d2d/l2f 0 2024-09-17T01:07:06.269 INFO:tasks.workunit.client.0.smithi103.stdout:8/179: unlink d0/d6/dc/l3a 0 2024-09-17T01:07:06.271 INFO:tasks.workunit.client.0.smithi103.stdout:8/180: read d0/d6/dc/f35 [706179,109964] 0 2024-09-17T01:07:06.274 INFO:tasks.workunit.client.0.smithi103.stdout:1/221: truncate d2/f8 2018649 0 2024-09-17T01:07:06.275 INFO:tasks.workunit.client.0.smithi103.stdout:8/181: rename d0/d6/f22 to d0/d6/f3b 0 2024-09-17T01:07:06.279 INFO:tasks.workunit.client.0.smithi103.stdout:8/182: stat d0/d6/f1d 0 2024-09-17T01:07:06.283 INFO:tasks.workunit.client.0.smithi103.stdout:8/183: rmdir d0/d6/dc/d30/d25 39 2024-09-17T01:07:06.290 INFO:tasks.workunit.client.0.smithi103.stdout:8/184: dwrite d0/d6/dc/f35 [0,4194304] 0 2024-09-17T01:07:06.291 INFO:tasks.workunit.client.0.smithi103.stdout:8/185: read d0/d6/f3b [1022791,129812] 0 2024-09-17T01:07:06.298 INFO:tasks.workunit.client.0.smithi103.stdout:1/222: dwrite d2/d7/f1d [4194304,4194304] 0 2024-09-17T01:07:06.301 INFO:tasks.workunit.client.0.smithi103.stdout:1/223: read d2/de/f1b [374788,91471] 0 2024-09-17T01:07:06.316 INFO:tasks.workunit.client.1.smithi143.stdout:5/684: creat d1/d46/df/d1f/d66/d70/de2/de3/f104 x:0 0 0 2024-09-17T01:07:06.317 INFO:tasks.workunit.client.1.smithi143.stdout:6/657: fsync d2/d17/f97 0 2024-09-17T01:07:06.318 INFO:tasks.workunit.client.1.smithi143.stdout:0/705: creat d3/d88/d93/fe3 x:0 0 0 2024-09-17T01:07:06.318 INFO:tasks.workunit.client.1.smithi143.stdout:3/738: read d6/d1c/d33/d41/f16 [634571,59655] 0 2024-09-17T01:07:06.319 INFO:tasks.workunit.client.1.smithi143.stdout:4/761: mkdir da/d68/d9b/ddd/df6 0 2024-09-17T01:07:06.320 INFO:tasks.workunit.client.1.smithi143.stdout:7/880: creat d4/d1f/d29/d65/d5d/d113/f11d x:0 0 0 2024-09-17T01:07:06.323 INFO:tasks.workunit.client.1.smithi143.stdout:5/685: dwrite d1/d46/d6e/f8d [4194304,4194304] 0 2024-09-17T01:07:06.325 INFO:tasks.workunit.client.0.smithi103.stdout:1/224: write d2/de/d1f/f34 [432789,128956] 0 2024-09-17T01:07:06.326 INFO:tasks.workunit.client.1.smithi143.stdout:0/706: chown d3/d68/l77 39867786 1 2024-09-17T01:07:06.328 INFO:tasks.workunit.client.1.smithi143.stdout:1/778: unlink d0/l9b 0 2024-09-17T01:07:06.328 INFO:tasks.workunit.client.0.smithi103.stdout:8/186: truncate d0/d6/dc/d30/d25/f27 1782032 0 2024-09-17T01:07:06.328 INFO:tasks.workunit.client.0.smithi103.stdout:8/187: chown d0/d6 213 1 2024-09-17T01:07:06.329 INFO:tasks.workunit.client.1.smithi143.stdout:7/881: readlink d4/d1f/d4a/d9e/da2/lc4 0 2024-09-17T01:07:06.329 INFO:tasks.workunit.client.1.smithi143.stdout:0/707: write d3/d5/d8/d10/f4f [523405,56683] 0 2024-09-17T01:07:06.330 INFO:tasks.workunit.client.0.smithi103.stdout:1/225: creat d2/de/f44 x:0 0 0 2024-09-17T01:07:06.331 INFO:tasks.workunit.client.1.smithi143.stdout:1/779: fdatasync d0/d6/d43/d6a/df/f8c 0 2024-09-17T01:07:06.333 INFO:tasks.workunit.client.0.smithi103.stdout:8/188: creat d0/d6/dc/d30/d2d/f3c x:0 0 0 2024-09-17T01:07:06.334 INFO:tasks.workunit.client.1.smithi143.stdout:5/686: dwrite d1/d46/df/d53/f56 [0,4194304] 0 2024-09-17T01:07:06.334 INFO:tasks.workunit.client.1.smithi143.stdout:2/692: creat d0/d10/d58/d5a/d5b/d4c/fe6 x:0 0 0 2024-09-17T01:07:06.334 INFO:tasks.workunit.client.1.smithi143.stdout:4/762: dwrite da/d3a/f51 [0,4194304] 0 2024-09-17T01:07:06.336 INFO:tasks.workunit.client.0.smithi103.stdout:1/226: unlink d2/de/c26 0 2024-09-17T01:07:06.340 INFO:tasks.workunit.client.1.smithi143.stdout:3/739: mkdir d6/d1c/d82/de4 0 2024-09-17T01:07:06.344 INFO:tasks.workunit.client.1.smithi143.stdout:0/708: rmdir d3/d5/d6b 39 2024-09-17T01:07:06.345 INFO:tasks.workunit.client.0.smithi103.stdout:1/227: dwrite d2/d16/f32 [0,4194304] 0 2024-09-17T01:07:06.350 INFO:tasks.workunit.client.1.smithi143.stdout:5/687: symlink d1/d46/df/d23/d4f/l105 0 2024-09-17T01:07:06.353 INFO:tasks.workunit.client.1.smithi143.stdout:4/763: fsync da/d3a/d40/f27 0 2024-09-17T01:07:06.356 INFO:tasks.workunit.client.1.smithi143.stdout:3/740: rename d6/f8a to d6/d1c/d4d/fe5 0 2024-09-17T01:07:06.358 INFO:tasks.workunit.client.1.smithi143.stdout:1/780: symlink d0/dc/d74/l104 0 2024-09-17T01:07:06.360 INFO:tasks.workunit.client.1.smithi143.stdout:5/688: mkdir d1/d46/d6e/d106 0 2024-09-17T01:07:06.360 INFO:tasks.workunit.client.1.smithi143.stdout:6/658: write d2/d30/d45/f50 [4445392,631] 0 2024-09-17T01:07:06.361 INFO:tasks.workunit.client.0.smithi103.stdout:1/228: link d2/d1c/d20/d33/l42 d2/d1c/d20/l45 0 2024-09-17T01:07:06.366 INFO:tasks.workunit.client.1.smithi143.stdout:2/693: dwrite d0/d2/d21/d84/d8d/fbb [0,4194304] 0 2024-09-17T01:07:06.366 INFO:tasks.workunit.client.1.smithi143.stdout:0/709: mknod d3/d5/d8/d21/d2e/dda/ce4 0 2024-09-17T01:07:06.368 INFO:tasks.workunit.client.1.smithi143.stdout:2/694: chown d0/d10/d58/d5a/d5b/d4c/d71/d9d/c5e 721056214 1 2024-09-17T01:07:06.369 INFO:tasks.workunit.client.0.smithi103.stdout:1/229: dwrite d2/d7/f1d [4194304,4194304] 0 2024-09-17T01:07:06.369 INFO:tasks.workunit.client.1.smithi143.stdout:1/781: rmdir d0/d6/d43/d6d/d8b 39 2024-09-17T01:07:06.369 INFO:tasks.workunit.client.1.smithi143.stdout:1/782: stat d0/dc/fd7 0 2024-09-17T01:07:06.370 INFO:tasks.workunit.client.0.smithi103.stdout:1/230: stat d2/d31 0 2024-09-17T01:07:06.370 INFO:tasks.workunit.client.0.smithi103.stdout:8/189: dread d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:06.371 INFO:tasks.workunit.client.1.smithi143.stdout:6/659: stat d2/df/d18/lb9 0 2024-09-17T01:07:06.372 INFO:tasks.workunit.client.0.smithi103.stdout:8/190: dread - d0/d6/dc/d30/d2d/f3c zero size 2024-09-17T01:07:06.374 INFO:tasks.workunit.client.1.smithi143.stdout:4/764: mknod da/d68/d9b/ddd/df6/cf7 0 2024-09-17T01:07:06.377 INFO:tasks.workunit.client.1.smithi143.stdout:9/717: sync 2024-09-17T01:07:06.377 INFO:tasks.workunit.client.1.smithi143.stdout:8/767: sync 2024-09-17T01:07:06.378 INFO:tasks.workunit.client.1.smithi143.stdout:5/689: rename d1/d46/df/d1f/de9/lae to d1/d46/df/d23/d4f/d7d/d102/l107 0 2024-09-17T01:07:06.380 INFO:tasks.workunit.client.0.smithi103.stdout:1/231: dwrite d2/de/f44 [0,4194304] 0 2024-09-17T01:07:06.380 INFO:tasks.workunit.client.1.smithi143.stdout:5/690: fdatasync d1/d46/df/d23/f2a 0 2024-09-17T01:07:06.381 INFO:tasks.workunit.client.1.smithi143.stdout:8/768: truncate d9/d26/fb6 603279 0 2024-09-17T01:07:06.384 INFO:tasks.workunit.client.1.smithi143.stdout:0/710: unlink d3/d5/d8/d10/f25 0 2024-09-17T01:07:06.384 INFO:tasks.workunit.client.0.smithi103.stdout:8/191: dwrite d0/d6/dc/f35 [0,4194304] 0 2024-09-17T01:07:06.385 INFO:tasks.workunit.client.1.smithi143.stdout:4/765: dwrite da/d3a/d3e/d72/d9e/fd8 [0,4194304] 0 2024-09-17T01:07:06.385 INFO:tasks.workunit.client.0.smithi103.stdout:1/232: creat d2/d31/f46 x:0 0 0 2024-09-17T01:07:06.386 INFO:tasks.workunit.client.1.smithi143.stdout:5/691: write d1/d46/df/d23/f2a [687370,128125] 0 2024-09-17T01:07:06.390 INFO:tasks.workunit.client.1.smithi143.stdout:8/769: write d9/d23/db4/d55/dfe/f94 [4825209,21664] 0 2024-09-17T01:07:06.390 INFO:tasks.workunit.client.1.smithi143.stdout:1/783: truncate d0/d6/f29 1029834 0 2024-09-17T01:07:06.392 INFO:tasks.workunit.client.0.smithi103.stdout:1/233: symlink d2/d1c/d20/l47 0 2024-09-17T01:07:06.393 INFO:tasks.workunit.client.1.smithi143.stdout:2/695: read d0/d2/d21/d22/f3c [635748,123614] 0 2024-09-17T01:07:06.393 INFO:tasks.workunit.client.1.smithi143.stdout:0/711: write d3/d5/d8/d21/f3e [4262459,115488] 0 2024-09-17T01:07:06.394 INFO:tasks.workunit.client.0.smithi103.stdout:1/234: stat d2/d31 0 2024-09-17T01:07:06.396 INFO:tasks.workunit.client.1.smithi143.stdout:7/882: dwrite d4/d16/dbd/fc9 [0,4194304] 0 2024-09-17T01:07:06.397 INFO:tasks.workunit.client.0.smithi103.stdout:8/192: dwrite d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:06.398 INFO:tasks.workunit.client.1.smithi143.stdout:2/696: write d0/d44/d6a/fc2 [896380,79758] 0 2024-09-17T01:07:06.400 INFO:tasks.workunit.client.1.smithi143.stdout:3/741: creat d6/d1c/d4b/fe6 x:0 0 0 2024-09-17T01:07:06.401 INFO:tasks.workunit.client.0.smithi103.stdout:1/235: symlink d2/d1c/d20/d33/l48 0 2024-09-17T01:07:06.406 INFO:tasks.workunit.client.0.smithi103.stdout:1/236: rename d2/d1c/l3f to d2/d1c/d28/l49 0 2024-09-17T01:07:06.406 INFO:tasks.workunit.client.0.smithi103.stdout:1/237: fsync d2/f1a 0 2024-09-17T01:07:06.409 INFO:tasks.workunit.client.1.smithi143.stdout:4/766: dread da/d3a/d40/f37 [0,4194304] 0 2024-09-17T01:07:06.409 INFO:tasks.workunit.client.1.smithi143.stdout:5/692: symlink d1/d46/df/d1f/d66/l108 0 2024-09-17T01:07:06.410 INFO:tasks.workunit.client.1.smithi143.stdout:5/693: fsync d1/d96/fef 0 2024-09-17T01:07:06.411 INFO:tasks.workunit.client.0.smithi103.stdout:8/193: dwrite d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:06.411 INFO:tasks.workunit.client.1.smithi143.stdout:1/784: symlink d0/d6/d43/d6a/df/d6e/d2/l105 0 2024-09-17T01:07:06.411 INFO:tasks.workunit.client.1.smithi143.stdout:5/694: stat d1/d46/df/f3d 0 2024-09-17T01:07:06.412 INFO:tasks.workunit.client.0.smithi103.stdout:1/238: mknod d2/d16/d18/c4a 0 2024-09-17T01:07:06.412 INFO:tasks.workunit.client.1.smithi143.stdout:1/785: readlink d0/d6/d43/d6a/d52/lff 0 2024-09-17T01:07:06.412 INFO:tasks.workunit.client.1.smithi143.stdout:8/770: truncate d9/de/f10 333172 0 2024-09-17T01:07:06.413 INFO:tasks.workunit.client.1.smithi143.stdout:2/697: symlink d0/d44/d7a/d86/d97/le7 0 2024-09-17T01:07:06.414 INFO:tasks.workunit.client.1.smithi143.stdout:8/771: write d9/d12/d38/d7a/d8f/f92 [1225004,127064] 0 2024-09-17T01:07:06.415 INFO:tasks.workunit.client.0.smithi103.stdout:1/239: mkdir d2/d1c/d28/d4b 0 2024-09-17T01:07:06.416 INFO:tasks.workunit.client.0.smithi103.stdout:8/194: mkdir d0/d6/dc/d3d 0 2024-09-17T01:07:06.416 INFO:tasks.workunit.client.0.smithi103.stdout:1/240: write d2/d1c/d28/f29 [3338664,119484] 0 2024-09-17T01:07:06.417 INFO:tasks.workunit.client.1.smithi143.stdout:3/742: creat d6/d1c/d4d/fe7 x:0 0 0 2024-09-17T01:07:06.420 INFO:tasks.workunit.client.1.smithi143.stdout:6/660: creat d2/d17/d6e/d26/fda x:0 0 0 2024-09-17T01:07:06.420 INFO:tasks.workunit.client.0.smithi103.stdout:8/195: creat d0/f3e x:0 0 0 2024-09-17T01:07:06.421 INFO:tasks.workunit.client.1.smithi143.stdout:8/772: dread d9/d12/d38/d7a/fb9 [0,4194304] 0 2024-09-17T01:07:06.421 INFO:tasks.workunit.client.1.smithi143.stdout:7/883: dread d4/d1f/d29/f81 [0,4194304] 0 2024-09-17T01:07:06.423 INFO:tasks.workunit.client.1.smithi143.stdout:5/695: readlink d1/l12 0 2024-09-17T01:07:06.423 INFO:tasks.workunit.client.0.smithi103.stdout:8/196: truncate d0/d6/dc/f9 2132043 0 2024-09-17T01:07:06.424 INFO:tasks.workunit.client.1.smithi143.stdout:1/786: creat d0/dc/d57/dc2/f106 x:0 0 0 2024-09-17T01:07:06.425 INFO:tasks.workunit.client.1.smithi143.stdout:2/698: readlink d0/d44/d7a/d86/d97/l98 0 2024-09-17T01:07:06.426 INFO:tasks.workunit.client.1.smithi143.stdout:4/767: mkdir da/d3a/df8 0 2024-09-17T01:07:06.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:06 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi143 to 2240M 2024-09-17T01:07:06.427 INFO:tasks.workunit.client.0.smithi103.stdout:8/197: symlink d0/d6/dc/d30/d2d/l3f 0 2024-09-17T01:07:06.427 INFO:tasks.workunit.client.0.smithi103.stdout:1/241: dwrite d2/d16/f40 [0,4194304] 0 2024-09-17T01:07:06.428 INFO:tasks.workunit.client.0.smithi103.stdout:8/198: chown d0/c2a 23459642 1 2024-09-17T01:07:06.429 INFO:tasks.workunit.client.1.smithi143.stdout:1/787: write d0/d6/d43/f65 [1944358,34520] 0 2024-09-17T01:07:06.429 INFO:tasks.workunit.client.1.smithi143.stdout:3/743: dwrite d6/d1c/d33/d5d/fc0 [0,4194304] 0 2024-09-17T01:07:06.429 INFO:tasks.workunit.client.1.smithi143.stdout:6/661: creat d2/d30/d45/d70/d87/d74/fdb x:0 0 0 2024-09-17T01:07:06.429 INFO:tasks.workunit.client.0.smithi103.stdout:8/199: chown d0/d6/dc/l29 9942 1 2024-09-17T01:07:06.431 INFO:tasks.workunit.client.1.smithi143.stdout:8/773: dread d9/d23/faa [0,4194304] 0 2024-09-17T01:07:06.433 INFO:tasks.workunit.client.1.smithi143.stdout:8/774: chown d9/de/d53/d75/daf/df2 210 1 2024-09-17T01:07:06.434 INFO:tasks.workunit.client.0.smithi103.stdout:1/242: mknod d2/d16/c4c 0 2024-09-17T01:07:06.436 INFO:tasks.workunit.client.1.smithi143.stdout:7/884: mknod d4/d1f/d4a/d66/db5/df3/d106/c11e 0 2024-09-17T01:07:06.439 INFO:tasks.workunit.client.1.smithi143.stdout:0/712: getdents d3/d5/d8 0 2024-09-17T01:07:06.441 INFO:tasks.workunit.client.1.smithi143.stdout:4/768: write da/f2a [4465825,10995] 0 2024-09-17T01:07:06.442 INFO:tasks.workunit.client.0.smithi103.stdout:1/243: dwrite d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:06.445 INFO:tasks.workunit.client.1.smithi143.stdout:5/696: rename d1/d46/df/d1f/d66/c7b to d1/d5e/c109 0 2024-09-17T01:07:06.447 INFO:tasks.workunit.client.1.smithi143.stdout:5/697: write d1/d46/fed [120774,62269] 0 2024-09-17T01:07:06.449 INFO:tasks.workunit.client.1.smithi143.stdout:6/662: mkdir d2/d17/d6e/ddc 0 2024-09-17T01:07:06.451 INFO:tasks.workunit.client.1.smithi143.stdout:6/663: write d2/d17/d3a/fc2 [520361,1876] 0 2024-09-17T01:07:06.453 INFO:tasks.workunit.client.1.smithi143.stdout:7/885: read d4/f13 [709353,29774] 0 2024-09-17T01:07:06.454 INFO:tasks.workunit.client.1.smithi143.stdout:7/886: dread - d4/d1f/d4a/de4/d4e/d9f/fca zero size 2024-09-17T01:07:06.455 INFO:tasks.workunit.client.1.smithi143.stdout:9/718: truncate d3/d39/d6a/d9/f49 2375990 0 2024-09-17T01:07:06.456 INFO:tasks.workunit.client.1.smithi143.stdout:3/744: rename d6/d1c/d4b/d57/cc8 to d6/d1c/d33/d3f/d5c/ce8 0 2024-09-17T01:07:06.457 INFO:tasks.workunit.client.1.smithi143.stdout:3/745: stat d6/d1c/d33/d3f/d5c/da1/ca3 0 2024-09-17T01:07:06.458 INFO:tasks.workunit.client.0.smithi103.stdout:8/200: getdents d0/d6/dc 0 2024-09-17T01:07:06.462 INFO:tasks.workunit.client.0.smithi103.stdout:8/201: dread d0/d6/dc/f11 [0,4194304] 0 2024-09-17T01:07:06.462 INFO:tasks.workunit.client.1.smithi143.stdout:6/664: unlink d2/d17/cd6 0 2024-09-17T01:07:06.463 INFO:tasks.workunit.client.0.smithi103.stdout:8/202: fsync d0/d6/f1d 0 2024-09-17T01:07:06.463 INFO:tasks.workunit.client.0.smithi103.stdout:8/203: fdatasync d0/f3e 0 2024-09-17T01:07:06.464 INFO:tasks.workunit.client.1.smithi143.stdout:9/719: dread d3/d39/d6a/dc3/d3e/d51/d52/fbd [0,4194304] 0 2024-09-17T01:07:06.465 INFO:tasks.workunit.client.1.smithi143.stdout:9/720: chown d3/d39/d6a/dc3/d3e/d51/d52/l8f 462170637 1 2024-09-17T01:07:06.465 INFO:tasks.workunit.client.1.smithi143.stdout:4/769: mkdir da/d3a/d3e/d72/da3/dc0/df9 0 2024-09-17T01:07:06.466 INFO:tasks.workunit.client.0.smithi103.stdout:8/204: chown d0/d6/f36 1773214 1 2024-09-17T01:07:06.470 INFO:tasks.workunit.client.0.smithi103.stdout:8/205: creat d0/d6/dc/d3d/f40 x:0 0 0 2024-09-17T01:07:06.471 INFO:tasks.workunit.client.0.smithi103.stdout:4/242: sync 2024-09-17T01:07:06.473 INFO:tasks.workunit.client.0.smithi103.stdout:8/206: creat d0/f41 x:0 0 0 2024-09-17T01:07:06.475 INFO:tasks.workunit.client.0.smithi103.stdout:1/244: write d2/de/f1b [1157120,47128] 0 2024-09-17T01:07:06.476 INFO:tasks.workunit.client.1.smithi143.stdout:9/721: dread - d3/d39/fa2 zero size 2024-09-17T01:07:06.478 INFO:tasks.workunit.client.0.smithi103.stdout:4/243: getdents d9/d16/d36/d42 0 2024-09-17T01:07:06.478 INFO:tasks.workunit.client.1.smithi143.stdout:7/887: getdents d4/d1f/d4a/d66/db5/df3/d106/d114 0 2024-09-17T01:07:06.479 INFO:tasks.workunit.client.1.smithi143.stdout:4/770: truncate da/d3a/d40/daa/dc3/fd4 1059727 0 2024-09-17T01:07:06.482 INFO:tasks.workunit.client.1.smithi143.stdout:8/775: truncate d9/de/f6f 39813 0 2024-09-17T01:07:06.483 INFO:tasks.workunit.client.1.smithi143.stdout:9/722: dwrite d3/d39/d6a/d9/f5c [0,4194304] 0 2024-09-17T01:07:06.484 INFO:tasks.workunit.client.1.smithi143.stdout:0/713: truncate d3/d14/d32/f38 2882438 0 2024-09-17T01:07:06.486 INFO:tasks.workunit.client.1.smithi143.stdout:0/714: write d3/d14/d32/fd6 [34179,100524] 0 2024-09-17T01:07:06.486 INFO:tasks.workunit.client.1.smithi143.stdout:2/699: link d0/d10/d58/d5a/d5b/d4c/d71/dd2/lde d0/d10/d58/d5a/le8 0 2024-09-17T01:07:06.487 INFO:tasks.workunit.client.0.smithi103.stdout:4/244: mkdir d9/d16/d44 0 2024-09-17T01:07:06.489 INFO:tasks.workunit.client.0.smithi103.stdout:4/245: truncate d9/dc/df/f25 5202151 0 2024-09-17T01:07:06.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/245: link d2/d7/l9 d2/d16/l4d 0 2024-09-17T01:07:06.490 INFO:tasks.workunit.client.1.smithi143.stdout:4/771: dwrite da/d3a/d3e/d5e/d63/d80/fec [0,4194304] 0 2024-09-17T01:07:06.490 INFO:tasks.workunit.client.1.smithi143.stdout:0/715: chown d3/d5/d8/d10/l56 122421 1 2024-09-17T01:07:06.490 INFO:tasks.workunit.client.0.smithi103.stdout:4/246: fsync d9/dc/f2f 0 2024-09-17T01:07:06.491 INFO:tasks.workunit.client.1.smithi143.stdout:5/698: write d1/f19 [995883,43051] 0 2024-09-17T01:07:06.492 INFO:tasks.workunit.client.0.smithi103.stdout:8/207: link d0/c20 d0/d6/c42 0 2024-09-17T01:07:06.493 INFO:tasks.workunit.client.0.smithi103.stdout:8/208: chown d0/d6/f36 52801 1 2024-09-17T01:07:06.497 INFO:tasks.workunit.client.1.smithi143.stdout:1/788: rename d0/dc/d57/d58 to d0/d6/d43/d6a/d107 0 2024-09-17T01:07:06.499 INFO:tasks.workunit.client.0.smithi103.stdout:1/246: unlink d2/de/d1f/l24 0 2024-09-17T01:07:06.499 INFO:tasks.workunit.client.1.smithi143.stdout:3/746: creat d6/d1c/d33/fe9 x:0 0 0 2024-09-17T01:07:06.500 INFO:tasks.workunit.client.1.smithi143.stdout:8/776: rmdir d9/d12/d38/d7a/d8f 39 2024-09-17T01:07:06.501 INFO:tasks.workunit.client.1.smithi143.stdout:8/777: dread - d9/d12/df4/f111 zero size 2024-09-17T01:07:06.505 INFO:tasks.workunit.client.1.smithi143.stdout:9/723: creat d3/d81/ff5 x:0 0 0 2024-09-17T01:07:06.505 INFO:tasks.workunit.client.1.smithi143.stdout:8/778: truncate d9/d12/ff5 4226739 0 2024-09-17T01:07:06.505 INFO:tasks.workunit.client.0.smithi103.stdout:8/209: dwrite d0/d6/dc/d30/d2d/f3c [0,4194304] 0 2024-09-17T01:07:06.505 INFO:tasks.workunit.client.0.smithi103.stdout:8/210: chown d0/d6/dc 0 1 2024-09-17T01:07:06.505 INFO:tasks.workunit.client.0.smithi103.stdout:1/247: mkdir d2/d7/d4e 0 2024-09-17T01:07:06.506 INFO:tasks.workunit.client.0.smithi103.stdout:4/247: mkdir d9/d16/d45 0 2024-09-17T01:07:06.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:06 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi143 to 2240M 2024-09-17T01:07:06.509 INFO:tasks.workunit.client.1.smithi143.stdout:4/772: mkdir da/d3a/d3e/d72/dfa 0 2024-09-17T01:07:06.510 INFO:tasks.workunit.client.0.smithi103.stdout:4/248: truncate f5 2346323 0 2024-09-17T01:07:06.511 INFO:tasks.workunit.client.1.smithi143.stdout:0/716: dread d3/d5/d8/d27/f4b [0,4194304] 0 2024-09-17T01:07:06.511 INFO:tasks.workunit.client.0.smithi103.stdout:1/248: dwrite d2/de/f44 [4194304,4194304] 0 2024-09-17T01:07:06.511 INFO:tasks.workunit.client.0.smithi103.stdout:4/249: write d9/dc/f18 [1263170,5408] 0 2024-09-17T01:07:06.512 INFO:tasks.workunit.client.1.smithi143.stdout:5/699: unlink d1/d46/df/d53/f61 0 2024-09-17T01:07:06.512 INFO:tasks.workunit.client.0.smithi103.stdout:8/211: mknod d0/d6/dc/d30/d2d/d32/d34/c43 0 2024-09-17T01:07:06.513 INFO:tasks.workunit.client.1.smithi143.stdout:6/665: read d2/d17/d6e/d26/d46/d65/f7f [3838055,81278] 0 2024-09-17T01:07:06.514 INFO:tasks.workunit.client.1.smithi143.stdout:0/717: truncate d3/d5/d8/d21/f42 3632023 0 2024-09-17T01:07:06.516 INFO:tasks.workunit.client.1.smithi143.stdout:7/888: rename d4/d1f/d29/l6b to d4/d16/d97/da3/l11f 0 2024-09-17T01:07:06.517 INFO:tasks.workunit.client.1.smithi143.stdout:7/889: readlink d4/d1f/d4a/de4/d4e/d9f/l112 0 2024-09-17T01:07:06.519 INFO:tasks.workunit.client.1.smithi143.stdout:7/890: write d4/d16/d97/fbf [1692271,91427] 0 2024-09-17T01:07:06.521 INFO:tasks.workunit.client.0.smithi103.stdout:4/250: rename d9/d16/d23/d2b/f3c to d9/d16/d23/f46 0 2024-09-17T01:07:06.522 INFO:tasks.workunit.client.1.smithi143.stdout:7/891: stat d4/d1f/d4a/d66/db5 0 2024-09-17T01:07:06.524 INFO:tasks.workunit.client.1.smithi143.stdout:3/747: mkdir d6/d1c/d4d/da4/dea 0 2024-09-17T01:07:06.525 INFO:tasks.workunit.client.1.smithi143.stdout:3/748: dread - d6/d1c/d33/d41/d2e/d30/fd6 zero size 2024-09-17T01:07:06.525 INFO:tasks.workunit.client.0.smithi103.stdout:8/212: dwrite d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:06.525 INFO:tasks.workunit.client.1.smithi143.stdout:3/749: stat d6/d1c/d33/d41/d2e/d86/fcb 0 2024-09-17T01:07:06.528 INFO:tasks.workunit.client.0.smithi103.stdout:1/249: dwrite d2/d1c/f1e [4194304,4194304] 0 2024-09-17T01:07:06.530 INFO:tasks.workunit.client.1.smithi143.stdout:8/779: rmdir d9/d12/d38/d7a 39 2024-09-17T01:07:06.535 INFO:tasks.workunit.client.0.smithi103.stdout:4/251: dwrite f3 [4194304,4194304] 0 2024-09-17T01:07:06.541 INFO:tasks.workunit.client.0.smithi103.stdout:1/250: dread d2/f1a [0,4194304] 0 2024-09-17T01:07:06.545 INFO:tasks.workunit.client.1.smithi143.stdout:6/666: creat d2/d17/d6e/d26/dbd/d5e/d7c/fdd x:0 0 0 2024-09-17T01:07:06.546 INFO:tasks.workunit.client.0.smithi103.stdout:4/252: mkdir d9/d16/d23/d2b/d47 0 2024-09-17T01:07:06.547 INFO:tasks.workunit.client.1.smithi143.stdout:0/718: mkdir d3/d5/d35/da8/dcd/de5 0 2024-09-17T01:07:06.549 INFO:tasks.workunit.client.1.smithi143.stdout:4/773: rename da/d3a/d3e/d4a/d8c/f9f to da/d3a/d3e/d72/d9e/dde/ffb 0 2024-09-17T01:07:06.550 INFO:tasks.workunit.client.0.smithi103.stdout:1/251: creat d2/de/d1f/f4f x:0 0 0 2024-09-17T01:07:06.552 INFO:tasks.workunit.client.0.smithi103.stdout:4/253: rmdir d9/d16/d38/d3f 39 2024-09-17T01:07:06.553 INFO:tasks.workunit.client.1.smithi143.stdout:1/789: mknod d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/c108 0 2024-09-17T01:07:06.554 INFO:tasks.workunit.client.1.smithi143.stdout:1/790: stat d0/d6/d43/d47/d68 0 2024-09-17T01:07:06.557 INFO:tasks.workunit.client.1.smithi143.stdout:2/700: dwrite d0/d44/f95 [0,4194304] 0 2024-09-17T01:07:06.558 INFO:tasks.workunit.client.1.smithi143.stdout:9/724: mkdir d3/d39/d6a/df6 0 2024-09-17T01:07:06.559 INFO:tasks.workunit.client.1.smithi143.stdout:5/700: rmdir d1/d46/df 39 2024-09-17T01:07:06.560 INFO:tasks.workunit.client.0.smithi103.stdout:4/254: getdents d9/d16/d23/d2b/d47 0 2024-09-17T01:07:06.566 INFO:tasks.workunit.client.0.smithi103.stdout:4/255: dwrite d9/d16/f12 [0,4194304] 0 2024-09-17T01:07:06.568 INFO:tasks.workunit.client.1.smithi143.stdout:0/719: rename d3/d5/d8/d27/d8c to d3/d5/d8/d27/d31/d48/d8d/de6 0 2024-09-17T01:07:06.569 INFO:tasks.workunit.client.1.smithi143.stdout:4/774: mknod da/d3a/d40/d84/cfc 0 2024-09-17T01:07:06.571 INFO:tasks.workunit.client.0.smithi103.stdout:4/256: stat d9/f21 0 2024-09-17T01:07:06.575 INFO:tasks.workunit.client.0.smithi103.stdout:8/213: fsync d0/d6/dc/f9 0 2024-09-17T01:07:06.576 INFO:tasks.workunit.client.1.smithi143.stdout:2/701: fdatasync d0/d2/d21/d22/f2f 0 2024-09-17T01:07:06.576 INFO:tasks.workunit.client.0.smithi103.stdout:8/214: write d0/d6/dc/f9 [2372253,34960] 0 2024-09-17T01:07:06.580 INFO:tasks.workunit.client.0.smithi103.stdout:8/215: creat d0/f44 x:0 0 0 2024-09-17T01:07:06.581 INFO:tasks.workunit.client.0.smithi103.stdout:1/252: write d2/d7/f19 [1281944,4097] 0 2024-09-17T01:07:06.584 INFO:tasks.workunit.client.1.smithi143.stdout:9/725: dread d3/d39/d6a/d9/f41 [0,4194304] 0 2024-09-17T01:07:06.585 INFO:tasks.workunit.client.0.smithi103.stdout:8/216: symlink d0/d6/dc/l45 0 2024-09-17T01:07:06.587 INFO:tasks.workunit.client.1.smithi143.stdout:1/791: dread d0/d6/d43/d6a/f48 [0,4194304] 0 2024-09-17T01:07:06.588 INFO:tasks.workunit.client.1.smithi143.stdout:6/667: truncate d2/fb 2763643 0 2024-09-17T01:07:06.589 INFO:tasks.workunit.client.0.smithi103.stdout:1/253: dwrite d2/f8 [0,4194304] 0 2024-09-17T01:07:06.590 INFO:tasks.workunit.client.0.smithi103.stdout:1/254: chown d2/de/d1f 121691 1 2024-09-17T01:07:06.591 INFO:tasks.workunit.client.1.smithi143.stdout:7/892: write d4/d26/f2d [297898,47049] 0 2024-09-17T01:07:06.594 INFO:tasks.workunit.client.1.smithi143.stdout:2/702: dread d0/d10/d56/f66 [0,4194304] 0 2024-09-17T01:07:06.595 INFO:tasks.workunit.client.0.smithi103.stdout:8/217: creat d0/d6/dc/d30/d2d/d32/f46 x:0 0 0 2024-09-17T01:07:06.595 INFO:tasks.workunit.client.1.smithi143.stdout:2/703: stat d0/d10/d58/d5a/d5b/d4c/d71/d9d/fbc 0 2024-09-17T01:07:06.597 INFO:tasks.workunit.client.1.smithi143.stdout:3/750: link d6/d1c/d33/d41/d2b/l49 d6/d1c/d33/d41/d42/leb 0 2024-09-17T01:07:06.598 INFO:tasks.workunit.client.1.smithi143.stdout:5/701: truncate d1/d46/df/d53/d74/fa3 319807 0 2024-09-17T01:07:06.599 INFO:tasks.workunit.client.0.smithi103.stdout:4/257: dread d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:06.599 INFO:tasks.workunit.client.0.smithi103.stdout:1/255: dread d2/d7/f37 [0,4194304] 0 2024-09-17T01:07:06.600 INFO:tasks.workunit.client.1.smithi143.stdout:8/780: creat d9/de/f116 x:0 0 0 2024-09-17T01:07:06.600 INFO:tasks.workunit.client.1.smithi143.stdout:1/792: write d0/dc/f83 [2328704,5893] 0 2024-09-17T01:07:06.601 INFO:tasks.workunit.client.0.smithi103.stdout:4/258: write d9/dc/f18 [2013747,81540] 0 2024-09-17T01:07:06.601 INFO:tasks.workunit.client.1.smithi143.stdout:6/668: creat d2/df/d20/d2c/d38/fde x:0 0 0 2024-09-17T01:07:06.602 INFO:tasks.workunit.client.0.smithi103.stdout:4/259: fsync d9/dc/df/f20 0 2024-09-17T01:07:06.603 INFO:tasks.workunit.client.1.smithi143.stdout:4/775: creat da/d6d/dca/ffd x:0 0 0 2024-09-17T01:07:06.603 INFO:tasks.workunit.client.1.smithi143.stdout:8/781: truncate d9/d12/d38/d58/d70/f107 482338 0 2024-09-17T01:07:06.603 INFO:tasks.workunit.client.0.smithi103.stdout:4/260: stat d9/d10/f14 0 2024-09-17T01:07:06.603 INFO:tasks.workunit.client.0.smithi103.stdout:4/261: dread - d9/f3d zero size 2024-09-17T01:07:06.604 INFO:tasks.workunit.client.1.smithi143.stdout:6/669: truncate d2/d17/d6e/d26/d46/d65/f9c 57722 0 2024-09-17T01:07:06.605 INFO:tasks.workunit.client.1.smithi143.stdout:4/776: write da/d3a/d3e/d5e/d63/d80/fec [743782,102478] 0 2024-09-17T01:07:06.606 INFO:tasks.workunit.client.1.smithi143.stdout:2/704: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d9f/de9 0 2024-09-17T01:07:06.606 INFO:tasks.workunit.client.0.smithi103.stdout:1/256: fdatasync d2/d7/f19 0 2024-09-17T01:07:06.606 INFO:tasks.workunit.client.1.smithi143.stdout:3/751: creat d6/d1c/d4d/da4/fec x:0 0 0 2024-09-17T01:07:06.608 INFO:tasks.workunit.client.1.smithi143.stdout:2/705: chown d0/d44/d6a/fab 249 1 2024-09-17T01:07:06.608 INFO:tasks.workunit.client.0.smithi103.stdout:4/262: symlink d9/d16/d45/l48 0 2024-09-17T01:07:06.609 INFO:tasks.workunit.client.1.smithi143.stdout:3/752: chown d6/d1c/d33/d41/l53 194 1 2024-09-17T01:07:06.610 INFO:tasks.workunit.client.0.smithi103.stdout:4/263: write d9/dc/df/f20 [1812014,90915] 0 2024-09-17T01:07:06.612 INFO:tasks.workunit.client.1.smithi143.stdout:8/782: creat d9/d23/d32/f117 x:0 0 0 2024-09-17T01:07:06.613 INFO:tasks.workunit.client.0.smithi103.stdout:1/257: getdents d2/d7/d4e 0 2024-09-17T01:07:06.614 INFO:tasks.workunit.client.1.smithi143.stdout:8/783: stat d9/d23/db4/d55/d57/fbb 0 2024-09-17T01:07:06.615 INFO:tasks.workunit.client.1.smithi143.stdout:6/670: creat d2/d30/db4/dbc/fdf x:0 0 0 2024-09-17T01:07:06.616 INFO:tasks.workunit.client.0.smithi103.stdout:1/258: unlink d2/d1c/d20/f39 0 2024-09-17T01:07:06.616 INFO:tasks.workunit.client.1.smithi143.stdout:4/777: dwrite da/d3a/d3e/d4a/d8a/fdc [0,4194304] 0 2024-09-17T01:07:06.616 INFO:tasks.workunit.client.1.smithi143.stdout:6/671: readlink d2/d17/d3a/d47/d8e/l93 0 2024-09-17T01:07:06.618 INFO:tasks.workunit.client.0.smithi103.stdout:4/264: mknod d9/d16/d36/d42/c49 0 2024-09-17T01:07:06.618 INFO:tasks.workunit.client.1.smithi143.stdout:1/793: symlink d0/dc/l109 0 2024-09-17T01:07:06.620 INFO:tasks.workunit.client.1.smithi143.stdout:0/720: getdents d3/d5/d8/d27/d31/d48/d72 0 2024-09-17T01:07:06.621 INFO:tasks.workunit.client.0.smithi103.stdout:1/259: rmdir d2/d31 39 2024-09-17T01:07:06.626 INFO:tasks.workunit.client.0.smithi103.stdout:1/260: rmdir d2/de 39 2024-09-17T01:07:06.630 INFO:tasks.workunit.client.1.smithi143.stdout:5/702: write d1/d46/df/d1f/f16 [1223160,116994] 0 2024-09-17T01:07:06.631 INFO:tasks.workunit.client.0.smithi103.stdout:1/261: fdatasync d2/de/f44 0 2024-09-17T01:07:06.631 INFO:tasks.workunit.client.0.smithi103.stdout:8/218: dread d0/d6/dc/f2c [0,4194304] 0 2024-09-17T01:07:06.631 INFO:tasks.workunit.client.0.smithi103.stdout:1/262: fsync d2/d7/f1d 0 2024-09-17T01:07:06.632 INFO:tasks.workunit.client.0.smithi103.stdout:1/263: stat d2/de/d1f/f27 0 2024-09-17T01:07:06.633 INFO:tasks.workunit.client.1.smithi143.stdout:5/703: readlink d1/d46/d6e/db7/lce 0 2024-09-17T01:07:06.633 INFO:tasks.workunit.client.1.smithi143.stdout:8/784: dwrite d9/d12/d38/d58/d70/ff1 [0,4194304] 0 2024-09-17T01:07:06.636 INFO:tasks.workunit.client.0.smithi103.stdout:1/264: dread d2/d16/f32 [0,4194304] 0 2024-09-17T01:07:06.639 INFO:tasks.workunit.client.1.smithi143.stdout:6/672: getdents d2/df/d20/d2c/d82/db3 0 2024-09-17T01:07:06.639 INFO:tasks.workunit.client.0.smithi103.stdout:8/219: getdents d0/d6 0 2024-09-17T01:07:06.641 INFO:tasks.workunit.client.1.smithi143.stdout:8/785: mknod d9/d23/db4/c118 0 2024-09-17T01:07:06.642 INFO:tasks.workunit.client.1.smithi143.stdout:2/706: dwrite d0/d10/d56/f6d [0,4194304] 0 2024-09-17T01:07:06.643 INFO:tasks.workunit.client.0.smithi103.stdout:1/265: truncate d2/de/f11 498060 0 2024-09-17T01:07:06.644 INFO:tasks.workunit.client.0.smithi103.stdout:4/265: dread d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:06.646 INFO:tasks.workunit.client.1.smithi143.stdout:2/707: write d0/d10/d58/d5a/d5b/d4c/d71/d9d/f36 [1446041,103090] 0 2024-09-17T01:07:06.647 INFO:tasks.workunit.client.1.smithi143.stdout:3/753: rename d6/d1c/d33/d41/d2e/d86/ddc/cae to d6/d1c/d33/d41/ced 0 2024-09-17T01:07:06.648 INFO:tasks.workunit.client.0.smithi103.stdout:1/266: mknod d2/d1c/d20/c50 0 2024-09-17T01:07:06.649 INFO:tasks.workunit.client.0.smithi103.stdout:1/267: chown d2/d16/f3d 0 1 2024-09-17T01:07:06.649 INFO:tasks.workunit.client.1.smithi143.stdout:4/778: dwrite da/d3a/d40/f27 [0,4194304] 0 2024-09-17T01:07:06.650 INFO:tasks.workunit.client.1.smithi143.stdout:0/721: symlink d3/d5/d35/da8/dcd/de5/le7 0 2024-09-17T01:07:06.650 INFO:tasks.workunit.client.0.smithi103.stdout:1/268: chown d2/d1c/d28/c41 127 1 2024-09-17T01:07:06.651 INFO:tasks.workunit.client.0.smithi103.stdout:1/269: write d2/d1c/d20/d33/f3c [911473,55371] 0 2024-09-17T01:07:06.653 INFO:tasks.workunit.client.1.smithi143.stdout:0/722: dread d3/d5/d8/d27/d31/d48/f5e [0,4194304] 0 2024-09-17T01:07:06.655 INFO:tasks.workunit.client.1.smithi143.stdout:0/723: truncate d3/d5/d8/d27/d31/fdf 233063 0 2024-09-17T01:07:06.664 INFO:tasks.workunit.client.0.smithi103.stdout:8/220: truncate d0/d6/f3b 2023741 0 2024-09-17T01:07:06.665 INFO:tasks.workunit.client.1.smithi143.stdout:2/708: creat d0/d44/d6a/d91/dc7/fea x:0 0 0 2024-09-17T01:07:06.665 INFO:tasks.workunit.client.0.smithi103.stdout:1/270: unlink d2/d16/l4d 0 2024-09-17T01:07:06.666 INFO:tasks.workunit.client.1.smithi143.stdout:3/754: creat d6/d1c/d33/d3f/d5c/fee x:0 0 0 2024-09-17T01:07:06.667 INFO:tasks.workunit.client.1.smithi143.stdout:4/779: mkdir da/d3a/d40/d84/dd0/dfe 0 2024-09-17T01:07:06.668 INFO:tasks.workunit.client.1.smithi143.stdout:4/780: fdatasync da/d3a/d40/f5b 0 2024-09-17T01:07:06.668 INFO:tasks.workunit.client.1.smithi143.stdout:6/673: write d2/d17/d6e/fa7 [659789,121431] 0 2024-09-17T01:07:06.669 INFO:tasks.workunit.client.1.smithi143.stdout:4/781: chown da/f2a 7784 1 2024-09-17T01:07:06.669 INFO:tasks.workunit.client.0.smithi103.stdout:1/271: fdatasync d2/d16/f32 0 2024-09-17T01:07:06.670 INFO:tasks.workunit.client.0.smithi103.stdout:1/272: read d2/f36 [2508648,94114] 0 2024-09-17T01:07:06.670 INFO:tasks.workunit.client.1.smithi143.stdout:0/724: rename d3/d5/d35/da8 to d3/d68/d8f/ddb/de8 0 2024-09-17T01:07:06.671 INFO:tasks.workunit.client.0.smithi103.stdout:1/273: write d2/d16/f3d [392271,127908] 0 2024-09-17T01:07:06.672 INFO:tasks.workunit.client.1.smithi143.stdout:1/794: getdents d0/d6/d43/d47/dbf/deb 0 2024-09-17T01:07:06.672 INFO:tasks.workunit.client.1.smithi143.stdout:0/725: truncate d3/d88/d93/fe3 105288 0 2024-09-17T01:07:06.674 INFO:tasks.workunit.client.0.smithi103.stdout:1/274: mkdir d2/d16/d51 0 2024-09-17T01:07:06.675 INFO:tasks.workunit.client.1.smithi143.stdout:2/709: unlink d0/d10/d58/d5a/d5b/d4c/d59/l88 0 2024-09-17T01:07:06.676 INFO:tasks.workunit.client.0.smithi103.stdout:4/266: write d9/d16/f37 [1333401,114484] 0 2024-09-17T01:07:06.679 INFO:tasks.workunit.client.1.smithi143.stdout:8/786: dwrite d9/de/d53/d75/dfa/d66/fa9 [0,4194304] 0 2024-09-17T01:07:06.679 INFO:tasks.workunit.client.0.smithi103.stdout:1/275: mkdir d2/d1c/d28/d52 0 2024-09-17T01:07:06.681 INFO:tasks.workunit.client.0.smithi103.stdout:4/267: readlink d9/d10/l17 0 2024-09-17T01:07:06.682 INFO:tasks.workunit.client.0.smithi103.stdout:4/268: write d9/d16/f1e [4547448,115732] 0 2024-09-17T01:07:06.689 INFO:tasks.workunit.client.1.smithi143.stdout:4/782: mkdir da/d3a/d3e/d4a/d8a/dff 0 2024-09-17T01:07:06.689 INFO:tasks.workunit.client.0.smithi103.stdout:4/269: creat d9/d2d/f4a x:0 0 0 2024-09-17T01:07:06.692 INFO:tasks.workunit.client.0.smithi103.stdout:4/270: fdatasync d9/dc/f18 0 2024-09-17T01:07:06.694 INFO:tasks.workunit.client.0.smithi103.stdout:4/271: write d9/dc/df/f20 [4281778,93488] 0 2024-09-17T01:07:06.696 INFO:tasks.workunit.client.1.smithi143.stdout:2/710: dread d0/d2/d21/f27 [0,4194304] 0 2024-09-17T01:07:06.696 INFO:tasks.workunit.client.0.smithi103.stdout:8/221: dwrite d0/d6/f3b [0,4194304] 0 2024-09-17T01:07:06.697 INFO:tasks.workunit.client.0.smithi103.stdout:1/276: link d2/d1c/d20/c43 d2/de/d1f/c53 0 2024-09-17T01:07:06.701 INFO:tasks.workunit.client.0.smithi103.stdout:4/272: dread d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:06.702 INFO:tasks.workunit.client.1.smithi143.stdout:5/704: getdents d1/d46/d9d 0 2024-09-17T01:07:06.703 INFO:tasks.workunit.client.0.smithi103.stdout:1/277: chown d2/d1c/d20/l45 982 1 2024-09-17T01:07:06.708 INFO:tasks.workunit.client.0.smithi103.stdout:4/273: read d9/fd [784197,6674] 0 2024-09-17T01:07:06.708 INFO:tasks.workunit.client.0.smithi103.stdout:8/222: link d0/d6/f1c d0/d6/dc/d30/d2d/d32/d34/f47 0 2024-09-17T01:07:06.709 INFO:tasks.workunit.client.1.smithi143.stdout:3/755: link d6/d1c/d33/f5e d6/d1c/d4d/da4/dea/fef 0 2024-09-17T01:07:06.709 INFO:tasks.workunit.client.0.smithi103.stdout:1/278: dwrite d2/d16/f32 [0,4194304] 0 2024-09-17T01:07:06.710 INFO:tasks.workunit.client.1.smithi143.stdout:5/705: symlink d1/d46/df/d1f/de9/l10a 0 2024-09-17T01:07:06.710 INFO:tasks.workunit.client.1.smithi143.stdout:8/787: dwrite d9/d23/db4/d55/d57/d9d/fa1 [0,4194304] 0 2024-09-17T01:07:06.711 INFO:tasks.workunit.client.0.smithi103.stdout:1/279: write d2/d1c/d20/d33/f3c [1137433,3326] 0 2024-09-17T01:07:06.711 INFO:tasks.workunit.client.0.smithi103.stdout:4/274: rename d9/d16/l1a to d9/d16/d36/l4b 0 2024-09-17T01:07:06.711 INFO:tasks.workunit.client.0.smithi103.stdout:1/280: readlink d2/l5 0 2024-09-17T01:07:06.715 INFO:tasks.workunit.client.0.smithi103.stdout:4/275: chown d9/d16/d23/d32/c40 16 1 2024-09-17T01:07:06.716 INFO:tasks.workunit.client.1.smithi143.stdout:1/795: creat d0/d6/d43/d6d/d8b/dd0/de2/f10a x:0 0 0 2024-09-17T01:07:06.717 INFO:tasks.workunit.client.1.smithi143.stdout:2/711: mknod d0/d10/d58/d5a/d5b/d4c/d71/d9f/de9/ceb 0 2024-09-17T01:07:06.719 INFO:tasks.workunit.client.1.smithi143.stdout:2/712: write d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fc6 [558827,81151] 0 2024-09-17T01:07:06.721 INFO:tasks.workunit.client.1.smithi143.stdout:2/713: write d0/d44/f95 [593712,47911] 0 2024-09-17T01:07:06.722 INFO:tasks.workunit.client.1.smithi143.stdout:6/674: getdents d2/df/d20/d2c 0 2024-09-17T01:07:06.724 INFO:tasks.workunit.client.0.smithi103.stdout:1/281: rename d2/d31 to d2/d1c/d54 0 2024-09-17T01:07:06.724 INFO:tasks.workunit.client.0.smithi103.stdout:4/276: dread d9/d16/f37 [0,4194304] 0 2024-09-17T01:07:06.726 INFO:tasks.workunit.client.1.smithi143.stdout:4/783: creat da/d3a/d7c/ded/f100 x:0 0 0 2024-09-17T01:07:06.726 INFO:tasks.workunit.client.0.smithi103.stdout:2/99: sync 2024-09-17T01:07:06.726 INFO:tasks.workunit.client.0.smithi103.stdout:5/153: sync 2024-09-17T01:07:06.727 INFO:tasks.workunit.client.0.smithi103.stdout:0/199: sync 2024-09-17T01:07:06.727 INFO:tasks.workunit.client.1.smithi143.stdout:4/784: write da/d3a/f79 [6581286,100064] 0 2024-09-17T01:07:06.727 INFO:tasks.workunit.client.1.smithi143.stdout:0/726: rename d3/d5/d8/d58/cc9 to d3/d14/ce9 0 2024-09-17T01:07:06.728 INFO:tasks.workunit.client.0.smithi103.stdout:0/200: fdatasync dd/df/d1b/f2e 0 2024-09-17T01:07:06.728 INFO:tasks.workunit.client.0.smithi103.stdout:5/154: write d6/d11/d13/f21 [499196,90162] 0 2024-09-17T01:07:06.729 INFO:tasks.workunit.client.0.smithi103.stdout:0/201: write dd/d1c/f28 [5200601,74904] 0 2024-09-17T01:07:06.733 INFO:tasks.workunit.client.0.smithi103.stdout:2/100: write d6/da/f14 [292190,22210] 0 2024-09-17T01:07:06.736 INFO:tasks.workunit.client.1.smithi143.stdout:8/788: link d9/d23/db4/d55/d57/d9d/fa1 d9/d12/df4/f119 0 2024-09-17T01:07:06.737 INFO:tasks.workunit.client.1.smithi143.stdout:8/789: stat d9/d23/db4/d55/d57/l69 0 2024-09-17T01:07:06.737 INFO:tasks.workunit.client.1.smithi143.stdout:6/675: dread d2/d17/d6e/d26/dbd/f91 [0,4194304] 0 2024-09-17T01:07:06.737 INFO:tasks.workunit.client.1.smithi143.stdout:2/714: truncate d0/d10/d58/d5a/d5b/d4c/f6c 4294308 0 2024-09-17T01:07:06.739 INFO:tasks.workunit.client.1.smithi143.stdout:3/756: write d6/d1c/f66 [1290443,107565] 0 2024-09-17T01:07:06.740 INFO:tasks.workunit.client.0.smithi103.stdout:8/223: link d0/d6/dc/d30/d2d/c2e d0/d6/dc/d30/c48 0 2024-09-17T01:07:06.741 INFO:tasks.workunit.client.0.smithi103.stdout:8/224: chown d0/d6/dc/d30/d25/l33 10683 1 2024-09-17T01:07:06.742 INFO:tasks.workunit.client.1.smithi143.stdout:1/796: dread d0/d6/d43/d6a/d52/db2/db6/fe4 [0,4194304] 0 2024-09-17T01:07:06.742 INFO:tasks.workunit.client.1.smithi143.stdout:3/757: read d6/d1c/d33/d41/f21 [641284,123245] 0 2024-09-17T01:07:06.742 INFO:tasks.workunit.client.1.smithi143.stdout:0/727: mknod d3/d88/cea 0 2024-09-17T01:07:06.743 INFO:tasks.workunit.client.0.smithi103.stdout:4/277: mkdir d9/d16/d23/d32/d4c 0 2024-09-17T01:07:06.745 INFO:tasks.workunit.client.1.smithi143.stdout:5/706: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:07:06.746 INFO:tasks.workunit.client.1.smithi143.stdout:5/707: write d1/d46/f79 [250507,9565] 0 2024-09-17T01:07:06.749 INFO:tasks.workunit.client.1.smithi143.stdout:6/676: creat d2/d30/d84/fe0 x:0 0 0 2024-09-17T01:07:06.750 INFO:tasks.workunit.client.0.smithi103.stdout:1/282: dwrite d2/f36 [0,4194304] 0 2024-09-17T01:07:06.752 INFO:tasks.workunit.client.1.smithi143.stdout:2/715: mkdir d0/d44/d7a/d86/d97/dec 0 2024-09-17T01:07:06.753 INFO:tasks.workunit.client.1.smithi143.stdout:4/785: creat da/d3a/d40/df0/f101 x:0 0 0 2024-09-17T01:07:06.758 INFO:tasks.workunit.client.0.smithi103.stdout:4/278: read f5 [538263,109364] 0 2024-09-17T01:07:06.758 INFO:tasks.workunit.client.1.smithi143.stdout:0/728: dwrite d3/d5/d8/d27/d31/d4c/f1d [0,4194304] 0 2024-09-17T01:07:06.759 INFO:tasks.workunit.client.0.smithi103.stdout:5/155: creat d6/db/f3a x:0 0 0 2024-09-17T01:07:06.759 INFO:tasks.workunit.client.0.smithi103.stdout:2/101: dread d6/f8 [0,4194304] 0 2024-09-17T01:07:06.760 INFO:tasks.workunit.client.0.smithi103.stdout:8/225: symlink d0/d6/dc/d30/l49 0 2024-09-17T01:07:06.761 INFO:tasks.workunit.client.1.smithi143.stdout:8/790: creat d9/d12/d38/d58/dd7/f11a x:0 0 0 2024-09-17T01:07:06.762 INFO:tasks.workunit.client.0.smithi103.stdout:2/102: write f4 [1496842,17826] 0 2024-09-17T01:07:06.762 INFO:tasks.workunit.client.0.smithi103.stdout:8/226: write d0/f41 [479108,119209] 0 2024-09-17T01:07:06.763 INFO:tasks.workunit.client.1.smithi143.stdout:5/708: dwrite d1/d46/df/d1f/f16 [0,4194304] 0 2024-09-17T01:07:06.763 INFO:tasks.workunit.client.1.smithi143.stdout:6/677: mknod d2/d17/d6e/d26/dbd/ce1 0 2024-09-17T01:07:06.764 INFO:tasks.workunit.client.0.smithi103.stdout:1/283: creat d2/d7/d4e/f55 x:0 0 0 2024-09-17T01:07:06.764 INFO:tasks.workunit.client.0.smithi103.stdout:8/227: stat d0/d6/dc/d30/d25 0 2024-09-17T01:07:06.765 INFO:tasks.workunit.client.1.smithi143.stdout:1/797: dread d0/d6/d43/d47/d72/f9e [0,4194304] 0 2024-09-17T01:07:06.765 INFO:tasks.workunit.client.0.smithi103.stdout:1/284: truncate d2/d7/d4e/f55 178565 0 2024-09-17T01:07:06.766 INFO:tasks.workunit.client.1.smithi143.stdout:3/758: mkdir d6/d1c/d33/d3f/df0 0 2024-09-17T01:07:06.767 INFO:tasks.workunit.client.0.smithi103.stdout:1/285: write d2/de/d1f/f3b [668083,128837] 0 2024-09-17T01:07:06.767 INFO:tasks.workunit.client.1.smithi143.stdout:5/709: dread - d1/d46/df/d53/d74/d9a/d9c/fd3 zero size 2024-09-17T01:07:06.769 INFO:tasks.workunit.client.1.smithi143.stdout:9/726: sync 2024-09-17T01:07:06.770 INFO:tasks.workunit.client.0.smithi103.stdout:5/156: mknod d6/d11/c3b 0 2024-09-17T01:07:06.770 INFO:tasks.workunit.client.1.smithi143.stdout:4/786: chown da/d3a/d3e/d72/d9e/da1 4 1 2024-09-17T01:07:06.771 INFO:tasks.workunit.client.1.smithi143.stdout:7/893: sync 2024-09-17T01:07:06.773 INFO:tasks.workunit.client.1.smithi143.stdout:5/710: truncate d1/d46/df/d53/ff9 283604 0 2024-09-17T01:07:06.773 INFO:tasks.workunit.client.0.smithi103.stdout:0/202: getdents dd/df/d1b 0 2024-09-17T01:07:06.773 INFO:tasks.workunit.client.1.smithi143.stdout:8/791: readlink d9/de/l6d 0 2024-09-17T01:07:06.774 INFO:tasks.workunit.client.0.smithi103.stdout:0/203: truncate dd/df/f41 600832 0 2024-09-17T01:07:06.775 INFO:tasks.workunit.client.0.smithi103.stdout:2/103: rename d6/da/dd to d6/da/d17/d1a 0 2024-09-17T01:07:06.777 INFO:tasks.workunit.client.0.smithi103.stdout:0/204: dread f8 [0,4194304] 0 2024-09-17T01:07:06.778 INFO:tasks.workunit.client.0.smithi103.stdout:8/228: write d0/d6/dc/f9 [3954800,44474] 0 2024-09-17T01:07:06.779 INFO:tasks.workunit.client.0.smithi103.stdout:4/279: symlink d9/d16/d38/d3f/l4d 0 2024-09-17T01:07:06.781 INFO:tasks.workunit.client.0.smithi103.stdout:1/286: mknod d2/d16/d18/c56 0 2024-09-17T01:07:06.782 INFO:tasks.workunit.client.1.smithi143.stdout:3/759: write d6/d1c/d33/d41/f21 [208707,128049] 0 2024-09-17T01:07:06.782 INFO:tasks.workunit.client.0.smithi103.stdout:1/287: fsync d2/f1a 0 2024-09-17T01:07:06.783 INFO:tasks.workunit.client.0.smithi103.stdout:7/162: sync 2024-09-17T01:07:06.783 INFO:tasks.workunit.client.0.smithi103.stdout:9/221: sync 2024-09-17T01:07:06.783 INFO:tasks.workunit.client.0.smithi103.stdout:3/255: sync 2024-09-17T01:07:06.783 INFO:tasks.workunit.client.0.smithi103.stdout:6/134: sync 2024-09-17T01:07:06.783 INFO:tasks.workunit.client.0.smithi103.stdout:1/288: fsync d2/d16/f2a 0 2024-09-17T01:07:06.783 INFO:tasks.workunit.client.0.smithi103.stdout:5/157: symlink d6/d2c/l3c 0 2024-09-17T01:07:06.785 INFO:tasks.workunit.client.1.smithi143.stdout:4/787: creat da/d6d/dca/f102 x:0 0 0 2024-09-17T01:07:06.786 INFO:tasks.workunit.client.0.smithi103.stdout:3/256: stat d3/d16/d1b/d36/l49 0 2024-09-17T01:07:06.786 INFO:tasks.workunit.client.0.smithi103.stdout:7/163: read d4/d11/d2b/f2f [339546,65676] 0 2024-09-17T01:07:06.787 INFO:tasks.workunit.client.0.smithi103.stdout:9/222: write d7/d43/d48/d11/fb [3913664,20228] 0 2024-09-17T01:07:06.789 INFO:tasks.workunit.client.0.smithi103.stdout:9/223: fsync f0 0 2024-09-17T01:07:06.790 INFO:tasks.workunit.client.0.smithi103.stdout:4/280: dread d9/fd [0,4194304] 0 2024-09-17T01:07:06.792 INFO:tasks.workunit.client.1.smithi143.stdout:5/711: rename d1/d46/df/d1f/d66/l108 to d1/d96/l10b 0 2024-09-17T01:07:06.793 INFO:tasks.workunit.client.1.smithi143.stdout:7/894: dread d4/d1f/f3e [0,4194304] 0 2024-09-17T01:07:06.794 INFO:tasks.workunit.client.0.smithi103.stdout:1/289: dwrite d2/f6 [0,4194304] 0 2024-09-17T01:07:06.796 INFO:tasks.workunit.client.0.smithi103.stdout:1/290: write d2/d16/f30 [2991871,98517] 0 2024-09-17T01:07:06.796 INFO:tasks.workunit.client.0.smithi103.stdout:6/135: fdatasync d3/f9 0 2024-09-17T01:07:06.798 INFO:tasks.workunit.client.1.smithi143.stdout:5/712: dwrite d1/d46/fed [0,4194304] 0 2024-09-17T01:07:06.799 INFO:tasks.workunit.client.0.smithi103.stdout:2/104: mknod d6/da/d17/d1a/df/c1b 0 2024-09-17T01:07:06.800 INFO:tasks.workunit.client.0.smithi103.stdout:5/158: creat d6/d2c/f3d x:0 0 0 2024-09-17T01:07:06.800 INFO:tasks.workunit.client.1.smithi143.stdout:2/716: truncate d0/d10/d58/d5a/d5b/d4c/f6c 2956018 0 2024-09-17T01:07:06.805 INFO:tasks.workunit.client.1.smithi143.stdout:1/798: truncate d0/d6/d43/d6a/df/d6e/d18/fe7 2702861 0 2024-09-17T01:07:06.806 INFO:tasks.workunit.client.0.smithi103.stdout:0/205: mknod dd/d43/c45 0 2024-09-17T01:07:06.807 INFO:tasks.workunit.client.1.smithi143.stdout:1/799: truncate d0/d6/d43/d6a/d52/db2/fed 872844 0 2024-09-17T01:07:06.808 INFO:tasks.workunit.client.1.smithi143.stdout:9/727: mkdir d3/d39/d6a/dc3/d3e/df7 0 2024-09-17T01:07:06.809 INFO:tasks.workunit.client.1.smithi143.stdout:9/728: chown d3/f15 10 1 2024-09-17T01:07:06.810 INFO:tasks.workunit.client.1.smithi143.stdout:3/760: write d6/d1c/d4d/f6d [3353600,112530] 0 2024-09-17T01:07:06.811 INFO:tasks.workunit.client.1.smithi143.stdout:4/788: chown da/c1e 46 1 2024-09-17T01:07:06.811 INFO:tasks.workunit.client.1.smithi143.stdout:1/800: dread d0/d6/d43/d6a/df/d6e/d2/f28 [0,4194304] 0 2024-09-17T01:07:06.814 INFO:tasks.workunit.client.1.smithi143.stdout:4/789: write da/d3a/d3e/fdf [1504917,6159] 0 2024-09-17T01:07:06.814 INFO:tasks.workunit.client.0.smithi103.stdout:7/164: mkdir d4/d11/d2b/d36 0 2024-09-17T01:07:06.815 INFO:tasks.workunit.client.1.smithi143.stdout:0/729: creat d3/d5/d8/d27/feb x:0 0 0 2024-09-17T01:07:06.816 INFO:tasks.workunit.client.0.smithi103.stdout:3/257: dwrite d3/f27 [4194304,4194304] 0 2024-09-17T01:07:06.818 INFO:tasks.workunit.client.0.smithi103.stdout:8/229: unlink d0/d6/dc/f11 0 2024-09-17T01:07:06.818 INFO:tasks.workunit.client.1.smithi143.stdout:9/729: dwrite d3/d81/ff5 [0,4194304] 0 2024-09-17T01:07:06.819 INFO:tasks.workunit.client.1.smithi143.stdout:8/792: fdatasync d9/d23/db4/d55/d57/f10c 0 2024-09-17T01:07:06.820 INFO:tasks.workunit.client.0.smithi103.stdout:9/224: creat d7/d43/d48/d11/d20/f4a x:0 0 0 2024-09-17T01:07:06.821 INFO:tasks.workunit.client.0.smithi103.stdout:9/225: write d7/d43/d48/f16 [3187886,35125] 0 2024-09-17T01:07:06.823 INFO:tasks.workunit.client.0.smithi103.stdout:1/291: creat d2/d1c/d20/d33/f57 x:0 0 0 2024-09-17T01:07:06.824 INFO:tasks.workunit.client.0.smithi103.stdout:9/226: write d7/d43/d48/d11/d21/f26 [744569,87101] 0 2024-09-17T01:07:06.826 INFO:tasks.workunit.client.0.smithi103.stdout:6/136: rename d3/c10 to d3/d25/d26/c2c 0 2024-09-17T01:07:06.827 INFO:tasks.workunit.client.0.smithi103.stdout:1/292: dread d2/de/d1f/f27 [0,4194304] 0 2024-09-17T01:07:06.829 INFO:tasks.workunit.client.1.smithi143.stdout:5/713: creat d1/d5e/f10c x:0 0 0 2024-09-17T01:07:06.833 INFO:tasks.workunit.client.1.smithi143.stdout:2/717: rename d0/d10/d58/d5a/d5b/d4c/d59/f8b to d0/d2/d21/d22/fed 0 2024-09-17T01:07:06.834 INFO:tasks.workunit.client.1.smithi143.stdout:1/801: rename d0/d6/d43/d47/dbf/deb/d78 to d0/d6/d43/d47/dbf/deb/d78/d10b 22 2024-09-17T01:07:06.834 INFO:tasks.workunit.client.0.smithi103.stdout:0/206: unlink dd/d43/c45 0 2024-09-17T01:07:06.835 INFO:tasks.workunit.client.1.smithi143.stdout:2/718: stat d0/d10/d58/d5a/d5b/d4c/d59/l72 0 2024-09-17T01:07:06.836 INFO:tasks.workunit.client.0.smithi103.stdout:7/165: mkdir d4/d10/d37 0 2024-09-17T01:07:06.842 INFO:tasks.workunit.client.1.smithi143.stdout:0/730: mkdir d3/d5/d8/d27/d31/d48/d8d/de6/dec 0 2024-09-17T01:07:06.843 INFO:tasks.workunit.client.1.smithi143.stdout:0/731: write d3/d5/d8/d21/f47 [318323,27223] 0 2024-09-17T01:07:06.844 INFO:tasks.workunit.client.1.smithi143.stdout:7/895: mknod d4/d1f/d29/c120 0 2024-09-17T01:07:06.845 INFO:tasks.workunit.client.1.smithi143.stdout:6/678: getdents d2/d17/d3a 0 2024-09-17T01:07:06.847 INFO:tasks.workunit.client.0.smithi103.stdout:6/137: creat d3/d16/f2d x:0 0 0 2024-09-17T01:07:06.847 INFO:tasks.workunit.client.0.smithi103.stdout:6/138: read - d3/d16/f2d zero size 2024-09-17T01:07:06.847 INFO:tasks.workunit.client.0.smithi103.stdout:6/139: stat d3/d17 0 2024-09-17T01:07:06.852 INFO:tasks.workunit.client.1.smithi143.stdout:9/730: rename d3/d39/d6a/d9/d74/f6c to d3/d39/d42/d58/dbf/ff8 0 2024-09-17T01:07:06.854 INFO:tasks.workunit.client.0.smithi103.stdout:7/166: rmdir d4/d10 39 2024-09-17T01:07:06.856 INFO:tasks.workunit.client.1.smithi143.stdout:2/719: dread - d0/d10/d58/f68 zero size 2024-09-17T01:07:06.856 INFO:tasks.workunit.client.0.smithi103.stdout:7/167: read d4/fb [3152421,51358] 0 2024-09-17T01:07:06.857 INFO:tasks.workunit.client.0.smithi103.stdout:8/230: rename d0/d6/dc/d30/l49 to d0/d6/dc/d3d/l4a 0 2024-09-17T01:07:06.858 INFO:tasks.workunit.client.0.smithi103.stdout:9/227: write d7/d43/d48/d11/d21/f33 [888125,51858] 0 2024-09-17T01:07:06.859 INFO:tasks.workunit.client.1.smithi143.stdout:4/790: mkdir da/d75/d103 0 2024-09-17T01:07:06.862 INFO:tasks.workunit.client.0.smithi103.stdout:8/231: dread d0/d6/dc/d30/d2d/f3c [0,4194304] 0 2024-09-17T01:07:06.863 INFO:tasks.workunit.client.0.smithi103.stdout:8/232: dread - d0/f3e zero size 2024-09-17T01:07:06.864 INFO:tasks.workunit.client.0.smithi103.stdout:6/140: creat d3/d25/d26/f2e x:0 0 0 2024-09-17T01:07:06.865 INFO:tasks.workunit.client.1.smithi143.stdout:6/679: dread d2/df/d20/f54 [0,4194304] 0 2024-09-17T01:07:06.866 INFO:tasks.workunit.client.1.smithi143.stdout:6/680: chown d2/d17/d6e/d26/d79 491 1 2024-09-17T01:07:06.867 INFO:tasks.workunit.client.1.smithi143.stdout:6/681: fsync d2/d30/d45/d70/da5/fc3 0 2024-09-17T01:07:06.867 INFO:tasks.workunit.client.1.smithi143.stdout:0/732: chown d3/d5/d8/d21/l63 15872316 1 2024-09-17T01:07:06.869 INFO:tasks.workunit.client.0.smithi103.stdout:9/228: dread d7/d43/d48/d11/f10 [0,4194304] 0 2024-09-17T01:07:06.871 INFO:tasks.workunit.client.0.smithi103.stdout:1/293: truncate d2/de/d1f/f34 1568288 0 2024-09-17T01:07:06.871 INFO:tasks.workunit.client.1.smithi143.stdout:3/761: dwrite d6/d1c/d33/d3f/fbf [0,4194304] 0 2024-09-17T01:07:06.872 INFO:tasks.workunit.client.1.smithi143.stdout:3/762: stat d6/d1c/d4b/lc1 0 2024-09-17T01:07:06.872 INFO:tasks.workunit.client.1.smithi143.stdout:8/793: truncate f7 1108469 0 2024-09-17T01:07:06.874 INFO:tasks.workunit.client.1.smithi143.stdout:5/714: creat d1/d46/d6e/d106/f10d x:0 0 0 2024-09-17T01:07:06.875 INFO:tasks.workunit.client.0.smithi103.stdout:3/258: creat d3/d16/d1b/f5e x:0 0 0 2024-09-17T01:07:06.876 INFO:tasks.workunit.client.1.smithi143.stdout:7/896: write d4/d26/f22 [5085188,15570] 0 2024-09-17T01:07:06.876 INFO:tasks.workunit.client.1.smithi143.stdout:4/791: dread da/d6d/f76 [0,4194304] 0 2024-09-17T01:07:06.877 INFO:tasks.workunit.client.0.smithi103.stdout:7/168: symlink d4/d11/d2b/l38 0 2024-09-17T01:07:06.878 INFO:tasks.workunit.client.1.smithi143.stdout:8/794: dread d9/d23/db4/d55/dfe/f81 [0,4194304] 0 2024-09-17T01:07:06.879 INFO:tasks.workunit.client.1.smithi143.stdout:9/731: truncate d3/d39/f53 4863286 0 2024-09-17T01:07:06.880 INFO:tasks.workunit.client.1.smithi143.stdout:8/795: write d9/d12/df4/ff6 [840461,18419] 0 2024-09-17T01:07:06.881 INFO:tasks.workunit.client.0.smithi103.stdout:6/141: mkdir d3/d17/d2f 0 2024-09-17T01:07:06.882 INFO:tasks.workunit.client.0.smithi103.stdout:2/105: getdents d6/da/d17 0 2024-09-17T01:07:06.885 INFO:tasks.workunit.client.0.smithi103.stdout:5/159: link d6/d11/f2f d6/f3e 0 2024-09-17T01:07:06.887 INFO:tasks.workunit.client.0.smithi103.stdout:0/207: creat dd/df/f46 x:0 0 0 2024-09-17T01:07:06.888 INFO:tasks.workunit.client.1.smithi143.stdout:3/763: creat d6/d68/ff1 x:0 0 0 2024-09-17T01:07:06.889 INFO:tasks.workunit.client.1.smithi143.stdout:5/715: truncate d1/f14 1518762 0 2024-09-17T01:07:06.890 INFO:tasks.workunit.client.0.smithi103.stdout:1/294: creat d2/de/f58 x:0 0 0 2024-09-17T01:07:06.892 INFO:tasks.workunit.client.1.smithi143.stdout:7/897: creat d4/d1f/d4a/ddb/de7/f121 x:0 0 0 2024-09-17T01:07:06.892 INFO:tasks.workunit.client.1.smithi143.stdout:7/898: read - d4/d1f/d4a/d66/d86/fb8 zero size 2024-09-17T01:07:06.893 INFO:tasks.workunit.client.1.smithi143.stdout:1/802: link d0/d6/d43/d6a/df/fe1 d0/dc/d74/f10c 0 2024-09-17T01:07:06.895 INFO:tasks.workunit.client.1.smithi143.stdout:8/796: symlink d9/d12/d38/d58/dd7/l11b 0 2024-09-17T01:07:06.897 INFO:tasks.workunit.client.0.smithi103.stdout:6/142: creat d3/d17/f30 x:0 0 0 2024-09-17T01:07:06.899 INFO:tasks.workunit.client.0.smithi103.stdout:9/229: rename d7/d43/d48/d11/c46 to d7/d43/d48/d11/d21/c4b 0 2024-09-17T01:07:06.901 INFO:tasks.workunit.client.1.smithi143.stdout:9/732: dread d3/f8 [0,4194304] 0 2024-09-17T01:07:06.901 INFO:tasks.workunit.client.1.smithi143.stdout:7/899: creat d4/d1f/d4a/de4/d78/f122 x:0 0 0 2024-09-17T01:07:06.903 INFO:tasks.workunit.client.1.smithi143.stdout:7/900: write d4/d1f/d4a/d9e/da2/fff [868965,612] 0 2024-09-17T01:07:06.907 INFO:tasks.workunit.client.1.smithi143.stdout:7/901: dread d4/d26/dcc/fe8 [0,4194304] 0 2024-09-17T01:07:06.908 INFO:tasks.workunit.client.1.smithi143.stdout:7/902: chown d4/d1f/ff2 142638 1 2024-09-17T01:07:06.908 INFO:tasks.workunit.client.1.smithi143.stdout:0/733: creat d3/fed x:0 0 0 2024-09-17T01:07:06.909 INFO:tasks.workunit.client.0.smithi103.stdout:2/106: rename d6/da/d17/d1a to d6/da/d17/d1a/d1c 22 2024-09-17T01:07:06.911 INFO:tasks.workunit.client.1.smithi143.stdout:8/797: dread d9/d26/f3e [0,4194304] 0 2024-09-17T01:07:06.911 INFO:tasks.workunit.client.0.smithi103.stdout:9/230: creat d7/d2d/f4c x:0 0 0 2024-09-17T01:07:06.916 INFO:tasks.workunit.client.0.smithi103.stdout:1/295: link d2/fb d2/d1c/d20/d33/f59 0 2024-09-17T01:07:06.916 INFO:tasks.workunit.client.0.smithi103.stdout:1/296: write d2/d1c/d28/f29 [4307185,76708] 0 2024-09-17T01:07:06.916 INFO:tasks.workunit.client.1.smithi143.stdout:3/764: dwrite d6/d1c/d33/d41/f16 [4194304,4194304] 0 2024-09-17T01:07:06.917 INFO:tasks.workunit.client.0.smithi103.stdout:1/297: read d2/d1c/d20/d33/f3c [152871,45297] 0 2024-09-17T01:07:06.917 INFO:tasks.workunit.client.0.smithi103.stdout:7/169: creat d4/d10/d37/f39 x:0 0 0 2024-09-17T01:07:06.919 INFO:tasks.workunit.client.0.smithi103.stdout:8/233: getdents d0/d6/dc/d30 0 2024-09-17T01:07:06.919 INFO:tasks.workunit.client.0.smithi103.stdout:1/298: write d2/f1a [2022998,84992] 0 2024-09-17T01:07:06.922 INFO:tasks.workunit.client.0.smithi103.stdout:8/234: chown d0/d6/dc/d30/d2d/d32/d34 51 1 2024-09-17T01:07:06.923 INFO:tasks.workunit.client.0.smithi103.stdout:0/208: rename dd/c16 to dd/d1c/c47 0 2024-09-17T01:07:06.925 INFO:tasks.workunit.client.0.smithi103.stdout:0/209: write dd/f36 [1361010,105083] 0 2024-09-17T01:07:06.925 INFO:tasks.workunit.client.1.smithi143.stdout:8/798: mknod d9/d23/db4/d55/d57/d108/c11c 0 2024-09-17T01:07:06.925 INFO:tasks.workunit.client.0.smithi103.stdout:3/259: dwrite d3/d16/d1b/d2c/f41 [0,4194304] 0 2024-09-17T01:07:06.927 INFO:tasks.workunit.client.0.smithi103.stdout:2/107: rmdir d6/da 39 2024-09-17T01:07:06.928 INFO:tasks.workunit.client.1.smithi143.stdout:9/733: truncate d3/d39/d6a/d9/f60 1153618 0 2024-09-17T01:07:06.929 INFO:tasks.workunit.client.0.smithi103.stdout:9/231: mknod d7/d43/d48/d11/c4d 0 2024-09-17T01:07:06.930 INFO:tasks.workunit.client.0.smithi103.stdout:9/232: stat c1 0 2024-09-17T01:07:06.933 INFO:tasks.workunit.client.0.smithi103.stdout:3/260: dwrite d3/d16/d1b/f46 [0,4194304] 0 2024-09-17T01:07:06.934 INFO:tasks.workunit.client.0.smithi103.stdout:3/261: fdatasync d3/f27 0 2024-09-17T01:07:06.935 INFO:tasks.workunit.client.1.smithi143.stdout:1/803: dwrite d0/d6/d43/d6d/d8b/dd0/de2/d79/f7a [0,4194304] 0 2024-09-17T01:07:06.937 INFO:tasks.workunit.client.0.smithi103.stdout:1/299: creat d2/d7/f5a x:0 0 0 2024-09-17T01:07:06.938 INFO:tasks.workunit.client.1.smithi143.stdout:1/804: truncate d0/d6/d43/d47/d68/d7b/daf/ff2 919312 0 2024-09-17T01:07:06.938 INFO:tasks.workunit.client.1.smithi143.stdout:0/734: creat d3/d68/d75/dd0/fee x:0 0 0 2024-09-17T01:07:06.940 INFO:tasks.workunit.client.1.smithi143.stdout:5/716: getdents d1/d46/df/d53 0 2024-09-17T01:07:06.943 INFO:tasks.workunit.client.0.smithi103.stdout:0/210: unlink dd/c1a 0 2024-09-17T01:07:06.946 INFO:tasks.workunit.client.1.smithi143.stdout:1/805: mknod d0/d6/d43/d6d/d8b/dd0/de2/d6b/d9d/c10d 0 2024-09-17T01:07:06.947 INFO:tasks.workunit.client.1.smithi143.stdout:5/717: symlink d1/d46/d6e/d106/l10e 0 2024-09-17T01:07:06.948 INFO:tasks.workunit.client.1.smithi143.stdout:1/806: truncate d0/d6/d43/d47/d68/d7b/daf/ff2 1229694 0 2024-09-17T01:07:06.948 INFO:tasks.workunit.client.1.smithi143.stdout:5/718: write d1/d46/d6e/da0/fbf [720232,130842] 0 2024-09-17T01:07:06.950 INFO:tasks.workunit.client.1.smithi143.stdout:9/734: mknod d3/d39/d6a/dc3/d3e/df7/cf9 0 2024-09-17T01:07:06.951 INFO:tasks.workunit.client.0.smithi103.stdout:6/143: link d3/d16/l19 d3/d16/l31 0 2024-09-17T01:07:06.952 INFO:tasks.workunit.client.0.smithi103.stdout:6/144: chown d3/d17/f2a 154891295 1 2024-09-17T01:07:06.953 INFO:tasks.workunit.client.1.smithi143.stdout:8/799: symlink d9/d12/d38/d7a/d8f/l11d 0 2024-09-17T01:07:06.954 INFO:tasks.workunit.client.1.smithi143.stdout:8/800: fsync d9/d12/d38/d58/dd7/f11a 0 2024-09-17T01:07:06.955 INFO:tasks.workunit.client.1.smithi143.stdout:3/765: creat d6/d1c/d33/d41/d42/ff2 x:0 0 0 2024-09-17T01:07:06.957 INFO:tasks.workunit.client.1.smithi143.stdout:1/807: mknod d0/d6/d43/d6a/d52/db3/c10e 0 2024-09-17T01:07:06.958 INFO:tasks.workunit.client.0.smithi103.stdout:6/145: creat d3/d17/f32 x:0 0 0 2024-09-17T01:07:06.958 INFO:tasks.workunit.client.1.smithi143.stdout:5/719: mkdir d1/d46/df/d53/d74/d9a/dd7/d10f 0 2024-09-17T01:07:06.958 INFO:tasks.workunit.client.0.smithi103.stdout:6/146: chown d3/d16/f1f 55 1 2024-09-17T01:07:06.959 INFO:tasks.workunit.client.0.smithi103.stdout:8/235: creat d0/d6/dc/f4b x:0 0 0 2024-09-17T01:07:06.960 INFO:tasks.workunit.client.1.smithi143.stdout:8/801: creat d9/d23/db4/f11e x:0 0 0 2024-09-17T01:07:06.961 INFO:tasks.workunit.client.0.smithi103.stdout:2/108: mknod d6/da/d17/d1a/c1d 0 2024-09-17T01:07:06.963 INFO:tasks.workunit.client.0.smithi103.stdout:0/211: link dd/df/f26 dd/df/d1b/f48 0 2024-09-17T01:07:06.965 INFO:tasks.workunit.client.0.smithi103.stdout:0/212: write dd/d1c/f28 [6044793,103749] 0 2024-09-17T01:07:06.965 INFO:tasks.workunit.client.0.smithi103.stdout:0/213: read - dd/f42 zero size 2024-09-17T01:07:06.966 INFO:tasks.workunit.client.0.smithi103.stdout:3/262: dread d3/f1d [0,4194304] 0 2024-09-17T01:07:06.966 INFO:tasks.workunit.client.0.smithi103.stdout:9/233: rename d7/d43/d48/d11/d21/l2b to d7/d43/d48/l4e 0 2024-09-17T01:07:06.968 INFO:tasks.workunit.client.0.smithi103.stdout:3/263: dread - d3/f57 zero size 2024-09-17T01:07:06.969 INFO:tasks.workunit.client.0.smithi103.stdout:6/147: mkdir d3/d16/d33 0 2024-09-17T01:07:06.969 INFO:tasks.workunit.client.0.smithi103.stdout:3/264: fdatasync d3/fd 0 2024-09-17T01:07:06.970 INFO:tasks.workunit.client.1.smithi143.stdout:5/720: symlink d1/d46/df/d53/d74/dc7/l110 0 2024-09-17T01:07:06.971 INFO:tasks.workunit.client.0.smithi103.stdout:3/265: write d3/f9 [5198263,9859] 0 2024-09-17T01:07:06.972 INFO:tasks.workunit.client.0.smithi103.stdout:8/236: creat d0/f4c x:0 0 0 2024-09-17T01:07:06.973 INFO:tasks.workunit.client.1.smithi143.stdout:0/735: dread d3/d5/f84 [0,4194304] 0 2024-09-17T01:07:06.973 INFO:tasks.workunit.client.1.smithi143.stdout:8/802: mkdir d9/d23/d32/d11f 0 2024-09-17T01:07:06.974 INFO:tasks.workunit.client.1.smithi143.stdout:0/736: fsync d3/d5/d35/fc6 0 2024-09-17T01:07:06.974 INFO:tasks.workunit.client.0.smithi103.stdout:7/170: dwrite d4/fb [0,4194304] 0 2024-09-17T01:07:06.975 INFO:tasks.workunit.client.0.smithi103.stdout:2/109: rmdir d6/da/d17 39 2024-09-17T01:07:06.975 INFO:tasks.workunit.client.0.smithi103.stdout:7/171: readlink d4/l33 0 2024-09-17T01:07:06.976 INFO:tasks.workunit.client.0.smithi103.stdout:6/148: dread d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:06.979 INFO:tasks.workunit.client.0.smithi103.stdout:0/214: creat dd/df/d38/f49 x:0 0 0 2024-09-17T01:07:06.980 INFO:tasks.workunit.client.0.smithi103.stdout:1/300: write d2/d1c/d20/d33/f59 [4011555,51829] 0 2024-09-17T01:07:06.981 INFO:tasks.workunit.client.0.smithi103.stdout:0/215: write dd/df/d1b/f2c [286968,127505] 0 2024-09-17T01:07:06.982 INFO:tasks.workunit.client.0.smithi103.stdout:9/234: unlink d7/d43/d48/d11/c1e 0 2024-09-17T01:07:06.983 INFO:tasks.workunit.client.0.smithi103.stdout:0/216: write dd/df/f25 [4975581,44236] 0 2024-09-17T01:07:06.984 INFO:tasks.workunit.client.0.smithi103.stdout:9/235: truncate d7/d43/d48/f2f 677352 0 2024-09-17T01:07:06.984 INFO:tasks.workunit.client.0.smithi103.stdout:0/217: dread f8 [0,4194304] 0 2024-09-17T01:07:06.985 INFO:tasks.workunit.client.1.smithi143.stdout:9/735: write d3/d39/d6a/fc [1144438,28680] 0 2024-09-17T01:07:06.985 INFO:tasks.workunit.client.1.smithi143.stdout:3/766: creat d6/ff3 x:0 0 0 2024-09-17T01:07:06.987 INFO:tasks.workunit.client.1.smithi143.stdout:5/721: creat d1/d96/dff/f111 x:0 0 0 2024-09-17T01:07:06.989 INFO:tasks.workunit.client.1.smithi143.stdout:8/803: mkdir d9/d23/d120 0 2024-09-17T01:07:06.992 INFO:tasks.workunit.client.0.smithi103.stdout:3/266: creat d3/d16/d1b/d2c/d34/f5f x:0 0 0 2024-09-17T01:07:06.993 INFO:tasks.workunit.client.1.smithi143.stdout:9/736: truncate d3/d39/d42/d80/df3/d99/faf 132343 0 2024-09-17T01:07:06.994 INFO:tasks.workunit.client.1.smithi143.stdout:9/737: write d3/d39/d6a/fc [2170007,89479] 0 2024-09-17T01:07:06.998 INFO:tasks.workunit.client.0.smithi103.stdout:1/301: mknod d2/de/d1f/c5b 0 2024-09-17T01:07:07.000 INFO:tasks.workunit.client.1.smithi143.stdout:1/808: dwrite d0/d6/d43/f67 [0,4194304] 0 2024-09-17T01:07:07.001 INFO:tasks.workunit.client.1.smithi143.stdout:9/738: truncate d3/f8 1362975 0 2024-09-17T01:07:07.002 INFO:tasks.workunit.client.1.smithi143.stdout:2/720: sync 2024-09-17T01:07:07.003 INFO:tasks.workunit.client.0.smithi103.stdout:9/236: mkdir d7/d43/d48/d11/d20/d4f 0 2024-09-17T01:07:07.004 INFO:tasks.workunit.client.0.smithi103.stdout:0/218: creat dd/d1c/f4a x:0 0 0 2024-09-17T01:07:07.006 INFO:tasks.workunit.client.0.smithi103.stdout:1/302: dwrite d2/d16/f30 [0,4194304] 0 2024-09-17T01:07:07.008 INFO:tasks.workunit.client.1.smithi143.stdout:5/722: dread d1/d46/df/d23/d4f/d7d/f98 [0,4194304] 0 2024-09-17T01:07:07.010 INFO:tasks.workunit.client.0.smithi103.stdout:3/267: creat d3/d16/d1b/d3c/f60 x:0 0 0 2024-09-17T01:07:07.012 INFO:tasks.workunit.client.0.smithi103.stdout:7/172: mkdir d4/d11/d2b/d36/d3a 0 2024-09-17T01:07:07.012 INFO:tasks.workunit.client.0.smithi103.stdout:7/173: readlink d4/l1c 0 2024-09-17T01:07:07.013 INFO:tasks.workunit.client.1.smithi143.stdout:9/739: chown d3/d39/d42/d80/df3/lba 60 1 2024-09-17T01:07:07.013 INFO:tasks.workunit.client.0.smithi103.stdout:6/149: creat d3/d17/d2f/f34 x:0 0 0 2024-09-17T01:07:07.014 INFO:tasks.workunit.client.1.smithi143.stdout:8/804: creat d9/de/f121 x:0 0 0 2024-09-17T01:07:07.015 INFO:tasks.workunit.client.0.smithi103.stdout:6/150: stat d3/f28 0 2024-09-17T01:07:07.016 INFO:tasks.workunit.client.1.smithi143.stdout:3/767: dwrite d6/d1c/d33/d41/d2e/d30/f6f [0,4194304] 0 2024-09-17T01:07:07.016 INFO:tasks.workunit.client.0.smithi103.stdout:6/151: write d3/f2b [824436,122075] 0 2024-09-17T01:07:07.016 INFO:tasks.workunit.client.0.smithi103.stdout:6/152: stat d3/d16/f2d 0 2024-09-17T01:07:07.018 INFO:tasks.workunit.client.0.smithi103.stdout:6/153: truncate d3/f2b 1973938 0 2024-09-17T01:07:07.020 INFO:tasks.workunit.client.0.smithi103.stdout:0/219: symlink dd/l4b 0 2024-09-17T01:07:07.021 INFO:tasks.workunit.client.1.smithi143.stdout:5/723: dwrite d1/f59 [0,4194304] 0 2024-09-17T01:07:07.022 INFO:tasks.workunit.client.0.smithi103.stdout:1/303: readlink d2/d7/l9 0 2024-09-17T01:07:07.023 INFO:tasks.workunit.client.0.smithi103.stdout:9/237: read d7/fc [4903622,80951] 0 2024-09-17T01:07:07.027 INFO:tasks.workunit.client.0.smithi103.stdout:2/110: link d6/f7 d6/da/d17/f1e 0 2024-09-17T01:07:07.027 INFO:tasks.workunit.client.0.smithi103.stdout:6/154: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:07:07.030 INFO:tasks.workunit.client.0.smithi103.stdout:7/174: chown d4/le 1030520505 1 2024-09-17T01:07:07.031 INFO:tasks.workunit.client.1.smithi143.stdout:1/809: write d0/f19 [2239891,48678] 0 2024-09-17T01:07:07.033 INFO:tasks.workunit.client.1.smithi143.stdout:8/805: rename d9/d84/c77 to d9/d12/d13/d73/dee/c122 0 2024-09-17T01:07:07.034 INFO:tasks.workunit.client.0.smithi103.stdout:8/237: getdents d0/d6/dc/d30/d2d 0 2024-09-17T01:07:07.035 INFO:tasks.workunit.client.0.smithi103.stdout:9/238: dwrite d7/d43/d48/f2f [0,4194304] 0 2024-09-17T01:07:07.036 INFO:tasks.workunit.client.1.smithi143.stdout:5/724: symlink d1/d46/df/d23/d4f/d7d/d92/l112 0 2024-09-17T01:07:07.037 INFO:tasks.workunit.client.0.smithi103.stdout:8/238: write d0/d6/dc/f4b [104838,45114] 0 2024-09-17T01:07:07.039 INFO:tasks.workunit.client.1.smithi143.stdout:9/740: unlink d3/d39/d6a/dc3/l20 0 2024-09-17T01:07:07.042 INFO:tasks.workunit.client.1.smithi143.stdout:2/721: getdents d0/d10/d58/d79 0 2024-09-17T01:07:07.047 INFO:tasks.workunit.client.0.smithi103.stdout:1/304: creat d2/d1c/d28/d52/f5c x:0 0 0 2024-09-17T01:07:07.048 INFO:tasks.workunit.client.1.smithi143.stdout:5/725: dread d1/d46/df/d1f/de9/fdc [0,4194304] 0 2024-09-17T01:07:07.048 INFO:tasks.workunit.client.0.smithi103.stdout:3/268: rename d3/d16/d1b/d3c/c5a to d3/d16/c61 0 2024-09-17T01:07:07.049 INFO:tasks.workunit.client.1.smithi143.stdout:3/768: dread d6/d1c/d4b/f67 [0,4194304] 0 2024-09-17T01:07:07.050 INFO:tasks.workunit.client.1.smithi143.stdout:5/726: dread - d1/d46/d6e/da0/ffa zero size 2024-09-17T01:07:07.050 INFO:tasks.workunit.client.1.smithi143.stdout:8/806: dwrite d9/de/fb5 [0,4194304] 0 2024-09-17T01:07:07.051 INFO:tasks.workunit.client.1.smithi143.stdout:1/810: link d0/d6/d43/d6a/df/l98 d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/de8/l10f 0 2024-09-17T01:07:07.051 INFO:tasks.workunit.client.0.smithi103.stdout:6/155: creat d3/d16/d33/f35 x:0 0 0 2024-09-17T01:07:07.052 INFO:tasks.workunit.client.0.smithi103.stdout:9/239: dread d7/d43/d48/f38 [0,4194304] 0 2024-09-17T01:07:07.052 INFO:tasks.workunit.client.0.smithi103.stdout:6/156: truncate d3/d16/f1f 114370 0 2024-09-17T01:07:07.052 INFO:tasks.workunit.client.0.smithi103.stdout:9/240: chown d7/d43/d48/d11/d21/l28 304633 1 2024-09-17T01:07:07.052 INFO:tasks.workunit.client.1.smithi143.stdout:8/807: readlink d9/d23/db4/d55/dfe/l45 0 2024-09-17T01:07:07.052 INFO:tasks.workunit.client.1.smithi143.stdout:3/769: write d6/d1c/d33/d41/d2e/d30/f6c [230139,8240] 0 2024-09-17T01:07:07.053 INFO:tasks.workunit.client.0.smithi103.stdout:7/175: symlink d4/l3b 0 2024-09-17T01:07:07.055 INFO:tasks.workunit.client.1.smithi143.stdout:2/722: symlink d0/d10/d58/d5a/d5b/d4c/lee 0 2024-09-17T01:07:07.055 INFO:tasks.workunit.client.1.smithi143.stdout:1/811: mkdir d0/da1/d110 0 2024-09-17T01:07:07.055 INFO:tasks.workunit.client.0.smithi103.stdout:0/220: rename dd/df/f18 to dd/df/d1b/f4c 0 2024-09-17T01:07:07.056 INFO:tasks.workunit.client.0.smithi103.stdout:0/221: chown dd/df/f3d 749 1 2024-09-17T01:07:07.057 INFO:tasks.workunit.client.1.smithi143.stdout:5/727: mknod d1/d46/df/d23/d4f/d7d/dcf/c113 0 2024-09-17T01:07:07.058 INFO:tasks.workunit.client.0.smithi103.stdout:0/222: write f6 [434527,96846] 0 2024-09-17T01:07:07.058 INFO:tasks.workunit.client.0.smithi103.stdout:2/111: rename d6/c13 to d6/c1f 0 2024-09-17T01:07:07.060 INFO:tasks.workunit.client.1.smithi143.stdout:5/728: write d1/d46/df/d23/fb0 [2048335,11024] 0 2024-09-17T01:07:07.060 INFO:tasks.workunit.client.1.smithi143.stdout:8/808: symlink d9/d12/d38/d58/d79/l123 0 2024-09-17T01:07:07.061 INFO:tasks.workunit.client.0.smithi103.stdout:9/241: truncate d7/f19 1276345 0 2024-09-17T01:07:07.062 INFO:tasks.workunit.client.0.smithi103.stdout:6/157: rename d3/f2b to d3/f36 0 2024-09-17T01:07:07.063 INFO:tasks.workunit.client.1.smithi143.stdout:3/770: dwrite d6/d1c/d4b/f8e [0,4194304] 0 2024-09-17T01:07:07.064 INFO:tasks.workunit.client.1.smithi143.stdout:2/723: creat d0/d44/d7a/d86/fef x:0 0 0 2024-09-17T01:07:07.065 INFO:tasks.workunit.client.0.smithi103.stdout:7/176: creat d4/d10/f3c x:0 0 0 2024-09-17T01:07:07.066 INFO:tasks.workunit.client.1.smithi143.stdout:1/812: dwrite d0/d6/d43/d47/dbf/deb/dc3/ff1 [0,4194304] 0 2024-09-17T01:07:07.067 INFO:tasks.workunit.client.1.smithi143.stdout:2/724: fdatasync d0/d10/d56/fe0 0 2024-09-17T01:07:07.067 INFO:tasks.workunit.client.0.smithi103.stdout:0/223: dwrite dd/df/f3d [0,4194304] 0 2024-09-17T01:07:07.068 INFO:tasks.workunit.client.1.smithi143.stdout:3/771: fsync d6/d1c/d33/d41/d2e/d30/f69 0 2024-09-17T01:07:07.069 INFO:tasks.workunit.client.1.smithi143.stdout:3/772: fdatasync d6/d1c/d33/fe2 0 2024-09-17T01:07:07.071 INFO:tasks.workunit.client.1.smithi143.stdout:3/773: dread - d6/d1c/d4b/d57/fdd zero size 2024-09-17T01:07:07.072 INFO:tasks.workunit.client.1.smithi143.stdout:5/729: symlink d1/d96/l114 0 2024-09-17T01:07:07.073 INFO:tasks.workunit.client.0.smithi103.stdout:2/112: chown l2 27 1 2024-09-17T01:07:07.074 INFO:tasks.workunit.client.1.smithi143.stdout:3/774: readlink d6/d1c/d33/d3f/d5c/l6b 0 2024-09-17T01:07:07.074 INFO:tasks.workunit.client.1.smithi143.stdout:1/813: write d0/d6/d43/d6d/d8b/dd0/de2/d79/f7a [970194,30920] 0 2024-09-17T01:07:07.079 INFO:tasks.workunit.client.1.smithi143.stdout:1/814: chown d0/dc/d57/ccb 1023775 1 2024-09-17T01:07:07.082 INFO:tasks.workunit.client.1.smithi143.stdout:9/741: truncate d3/d39/d42/d80/df3/d99/ff0 2683652 0 2024-09-17T01:07:07.084 INFO:tasks.workunit.client.0.smithi103.stdout:1/305: creat d2/f5d x:0 0 0 2024-09-17T01:07:07.085 INFO:tasks.workunit.client.1.smithi143.stdout:3/775: creat d6/d1c/d33/d5d/ff4 x:0 0 0 2024-09-17T01:07:07.086 INFO:tasks.workunit.client.1.smithi143.stdout:1/815: mknod d0/d6/d43/d47/dbf/deb/df9/c111 0 2024-09-17T01:07:07.086 INFO:tasks.workunit.client.0.smithi103.stdout:0/224: creat dd/f4d x:0 0 0 2024-09-17T01:07:07.087 INFO:tasks.workunit.client.0.smithi103.stdout:3/269: dread d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:07.088 INFO:tasks.workunit.client.0.smithi103.stdout:3/270: dread - d3/f57 zero size 2024-09-17T01:07:07.088 INFO:tasks.workunit.client.0.smithi103.stdout:8/239: rename d0/d6/dc/f35 to d0/d6/dc/d30/d2d/d32/f4d 0 2024-09-17T01:07:07.090 INFO:tasks.workunit.client.0.smithi103.stdout:2/113: creat d6/da/d17/f20 x:0 0 0 2024-09-17T01:07:07.091 INFO:tasks.workunit.client.1.smithi143.stdout:9/742: mkdir d3/d39/d42/d80/df3/d99/dfa 0 2024-09-17T01:07:07.092 INFO:tasks.workunit.client.1.smithi143.stdout:9/743: chown d3/d39/d6a/dc3/d3e/d51/d52/c8d 132417633 1 2024-09-17T01:07:07.092 INFO:tasks.workunit.client.0.smithi103.stdout:7/177: mkdir d4/d11/d34/d3d 0 2024-09-17T01:07:07.093 INFO:tasks.workunit.client.1.smithi143.stdout:1/816: truncate d0/dc/f82 1416510 0 2024-09-17T01:07:07.094 INFO:tasks.workunit.client.1.smithi143.stdout:2/725: creat d0/d10/d58/d5a/d5b/d4c/d71/ff0 x:0 0 0 2024-09-17T01:07:07.095 INFO:tasks.workunit.client.1.smithi143.stdout:3/776: rmdir d6/d1c/d33/d3f/d79 39 2024-09-17T01:07:07.096 INFO:tasks.workunit.client.1.smithi143.stdout:9/744: fdatasync d3/d39/d6a/dc3/d3e/d51/d52/fbd 0 2024-09-17T01:07:07.097 INFO:tasks.workunit.client.0.smithi103.stdout:8/240: unlink d0/f41 0 2024-09-17T01:07:07.098 INFO:tasks.workunit.client.0.smithi103.stdout:8/241: write d0/d6/f39 [872872,110553] 0 2024-09-17T01:07:07.100 INFO:tasks.workunit.client.0.smithi103.stdout:2/114: fsync d6/f12 0 2024-09-17T01:07:07.100 INFO:tasks.workunit.client.1.smithi143.stdout:5/730: dread d1/d46/d6e/f8d [0,4194304] 0 2024-09-17T01:07:07.103 INFO:tasks.workunit.client.0.smithi103.stdout:9/242: creat d7/d43/d48/f50 x:0 0 0 2024-09-17T01:07:07.105 INFO:tasks.workunit.client.0.smithi103.stdout:7/178: creat d4/d11/d2b/f3e x:0 0 0 2024-09-17T01:07:07.106 INFO:tasks.workunit.client.0.smithi103.stdout:2/115: dwrite d6/f18 [0,4194304] 0 2024-09-17T01:07:07.108 INFO:tasks.workunit.client.0.smithi103.stdout:6/158: rmdir d3 39 2024-09-17T01:07:07.110 INFO:tasks.workunit.client.1.smithi143.stdout:2/726: mknod d0/d2/d21/cf1 0 2024-09-17T01:07:07.110 INFO:tasks.workunit.client.1.smithi143.stdout:2/727: chown d0/d2/l3f 7650 1 2024-09-17T01:07:07.114 INFO:tasks.workunit.client.0.smithi103.stdout:3/271: rename d3/d44/l50 to d3/d16/d1b/d3c/l62 0 2024-09-17T01:07:07.116 INFO:tasks.workunit.client.1.smithi143.stdout:5/731: mkdir d1/d46/df/d23/d4f/d7d/d102/d115 0 2024-09-17T01:07:07.118 INFO:tasks.workunit.client.1.smithi143.stdout:9/745: creat d3/d39/d6a/df6/ffb x:0 0 0 2024-09-17T01:07:07.120 INFO:tasks.workunit.client.1.smithi143.stdout:5/732: dread d1/d46/df/d53/f56 [0,4194304] 0 2024-09-17T01:07:07.121 INFO:tasks.workunit.client.1.smithi143.stdout:2/728: creat d0/dcf/ff2 x:0 0 0 2024-09-17T01:07:07.123 INFO:tasks.workunit.client.1.smithi143.stdout:3/777: unlink d6/d1c/d33/d3f/d79/f9a 0 2024-09-17T01:07:07.124 INFO:tasks.workunit.client.0.smithi103.stdout:7/179: read d4/d10/f25 [1783101,9620] 0 2024-09-17T01:07:07.125 INFO:tasks.workunit.client.0.smithi103.stdout:7/180: read d4/d10/f2c [2112148,104430] 0 2024-09-17T01:07:07.126 INFO:tasks.workunit.client.1.smithi143.stdout:9/746: dwrite d3/d39/d42/d80/df3/d99/dc5/fc7 [0,4194304] 0 2024-09-17T01:07:07.127 INFO:tasks.workunit.client.0.smithi103.stdout:2/116: mkdir d6/da/d17/d21 0 2024-09-17T01:07:07.129 INFO:tasks.workunit.client.1.smithi143.stdout:5/733: mkdir d1/d96/d116 0 2024-09-17T01:07:07.135 INFO:tasks.workunit.client.0.smithi103.stdout:0/225: link dd/df/f26 dd/d43/f4e 0 2024-09-17T01:07:07.135 INFO:tasks.workunit.client.0.smithi103.stdout:2/117: dwrite d6/f19 [0,4194304] 0 2024-09-17T01:07:07.139 INFO:tasks.workunit.client.0.smithi103.stdout:6/159: dread d3/f18 [4194304,4194304] 0 2024-09-17T01:07:07.139 INFO:tasks.workunit.client.0.smithi103.stdout:9/243: dread d7/f3b [0,4194304] 0 2024-09-17T01:07:07.142 INFO:tasks.workunit.client.1.smithi143.stdout:3/778: creat d6/d1c/d4d/da4/ff5 x:0 0 0 2024-09-17T01:07:07.142 INFO:tasks.workunit.client.0.smithi103.stdout:3/272: read d3/d16/d1b/d3c/f35 [4258,79051] 0 2024-09-17T01:07:07.143 INFO:tasks.workunit.client.1.smithi143.stdout:3/779: write d6/fa [4385330,79299] 0 2024-09-17T01:07:07.145 INFO:tasks.workunit.client.1.smithi143.stdout:9/747: dread - d3/d39/d6a/dc3/f86 zero size 2024-09-17T01:07:07.148 INFO:tasks.workunit.client.1.smithi143.stdout:1/817: truncate d0/d6/d43/f65 451226 0 2024-09-17T01:07:07.149 INFO:tasks.workunit.client.0.smithi103.stdout:1/306: truncate d2/d1c/f38 2913120 0 2024-09-17T01:07:07.150 INFO:tasks.workunit.client.1.smithi143.stdout:2/729: symlink d0/d2/d21/lf3 0 2024-09-17T01:07:07.151 INFO:tasks.workunit.client.0.smithi103.stdout:7/181: mkdir d4/d11/d3f 0 2024-09-17T01:07:07.152 INFO:tasks.workunit.client.1.smithi143.stdout:3/780: dwrite d6/d1c/d33/d5d/ff4 [0,4194304] 0 2024-09-17T01:07:07.152 INFO:tasks.workunit.client.1.smithi143.stdout:9/748: chown d3/d39/d6a/c25 87246 1 2024-09-17T01:07:07.153 INFO:tasks.workunit.client.1.smithi143.stdout:2/730: fsync d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fdd 0 2024-09-17T01:07:07.154 INFO:tasks.workunit.client.1.smithi143.stdout:5/734: creat d1/d46/df/d23/d4f/d82/da6/f117 x:0 0 0 2024-09-17T01:07:07.156 INFO:tasks.workunit.client.1.smithi143.stdout:6/682: sync 2024-09-17T01:07:07.156 INFO:tasks.workunit.client.1.smithi143.stdout:4/792: sync 2024-09-17T01:07:07.157 INFO:tasks.workunit.client.0.smithi103.stdout:2/118: fdatasync d6/f7 0 2024-09-17T01:07:07.158 INFO:tasks.workunit.client.1.smithi143.stdout:1/818: symlink d0/d6/d43/d47/dbf/deb/df9/l112 0 2024-09-17T01:07:07.160 INFO:tasks.workunit.client.0.smithi103.stdout:0/226: rename dd/df/d1b to dd/d4f 0 2024-09-17T01:07:07.160 INFO:tasks.workunit.client.1.smithi143.stdout:3/781: dread d6/d1c/d33/d3f/f75 [0,4194304] 0 2024-09-17T01:07:07.162 INFO:tasks.workunit.client.0.smithi103.stdout:6/160: creat d3/d25/f37 x:0 0 0 2024-09-17T01:07:07.163 INFO:tasks.workunit.client.0.smithi103.stdout:9/244: mknod d7/d2d/c51 0 2024-09-17T01:07:07.167 INFO:tasks.workunit.client.1.smithi143.stdout:4/793: rename da/d3a/d7c to da/d3a/d3e/d4a/d104 0 2024-09-17T01:07:07.168 INFO:tasks.workunit.client.0.smithi103.stdout:3/273: mkdir d3/d44/d63 0 2024-09-17T01:07:07.171 INFO:tasks.workunit.client.0.smithi103.stdout:1/307: creat d2/d7/f5e x:0 0 0 2024-09-17T01:07:07.171 INFO:tasks.workunit.client.1.smithi143.stdout:4/794: truncate da/d3a/d3e/d72/ff4 157571 0 2024-09-17T01:07:07.174 INFO:tasks.workunit.client.1.smithi143.stdout:6/683: dread d2/d30/d45/d56/f60 [0,4194304] 0 2024-09-17T01:07:07.176 INFO:tasks.workunit.client.0.smithi103.stdout:7/182: rename d4/d11/d2b/c31 to d4/d11/d2b/d36/c40 0 2024-09-17T01:07:07.177 INFO:tasks.workunit.client.0.smithi103.stdout:8/242: truncate d0/d6/dc/f9 2224498 0 2024-09-17T01:07:07.177 INFO:tasks.workunit.client.0.smithi103.stdout:8/243: fsync d0/d6/dc/d30/f1f 0 2024-09-17T01:07:07.178 INFO:tasks.workunit.client.0.smithi103.stdout:0/227: mkdir dd/d1c/d50 0 2024-09-17T01:07:07.179 INFO:tasks.workunit.client.1.smithi143.stdout:9/749: creat d3/d39/d6a/dc3/ffc x:0 0 0 2024-09-17T01:07:07.180 INFO:tasks.workunit.client.0.smithi103.stdout:6/161: symlink d3/d17/d2f/l38 0 2024-09-17T01:07:07.183 INFO:tasks.workunit.client.0.smithi103.stdout:9/245: creat d7/d43/f52 x:0 0 0 2024-09-17T01:07:07.183 INFO:tasks.workunit.client.1.smithi143.stdout:5/735: link d1/d46/df/d23/d4f/d7d/d92/l112 d1/d46/df/d53/l118 0 2024-09-17T01:07:07.185 INFO:tasks.workunit.client.1.smithi143.stdout:6/684: stat d2/df/d40/d41/lce 0 2024-09-17T01:07:07.186 INFO:tasks.workunit.client.1.smithi143.stdout:6/685: dread - d2/d17/d3a/d47/d8e/d95/fb2 zero size 2024-09-17T01:07:07.186 INFO:tasks.workunit.client.1.smithi143.stdout:6/686: chown d2/d17/d6e/fa7 161 1 2024-09-17T01:07:07.187 INFO:tasks.workunit.client.0.smithi103.stdout:1/308: unlink d2/de/f44 0 2024-09-17T01:07:07.189 INFO:tasks.workunit.client.1.smithi143.stdout:9/750: fdatasync d3/f15 0 2024-09-17T01:07:07.190 INFO:tasks.workunit.client.1.smithi143.stdout:4/795: creat da/d3a/d3e/d72/dfa/f105 x:0 0 0 2024-09-17T01:07:07.192 INFO:tasks.workunit.client.1.smithi143.stdout:5/736: fsync d1/d46/df/d23/f4e 0 2024-09-17T01:07:07.194 INFO:tasks.workunit.client.1.smithi143.stdout:5/737: write d1/d46/df/d1f/d66/d70/de2/de3/f104 [948081,57955] 0 2024-09-17T01:07:07.194 INFO:tasks.workunit.client.1.smithi143.stdout:6/687: rename d2/d19/c1e to d2/df/d20/d2c/d38/ce2 0 2024-09-17T01:07:07.195 INFO:tasks.workunit.client.1.smithi143.stdout:5/738: fsync d1/d46/df/d53/d74/d9a/d9c/fc6 0 2024-09-17T01:07:07.197 INFO:tasks.workunit.client.1.smithi143.stdout:9/751: fsync d3/d39/d6a/dc3/d3e/f4d 0 2024-09-17T01:07:07.198 INFO:tasks.workunit.client.1.smithi143.stdout:9/752: chown d3/d39/d42/d80/df3/lba 57 1 2024-09-17T01:07:07.198 INFO:tasks.workunit.client.1.smithi143.stdout:4/796: fsync da/d3a/f59 0 2024-09-17T01:07:07.203 INFO:tasks.workunit.client.1.smithi143.stdout:1/819: dwrite d0/fee [0,4194304] 0 2024-09-17T01:07:07.205 INFO:tasks.workunit.client.1.smithi143.stdout:4/797: creat da/d3a/d3e/d72/dfa/f106 x:0 0 0 2024-09-17T01:07:07.207 INFO:tasks.workunit.client.1.smithi143.stdout:6/688: creat d2/d17/d6e/db0/fe3 x:0 0 0 2024-09-17T01:07:07.208 INFO:tasks.workunit.client.1.smithi143.stdout:5/739: getdents d1/d46/df/d1f/d66 0 2024-09-17T01:07:07.209 INFO:tasks.workunit.client.1.smithi143.stdout:9/753: dwrite d3/d81/d9c/fda [0,4194304] 0 2024-09-17T01:07:07.211 INFO:tasks.workunit.client.1.smithi143.stdout:4/798: chown da/f1c 16995 1 2024-09-17T01:07:07.212 INFO:tasks.workunit.client.1.smithi143.stdout:9/754: read d3/d81/d9c/fda [530956,49578] 0 2024-09-17T01:07:07.212 INFO:tasks.workunit.client.1.smithi143.stdout:1/820: rename d0/d6/d43/d6d/d8b/dd0/de2/d79/f7a to d0/dc/d89/f113 0 2024-09-17T01:07:07.214 INFO:tasks.workunit.client.1.smithi143.stdout:5/740: write d1/d46/d6e/f8d [3043128,54715] 0 2024-09-17T01:07:07.217 INFO:tasks.workunit.client.0.smithi103.stdout:4/281: sync 2024-09-17T01:07:07.218 INFO:tasks.workunit.client.1.smithi143.stdout:9/755: unlink d3/d39/d6a/dc3/d3e/d51/d52/l8f 0 2024-09-17T01:07:07.219 INFO:tasks.workunit.client.1.smithi143.stdout:6/689: mknod d2/d30/d45/d70/d87/ce4 0 2024-09-17T01:07:07.222 INFO:tasks.workunit.client.1.smithi143.stdout:5/741: dwrite d1/d46/d6e/f8d [0,4194304] 0 2024-09-17T01:07:07.228 INFO:tasks.workunit.client.1.smithi143.stdout:5/742: read d1/d46/f91 [4130066,23644] 0 2024-09-17T01:07:07.236 INFO:tasks.workunit.client.1.smithi143.stdout:1/821: rename d0/dc/l109 to d0/d6/d43/d6d/d8b/dd0/de2/d79/l114 0 2024-09-17T01:07:07.236 INFO:tasks.workunit.client.0.smithi103.stdout:3/274: mknod d3/c64 0 2024-09-17T01:07:07.237 INFO:tasks.workunit.client.1.smithi143.stdout:4/799: dread da/f31 [0,4194304] 0 2024-09-17T01:07:07.237 INFO:tasks.workunit.client.0.smithi103.stdout:9/246: dwrite d7/d43/f52 [0,4194304] 0 2024-09-17T01:07:07.237 INFO:tasks.workunit.client.0.smithi103.stdout:4/282: truncate d9/f3d 261584 0 2024-09-17T01:07:07.238 INFO:tasks.workunit.client.0.smithi103.stdout:3/275: stat d3/d16/d1b/d3c/f53 0 2024-09-17T01:07:07.240 INFO:tasks.workunit.client.0.smithi103.stdout:2/119: creat d6/da/d17/d1a/f22 x:0 0 0 2024-09-17T01:07:07.241 INFO:tasks.workunit.client.0.smithi103.stdout:2/120: chown d6/da/f14 23868 1 2024-09-17T01:07:07.242 INFO:tasks.workunit.client.1.smithi143.stdout:9/756: chown d3/d39/f82 2 1 2024-09-17T01:07:07.243 INFO:tasks.workunit.client.0.smithi103.stdout:0/228: dread f5 [0,4194304] 0 2024-09-17T01:07:07.244 INFO:tasks.workunit.client.0.smithi103.stdout:6/162: creat d3/d16/d21/f39 x:0 0 0 2024-09-17T01:07:07.245 INFO:tasks.workunit.client.0.smithi103.stdout:0/229: write dd/f36 [1537133,54111] 0 2024-09-17T01:07:07.245 INFO:tasks.workunit.client.0.smithi103.stdout:6/163: chown d3/d16/f1f 2268 1 2024-09-17T01:07:07.247 INFO:tasks.workunit.client.1.smithi143.stdout:6/690: fdatasync d2/df/d20/d2c/d75/f71 0 2024-09-17T01:07:07.249 INFO:tasks.workunit.client.0.smithi103.stdout:1/309: creat d2/d1c/d54/f5f x:0 0 0 2024-09-17T01:07:07.250 INFO:tasks.workunit.client.0.smithi103.stdout:3/276: read d3/d16/f3d [109175,35973] 0 2024-09-17T01:07:07.251 INFO:tasks.workunit.client.1.smithi143.stdout:5/743: write d1/d46/df/d23/d4f/d7d/f98 [3774981,49398] 0 2024-09-17T01:07:07.252 INFO:tasks.workunit.client.0.smithi103.stdout:0/230: dwrite dd/f4d [0,4194304] 0 2024-09-17T01:07:07.253 INFO:tasks.workunit.client.1.smithi143.stdout:1/822: creat d0/d6/d43/d47/d68/f115 x:0 0 0 2024-09-17T01:07:07.254 INFO:tasks.workunit.client.0.smithi103.stdout:4/283: write d9/d16/d23/f46 [4853330,33961] 0 2024-09-17T01:07:07.256 INFO:tasks.workunit.client.1.smithi143.stdout:4/800: rmdir da/d3a/d40/d84/db6 39 2024-09-17T01:07:07.261 INFO:tasks.workunit.client.0.smithi103.stdout:4/284: dwrite d9/d2d/f4a [0,4194304] 0 2024-09-17T01:07:07.264 INFO:tasks.workunit.client.1.smithi143.stdout:5/744: dread d1/d96/fd2 [0,4194304] 0 2024-09-17T01:07:07.264 INFO:tasks.workunit.client.1.smithi143.stdout:6/691: mknod d2/df/d18/ce5 0 2024-09-17T01:07:07.267 INFO:tasks.workunit.client.1.smithi143.stdout:1/823: dread d0/d6/d43/d6a/d52/db2/fed [0,4194304] 0 2024-09-17T01:07:07.267 INFO:tasks.workunit.client.0.smithi103.stdout:3/277: rmdir d3/d16/d1b 39 2024-09-17T01:07:07.276 INFO:tasks.workunit.client.1.smithi143.stdout:7/903: sync 2024-09-17T01:07:07.276 INFO:tasks.workunit.client.1.smithi143.stdout:0/737: sync 2024-09-17T01:07:07.278 INFO:tasks.workunit.client.0.smithi103.stdout:9/247: link d7/d43/d48/d11/d20/f44 d7/f53 0 2024-09-17T01:07:07.279 INFO:tasks.workunit.client.0.smithi103.stdout:9/248: stat d7/d43/d48/d11/d20/l30 0 2024-09-17T01:07:07.279 INFO:tasks.workunit.client.0.smithi103.stdout:9/249: chown d7/d2d 53 1 2024-09-17T01:07:07.280 INFO:tasks.workunit.client.0.smithi103.stdout:2/121: rename l2 to d6/l23 0 2024-09-17T01:07:07.281 INFO:tasks.workunit.client.0.smithi103.stdout:0/231: rename dd/df/d38 to dd/df/d38/d51 22 2024-09-17T01:07:07.282 INFO:tasks.workunit.client.0.smithi103.stdout:0/232: fdatasync dd/df/d38/f33 0 2024-09-17T01:07:07.283 INFO:tasks.workunit.client.0.smithi103.stdout:3/278: mkdir d3/d16/d1b/d3c/d65 0 2024-09-17T01:07:07.284 INFO:tasks.workunit.client.0.smithi103.stdout:3/279: chown d3/f8 90 1 2024-09-17T01:07:07.285 INFO:tasks.workunit.client.0.smithi103.stdout:3/280: write d3/f9 [1930796,18376] 0 2024-09-17T01:07:07.286 INFO:tasks.workunit.client.0.smithi103.stdout:3/281: fdatasync d3/f8 0 2024-09-17T01:07:07.286 INFO:tasks.workunit.client.0.smithi103.stdout:9/250: rename d7/d43/d48/c25 to d7/d43/c54 0 2024-09-17T01:07:07.287 INFO:tasks.workunit.client.0.smithi103.stdout:3/282: truncate d3/d16/d1b/f5e 420165 0 2024-09-17T01:07:07.288 INFO:tasks.workunit.client.0.smithi103.stdout:3/283: write d3/f7 [331508,65502] 0 2024-09-17T01:07:07.289 INFO:tasks.workunit.client.0.smithi103.stdout:6/164: truncate d3/d16/f1b 80304 0 2024-09-17T01:07:07.291 INFO:tasks.workunit.client.0.smithi103.stdout:4/285: write f5 [2347369,26802] 0 2024-09-17T01:07:07.295 INFO:tasks.workunit.client.1.smithi143.stdout:2/731: sync 2024-09-17T01:07:07.295 INFO:tasks.workunit.client.1.smithi143.stdout:8/809: sync 2024-09-17T01:07:07.295 INFO:tasks.workunit.client.1.smithi143.stdout:3/782: sync 2024-09-17T01:07:07.295 INFO:tasks.workunit.client.1.smithi143.stdout:2/732: readlink d0/dcf/ld1 0 2024-09-17T01:07:07.297 INFO:tasks.workunit.client.0.smithi103.stdout:6/165: mkdir d3/d25/d26/d3a 0 2024-09-17T01:07:07.298 INFO:tasks.workunit.client.0.smithi103.stdout:6/166: read d3/ff [758441,59887] 0 2024-09-17T01:07:07.300 INFO:tasks.workunit.client.0.smithi103.stdout:6/167: write d3/d16/f2d [479072,25923] 0 2024-09-17T01:07:07.300 INFO:tasks.workunit.client.0.smithi103.stdout:0/233: creat dd/d1c/d50/f52 x:0 0 0 2024-09-17T01:07:07.303 INFO:tasks.workunit.client.0.smithi103.stdout:4/286: symlink d9/d16/d23/l4e 0 2024-09-17T01:07:07.304 INFO:tasks.workunit.client.0.smithi103.stdout:0/234: dread dd/d1c/f1f [0,4194304] 0 2024-09-17T01:07:07.304 INFO:tasks.workunit.client.0.smithi103.stdout:4/287: fsync d9/d2d/f4a 0 2024-09-17T01:07:07.310 INFO:tasks.workunit.client.0.smithi103.stdout:6/168: rmdir d3/d16/d21 39 2024-09-17T01:07:07.316 INFO:tasks.workunit.client.0.smithi103.stdout:2/122: rename d6/da/d17/d21 to d6/da/d24 0 2024-09-17T01:07:07.324 INFO:tasks.workunit.client.0.smithi103.stdout:4/288: dread d9/d16/f1e [0,4194304] 0 2024-09-17T01:07:07.324 INFO:tasks.workunit.client.0.smithi103.stdout:0/235: dwrite dd/df/f13 [0,4194304] 0 2024-09-17T01:07:07.385 INFO:tasks.workunit.client.0.smithi103.stdout:3/284: link d3/d16/d1b/f4e d3/f66 0 2024-09-17T01:07:07.387 INFO:tasks.workunit.client.0.smithi103.stdout:6/169: dwrite d3/ff [0,4194304] 0 2024-09-17T01:07:07.418 INFO:tasks.workunit.client.0.smithi103.stdout:6/170: dread d3/d16/f1f [0,4194304] 0 2024-09-17T01:07:07.419 INFO:tasks.workunit.client.0.smithi103.stdout:6/171: dread - d3/d25/f37 zero size 2024-09-17T01:07:07.423 INFO:tasks.workunit.client.0.smithi103.stdout:0/236: creat dd/d43/f53 x:0 0 0 2024-09-17T01:07:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:07 smithi103 ceph-mon[28156]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 258 MiB/s wr, 462 op/s 2024-09-17T01:07:07.427 INFO:tasks.workunit.client.1.smithi143.stdout:5/745: fdatasync d1/d96/fd6 0 2024-09-17T01:07:07.428 INFO:tasks.workunit.client.1.smithi143.stdout:5/746: chown d1/d46/df/d23/d4f/l31 12757276 1 2024-09-17T01:07:07.429 INFO:tasks.workunit.client.1.smithi143.stdout:5/747: chown d1/d46/df/d1f/d9f/fa4 382 1 2024-09-17T01:07:07.434 INFO:tasks.workunit.client.1.smithi143.stdout:1/824: fsync d0/dc/d74/f8a 0 2024-09-17T01:07:07.435 INFO:tasks.workunit.client.0.smithi103.stdout:0/237: mknod dd/d1c/c54 0 2024-09-17T01:07:07.444 INFO:tasks.workunit.client.0.smithi103.stdout:2/123: creat d6/f25 x:0 0 0 2024-09-17T01:07:07.446 INFO:tasks.workunit.client.1.smithi143.stdout:8/810: creat d9/d12/d38/d7a/d8f/f124 x:0 0 0 2024-09-17T01:07:07.447 INFO:tasks.workunit.client.0.smithi103.stdout:0/238: mkdir dd/df/d38/d55 0 2024-09-17T01:07:07.449 INFO:tasks.workunit.client.1.smithi143.stdout:2/733: symlink d0/d10/d58/d5a/d5b/d4c/d71/dd2/lf4 0 2024-09-17T01:07:07.450 INFO:tasks.workunit.client.0.smithi103.stdout:2/124: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:07:07.451 INFO:tasks.workunit.client.1.smithi143.stdout:3/783: truncate d6/d1c/d33/d41/d2e/f87 799990 0 2024-09-17T01:07:07.451 INFO:tasks.workunit.client.0.smithi103.stdout:2/125: write d6/f19 [2833323,56435] 0 2024-09-17T01:07:07.454 INFO:tasks.workunit.client.1.smithi143.stdout:3/784: dread d6/d1c/d33/d3f/fbf [0,4194304] 0 2024-09-17T01:07:07.458 INFO:tasks.workunit.client.0.smithi103.stdout:2/126: mkdir d6/da/d17/d26 0 2024-09-17T01:07:07.459 INFO:tasks.workunit.client.0.smithi103.stdout:2/127: stat d6/da/d17/d1a/f22 0 2024-09-17T01:07:07.461 INFO:tasks.workunit.client.0.smithi103.stdout:0/239: truncate dd/d4f/f37 1338366 0 2024-09-17T01:07:07.461 INFO:tasks.workunit.client.0.smithi103.stdout:2/128: readlink d6/l23 0 2024-09-17T01:07:07.463 INFO:tasks.workunit.client.0.smithi103.stdout:0/240: dread f5 [0,4194304] 0 2024-09-17T01:07:07.465 INFO:tasks.workunit.client.1.smithi143.stdout:1/825: creat d0/d6/d43/d6d/d8b/dd0/f116 x:0 0 0 2024-09-17T01:07:07.466 INFO:tasks.workunit.client.1.smithi143.stdout:1/826: chown d0/d6/d43/d6a/l34 512552 1 2024-09-17T01:07:07.466 INFO:tasks.workunit.client.1.smithi143.stdout:7/904: symlink d4/d16/dbd/d104/l123 0 2024-09-17T01:07:07.467 INFO:tasks.workunit.client.0.smithi103.stdout:0/241: chown c2 122466155 1 2024-09-17T01:07:07.467 INFO:tasks.workunit.client.0.smithi103.stdout:0/242: stat dd/d4f/f2a 0 2024-09-17T01:07:07.467 INFO:tasks.workunit.client.1.smithi143.stdout:1/827: read d0/d6/d43/d47/d68/d7b/daf/ff2 [422456,77147] 0 2024-09-17T01:07:07.468 INFO:tasks.workunit.client.0.smithi103.stdout:2/129: link d6/f25 d6/da/d24/f27 0 2024-09-17T01:07:07.469 INFO:tasks.workunit.client.1.smithi143.stdout:1/828: read d0/d6/d43/d6a/df/d27/f84 [716870,86404] 0 2024-09-17T01:07:07.470 INFO:tasks.workunit.client.0.smithi103.stdout:0/243: mknod dd/d4f/c56 0 2024-09-17T01:07:07.470 INFO:tasks.workunit.client.0.smithi103.stdout:0/244: chown dd/df/d38/f33 9681530 1 2024-09-17T01:07:07.471 INFO:tasks.workunit.client.1.smithi143.stdout:7/905: read d4/d1f/f23 [229101,89446] 0 2024-09-17T01:07:07.471 INFO:tasks.workunit.client.1.smithi143.stdout:3/785: dread d6/d1c/d33/d41/f11 [0,4194304] 0 2024-09-17T01:07:07.475 INFO:tasks.workunit.client.0.smithi103.stdout:2/130: mkdir d6/da/d28 0 2024-09-17T01:07:07.476 INFO:tasks.workunit.client.1.smithi143.stdout:5/748: getdents d1/d46/df/d23/d4f/d7d/d102/d115 0 2024-09-17T01:07:07.479 INFO:tasks.workunit.client.0.smithi103.stdout:2/131: chown f4 988776 1 2024-09-17T01:07:07.483 INFO:tasks.workunit.client.0.smithi103.stdout:2/132: rmdir d6/da/d17/d1a 39 2024-09-17T01:07:07.490 INFO:tasks.workunit.client.1.smithi143.stdout:7/906: creat d4/d16/dbd/f124 x:0 0 0 2024-09-17T01:07:07.490 INFO:tasks.workunit.client.0.smithi103.stdout:2/133: dwrite d6/da/d17/f20 [0,4194304] 0 2024-09-17T01:07:07.494 INFO:tasks.workunit.client.1.smithi143.stdout:5/749: truncate d1/d46/df/f36 1196005 0 2024-09-17T01:07:07.496 INFO:tasks.workunit.client.1.smithi143.stdout:7/907: dwrite d4/fb7 [0,4194304] 0 2024-09-17T01:07:07.497 INFO:tasks.workunit.client.1.smithi143.stdout:4/801: getdents da/d3a/d3e/d4a/d8c 0 2024-09-17T01:07:07.501 INFO:tasks.workunit.client.0.smithi103.stdout:2/134: creat d6/da/d17/f29 x:0 0 0 2024-09-17T01:07:07.502 INFO:tasks.workunit.client.1.smithi143.stdout:6/692: creat d2/d17/d6e/d26/d46/fe6 x:0 0 0 2024-09-17T01:07:07.503 INFO:tasks.workunit.client.1.smithi143.stdout:6/693: truncate d2/d30/dc1/fc8 5339045 0 2024-09-17T01:07:07.504 INFO:tasks.workunit.client.1.smithi143.stdout:3/786: fsync d6/d1c/d33/d41/d42/f4c 0 2024-09-17T01:07:07.505 INFO:tasks.workunit.client.1.smithi143.stdout:3/787: dread - d6/d1c/d33/fe9 zero size 2024-09-17T01:07:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:07 smithi143 ceph-mon[35452]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 258 MiB/s wr, 462 op/s 2024-09-17T01:07:07.508 INFO:tasks.workunit.client.0.smithi103.stdout:2/135: link d6/da/d24/f27 d6/da/d24/f2a 0 2024-09-17T01:07:07.510 INFO:tasks.workunit.client.1.smithi143.stdout:4/802: fsync da/d3a/d40/d84/f4b 0 2024-09-17T01:07:07.512 INFO:tasks.workunit.client.0.smithi103.stdout:2/136: creat d6/da/d28/f2b x:0 0 0 2024-09-17T01:07:07.514 INFO:tasks.workunit.client.1.smithi143.stdout:6/694: mknod d2/df/d20/d2c/d75/ce7 0 2024-09-17T01:07:07.515 INFO:tasks.workunit.client.1.smithi143.stdout:3/788: creat d6/d68/ff6 x:0 0 0 2024-09-17T01:07:07.516 INFO:tasks.workunit.client.1.smithi143.stdout:3/789: truncate d6/d1c/d33/d41/d2b/fce 404469 0 2024-09-17T01:07:07.516 INFO:tasks.workunit.client.0.smithi103.stdout:2/137: creat d6/da/d17/d26/f2c x:0 0 0 2024-09-17T01:07:07.519 INFO:tasks.workunit.client.1.smithi143.stdout:4/803: write da/d3a/d3e/d5e/fa2 [2258215,43095] 0 2024-09-17T01:07:07.520 INFO:tasks.workunit.client.1.smithi143.stdout:6/695: mkdir d2/d30/dc1/de8 0 2024-09-17T01:07:07.520 INFO:tasks.workunit.client.1.smithi143.stdout:4/804: chown da/d3a/d3e/d72/dfa/f105 4 1 2024-09-17T01:07:07.522 INFO:tasks.workunit.client.1.smithi143.stdout:3/790: creat d6/d1c/d82/de4/ff7 x:0 0 0 2024-09-17T01:07:07.522 INFO:tasks.workunit.client.1.smithi143.stdout:4/805: truncate da/d3a/d3e/d4a/d8c/fa0 1002504 0 2024-09-17T01:07:07.524 INFO:tasks.workunit.client.1.smithi143.stdout:4/806: chown da/d6d/fd6 61 1 2024-09-17T01:07:07.529 INFO:tasks.workunit.client.1.smithi143.stdout:4/807: creat da/d3a/d40/d84/dd0/f107 x:0 0 0 2024-09-17T01:07:07.529 INFO:tasks.workunit.client.1.smithi143.stdout:4/808: mknod da/d68/d9b/ddd/c108 0 2024-09-17T01:07:07.531 INFO:tasks.workunit.client.1.smithi143.stdout:4/809: symlink da/d3a/d3e/d4a/d104/l109 0 2024-09-17T01:07:07.540 INFO:tasks.workunit.client.0.smithi103.stdout:4/289: dwrite d9/f3a [0,4194304] 0 2024-09-17T01:07:07.542 INFO:tasks.workunit.client.0.smithi103.stdout:4/290: write d9/dc/df/f20 [1509399,83750] 0 2024-09-17T01:07:07.543 INFO:tasks.workunit.client.0.smithi103.stdout:4/291: chown d9/d16/l1c 0 1 2024-09-17T01:07:07.543 INFO:tasks.workunit.client.0.smithi103.stdout:4/292: readlink d9/d16/d38/d3f/l41 0 2024-09-17T01:07:07.546 INFO:tasks.workunit.client.0.smithi103.stdout:4/293: creat d9/d16/d44/f4f x:0 0 0 2024-09-17T01:07:07.548 INFO:tasks.workunit.client.0.smithi103.stdout:4/294: read d9/d2d/f39 [479548,78154] 0 2024-09-17T01:07:07.551 INFO:tasks.workunit.client.1.smithi143.stdout:0/738: rename d3/d14/d32/dde to d3/d5/d8/def 0 2024-09-17T01:07:07.554 INFO:tasks.workunit.client.1.smithi143.stdout:6/696: rename d2/df/d40/d41/d6c to d2/d30/dc1/de8/de9 0 2024-09-17T01:07:07.557 INFO:tasks.workunit.client.1.smithi143.stdout:3/791: rename d6/d1c/d33/d41/d2e/d30/c7c to d6/d1c/d33/d3f/df0/cf8 0 2024-09-17T01:07:07.558 INFO:tasks.workunit.client.1.smithi143.stdout:6/697: mknod d2/df/d20/d2c/d38/cea 0 2024-09-17T01:07:07.561 INFO:tasks.workunit.client.1.smithi143.stdout:6/698: creat d2/d30/feb x:0 0 0 2024-09-17T01:07:07.563 INFO:tasks.workunit.client.1.smithi143.stdout:6/699: dread d2/d19/f98 [0,4194304] 0 2024-09-17T01:07:07.566 INFO:tasks.workunit.client.1.smithi143.stdout:6/700: mkdir d2/d17/d6e/d26/d79/dec 0 2024-09-17T01:07:07.567 INFO:tasks.workunit.client.1.smithi143.stdout:6/701: dread - d2/d30/db4/dbc/fdf zero size 2024-09-17T01:07:07.567 INFO:tasks.workunit.client.1.smithi143.stdout:2/734: write d0/d10/d58/d5a/f78 [736554,112399] 0 2024-09-17T01:07:07.568 INFO:tasks.workunit.client.0.smithi103.stdout:3/285: unlink d3/d16/f2b 0 2024-09-17T01:07:07.569 INFO:tasks.workunit.client.1.smithi143.stdout:3/792: dread d6/fa [0,4194304] 0 2024-09-17T01:07:07.570 INFO:tasks.workunit.client.1.smithi143.stdout:2/735: write d0/d2/d21/d84/d8d/fb1 [2141519,3069] 0 2024-09-17T01:07:07.570 INFO:tasks.workunit.client.1.smithi143.stdout:3/793: dread - d6/d1c/d82/de4/ff7 zero size 2024-09-17T01:07:07.571 INFO:tasks.workunit.client.0.smithi103.stdout:9/251: rename f5 to d7/f55 0 2024-09-17T01:07:07.573 INFO:tasks.workunit.client.0.smithi103.stdout:0/245: dwrite dd/df/f26 [0,4194304] 0 2024-09-17T01:07:07.573 INFO:tasks.workunit.client.0.smithi103.stdout:3/286: creat d3/d16/d1b/d36/f67 x:0 0 0 2024-09-17T01:07:07.573 INFO:tasks.workunit.client.1.smithi143.stdout:6/702: truncate d2/d30/d45/d70/f78 443162 0 2024-09-17T01:07:07.574 INFO:tasks.workunit.client.1.smithi143.stdout:3/794: read - d6/d1c/d33/d41/d2e/d30/fb6 zero size 2024-09-17T01:07:07.574 INFO:tasks.workunit.client.0.smithi103.stdout:0/246: write dd/d43/f53 [355860,43254] 0 2024-09-17T01:07:07.574 INFO:tasks.workunit.client.0.smithi103.stdout:3/287: write d3/d16/d1b/f46 [5163120,37285] 0 2024-09-17T01:07:07.575 INFO:tasks.workunit.client.0.smithi103.stdout:0/247: chown dd/d1c/l31 0 1 2024-09-17T01:07:07.576 INFO:tasks.workunit.client.0.smithi103.stdout:0/248: chown dd/f3e 8059778 1 2024-09-17T01:07:07.580 INFO:tasks.workunit.client.0.smithi103.stdout:4/295: rename d9/dc/f2f to d9/d16/d23/d2a/f50 0 2024-09-17T01:07:07.581 INFO:tasks.workunit.client.0.smithi103.stdout:4/296: write f5 [2546887,102752] 0 2024-09-17T01:07:07.583 INFO:tasks.workunit.client.1.smithi143.stdout:8/811: dwrite d9/de/f6f [0,4194304] 0 2024-09-17T01:07:07.583 INFO:tasks.workunit.client.1.smithi143.stdout:6/703: truncate d2/d17/d6e/d26/d46/d65/f7f 4222291 0 2024-09-17T01:07:07.583 INFO:tasks.workunit.client.0.smithi103.stdout:4/297: chown d9/d10/f1f 2482 1 2024-09-17T01:07:07.584 INFO:tasks.workunit.client.0.smithi103.stdout:0/249: dwrite dd/df/f41 [0,4194304] 0 2024-09-17T01:07:07.584 INFO:tasks.workunit.client.0.smithi103.stdout:9/252: symlink d7/l56 0 2024-09-17T01:07:07.586 INFO:tasks.workunit.client.0.smithi103.stdout:9/253: write d7/d43/d48/f50 [43324,118130] 0 2024-09-17T01:07:07.586 INFO:tasks.workunit.client.0.smithi103.stdout:4/298: write f5 [100454,17117] 0 2024-09-17T01:07:07.586 INFO:tasks.workunit.client.1.smithi143.stdout:2/736: link d0/d2/d21/d22/fd4 d0/d10/d58/d5a/d5b/d4c/d71/d99/ff5 0 2024-09-17T01:07:07.590 INFO:tasks.workunit.client.1.smithi143.stdout:9/757: rename d3/fc9 to d3/ffd 0 2024-09-17T01:07:07.594 INFO:tasks.workunit.client.1.smithi143.stdout:8/812: mkdir d9/d12/d38/d58/d125 0 2024-09-17T01:07:07.598 INFO:tasks.workunit.client.1.smithi143.stdout:9/758: rename d3/d3d/c8e to d3/d39/d6a/dc3/d3e/d51/cfe 0 2024-09-17T01:07:07.599 INFO:tasks.workunit.client.0.smithi103.stdout:5/160: sync 2024-09-17T01:07:07.600 INFO:tasks.workunit.client.0.smithi103.stdout:9/254: fsync d7/d43/d48/f38 0 2024-09-17T01:07:07.601 INFO:tasks.workunit.client.1.smithi143.stdout:5/750: write d1/d46/df/d53/d74/d9a/d9c/fc8 [429850,20739] 0 2024-09-17T01:07:07.602 INFO:tasks.workunit.client.0.smithi103.stdout:4/299: symlink d9/d16/d38/d3f/l51 0 2024-09-17T01:07:07.602 INFO:tasks.workunit.client.1.smithi143.stdout:6/704: dwrite d2/d17/d6e/d26/d46/f80 [0,4194304] 0 2024-09-17T01:07:07.605 INFO:tasks.workunit.client.1.smithi143.stdout:8/813: dwrite d9/d2b/f78 [4194304,4194304] 0 2024-09-17T01:07:07.606 INFO:tasks.workunit.client.1.smithi143.stdout:1/829: sync 2024-09-17T01:07:07.606 INFO:tasks.workunit.client.1.smithi143.stdout:7/908: write d4/d16/f1d [2341039,25978] 0 2024-09-17T01:07:07.606 INFO:tasks.workunit.client.0.smithi103.stdout:5/161: mknod d6/d28/c3f 0 2024-09-17T01:07:07.610 INFO:tasks.workunit.client.0.smithi103.stdout:4/300: fdatasync d9/fd 0 2024-09-17T01:07:07.612 INFO:tasks.workunit.client.0.smithi103.stdout:0/250: creat dd/df/f57 x:0 0 0 2024-09-17T01:07:07.612 INFO:tasks.workunit.client.1.smithi143.stdout:5/751: mknod d1/d46/df/d1f/d7a/c119 0 2024-09-17T01:07:07.612 INFO:tasks.workunit.client.1.smithi143.stdout:2/737: link d0/d10/c4b d0/d44/d6a/d91/dc4/cf6 0 2024-09-17T01:07:07.615 INFO:tasks.workunit.client.1.smithi143.stdout:9/759: dread d3/d39/d6a/fc [0,4194304] 0 2024-09-17T01:07:07.617 INFO:tasks.workunit.client.0.smithi103.stdout:2/138: truncate f5 949023 0 2024-09-17T01:07:07.617 INFO:tasks.workunit.client.1.smithi143.stdout:7/909: symlink d4/d1f/d4a/d9e/da2/l125 0 2024-09-17T01:07:07.618 INFO:tasks.workunit.client.1.smithi143.stdout:5/752: write d1/d46/df/d23/f2a [1259236,69703] 0 2024-09-17T01:07:07.618 INFO:tasks.workunit.client.0.smithi103.stdout:4/301: unlink d9/dc/l11 0 2024-09-17T01:07:07.619 INFO:tasks.workunit.client.1.smithi143.stdout:8/814: dwrite d9/de/d53/d75/dfa/d66/fa9 [0,4194304] 0 2024-09-17T01:07:07.621 INFO:tasks.workunit.client.1.smithi143.stdout:5/753: chown d1/d46/df/d53/d74/d9a/d9c/fc6 4196942 1 2024-09-17T01:07:07.621 INFO:tasks.workunit.client.0.smithi103.stdout:5/162: symlink d6/db/l40 0 2024-09-17T01:07:07.624 INFO:tasks.workunit.client.1.smithi143.stdout:2/738: rmdir d0/d10/d58/d5a/d5b/d4c/d71/dd2 39 2024-09-17T01:07:07.627 INFO:tasks.workunit.client.1.smithi143.stdout:1/830: truncate d0/d6/d43/d47/d68/d7b/fb0 708591 0 2024-09-17T01:07:07.628 INFO:tasks.workunit.client.1.smithi143.stdout:2/739: dwrite d0/d10/d56/f6d [0,4194304] 0 2024-09-17T01:07:07.629 INFO:tasks.workunit.client.1.smithi143.stdout:2/740: readlink d0/d44/d6a/la3 0 2024-09-17T01:07:07.629 INFO:tasks.workunit.client.1.smithi143.stdout:9/760: unlink d3/d39/d6a/ce 0 2024-09-17T01:07:07.630 INFO:tasks.workunit.client.1.smithi143.stdout:4/810: write da/f1b [3073343,82647] 0 2024-09-17T01:07:07.630 INFO:tasks.workunit.client.0.smithi103.stdout:5/163: rename d6/d11/l19 to d6/d11/l41 0 2024-09-17T01:07:07.633 INFO:tasks.workunit.client.1.smithi143.stdout:7/910: fsync d4/d26/fab 0 2024-09-17T01:07:07.636 INFO:tasks.workunit.client.1.smithi143.stdout:2/741: dread d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fc6 [0,4194304] 0 2024-09-17T01:07:07.636 INFO:tasks.workunit.client.0.smithi103.stdout:5/164: mknod d6/d2c/d32/c42 0 2024-09-17T01:07:07.638 INFO:tasks.workunit.client.1.smithi143.stdout:2/742: chown d0/d10/d58/d5a/d5b/d4c/d71/d9d/c5e 76659628 1 2024-09-17T01:07:07.640 INFO:tasks.workunit.client.0.smithi103.stdout:0/251: getdents dd/d43 0 2024-09-17T01:07:07.643 INFO:tasks.workunit.client.0.smithi103.stdout:2/139: link d6/da/d17/d1a/f22 d6/f2d 0 2024-09-17T01:07:07.646 INFO:tasks.workunit.client.0.smithi103.stdout:0/252: dwrite dd/f3b [0,4194304] 0 2024-09-17T01:07:07.650 INFO:tasks.workunit.client.0.smithi103.stdout:0/253: creat dd/d43/f58 x:0 0 0 2024-09-17T01:07:07.654 INFO:tasks.workunit.client.1.smithi143.stdout:7/911: fdatasync d4/f13 0 2024-09-17T01:07:07.658 INFO:tasks.workunit.client.0.smithi103.stdout:0/254: creat dd/df/d38/d55/f59 x:0 0 0 2024-09-17T01:07:07.660 INFO:tasks.workunit.client.1.smithi143.stdout:5/754: creat d1/d46/df/d23/d4f/d7d/d102/d115/f11a x:0 0 0 2024-09-17T01:07:07.662 INFO:tasks.workunit.client.0.smithi103.stdout:0/255: mknod dd/d1c/c5a 0 2024-09-17T01:07:07.662 INFO:tasks.workunit.client.0.smithi103.stdout:0/256: fdatasync dd/df/f46 0 2024-09-17T01:07:07.665 INFO:tasks.workunit.client.1.smithi143.stdout:9/761: mkdir d3/d3d/de3/df4/dff 0 2024-09-17T01:07:07.665 INFO:tasks.workunit.client.1.smithi143.stdout:3/795: dwrite d6/d68/fb8 [0,4194304] 0 2024-09-17T01:07:07.666 INFO:tasks.workunit.client.0.smithi103.stdout:0/257: write dd/df/f39 [4377,114435] 0 2024-09-17T01:07:07.669 INFO:tasks.workunit.client.1.smithi143.stdout:4/811: mkdir da/d3a/d3e/d5e/dd5/d10a 0 2024-09-17T01:07:07.670 INFO:tasks.workunit.client.1.smithi143.stdout:6/705: link d2/d17/d6e/d26/d46/c81 d2/df/d40/d41/ced 0 2024-09-17T01:07:07.671 INFO:tasks.workunit.client.1.smithi143.stdout:9/762: dread d3/d39/d42/d80/df3/fce [0,4194304] 0 2024-09-17T01:07:07.671 INFO:tasks.workunit.client.1.smithi143.stdout:8/815: creat d9/f126 x:0 0 0 2024-09-17T01:07:07.672 INFO:tasks.workunit.client.1.smithi143.stdout:6/706: write d2/d17/d3a/d47/d8e/d95/fb2 [780052,35025] 0 2024-09-17T01:07:07.672 INFO:tasks.workunit.client.1.smithi143.stdout:5/755: dread - d1/d46/df/d23/f6f zero size 2024-09-17T01:07:07.677 INFO:tasks.workunit.client.1.smithi143.stdout:4/812: symlink da/d3a/d3e/d72/dfa/l10b 0 2024-09-17T01:07:07.678 INFO:tasks.workunit.client.1.smithi143.stdout:8/816: dread d9/d23/fd0 [0,4194304] 0 2024-09-17T01:07:07.679 INFO:tasks.workunit.client.1.smithi143.stdout:5/756: stat d1/l49 0 2024-09-17T01:07:07.680 INFO:tasks.workunit.client.1.smithi143.stdout:8/817: chown d9/d12/ff7 6773 1 2024-09-17T01:07:07.680 INFO:tasks.workunit.client.1.smithi143.stdout:6/707: dwrite d2/d17/f77 [0,4194304] 0 2024-09-17T01:07:07.682 INFO:tasks.workunit.client.0.smithi103.stdout:9/255: write d7/fc [5699891,98492] 0 2024-09-17T01:07:07.686 INFO:tasks.workunit.client.1.smithi143.stdout:4/813: creat da/d3a/d3e/d5e/d63/f10c x:0 0 0 2024-09-17T01:07:07.686 INFO:tasks.workunit.client.1.smithi143.stdout:0/739: creat d3/d5/d8/d27/d31/d4c/ff0 x:0 0 0 2024-09-17T01:07:07.687 INFO:tasks.workunit.client.0.smithi103.stdout:9/256: dread d7/d43/f52 [0,4194304] 0 2024-09-17T01:07:07.689 INFO:tasks.workunit.client.1.smithi143.stdout:4/814: read da/d3a/d3e/d4a/d8a/fdc [1348887,82453] 0 2024-09-17T01:07:07.689 INFO:tasks.workunit.client.1.smithi143.stdout:0/740: chown d3/d5/d8/d27/d31/d85/fa4 38 1 2024-09-17T01:07:07.690 INFO:tasks.workunit.client.1.smithi143.stdout:8/818: creat d9/d12/d38/d7a/d8f/f127 x:0 0 0 2024-09-17T01:07:07.692 INFO:tasks.workunit.client.1.smithi143.stdout:8/819: write d9/d23/db4/d55/dfe/f114 [730723,111189] 0 2024-09-17T01:07:07.692 INFO:tasks.workunit.client.0.smithi103.stdout:3/288: rename d3/fd to d3/d16/d1b/d3c/f68 0 2024-09-17T01:07:07.694 INFO:tasks.workunit.client.0.smithi103.stdout:9/257: write d7/d43/d48/d11/d21/f3f [2359534,22898] 0 2024-09-17T01:07:07.696 INFO:tasks.workunit.client.0.smithi103.stdout:3/289: fdatasync d3/f66 0 2024-09-17T01:07:07.698 INFO:tasks.workunit.client.0.smithi103.stdout:5/165: rename d6/d2c/l2e to d6/d28/l43 0 2024-09-17T01:07:07.704 INFO:tasks.workunit.client.0.smithi103.stdout:2/140: rename d6/da/f14 to d6/da/d28/f2e 0 2024-09-17T01:07:07.706 INFO:tasks.workunit.client.1.smithi143.stdout:1/831: dwrite d0/d6/d43/d47/d68/d7b/daf/ff2 [0,4194304] 0 2024-09-17T01:07:07.707 INFO:tasks.workunit.client.1.smithi143.stdout:1/832: dread - d0/d6/d43/d6d/d8b/dd0/de2/d6b/d9d/fd1 zero size 2024-09-17T01:07:07.709 INFO:tasks.workunit.client.1.smithi143.stdout:4/815: creat da/d3a/d3e/d72/da3/dc0/df1/f10d x:0 0 0 2024-09-17T01:07:07.710 INFO:tasks.workunit.client.1.smithi143.stdout:6/708: dread d2/d30/d84/fb1 [0,4194304] 0 2024-09-17T01:07:07.711 INFO:tasks.workunit.client.1.smithi143.stdout:2/743: write d0/d10/d58/d5a/d5b/fa4 [215295,36672] 0 2024-09-17T01:07:07.712 INFO:tasks.workunit.client.1.smithi143.stdout:4/816: write da/d6d/dca/ffd [196697,52400] 0 2024-09-17T01:07:07.714 INFO:tasks.workunit.client.0.smithi103.stdout:0/258: rename dd/d4f/l27 to dd/df/d38/l5b 0 2024-09-17T01:07:07.716 INFO:tasks.workunit.client.0.smithi103.stdout:5/166: symlink d6/d2c/d38/l44 0 2024-09-17T01:07:07.718 INFO:tasks.workunit.client.0.smithi103.stdout:3/290: rename d3/l33 to d3/l69 0 2024-09-17T01:07:07.719 INFO:tasks.workunit.client.1.smithi143.stdout:3/796: write d6/d1c/d33/fb5 [551699,16717] 0 2024-09-17T01:07:07.720 INFO:tasks.workunit.client.0.smithi103.stdout:0/259: dwrite dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:07.721 INFO:tasks.workunit.client.1.smithi143.stdout:8/820: rename c8 to d9/c128 0 2024-09-17T01:07:07.723 INFO:tasks.workunit.client.0.smithi103.stdout:5/167: symlink d6/d11/d13/l45 0 2024-09-17T01:07:07.724 INFO:tasks.workunit.client.0.smithi103.stdout:5/168: chown d6/d11/d30 138 1 2024-09-17T01:07:07.724 INFO:tasks.workunit.client.0.smithi103.stdout:5/169: chown f0 6542180 1 2024-09-17T01:07:07.725 INFO:tasks.workunit.client.1.smithi143.stdout:6/709: write d2/d30/d45/d56/f60 [4784684,100524] 0 2024-09-17T01:07:07.728 INFO:tasks.workunit.client.0.smithi103.stdout:2/141: creat d6/da/f2f x:0 0 0 2024-09-17T01:07:07.731 INFO:tasks.workunit.client.0.smithi103.stdout:0/260: unlink dd/df/f21 0 2024-09-17T01:07:07.732 INFO:tasks.workunit.client.1.smithi143.stdout:5/757: write d1/d46/d6e/f78 [608327,83760] 0 2024-09-17T01:07:07.732 INFO:tasks.workunit.client.0.smithi103.stdout:5/170: dwrite d6/db/f34 [0,4194304] 0 2024-09-17T01:07:07.733 INFO:tasks.workunit.client.1.smithi143.stdout:9/763: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:07:07.733 INFO:tasks.workunit.client.1.smithi143.stdout:3/797: creat d6/d1c/d33/d41/d2e/ff9 x:0 0 0 2024-09-17T01:07:07.735 INFO:tasks.workunit.client.0.smithi103.stdout:3/291: symlink d3/d16/l6a 0 2024-09-17T01:07:07.736 INFO:tasks.workunit.client.0.smithi103.stdout:5/171: fsync d6/d11/d13/f21 0 2024-09-17T01:07:07.737 INFO:tasks.workunit.client.1.smithi143.stdout:3/798: dread d6/d1c/d33/d41/d2e/d30/f6f [0,4194304] 0 2024-09-17T01:07:07.739 INFO:tasks.workunit.client.1.smithi143.stdout:1/833: rename d0/d6/d43/d6a/df/c16 to d0/d6/d43/d47/d68/d7b/daf/c117 0 2024-09-17T01:07:07.740 INFO:tasks.workunit.client.1.smithi143.stdout:6/710: dread d2/d17/d3a/f51 [0,4194304] 0 2024-09-17T01:07:07.741 INFO:tasks.workunit.client.1.smithi143.stdout:1/834: write d0/f19 [4672901,57616] 0 2024-09-17T01:07:07.742 INFO:tasks.workunit.client.0.smithi103.stdout:3/292: dread d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:07.743 INFO:tasks.workunit.client.0.smithi103.stdout:3/293: fdatasync d3/d16/d1b/d3c/f4f 0 2024-09-17T01:07:07.745 INFO:tasks.workunit.client.1.smithi143.stdout:3/799: dwrite d6/d1c/d4d/da4/ff5 [0,4194304] 0 2024-09-17T01:07:07.746 INFO:tasks.workunit.client.0.smithi103.stdout:5/172: dwrite d6/f1e [4194304,4194304] 0 2024-09-17T01:07:07.749 INFO:tasks.workunit.client.0.smithi103.stdout:5/173: write d6/d11/f26 [4987745,106275] 0 2024-09-17T01:07:07.749 INFO:tasks.workunit.client.0.smithi103.stdout:2/142: symlink d6/da/d17/d1a/df/l30 0 2024-09-17T01:07:07.751 INFO:tasks.workunit.client.0.smithi103.stdout:2/143: dread - d6/da/d17/d1a/f22 zero size 2024-09-17T01:07:07.755 INFO:tasks.workunit.client.0.smithi103.stdout:0/261: unlink dd/d1c/l31 0 2024-09-17T01:07:07.756 INFO:tasks.workunit.client.0.smithi103.stdout:0/262: read - dd/f42 zero size 2024-09-17T01:07:07.758 INFO:tasks.workunit.client.0.smithi103.stdout:9/258: dwrite d7/d43/d48/d11/f10 [0,4194304] 0 2024-09-17T01:07:07.759 INFO:tasks.workunit.client.1.smithi143.stdout:0/741: write d3/d5/d8/d21/f49 [1668026,91887] 0 2024-09-17T01:07:07.761 INFO:tasks.workunit.client.1.smithi143.stdout:5/758: dread d1/f68 [0,4194304] 0 2024-09-17T01:07:07.762 INFO:tasks.workunit.client.1.smithi143.stdout:0/742: write d3/d5/d8/d21/d9b/dba/fd1 [4735066,63618] 0 2024-09-17T01:07:07.765 INFO:tasks.workunit.client.0.smithi103.stdout:5/174: mknod d6/d2c/d38/c46 0 2024-09-17T01:07:07.769 INFO:tasks.workunit.client.0.smithi103.stdout:2/144: mknod d6/da/d17/d26/c31 0 2024-09-17T01:07:07.770 INFO:tasks.workunit.client.1.smithi143.stdout:7/912: sync 2024-09-17T01:07:07.772 INFO:tasks.workunit.client.1.smithi143.stdout:2/744: write d0/d10/d58/d5a/d5b/d4c/d71/d9d/f73 [609522,96311] 0 2024-09-17T01:07:07.773 INFO:tasks.workunit.client.0.smithi103.stdout:9/259: rename d7/d43/d48/d11/d21/f3f to d7/d43/f57 0 2024-09-17T01:07:07.775 INFO:tasks.workunit.client.0.smithi103.stdout:3/294: creat d3/d16/d1b/d3c/d65/f6b x:0 0 0 2024-09-17T01:07:07.776 INFO:tasks.workunit.client.0.smithi103.stdout:3/295: write d3/d16/d1b/d2c/f41 [5087888,97197] 0 2024-09-17T01:07:07.777 INFO:tasks.workunit.client.0.smithi103.stdout:5/175: mkdir d6/d2c/d32/d47 0 2024-09-17T01:07:07.778 INFO:tasks.workunit.client.1.smithi143.stdout:4/817: dwrite da/d3a/d3e/d4a/fd9 [4194304,4194304] 0 2024-09-17T01:07:07.778 INFO:tasks.workunit.client.1.smithi143.stdout:6/711: dwrite d2/d30/d84/fb1 [0,4194304] 0 2024-09-17T01:07:07.779 INFO:tasks.workunit.client.0.smithi103.stdout:3/296: dread d3/d16/d1b/d3c/f40 [0,4194304] 0 2024-09-17T01:07:07.780 INFO:tasks.workunit.client.1.smithi143.stdout:9/764: dread d3/d39/d42/f54 [0,4194304] 0 2024-09-17T01:07:07.781 INFO:tasks.workunit.client.1.smithi143.stdout:0/743: mknod d3/d5/d8/d21/d2e/dda/cf1 0 2024-09-17T01:07:07.783 INFO:tasks.workunit.client.0.smithi103.stdout:2/145: unlink d6/da/d17/d1a/df/f16 0 2024-09-17T01:07:07.784 INFO:tasks.workunit.client.0.smithi103.stdout:2/146: dread - d6/da/d17/f29 zero size 2024-09-17T01:07:07.785 INFO:tasks.workunit.client.1.smithi143.stdout:1/835: mkdir d0/d118 0 2024-09-17T01:07:07.785 INFO:tasks.workunit.client.0.smithi103.stdout:2/147: dread - d6/f25 zero size 2024-09-17T01:07:07.788 INFO:tasks.workunit.client.1.smithi143.stdout:8/821: write d9/d12/d38/f64 [1843121,35246] 0 2024-09-17T01:07:07.790 INFO:tasks.workunit.client.0.smithi103.stdout:9/260: creat d7/d43/d48/d11/d20/f58 x:0 0 0 2024-09-17T01:07:07.792 INFO:tasks.workunit.client.1.smithi143.stdout:8/822: read d9/d23/db4/d55/dfe/f114 [14638,9029] 0 2024-09-17T01:07:07.795 INFO:tasks.workunit.client.1.smithi143.stdout:2/745: mknod d0/d10/d58/d5a/cf7 0 2024-09-17T01:07:07.795 INFO:tasks.workunit.client.1.smithi143.stdout:2/746: write d0/d10/d56/fb7 [522664,96552] 0 2024-09-17T01:07:07.798 INFO:tasks.workunit.client.0.smithi103.stdout:5/176: symlink d6/d11/d13/l48 0 2024-09-17T01:07:07.800 INFO:tasks.workunit.client.0.smithi103.stdout:0/263: rmdir dd/d1c 39 2024-09-17T01:07:07.800 INFO:tasks.workunit.client.0.smithi103.stdout:5/177: chown d6/d11/d13/c25 1382271 1 2024-09-17T01:07:07.802 INFO:tasks.workunit.client.0.smithi103.stdout:3/297: rmdir d3/d16/d1b/d2c 39 2024-09-17T01:07:07.805 INFO:tasks.workunit.client.0.smithi103.stdout:3/298: truncate d3/d16/d1b/d3c/d65/f6b 780120 0 2024-09-17T01:07:07.806 INFO:tasks.workunit.client.0.smithi103.stdout:3/299: stat d3/d16/d1b/f45 0 2024-09-17T01:07:07.806 INFO:tasks.workunit.client.0.smithi103.stdout:0/264: dwrite dd/df/f24 [0,4194304] 0 2024-09-17T01:07:07.807 INFO:tasks.workunit.client.0.smithi103.stdout:2/148: creat d6/da/d17/d26/f32 x:0 0 0 2024-09-17T01:07:07.809 INFO:tasks.workunit.client.1.smithi143.stdout:3/800: link d6/d1c/d33/d3f/d79/d7b/f9e d6/ffa 0 2024-09-17T01:07:07.810 INFO:tasks.workunit.client.1.smithi143.stdout:3/801: write d6/d1c/d33/d41/d2e/d86/ddc/fdf [300169,127470] 0 2024-09-17T01:07:07.811 INFO:tasks.workunit.client.0.smithi103.stdout:9/261: mkdir d7/d2d/d59 0 2024-09-17T01:07:07.817 INFO:tasks.workunit.client.0.smithi103.stdout:5/178: rename l5 to d6/d11/l49 0 2024-09-17T01:07:07.819 INFO:tasks.workunit.client.1.smithi143.stdout:5/759: dwrite d1/d46/df/d23/fcc [0,4194304] 0 2024-09-17T01:07:07.820 INFO:tasks.workunit.client.0.smithi103.stdout:1/310: sync 2024-09-17T01:07:07.821 INFO:tasks.workunit.client.0.smithi103.stdout:8/244: sync 2024-09-17T01:07:07.821 INFO:tasks.workunit.client.0.smithi103.stdout:7/183: sync 2024-09-17T01:07:07.821 INFO:tasks.workunit.client.0.smithi103.stdout:4/302: sync 2024-09-17T01:07:07.821 INFO:tasks.workunit.client.0.smithi103.stdout:6/172: sync 2024-09-17T01:07:07.821 INFO:tasks.workunit.client.0.smithi103.stdout:7/184: stat d4/d10/f25 0 2024-09-17T01:07:07.822 INFO:tasks.workunit.client.0.smithi103.stdout:1/311: chown d2/d7/c15 278708 1 2024-09-17T01:07:07.826 INFO:tasks.workunit.client.1.smithi143.stdout:2/747: dwrite d0/d2/d21/f62 [0,4194304] 0 2024-09-17T01:07:07.827 INFO:tasks.workunit.client.1.smithi143.stdout:2/748: write d0/d44/f94 [746552,43100] 0 2024-09-17T01:07:07.828 INFO:tasks.workunit.client.0.smithi103.stdout:0/265: mkdir dd/d1c/d50/d5c 0 2024-09-17T01:07:07.829 INFO:tasks.workunit.client.0.smithi103.stdout:8/245: dwrite d0/d6/dc/f2c [0,4194304] 0 2024-09-17T01:07:07.831 INFO:tasks.workunit.client.0.smithi103.stdout:3/300: creat d3/d44/d63/f6c x:0 0 0 2024-09-17T01:07:07.840 INFO:tasks.workunit.client.0.smithi103.stdout:8/246: dwrite d0/d6/dc/d30/f1f [0,4194304] 0 2024-09-17T01:07:07.840 INFO:tasks.workunit.client.1.smithi143.stdout:7/913: rename d4/d1f/d4a/f57 to d4/d1f/d29/f126 0 2024-09-17T01:07:07.843 INFO:tasks.workunit.client.0.smithi103.stdout:2/149: mknod d6/da/d17/c33 0 2024-09-17T01:07:07.846 INFO:tasks.workunit.client.1.smithi143.stdout:3/802: read d6/d1c/d33/f38 [214966,45343] 0 2024-09-17T01:07:07.848 INFO:tasks.workunit.client.0.smithi103.stdout:4/303: dwrite d9/d16/f1e [0,4194304] 0 2024-09-17T01:07:07.850 INFO:tasks.workunit.client.1.smithi143.stdout:4/818: creat da/d3a/f10e x:0 0 0 2024-09-17T01:07:07.851 INFO:tasks.workunit.client.0.smithi103.stdout:1/312: mknod d2/de/c60 0 2024-09-17T01:07:07.851 INFO:tasks.workunit.client.1.smithi143.stdout:5/760: creat d1/d46/df/d23/d4f/d82/f11b x:0 0 0 2024-09-17T01:07:07.852 INFO:tasks.workunit.client.1.smithi143.stdout:6/712: creat d2/d30/d45/d70/d87/fee x:0 0 0 2024-09-17T01:07:07.852 INFO:tasks.workunit.client.0.smithi103.stdout:4/304: readlink d9/d16/l29 0 2024-09-17T01:07:07.853 INFO:tasks.workunit.client.1.smithi143.stdout:0/744: dwrite d3/d5/d8/d21/f3b [0,4194304] 0 2024-09-17T01:07:07.854 INFO:tasks.workunit.client.0.smithi103.stdout:3/301: dread d3/d16/d1b/f46 [0,4194304] 0 2024-09-17T01:07:07.854 INFO:tasks.workunit.client.1.smithi143.stdout:6/713: dread - d2/df/d20/d2c/d38/fb6 zero size 2024-09-17T01:07:07.855 INFO:tasks.workunit.client.0.smithi103.stdout:5/179: rename d6/d28/l43 to d6/d28/l4a 0 2024-09-17T01:07:07.856 INFO:tasks.workunit.client.0.smithi103.stdout:2/150: write d6/da/d17/f20 [4926314,105793] 0 2024-09-17T01:07:07.856 INFO:tasks.workunit.client.1.smithi143.stdout:6/714: readlink d2/df/d20/d2c/d75/l9d 0 2024-09-17T01:07:07.857 INFO:tasks.workunit.client.1.smithi143.stdout:1/836: rename d0/d6/d64/f80 to d0/d6/d43/d6d/d8b/dd0/de2/d79/f119 0 2024-09-17T01:07:07.858 INFO:tasks.workunit.client.0.smithi103.stdout:6/173: dread d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:07.859 INFO:tasks.workunit.client.0.smithi103.stdout:4/305: dread - d9/d16/d44/f4f zero size 2024-09-17T01:07:07.859 INFO:tasks.workunit.client.0.smithi103.stdout:8/247: dwrite d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:07.859 INFO:tasks.workunit.client.0.smithi103.stdout:3/302: read - d3/d16/d1b/f4e zero size 2024-09-17T01:07:07.860 INFO:tasks.workunit.client.1.smithi143.stdout:7/914: mknod d4/d26/c127 0 2024-09-17T01:07:07.860 INFO:tasks.workunit.client.1.smithi143.stdout:8/823: link d9/de/d53/d75/daf/ld9 d9/de/d53/d75/l129 0 2024-09-17T01:07:07.860 INFO:tasks.workunit.client.1.smithi143.stdout:7/915: stat d4/d26/f8a 0 2024-09-17T01:07:07.862 INFO:tasks.workunit.client.0.smithi103.stdout:2/151: dread - d6/da/d17/d26/f32 zero size 2024-09-17T01:07:07.862 INFO:tasks.workunit.client.1.smithi143.stdout:9/765: truncate d3/d39/d6a/f30 6781365 0 2024-09-17T01:07:07.863 INFO:tasks.workunit.client.0.smithi103.stdout:0/266: mkdir dd/d5d 0 2024-09-17T01:07:07.866 INFO:tasks.workunit.client.0.smithi103.stdout:7/185: write d4/d10/f25 [4171782,120322] 0 2024-09-17T01:07:07.866 INFO:tasks.workunit.client.0.smithi103.stdout:0/267: chown dd/d1c/d50/d5c 2180 1 2024-09-17T01:07:07.869 INFO:tasks.workunit.client.0.smithi103.stdout:2/152: write d6/f18 [742013,44099] 0 2024-09-17T01:07:07.875 INFO:tasks.workunit.client.0.smithi103.stdout:5/180: dread d6/d2c/f37 [0,4194304] 0 2024-09-17T01:07:07.876 INFO:tasks.workunit.client.0.smithi103.stdout:4/306: dwrite d9/d2d/f4a [4194304,4194304] 0 2024-09-17T01:07:07.879 INFO:tasks.workunit.client.1.smithi143.stdout:4/819: rename da/d3a/d3e/d72/da3/fa5 to da/d3a/d40/df0/f10f 0 2024-09-17T01:07:07.882 INFO:tasks.workunit.client.0.smithi103.stdout:8/248: write d0/d6/dc/d30/d2d/f3c [759033,85109] 0 2024-09-17T01:07:07.883 INFO:tasks.workunit.client.1.smithi143.stdout:2/749: write d0/d10/f47 [3685573,34039] 0 2024-09-17T01:07:07.887 INFO:tasks.workunit.client.1.smithi143.stdout:5/761: dread d1/d46/df/f62 [0,4194304] 0 2024-09-17T01:07:07.887 INFO:tasks.workunit.client.0.smithi103.stdout:2/153: mkdir d6/da/d17/d26/d34 0 2024-09-17T01:07:07.894 INFO:tasks.workunit.client.0.smithi103.stdout:7/186: unlink d4/d10/f3c 0 2024-09-17T01:07:07.894 INFO:tasks.workunit.client.0.smithi103.stdout:7/187: chown d4/d11/d34 0 1 2024-09-17T01:07:07.895 INFO:tasks.workunit.client.0.smithi103.stdout:0/268: symlink dd/df/d38/l5e 0 2024-09-17T01:07:07.895 INFO:tasks.workunit.client.1.smithi143.stdout:3/803: dwrite d6/d1c/d33/d41/d2e/d30/f6f [0,4194304] 0 2024-09-17T01:07:07.896 INFO:tasks.workunit.client.1.smithi143.stdout:1/837: dread d0/d6/d43/d6a/f42 [0,4194304] 0 2024-09-17T01:07:07.896 INFO:tasks.workunit.client.1.smithi143.stdout:9/766: dread d3/d39/d6a/d9/f66 [0,4194304] 0 2024-09-17T01:07:07.897 INFO:tasks.workunit.client.0.smithi103.stdout:6/174: creat d3/d16/d21/f3b x:0 0 0 2024-09-17T01:07:07.899 INFO:tasks.workunit.client.0.smithi103.stdout:5/181: mknod d6/d2c/c4b 0 2024-09-17T01:07:07.900 INFO:tasks.workunit.client.0.smithi103.stdout:1/313: dwrite d2/d1c/f38 [0,4194304] 0 2024-09-17T01:07:07.901 INFO:tasks.workunit.client.1.smithi143.stdout:6/715: link d2/d30/dc1/fc8 d2/d30/d45/d70/fef 0 2024-09-17T01:07:07.901 INFO:tasks.workunit.client.1.smithi143.stdout:3/804: dread d6/d1c/d33/d41/d2e/d86/ddc/fdf [0,4194304] 0 2024-09-17T01:07:07.903 INFO:tasks.workunit.client.0.smithi103.stdout:1/314: write d2/d16/f30 [22064,54353] 0 2024-09-17T01:07:07.908 INFO:tasks.workunit.client.0.smithi103.stdout:7/188: creat d4/d11/d34/f41 x:0 0 0 2024-09-17T01:07:07.910 INFO:tasks.workunit.client.1.smithi143.stdout:0/745: creat d3/d68/d8f/ddb/de8/ff2 x:0 0 0 2024-09-17T01:07:07.911 INFO:tasks.workunit.client.0.smithi103.stdout:0/269: write dd/d4f/f4c [3451556,83414] 0 2024-09-17T01:07:07.913 INFO:tasks.workunit.client.1.smithi143.stdout:8/824: write d9/d12/df4/f6e [640221,39735] 0 2024-09-17T01:07:07.914 INFO:tasks.workunit.client.0.smithi103.stdout:0/270: chown c1 327394 1 2024-09-17T01:07:07.916 INFO:tasks.workunit.client.1.smithi143.stdout:1/838: creat d0/d6/d43/d6d/d8b/dd0/f11a x:0 0 0 2024-09-17T01:07:07.918 INFO:tasks.workunit.client.1.smithi143.stdout:9/767: mknod d3/d39/d6a/dc3/d3e/d51/c100 0 2024-09-17T01:07:07.919 INFO:tasks.workunit.client.1.smithi143.stdout:1/839: dread - d0/dc/d57/dc2/f106 zero size 2024-09-17T01:07:07.919 INFO:tasks.workunit.client.0.smithi103.stdout:3/303: dwrite d3/d16/d1b/d3c/f35 [0,4194304] 0 2024-09-17T01:07:07.919 INFO:tasks.workunit.client.0.smithi103.stdout:3/304: dread - d3/d16/d1b/d36/f67 zero size 2024-09-17T01:07:07.920 INFO:tasks.workunit.client.1.smithi143.stdout:9/768: chown d3/d39/d42/d80/df3/d99/f93 160272 1 2024-09-17T01:07:07.920 INFO:tasks.workunit.client.0.smithi103.stdout:1/315: write d2/d7/f37 [1610267,121278] 0 2024-09-17T01:07:07.922 INFO:tasks.workunit.client.1.smithi143.stdout:1/840: chown d0/d6/d43/d6a/df/d27/ca0 460 1 2024-09-17T01:07:07.922 INFO:tasks.workunit.client.1.smithi143.stdout:2/750: unlink d0/d10/d58/d5a/d5b/c87 0 2024-09-17T01:07:07.922 INFO:tasks.workunit.client.0.smithi103.stdout:1/316: write d2/d1c/d28/f29 [211394,64273] 0 2024-09-17T01:07:07.923 INFO:tasks.workunit.client.1.smithi143.stdout:0/746: mkdir d3/d5/d8/d27/d31/d48/d72/df3 0 2024-09-17T01:07:07.925 INFO:tasks.workunit.client.0.smithi103.stdout:0/271: rmdir dd/d4f 39 2024-09-17T01:07:07.926 INFO:tasks.workunit.client.1.smithi143.stdout:4/820: link da/d3a/d40/ff3 da/d3a/f110 0 2024-09-17T01:07:07.930 INFO:tasks.workunit.client.1.smithi143.stdout:9/769: mknod d3/d39/d6a/dc3/d3e/c101 0 2024-09-17T01:07:07.930 INFO:tasks.workunit.client.1.smithi143.stdout:6/716: dwrite d2/fa [0,4194304] 0 2024-09-17T01:07:07.931 INFO:tasks.workunit.client.0.smithi103.stdout:4/307: getdents d9/d16/d23/d32 0 2024-09-17T01:07:07.931 INFO:tasks.workunit.client.1.smithi143.stdout:0/747: dread - d3/d68/d75/fb1 zero size 2024-09-17T01:07:07.932 INFO:tasks.workunit.client.0.smithi103.stdout:3/305: dread d3/d16/d1b/f46 [0,4194304] 0 2024-09-17T01:07:07.933 INFO:tasks.workunit.client.1.smithi143.stdout:6/717: stat d2/d17/d6e/db0/fe3 0 2024-09-17T01:07:07.935 INFO:tasks.workunit.client.0.smithi103.stdout:3/306: fdatasync d3/d16/d1b/d36/f67 0 2024-09-17T01:07:07.936 INFO:tasks.workunit.client.1.smithi143.stdout:1/841: rename d0/d6/d43/d6a/df/d6e to d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b 0 2024-09-17T01:07:07.936 INFO:tasks.workunit.client.1.smithi143.stdout:5/762: dread d1/d46/df/d23/f8e [0,4194304] 0 2024-09-17T01:07:07.936 INFO:tasks.workunit.client.1.smithi143.stdout:0/748: write d3/d5/d8/d27/d31/fdd [111499,56341] 0 2024-09-17T01:07:07.936 INFO:tasks.workunit.client.0.smithi103.stdout:5/182: dread d6/d11/f1d [0,4194304] 0 2024-09-17T01:07:07.937 INFO:tasks.workunit.client.0.smithi103.stdout:2/154: getdents d6 0 2024-09-17T01:07:07.940 INFO:tasks.workunit.client.0.smithi103.stdout:7/189: link d4/l33 d4/d11/d2b/d36/l42 0 2024-09-17T01:07:07.940 INFO:tasks.workunit.client.1.smithi143.stdout:9/770: fdatasync d3/d39/d6a/fc 0 2024-09-17T01:07:07.941 INFO:tasks.workunit.client.1.smithi143.stdout:4/821: dread da/d6d/f76 [0,4194304] 0 2024-09-17T01:07:07.941 INFO:tasks.workunit.client.1.smithi143.stdout:2/751: creat d0/d2/d21/d84/ff8 x:0 0 0 2024-09-17T01:07:07.943 INFO:tasks.workunit.client.1.smithi143.stdout:6/718: dread d2/d19/f73 [0,4194304] 0 2024-09-17T01:07:07.944 INFO:tasks.workunit.client.1.smithi143.stdout:1/842: mknod d0/dc/d89/c11c 0 2024-09-17T01:07:07.945 INFO:tasks.workunit.client.1.smithi143.stdout:2/752: fdatasync d0/d10/d58/d5a/d5b/fa4 0 2024-09-17T01:07:07.946 INFO:tasks.workunit.client.0.smithi103.stdout:4/308: mkdir d9/d16/d23/d52 0 2024-09-17T01:07:07.946 INFO:tasks.workunit.client.1.smithi143.stdout:5/763: creat d1/d46/df/d53/d74/d9a/dd7/f11c x:0 0 0 2024-09-17T01:07:07.947 INFO:tasks.workunit.client.1.smithi143.stdout:6/719: chown d2/df/d18/d69/ld8 2 1 2024-09-17T01:07:07.947 INFO:tasks.workunit.client.1.smithi143.stdout:1/843: readlink d0/dc/d57/dc2/ld2 0 2024-09-17T01:07:07.948 INFO:tasks.workunit.client.0.smithi103.stdout:8/249: write d0/d6/dc/f9 [2279925,29431] 0 2024-09-17T01:07:07.948 INFO:tasks.workunit.client.1.smithi143.stdout:8/825: dread d9/d12/d38/d58/dda/dea/ffc [0,4194304] 0 2024-09-17T01:07:07.949 INFO:tasks.workunit.client.0.smithi103.stdout:5/183: mkdir d6/d2c/d38/d4c 0 2024-09-17T01:07:07.949 INFO:tasks.workunit.client.0.smithi103.stdout:5/184: fdatasync d6/db/f3a 0 2024-09-17T01:07:07.950 INFO:tasks.workunit.client.0.smithi103.stdout:5/185: stat d6/d28/l2a 0 2024-09-17T01:07:07.951 INFO:tasks.workunit.client.0.smithi103.stdout:5/186: chown d6/d2c/d38/l44 29140098 1 2024-09-17T01:07:07.951 INFO:tasks.workunit.client.1.smithi143.stdout:8/826: write d9/d26/fb6 [1594655,76363] 0 2024-09-17T01:07:07.952 INFO:tasks.workunit.client.0.smithi103.stdout:2/155: rename d6/f12 to d6/da/d28/f35 0 2024-09-17T01:07:07.953 INFO:tasks.workunit.client.0.smithi103.stdout:7/190: mkdir d4/d10/d43 0 2024-09-17T01:07:07.955 INFO:tasks.workunit.client.1.smithi143.stdout:6/720: dread d2/d30/d45/d70/d87/fa2 [0,4194304] 0 2024-09-17T01:07:07.955 INFO:tasks.workunit.client.1.smithi143.stdout:2/753: unlink d0/fca 0 2024-09-17T01:07:07.956 INFO:tasks.workunit.client.0.smithi103.stdout:0/272: creat dd/df/f5f x:0 0 0 2024-09-17T01:07:07.958 INFO:tasks.workunit.client.0.smithi103.stdout:4/309: mknod d9/dc/df/c53 0 2024-09-17T01:07:07.961 INFO:tasks.workunit.client.1.smithi143.stdout:4/822: link da/d3a/f10e da/d6d/f111 0 2024-09-17T01:07:07.964 INFO:tasks.workunit.client.1.smithi143.stdout:5/764: creat d1/d46/df/d53/d74/d9a/dd7/f11d x:0 0 0 2024-09-17T01:07:07.967 INFO:tasks.workunit.client.0.smithi103.stdout:8/250: creat d0/f4e x:0 0 0 2024-09-17T01:07:07.967 INFO:tasks.workunit.client.0.smithi103.stdout:1/317: truncate d2/d16/f32 1432796 0 2024-09-17T01:07:07.967 INFO:tasks.workunit.client.1.smithi143.stdout:0/749: write d3/d14/fb2 [537087,33739] 0 2024-09-17T01:07:07.968 INFO:tasks.workunit.client.0.smithi103.stdout:8/251: write d0/d6/f36 [4017864,89858] 0 2024-09-17T01:07:07.968 INFO:tasks.workunit.client.0.smithi103.stdout:5/187: rmdir d6/db 39 2024-09-17T01:07:07.970 INFO:tasks.workunit.client.0.smithi103.stdout:5/188: truncate d6/d2c/f3d 985758 0 2024-09-17T01:07:07.970 INFO:tasks.workunit.client.0.smithi103.stdout:5/189: stat d6/d28 0 2024-09-17T01:07:07.971 INFO:tasks.workunit.client.0.smithi103.stdout:7/191: creat d4/d11/f44 x:0 0 0 2024-09-17T01:07:07.975 INFO:tasks.workunit.client.0.smithi103.stdout:4/310: mknod d9/d2d/c54 0 2024-09-17T01:07:07.979 INFO:tasks.workunit.client.1.smithi143.stdout:9/771: rmdir d3/d3d/de3/df4/dff 0 2024-09-17T01:07:07.981 INFO:tasks.workunit.client.1.smithi143.stdout:4/823: unlink da/d68/f87 0 2024-09-17T01:07:07.984 INFO:tasks.workunit.client.0.smithi103.stdout:8/252: rmdir d0/d6/dc/d30/d2d/d32 39 2024-09-17T01:07:07.985 INFO:tasks.workunit.client.1.smithi143.stdout:0/750: rmdir d3/d68/d8f 39 2024-09-17T01:07:07.987 INFO:tasks.workunit.client.1.smithi143.stdout:0/751: write d3/d5/d8/d27/d31/d4c/f6d [731331,98794] 0 2024-09-17T01:07:07.987 INFO:tasks.workunit.client.1.smithi143.stdout:0/752: dread - d3/d5/d8/d27/d31/d85/fa4 zero size 2024-09-17T01:07:07.988 INFO:tasks.workunit.client.1.smithi143.stdout:7/916: sync 2024-09-17T01:07:07.991 INFO:tasks.workunit.client.1.smithi143.stdout:6/721: mknod d2/d17/d6e/dad/cf0 0 2024-09-17T01:07:07.993 INFO:tasks.workunit.client.1.smithi143.stdout:2/754: mknod d0/d10/d58/d5a/d5b/d4c/d71/d99/cf9 0 2024-09-17T01:07:07.993 INFO:tasks.workunit.client.0.smithi103.stdout:0/273: write f8 [1461747,75478] 0 2024-09-17T01:07:07.994 INFO:tasks.workunit.client.0.smithi103.stdout:5/190: dwrite d6/db/f27 [0,4194304] 0 2024-09-17T01:07:07.996 INFO:tasks.workunit.client.1.smithi143.stdout:1/844: dwrite d0/d6/d43/d47/dbf/deb/d78/f90 [0,4194304] 0 2024-09-17T01:07:07.998 INFO:tasks.workunit.client.0.smithi103.stdout:7/192: dwrite d4/d11/f19 [0,4194304] 0 2024-09-17T01:07:08.005 INFO:tasks.workunit.client.1.smithi143.stdout:1/845: dwrite d0/dc/d57/dc2/f106 [0,4194304] 0 2024-09-17T01:07:08.005 INFO:tasks.workunit.client.1.smithi143.stdout:0/753: dread d3/d5/d8/d21/f3e [4194304,4194304] 0 2024-09-17T01:07:08.009 INFO:tasks.workunit.client.0.smithi103.stdout:2/156: write d6/da/d28/f2e [310541,11470] 0 2024-09-17T01:07:08.010 INFO:tasks.workunit.client.1.smithi143.stdout:7/917: rename d4/d1f/d4a/ddb/de7/f121 to d4/d1f/d98/f128 0 2024-09-17T01:07:08.012 INFO:tasks.workunit.client.0.smithi103.stdout:0/274: creat dd/df/d38/f60 x:0 0 0 2024-09-17T01:07:08.012 INFO:tasks.workunit.client.1.smithi143.stdout:7/918: chown d4/l70 4453131 1 2024-09-17T01:07:08.012 INFO:tasks.workunit.client.0.smithi103.stdout:3/307: getdents d3/d16/d1b/d2c/d34 0 2024-09-17T01:07:08.014 INFO:tasks.workunit.client.0.smithi103.stdout:5/191: symlink d6/d2c/d38/l4d 0 2024-09-17T01:07:08.015 INFO:tasks.workunit.client.0.smithi103.stdout:5/192: stat d6/db/c1f 0 2024-09-17T01:07:08.017 INFO:tasks.workunit.client.0.smithi103.stdout:7/193: truncate d4/d10/f2c 2616674 0 2024-09-17T01:07:08.018 INFO:tasks.workunit.client.0.smithi103.stdout:1/318: link d2/d1c/d28/c2f d2/d16/c61 0 2024-09-17T01:07:08.019 INFO:tasks.workunit.client.0.smithi103.stdout:7/194: write d4/f1a [3135868,63111] 0 2024-09-17T01:07:08.020 INFO:tasks.workunit.client.0.smithi103.stdout:1/319: truncate d2/d1c/d28/f29 5001009 0 2024-09-17T01:07:08.020 INFO:tasks.workunit.client.1.smithi143.stdout:1/846: creat d0/d6/d43/d47/dbf/f11d x:0 0 0 2024-09-17T01:07:08.022 INFO:tasks.workunit.client.0.smithi103.stdout:2/157: creat d6/da/d17/d1a/df/f36 x:0 0 0 2024-09-17T01:07:08.023 INFO:tasks.workunit.client.1.smithi143.stdout:0/754: creat d3/d5/d8/d27/d31/d4c/d65/ff4 x:0 0 0 2024-09-17T01:07:08.027 INFO:tasks.workunit.client.1.smithi143.stdout:4/824: write da/d75/f8b [556447,37934] 0 2024-09-17T01:07:08.027 INFO:tasks.workunit.client.0.smithi103.stdout:3/308: rename d3/d16/d1b/d36/l49 to d3/d16/d1b/d2c/l6d 0 2024-09-17T01:07:08.028 INFO:tasks.workunit.client.1.smithi143.stdout:5/765: truncate d1/d46/f79 3920434 0 2024-09-17T01:07:08.028 INFO:tasks.workunit.client.1.smithi143.stdout:5/766: fsync d1/d46/d6e/f8d 0 2024-09-17T01:07:08.030 INFO:tasks.workunit.client.0.smithi103.stdout:2/158: dwrite d6/da/d28/f2b [0,4194304] 0 2024-09-17T01:07:08.031 INFO:tasks.workunit.client.0.smithi103.stdout:2/159: chown f4 0 1 2024-09-17T01:07:08.032 INFO:tasks.workunit.client.0.smithi103.stdout:1/320: creat d2/d1c/d20/d33/f62 x:0 0 0 2024-09-17T01:07:08.034 INFO:tasks.workunit.client.1.smithi143.stdout:5/767: dwrite d1/d46/df/d53/ff9 [0,4194304] 0 2024-09-17T01:07:08.035 INFO:tasks.workunit.client.0.smithi103.stdout:0/275: creat dd/d5d/f61 x:0 0 0 2024-09-17T01:07:08.036 INFO:tasks.workunit.client.0.smithi103.stdout:8/253: dread d0/d6/dc/d30/d2d/d32/f4d [0,4194304] 0 2024-09-17T01:07:08.037 INFO:tasks.workunit.client.0.smithi103.stdout:4/311: truncate d9/d2d/f4a 1680185 0 2024-09-17T01:07:08.039 INFO:tasks.workunit.client.0.smithi103.stdout:8/254: stat d0/d6/dc/f2c 0 2024-09-17T01:07:08.039 INFO:tasks.workunit.client.1.smithi143.stdout:0/755: mknod d3/d5/d8/d21/d2e/cf5 0 2024-09-17T01:07:08.040 INFO:tasks.workunit.client.0.smithi103.stdout:7/195: creat d4/d11/d34/d3d/f45 x:0 0 0 2024-09-17T01:07:08.041 INFO:tasks.workunit.client.0.smithi103.stdout:7/196: chown d4/f5 549 1 2024-09-17T01:07:08.041 INFO:tasks.workunit.client.0.smithi103.stdout:0/276: dread f5 [0,4194304] 0 2024-09-17T01:07:08.042 INFO:tasks.workunit.client.0.smithi103.stdout:0/277: write dd/d5d/f61 [295222,82187] 0 2024-09-17T01:07:08.044 INFO:tasks.workunit.client.0.smithi103.stdout:1/321: symlink d2/d1c/d28/d52/l63 0 2024-09-17T01:07:08.048 INFO:tasks.workunit.client.1.smithi143.stdout:9/772: getdents d3/d39/d42/d58 0 2024-09-17T01:07:08.049 INFO:tasks.workunit.client.0.smithi103.stdout:3/309: dread d3/f9 [0,4194304] 0 2024-09-17T01:07:08.049 INFO:tasks.workunit.client.0.smithi103.stdout:4/312: fsync d9/d16/d23/d2a/f50 0 2024-09-17T01:07:08.050 INFO:tasks.workunit.client.0.smithi103.stdout:4/313: chown d9/dc/df/f25 331 1 2024-09-17T01:07:08.051 INFO:tasks.workunit.client.0.smithi103.stdout:8/255: chown d0/d6/dc/d30/d25/f27 1 1 2024-09-17T01:07:08.054 INFO:tasks.workunit.client.1.smithi143.stdout:6/722: write d2/d30/dc1/de8/de9/f99 [912777,69755] 0 2024-09-17T01:07:08.055 INFO:tasks.workunit.client.0.smithi103.stdout:2/160: unlink d6/l23 0 2024-09-17T01:07:08.056 INFO:tasks.workunit.client.1.smithi143.stdout:0/756: stat d3/d5/d8/d10/l1f 0 2024-09-17T01:07:08.056 INFO:tasks.workunit.client.1.smithi143.stdout:0/757: write d3/fed [861938,104231] 0 2024-09-17T01:07:08.057 INFO:tasks.workunit.client.0.smithi103.stdout:0/278: unlink dd/f36 0 2024-09-17T01:07:08.057 INFO:tasks.workunit.client.0.smithi103.stdout:0/279: chown dd/df/f41 0 1 2024-09-17T01:07:08.058 INFO:tasks.workunit.client.0.smithi103.stdout:0/280: stat f8 0 2024-09-17T01:07:08.058 INFO:tasks.workunit.client.1.smithi143.stdout:0/758: write d3/d68/fdc [632056,78511] 0 2024-09-17T01:07:08.058 INFO:tasks.workunit.client.1.smithi143.stdout:2/755: truncate d0/fc 3179023 0 2024-09-17T01:07:08.059 INFO:tasks.workunit.client.0.smithi103.stdout:5/193: rename f4 to d6/db/f4e 0 2024-09-17T01:07:08.060 INFO:tasks.workunit.client.1.smithi143.stdout:2/756: dread - d0/d44/d7a/d86/d97/fc8 zero size 2024-09-17T01:07:08.060 INFO:tasks.workunit.client.1.smithi143.stdout:0/759: dread - d3/d5/d8/d27/d31/d48/fd9 zero size 2024-09-17T01:07:08.064 INFO:tasks.workunit.client.1.smithi143.stdout:1/847: rename d0/d6/d43/d6d/d8b/dd0/de2/d6b/d9d/fd1 to d0/d6/d43/d47/f11e 0 2024-09-17T01:07:08.065 INFO:tasks.workunit.client.0.smithi103.stdout:4/314: rmdir d9/d16/d23/d2b 39 2024-09-17T01:07:08.066 INFO:tasks.workunit.client.1.smithi143.stdout:7/919: getdents d4/d1f/d4a/d66/db5/df3 0 2024-09-17T01:07:08.070 INFO:tasks.workunit.client.0.smithi103.stdout:2/161: truncate d6/da/d17/d26/f32 23945 0 2024-09-17T01:07:08.071 INFO:tasks.workunit.client.1.smithi143.stdout:7/920: dwrite d4/d1f/d4a/ddb/f10d [0,4194304] 0 2024-09-17T01:07:08.076 INFO:tasks.workunit.client.0.smithi103.stdout:0/281: mkdir dd/df/d38/d62 0 2024-09-17T01:07:08.081 INFO:tasks.workunit.client.0.smithi103.stdout:1/322: rename d2/de/d1f/f4f to d2/d1c/d20/f64 0 2024-09-17T01:07:08.083 INFO:tasks.workunit.client.0.smithi103.stdout:5/194: creat d6/d11/d13/f4f x:0 0 0 2024-09-17T01:07:08.084 INFO:tasks.workunit.client.0.smithi103.stdout:0/282: dwrite dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:08.087 INFO:tasks.workunit.client.0.smithi103.stdout:4/315: mkdir d9/d2d/d55 0 2024-09-17T01:07:08.089 INFO:tasks.workunit.client.0.smithi103.stdout:7/197: link d4/l1c d4/d11/d2b/d36/l46 0 2024-09-17T01:07:08.093 INFO:tasks.workunit.client.0.smithi103.stdout:5/195: dread d6/d2c/f3d [0,4194304] 0 2024-09-17T01:07:08.093 INFO:tasks.workunit.client.0.smithi103.stdout:3/310: dwrite d3/d16/d1b/f46 [4194304,4194304] 0 2024-09-17T01:07:08.095 INFO:tasks.workunit.client.0.smithi103.stdout:7/198: write d4/d11/d2b/f3e [282181,95241] 0 2024-09-17T01:07:08.097 INFO:tasks.workunit.client.0.smithi103.stdout:8/256: rename d0/d6/dc/d30/d25/f27 to d0/d6/f4f 0 2024-09-17T01:07:08.099 INFO:tasks.workunit.client.1.smithi143.stdout:3/805: sync 2024-09-17T01:07:08.100 INFO:tasks.workunit.client.1.smithi143.stdout:9/773: rename d3/d39/d6a/d26/f69 to d3/d39/d6a/d9/ded/f102 0 2024-09-17T01:07:08.101 INFO:tasks.workunit.client.0.smithi103.stdout:0/283: creat dd/df/d38/f63 x:0 0 0 2024-09-17T01:07:08.102 INFO:tasks.workunit.client.1.smithi143.stdout:5/768: getdents d1/d46/df/d23/d4f/d7d/d102/d115 0 2024-09-17T01:07:08.102 INFO:tasks.workunit.client.0.smithi103.stdout:8/257: stat d0/d6/dc/d30/d2d/l2f 0 2024-09-17T01:07:08.103 INFO:tasks.workunit.client.1.smithi143.stdout:7/921: dread - d4/f62 zero size 2024-09-17T01:07:08.103 INFO:tasks.workunit.client.1.smithi143.stdout:5/769: fsync d1/d46/d6e/da0/fbf 0 2024-09-17T01:07:08.104 INFO:tasks.workunit.client.1.smithi143.stdout:7/922: write d4/f18 [3685047,37971] 0 2024-09-17T01:07:08.104 INFO:tasks.workunit.client.1.smithi143.stdout:2/757: read d0/fc [333475,55551] 0 2024-09-17T01:07:08.105 INFO:tasks.workunit.client.0.smithi103.stdout:0/284: dread - dd/d1c/f4a zero size 2024-09-17T01:07:08.106 INFO:tasks.workunit.client.1.smithi143.stdout:2/758: readlink d0/d10/d58/d5a/d5b/d4c/d71/d9d/ld9 0 2024-09-17T01:07:08.108 INFO:tasks.workunit.client.0.smithi103.stdout:4/316: dwrite d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:08.109 INFO:tasks.workunit.client.0.smithi103.stdout:1/323: truncate d2/de/f11 936149 0 2024-09-17T01:07:08.111 INFO:tasks.workunit.client.0.smithi103.stdout:5/196: dwrite d6/db/f27 [0,4194304] 0 2024-09-17T01:07:08.112 INFO:tasks.workunit.client.1.smithi143.stdout:6/723: rename d2/df/d20/d2c/d82 to d2/d17/d6e/ddc/df1 0 2024-09-17T01:07:08.114 INFO:tasks.workunit.client.0.smithi103.stdout:5/197: stat d6/db/c1f 0 2024-09-17T01:07:08.115 INFO:tasks.workunit.client.0.smithi103.stdout:7/199: dwrite d4/f7 [0,4194304] 0 2024-09-17T01:07:08.117 INFO:tasks.workunit.client.0.smithi103.stdout:2/162: dread d6/f7 [0,4194304] 0 2024-09-17T01:07:08.119 INFO:tasks.workunit.client.0.smithi103.stdout:5/198: readlink d6/d2c/d38/l4d 0 2024-09-17T01:07:08.121 INFO:tasks.workunit.client.0.smithi103.stdout:4/317: dread d9/f3a [0,4194304] 0 2024-09-17T01:07:08.122 INFO:tasks.workunit.client.1.smithi143.stdout:9/774: mknod d3/d39/d6a/d26/c103 0 2024-09-17T01:07:08.122 INFO:tasks.workunit.client.0.smithi103.stdout:4/318: chown d9/d16/d36 4558656 1 2024-09-17T01:07:08.123 INFO:tasks.workunit.client.1.smithi143.stdout:9/775: chown d3/d39/d42 2238 1 2024-09-17T01:07:08.128 INFO:tasks.workunit.client.0.smithi103.stdout:8/258: rename d0/d6/c23 to d0/d6/dc/d30/d25/c50 0 2024-09-17T01:07:08.130 INFO:tasks.workunit.client.1.smithi143.stdout:7/923: fsync d4/d1f/d29/f34 0 2024-09-17T01:07:08.134 INFO:tasks.workunit.client.1.smithi143.stdout:5/770: dwrite d1/d46/df/d1f/de9/fdc [0,4194304] 0 2024-09-17T01:07:08.136 INFO:tasks.workunit.client.1.smithi143.stdout:2/759: rmdir d0 39 2024-09-17T01:07:08.141 INFO:tasks.workunit.client.0.smithi103.stdout:4/319: creat d9/d16/d36/d42/f56 x:0 0 0 2024-09-17T01:07:08.141 INFO:tasks.workunit.client.0.smithi103.stdout:3/311: write d3/f7 [524762,25059] 0 2024-09-17T01:07:08.143 INFO:tasks.workunit.client.0.smithi103.stdout:3/312: fdatasync d3/d16/d1b/d2c/f41 0 2024-09-17T01:07:08.143 INFO:tasks.workunit.client.0.smithi103.stdout:0/285: mkdir dd/d4f/d64 0 2024-09-17T01:07:08.144 INFO:tasks.workunit.client.0.smithi103.stdout:0/286: chown dd/df/f39 8847047 1 2024-09-17T01:07:08.145 INFO:tasks.workunit.client.1.smithi143.stdout:9/776: unlink d3/d39/f82 0 2024-09-17T01:07:08.148 INFO:tasks.workunit.client.1.smithi143.stdout:9/777: dread d3/f8 [0,4194304] 0 2024-09-17T01:07:08.149 INFO:tasks.workunit.client.0.smithi103.stdout:1/324: mkdir d2/d16/d51/d65 0 2024-09-17T01:07:08.151 INFO:tasks.workunit.client.0.smithi103.stdout:2/163: rename d6/da/d17/d1a/df/l30 to d6/da/d24/l37 0 2024-09-17T01:07:08.154 INFO:tasks.workunit.client.1.smithi143.stdout:9/778: dwrite d3/d81/d9c/fda [0,4194304] 0 2024-09-17T01:07:08.155 INFO:tasks.workunit.client.1.smithi143.stdout:6/724: symlink d2/df/d18/d69/dba/lf2 0 2024-09-17T01:07:08.161 INFO:tasks.workunit.client.0.smithi103.stdout:0/287: unlink dd/df/f3a 0 2024-09-17T01:07:08.163 INFO:tasks.workunit.client.1.smithi143.stdout:5/771: mknod d1/d46/df/d23/c11e 0 2024-09-17T01:07:08.164 INFO:tasks.workunit.client.0.smithi103.stdout:8/259: unlink d0/c20 0 2024-09-17T01:07:08.164 INFO:tasks.workunit.client.1.smithi143.stdout:5/772: stat d1/d46/d6e/d106 0 2024-09-17T01:07:08.167 INFO:tasks.workunit.client.1.smithi143.stdout:5/773: truncate d1/d46/df/d23/d4f/d7d/d102/d115/f11a 101161 0 2024-09-17T01:07:08.168 INFO:tasks.workunit.client.1.smithi143.stdout:7/924: write d4/f13 [5865307,66728] 0 2024-09-17T01:07:08.169 INFO:tasks.workunit.client.0.smithi103.stdout:3/313: rename d3/d16/d1b/d2c/d34/c54 to d3/d44/d63/c6e 0 2024-09-17T01:07:08.170 INFO:tasks.workunit.client.0.smithi103.stdout:3/314: dread - d3/d16/d1b/d2c/d34/f48 zero size 2024-09-17T01:07:08.171 INFO:tasks.workunit.client.1.smithi143.stdout:6/725: mknod d2/d17/d6e/d26/dbd/d5e/d7c/cf3 0 2024-09-17T01:07:08.172 INFO:tasks.workunit.client.0.smithi103.stdout:3/315: read - d3/d16/d1b/d2c/d34/f48 zero size 2024-09-17T01:07:08.173 INFO:tasks.workunit.client.1.smithi143.stdout:6/726: write d2/df/d20/f5b [17534,29183] 0 2024-09-17T01:07:08.173 INFO:tasks.workunit.client.0.smithi103.stdout:2/164: creat d6/da/d17/d1a/df/f38 x:0 0 0 2024-09-17T01:07:08.175 INFO:tasks.workunit.client.1.smithi143.stdout:9/779: mkdir d3/d39/d104 0 2024-09-17T01:07:08.175 INFO:tasks.workunit.client.1.smithi143.stdout:4/825: sync 2024-09-17T01:07:08.175 INFO:tasks.workunit.client.1.smithi143.stdout:8/827: sync 2024-09-17T01:07:08.179 INFO:tasks.workunit.client.1.smithi143.stdout:6/727: dwrite d2/d30/d45/d70/d87/fee [0,4194304] 0 2024-09-17T01:07:08.180 INFO:tasks.workunit.client.0.smithi103.stdout:0/288: creat dd/d1c/f65 x:0 0 0 2024-09-17T01:07:08.180 INFO:tasks.workunit.client.0.smithi103.stdout:8/260: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:08.181 INFO:tasks.workunit.client.0.smithi103.stdout:7/200: dwrite d4/d11/f23 [0,4194304] 0 2024-09-17T01:07:08.182 INFO:tasks.workunit.client.0.smithi103.stdout:0/289: fdatasync dd/df/f41 0 2024-09-17T01:07:08.182 INFO:tasks.workunit.client.1.smithi143.stdout:5/774: creat d1/d46/df/d23/d4f/d7d/d100/f11f x:0 0 0 2024-09-17T01:07:08.183 INFO:tasks.workunit.client.1.smithi143.stdout:5/775: chown d1/d46/d6e/da0/l103 244 1 2024-09-17T01:07:08.184 INFO:tasks.workunit.client.0.smithi103.stdout:1/325: creat d2/d1c/d28/d4b/f66 x:0 0 0 2024-09-17T01:07:08.185 INFO:tasks.workunit.client.1.smithi143.stdout:9/780: unlink d3/d39/d6a/l96 0 2024-09-17T01:07:08.186 INFO:tasks.workunit.client.0.smithi103.stdout:1/326: dread - d2/de/f58 zero size 2024-09-17T01:07:08.187 INFO:tasks.workunit.client.1.smithi143.stdout:2/760: dread d0/d44/d6a/f74 [0,4194304] 0 2024-09-17T01:07:08.190 INFO:tasks.workunit.client.0.smithi103.stdout:4/320: dwrite d9/fd [0,4194304] 0 2024-09-17T01:07:08.192 INFO:tasks.workunit.client.1.smithi143.stdout:8/828: fsync d9/d23/faa 0 2024-09-17T01:07:08.193 INFO:tasks.workunit.client.0.smithi103.stdout:8/261: creat d0/d6/f51 x:0 0 0 2024-09-17T01:07:08.197 INFO:tasks.workunit.client.1.smithi143.stdout:8/829: dread d9/d2b/f78 [4194304,4194304] 0 2024-09-17T01:07:08.197 INFO:tasks.workunit.client.1.smithi143.stdout:8/830: dread - d9/de/d53/d75/ff9 zero size 2024-09-17T01:07:08.197 INFO:tasks.workunit.client.0.smithi103.stdout:7/201: rmdir d4/d10/d37 39 2024-09-17T01:07:08.197 INFO:tasks.workunit.client.0.smithi103.stdout:7/202: readlink d4/d11/l26 0 2024-09-17T01:07:08.198 INFO:tasks.workunit.client.0.smithi103.stdout:0/290: creat dd/d1c/d50/f66 x:0 0 0 2024-09-17T01:07:08.199 INFO:tasks.workunit.client.0.smithi103.stdout:3/316: symlink d3/d16/d1b/d2c/d5c/l6f 0 2024-09-17T01:07:08.199 INFO:tasks.workunit.client.0.smithi103.stdout:4/321: dwrite d9/d16/d23/f46 [0,4194304] 0 2024-09-17T01:07:08.200 INFO:tasks.workunit.client.1.smithi143.stdout:9/781: rename d3/d39/d6a/dc3/f86 to d3/d39/d6a/dc3/d3e/d51/db7/f105 0 2024-09-17T01:07:08.202 INFO:tasks.workunit.client.0.smithi103.stdout:1/327: mkdir d2/d1c/d28/d4b/d67 0 2024-09-17T01:07:08.203 INFO:tasks.workunit.client.0.smithi103.stdout:1/328: readlink d2/d7/l23 0 2024-09-17T01:07:08.206 INFO:tasks.workunit.client.0.smithi103.stdout:8/262: chown d0/d6/dc/c38 1864 1 2024-09-17T01:07:08.211 INFO:tasks.workunit.client.1.smithi143.stdout:6/728: creat d2/df/d40/dcc/ff4 x:0 0 0 2024-09-17T01:07:08.212 INFO:tasks.workunit.client.0.smithi103.stdout:2/165: rmdir d6/da/d17/d1a/df 39 2024-09-17T01:07:08.215 INFO:tasks.workunit.client.1.smithi143.stdout:5/776: mknod d1/d46/df/d1f/d66/d70/dea/c120 0 2024-09-17T01:07:08.215 INFO:tasks.workunit.client.1.smithi143.stdout:5/777: fsync d1/d46/d6e/da0/fbf 0 2024-09-17T01:07:08.216 INFO:tasks.workunit.client.0.smithi103.stdout:3/317: fsync d3/d16/f1a 0 2024-09-17T01:07:08.217 INFO:tasks.workunit.client.1.smithi143.stdout:8/831: mkdir d9/d23/db4/d55/d57/d12a 0 2024-09-17T01:07:08.218 INFO:tasks.workunit.client.0.smithi103.stdout:4/322: rmdir d9/d16 39 2024-09-17T01:07:08.220 INFO:tasks.workunit.client.1.smithi143.stdout:4/826: rename da/d3a/d3e/d72/ff4 to da/d3a/d40/d84/db6/df2/f112 0 2024-09-17T01:07:08.221 INFO:tasks.workunit.client.1.smithi143.stdout:4/827: chown da/f2a 103712 1 2024-09-17T01:07:08.221 INFO:tasks.workunit.client.1.smithi143.stdout:0/760: sync 2024-09-17T01:07:08.223 INFO:tasks.workunit.client.0.smithi103.stdout:8/263: write d0/d6/dc/d30/f26 [4000682,84327] 0 2024-09-17T01:07:08.224 INFO:tasks.workunit.client.1.smithi143.stdout:7/925: truncate d4/d16/dbd/fc9 3384712 0 2024-09-17T01:07:08.225 INFO:tasks.workunit.client.0.smithi103.stdout:7/203: symlink d4/d11/d3f/l47 0 2024-09-17T01:07:08.225 INFO:tasks.workunit.client.0.smithi103.stdout:7/204: truncate d4/d10/f2c 4527206 0 2024-09-17T01:07:08.226 INFO:tasks.workunit.client.0.smithi103.stdout:7/205: fsync d4/d10/f25 0 2024-09-17T01:07:08.227 INFO:tasks.workunit.client.1.smithi143.stdout:6/729: mknod d2/d17/d6e/ddc/cf5 0 2024-09-17T01:07:08.228 INFO:tasks.workunit.client.0.smithi103.stdout:7/206: read d4/d11/f2a [1383422,82369] 0 2024-09-17T01:07:08.229 INFO:tasks.workunit.client.0.smithi103.stdout:7/207: dread - d4/d11/d34/d3d/f45 zero size 2024-09-17T01:07:08.231 INFO:tasks.workunit.client.1.smithi143.stdout:5/778: truncate d1/d5e/f65 1602900 0 2024-09-17T01:07:08.232 INFO:tasks.workunit.client.1.smithi143.stdout:5/779: write d1/d46/df/d1f/ff1 [523487,122611] 0 2024-09-17T01:07:08.232 INFO:tasks.workunit.client.1.smithi143.stdout:5/780: stat d1/d46/df/d53/d74/d9a/d9c/fd3 0 2024-09-17T01:07:08.235 INFO:tasks.workunit.client.1.smithi143.stdout:8/832: rename d9/d12/d38/d58/dd7 to d9/d12/d38/d58/d79/d9b/d12b 0 2024-09-17T01:07:08.237 INFO:tasks.workunit.client.0.smithi103.stdout:4/323: dread - d9/d16/d44/f4f zero size 2024-09-17T01:07:08.238 INFO:tasks.workunit.client.1.smithi143.stdout:4/828: read da/f11 [1264232,104323] 0 2024-09-17T01:07:08.240 INFO:tasks.workunit.client.1.smithi143.stdout:7/926: mkdir d4/d1f/d4a/ddb/d129 0 2024-09-17T01:07:08.241 INFO:tasks.workunit.client.1.smithi143.stdout:2/761: dwrite d0/d10/d58/d5a/d5b/d4c/f64 [0,4194304] 0 2024-09-17T01:07:08.245 INFO:tasks.workunit.client.1.smithi143.stdout:6/730: read d2/df/d40/d41/f4c [2640523,91799] 0 2024-09-17T01:07:08.247 INFO:tasks.workunit.client.1.smithi143.stdout:6/731: chown d2/d30/d45/d56 14267 1 2024-09-17T01:07:08.250 INFO:tasks.workunit.client.1.smithi143.stdout:9/782: dwrite d3/d39/d42/d58/d5a/fbc [0,4194304] 0 2024-09-17T01:07:08.251 INFO:tasks.workunit.client.0.smithi103.stdout:4/324: creat d9/d16/d44/f57 x:0 0 0 2024-09-17T01:07:08.252 INFO:tasks.workunit.client.0.smithi103.stdout:1/329: link d2/fb d2/f68 0 2024-09-17T01:07:08.253 INFO:tasks.workunit.client.1.smithi143.stdout:9/783: readlink d3/d39/d6a/dc3/d3e/d51/d52/l6d 0 2024-09-17T01:07:08.256 INFO:tasks.workunit.client.1.smithi143.stdout:0/761: dread d3/d68/f9d [0,4194304] 0 2024-09-17T01:07:08.256 INFO:tasks.workunit.client.1.smithi143.stdout:5/781: creat d1/d46/d9b/daa/ddd/f121 x:0 0 0 2024-09-17T01:07:08.258 INFO:tasks.workunit.client.0.smithi103.stdout:8/264: readlink d0/d6/dc/d30/d2d/l3f 0 2024-09-17T01:07:08.259 INFO:tasks.workunit.client.0.smithi103.stdout:0/291: getdents dd/df 0 2024-09-17T01:07:08.259 INFO:tasks.workunit.client.1.smithi143.stdout:5/782: chown d1/d46/df/d23/d4f/d7d/d92 1965 1 2024-09-17T01:07:08.259 INFO:tasks.workunit.client.1.smithi143.stdout:4/829: dwrite da/f32 [0,4194304] 0 2024-09-17T01:07:08.260 INFO:tasks.workunit.client.0.smithi103.stdout:0/292: truncate dd/f3e 881033 0 2024-09-17T01:07:08.260 INFO:tasks.workunit.client.0.smithi103.stdout:8/265: write d0/d6/dc/d3d/f40 [482523,79549] 0 2024-09-17T01:07:08.261 INFO:tasks.workunit.client.0.smithi103.stdout:8/266: chown d0 4001444 1 2024-09-17T01:07:08.261 INFO:tasks.workunit.client.1.smithi143.stdout:4/830: read da/d6d/f76 [234734,57249] 0 2024-09-17T01:07:08.261 INFO:tasks.workunit.client.0.smithi103.stdout:3/318: rename d3/d16/d1b/d2c/d5c/l6f to d3/d16/l70 0 2024-09-17T01:07:08.262 INFO:tasks.workunit.client.1.smithi143.stdout:3/806: sync 2024-09-17T01:07:08.262 INFO:tasks.workunit.client.1.smithi143.stdout:1/848: sync 2024-09-17T01:07:08.263 INFO:tasks.workunit.client.0.smithi103.stdout:3/319: read - d3/d16/d1b/d2c/f58 zero size 2024-09-17T01:07:08.264 INFO:tasks.workunit.client.0.smithi103.stdout:1/330: mkdir d2/d1c/d28/d52/d69 0 2024-09-17T01:07:08.265 INFO:tasks.workunit.client.0.smithi103.stdout:1/331: chown d2/d7/d4e/f55 7470534 1 2024-09-17T01:07:08.268 INFO:tasks.workunit.client.0.smithi103.stdout:7/208: rename d4/fa to d4/d11/f48 0 2024-09-17T01:07:08.269 INFO:tasks.workunit.client.0.smithi103.stdout:7/209: chown d4/d11/f44 956 1 2024-09-17T01:07:08.269 INFO:tasks.workunit.client.0.smithi103.stdout:3/320: chown d3/d16/d1b/l38 1429309 1 2024-09-17T01:07:08.270 INFO:tasks.workunit.client.0.smithi103.stdout:1/332: fsync d2/de/d1f/f27 0 2024-09-17T01:07:08.271 INFO:tasks.workunit.client.1.smithi143.stdout:1/849: chown d0/dc/f38 6743 1 2024-09-17T01:07:08.271 INFO:tasks.workunit.client.1.smithi143.stdout:3/807: write d6/d1c/d4b/fe6 [1007010,401] 0 2024-09-17T01:07:08.272 INFO:tasks.workunit.client.0.smithi103.stdout:1/333: write d2/de/d1f/f3b [1837242,36064] 0 2024-09-17T01:07:08.273 INFO:tasks.workunit.client.1.smithi143.stdout:9/784: creat d3/d39/d6a/d26/f106 x:0 0 0 2024-09-17T01:07:08.273 INFO:tasks.workunit.client.1.smithi143.stdout:3/808: write d6/d1c/d33/d3f/d5c/fee [124087,61543] 0 2024-09-17T01:07:08.273 INFO:tasks.workunit.client.0.smithi103.stdout:2/166: link d6/da/d17/d1a/df/c1b d6/da/d17/c39 0 2024-09-17T01:07:08.275 INFO:tasks.workunit.client.1.smithi143.stdout:0/762: truncate d3/d68/f7a 993362 0 2024-09-17T01:07:08.277 INFO:tasks.workunit.client.1.smithi143.stdout:0/763: write d3/d5/d8/d27/feb [697502,69186] 0 2024-09-17T01:07:08.277 INFO:tasks.workunit.client.0.smithi103.stdout:8/267: rename d0/d6/dc/c38 to d0/d6/dc/d30/d2d/d32/d34/c52 0 2024-09-17T01:07:08.278 INFO:tasks.workunit.client.1.smithi143.stdout:0/764: read - d3/fb8 zero size 2024-09-17T01:07:08.279 INFO:tasks.workunit.client.0.smithi103.stdout:3/321: dwrite d3/d44/f4a [0,4194304] 0 2024-09-17T01:07:08.279 INFO:tasks.workunit.client.1.smithi143.stdout:4/831: creat da/d3a/d40/daa/dc3/dcd/f113 x:0 0 0 2024-09-17T01:07:08.280 INFO:tasks.workunit.client.1.smithi143.stdout:7/927: dread d4/d16/f17 [0,4194304] 0 2024-09-17T01:07:08.280 INFO:tasks.workunit.client.0.smithi103.stdout:3/322: write d3/d16/d1b/f5e [35873,31626] 0 2024-09-17T01:07:08.281 INFO:tasks.workunit.client.1.smithi143.stdout:7/928: chown d4/d1f/d4a/d66/d86 382476241 1 2024-09-17T01:07:08.282 INFO:tasks.workunit.client.1.smithi143.stdout:2/762: dread d0/d10/f33 [0,4194304] 0 2024-09-17T01:07:08.282 INFO:tasks.workunit.client.0.smithi103.stdout:3/323: truncate d3/f7 2088129 0 2024-09-17T01:07:08.283 INFO:tasks.workunit.client.1.smithi143.stdout:3/809: dread d6/d1c/f66 [0,4194304] 0 2024-09-17T01:07:08.285 INFO:tasks.workunit.client.1.smithi143.stdout:8/833: dread d9/d12/df4/fa2 [0,4194304] 0 2024-09-17T01:07:08.287 INFO:tasks.workunit.client.0.smithi103.stdout:8/268: stat d0/d6/f1c 0 2024-09-17T01:07:08.288 INFO:tasks.workunit.client.0.smithi103.stdout:8/269: chown d0/f4e 7 1 2024-09-17T01:07:08.290 INFO:tasks.workunit.client.0.smithi103.stdout:7/210: rename d4/d10/f1d to d4/d11/d34/f49 0 2024-09-17T01:07:08.290 INFO:tasks.workunit.client.1.smithi143.stdout:3/810: dwrite d6/d1c/d33/d41/d42/ff2 [0,4194304] 0 2024-09-17T01:07:08.292 INFO:tasks.workunit.client.1.smithi143.stdout:6/732: dread d2/d30/dc1/fc8 [0,4194304] 0 2024-09-17T01:07:08.292 INFO:tasks.workunit.client.1.smithi143.stdout:6/733: stat d2/df/d20/d2c/d75/fd9 0 2024-09-17T01:07:08.294 INFO:tasks.workunit.client.0.smithi103.stdout:3/324: creat d3/d44/f71 x:0 0 0 2024-09-17T01:07:08.298 INFO:tasks.workunit.client.0.smithi103.stdout:1/334: creat d2/d1c/d28/d4b/d67/f6a x:0 0 0 2024-09-17T01:07:08.308 INFO:tasks.workunit.client.0.smithi103.stdout:3/325: creat d3/d16/d1b/d2c/d5c/f72 x:0 0 0 2024-09-17T01:07:08.309 INFO:tasks.workunit.client.0.smithi103.stdout:7/211: dwrite d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:08.309 INFO:tasks.workunit.client.0.smithi103.stdout:1/335: creat d2/d1c/d28/d4b/d67/f6b x:0 0 0 2024-09-17T01:07:08.310 INFO:tasks.workunit.client.1.smithi143.stdout:5/783: dwrite d1/d46/df/d23/d4f/f20 [0,4194304] 0 2024-09-17T01:07:08.311 INFO:tasks.workunit.client.0.smithi103.stdout:8/270: truncate d0/d6/f4f 2823200 0 2024-09-17T01:07:08.312 INFO:tasks.workunit.client.0.smithi103.stdout:2/167: getdents d6/da/d24 0 2024-09-17T01:07:08.317 INFO:tasks.workunit.client.0.smithi103.stdout:8/271: fsync d0/d6/f10 0 2024-09-17T01:07:08.318 INFO:tasks.workunit.client.0.smithi103.stdout:7/212: mkdir d4/d4a 0 2024-09-17T01:07:08.318 INFO:tasks.workunit.client.0.smithi103.stdout:1/336: dwrite d2/d1c/d28/d52/f5c [0,4194304] 0 2024-09-17T01:07:08.322 INFO:tasks.workunit.client.0.smithi103.stdout:7/213: truncate d4/d11/f44 290194 0 2024-09-17T01:07:08.323 INFO:tasks.workunit.client.0.smithi103.stdout:2/168: dwrite d6/da/f2f [0,4194304] 0 2024-09-17T01:07:08.330 INFO:tasks.workunit.client.0.smithi103.stdout:1/337: rename d2/d1c/d54/f5f to d2/d1c/d28/d52/d69/f6c 0 2024-09-17T01:07:08.333 INFO:tasks.workunit.client.0.smithi103.stdout:7/214: mkdir d4/d4a/d4b 0 2024-09-17T01:07:08.336 INFO:tasks.workunit.client.0.smithi103.stdout:1/338: unlink d2/d16/c2b 0 2024-09-17T01:07:08.339 INFO:tasks.workunit.client.0.smithi103.stdout:7/215: dwrite d4/d10/f2c [0,4194304] 0 2024-09-17T01:07:08.345 INFO:tasks.workunit.client.0.smithi103.stdout:7/216: link d4/d11/d2b/f3e d4/d11/d2b/d36/d3a/f4c 0 2024-09-17T01:07:08.346 INFO:tasks.workunit.client.1.smithi143.stdout:1/850: mkdir d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/d3c/d11f 0 2024-09-17T01:07:08.348 INFO:tasks.workunit.client.1.smithi143.stdout:9/785: mkdir d3/d39/d6a/d9/d107 0 2024-09-17T01:07:08.349 INFO:tasks.workunit.client.1.smithi143.stdout:4/832: truncate da/d75/f7b 1135058 0 2024-09-17T01:07:08.349 INFO:tasks.workunit.client.0.smithi103.stdout:7/217: creat d4/d10/f4d x:0 0 0 2024-09-17T01:07:08.350 INFO:tasks.workunit.client.1.smithi143.stdout:7/929: symlink d4/d1f/d4a/d66/l12a 0 2024-09-17T01:07:08.350 INFO:tasks.workunit.client.1.smithi143.stdout:9/786: write d3/d39/d6a/dc3/d3e/d51/db7/fdf [274882,49685] 0 2024-09-17T01:07:08.351 INFO:tasks.workunit.client.0.smithi103.stdout:7/218: write d4/d11/d34/d3d/f45 [430734,26495] 0 2024-09-17T01:07:08.352 INFO:tasks.workunit.client.1.smithi143.stdout:2/763: rename d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fdd to d0/d10/d58/d5a/d5b/d4c/d71/dc5/ffa 0 2024-09-17T01:07:08.354 INFO:tasks.workunit.client.1.smithi143.stdout:3/811: unlink d6/d1c/d4d/lc4 0 2024-09-17T01:07:08.355 INFO:tasks.workunit.client.1.smithi143.stdout:4/833: dwrite da/d3a/d40/f39 [0,4194304] 0 2024-09-17T01:07:08.355 INFO:tasks.workunit.client.0.smithi103.stdout:7/219: dread d4/d11/f19 [0,4194304] 0 2024-09-17T01:07:08.356 INFO:tasks.workunit.client.1.smithi143.stdout:6/734: mkdir d2/d17/d6e/db0/df6 0 2024-09-17T01:07:08.358 INFO:tasks.workunit.client.1.smithi143.stdout:5/784: rmdir d1/d46/df/d1f/d66/d70/de2/de3 39 2024-09-17T01:07:08.361 INFO:tasks.workunit.client.0.smithi103.stdout:7/220: mkdir d4/d10/d4e 0 2024-09-17T01:07:08.364 INFO:tasks.workunit.client.0.smithi103.stdout:8/272: dread d0/d6/dc/d30/f26 [0,4194304] 0 2024-09-17T01:07:08.366 INFO:tasks.workunit.client.1.smithi143.stdout:7/930: creat d4/d1f/f12b x:0 0 0 2024-09-17T01:07:08.369 INFO:tasks.workunit.client.0.smithi103.stdout:7/221: mkdir d4/d10/d32/d4f 0 2024-09-17T01:07:08.370 INFO:tasks.workunit.client.1.smithi143.stdout:3/812: mknod d6/d1c/d33/d3f/d79/dc6/cfb 0 2024-09-17T01:07:08.372 INFO:tasks.workunit.client.1.smithi143.stdout:6/735: dread - d2/d17/d6e/fbb zero size 2024-09-17T01:07:08.373 INFO:tasks.workunit.client.0.smithi103.stdout:7/222: write d4/d11/d2b/d36/d3a/f4c [383329,95048] 0 2024-09-17T01:07:08.375 INFO:tasks.workunit.client.0.smithi103.stdout:1/339: rmdir d2/d1c/d28/d4b 39 2024-09-17T01:07:08.380 INFO:tasks.workunit.client.0.smithi103.stdout:7/223: dwrite d4/f7 [0,4194304] 0 2024-09-17T01:07:08.381 INFO:tasks.workunit.client.0.smithi103.stdout:7/224: readlink d4/d10/l1b 0 2024-09-17T01:07:08.382 INFO:tasks.workunit.client.0.smithi103.stdout:1/340: mkdir d2/d1c/d20/d6d 0 2024-09-17T01:07:08.382 INFO:tasks.workunit.client.1.smithi143.stdout:9/787: truncate d3/d39/f72 715011 0 2024-09-17T01:07:08.384 INFO:tasks.workunit.client.1.smithi143.stdout:2/764: symlink d0/d44/lfb 0 2024-09-17T01:07:08.387 INFO:tasks.workunit.client.0.smithi103.stdout:7/225: rename d4/f5 to d4/d10/d32/d4f/f50 0 2024-09-17T01:07:08.389 INFO:tasks.workunit.client.0.smithi103.stdout:1/341: mknod d2/d1c/d20/c6e 0 2024-09-17T01:07:08.390 INFO:tasks.workunit.client.0.smithi103.stdout:1/342: write d2/d16/f40 [5544616,61593] 0 2024-09-17T01:07:08.391 INFO:tasks.workunit.client.1.smithi143.stdout:3/813: unlink d6/d1c/d33/d3f/fe0 0 2024-09-17T01:07:08.392 INFO:tasks.workunit.client.0.smithi103.stdout:8/273: dread d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:08.396 INFO:tasks.workunit.client.0.smithi103.stdout:2/169: write f4 [292770,19016] 0 2024-09-17T01:07:08.398 INFO:tasks.workunit.client.0.smithi103.stdout:1/343: dread d2/de/d1f/f27 [0,4194304] 0 2024-09-17T01:07:08.398 INFO:tasks.workunit.client.1.smithi143.stdout:1/851: link d0/d6/d43/d6a/d107/lf6 d0/d6/d43/d6a/d107/ddd/l120 0 2024-09-17T01:07:08.398 INFO:tasks.workunit.client.1.smithi143.stdout:1/852: fsync d0/d6/d43/d47/d72/f9e 0 2024-09-17T01:07:08.400 INFO:tasks.workunit.client.0.smithi103.stdout:9/262: sync 2024-09-17T01:07:08.402 INFO:tasks.workunit.client.0.smithi103.stdout:8/274: creat d0/d6/dc/d30/d2d/d32/f53 x:0 0 0 2024-09-17T01:07:08.404 INFO:tasks.workunit.client.1.smithi143.stdout:4/834: unlink da/d68/c7e 0 2024-09-17T01:07:08.405 INFO:tasks.workunit.client.0.smithi103.stdout:7/226: mkdir d4/d11/d2b/d36/d3a/d51 0 2024-09-17T01:07:08.406 INFO:tasks.workunit.client.1.smithi143.stdout:3/814: symlink d6/d1c/d82/db1/lfc 0 2024-09-17T01:07:08.408 INFO:tasks.workunit.client.1.smithi143.stdout:6/736: truncate d2/d17/d6e/d26/d46/d65/f7f 1097442 0 2024-09-17T01:07:08.409 INFO:tasks.workunit.client.1.smithi143.stdout:3/815: dread d6/fa [0,4194304] 0 2024-09-17T01:07:08.410 INFO:tasks.workunit.client.0.smithi103.stdout:9/263: unlink d7/d43/d48/d11/fa 0 2024-09-17T01:07:08.411 INFO:tasks.workunit.client.1.smithi143.stdout:6/737: dread d2/d30/d45/d70/fef [0,4194304] 0 2024-09-17T01:07:08.412 INFO:tasks.workunit.client.0.smithi103.stdout:8/275: write d0/d6/f39 [710515,2153] 0 2024-09-17T01:07:08.413 INFO:tasks.workunit.client.1.smithi143.stdout:1/853: creat d0/d6/d43/d6d/d8b/dd0/de2/d79/f121 x:0 0 0 2024-09-17T01:07:08.415 INFO:tasks.workunit.client.1.smithi143.stdout:9/788: chown d3/d39/f72 34 1 2024-09-17T01:07:08.415 INFO:tasks.workunit.client.1.smithi143.stdout:9/789: chown d3/d39/d6a/l73 669628360 1 2024-09-17T01:07:08.416 INFO:tasks.workunit.client.1.smithi143.stdout:9/790: chown d3/d39/d42/d58/dbf 3702725 1 2024-09-17T01:07:08.416 INFO:tasks.workunit.client.0.smithi103.stdout:2/170: symlink d6/da/d17/d1a/l3a 0 2024-09-17T01:07:08.417 INFO:tasks.workunit.client.0.smithi103.stdout:2/171: write d6/f7 [2407300,67861] 0 2024-09-17T01:07:08.417 INFO:tasks.workunit.client.1.smithi143.stdout:1/854: dread d0/d6/d43/d47/d68/d7b/daf/ff2 [0,4194304] 0 2024-09-17T01:07:08.417 INFO:tasks.workunit.client.1.smithi143.stdout:2/765: symlink d0/d2/d21/lfc 0 2024-09-17T01:07:08.420 INFO:tasks.workunit.client.1.smithi143.stdout:4/835: mknod da/d6d/d90/c114 0 2024-09-17T01:07:08.421 INFO:tasks.workunit.client.0.smithi103.stdout:9/264: unlink d7/d43/f57 0 2024-09-17T01:07:08.422 INFO:tasks.workunit.client.1.smithi143.stdout:5/785: link d1/c6 d1/d46/df/d23/d4f/d7d/d102/c122 0 2024-09-17T01:07:08.422 INFO:tasks.workunit.client.1.smithi143.stdout:5/786: chown d1/d46/d9b 9 1 2024-09-17T01:07:08.423 INFO:tasks.workunit.client.1.smithi143.stdout:8/834: sync 2024-09-17T01:07:08.423 INFO:tasks.workunit.client.0.smithi103.stdout:2/172: dwrite d6/da/d17/f1e [0,4194304] 0 2024-09-17T01:07:08.426 INFO:tasks.workunit.client.1.smithi143.stdout:4/836: dwrite da/d3a/d3e/d5e/d63/f10c [0,4194304] 0 2024-09-17T01:07:08.431 INFO:tasks.workunit.client.1.smithi143.stdout:9/791: chown d3/d39/d6a/dc3/c33 3 1 2024-09-17T01:07:08.432 INFO:tasks.workunit.client.1.smithi143.stdout:5/787: dwrite d1/d46/d6e/db7/fcd [0,4194304] 0 2024-09-17T01:07:08.435 INFO:tasks.workunit.client.1.smithi143.stdout:2/766: symlink d0/d10/d56/lfd 0 2024-09-17T01:07:08.435 INFO:tasks.workunit.client.1.smithi143.stdout:0/765: write d3/d14/f61 [7846690,41368] 0 2024-09-17T01:07:08.436 INFO:tasks.workunit.client.1.smithi143.stdout:1/855: symlink d0/d6/d43/d6d/d8b/dd0/de2/d79/l122 0 2024-09-17T01:07:08.439 INFO:tasks.workunit.client.1.smithi143.stdout:0/766: stat d3/d5/f41 0 2024-09-17T01:07:08.443 INFO:tasks.workunit.client.1.smithi143.stdout:9/792: dwrite d3/d39/d6a/dc3/d3e/d51/d52/fbd [0,4194304] 0 2024-09-17T01:07:08.452 INFO:tasks.workunit.client.1.smithi143.stdout:8/835: mkdir d9/d23/d12c 0 2024-09-17T01:07:08.459 INFO:tasks.workunit.client.1.smithi143.stdout:0/767: dwrite d3/d5/d8/d27/f4b [0,4194304] 0 2024-09-17T01:07:08.459 INFO:tasks.workunit.client.1.smithi143.stdout:0/768: fsync d3/d68/f70 0 2024-09-17T01:07:08.460 INFO:tasks.workunit.client.1.smithi143.stdout:0/769: write d3/d14/f61 [8599571,24148] 0 2024-09-17T01:07:08.461 INFO:tasks.workunit.client.1.smithi143.stdout:9/793: rename d3/d39/d6a/dc3/d3e to d3/d39/d42/dab/d108 0 2024-09-17T01:07:08.471 INFO:tasks.workunit.client.1.smithi143.stdout:5/788: creat d1/d46/f123 x:0 0 0 2024-09-17T01:07:08.471 INFO:tasks.workunit.client.1.smithi143.stdout:0/770: creat d3/d5/d8/d27/d31/d48/d8d/ff6 x:0 0 0 2024-09-17T01:07:08.471 INFO:tasks.workunit.client.1.smithi143.stdout:2/767: creat d0/d10/ffe x:0 0 0 2024-09-17T01:07:08.473 INFO:tasks.workunit.client.1.smithi143.stdout:7/931: link d4/d1f/d4a/de4/d4e/d9f/fca d4/d1f/d4a/d9e/dd1/f12c 0 2024-09-17T01:07:08.473 INFO:tasks.workunit.client.1.smithi143.stdout:2/768: chown d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fe3 6050 1 2024-09-17T01:07:08.474 INFO:tasks.workunit.client.1.smithi143.stdout:7/932: readlink d4/d1f/d4a/de4/d4e/d9f/l112 0 2024-09-17T01:07:08.475 INFO:tasks.workunit.client.1.smithi143.stdout:1/856: getdents d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/de8 0 2024-09-17T01:07:08.476 INFO:tasks.workunit.client.1.smithi143.stdout:3/816: truncate d6/f90 361092 0 2024-09-17T01:07:08.476 INFO:tasks.workunit.client.1.smithi143.stdout:0/771: mkdir d3/df7 0 2024-09-17T01:07:08.477 INFO:tasks.workunit.client.1.smithi143.stdout:4/837: write da/d3a/d40/d84/f4b [1186980,62406] 0 2024-09-17T01:07:08.477 INFO:tasks.workunit.client.1.smithi143.stdout:2/769: truncate d0/d10/d58/d5a/f5f 1767687 0 2024-09-17T01:07:08.477 INFO:tasks.workunit.client.1.smithi143.stdout:6/738: truncate d2/d30/d45/f4d 2172610 0 2024-09-17T01:07:08.479 INFO:tasks.workunit.client.1.smithi143.stdout:7/933: creat d4/d1f/d4a/de4/d4e/f12d x:0 0 0 2024-09-17T01:07:08.479 INFO:tasks.workunit.client.1.smithi143.stdout:6/739: truncate d2/fa 4366605 0 2024-09-17T01:07:08.523 INFO:tasks.workunit.client.0.smithi103.stdout:6/175: sync 2024-09-17T01:07:08.553 INFO:tasks.workunit.client.1.smithi143.stdout:8/836: sync 2024-09-17T01:07:08.553 INFO:tasks.workunit.client.1.smithi143.stdout:8/837: chown d9/de/d53/d75/f86 32995045 1 2024-09-17T01:07:08.562 INFO:tasks.workunit.client.1.smithi143.stdout:4/838: unlink da/d3a/d3e/d4a/d104/ca6 0 2024-09-17T01:07:08.563 INFO:tasks.workunit.client.1.smithi143.stdout:2/770: read - d0/d10/d58/d5a/d5b/d4c/d71/d99/fa1 zero size 2024-09-17T01:07:08.564 INFO:tasks.workunit.client.1.smithi143.stdout:4/839: read da/d3a/d40/f37 [91911,40411] 0 2024-09-17T01:07:08.564 INFO:tasks.workunit.client.1.smithi143.stdout:1/857: unlink d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/cbb 0 2024-09-17T01:07:08.565 INFO:tasks.workunit.client.1.smithi143.stdout:1/858: write d0/d6/d43/d47/dbf/deb/dc3/ff1 [4546667,91244] 0 2024-09-17T01:07:08.566 INFO:tasks.workunit.client.1.smithi143.stdout:1/859: chown d0/d6/d43/d47/d88/cb8 20506814 1 2024-09-17T01:07:08.569 INFO:tasks.workunit.client.0.smithi103.stdout:2/173: mknod d6/da/d17/d26/c3b 0 2024-09-17T01:07:08.569 INFO:tasks.workunit.client.0.smithi103.stdout:8/276: dread d0/d6/f3b [0,4194304] 0 2024-09-17T01:07:08.572 INFO:tasks.workunit.client.1.smithi143.stdout:3/817: fsync d6/d1c/d82/db1/fc3 0 2024-09-17T01:07:08.573 INFO:tasks.workunit.client.1.smithi143.stdout:6/740: stat d2/d30/d45/d70/d87/d8d 0 2024-09-17T01:07:08.573 INFO:tasks.workunit.client.1.smithi143.stdout:9/794: write d3/d39/d6a/d26/fb5 [2208607,60944] 0 2024-09-17T01:07:08.573 INFO:tasks.workunit.client.1.smithi143.stdout:3/818: stat d6/d1c/d4d/da4 0 2024-09-17T01:07:08.575 INFO:tasks.workunit.client.0.smithi103.stdout:6/176: creat d3/d17/d2f/f3c x:0 0 0 2024-09-17T01:07:08.575 INFO:tasks.workunit.client.0.smithi103.stdout:6/177: dread - d3/d17/d2f/f34 zero size 2024-09-17T01:07:08.576 INFO:tasks.workunit.client.0.smithi103.stdout:6/178: dread - d3/d25/f37 zero size 2024-09-17T01:07:08.577 INFO:tasks.workunit.client.1.smithi143.stdout:5/789: write d1/d46/df/d1f/f30 [1565066,64497] 0 2024-09-17T01:07:08.578 INFO:tasks.workunit.client.1.smithi143.stdout:2/771: chown d0/f80 5 1 2024-09-17T01:07:08.581 INFO:tasks.workunit.client.0.smithi103.stdout:8/277: rmdir d0/d6/dc 39 2024-09-17T01:07:08.582 INFO:tasks.workunit.client.1.smithi143.stdout:4/840: mknod da/d3a/d3e/d4a/c115 0 2024-09-17T01:07:08.583 INFO:tasks.workunit.client.0.smithi103.stdout:7/227: getdents d4/d11/d34/d3d 0 2024-09-17T01:07:08.587 INFO:tasks.workunit.client.0.smithi103.stdout:9/265: creat d7/d43/d48/f5a x:0 0 0 2024-09-17T01:07:08.589 INFO:tasks.workunit.client.0.smithi103.stdout:6/179: mknod d3/d16/d33/c3d 0 2024-09-17T01:07:08.594 INFO:tasks.workunit.client.1.smithi143.stdout:0/772: creat d3/d14/ff8 x:0 0 0 2024-09-17T01:07:08.596 INFO:tasks.workunit.client.0.smithi103.stdout:9/266: creat d7/d43/d48/d11/d21/f5b x:0 0 0 2024-09-17T01:07:08.597 INFO:tasks.workunit.client.1.smithi143.stdout:3/819: mkdir d6/d1c/d33/d3f/d79/d7b/dfd 0 2024-09-17T01:07:08.598 INFO:tasks.workunit.client.1.smithi143.stdout:3/820: chown d6/d1c/d4b/la8 36 1 2024-09-17T01:07:08.598 INFO:tasks.workunit.client.0.smithi103.stdout:6/180: truncate d3/d17/f2a 3208485 0 2024-09-17T01:07:08.599 INFO:tasks.workunit.client.1.smithi143.stdout:3/821: chown d6/d1c/d33/d41/d2e/d86/ld8 55179244 1 2024-09-17T01:07:08.599 INFO:tasks.workunit.client.1.smithi143.stdout:9/795: unlink d3/d39/d42/dab/d108/d51/d52/fbd 0 2024-09-17T01:07:08.600 INFO:tasks.workunit.client.1.smithi143.stdout:7/934: write d4/d1f/d29/d65/f7c [680417,42446] 0 2024-09-17T01:07:08.601 INFO:tasks.workunit.client.1.smithi143.stdout:9/796: chown d3/d39/d42/d80/df3/d99/dc5/fc7 89948 1 2024-09-17T01:07:08.603 INFO:tasks.workunit.client.0.smithi103.stdout:7/228: mknod d4/d10/d37/c52 0 2024-09-17T01:07:08.603 INFO:tasks.workunit.client.0.smithi103.stdout:7/229: stat d4/d10/d4e 0 2024-09-17T01:07:08.604 INFO:tasks.workunit.client.0.smithi103.stdout:7/230: readlink d4/d10/l29 0 2024-09-17T01:07:08.604 INFO:tasks.workunit.client.0.smithi103.stdout:8/278: dread d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:08.605 INFO:tasks.workunit.client.0.smithi103.stdout:7/231: chown d4/d11/c20 25944618 1 2024-09-17T01:07:08.606 INFO:tasks.workunit.client.0.smithi103.stdout:6/181: mkdir d3/d16/d33/d3e 0 2024-09-17T01:07:08.607 INFO:tasks.workunit.client.1.smithi143.stdout:3/822: dread d6/d1c/d4b/f67 [0,4194304] 0 2024-09-17T01:07:08.608 INFO:tasks.workunit.client.1.smithi143.stdout:7/935: dwrite d4/d1f/d4a/de4/d78/f91 [0,4194304] 0 2024-09-17T01:07:08.610 INFO:tasks.workunit.client.0.smithi103.stdout:2/174: getdents d6/da/d17 0 2024-09-17T01:07:08.611 INFO:tasks.workunit.client.0.smithi103.stdout:9/267: dwrite d7/f18 [0,4194304] 0 2024-09-17T01:07:08.612 INFO:tasks.workunit.client.1.smithi143.stdout:2/772: write d0/d44/d7a/d86/fa7 [410542,104929] 0 2024-09-17T01:07:08.614 INFO:tasks.workunit.client.0.smithi103.stdout:8/279: write d0/d6/dc/d30/d2d/d32/f46 [199842,63153] 0 2024-09-17T01:07:08.615 INFO:tasks.workunit.client.1.smithi143.stdout:5/790: dwrite d1/d46/df/d23/d4f/f6a [0,4194304] 0 2024-09-17T01:07:08.617 INFO:tasks.workunit.client.0.smithi103.stdout:2/175: chown d6/da/d17/d1a/df/c1b 7 1 2024-09-17T01:07:08.619 INFO:tasks.workunit.client.1.smithi143.stdout:6/741: mkdir d2/d17/d6e/d26/df7 0 2024-09-17T01:07:08.622 INFO:tasks.workunit.client.0.smithi103.stdout:7/232: symlink d4/d4a/d4b/l53 0 2024-09-17T01:07:08.626 INFO:tasks.workunit.client.0.smithi103.stdout:8/280: creat d0/d6/dc/d30/d2d/d32/f54 x:0 0 0 2024-09-17T01:07:08.626 INFO:tasks.workunit.client.0.smithi103.stdout:7/233: truncate d4/d11/d34/f41 884352 0 2024-09-17T01:07:08.629 INFO:tasks.workunit.client.1.smithi143.stdout:4/841: creat da/d68/d9b/ddd/f116 x:0 0 0 2024-09-17T01:07:08.629 INFO:tasks.workunit.client.0.smithi103.stdout:7/234: read d4/d11/d34/f49 [3213773,1032] 0 2024-09-17T01:07:08.630 INFO:tasks.workunit.client.0.smithi103.stdout:9/268: dwrite d7/d43/d48/d11/f1f [4194304,4194304] 0 2024-09-17T01:07:08.630 INFO:tasks.workunit.client.0.smithi103.stdout:2/176: truncate f5 941539 0 2024-09-17T01:07:08.632 INFO:tasks.workunit.client.0.smithi103.stdout:2/177: chown d6/da/d17/d26/f32 510505 1 2024-09-17T01:07:08.633 INFO:tasks.workunit.client.1.smithi143.stdout:4/842: read da/d3a/d40/d84/f94 [919952,119755] 0 2024-09-17T01:07:08.634 INFO:tasks.workunit.client.1.smithi143.stdout:3/823: dread d6/d1c/d4b/f76 [0,4194304] 0 2024-09-17T01:07:08.635 INFO:tasks.workunit.client.1.smithi143.stdout:2/773: write d0/d2/d21/d84/d8d/fd8 [1282003,22569] 0 2024-09-17T01:07:08.636 INFO:tasks.workunit.client.1.smithi143.stdout:5/791: mkdir d1/d46/df/d1f/d9f/d124 0 2024-09-17T01:07:08.638 INFO:tasks.workunit.client.1.smithi143.stdout:2/774: dread d0/d10/d58/d5a/d5b/fa4 [0,4194304] 0 2024-09-17T01:07:08.639 INFO:tasks.workunit.client.1.smithi143.stdout:6/742: mkdir d2/d17/d6e/d26/dbd/df8 0 2024-09-17T01:07:08.639 INFO:tasks.workunit.client.0.smithi103.stdout:9/269: dwrite d7/d43/d48/f2c [0,4194304] 0 2024-09-17T01:07:08.640 INFO:tasks.workunit.client.1.smithi143.stdout:8/838: getdents d9/d12/d38/d58/dda 0 2024-09-17T01:07:08.641 INFO:tasks.workunit.client.0.smithi103.stdout:9/270: write d7/d43/d48/d11/fb [2681109,10781] 0 2024-09-17T01:07:08.643 INFO:tasks.workunit.client.0.smithi103.stdout:7/235: symlink d4/d10/l54 0 2024-09-17T01:07:08.645 INFO:tasks.workunit.client.0.smithi103.stdout:7/236: write d4/f7 [3743416,67577] 0 2024-09-17T01:07:08.646 INFO:tasks.workunit.client.1.smithi143.stdout:1/860: getdents d0/d6/d43/d6d/d8b/dd0/de2/d79 0 2024-09-17T01:07:08.648 INFO:tasks.workunit.client.0.smithi103.stdout:2/178: dwrite d6/da/d28/f35 [0,4194304] 0 2024-09-17T01:07:08.648 INFO:tasks.workunit.client.0.smithi103.stdout:9/271: mkdir d7/d43/d48/d11/d5c 0 2024-09-17T01:07:08.649 INFO:tasks.workunit.client.0.smithi103.stdout:9/272: stat d7/d43/d48/d11/d21 0 2024-09-17T01:07:08.650 INFO:tasks.workunit.client.1.smithi143.stdout:1/861: truncate d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/fe7 5116842 0 2024-09-17T01:07:08.651 INFO:tasks.workunit.client.1.smithi143.stdout:4/843: rename da/d3a/d3e/d72/da3/lac to da/d3a/d40/d84/dd0/dfe/l117 0 2024-09-17T01:07:08.652 INFO:tasks.workunit.client.0.smithi103.stdout:7/237: mknod d4/d11/d34/c55 0 2024-09-17T01:07:08.653 INFO:tasks.workunit.client.1.smithi143.stdout:1/862: chown d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/d4d 279274 1 2024-09-17T01:07:08.653 INFO:tasks.workunit.client.0.smithi103.stdout:2/179: rmdir d6/da/d17/d1a 39 2024-09-17T01:07:08.654 INFO:tasks.workunit.client.0.smithi103.stdout:2/180: fdatasync d6/da/d28/f2b 0 2024-09-17T01:07:08.655 INFO:tasks.workunit.client.1.smithi143.stdout:5/792: truncate d1/d46/df/d53/f86 3710177 0 2024-09-17T01:07:08.655 INFO:tasks.workunit.client.1.smithi143.stdout:1/863: write d0/d6/d43/d47/dd8/ff5 [1542870,22055] 0 2024-09-17T01:07:08.657 INFO:tasks.workunit.client.1.smithi143.stdout:5/793: fsync d1/d46/df/d53/d74/d9a/dd7/f11c 0 2024-09-17T01:07:08.657 INFO:tasks.workunit.client.0.smithi103.stdout:9/273: creat d7/d43/d48/d11/f5d x:0 0 0 2024-09-17T01:07:08.658 INFO:tasks.workunit.client.1.smithi143.stdout:2/775: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/fff x:0 0 0 2024-09-17T01:07:08.658 INFO:tasks.workunit.client.1.smithi143.stdout:4/844: dread da/d3a/d3e/d5e/d63/f70 [0,4194304] 0 2024-09-17T01:07:08.660 INFO:tasks.workunit.client.0.smithi103.stdout:7/238: dwrite d4/d11/f44 [0,4194304] 0 2024-09-17T01:07:08.661 INFO:tasks.workunit.client.0.smithi103.stdout:7/239: read - d4/d10/d37/f39 zero size 2024-09-17T01:07:08.667 INFO:tasks.workunit.client.0.smithi103.stdout:8/281: getdents d0/d6/dc/d30/d2d/d32 0 2024-09-17T01:07:08.671 INFO:tasks.workunit.client.1.smithi143.stdout:6/743: rename d2/df/d18/da8/fc9 to d2/df/d18/d69/ff9 0 2024-09-17T01:07:08.671 INFO:tasks.workunit.client.1.smithi143.stdout:6/744: write d2/d30/db4/dbc/fd1 [473409,35352] 0 2024-09-17T01:07:08.673 INFO:tasks.workunit.client.0.smithi103.stdout:2/181: dread - d6/da/d17/f29 zero size 2024-09-17T01:07:08.674 INFO:tasks.workunit.client.0.smithi103.stdout:7/240: dread d4/d11/d2b/f2f [0,4194304] 0 2024-09-17T01:07:08.675 INFO:tasks.workunit.client.0.smithi103.stdout:8/282: dwrite d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:08.676 INFO:tasks.workunit.client.0.smithi103.stdout:7/241: read d4/d11/d2b/f2f [1010206,13273] 0 2024-09-17T01:07:08.679 INFO:tasks.workunit.client.1.smithi143.stdout:0/773: write d3/d5/d8/d21/d2e/f91 [2060881,111612] 0 2024-09-17T01:07:08.683 INFO:tasks.workunit.client.0.smithi103.stdout:8/283: rename d0/d6/dc/d30/d2d/l3f to d0/l55 0 2024-09-17T01:07:08.683 INFO:tasks.workunit.client.1.smithi143.stdout:7/936: truncate d4/d26/f22 4597306 0 2024-09-17T01:07:08.685 INFO:tasks.workunit.client.1.smithi143.stdout:2/776: symlink d0/d10/d58/d5a/d5b/d4c/d71/dc5/l100 0 2024-09-17T01:07:08.686 INFO:tasks.workunit.client.1.smithi143.stdout:9/797: getdents d3/d39/d42/d80/df3/d99/dc5 0 2024-09-17T01:07:08.687 INFO:tasks.workunit.client.0.smithi103.stdout:9/274: getdents d7/d43/d48/d11/d21 0 2024-09-17T01:07:08.691 INFO:tasks.workunit.client.0.smithi103.stdout:7/242: getdents d4/d10/d4e 0 2024-09-17T01:07:08.693 INFO:tasks.workunit.client.0.smithi103.stdout:9/275: unlink d7/d43/d48/d11/c13 0 2024-09-17T01:07:08.695 INFO:tasks.workunit.client.0.smithi103.stdout:2/182: creat d6/da/d17/f3c x:0 0 0 2024-09-17T01:07:08.696 INFO:tasks.workunit.client.1.smithi143.stdout:6/745: creat d2/df/d18/ffa x:0 0 0 2024-09-17T01:07:08.704 INFO:tasks.workunit.client.1.smithi143.stdout:1/864: dwrite d0/d6/d43/d6d/d8b/fcf [0,4194304] 0 2024-09-17T01:07:08.706 INFO:tasks.workunit.client.1.smithi143.stdout:8/839: truncate d9/d23/d32/fb0 114378 0 2024-09-17T01:07:08.706 INFO:tasks.workunit.client.0.smithi103.stdout:2/183: rmdir d6/da/d17/d26 39 2024-09-17T01:07:08.709 INFO:tasks.workunit.client.1.smithi143.stdout:8/840: truncate d9/d12/d13/fed 323325 0 2024-09-17T01:07:08.709 INFO:tasks.workunit.client.1.smithi143.stdout:7/937: mknod d4/d1f/d29/d65/d5d/db1/c12e 0 2024-09-17T01:07:08.709 INFO:tasks.workunit.client.1.smithi143.stdout:8/841: stat d9/d12/d38/d58/d79/d9b 0 2024-09-17T01:07:08.709 INFO:tasks.workunit.client.0.smithi103.stdout:7/243: creat d4/d10/f56 x:0 0 0 2024-09-17T01:07:08.710 INFO:tasks.workunit.client.0.smithi103.stdout:9/276: rmdir d7/d43/d48/d11 39 2024-09-17T01:07:08.710 INFO:tasks.workunit.client.0.smithi103.stdout:9/277: stat d7/f19 0 2024-09-17T01:07:08.710 INFO:tasks.workunit.client.0.smithi103.stdout:7/244: chown d4/d10/f2e 12297 1 2024-09-17T01:07:08.711 INFO:tasks.workunit.client.0.smithi103.stdout:7/245: chown d4/d10/f35 7015 1 2024-09-17T01:07:08.713 INFO:tasks.workunit.client.0.smithi103.stdout:2/184: mknod d6/da/d28/c3d 0 2024-09-17T01:07:08.714 INFO:tasks.workunit.client.1.smithi143.stdout:9/798: creat d3/d39/d42/d58/dbf/f109 x:0 0 0 2024-09-17T01:07:08.715 INFO:tasks.workunit.client.1.smithi143.stdout:8/842: dwrite d9/de/fb5 [0,4194304] 0 2024-09-17T01:07:08.716 INFO:tasks.workunit.client.1.smithi143.stdout:3/824: getdents d6/d1c/d33/d3f/df0 0 2024-09-17T01:07:08.717 INFO:tasks.workunit.client.1.smithi143.stdout:9/799: write d3/d39/d42/d58/f76 [592479,12940] 0 2024-09-17T01:07:08.718 INFO:tasks.workunit.client.0.smithi103.stdout:9/278: read d7/d43/d48/d11/fe [66385,89051] 0 2024-09-17T01:07:08.720 INFO:tasks.workunit.client.1.smithi143.stdout:6/746: mkdir d2/d30/d45/d70/d87/d8d/dfb 0 2024-09-17T01:07:08.725 INFO:tasks.workunit.client.1.smithi143.stdout:0/774: symlink d3/df7/lf9 0 2024-09-17T01:07:08.727 INFO:tasks.workunit.client.0.smithi103.stdout:7/246: creat d4/d10/d43/f57 x:0 0 0 2024-09-17T01:07:08.728 INFO:tasks.workunit.client.0.smithi103.stdout:2/185: symlink d6/da/d17/l3e 0 2024-09-17T01:07:08.729 INFO:tasks.workunit.client.0.smithi103.stdout:7/247: write d4/d11/d34/d3d/f45 [886335,78243] 0 2024-09-17T01:07:08.731 INFO:tasks.workunit.client.1.smithi143.stdout:4/845: dwrite da/d75/f7b [0,4194304] 0 2024-09-17T01:07:08.732 INFO:tasks.workunit.client.1.smithi143.stdout:3/825: dwrite d6/d1c/d4d/f6d [0,4194304] 0 2024-09-17T01:07:08.735 INFO:tasks.workunit.client.1.smithi143.stdout:8/843: dwrite d9/d12/d38/f64 [0,4194304] 0 2024-09-17T01:07:08.738 INFO:tasks.workunit.client.1.smithi143.stdout:5/794: getdents d1/d46/d6e/d106 0 2024-09-17T01:07:08.739 INFO:tasks.workunit.client.1.smithi143.stdout:5/795: chown d1/d96/fd6 48 1 2024-09-17T01:07:08.739 INFO:tasks.workunit.client.0.smithi103.stdout:7/248: creat d4/d10/d32/d4f/f58 x:0 0 0 2024-09-17T01:07:08.739 INFO:tasks.workunit.client.0.smithi103.stdout:9/279: mkdir d7/d43/d48/d11/d5c/d5e 0 2024-09-17T01:07:08.741 INFO:tasks.workunit.client.1.smithi143.stdout:7/938: dread d4/d1f/d4a/de4/d4e/f5b [0,4194304] 0 2024-09-17T01:07:08.742 INFO:tasks.workunit.client.0.smithi103.stdout:2/186: dwrite d6/da/d28/f2e [0,4194304] 0 2024-09-17T01:07:08.742 INFO:tasks.workunit.client.1.smithi143.stdout:5/796: write d1/d46/df/d53/d74/fa7 [1210308,87690] 0 2024-09-17T01:07:08.746 INFO:tasks.workunit.client.1.smithi143.stdout:9/800: rename d3/d39/d42/d58/dbf/f109 to d3/d39/d42/d80/f10a 0 2024-09-17T01:07:08.747 INFO:tasks.workunit.client.1.smithi143.stdout:0/775: symlink d3/df7/lfa 0 2024-09-17T01:07:08.748 INFO:tasks.workunit.client.0.smithi103.stdout:9/280: fdatasync d7/d43/d48/d11/d20/f44 0 2024-09-17T01:07:08.749 INFO:tasks.workunit.client.1.smithi143.stdout:2/777: creat d0/d10/f101 x:0 0 0 2024-09-17T01:07:08.749 INFO:tasks.workunit.client.0.smithi103.stdout:9/281: fdatasync d7/d43/d48/d11/d21/f33 0 2024-09-17T01:07:08.753 INFO:tasks.workunit.client.0.smithi103.stdout:2/187: mkdir d6/da/d3f 0 2024-09-17T01:07:08.756 INFO:tasks.workunit.client.0.smithi103.stdout:9/282: mkdir d7/d43/d5f 0 2024-09-17T01:07:08.756 INFO:tasks.workunit.client.1.smithi143.stdout:5/797: mkdir d1/d46/df/d1f/d9f/d125 0 2024-09-17T01:07:08.757 INFO:tasks.workunit.client.0.smithi103.stdout:9/283: write d7/f3c [1581624,77847] 0 2024-09-17T01:07:08.758 INFO:tasks.workunit.client.0.smithi103.stdout:2/188: rmdir d6/da/d17/d1a 39 2024-09-17T01:07:08.760 INFO:tasks.workunit.client.1.smithi143.stdout:2/778: symlink d0/d2/d21/d84/d8d/l102 0 2024-09-17T01:07:08.761 INFO:tasks.workunit.client.0.smithi103.stdout:9/284: symlink d7/d43/d48/d11/d21/l60 0 2024-09-17T01:07:08.761 INFO:tasks.workunit.client.1.smithi143.stdout:4/846: mknod da/d3a/d3e/d72/d9e/c118 0 2024-09-17T01:07:08.762 INFO:tasks.workunit.client.1.smithi143.stdout:4/847: dread - da/d3a/d40/ff3 zero size 2024-09-17T01:07:08.763 INFO:tasks.workunit.client.1.smithi143.stdout:4/848: read da/d75/f8b [309002,16930] 0 2024-09-17T01:07:08.764 INFO:tasks.workunit.client.1.smithi143.stdout:1/865: getdents d0/d6/d43/d47/d88 0 2024-09-17T01:07:08.767 INFO:tasks.workunit.client.0.smithi103.stdout:9/285: rename d7/d43/d48/d11/d20/f58 to d7/d43/d48/d11/d5c/f61 0 2024-09-17T01:07:08.768 INFO:tasks.workunit.client.0.smithi103.stdout:2/189: dwrite d6/da/d17/f20 [0,4194304] 0 2024-09-17T01:07:08.770 INFO:tasks.workunit.client.1.smithi143.stdout:5/798: read d1/d46/df/d23/f41 [1024584,22512] 0 2024-09-17T01:07:08.774 INFO:tasks.workunit.client.0.smithi103.stdout:2/190: dread - d6/f2d zero size 2024-09-17T01:07:08.779 INFO:tasks.workunit.client.1.smithi143.stdout:4/849: chown da/d3a/f3b 99 1 2024-09-17T01:07:08.780 INFO:tasks.workunit.client.0.smithi103.stdout:7/249: truncate d4/f7 3194425 0 2024-09-17T01:07:08.781 INFO:tasks.workunit.client.1.smithi143.stdout:7/939: mkdir d4/d1f/d4a/dc1/d12f 0 2024-09-17T01:07:08.782 INFO:tasks.workunit.client.0.smithi103.stdout:9/286: dwrite d7/f53 [0,4194304] 0 2024-09-17T01:07:08.786 INFO:tasks.workunit.client.1.smithi143.stdout:3/826: rename d6/d1c/d33/d5d to d6/d1c/d82/dfe 0 2024-09-17T01:07:08.787 INFO:tasks.workunit.client.1.smithi143.stdout:3/827: chown d6/d1c/d4d/da4/fec 224985 1 2024-09-17T01:07:08.787 INFO:tasks.workunit.client.0.smithi103.stdout:7/250: chown d4/d11/d2b/d36/c40 96358 1 2024-09-17T01:07:08.788 INFO:tasks.workunit.client.1.smithi143.stdout:5/799: truncate d1/d46/df/d53/d74/d9a/fb1 2394723 0 2024-09-17T01:07:08.790 INFO:tasks.workunit.client.1.smithi143.stdout:0/776: link d3/d5/d8/d27/d31/d85/fa4 d3/d5/ffb 0 2024-09-17T01:07:08.792 INFO:tasks.workunit.client.0.smithi103.stdout:7/251: symlink d4/d10/d32/d4f/l59 0 2024-09-17T01:07:08.794 INFO:tasks.workunit.client.0.smithi103.stdout:7/252: write d4/d11/d34/f41 [1260467,8436] 0 2024-09-17T01:07:08.795 INFO:tasks.workunit.client.1.smithi143.stdout:1/866: creat d0/d118/f123 x:0 0 0 2024-09-17T01:07:08.795 INFO:tasks.workunit.client.0.smithi103.stdout:9/287: symlink d7/d43/d48/d11/d20/d4f/l62 0 2024-09-17T01:07:08.796 INFO:tasks.workunit.client.1.smithi143.stdout:7/940: fdatasync d4/d1f/d29/d65/fee 0 2024-09-17T01:07:08.797 INFO:tasks.workunit.client.1.smithi143.stdout:1/867: dread d0/dc/d74/f8a [0,4194304] 0 2024-09-17T01:07:08.798 INFO:tasks.workunit.client.1.smithi143.stdout:7/941: chown d4/d1f/d4a/d66/f6c 10 1 2024-09-17T01:07:08.798 INFO:tasks.workunit.client.1.smithi143.stdout:6/747: link d2/d17/d6e/l58 d2/d17/lfc 0 2024-09-17T01:07:08.799 INFO:tasks.workunit.client.1.smithi143.stdout:1/868: chown d0/d6/d43/d47/dbf/deb/d78/f90 3972187 1 2024-09-17T01:07:08.799 INFO:tasks.workunit.client.1.smithi143.stdout:7/942: fdatasync d4/d1f/d4a/d9e/da2/fff 0 2024-09-17T01:07:08.800 INFO:tasks.workunit.client.0.smithi103.stdout:7/253: unlink d4/d10/c17 0 2024-09-17T01:07:08.800 INFO:tasks.workunit.client.1.smithi143.stdout:7/943: chown d4/d1f/d4a/d9e/da2/l125 0 1 2024-09-17T01:07:08.801 INFO:tasks.workunit.client.1.smithi143.stdout:8/844: rename d9/d12/c16 to d9/d12/d13/d73/c12d 0 2024-09-17T01:07:08.805 INFO:tasks.workunit.client.0.smithi103.stdout:7/254: mknod d4/d11/d2b/d36/d3a/c5a 0 2024-09-17T01:07:08.805 INFO:tasks.workunit.client.0.smithi103.stdout:7/255: read d4/d11/d2b/f3e [341183,11038] 0 2024-09-17T01:07:08.808 INFO:tasks.workunit.client.1.smithi143.stdout:2/779: creat d0/d2/d21/f103 x:0 0 0 2024-09-17T01:07:08.810 INFO:tasks.workunit.client.1.smithi143.stdout:2/780: read d0/d10/d58/d5a/d5b/d4c/d77/fcc [3701434,2101] 0 2024-09-17T01:07:08.812 INFO:tasks.workunit.client.0.smithi103.stdout:7/256: link d4/d11/d2b/d36/d3a/f4c d4/d11/d34/d3d/f5b 0 2024-09-17T01:07:08.813 INFO:tasks.workunit.client.1.smithi143.stdout:1/869: rmdir d0/d6/d43/d47/dbf/deb/d78 39 2024-09-17T01:07:08.813 INFO:tasks.workunit.client.0.smithi103.stdout:7/257: chown d4/d11/d2b/l2d 62 1 2024-09-17T01:07:08.814 INFO:tasks.workunit.client.0.smithi103.stdout:7/258: write d4/d10/d32/d4f/f58 [1000874,127147] 0 2024-09-17T01:07:08.815 INFO:tasks.workunit.client.0.smithi103.stdout:7/259: chown d4/d11/d2b/d36/d3a/c5a 13 1 2024-09-17T01:07:08.816 INFO:tasks.workunit.client.1.smithi143.stdout:2/781: dwrite d0/d10/d58/d5a/d5b/d4c/d71/d9d/f73 [0,4194304] 0 2024-09-17T01:07:08.816 INFO:tasks.workunit.client.0.smithi103.stdout:7/260: write d4/d10/d32/d4f/f58 [883358,63333] 0 2024-09-17T01:07:08.819 INFO:tasks.workunit.client.1.smithi143.stdout:8/845: creat d9/d12/d38/d58/d79/f12e x:0 0 0 2024-09-17T01:07:08.821 INFO:tasks.workunit.client.1.smithi143.stdout:5/800: write d1/d46/df/d23/f72 [5188552,56867] 0 2024-09-17T01:07:08.821 INFO:tasks.workunit.client.0.smithi103.stdout:7/261: symlink d4/d11/l5c 0 2024-09-17T01:07:08.821 INFO:tasks.workunit.client.0.smithi103.stdout:7/262: chown d4/d11/d34/c55 217236626 1 2024-09-17T01:07:08.825 INFO:tasks.workunit.client.1.smithi143.stdout:6/748: link d2/d30/d45/f50 d2/d17/d6e/d26/dbd/df8/ffd 0 2024-09-17T01:07:08.825 INFO:tasks.workunit.client.1.smithi143.stdout:5/801: dread d1/f68 [0,4194304] 0 2024-09-17T01:07:08.825 INFO:tasks.workunit.client.1.smithi143.stdout:3/828: dwrite d6/d1c/d4b/d57/f9d [0,4194304] 0 2024-09-17T01:07:08.826 INFO:tasks.workunit.client.1.smithi143.stdout:7/944: fsync d4/d1f/f23 0 2024-09-17T01:07:08.831 INFO:tasks.workunit.client.1.smithi143.stdout:7/945: chown d4/d1f/d29/f64 208576331 1 2024-09-17T01:07:08.833 INFO:tasks.workunit.client.1.smithi143.stdout:6/749: symlink d2/df/d20/d2c/d75/daf/lfe 0 2024-09-17T01:07:08.834 INFO:tasks.workunit.client.1.smithi143.stdout:1/870: link d0/dc/d74/l104 d0/d6/d43/d47/d68/l124 0 2024-09-17T01:07:08.835 INFO:tasks.workunit.client.1.smithi143.stdout:2/782: creat d0/d44/f104 x:0 0 0 2024-09-17T01:07:08.836 INFO:tasks.workunit.client.1.smithi143.stdout:8/846: dwrite d9/d12/d13/d73/dee/ff3 [0,4194304] 0 2024-09-17T01:07:08.839 INFO:tasks.workunit.client.1.smithi143.stdout:1/871: dread - d0/d6/d43/d6a/d52/db2/fe9 zero size 2024-09-17T01:07:08.841 INFO:tasks.workunit.client.1.smithi143.stdout:5/802: dwrite d1/d46/d9b/ffe [0,4194304] 0 2024-09-17T01:07:08.843 INFO:tasks.workunit.client.1.smithi143.stdout:1/872: chown d0/d6/d43/d47/d68/f73 148703 1 2024-09-17T01:07:08.845 INFO:tasks.workunit.client.1.smithi143.stdout:5/803: stat d1/d46/df/d53/d74/dc7/fe6 0 2024-09-17T01:07:08.845 INFO:tasks.workunit.client.1.smithi143.stdout:2/783: dread d0/d10/d58/d5a/f78 [0,4194304] 0 2024-09-17T01:07:08.849 INFO:tasks.workunit.client.1.smithi143.stdout:8/847: dwrite d9/d23/d32/f117 [0,4194304] 0 2024-09-17T01:07:08.851 INFO:tasks.workunit.client.1.smithi143.stdout:9/801: rename d3/d39/f72 to d3/d3d/f10b 0 2024-09-17T01:07:08.854 INFO:tasks.workunit.client.1.smithi143.stdout:0/777: write d3/d5/d8/d58/f7f [599436,99327] 0 2024-09-17T01:07:08.857 INFO:tasks.workunit.client.1.smithi143.stdout:1/873: dwrite d0/d6/d43/d47/d72/fe3 [0,4194304] 0 2024-09-17T01:07:08.868 INFO:tasks.workunit.client.1.smithi143.stdout:8/848: fsync d9/d12/df4/f119 0 2024-09-17T01:07:08.869 INFO:tasks.workunit.client.0.smithi103.stdout:7/263: truncate d4/f1a 4817170 0 2024-09-17T01:07:08.874 INFO:tasks.workunit.client.0.smithi103.stdout:7/264: fdatasync d4/f7 0 2024-09-17T01:07:08.876 INFO:tasks.workunit.client.1.smithi143.stdout:1/874: creat d0/d6/d43/d6a/d52/db3/f125 x:0 0 0 2024-09-17T01:07:08.876 INFO:tasks.workunit.client.1.smithi143.stdout:5/804: mkdir d1/d46/df/d1f/d9f/d124/d126 0 2024-09-17T01:07:08.878 INFO:tasks.workunit.client.1.smithi143.stdout:9/802: dwrite d3/d39/d42/d80/df3/d99/f9d [0,4194304] 0 2024-09-17T01:07:08.879 INFO:tasks.workunit.client.1.smithi143.stdout:3/829: truncate d6/d1c/d4d/fe5 629907 0 2024-09-17T01:07:08.880 INFO:tasks.workunit.client.1.smithi143.stdout:5/805: dread - d1/d46/df/d53/fa2 zero size 2024-09-17T01:07:08.882 INFO:tasks.workunit.client.1.smithi143.stdout:8/849: creat d9/de/d53/d75/dfa/d66/f12f x:0 0 0 2024-09-17T01:07:08.885 INFO:tasks.workunit.client.1.smithi143.stdout:0/778: fsync d3/d68/f7a 0 2024-09-17T01:07:08.887 INFO:tasks.workunit.client.1.smithi143.stdout:9/803: mkdir d3/d81/d9c/d10c 0 2024-09-17T01:07:08.890 INFO:tasks.workunit.client.1.smithi143.stdout:3/830: mkdir d6/d1c/d4d/da4/dea/dff 0 2024-09-17T01:07:08.891 INFO:tasks.workunit.client.1.smithi143.stdout:5/806: write d1/d46/df/d53/d74/d9a/d9c/fc4 [3992156,78596] 0 2024-09-17T01:07:08.892 INFO:tasks.workunit.client.1.smithi143.stdout:7/946: dwrite d4/d1f/d4a/de4/d4e/f5b [0,4194304] 0 2024-09-17T01:07:08.893 INFO:tasks.workunit.client.1.smithi143.stdout:0/779: creat d3/d14/d32/ffc x:0 0 0 2024-09-17T01:07:08.893 INFO:tasks.workunit.client.1.smithi143.stdout:9/804: write d3/d39/d42/d58/ff2 [584605,50427] 0 2024-09-17T01:07:08.894 INFO:tasks.workunit.client.1.smithi143.stdout:6/750: dwrite d2/df/f6b [0,4194304] 0 2024-09-17T01:07:08.894 INFO:tasks.workunit.client.1.smithi143.stdout:8/850: creat d9/d12/d38/d58/d79/d10d/f130 x:0 0 0 2024-09-17T01:07:08.896 INFO:tasks.workunit.client.1.smithi143.stdout:1/875: link d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/f2a d0/d6/d43/d47/d68/d7b/de0/f126 0 2024-09-17T01:07:08.896 INFO:tasks.workunit.client.1.smithi143.stdout:3/831: chown d6/d1c/d4b/lcd 77774 1 2024-09-17T01:07:08.899 INFO:tasks.workunit.client.1.smithi143.stdout:4/850: sync 2024-09-17T01:07:08.901 INFO:tasks.workunit.client.0.smithi103.stdout:7/265: truncate d4/d11/f18 996792 0 2024-09-17T01:07:08.906 INFO:tasks.workunit.client.1.smithi143.stdout:1/876: unlink d0/d6/d43/d6a/df/f1a 0 2024-09-17T01:07:08.906 INFO:tasks.workunit.client.1.smithi143.stdout:2/784: dread d0/d10/f17 [0,4194304] 0 2024-09-17T01:07:08.911 INFO:tasks.workunit.client.1.smithi143.stdout:0/780: dwrite d3/d68/fdc [0,4194304] 0 2024-09-17T01:07:08.912 INFO:tasks.workunit.client.1.smithi143.stdout:8/851: dread d9/d12/ff7 [0,4194304] 0 2024-09-17T01:07:08.912 INFO:tasks.workunit.client.1.smithi143.stdout:7/947: dread - d4/d1f/d4a/d66/db5/fe9 zero size 2024-09-17T01:07:08.912 INFO:tasks.workunit.client.0.smithi103.stdout:7/266: dread d4/d11/f2a [0,4194304] 0 2024-09-17T01:07:08.912 INFO:tasks.workunit.client.1.smithi143.stdout:4/851: mknod da/d3a/d40/d84/db6/df2/c119 0 2024-09-17T01:07:08.913 INFO:tasks.workunit.client.1.smithi143.stdout:5/807: symlink d1/d46/df/d1f/d9f/d124/d126/l127 0 2024-09-17T01:07:08.913 INFO:tasks.workunit.client.1.smithi143.stdout:8/852: write d9/de/fb5 [2821731,119550] 0 2024-09-17T01:07:08.915 INFO:tasks.workunit.client.1.smithi143.stdout:4/852: chown da/d3a/d3e/d4a/d8a/f99 361 1 2024-09-17T01:07:08.915 INFO:tasks.workunit.client.0.smithi103.stdout:7/267: creat d4/d11/d2b/d36/d3a/f5d x:0 0 0 2024-09-17T01:07:08.917 INFO:tasks.workunit.client.1.smithi143.stdout:7/948: truncate d4/d26/f61 4818700 0 2024-09-17T01:07:08.917 INFO:tasks.workunit.client.1.smithi143.stdout:1/877: read d0/d6/d43/d6d/d8b/dd0/de2/f5e [960840,105281] 0 2024-09-17T01:07:08.918 INFO:tasks.workunit.client.1.smithi143.stdout:8/853: rmdir d9/d12/d38/d7a/d8f 39 2024-09-17T01:07:08.921 INFO:tasks.workunit.client.1.smithi143.stdout:1/878: read d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/f36 [3031947,58354] 0 2024-09-17T01:07:08.923 INFO:tasks.workunit.client.0.smithi103.stdout:7/268: mkdir d4/d11/d2b/d36/d3a/d51/d5e 0 2024-09-17T01:07:08.924 INFO:tasks.workunit.client.1.smithi143.stdout:6/751: dread d2/d17/f77 [0,4194304] 0 2024-09-17T01:07:08.925 INFO:tasks.workunit.client.1.smithi143.stdout:4/853: creat da/d3a/d3e/d5e/d63/f11a x:0 0 0 2024-09-17T01:07:08.925 INFO:tasks.workunit.client.1.smithi143.stdout:7/949: creat d4/d26/dcc/f130 x:0 0 0 2024-09-17T01:07:08.926 INFO:tasks.workunit.client.1.smithi143.stdout:9/805: write d3/d39/d42/dab/d108/d51/d52/fc1 [4468201,93286] 0 2024-09-17T01:07:08.926 INFO:tasks.workunit.client.0.smithi103.stdout:7/269: creat d4/d11/f5f x:0 0 0 2024-09-17T01:07:08.928 INFO:tasks.workunit.client.1.smithi143.stdout:8/854: unlink d9/fa5 0 2024-09-17T01:07:08.929 INFO:tasks.workunit.client.1.smithi143.stdout:4/854: chown da/d3a/d3e/d72/d9e/fc4 1726 1 2024-09-17T01:07:08.930 INFO:tasks.workunit.client.1.smithi143.stdout:7/950: chown d4/d1f/d4a/de4/d4e/d9f/fca 125179 1 2024-09-17T01:07:08.930 INFO:tasks.workunit.client.0.smithi103.stdout:7/270: creat d4/d11/d2b/d36/d3a/d51/d5e/f60 x:0 0 0 2024-09-17T01:07:08.932 INFO:tasks.workunit.client.1.smithi143.stdout:3/832: dwrite d6/d1c/d33/f38 [0,4194304] 0 2024-09-17T01:07:08.932 INFO:tasks.workunit.client.1.smithi143.stdout:1/879: rmdir d0/d6/d43/d6d 39 2024-09-17T01:07:08.933 INFO:tasks.workunit.client.1.smithi143.stdout:5/808: write d1/d46/d6e/da0/fbb [31895,102695] 0 2024-09-17T01:07:08.935 INFO:tasks.workunit.client.0.smithi103.stdout:7/271: chown d4/f1a 41412 1 2024-09-17T01:07:08.936 INFO:tasks.workunit.client.1.smithi143.stdout:5/809: readlink d1/d46/df/d1f/d9f/la8 0 2024-09-17T01:07:08.938 INFO:tasks.workunit.client.1.smithi143.stdout:6/752: dread d2/d30/d45/d70/d87/fa2 [0,4194304] 0 2024-09-17T01:07:08.938 INFO:tasks.workunit.client.1.smithi143.stdout:6/753: chown d2/d19 4 1 2024-09-17T01:07:08.940 INFO:tasks.workunit.client.1.smithi143.stdout:3/833: dwrite d6/d1c/d4b/d57/f9d [0,4194304] 0 2024-09-17T01:07:08.942 INFO:tasks.workunit.client.1.smithi143.stdout:3/834: truncate d6/d1c/d4d/da4/fec 305270 0 2024-09-17T01:07:08.943 INFO:tasks.workunit.client.0.smithi103.stdout:7/272: dwrite d4/d11/d2b/d36/d3a/d51/d5e/f60 [0,4194304] 0 2024-09-17T01:07:08.947 INFO:tasks.workunit.client.0.smithi103.stdout:7/273: unlink d4/d10/l1f 0 2024-09-17T01:07:08.951 INFO:tasks.workunit.client.0.smithi103.stdout:7/274: symlink d4/d11/l61 0 2024-09-17T01:07:08.954 INFO:tasks.workunit.client.1.smithi143.stdout:8/855: creat d9/d23/d32/d11f/f131 x:0 0 0 2024-09-17T01:07:08.954 INFO:tasks.workunit.client.0.smithi103.stdout:7/275: mknod d4/d11/d2b/d36/c62 0 2024-09-17T01:07:08.956 INFO:tasks.workunit.client.1.smithi143.stdout:3/835: chown d6/d1c/d33/d41/d42/l59 88 1 2024-09-17T01:07:08.961 INFO:tasks.workunit.client.1.smithi143.stdout:4/855: getdents da/d3a/d3e/d72/d9e/da1 0 2024-09-17T01:07:08.961 INFO:tasks.workunit.client.1.smithi143.stdout:1/880: getdents d0/d6/d43/d47/dbf 0 2024-09-17T01:07:08.961 INFO:tasks.workunit.client.1.smithi143.stdout:6/754: dwrite d2/d19/f8a [4194304,4194304] 0 2024-09-17T01:07:08.963 INFO:tasks.workunit.client.1.smithi143.stdout:7/951: dread d4/d26/ffb [0,4194304] 0 2024-09-17T01:07:08.965 INFO:tasks.workunit.client.1.smithi143.stdout:6/755: readlink d2/df/d20/d2c/d75/la6 0 2024-09-17T01:07:08.966 INFO:tasks.workunit.client.1.smithi143.stdout:1/881: dread - d0/dc/d57/dc2/ff4 zero size 2024-09-17T01:07:08.967 INFO:tasks.workunit.client.0.smithi103.stdout:7/276: rmdir d4/d10 39 2024-09-17T01:07:08.968 INFO:tasks.workunit.client.1.smithi143.stdout:4/856: rmdir da/d3a/d40/d84/dd0 39 2024-09-17T01:07:08.968 INFO:tasks.workunit.client.1.smithi143.stdout:8/856: dwrite d9/d12/d38/d58/d70/ff1 [0,4194304] 0 2024-09-17T01:07:08.968 INFO:tasks.workunit.client.1.smithi143.stdout:6/756: chown d2/d17/d6e/d26/dbd/d5e/d7c/cf3 55 1 2024-09-17T01:07:08.969 INFO:tasks.workunit.client.1.smithi143.stdout:3/836: dwrite d6/d1c/d33/d3f/d5c/da1/fdb [0,4194304] 0 2024-09-17T01:07:08.972 INFO:tasks.workunit.client.1.smithi143.stdout:7/952: creat d4/d1f/d4a/d66/d86/f131 x:0 0 0 2024-09-17T01:07:08.973 INFO:tasks.workunit.client.0.smithi103.stdout:7/277: unlink d4/d11/d2b/f3e 0 2024-09-17T01:07:08.993 INFO:tasks.workunit.client.0.smithi103.stdout:7/278: truncate d4/d10/d32/d4f/f50 1797200 0 2024-09-17T01:07:08.994 INFO:tasks.workunit.client.0.smithi103.stdout:7/279: stat d4/d11/d2b/f2f 0 2024-09-17T01:07:08.995 INFO:tasks.workunit.client.0.smithi103.stdout:7/280: mkdir d4/d11/d3f/d63 0 2024-09-17T01:07:09.001 INFO:tasks.workunit.client.0.smithi103.stdout:7/281: rename d4/d11/f48 to d4/d11/d2b/d36/d3a/d51/d5e/f64 0 2024-09-17T01:07:09.002 INFO:tasks.workunit.client.0.smithi103.stdout:7/282: rmdir d4/d4a/d4b 39 2024-09-17T01:07:09.003 INFO:tasks.workunit.client.0.smithi103.stdout:7/283: creat d4/d11/d2b/f65 x:0 0 0 2024-09-17T01:07:09.008 INFO:tasks.workunit.client.0.smithi103.stdout:7/284: dwrite d4/d10/d43/f57 [0,4194304] 0 2024-09-17T01:07:09.015 INFO:tasks.workunit.client.0.smithi103.stdout:7/285: dwrite d4/d11/f5f [0,4194304] 0 2024-09-17T01:07:09.021 INFO:tasks.workunit.client.0.smithi103.stdout:7/286: rename d4/d10/d32/d4f to d4/d10/d66 0 2024-09-17T01:07:09.023 INFO:tasks.workunit.client.0.smithi103.stdout:7/287: creat d4/d4a/f67 x:0 0 0 2024-09-17T01:07:09.029 INFO:tasks.workunit.client.1.smithi143.stdout:9/806: write d3/d39/d42/dab/d108/d51/db7/f105 [951850,18445] 0 2024-09-17T01:07:09.033 INFO:tasks.workunit.client.1.smithi143.stdout:6/757: rename d2/d17/d3a/c5f to d2/d30/dc1/de8/cff 0 2024-09-17T01:07:09.035 INFO:tasks.workunit.client.1.smithi143.stdout:8/857: symlink d9/d23/db4/d55/d57/d12a/l132 0 2024-09-17T01:07:09.036 INFO:tasks.workunit.client.1.smithi143.stdout:7/953: unlink d4/d1f/d4a/f94 0 2024-09-17T01:07:09.037 INFO:tasks.workunit.client.0.smithi103.stdout:7/288: dwrite d4/d10/d66/f50 [0,4194304] 0 2024-09-17T01:07:09.037 INFO:tasks.workunit.client.1.smithi143.stdout:5/810: dwrite d1/d46/df/d53/fa2 [0,4194304] 0 2024-09-17T01:07:09.039 INFO:tasks.workunit.client.1.smithi143.stdout:8/858: fdatasync d9/d12/d4b/f41 0 2024-09-17T01:07:09.039 INFO:tasks.workunit.client.1.smithi143.stdout:4/857: dwrite da/d6d/dca/ffd [0,4194304] 0 2024-09-17T01:07:09.039 INFO:tasks.workunit.client.1.smithi143.stdout:9/807: dread d3/d39/d42/d80/df3/d99/f93 [0,4194304] 0 2024-09-17T01:07:09.044 INFO:tasks.workunit.client.1.smithi143.stdout:6/758: mknod d2/d17/d3a/dd2/c100 0 2024-09-17T01:07:09.044 INFO:tasks.workunit.client.1.smithi143.stdout:5/811: mknod d1/d96/dff/c128 0 2024-09-17T01:07:09.045 INFO:tasks.workunit.client.1.smithi143.stdout:9/808: write d3/d39/d42/dab/d108/d51/db7/fdf [1154376,10047] 0 2024-09-17T01:07:09.045 INFO:tasks.workunit.client.1.smithi143.stdout:4/858: rmdir da/d68/d9b/ddd 39 2024-09-17T01:07:09.046 INFO:tasks.workunit.client.1.smithi143.stdout:7/954: write d4/d1f/d4a/de4/d78/de5/fef [5904447,49734] 0 2024-09-17T01:07:09.049 INFO:tasks.workunit.client.1.smithi143.stdout:6/759: read d2/df/d20/d2c/f22 [3816288,95225] 0 2024-09-17T01:07:09.051 INFO:tasks.workunit.client.1.smithi143.stdout:5/812: rmdir d1/d46/d9b/daa/ddd 39 2024-09-17T01:07:09.056 INFO:tasks.workunit.client.1.smithi143.stdout:4/859: mknod da/d3a/d3e/d72/da3/c11b 0 2024-09-17T01:07:09.058 INFO:tasks.workunit.client.1.smithi143.stdout:5/813: creat d1/d46/d6e/d106/f129 x:0 0 0 2024-09-17T01:07:09.058 INFO:tasks.workunit.client.1.smithi143.stdout:6/760: dwrite d2/df/d20/f5b [0,4194304] 0 2024-09-17T01:07:09.060 INFO:tasks.workunit.client.1.smithi143.stdout:8/859: write d9/d12/df4/fc3 [4711755,75652] 0 2024-09-17T01:07:09.061 INFO:tasks.workunit.client.1.smithi143.stdout:4/860: symlink da/d75/l11c 0 2024-09-17T01:07:09.064 INFO:tasks.workunit.client.1.smithi143.stdout:0/781: sync 2024-09-17T01:07:09.064 INFO:tasks.workunit.client.1.smithi143.stdout:6/761: write d2/d17/d6e/f3e [433951,70573] 0 2024-09-17T01:07:09.068 INFO:tasks.workunit.client.1.smithi143.stdout:6/762: fsync d2/d17/d6e/d26/dbd/d5e/d7c/fdd 0 2024-09-17T01:07:09.068 INFO:tasks.workunit.client.1.smithi143.stdout:4/861: rmdir da/d3a/d3e/d5e 39 2024-09-17T01:07:09.070 INFO:tasks.workunit.client.1.smithi143.stdout:0/782: mknod d3/d68/d8f/cfd 0 2024-09-17T01:07:09.072 INFO:tasks.workunit.client.1.smithi143.stdout:8/860: creat d9/de/d53/d75/f133 x:0 0 0 2024-09-17T01:07:09.072 INFO:tasks.workunit.client.1.smithi143.stdout:3/837: dread d6/d1c/d33/d41/d42/fb7 [0,4194304] 0 2024-09-17T01:07:09.074 INFO:tasks.workunit.client.1.smithi143.stdout:0/783: creat d3/d68/d75/dd0/ffe x:0 0 0 2024-09-17T01:07:09.075 INFO:tasks.workunit.client.1.smithi143.stdout:7/955: dwrite d4/d1f/d4a/d66/d86/fb8 [0,4194304] 0 2024-09-17T01:07:09.076 INFO:tasks.workunit.client.1.smithi143.stdout:5/814: dread d1/d46/d6e/f78 [0,4194304] 0 2024-09-17T01:07:09.078 INFO:tasks.workunit.client.1.smithi143.stdout:7/956: dread - d4/d1f/d29/d65/fee zero size 2024-09-17T01:07:09.080 INFO:tasks.workunit.client.1.smithi143.stdout:8/861: mknod d9/d23/db4/d55/d57/c134 0 2024-09-17T01:07:09.081 INFO:tasks.workunit.client.1.smithi143.stdout:0/784: mkdir d3/d68/d75/dff 0 2024-09-17T01:07:09.082 INFO:tasks.workunit.client.1.smithi143.stdout:8/862: stat d9/d23/db4 0 2024-09-17T01:07:09.082 INFO:tasks.workunit.client.1.smithi143.stdout:4/862: truncate da/d3a/d3e/d5e/d63/f70 3221672 0 2024-09-17T01:07:09.083 INFO:tasks.workunit.client.1.smithi143.stdout:5/815: dread d1/d46/d6e/f78 [0,4194304] 0 2024-09-17T01:07:09.083 INFO:tasks.workunit.client.1.smithi143.stdout:0/785: fdatasync d3/d14/fb2 0 2024-09-17T01:07:09.086 INFO:tasks.workunit.client.1.smithi143.stdout:5/816: stat d1 0 2024-09-17T01:07:09.088 INFO:tasks.workunit.client.1.smithi143.stdout:6/763: dwrite d2/d30/d45/d70/d87/fee [0,4194304] 0 2024-09-17T01:07:09.088 INFO:tasks.workunit.client.1.smithi143.stdout:9/809: dread d3/d39/d6a/d9/f2e [0,4194304] 0 2024-09-17T01:07:09.091 INFO:tasks.workunit.client.1.smithi143.stdout:4/863: creat da/d3a/d40/d84/db6/df2/f11d x:0 0 0 2024-09-17T01:07:09.095 INFO:tasks.workunit.client.1.smithi143.stdout:5/817: write d1/d46/df/d1f/de9/fdc [5158702,53055] 0 2024-09-17T01:07:09.096 INFO:tasks.workunit.client.1.smithi143.stdout:7/957: dread d4/d26/f50 [0,4194304] 0 2024-09-17T01:07:09.096 INFO:tasks.workunit.client.1.smithi143.stdout:9/810: mknod d3/d3d/de3/df4/c10d 0 2024-09-17T01:07:09.098 INFO:tasks.workunit.client.1.smithi143.stdout:8/863: write d9/de/d53/d75/f88 [1448483,130305] 0 2024-09-17T01:07:09.099 INFO:tasks.workunit.client.1.smithi143.stdout:3/838: dwrite d6/d1c/d33/d41/f1a [0,4194304] 0 2024-09-17T01:07:09.099 INFO:tasks.workunit.client.1.smithi143.stdout:6/764: write d2/d17/d3a/f51 [570629,86253] 0 2024-09-17T01:07:09.100 INFO:tasks.workunit.client.1.smithi143.stdout:4/864: mkdir da/d3a/d40/d84/db6/df2/d11e 0 2024-09-17T01:07:09.102 INFO:tasks.workunit.client.1.smithi143.stdout:0/786: rename d3/d5/d8/d21/f55 to d3/d68/d8f/ddb/de8/dcd/f100 0 2024-09-17T01:07:09.102 INFO:tasks.workunit.client.1.smithi143.stdout:8/864: mknod d9/d12/d13/c135 0 2024-09-17T01:07:09.103 INFO:tasks.workunit.client.1.smithi143.stdout:9/811: dread - d3/d39/d42/d58/dbf/fcd zero size 2024-09-17T01:07:09.104 INFO:tasks.workunit.client.1.smithi143.stdout:6/765: write d2/d30/d45/d70/fcd [298454,88298] 0 2024-09-17T01:07:09.106 INFO:tasks.workunit.client.1.smithi143.stdout:0/787: write d3/d14/d32/fd6 [776587,66561] 0 2024-09-17T01:07:09.107 INFO:tasks.workunit.client.1.smithi143.stdout:8/865: symlink d9/d2b/l136 0 2024-09-17T01:07:09.110 INFO:tasks.workunit.client.1.smithi143.stdout:4/865: creat da/d3a/d3e/d72/da3/da8/f11f x:0 0 0 2024-09-17T01:07:09.112 INFO:tasks.workunit.client.1.smithi143.stdout:9/812: mknod d3/d39/d42/dab/ddd/c10e 0 2024-09-17T01:07:09.114 INFO:tasks.workunit.client.1.smithi143.stdout:5/818: write d1/d46/df/d23/f26 [2022488,34197] 0 2024-09-17T01:07:09.116 INFO:tasks.workunit.client.1.smithi143.stdout:8/866: creat d9/de/d53/d75/daf/d10b/f137 x:0 0 0 2024-09-17T01:07:09.118 INFO:tasks.workunit.client.1.smithi143.stdout:3/839: dwrite d6/d1c/d82/fcc [0,4194304] 0 2024-09-17T01:07:09.118 INFO:tasks.workunit.client.1.smithi143.stdout:4/866: write da/d3a/d3e/d72/dfa/f106 [509095,44211] 0 2024-09-17T01:07:09.120 INFO:tasks.workunit.client.1.smithi143.stdout:5/819: unlink d1/d46/df/le4 0 2024-09-17T01:07:09.124 INFO:tasks.workunit.client.1.smithi143.stdout:6/766: dwrite d2/d19/f8a [4194304,4194304] 0 2024-09-17T01:07:09.126 INFO:tasks.workunit.client.1.smithi143.stdout:8/867: fsync d9/d26/f36 0 2024-09-17T01:07:09.126 INFO:tasks.workunit.client.1.smithi143.stdout:9/813: creat d3/d39/d104/f10f x:0 0 0 2024-09-17T01:07:09.126 INFO:tasks.workunit.client.1.smithi143.stdout:4/867: rmdir da/d3a/d3e/d72/da3 39 2024-09-17T01:07:09.126 INFO:tasks.workunit.client.1.smithi143.stdout:0/788: dwrite d3/d5/d8/d21/f47 [0,4194304] 0 2024-09-17T01:07:09.130 INFO:tasks.workunit.client.1.smithi143.stdout:4/868: dread - da/d3a/d40/d84/db6/fc9 zero size 2024-09-17T01:07:09.132 INFO:tasks.workunit.client.1.smithi143.stdout:6/767: write d2/d19/f73 [869609,55909] 0 2024-09-17T01:07:09.134 INFO:tasks.workunit.client.1.smithi143.stdout:5/820: getdents d1/d46/df/d1f/d66 0 2024-09-17T01:07:09.134 INFO:tasks.workunit.client.1.smithi143.stdout:6/768: dread - d2/d30/feb zero size 2024-09-17T01:07:09.136 INFO:tasks.workunit.client.1.smithi143.stdout:8/868: symlink d9/d12/d38/d58/dda/dea/l138 0 2024-09-17T01:07:09.139 INFO:tasks.workunit.client.1.smithi143.stdout:0/789: fdatasync d3/d5/d8/f13 0 2024-09-17T01:07:09.144 INFO:tasks.workunit.client.1.smithi143.stdout:6/769: unlink d2/d30/d45/d70/d87/d74/fdb 0 2024-09-17T01:07:09.144 INFO:tasks.workunit.client.1.smithi143.stdout:5/821: truncate d1/d46/df/d53/f81 266033 0 2024-09-17T01:07:09.146 INFO:tasks.workunit.client.1.smithi143.stdout:8/869: dwrite d9/d12/d13/fed [0,4194304] 0 2024-09-17T01:07:09.146 INFO:tasks.workunit.client.1.smithi143.stdout:4/869: write da/f20 [4319730,31912] 0 2024-09-17T01:07:09.147 INFO:tasks.workunit.client.1.smithi143.stdout:6/770: creat d2/d19/f101 x:0 0 0 2024-09-17T01:07:09.151 INFO:tasks.workunit.client.1.smithi143.stdout:0/790: rename d3/d68/d8f/lc3 to d3/d5/l101 0 2024-09-17T01:07:09.152 INFO:tasks.workunit.client.1.smithi143.stdout:9/814: dwrite d3/d39/d42/d80/df3/d99/f5b [0,4194304] 0 2024-09-17T01:07:09.153 INFO:tasks.workunit.client.1.smithi143.stdout:6/771: creat d2/d30/d45/f102 x:0 0 0 2024-09-17T01:07:09.154 INFO:tasks.workunit.client.1.smithi143.stdout:8/870: mknod d9/d12/d38/d58/d79/d9b/d12b/c139 0 2024-09-17T01:07:09.156 INFO:tasks.workunit.client.1.smithi143.stdout:0/791: fsync d3/d68/d75/fb1 0 2024-09-17T01:07:09.159 INFO:tasks.workunit.client.1.smithi143.stdout:5/822: dwrite d1/d5e/f10c [0,4194304] 0 2024-09-17T01:07:09.160 INFO:tasks.workunit.client.1.smithi143.stdout:4/870: getdents da/d3a/d40 0 2024-09-17T01:07:09.163 INFO:tasks.workunit.client.1.smithi143.stdout:2/785: sync 2024-09-17T01:07:09.164 INFO:tasks.workunit.client.1.smithi143.stdout:8/871: mknod d9/d12/d38/d58/d79/d9b/d12b/c13a 0 2024-09-17T01:07:09.165 INFO:tasks.workunit.client.1.smithi143.stdout:0/792: rename d3/d68/f78 to d3/d5/d8/d10/f102 0 2024-09-17T01:07:09.169 INFO:tasks.workunit.client.1.smithi143.stdout:5/823: chown d1/d5e/c109 4834735 1 2024-09-17T01:07:09.169 INFO:tasks.workunit.client.1.smithi143.stdout:4/871: creat da/d3a/d40/daa/f120 x:0 0 0 2024-09-17T01:07:09.169 INFO:tasks.workunit.client.1.smithi143.stdout:6/772: dwrite d2/fb [0,4194304] 0 2024-09-17T01:07:09.169 INFO:tasks.workunit.client.1.smithi143.stdout:8/872: mknod d9/d12/d13/d73/c13b 0 2024-09-17T01:07:09.169 INFO:tasks.workunit.client.1.smithi143.stdout:0/793: dread - d3/f40 zero size 2024-09-17T01:07:09.171 INFO:tasks.workunit.client.1.smithi143.stdout:2/786: write d0/d10/d58/d5a/d5b/d4c/d71/dc5/ffa [762144,29365] 0 2024-09-17T01:07:09.173 INFO:tasks.workunit.client.1.smithi143.stdout:6/773: read - d2/df/d20/d2c/d38/fde zero size 2024-09-17T01:07:09.173 INFO:tasks.workunit.client.1.smithi143.stdout:3/840: truncate d6/d1c/d33/d3f/fbc 31383 0 2024-09-17T01:07:09.176 INFO:tasks.workunit.client.1.smithi143.stdout:2/787: write d0/d10/f47 [4120660,102091] 0 2024-09-17T01:07:09.177 INFO:tasks.workunit.client.1.smithi143.stdout:6/774: write d2/d17/d6e/d26/d46/f4b [5867411,127067] 0 2024-09-17T01:07:09.178 INFO:tasks.workunit.client.1.smithi143.stdout:0/794: chown d3/d5/d8/d27/d31/d85/c9f 1 1 2024-09-17T01:07:09.184 INFO:tasks.workunit.client.1.smithi143.stdout:2/788: mkdir d0/d2/d105 0 2024-09-17T01:07:09.185 INFO:tasks.workunit.client.1.smithi143.stdout:8/873: link d9/de/d53/d75/dfa/d66/f12f d9/d12/d38/d58/d79/d9b/f13c 0 2024-09-17T01:07:09.186 INFO:tasks.workunit.client.1.smithi143.stdout:3/841: truncate d6/d1c/d33/d41/d2e/f87 1782044 0 2024-09-17T01:07:09.187 INFO:tasks.workunit.client.1.smithi143.stdout:2/789: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d99/d106 0 2024-09-17T01:07:09.188 INFO:tasks.workunit.client.1.smithi143.stdout:8/874: creat d9/d12/d38/d58/dda/dea/f13d x:0 0 0 2024-09-17T01:07:09.190 INFO:tasks.workunit.client.1.smithi143.stdout:8/875: symlink d9/l13e 0 2024-09-17T01:07:09.191 INFO:tasks.workunit.client.1.smithi143.stdout:3/842: truncate d6/d1c/d33/d3f/f48 626287 0 2024-09-17T01:07:09.191 INFO:tasks.workunit.client.1.smithi143.stdout:2/790: mkdir d0/d10/d58/d5a/d5b/d4c/d71/dd2/d107 0 2024-09-17T01:07:09.193 INFO:tasks.workunit.client.1.smithi143.stdout:3/843: unlink d6/d1c/d82/dfe/f8b 0 2024-09-17T01:07:09.194 INFO:tasks.workunit.client.1.smithi143.stdout:2/791: creat d0/d44/dd6/f108 x:0 0 0 2024-09-17T01:07:09.195 INFO:tasks.workunit.client.1.smithi143.stdout:9/815: write d3/d39/d42/dab/d108/f4d [651910,94092] 0 2024-09-17T01:07:09.198 INFO:tasks.workunit.client.1.smithi143.stdout:1/882: sync 2024-09-17T01:07:09.198 INFO:tasks.workunit.client.1.smithi143.stdout:3/844: creat d6/d1c/d33/d41/d2b/f100 x:0 0 0 2024-09-17T01:07:09.203 INFO:tasks.workunit.client.1.smithi143.stdout:8/876: dwrite d9/d23/d32/d11f/f131 [0,4194304] 0 2024-09-17T01:07:09.204 INFO:tasks.workunit.client.1.smithi143.stdout:6/775: truncate d2/d30/d45/d70/fef 2769625 0 2024-09-17T01:07:09.206 INFO:tasks.workunit.client.1.smithi143.stdout:2/792: unlink d0/d10/d58/d5a/d5b/d4c/d71/d9d/ld9 0 2024-09-17T01:07:09.209 INFO:tasks.workunit.client.1.smithi143.stdout:3/845: fdatasync d6/d1c/d33/d3f/fbf 0 2024-09-17T01:07:09.213 INFO:tasks.workunit.client.1.smithi143.stdout:1/883: truncate d0/d6/d43/d6a/d52/db2/fe9 976882 0 2024-09-17T01:07:09.216 INFO:tasks.workunit.client.1.smithi143.stdout:5/824: dwrite d1/f68 [0,4194304] 0 2024-09-17T01:07:09.218 INFO:tasks.workunit.client.1.smithi143.stdout:4/872: dwrite da/d3a/f3b [0,4194304] 0 2024-09-17T01:07:09.219 INFO:tasks.workunit.client.1.smithi143.stdout:0/795: dread d3/d5/d8/d27/d31/d48/d62/fca [0,4194304] 0 2024-09-17T01:07:09.223 INFO:tasks.workunit.client.1.smithi143.stdout:8/877: mkdir d9/d12/d38/d58/d79/d13f 0 2024-09-17T01:07:09.229 INFO:tasks.workunit.client.1.smithi143.stdout:7/958: sync 2024-09-17T01:07:09.230 INFO:tasks.workunit.client.1.smithi143.stdout:6/776: dread - d2/d30/d45/d70/d87/d74/f86 zero size 2024-09-17T01:07:09.231 INFO:tasks.workunit.client.1.smithi143.stdout:9/816: dwrite d3/d39/d42/d80/df3/fb4 [0,4194304] 0 2024-09-17T01:07:09.232 INFO:tasks.workunit.client.0.smithi103.stdout:5/199: sync 2024-09-17T01:07:09.233 INFO:tasks.workunit.client.1.smithi143.stdout:3/846: mkdir d6/d1c/d33/d3f/d5c/da1/d101 0 2024-09-17T01:07:09.234 INFO:tasks.workunit.client.1.smithi143.stdout:5/825: symlink d1/d46/df/d53/d74/d9a/dd7/l12a 0 2024-09-17T01:07:09.236 INFO:tasks.workunit.client.1.smithi143.stdout:8/878: unlink d9/d12/c1b 0 2024-09-17T01:07:09.238 INFO:tasks.workunit.client.0.smithi103.stdout:5/200: rename d6/d11/d13 to d6/d2c/d38/d4c/d50 0 2024-09-17T01:07:09.238 INFO:tasks.workunit.client.1.smithi143.stdout:9/817: write d3/d81/ff5 [1951349,8044] 0 2024-09-17T01:07:09.239 INFO:tasks.workunit.client.1.smithi143.stdout:3/847: dread - d6/d1c/d33/f5e zero size 2024-09-17T01:07:09.239 INFO:tasks.workunit.client.1.smithi143.stdout:6/777: stat d2/d17/d6e/d26/dbd/f91 0 2024-09-17T01:07:09.239 INFO:tasks.workunit.client.0.smithi103.stdout:5/201: write d6/db/fd [5702525,89959] 0 2024-09-17T01:07:09.240 INFO:tasks.workunit.client.1.smithi143.stdout:0/796: mkdir d3/d68/d103 0 2024-09-17T01:07:09.241 INFO:tasks.workunit.client.1.smithi143.stdout:7/959: write d4/d1f/d4a/d66/d86/fa8 [186456,17607] 0 2024-09-17T01:07:09.241 INFO:tasks.workunit.client.0.smithi103.stdout:5/202: creat d6/d2c/f51 x:0 0 0 2024-09-17T01:07:09.243 INFO:tasks.workunit.client.0.smithi103.stdout:5/203: creat d6/d2c/f52 x:0 0 0 2024-09-17T01:07:09.243 INFO:tasks.workunit.client.1.smithi143.stdout:4/873: dwrite da/d3a/d40/daa/dc3/fd4 [0,4194304] 0 2024-09-17T01:07:09.245 INFO:tasks.workunit.client.1.smithi143.stdout:7/960: stat d4/d1f/d4a/d66 0 2024-09-17T01:07:09.245 INFO:tasks.workunit.client.0.smithi103.stdout:5/204: creat d6/d2c/d38/d4c/f53 x:0 0 0 2024-09-17T01:07:09.245 INFO:tasks.workunit.client.1.smithi143.stdout:9/818: fdatasync d3/d39/d6a/d9/f27 0 2024-09-17T01:07:09.246 INFO:tasks.workunit.client.1.smithi143.stdout:2/793: dwrite d0/d44/f46 [0,4194304] 0 2024-09-17T01:07:09.253 INFO:tasks.workunit.client.1.smithi143.stdout:2/794: chown d0/cc0 1080 1 2024-09-17T01:07:09.254 INFO:tasks.workunit.client.1.smithi143.stdout:7/961: chown d4/d1f/d4a/d66/db5/df3/d106/d107 1 1 2024-09-17T01:07:09.255 INFO:tasks.workunit.client.0.smithi103.stdout:8/284: sync 2024-09-17T01:07:09.255 INFO:tasks.workunit.client.0.smithi103.stdout:2/191: sync 2024-09-17T01:07:09.255 INFO:tasks.workunit.client.0.smithi103.stdout:6/182: sync 2024-09-17T01:07:09.255 INFO:tasks.workunit.client.0.smithi103.stdout:1/344: sync 2024-09-17T01:07:09.255 INFO:tasks.workunit.client.0.smithi103.stdout:3/326: sync 2024-09-17T01:07:09.255 INFO:tasks.workunit.client.0.smithi103.stdout:4/325: sync 2024-09-17T01:07:09.256 INFO:tasks.workunit.client.0.smithi103.stdout:7/289: sync 2024-09-17T01:07:09.256 INFO:tasks.workunit.client.0.smithi103.stdout:0/293: sync 2024-09-17T01:07:09.256 INFO:tasks.workunit.client.0.smithi103.stdout:9/288: sync 2024-09-17T01:07:09.258 INFO:tasks.workunit.client.0.smithi103.stdout:8/285: readlink d0/d6/dc/d30/d2d/d32/l37 0 2024-09-17T01:07:09.260 INFO:tasks.workunit.client.1.smithi143.stdout:8/879: dread d9/d23/d32/fbd [0,4194304] 0 2024-09-17T01:07:09.261 INFO:tasks.workunit.client.1.smithi143.stdout:5/826: dwrite d1/d46/df/d23/d4f/d82/da6/f117 [0,4194304] 0 2024-09-17T01:07:09.262 INFO:tasks.workunit.client.1.smithi143.stdout:2/795: mkdir d0/d2/d21/d22/d109 0 2024-09-17T01:07:09.264 INFO:tasks.workunit.client.1.smithi143.stdout:5/827: chown d1/d46/d9d 2 1 2024-09-17T01:07:09.267 INFO:tasks.workunit.client.1.smithi143.stdout:1/884: dread d0/d6/d43/f67 [0,4194304] 0 2024-09-17T01:07:09.267 INFO:tasks.workunit.client.1.smithi143.stdout:4/874: dwrite da/d75/f7b [0,4194304] 0 2024-09-17T01:07:09.268 INFO:tasks.workunit.client.1.smithi143.stdout:6/778: dread d2/d30/d45/d70/f78 [0,4194304] 0 2024-09-17T01:07:09.268 INFO:tasks.workunit.client.1.smithi143.stdout:2/796: truncate d0/d44/f61 4504932 0 2024-09-17T01:07:09.276 INFO:tasks.workunit.client.1.smithi143.stdout:3/848: getdents d6/d1c/d33/d41/d2e 0 2024-09-17T01:07:09.277 INFO:tasks.workunit.client.1.smithi143.stdout:7/962: symlink d4/d1f/d4a/dc1/d12f/l132 0 2024-09-17T01:07:09.278 INFO:tasks.workunit.client.1.smithi143.stdout:4/875: dread - da/d3a/d40/df0/f101 zero size 2024-09-17T01:07:09.278 INFO:tasks.workunit.client.1.smithi143.stdout:1/885: chown d0/d6/d43/d6a/d107/l87 2 1 2024-09-17T01:07:09.278 INFO:tasks.workunit.client.1.smithi143.stdout:6/779: mknod d2/d19/c103 0 2024-09-17T01:07:09.287 INFO:tasks.workunit.client.1.smithi143.stdout:0/797: dwrite d3/d5/d8/d27/d31/d4c/f79 [0,4194304] 0 2024-09-17T01:07:09.288 INFO:tasks.workunit.client.1.smithi143.stdout:3/849: dwrite d6/d1c/d33/d41/f16 [8388608,4194304] 0 2024-09-17T01:07:09.301 INFO:tasks.workunit.client.1.smithi143.stdout:7/963: stat d4/d1f/d4a/de4/d78/f110 0 2024-09-17T01:07:09.307 INFO:tasks.workunit.client.1.smithi143.stdout:5/828: link d1/d46/df/d23/d4f/d7d/c97 d1/d96/c12b 0 2024-09-17T01:07:09.308 INFO:tasks.workunit.client.1.smithi143.stdout:4/876: creat da/d3a/d3e/d72/f121 x:0 0 0 2024-09-17T01:07:09.308 INFO:tasks.workunit.client.1.smithi143.stdout:9/819: dread d3/d39/f4f [0,4194304] 0 2024-09-17T01:07:09.309 INFO:tasks.workunit.client.1.smithi143.stdout:2/797: dread d0/d2/d21/d84/d8d/fb1 [0,4194304] 0 2024-09-17T01:07:09.311 INFO:tasks.workunit.client.1.smithi143.stdout:8/880: dread d9/d12/df4/fa2 [0,4194304] 0 2024-09-17T01:07:09.311 INFO:tasks.workunit.client.1.smithi143.stdout:2/798: fsync d0/d10/f47 0 2024-09-17T01:07:09.311 INFO:tasks.workunit.client.1.smithi143.stdout:9/820: rmdir d3/d39/d6a/df6 39 2024-09-17T01:07:09.318 INFO:tasks.workunit.client.1.smithi143.stdout:2/799: truncate d0/d10/d58/d5a/d5b/d4c/fb3 717149 0 2024-09-17T01:07:09.318 INFO:tasks.workunit.client.1.smithi143.stdout:0/798: dread d3/d5/f41 [0,4194304] 0 2024-09-17T01:07:09.321 INFO:tasks.workunit.client.1.smithi143.stdout:0/799: unlink d3/d5/d8/d27/d31/d85/fa4 0 2024-09-17T01:07:09.322 INFO:tasks.workunit.client.1.smithi143.stdout:0/800: stat d3/d5/d8/d27/d31/d4c/d65/ff4 0 2024-09-17T01:07:09.324 INFO:tasks.workunit.client.1.smithi143.stdout:2/800: getdents d0/d2/d21 0 2024-09-17T01:07:09.327 INFO:tasks.workunit.client.1.smithi143.stdout:0/801: creat d3/d5/d8/d27/d31/d48/d72/df3/f104 x:0 0 0 2024-09-17T01:07:09.328 INFO:tasks.workunit.client.1.smithi143.stdout:1/886: dread d0/dc/d57/f5d [0,4194304] 0 2024-09-17T01:07:09.329 INFO:tasks.workunit.client.1.smithi143.stdout:1/887: readlink d0/dc/l10 0 2024-09-17T01:07:09.329 INFO:tasks.workunit.client.1.smithi143.stdout:1/888: chown d0/dc/f2c 862 1 2024-09-17T01:07:09.330 INFO:tasks.workunit.client.0.smithi103.stdout:7/290: creat d4/d11/d3f/f68 x:0 0 0 2024-09-17T01:07:09.332 INFO:tasks.workunit.client.0.smithi103.stdout:0/294: creat dd/f67 x:0 0 0 2024-09-17T01:07:09.332 INFO:tasks.workunit.client.1.smithi143.stdout:1/889: creat d0/d6/d43/d47/dd8/f127 x:0 0 0 2024-09-17T01:07:09.333 INFO:tasks.workunit.client.1.smithi143.stdout:0/802: dread d3/f5f [0,4194304] 0 2024-09-17T01:07:09.334 INFO:tasks.workunit.client.0.smithi103.stdout:7/291: chown d4/d11/d2b 960538575 1 2024-09-17T01:07:09.335 INFO:tasks.workunit.client.0.smithi103.stdout:5/205: rmdir d6/d2c 39 2024-09-17T01:07:09.335 INFO:tasks.workunit.client.1.smithi143.stdout:7/964: truncate d4/f58 3695413 0 2024-09-17T01:07:09.335 INFO:tasks.workunit.client.1.smithi143.stdout:9/821: dread d3/d39/d6a/d9/f6b [0,4194304] 0 2024-09-17T01:07:09.336 INFO:tasks.workunit.client.1.smithi143.stdout:5/829: dread d1/d46/df/d23/d4f/f33 [0,4194304] 0 2024-09-17T01:07:09.337 INFO:tasks.workunit.client.0.smithi103.stdout:6/183: dwrite d3/d16/f2d [0,4194304] 0 2024-09-17T01:07:09.339 INFO:tasks.workunit.client.0.smithi103.stdout:5/206: fdatasync d6/d11/f1a 0 2024-09-17T01:07:09.339 INFO:tasks.workunit.client.1.smithi143.stdout:8/881: truncate d9/f11 2593392 0 2024-09-17T01:07:09.340 INFO:tasks.workunit.client.1.smithi143.stdout:9/822: dread - d3/d39/fa2 zero size 2024-09-17T01:07:09.340 INFO:tasks.workunit.client.0.smithi103.stdout:9/289: dwrite d7/d43/d48/d11/d21/f5b [0,4194304] 0 2024-09-17T01:07:09.340 INFO:tasks.workunit.client.0.smithi103.stdout:7/292: dread d4/d10/f2c [4194304,4194304] 0 2024-09-17T01:07:09.341 INFO:tasks.workunit.client.1.smithi143.stdout:6/780: dwrite d2/d30/f57 [0,4194304] 0 2024-09-17T01:07:09.341 INFO:tasks.workunit.client.1.smithi143.stdout:5/830: chown d1/d46/df/d1f/d9f 46300 1 2024-09-17T01:07:09.342 INFO:tasks.workunit.client.0.smithi103.stdout:4/326: mkdir d9/d16/d23/d2b/d47/d58 0 2024-09-17T01:07:09.343 INFO:tasks.workunit.client.0.smithi103.stdout:4/327: chown d9/d16/d23/l4e 43 1 2024-09-17T01:07:09.344 INFO:tasks.workunit.client.0.smithi103.stdout:4/328: readlink d9/d10/l17 0 2024-09-17T01:07:09.344 INFO:tasks.workunit.client.1.smithi143.stdout:2/801: write d0/d10/d58/d5a/d5b/d4c/d71/d9d/fb4 [241100,46061] 0 2024-09-17T01:07:09.345 INFO:tasks.workunit.client.0.smithi103.stdout:4/329: truncate d9/f3d 987016 0 2024-09-17T01:07:09.350 INFO:tasks.workunit.client.1.smithi143.stdout:3/850: dwrite d6/d1c/d33/d41/d2e/d30/fb6 [0,4194304] 0 2024-09-17T01:07:09.350 INFO:tasks.workunit.client.1.smithi143.stdout:1/890: creat d0/d6/d43/d47/dbf/deb/df9/f128 x:0 0 0 2024-09-17T01:07:09.353 INFO:tasks.workunit.client.0.smithi103.stdout:8/286: mknod d0/d6/dc/d30/d2d/c56 0 2024-09-17T01:07:09.353 INFO:tasks.workunit.client.0.smithi103.stdout:8/287: dread - d0/f4e zero size 2024-09-17T01:07:09.354 INFO:tasks.workunit.client.1.smithi143.stdout:3/851: chown d6/d1c/d33/d41/d2e/d30/fb6 600894 1 2024-09-17T01:07:09.359 INFO:tasks.workunit.client.0.smithi103.stdout:6/184: unlink d3/d16/c1c 0 2024-09-17T01:07:09.360 INFO:tasks.workunit.client.1.smithi143.stdout:8/882: dwrite d9/d12/df4/f6e [0,4194304] 0 2024-09-17T01:07:09.362 INFO:tasks.workunit.client.0.smithi103.stdout:9/290: truncate d7/d43/d48/f50 259276 0 2024-09-17T01:07:09.362 INFO:tasks.workunit.client.1.smithi143.stdout:7/965: creat d4/d1f/d4a/d66/db5/df3/f133 x:0 0 0 2024-09-17T01:07:09.363 INFO:tasks.workunit.client.1.smithi143.stdout:9/823: unlink d3/d39/d42/d58/d5a/f62 0 2024-09-17T01:07:09.364 INFO:tasks.workunit.client.0.smithi103.stdout:5/207: dwrite d6/d2c/f51 [0,4194304] 0 2024-09-17T01:07:09.364 INFO:tasks.workunit.client.1.smithi143.stdout:9/824: write d3/d39/d6a/d9/f27 [832288,1492] 0 2024-09-17T01:07:09.365 INFO:tasks.workunit.client.0.smithi103.stdout:5/208: stat d6/d28/c3f 0 2024-09-17T01:07:09.366 INFO:tasks.workunit.client.1.smithi143.stdout:1/891: mknod d0/d6/d43/d47/dd8/c129 0 2024-09-17T01:07:09.367 INFO:tasks.workunit.client.0.smithi103.stdout:5/209: write f0 [125466,40398] 0 2024-09-17T01:07:09.367 INFO:tasks.workunit.client.0.smithi103.stdout:1/345: link d2/l5 d2/d1c/d28/d4b/d67/l6f 0 2024-09-17T01:07:09.368 INFO:tasks.workunit.client.1.smithi143.stdout:3/852: mkdir d6/d1c/d82/de4/d102 0 2024-09-17T01:07:09.373 INFO:tasks.workunit.client.1.smithi143.stdout:3/853: write d6/d1c/d33/d41/d2e/d30/f32 [4666980,46578] 0 2024-09-17T01:07:09.373 INFO:tasks.workunit.client.0.smithi103.stdout:8/288: symlink d0/d6/dc/d30/l57 0 2024-09-17T01:07:09.374 INFO:tasks.workunit.client.0.smithi103.stdout:8/289: read - d0/f4e zero size 2024-09-17T01:07:09.374 INFO:tasks.workunit.client.0.smithi103.stdout:8/290: truncate d0/f4e 569586 0 2024-09-17T01:07:09.374 INFO:tasks.workunit.client.0.smithi103.stdout:6/185: mknod d3/d17/c3f 0 2024-09-17T01:07:09.374 INFO:tasks.workunit.client.0.smithi103.stdout:8/291: fsync d0/d6/f10 0 2024-09-17T01:07:09.374 INFO:tasks.workunit.client.1.smithi143.stdout:8/883: unlink d9/d12/d13/c135 0 2024-09-17T01:07:09.375 INFO:tasks.workunit.client.1.smithi143.stdout:6/781: creat d2/d17/d6e/d26/d79/dec/f104 x:0 0 0 2024-09-17T01:07:09.376 INFO:tasks.workunit.client.0.smithi103.stdout:9/291: creat d7/d43/f63 x:0 0 0 2024-09-17T01:07:09.376 INFO:tasks.workunit.client.1.smithi143.stdout:8/884: chown d9/d23/db4/d55/d57/d9d/lcb 1880716 1 2024-09-17T01:07:09.376 INFO:tasks.workunit.client.1.smithi143.stdout:7/966: symlink d4/d1f/d4a/ddb/de7/l134 0 2024-09-17T01:07:09.377 INFO:tasks.workunit.client.0.smithi103.stdout:9/292: read d7/fc [6095898,27790] 0 2024-09-17T01:07:09.380 INFO:tasks.workunit.client.0.smithi103.stdout:2/192: getdents d6/da/d17/d1a/df 0 2024-09-17T01:07:09.383 INFO:tasks.workunit.client.1.smithi143.stdout:7/967: dwrite d4/d1f/d4a/d66/db5/df3/f133 [0,4194304] 0 2024-09-17T01:07:09.383 INFO:tasks.workunit.client.0.smithi103.stdout:5/210: unlink d6/d2c/d38/d4c/d50/c25 0 2024-09-17T01:07:09.384 INFO:tasks.workunit.client.1.smithi143.stdout:7/968: fsync d4/d16/f1a 0 2024-09-17T01:07:09.384 INFO:tasks.workunit.client.1.smithi143.stdout:7/969: chown d4/le 9932936 1 2024-09-17T01:07:09.385 INFO:tasks.workunit.client.1.smithi143.stdout:6/782: rmdir d2/d17/d6e/dad 39 2024-09-17T01:07:09.387 INFO:tasks.workunit.client.0.smithi103.stdout:6/186: unlink d3/d16/d33/f35 0 2024-09-17T01:07:09.388 INFO:tasks.workunit.client.1.smithi143.stdout:8/885: mknod d9/d12/d13/d73/dee/c140 0 2024-09-17T01:07:09.390 INFO:tasks.workunit.client.1.smithi143.stdout:2/802: rename d0/d10/d58/d5a/cf7 to d0/c10a 0 2024-09-17T01:07:09.391 INFO:tasks.workunit.client.1.smithi143.stdout:2/803: stat d0/d2/d21/d22/f2f 0 2024-09-17T01:07:09.391 INFO:tasks.workunit.client.0.smithi103.stdout:4/330: link d9/d16/d23/d2b/l3e d9/d16/d23/d32/d4c/l59 0 2024-09-17T01:07:09.392 INFO:tasks.workunit.client.0.smithi103.stdout:4/331: fdatasync d9/d16/f12 0 2024-09-17T01:07:09.394 INFO:tasks.workunit.client.0.smithi103.stdout:9/293: mknod d7/d43/d48/d11/c64 0 2024-09-17T01:07:09.396 INFO:tasks.workunit.client.0.smithi103.stdout:1/346: mkdir d2/d70 0 2024-09-17T01:07:09.397 INFO:tasks.workunit.client.0.smithi103.stdout:4/332: dread d9/d16/d23/f46 [0,4194304] 0 2024-09-17T01:07:09.397 INFO:tasks.workunit.client.1.smithi143.stdout:5/831: link d1/d46/d6e/c87 d1/d46/df/d23/d4f/d7d/d102/d115/c12c 0 2024-09-17T01:07:09.397 INFO:tasks.workunit.client.0.smithi103.stdout:1/347: truncate d2/d1c/f1e 9154248 0 2024-09-17T01:07:09.400 INFO:tasks.workunit.client.1.smithi143.stdout:7/970: symlink d4/d1f/d4a/d9e/da2/l135 0 2024-09-17T01:07:09.401 INFO:tasks.workunit.client.0.smithi103.stdout:4/333: dread d9/dc/df/f2c [0,4194304] 0 2024-09-17T01:07:09.401 INFO:tasks.workunit.client.0.smithi103.stdout:4/334: read d9/f3a [2553224,79445] 0 2024-09-17T01:07:09.402 INFO:tasks.workunit.client.1.smithi143.stdout:2/804: stat d0/l76 0 2024-09-17T01:07:09.406 INFO:tasks.workunit.client.1.smithi143.stdout:8/886: read d9/d23/db4/d55/d57/fbb [1797691,38618] 0 2024-09-17T01:07:09.406 INFO:tasks.workunit.client.1.smithi143.stdout:0/803: write d3/d5/d8/d21/f3e [4350607,90227] 0 2024-09-17T01:07:09.409 INFO:tasks.workunit.client.1.smithi143.stdout:5/832: mknod d1/d46/df/d23/d4f/d7d/d102/c12d 0 2024-09-17T01:07:09.410 INFO:tasks.workunit.client.0.smithi103.stdout:9/294: creat d7/d43/d48/d11/d5c/f65 x:0 0 0 2024-09-17T01:07:09.411 INFO:tasks.workunit.client.1.smithi143.stdout:2/805: dwrite d0/d44/d7a/d86/fa7 [0,4194304] 0 2024-09-17T01:07:09.411 INFO:tasks.workunit.client.1.smithi143.stdout:3/854: dread d6/d1c/d33/d3f/d5c/f91 [0,4194304] 0 2024-09-17T01:07:09.412 INFO:tasks.workunit.client.0.smithi103.stdout:2/193: creat d6/da/d3f/f40 x:0 0 0 2024-09-17T01:07:09.413 INFO:tasks.workunit.client.0.smithi103.stdout:2/194: stat d6/da/d24/l37 0 2024-09-17T01:07:09.416 INFO:tasks.workunit.client.0.smithi103.stdout:0/295: truncate dd/f4d 3586797 0 2024-09-17T01:07:09.417 INFO:tasks.workunit.client.0.smithi103.stdout:6/187: dread d3/f4 [0,4194304] 0 2024-09-17T01:07:09.417 INFO:tasks.workunit.client.0.smithi103.stdout:0/296: dread - dd/df/d38/f49 zero size 2024-09-17T01:07:09.419 INFO:tasks.workunit.client.1.smithi143.stdout:3/855: dwrite d6/d1c/d33/fe9 [0,4194304] 0 2024-09-17T01:07:09.419 INFO:tasks.workunit.client.0.smithi103.stdout:6/188: read d3/f36 [477600,115640] 0 2024-09-17T01:07:09.421 INFO:tasks.workunit.client.1.smithi143.stdout:9/825: link d3/d39/d6a/dc3/c18 d3/d39/d42/d80/df3/c110 0 2024-09-17T01:07:09.423 INFO:tasks.workunit.client.0.smithi103.stdout:4/335: creat d9/d16/d45/f5a x:0 0 0 2024-09-17T01:07:09.424 INFO:tasks.workunit.client.1.smithi143.stdout:4/877: sync 2024-09-17T01:07:09.425 INFO:tasks.workunit.client.0.smithi103.stdout:4/336: truncate d9/d16/d44/f4f 758272 0 2024-09-17T01:07:09.426 INFO:tasks.workunit.client.1.smithi143.stdout:4/878: chown da/d3a/d3e/d72/dfa 159494835 1 2024-09-17T01:07:09.426 INFO:tasks.workunit.client.0.smithi103.stdout:4/337: stat d9/d16/d23/d52 0 2024-09-17T01:07:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:09 smithi103 ceph-mon[28156]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 56 MiB/s rd, 187 MiB/s wr, 350 op/s 2024-09-17T01:07:09.427 INFO:tasks.workunit.client.1.smithi143.stdout:8/887: symlink d9/d12/d38/d58/dda/l141 0 2024-09-17T01:07:09.430 INFO:tasks.workunit.client.1.smithi143.stdout:5/833: mkdir d1/d96/d12e 0 2024-09-17T01:07:09.430 INFO:tasks.workunit.client.0.smithi103.stdout:1/348: dread d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:09.434 INFO:tasks.workunit.client.1.smithi143.stdout:1/892: dwrite d0/d6/f1f [0,4194304] 0 2024-09-17T01:07:09.435 INFO:tasks.workunit.client.0.smithi103.stdout:0/297: mkdir dd/df/d68 0 2024-09-17T01:07:09.439 INFO:tasks.workunit.client.0.smithi103.stdout:6/189: symlink d3/d16/d21/l40 0 2024-09-17T01:07:09.440 INFO:tasks.workunit.client.0.smithi103.stdout:8/292: getdents d0/d6/dc/d3d 0 2024-09-17T01:07:09.443 INFO:tasks.workunit.client.1.smithi143.stdout:1/893: dwrite d0/d6/d43/d47/dd8/ff5 [0,4194304] 0 2024-09-17T01:07:09.444 INFO:tasks.workunit.client.1.smithi143.stdout:1/894: read - d0/d6/d43/d47/dbf/f11d zero size 2024-09-17T01:07:09.444 INFO:tasks.workunit.client.1.smithi143.stdout:8/888: mkdir d9/de/d53/d75/daf/d10b/d142 0 2024-09-17T01:07:09.445 INFO:tasks.workunit.client.1.smithi143.stdout:6/783: write d2/d17/f97 [341977,3505] 0 2024-09-17T01:07:09.445 INFO:tasks.workunit.client.0.smithi103.stdout:2/195: mknod d6/da/d17/c41 0 2024-09-17T01:07:09.446 INFO:tasks.workunit.client.1.smithi143.stdout:8/889: chown d9/d12/d38/dba 0 1 2024-09-17T01:07:09.449 INFO:tasks.workunit.client.1.smithi143.stdout:2/806: mkdir d0/d10/d58/d5a/d5b/d4c/d71/dd2/d107/d10b 0 2024-09-17T01:07:09.452 INFO:tasks.workunit.client.0.smithi103.stdout:5/211: getdents d6 0 2024-09-17T01:07:09.453 INFO:tasks.workunit.client.1.smithi143.stdout:8/890: dwrite d9/d23/db4/d55/dfe/f81 [0,4194304] 0 2024-09-17T01:07:09.454 INFO:tasks.workunit.client.0.smithi103.stdout:2/196: dwrite d6/da/d17/f29 [0,4194304] 0 2024-09-17T01:07:09.457 INFO:tasks.workunit.client.1.smithi143.stdout:3/856: link d6/d1c/d33/d41/d2b/fd4 d6/d1c/d82/db1/f103 0 2024-09-17T01:07:09.458 INFO:tasks.workunit.client.0.smithi103.stdout:9/295: dread d7/d43/d48/f2f [0,4194304] 0 2024-09-17T01:07:09.461 INFO:tasks.workunit.client.1.smithi143.stdout:0/804: mkdir d3/d5/d105 0 2024-09-17T01:07:09.464 INFO:tasks.workunit.client.0.smithi103.stdout:1/349: creat d2/d16/d51/d65/f71 x:0 0 0 2024-09-17T01:07:09.465 INFO:tasks.workunit.client.0.smithi103.stdout:1/350: fsync d2/d1c/d54/f46 0 2024-09-17T01:07:09.465 INFO:tasks.workunit.client.0.smithi103.stdout:1/351: dread - d2/de/f58 zero size 2024-09-17T01:07:09.467 INFO:tasks.workunit.client.0.smithi103.stdout:1/352: write d2/d1c/d28/d4b/f66 [645811,40732] 0 2024-09-17T01:07:09.468 INFO:tasks.workunit.client.0.smithi103.stdout:6/190: creat d3/d16/d33/d3e/f41 x:0 0 0 2024-09-17T01:07:09.471 INFO:tasks.workunit.client.0.smithi103.stdout:5/212: mkdir d6/d2c/d38/d4c/d54 0 2024-09-17T01:07:09.471 INFO:tasks.workunit.client.1.smithi143.stdout:7/971: dwrite d4/d1f/d29/d65/d5d/db1/dc6/dfa/f108 [0,4194304] 0 2024-09-17T01:07:09.472 INFO:tasks.workunit.client.1.smithi143.stdout:5/834: mkdir d1/d46/df/d12f 0 2024-09-17T01:07:09.474 INFO:tasks.workunit.client.0.smithi103.stdout:5/213: dread d6/d11/f1d [0,4194304] 0 2024-09-17T01:07:09.475 INFO:tasks.workunit.client.1.smithi143.stdout:2/807: mknod d0/d44/dd6/c10c 0 2024-09-17T01:07:09.475 INFO:tasks.workunit.client.0.smithi103.stdout:4/338: getdents d9/d16/d23/d32 0 2024-09-17T01:07:09.480 INFO:tasks.workunit.client.1.smithi143.stdout:8/891: rename d9/de/d53/d75/daf to d9/d12/d38/d58/d79/d112/d143 0 2024-09-17T01:07:09.480 INFO:tasks.workunit.client.1.smithi143.stdout:8/892: stat d9/d23/l10a 0 2024-09-17T01:07:09.483 INFO:tasks.workunit.client.0.smithi103.stdout:5/214: dwrite d6/d2c/d38/d4c/f53 [0,4194304] 0 2024-09-17T01:07:09.484 INFO:tasks.workunit.client.0.smithi103.stdout:6/191: fsync d3/f36 0 2024-09-17T01:07:09.486 INFO:tasks.workunit.client.0.smithi103.stdout:6/192: read d3/f9 [57119,25549] 0 2024-09-17T01:07:09.486 INFO:tasks.workunit.client.1.smithi143.stdout:9/826: creat d3/f111 x:0 0 0 2024-09-17T01:07:09.487 INFO:tasks.workunit.client.1.smithi143.stdout:3/857: dwrite d6/d1c/d4b/f67 [4194304,4194304] 0 2024-09-17T01:07:09.491 INFO:tasks.workunit.client.1.smithi143.stdout:4/879: creat da/d3a/f122 x:0 0 0 2024-09-17T01:07:09.492 INFO:tasks.workunit.client.0.smithi103.stdout:2/197: mkdir d6/da/d17/d42 0 2024-09-17T01:07:09.493 INFO:tasks.workunit.client.0.smithi103.stdout:0/298: read dd/df/f26 [3185252,89725] 0 2024-09-17T01:07:09.498 INFO:tasks.workunit.client.1.smithi143.stdout:7/972: symlink d4/d1f/d4a/d9e/dd1/l136 0 2024-09-17T01:07:09.499 INFO:tasks.workunit.client.0.smithi103.stdout:9/296: creat d7/d2d/d59/f66 x:0 0 0 2024-09-17T01:07:09.500 INFO:tasks.workunit.client.1.smithi143.stdout:5/835: mknod d1/d46/df/d1f/d7a/c130 0 2024-09-17T01:07:09.502 INFO:tasks.workunit.client.0.smithi103.stdout:5/215: mkdir d6/d2c/d32/d55 0 2024-09-17T01:07:09.503 INFO:tasks.workunit.client.1.smithi143.stdout:2/808: rename d0/d44/d6a/fab to d0/d2/d21/d22/f10d 0 2024-09-17T01:07:09.504 INFO:tasks.workunit.client.1.smithi143.stdout:7/973: dwrite d4/d1f/d29/f71 [0,4194304] 0 2024-09-17T01:07:09.504 INFO:tasks.workunit.client.1.smithi143.stdout:8/893: dread - d9/d12/fdc zero size 2024-09-17T01:07:09.506 INFO:tasks.workunit.client.0.smithi103.stdout:1/353: link d2/d16/f30 d2/de/d1f/f72 0 2024-09-17T01:07:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:09 smithi143 ceph-mon[35452]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 56 MiB/s rd, 187 MiB/s wr, 350 op/s 2024-09-17T01:07:09.509 INFO:tasks.workunit.client.1.smithi143.stdout:8/894: dwrite d9/d12/d4b/f41 [0,4194304] 0 2024-09-17T01:07:09.510 INFO:tasks.workunit.client.0.smithi103.stdout:2/198: creat d6/da/d17/d1a/df/f43 x:0 0 0 2024-09-17T01:07:09.511 INFO:tasks.workunit.client.0.smithi103.stdout:0/299: readlink dd/df/d38/l5e 0 2024-09-17T01:07:09.514 INFO:tasks.workunit.client.1.smithi143.stdout:4/880: symlink da/d3a/d40/d84/db6/df2/l123 0 2024-09-17T01:07:09.514 INFO:tasks.workunit.client.0.smithi103.stdout:4/339: symlink d9/d16/d23/d52/l5b 0 2024-09-17T01:07:09.521 INFO:tasks.workunit.client.0.smithi103.stdout:9/297: rmdir d7/d2d 39 2024-09-17T01:07:09.531 INFO:tasks.workunit.client.1.smithi143.stdout:5/836: mknod d1/d46/df/d1f/d9f/d124/d126/c131 0 2024-09-17T01:07:09.531 INFO:tasks.workunit.client.0.smithi103.stdout:0/300: readlink dd/df/l12 0 2024-09-17T01:07:09.531 INFO:tasks.workunit.client.0.smithi103.stdout:0/301: fsync f6 0 2024-09-17T01:07:09.532 INFO:tasks.workunit.client.0.smithi103.stdout:0/302: chown dd/df/d38/d55/f59 35 1 2024-09-17T01:07:09.532 INFO:tasks.workunit.client.0.smithi103.stdout:0/303: chown dd/d1c/f1d 178810 1 2024-09-17T01:07:09.533 INFO:tasks.workunit.client.1.smithi143.stdout:8/895: creat d9/d23/d32/f144 x:0 0 0 2024-09-17T01:07:09.533 INFO:tasks.workunit.client.0.smithi103.stdout:4/340: creat d9/d16/d23/d2a/f5c x:0 0 0 2024-09-17T01:07:09.533 INFO:tasks.workunit.client.1.smithi143.stdout:3/858: write d6/d1c/d33/d41/d2e/f87 [2300570,82876] 0 2024-09-17T01:07:09.535 INFO:tasks.workunit.client.1.smithi143.stdout:0/805: dwrite d3/d5/d35/fc6 [0,4194304] 0 2024-09-17T01:07:09.535 INFO:tasks.workunit.client.0.smithi103.stdout:6/193: rename d3/d17/c3f to d3/d16/c42 0 2024-09-17T01:07:09.537 INFO:tasks.workunit.client.1.smithi143.stdout:4/881: stat da/d3a/d40/d84/dd0 0 2024-09-17T01:07:09.538 INFO:tasks.workunit.client.0.smithi103.stdout:9/298: mknod d7/d43/d48/d11/d20/c67 0 2024-09-17T01:07:09.538 INFO:tasks.workunit.client.1.smithi143.stdout:1/895: dwrite d0/dc/f82 [0,4194304] 0 2024-09-17T01:07:09.539 INFO:tasks.workunit.client.0.smithi103.stdout:1/354: truncate d2/de/d1f/f34 375550 0 2024-09-17T01:07:09.541 INFO:tasks.workunit.client.0.smithi103.stdout:1/355: stat d2/d1c/d28/d52/d69/f6c 0 2024-09-17T01:07:09.543 INFO:tasks.workunit.client.1.smithi143.stdout:6/784: dwrite d2/d17/d6e/d26/f3b [0,4194304] 0 2024-09-17T01:07:09.543 INFO:tasks.workunit.client.1.smithi143.stdout:7/974: write d4/d1f/d4a/de4/d78/f87 [671746,40433] 0 2024-09-17T01:07:09.546 INFO:tasks.workunit.client.0.smithi103.stdout:6/194: dwrite d3/d17/d2f/f3c [0,4194304] 0 2024-09-17T01:07:09.549 INFO:tasks.workunit.client.0.smithi103.stdout:4/341: mknod d9/d16/d44/c5d 0 2024-09-17T01:07:09.549 INFO:tasks.workunit.client.1.smithi143.stdout:5/837: chown d1/d46/df/d1f/d66/d70/de2/de3 26823 1 2024-09-17T01:07:09.549 INFO:tasks.workunit.client.0.smithi103.stdout:0/304: write dd/df/f13 [3184386,85508] 0 2024-09-17T01:07:09.550 INFO:tasks.workunit.client.1.smithi143.stdout:5/838: fsync d1/d96/fef 0 2024-09-17T01:07:09.551 INFO:tasks.workunit.client.0.smithi103.stdout:5/216: rename d6/db/c1f to d6/d2c/d32/d55/c56 0 2024-09-17T01:07:09.556 INFO:tasks.workunit.client.0.smithi103.stdout:1/356: mkdir d2/d7/d73 0 2024-09-17T01:07:09.557 INFO:tasks.workunit.client.1.smithi143.stdout:1/896: fdatasync d0/d6/d43/d6d/d8b/dd0/de2/f10a 0 2024-09-17T01:07:09.558 INFO:tasks.workunit.client.0.smithi103.stdout:2/199: creat d6/f44 x:0 0 0 2024-09-17T01:07:09.559 INFO:tasks.workunit.client.0.smithi103.stdout:1/357: write d2/d1c/d28/d4b/f66 [621081,90004] 0 2024-09-17T01:07:09.561 INFO:tasks.workunit.client.1.smithi143.stdout:9/827: link d3/d39/d6a/d9/l94 d3/d39/d6a/dc3/l112 0 2024-09-17T01:07:09.561 INFO:tasks.workunit.client.1.smithi143.stdout:7/975: fsync d4/d1f/d4a/d66/f6c 0 2024-09-17T01:07:09.562 INFO:tasks.workunit.client.1.smithi143.stdout:0/806: dread d3/d5/d8/d10/f4f [4194304,4194304] 0 2024-09-17T01:07:09.562 INFO:tasks.workunit.client.1.smithi143.stdout:6/785: mkdir d2/d17/d6e/d26/dbd/d105 0 2024-09-17T01:07:09.563 INFO:tasks.workunit.client.0.smithi103.stdout:4/342: mkdir d9/d16/d45/d5e 0 2024-09-17T01:07:09.564 INFO:tasks.workunit.client.1.smithi143.stdout:9/828: truncate d3/d39/d42/d80/df3/d99/f93 928663 0 2024-09-17T01:07:09.565 INFO:tasks.workunit.client.0.smithi103.stdout:0/305: unlink dd/l4b 0 2024-09-17T01:07:09.567 INFO:tasks.workunit.client.1.smithi143.stdout:5/839: mknod d1/d46/df/d23/d4f/d7d/d92/c132 0 2024-09-17T01:07:09.573 INFO:tasks.workunit.client.0.smithi103.stdout:9/299: rename d7/d43/d48/d11/f10 to d7/d2d/d59/f68 0 2024-09-17T01:07:09.574 INFO:tasks.workunit.client.0.smithi103.stdout:5/217: dwrite d6/d28/f39 [0,4194304] 0 2024-09-17T01:07:09.576 INFO:tasks.workunit.client.0.smithi103.stdout:5/218: chown d6/f1e 15719 1 2024-09-17T01:07:09.577 INFO:tasks.workunit.client.0.smithi103.stdout:5/219: read d6/d11/f1d [1821627,100557] 0 2024-09-17T01:07:09.579 INFO:tasks.workunit.client.1.smithi143.stdout:1/897: mknod d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/c12a 0 2024-09-17T01:07:09.580 INFO:tasks.workunit.client.1.smithi143.stdout:9/829: dread d3/d39/d6a/fc [0,4194304] 0 2024-09-17T01:07:09.582 INFO:tasks.workunit.client.1.smithi143.stdout:2/809: sync 2024-09-17T01:07:09.584 INFO:tasks.workunit.client.0.smithi103.stdout:6/195: dread f1 [0,4194304] 0 2024-09-17T01:07:09.585 INFO:tasks.workunit.client.0.smithi103.stdout:9/300: write d7/d43/d48/d11/d20/f44 [4707700,109684] 0 2024-09-17T01:07:09.586 INFO:tasks.workunit.client.0.smithi103.stdout:1/358: fsync d2/d1c/d28/d4b/f66 0 2024-09-17T01:07:09.586 INFO:tasks.workunit.client.1.smithi143.stdout:6/786: creat d2/d17/d3a/d47/f106 x:0 0 0 2024-09-17T01:07:09.587 INFO:tasks.workunit.client.1.smithi143.stdout:6/787: dread - d2/df/d20/d2c/d75/daf/fcb zero size 2024-09-17T01:07:09.588 INFO:tasks.workunit.client.1.smithi143.stdout:3/859: creat d6/d1c/d82/f104 x:0 0 0 2024-09-17T01:07:09.592 INFO:tasks.workunit.client.0.smithi103.stdout:6/196: creat d3/d16/d33/d3e/f43 x:0 0 0 2024-09-17T01:07:09.593 INFO:tasks.workunit.client.1.smithi143.stdout:6/788: dwrite d2/df/d20/d2c/d38/f39 [0,4194304] 0 2024-09-17T01:07:09.594 INFO:tasks.workunit.client.1.smithi143.stdout:6/789: fsync d2/df/d20/d2c/d38/fde 0 2024-09-17T01:07:09.595 INFO:tasks.workunit.client.0.smithi103.stdout:1/359: readlink d2/d1c/d28/l49 0 2024-09-17T01:07:09.597 INFO:tasks.workunit.client.1.smithi143.stdout:6/790: truncate d2/d30/db4/dbc/fd1 615839 0 2024-09-17T01:07:09.597 INFO:tasks.workunit.client.1.smithi143.stdout:4/882: truncate da/d3a/f79 2051654 0 2024-09-17T01:07:09.598 INFO:tasks.workunit.client.0.smithi103.stdout:1/360: chown d2/de/d1f/f3b 9949 1 2024-09-17T01:07:09.598 INFO:tasks.workunit.client.0.smithi103.stdout:9/301: creat d7/d43/d48/d11/d21/f69 x:0 0 0 2024-09-17T01:07:09.600 INFO:tasks.workunit.client.0.smithi103.stdout:6/197: dwrite d3/d16/d33/d3e/f43 [0,4194304] 0 2024-09-17T01:07:09.602 INFO:tasks.workunit.client.1.smithi143.stdout:1/898: dread - d0/d6/d43/d47/dd8/fe5 zero size 2024-09-17T01:07:09.602 INFO:tasks.workunit.client.0.smithi103.stdout:6/198: fdatasync d3/d16/f1e 0 2024-09-17T01:07:09.604 INFO:tasks.workunit.client.1.smithi143.stdout:6/791: dwrite d2/d30/d45/d70/da5/fc3 [0,4194304] 0 2024-09-17T01:07:09.606 INFO:tasks.workunit.client.0.smithi103.stdout:4/343: truncate f5 2068367 0 2024-09-17T01:07:09.608 INFO:tasks.workunit.client.0.smithi103.stdout:9/302: mknod d7/d2d/d59/c6a 0 2024-09-17T01:07:09.608 INFO:tasks.workunit.client.1.smithi143.stdout:7/976: mkdir d4/d1f/d4a/d137 0 2024-09-17T01:07:09.609 INFO:tasks.workunit.client.1.smithi143.stdout:3/860: rmdir d6/d1c/d4d/da4/dea 39 2024-09-17T01:07:09.609 INFO:tasks.workunit.client.0.smithi103.stdout:9/303: write d7/d43/d48/d11/d21/f5b [350586,39134] 0 2024-09-17T01:07:09.610 INFO:tasks.workunit.client.0.smithi103.stdout:9/304: stat d7/f53 0 2024-09-17T01:07:09.610 INFO:tasks.workunit.client.1.smithi143.stdout:5/840: write d1/d46/df/d23/d4f/f33 [597255,112503] 0 2024-09-17T01:07:09.611 INFO:tasks.workunit.client.0.smithi103.stdout:1/361: rename d2/d16/d18 to d2/d1c/d28/d4b/d74 0 2024-09-17T01:07:09.611 INFO:tasks.workunit.client.1.smithi143.stdout:7/977: chown d4/d26/f8a 144 1 2024-09-17T01:07:09.613 INFO:tasks.workunit.client.0.smithi103.stdout:4/344: symlink d9/d16/d45/l5f 0 2024-09-17T01:07:09.613 INFO:tasks.workunit.client.0.smithi103.stdout:4/345: chown d9/l30 276 1 2024-09-17T01:07:09.614 INFO:tasks.workunit.client.1.smithi143.stdout:6/792: dwrite d2/df/d18/ffa [0,4194304] 0 2024-09-17T01:07:09.614 INFO:tasks.workunit.client.0.smithi103.stdout:4/346: write d9/d2d/f39 [635854,57145] 0 2024-09-17T01:07:09.616 INFO:tasks.workunit.client.1.smithi143.stdout:8/896: getdents d9/d12/d38/d58/d79/d9b/d12b 0 2024-09-17T01:07:09.616 INFO:tasks.workunit.client.0.smithi103.stdout:4/347: chown d9/d16/d38/d3f/l51 3770293 1 2024-09-17T01:07:09.617 INFO:tasks.workunit.client.1.smithi143.stdout:6/793: write d2/df/d20/f5b [3401756,120049] 0 2024-09-17T01:07:09.619 INFO:tasks.workunit.client.1.smithi143.stdout:5/841: write d1/d46/df/d53/d74/d9a/dd7/f11c [771300,86827] 0 2024-09-17T01:07:09.621 INFO:tasks.workunit.client.0.smithi103.stdout:6/199: creat d3/d25/d26/d3a/f44 x:0 0 0 2024-09-17T01:07:09.624 INFO:tasks.workunit.client.0.smithi103.stdout:2/200: truncate d6/f8 1320635 0 2024-09-17T01:07:09.625 INFO:tasks.workunit.client.1.smithi143.stdout:9/830: mkdir d3/d39/d42/d80/df3/d99/dfa/d113 0 2024-09-17T01:07:09.626 INFO:tasks.workunit.client.1.smithi143.stdout:6/794: dwrite d2/df/d20/d2c/d75/fd9 [0,4194304] 0 2024-09-17T01:07:09.629 INFO:tasks.workunit.client.0.smithi103.stdout:6/200: dwrite d3/d16/d33/d3e/f41 [0,4194304] 0 2024-09-17T01:07:09.630 INFO:tasks.workunit.client.0.smithi103.stdout:1/362: link d2/d16/l3a d2/d1c/d28/d4b/d74/l75 0 2024-09-17T01:07:09.632 INFO:tasks.workunit.client.1.smithi143.stdout:8/897: creat d9/d12/d13/d73/f145 x:0 0 0 2024-09-17T01:07:09.636 INFO:tasks.workunit.client.1.smithi143.stdout:5/842: creat d1/d46/df/d23/d4f/d7d/dcf/f133 x:0 0 0 2024-09-17T01:07:09.638 INFO:tasks.workunit.client.0.smithi103.stdout:9/305: dread d7/d43/d48/f16 [0,4194304] 0 2024-09-17T01:07:09.640 INFO:tasks.workunit.client.1.smithi143.stdout:9/831: truncate d3/d39/d6a/d9/d74/f97 141744 0 2024-09-17T01:07:09.640 INFO:tasks.workunit.client.0.smithi103.stdout:1/363: mkdir d2/de/d76 0 2024-09-17T01:07:09.641 INFO:tasks.workunit.client.1.smithi143.stdout:9/832: dread - d3/d39/d104/f10f zero size 2024-09-17T01:07:09.641 INFO:tasks.workunit.client.0.smithi103.stdout:9/306: creat d7/d43/d48/d11/d21/f6b x:0 0 0 2024-09-17T01:07:09.642 INFO:tasks.workunit.client.1.smithi143.stdout:1/899: rmdir d0/d6/d43/dcc 0 2024-09-17T01:07:09.642 INFO:tasks.workunit.client.1.smithi143.stdout:8/898: dread - d9/d12/d38/d7a/fbe zero size 2024-09-17T01:07:09.644 INFO:tasks.workunit.client.1.smithi143.stdout:1/900: chown d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/fe7 0 1 2024-09-17T01:07:09.644 INFO:tasks.workunit.client.0.smithi103.stdout:1/364: dread d2/d1c/d28/d52/f5c [0,4194304] 0 2024-09-17T01:07:09.645 INFO:tasks.workunit.client.1.smithi143.stdout:9/833: unlink d3/d39/d6a/d9/c2c 0 2024-09-17T01:07:09.646 INFO:tasks.workunit.client.1.smithi143.stdout:8/899: creat d9/d84/f146 x:0 0 0 2024-09-17T01:07:09.649 INFO:tasks.workunit.client.0.smithi103.stdout:9/307: getdents d7/d43/d48 0 2024-09-17T01:07:09.650 INFO:tasks.workunit.client.1.smithi143.stdout:8/900: mknod d9/de/d53/d75/dfa/d66/c147 0 2024-09-17T01:07:09.651 INFO:tasks.workunit.client.1.smithi143.stdout:7/978: dread d4/d16/d97/ff9 [0,4194304] 0 2024-09-17T01:07:09.652 INFO:tasks.workunit.client.1.smithi143.stdout:7/979: readlink d4/le 0 2024-09-17T01:07:09.653 INFO:tasks.workunit.client.1.smithi143.stdout:7/980: mkdir d4/d26/d138 0 2024-09-17T01:07:09.655 INFO:tasks.workunit.client.1.smithi143.stdout:7/981: mkdir d4/d1f/d4a/d66/db5/d139 0 2024-09-17T01:07:09.655 INFO:tasks.workunit.client.0.smithi103.stdout:9/308: dwrite d7/d2d/f37 [0,4194304] 0 2024-09-17T01:07:09.656 INFO:tasks.workunit.client.1.smithi143.stdout:7/982: readlink d4/d1f/d4a/de4/l36 0 2024-09-17T01:07:09.658 INFO:tasks.workunit.client.0.smithi103.stdout:9/309: mkdir d7/d43/d48/d11/d5c/d5e/d6c 0 2024-09-17T01:07:09.659 INFO:tasks.workunit.client.0.smithi103.stdout:9/310: write d7/d43/d48/d11/d21/f5b [1410940,29686] 0 2024-09-17T01:07:09.662 INFO:tasks.workunit.client.1.smithi143.stdout:7/983: dwrite d4/d1f/d4a/d66/fc2 [4194304,4194304] 0 2024-09-17T01:07:09.666 INFO:tasks.workunit.client.0.smithi103.stdout:9/311: dwrite d7/d2d/f4c [0,4194304] 0 2024-09-17T01:07:09.669 INFO:tasks.workunit.client.0.smithi103.stdout:9/312: symlink d7/d43/d48/d11/d21/l6d 0 2024-09-17T01:07:09.672 INFO:tasks.workunit.client.1.smithi143.stdout:0/807: truncate d3/d5/d8/d27/d31/d4c/f1d 2447170 0 2024-09-17T01:07:09.674 INFO:tasks.workunit.client.0.smithi103.stdout:9/313: mkdir d7/d43/d48/d11/d5c/d5e/d6c/d6e 0 2024-09-17T01:07:09.674 INFO:tasks.workunit.client.0.smithi103.stdout:9/314: readlink d7/d43/d48/d11/d21/l28 0 2024-09-17T01:07:09.676 INFO:tasks.workunit.client.1.smithi143.stdout:4/883: write da/d3a/f10e [635354,11067] 0 2024-09-17T01:07:09.680 INFO:tasks.workunit.client.1.smithi143.stdout:0/808: dwrite d3/d5/d8/d27/f4b [0,4194304] 0 2024-09-17T01:07:09.682 INFO:tasks.workunit.client.1.smithi143.stdout:4/884: fsync da/f1b 0 2024-09-17T01:07:09.684 INFO:tasks.workunit.client.0.smithi103.stdout:6/201: dread d3/f9 [0,4194304] 0 2024-09-17T01:07:09.685 INFO:tasks.workunit.client.1.smithi143.stdout:0/809: rmdir d3/d5/d8/d21/d2e 39 2024-09-17T01:07:09.686 INFO:tasks.workunit.client.1.smithi143.stdout:3/861: write d6/d1c/d33/d41/d2e/d86/ddc/fc2 [478783,12349] 0 2024-09-17T01:07:09.687 INFO:tasks.workunit.client.0.smithi103.stdout:6/202: creat d3/d25/d26/d3a/f45 x:0 0 0 2024-09-17T01:07:09.688 INFO:tasks.workunit.client.0.smithi103.stdout:2/201: write d6/f2d [988730,91290] 0 2024-09-17T01:07:09.691 INFO:tasks.workunit.client.0.smithi103.stdout:4/348: truncate d9/d2d/f39 1421728 0 2024-09-17T01:07:09.692 INFO:tasks.workunit.client.1.smithi143.stdout:3/862: dwrite d6/d1c/d33/fe9 [0,4194304] 0 2024-09-17T01:07:09.693 INFO:tasks.workunit.client.1.smithi143.stdout:3/863: chown d6/d1c/d33/d41 116362 1 2024-09-17T01:07:09.694 INFO:tasks.workunit.client.1.smithi143.stdout:3/864: chown d6/d1c/d4b/d57/c78 1621665103 1 2024-09-17T01:07:09.696 INFO:tasks.workunit.client.0.smithi103.stdout:2/202: dwrite d6/da/d28/f35 [0,4194304] 0 2024-09-17T01:07:09.700 INFO:tasks.workunit.client.1.smithi143.stdout:6/795: dwrite d2/df/d20/f34 [4194304,4194304] 0 2024-09-17T01:07:09.700 INFO:tasks.workunit.client.0.smithi103.stdout:6/203: rename d3/d17/l1a to d3/d25/d26/d3a/l46 0 2024-09-17T01:07:09.705 INFO:tasks.workunit.client.1.smithi143.stdout:3/865: truncate d6/d1c/d33/d41/d2e/d30/f74 1231849 0 2024-09-17T01:07:09.705 INFO:tasks.workunit.client.0.smithi103.stdout:4/349: dwrite d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:09.705 INFO:tasks.workunit.client.1.smithi143.stdout:3/866: chown d6/d1c/d4b/l7a 1651278238 1 2024-09-17T01:07:09.713 INFO:tasks.workunit.client.0.smithi103.stdout:1/365: write d2/f68 [3312846,41257] 0 2024-09-17T01:07:09.713 INFO:tasks.workunit.client.0.smithi103.stdout:6/204: unlink d3/d16/c42 0 2024-09-17T01:07:09.714 INFO:tasks.workunit.client.1.smithi143.stdout:4/885: dread da/d6d/f111 [0,4194304] 0 2024-09-17T01:07:09.714 INFO:tasks.workunit.client.0.smithi103.stdout:6/205: dread - d3/d25/d26/f2e zero size 2024-09-17T01:07:09.715 INFO:tasks.workunit.client.1.smithi143.stdout:2/810: sync 2024-09-17T01:07:09.716 INFO:tasks.workunit.client.1.smithi143.stdout:9/834: write d3/d3d/faa [893881,96855] 0 2024-09-17T01:07:09.717 INFO:tasks.workunit.client.0.smithi103.stdout:1/366: symlink d2/d1c/d54/l77 0 2024-09-17T01:07:09.718 INFO:tasks.workunit.client.1.smithi143.stdout:4/886: dread - da/d3a/f122 zero size 2024-09-17T01:07:09.720 INFO:tasks.workunit.client.1.smithi143.stdout:1/901: dwrite d0/da1/fc6 [0,4194304] 0 2024-09-17T01:07:09.720 INFO:tasks.workunit.client.0.smithi103.stdout:6/206: symlink d3/d17/l47 0 2024-09-17T01:07:09.722 INFO:tasks.workunit.client.0.smithi103.stdout:6/207: symlink d3/d16/d21/l48 0 2024-09-17T01:07:09.722 INFO:tasks.workunit.client.1.smithi143.stdout:1/902: stat d0/d6/d43/d6d/fbc 0 2024-09-17T01:07:09.722 INFO:tasks.workunit.client.0.smithi103.stdout:1/367: truncate d2/de/d1f/f72 1924882 0 2024-09-17T01:07:09.723 INFO:tasks.workunit.client.0.smithi103.stdout:1/368: chown d2/d1c 6 1 2024-09-17T01:07:09.725 INFO:tasks.workunit.client.1.smithi143.stdout:7/984: write d4/d1f/d4a/d66/f6c [4498458,17007] 0 2024-09-17T01:07:09.726 INFO:tasks.workunit.client.1.smithi143.stdout:9/835: rmdir d3/d39/d42/dab/d108/d51/d52/db3 39 2024-09-17T01:07:09.727 INFO:tasks.workunit.client.1.smithi143.stdout:6/796: dread d2/d30/d45/d70/fef [0,4194304] 0 2024-09-17T01:07:09.729 INFO:tasks.workunit.client.0.smithi103.stdout:1/369: dwrite d2/fb [0,4194304] 0 2024-09-17T01:07:09.730 INFO:tasks.workunit.client.1.smithi143.stdout:2/811: creat d0/d10/d58/d5a/d5b/d4c/d71/dd2/f10e x:0 0 0 2024-09-17T01:07:09.730 INFO:tasks.workunit.client.1.smithi143.stdout:4/887: dread da/d75/f7b [0,4194304] 0 2024-09-17T01:07:09.731 INFO:tasks.workunit.client.0.smithi103.stdout:1/370: chown d2/d1c/d20 11 1 2024-09-17T01:07:09.732 INFO:tasks.workunit.client.0.smithi103.stdout:1/371: dread - d2/d1c/d20/d33/f62 zero size 2024-09-17T01:07:09.734 INFO:tasks.workunit.client.0.smithi103.stdout:9/315: write d7/fc [7878143,45168] 0 2024-09-17T01:07:09.734 INFO:tasks.workunit.client.1.smithi143.stdout:9/836: dread d3/d39/d42/d80/df3/d99/f93 [0,4194304] 0 2024-09-17T01:07:09.735 INFO:tasks.workunit.client.1.smithi143.stdout:7/985: symlink d4/d26/dcc/l13a 0 2024-09-17T01:07:09.735 INFO:tasks.workunit.client.0.smithi103.stdout:9/316: chown d7/d43/f52 121926928 1 2024-09-17T01:07:09.737 INFO:tasks.workunit.client.0.smithi103.stdout:1/372: symlink d2/d16/d51/d65/l78 0 2024-09-17T01:07:09.737 INFO:tasks.workunit.client.0.smithi103.stdout:1/373: dread - d2/d7/f5e zero size 2024-09-17T01:07:09.738 INFO:tasks.workunit.client.0.smithi103.stdout:1/374: fsync d2/de/f1b 0 2024-09-17T01:07:09.738 INFO:tasks.workunit.client.1.smithi143.stdout:6/797: mknod d2/d17/d6e/d26/dbd/d5e/c107 0 2024-09-17T01:07:09.739 INFO:tasks.workunit.client.0.smithi103.stdout:3/327: sync 2024-09-17T01:07:09.740 INFO:tasks.workunit.client.0.smithi103.stdout:6/208: getdents d3/d25 0 2024-09-17T01:07:09.741 INFO:tasks.workunit.client.1.smithi143.stdout:3/867: dread d6/d1c/d4b/d57/f9d [0,4194304] 0 2024-09-17T01:07:09.741 INFO:tasks.workunit.client.1.smithi143.stdout:4/888: rmdir da/d68 39 2024-09-17T01:07:09.742 INFO:tasks.workunit.client.0.smithi103.stdout:3/328: write d3/d16/f3d [331308,110289] 0 2024-09-17T01:07:09.743 INFO:tasks.workunit.client.1.smithi143.stdout:3/868: chown d6/d1c/d33/d3f/d5c/da1/fdb 306 1 2024-09-17T01:07:09.744 INFO:tasks.workunit.client.1.smithi143.stdout:0/810: write d3/d5/ffb [921246,102136] 0 2024-09-17T01:07:09.745 INFO:tasks.workunit.client.0.smithi103.stdout:9/317: write d7/d43/d48/d11/d5c/f61 [677270,66588] 0 2024-09-17T01:07:09.746 INFO:tasks.workunit.client.1.smithi143.stdout:1/903: mknod d0/d6/d43/d6a/d52/db2/db6/c12b 0 2024-09-17T01:07:09.748 INFO:tasks.workunit.client.0.smithi103.stdout:2/203: write d6/da/d24/f2a [479746,18764] 0 2024-09-17T01:07:09.749 INFO:tasks.workunit.client.1.smithi143.stdout:1/904: dread d0/d6/d43/d6a/f42 [4194304,4194304] 0 2024-09-17T01:07:09.750 INFO:tasks.workunit.client.0.smithi103.stdout:4/350: fdatasync d9/dc/df/f25 0 2024-09-17T01:07:09.751 INFO:tasks.workunit.client.0.smithi103.stdout:4/351: chown d9/dc/df/f25 34 1 2024-09-17T01:07:09.751 INFO:tasks.workunit.client.1.smithi143.stdout:1/905: dread - d0/d6/d43/d6d/d8b/dd0/de2/f100 zero size 2024-09-17T01:07:09.752 INFO:tasks.workunit.client.1.smithi143.stdout:6/798: creat d2/d30/d84/f108 x:0 0 0 2024-09-17T01:07:09.753 INFO:tasks.workunit.client.1.smithi143.stdout:4/889: read - da/d3a/d3e/d72/d9e/fc4 zero size 2024-09-17T01:07:09.756 INFO:tasks.workunit.client.1.smithi143.stdout:3/869: truncate d6/d1c/d33/d41/d42/fc9 2085740 0 2024-09-17T01:07:09.757 INFO:tasks.workunit.client.1.smithi143.stdout:5/843: sync 2024-09-17T01:07:09.758 INFO:tasks.workunit.client.1.smithi143.stdout:5/844: write d1/d46/df/f25 [2605620,93907] 0 2024-09-17T01:07:09.763 INFO:tasks.workunit.client.1.smithi143.stdout:6/799: readlink d2/d17/lfc 0 2024-09-17T01:07:09.763 INFO:tasks.workunit.client.1.smithi143.stdout:6/800: readlink d2/d17/d3a/dd2/ld5 0 2024-09-17T01:07:09.764 INFO:tasks.workunit.client.1.smithi143.stdout:1/906: dread - d0/d6/d43/d47/d68/fdc zero size 2024-09-17T01:07:09.765 INFO:tasks.workunit.client.1.smithi143.stdout:7/986: dread d4/d1f/d4a/ddb/f10d [0,4194304] 0 2024-09-17T01:07:09.766 INFO:tasks.workunit.client.1.smithi143.stdout:4/890: rmdir da/d3a/d3e/d72 39 2024-09-17T01:07:09.767 INFO:tasks.workunit.client.1.smithi143.stdout:2/812: write d0/d10/d58/d5a/d5b/d4c/d77/fc3 [422195,19645] 0 2024-09-17T01:07:09.768 INFO:tasks.workunit.client.1.smithi143.stdout:4/891: write da/d3a/d40/daa/dc3/fd4 [2444288,109097] 0 2024-09-17T01:07:09.769 INFO:tasks.workunit.client.1.smithi143.stdout:3/870: mkdir d6/d1c/d33/d41/d2e/d105 0 2024-09-17T01:07:09.769 INFO:tasks.workunit.client.1.smithi143.stdout:4/892: dread - da/d3a/d40/d84/db6/fc9 zero size 2024-09-17T01:07:09.770 INFO:tasks.workunit.client.0.smithi103.stdout:1/375: truncate d2/d16/f32 872005 0 2024-09-17T01:07:09.770 INFO:tasks.workunit.client.1.smithi143.stdout:3/871: fdatasync d6/d1c/d33/d41/d42/fc9 0 2024-09-17T01:07:09.771 INFO:tasks.workunit.client.1.smithi143.stdout:4/893: readlink da/d3a/d40/l77 0 2024-09-17T01:07:09.775 INFO:tasks.workunit.client.1.smithi143.stdout:6/801: mkdir d2/df/d109 0 2024-09-17T01:07:09.776 INFO:tasks.workunit.client.0.smithi103.stdout:4/352: creat d9/d2d/d55/f60 x:0 0 0 2024-09-17T01:07:09.777 INFO:tasks.workunit.client.0.smithi103.stdout:4/353: fsync d9/dc/df/f25 0 2024-09-17T01:07:09.778 INFO:tasks.workunit.client.0.smithi103.stdout:4/354: stat d9/d16/d44/c5d 0 2024-09-17T01:07:09.778 INFO:tasks.workunit.client.1.smithi143.stdout:5/845: dread d1/d46/df/d23/f4e [0,4194304] 0 2024-09-17T01:07:09.778 INFO:tasks.workunit.client.1.smithi143.stdout:7/987: rename d4/fb7 to d4/d1f/d4a/d66/db5/df3/d106/d114/f13b 0 2024-09-17T01:07:09.779 INFO:tasks.workunit.client.0.smithi103.stdout:1/376: mkdir d2/d16/d51/d79 0 2024-09-17T01:07:09.779 INFO:tasks.workunit.client.1.smithi143.stdout:5/846: fsync d1/d46/df/d53/d74/d9a/d9c/fc8 0 2024-09-17T01:07:09.779 INFO:tasks.workunit.client.0.smithi103.stdout:9/318: write d7/d43/f52 [1066029,9081] 0 2024-09-17T01:07:09.780 INFO:tasks.workunit.client.1.smithi143.stdout:5/847: write d1/d46/df/d23/fcc [2261791,121600] 0 2024-09-17T01:07:09.780 INFO:tasks.workunit.client.1.smithi143.stdout:2/813: unlink d0/d44/c69 0 2024-09-17T01:07:09.786 INFO:tasks.workunit.client.0.smithi103.stdout:3/329: creat d3/f73 x:0 0 0 2024-09-17T01:07:09.786 INFO:tasks.workunit.client.0.smithi103.stdout:9/319: dread d7/d43/d48/f2f [0,4194304] 0 2024-09-17T01:07:09.786 INFO:tasks.workunit.client.0.smithi103.stdout:1/377: dwrite d2/f68 [0,4194304] 0 2024-09-17T01:07:09.788 INFO:tasks.workunit.client.1.smithi143.stdout:0/811: dwrite d3/d5/d8/f44 [0,4194304] 0 2024-09-17T01:07:09.788 INFO:tasks.workunit.client.0.smithi103.stdout:3/330: truncate d3/d16/d1b/d2c/d34/f5f 193403 0 2024-09-17T01:07:09.788 INFO:tasks.workunit.client.0.smithi103.stdout:2/204: rename d6/da/d24 to d6/da/d17/d1a/d45 0 2024-09-17T01:07:09.790 INFO:tasks.workunit.client.1.smithi143.stdout:3/872: creat d6/d1c/d4b/d57/f106 x:0 0 0 2024-09-17T01:07:09.793 INFO:tasks.workunit.client.0.smithi103.stdout:1/378: dwrite d2/d7/f5a [0,4194304] 0 2024-09-17T01:07:09.795 INFO:tasks.workunit.client.0.smithi103.stdout:6/209: getdents d3/d16/d33 0 2024-09-17T01:07:09.796 INFO:tasks.workunit.client.1.smithi143.stdout:4/894: write da/d3a/d3e/d72/d9e/fd8 [261300,61764] 0 2024-09-17T01:07:09.797 INFO:tasks.workunit.client.0.smithi103.stdout:1/379: read d2/d1c/d54/f35 [67724,129680] 0 2024-09-17T01:07:09.797 INFO:tasks.workunit.client.0.smithi103.stdout:6/210: write d3/f28 [492506,1454] 0 2024-09-17T01:07:09.797 INFO:tasks.workunit.client.1.smithi143.stdout:4/895: write da/d3a/d3e/fb7 [948526,56028] 0 2024-09-17T01:07:09.798 INFO:tasks.workunit.client.1.smithi143.stdout:8/901: sync 2024-09-17T01:07:09.799 INFO:tasks.workunit.client.0.smithi103.stdout:1/380: chown d2/d1c/d20/f64 2 1 2024-09-17T01:07:09.799 INFO:tasks.workunit.client.0.smithi103.stdout:6/211: chown d3/d25/f29 52387 1 2024-09-17T01:07:09.800 INFO:tasks.workunit.client.1.smithi143.stdout:9/837: getdents d3/d39/d42/dab/d108/d51/d52 0 2024-09-17T01:07:09.800 INFO:tasks.workunit.client.0.smithi103.stdout:9/320: chown d7/cf 169892 1 2024-09-17T01:07:09.800 INFO:tasks.workunit.client.1.smithi143.stdout:4/896: write da/d3a/d3e/d4a/d8a/fb8 [1058473,91191] 0 2024-09-17T01:07:09.801 INFO:tasks.workunit.client.0.smithi103.stdout:1/381: readlink d2/d1c/d28/d52/l63 0 2024-09-17T01:07:09.801 INFO:tasks.workunit.client.1.smithi143.stdout:6/802: mkdir d2/df/d20/d2c/d75/daf/d10a 0 2024-09-17T01:07:09.802 INFO:tasks.workunit.client.0.smithi103.stdout:9/321: read - d7/d43/d48/d11/d20/f4a zero size 2024-09-17T01:07:09.804 INFO:tasks.workunit.client.0.smithi103.stdout:4/355: rename d9/d16/d23/d2b to d9/d16/d23/d32/d61 0 2024-09-17T01:07:09.804 INFO:tasks.workunit.client.0.smithi103.stdout:4/356: fdatasync f3 0 2024-09-17T01:07:09.806 INFO:tasks.workunit.client.0.smithi103.stdout:2/205: unlink d6/da/d17/d1a/df/f38 0 2024-09-17T01:07:09.808 INFO:tasks.workunit.client.1.smithi143.stdout:1/907: rename d0/d6/d43/d6d/d8b/fcf to d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/d4d/f12c 0 2024-09-17T01:07:09.811 INFO:tasks.workunit.client.1.smithi143.stdout:5/848: truncate d1/f3f 1643177 0 2024-09-17T01:07:09.812 INFO:tasks.workunit.client.0.smithi103.stdout:2/206: dwrite d6/da/d17/d1a/d45/f2a [0,4194304] 0 2024-09-17T01:07:09.812 INFO:tasks.workunit.client.0.smithi103.stdout:6/212: symlink d3/d16/d33/d3e/l49 0 2024-09-17T01:07:09.813 INFO:tasks.workunit.client.0.smithi103.stdout:6/213: write d3/ff [2954799,22559] 0 2024-09-17T01:07:09.813 INFO:tasks.workunit.client.1.smithi143.stdout:2/814: creat d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/f10f x:0 0 0 2024-09-17T01:07:09.814 INFO:tasks.workunit.client.1.smithi143.stdout:2/815: chown d0/d10/d58/d5a/d5b/d4c/d71/d99 0 1 2024-09-17T01:07:09.815 INFO:tasks.workunit.client.0.smithi103.stdout:6/214: write d3/d25/f37 [77933,121032] 0 2024-09-17T01:07:09.815 INFO:tasks.workunit.client.0.smithi103.stdout:1/382: symlink d2/d1c/d28/d4b/l7a 0 2024-09-17T01:07:09.816 INFO:tasks.workunit.client.1.smithi143.stdout:0/812: symlink d3/d88/d93/l106 0 2024-09-17T01:07:09.816 INFO:tasks.workunit.client.1.smithi143.stdout:2/816: chown d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/f10f 0 1 2024-09-17T01:07:09.822 INFO:tasks.workunit.client.0.smithi103.stdout:1/383: dwrite d2/d7/fc [4194304,4194304] 0 2024-09-17T01:07:09.824 INFO:tasks.workunit.client.0.smithi103.stdout:4/357: creat d9/d10/f62 x:0 0 0 2024-09-17T01:07:09.825 INFO:tasks.workunit.client.0.smithi103.stdout:4/358: readlink d9/d10/l17 0 2024-09-17T01:07:09.828 INFO:tasks.workunit.client.0.smithi103.stdout:3/331: write d3/d16/d1b/f4e [843844,31545] 0 2024-09-17T01:07:09.829 INFO:tasks.workunit.client.1.smithi143.stdout:8/902: symlink d9/d12/d38/d58/dda/l148 0 2024-09-17T01:07:09.832 INFO:tasks.workunit.client.1.smithi143.stdout:6/803: rmdir d2/d30/dc1/de8 39 2024-09-17T01:07:09.832 INFO:tasks.workunit.client.1.smithi143.stdout:8/903: dread d9/d12/df4/fa2 [0,4194304] 0 2024-09-17T01:07:09.834 INFO:tasks.workunit.client.0.smithi103.stdout:6/215: fdatasync d3/d16/f1f 0 2024-09-17T01:07:09.838 INFO:tasks.workunit.client.1.smithi143.stdout:7/988: rename d4/d1f/d4a/de4/d4e/d9f to d4/d1f/d4a/ddb/d129/d13c 0 2024-09-17T01:07:09.842 INFO:tasks.workunit.client.1.smithi143.stdout:1/908: dread d0/d6/d43/d6a/d52/db2/fed [0,4194304] 0 2024-09-17T01:07:09.843 INFO:tasks.workunit.client.0.smithi103.stdout:1/384: readlink d2/l5 0 2024-09-17T01:07:09.843 INFO:tasks.workunit.client.0.smithi103.stdout:1/385: chown d2/d7/fc 4202378 1 2024-09-17T01:07:09.845 INFO:tasks.workunit.client.0.smithi103.stdout:4/359: rename d9/l30 to d9/d16/d23/d32/l63 0 2024-09-17T01:07:09.845 INFO:tasks.workunit.client.1.smithi143.stdout:3/873: write d6/d1c/f66 [924939,3573] 0 2024-09-17T01:07:09.846 INFO:tasks.workunit.client.0.smithi103.stdout:4/360: stat d9/d2d/d55 0 2024-09-17T01:07:09.847 INFO:tasks.workunit.client.0.smithi103.stdout:4/361: dread - d9/d16/d45/f5a zero size 2024-09-17T01:07:09.851 INFO:tasks.workunit.client.0.smithi103.stdout:2/207: dread d6/fb [0,4194304] 0 2024-09-17T01:07:09.852 INFO:tasks.workunit.client.0.smithi103.stdout:2/208: readlink d6/da/d17/d1a/d45/l37 0 2024-09-17T01:07:09.853 INFO:tasks.workunit.client.1.smithi143.stdout:3/874: dwrite d6/d1c/d33/d41/d2e/d86/d89/fa7 [0,4194304] 0 2024-09-17T01:07:09.854 INFO:tasks.workunit.client.1.smithi143.stdout:8/904: mknod d9/d12/d38/d58/d79/d9b/d12b/c149 0 2024-09-17T01:07:09.857 INFO:tasks.workunit.client.0.smithi103.stdout:4/362: mkdir d9/d16/d23/d32/d64 0 2024-09-17T01:07:09.860 INFO:tasks.workunit.client.0.smithi103.stdout:9/322: truncate d7/d43/d48/d11/fb 350305 0 2024-09-17T01:07:09.861 INFO:tasks.workunit.client.1.smithi143.stdout:5/849: creat d1/d96/d12e/f134 x:0 0 0 2024-09-17T01:07:09.864 INFO:tasks.workunit.client.0.smithi103.stdout:2/209: dread d6/da/f2f [0,4194304] 0 2024-09-17T01:07:09.865 INFO:tasks.workunit.client.0.smithi103.stdout:1/386: link d2/fb d2/d7/d4e/f7b 0 2024-09-17T01:07:09.868 INFO:tasks.workunit.client.1.smithi143.stdout:9/838: dwrite d3/d39/d6a/d9/f60 [0,4194304] 0 2024-09-17T01:07:09.868 INFO:tasks.workunit.client.0.smithi103.stdout:3/332: rename d3/d16/d1b/f4e to d3/d16/d1b/f74 0 2024-09-17T01:07:09.870 INFO:tasks.workunit.client.0.smithi103.stdout:6/216: dwrite d3/f11 [0,4194304] 0 2024-09-17T01:07:09.872 INFO:tasks.workunit.client.1.smithi143.stdout:6/804: creat d2/d17/d6e/d26/df7/f10b x:0 0 0 2024-09-17T01:07:09.877 INFO:tasks.workunit.client.1.smithi143.stdout:0/813: dwrite d3/d5/d8/d21/d2e/f50 [0,4194304] 0 2024-09-17T01:07:09.885 INFO:tasks.workunit.client.1.smithi143.stdout:4/897: creat da/d3a/d3e/d72/da3/dc0/df9/f124 x:0 0 0 2024-09-17T01:07:09.886 INFO:tasks.workunit.client.0.smithi103.stdout:1/387: mknod d2/d16/c7c 0 2024-09-17T01:07:09.886 INFO:tasks.workunit.client.1.smithi143.stdout:4/898: write da/f2a [2181559,103719] 0 2024-09-17T01:07:09.887 INFO:tasks.workunit.client.1.smithi143.stdout:8/905: symlink d9/d23/db4/d55/d57/d12a/l14a 0 2024-09-17T01:07:09.891 INFO:tasks.workunit.client.0.smithi103.stdout:3/333: mkdir d3/d16/d1b/d3c/d65/d75 0 2024-09-17T01:07:09.893 INFO:tasks.workunit.client.1.smithi143.stdout:5/850: rename d1/d46/df/fdb to d1/d46/df/d1f/d9f/d125/f135 0 2024-09-17T01:07:09.893 INFO:tasks.workunit.client.0.smithi103.stdout:6/217: rmdir d3/d17 39 2024-09-17T01:07:09.896 INFO:tasks.workunit.client.0.smithi103.stdout:2/210: unlink d6/c11 0 2024-09-17T01:07:09.897 INFO:tasks.workunit.client.1.smithi143.stdout:9/839: chown d3/d39/d42/cdc 972868 1 2024-09-17T01:07:09.900 INFO:tasks.workunit.client.1.smithi143.stdout:7/989: truncate d4/d26/f2b 772862 0 2024-09-17T01:07:09.902 INFO:tasks.workunit.client.0.smithi103.stdout:4/363: rmdir d9/d16/d23/d32/d61/d47/d58 0 2024-09-17T01:07:09.903 INFO:tasks.workunit.client.0.smithi103.stdout:4/364: truncate d9/d16/d44/f4f 1134400 0 2024-09-17T01:07:09.905 INFO:tasks.workunit.client.0.smithi103.stdout:9/323: fdatasync d7/d43/d48/d11/fb 0 2024-09-17T01:07:09.905 INFO:tasks.workunit.client.0.smithi103.stdout:1/388: write d2/f6 [2094323,103625] 0 2024-09-17T01:07:09.909 INFO:tasks.workunit.client.0.smithi103.stdout:9/324: dread d7/d43/d48/d11/f12 [0,4194304] 0 2024-09-17T01:07:09.911 INFO:tasks.workunit.client.1.smithi143.stdout:6/805: rename d2/d30/d45/d70/d87/d8d to d2/df/d20/d2c/d75/d10c 0 2024-09-17T01:07:09.911 INFO:tasks.workunit.client.1.smithi143.stdout:3/875: dwrite d6/d1c/d4d/fe5 [0,4194304] 0 2024-09-17T01:07:09.912 INFO:tasks.workunit.client.0.smithi103.stdout:3/334: symlink d3/l76 0 2024-09-17T01:07:09.914 INFO:tasks.workunit.client.1.smithi143.stdout:5/851: creat d1/d96/f136 x:0 0 0 2024-09-17T01:07:09.914 INFO:tasks.workunit.client.0.smithi103.stdout:3/335: fsync d3/d16/d1b/d3c/f35 0 2024-09-17T01:07:09.915 INFO:tasks.workunit.client.1.smithi143.stdout:2/817: getdents d0/d44/d7a/d86 0 2024-09-17T01:07:09.915 INFO:tasks.workunit.client.1.smithi143.stdout:5/852: chown d1/d46/df/d1f/d9f/d125 1 1 2024-09-17T01:07:09.916 INFO:tasks.workunit.client.1.smithi143.stdout:9/840: creat d3/d39/d6a/d26/f114 x:0 0 0 2024-09-17T01:07:09.917 INFO:tasks.workunit.client.0.smithi103.stdout:9/325: dwrite d7/d43/d48/d11/d21/f69 [0,4194304] 0 2024-09-17T01:07:09.917 INFO:tasks.workunit.client.1.smithi143.stdout:5/853: write d1/d96/fef [348803,92608] 0 2024-09-17T01:07:09.918 INFO:tasks.workunit.client.0.smithi103.stdout:6/218: link d3/d25/d26/f2e d3/d25/d26/f4a 0 2024-09-17T01:07:09.919 INFO:tasks.workunit.client.0.smithi103.stdout:9/326: truncate d7/d43/d48/d11/d5c/f61 1559461 0 2024-09-17T01:07:09.920 INFO:tasks.workunit.client.1.smithi143.stdout:5/854: dread - d1/d46/df/d53/d74/d9a/dd7/f11d zero size 2024-09-17T01:07:09.921 INFO:tasks.workunit.client.1.smithi143.stdout:7/990: fsync d4/d1f/d4a/d9e/dd1/ff5 0 2024-09-17T01:07:09.923 INFO:tasks.workunit.client.0.smithi103.stdout:2/211: mknod d6/da/d17/d26/c46 0 2024-09-17T01:07:09.927 INFO:tasks.workunit.client.0.smithi103.stdout:6/219: dwrite d3/f36 [0,4194304] 0 2024-09-17T01:07:09.927 INFO:tasks.workunit.client.1.smithi143.stdout:8/906: unlink d9/de/f21 0 2024-09-17T01:07:09.927 INFO:tasks.workunit.client.1.smithi143.stdout:4/899: dread da/d6d/d90/fba [0,4194304] 0 2024-09-17T01:07:09.931 INFO:tasks.workunit.client.0.smithi103.stdout:9/327: dwrite d7/d43/f52 [0,4194304] 0 2024-09-17T01:07:09.934 INFO:tasks.workunit.client.1.smithi143.stdout:1/909: sync 2024-09-17T01:07:09.935 INFO:tasks.workunit.client.1.smithi143.stdout:6/806: creat d2/d17/d6e/d26/d46/d66/f10d x:0 0 0 2024-09-17T01:07:09.936 INFO:tasks.workunit.client.1.smithi143.stdout:4/900: dwrite da/d3a/d40/d84/f4b [0,4194304] 0 2024-09-17T01:07:09.936 INFO:tasks.workunit.client.0.smithi103.stdout:2/212: dwrite d6/da/d17/d26/f32 [0,4194304] 0 2024-09-17T01:07:09.937 INFO:tasks.workunit.client.1.smithi143.stdout:3/876: creat d6/d1c/d33/d41/d2e/d86/ddc/f107 x:0 0 0 2024-09-17T01:07:09.937 INFO:tasks.workunit.client.0.smithi103.stdout:2/213: chown d6/da/d17/d1a/df 69 1 2024-09-17T01:07:09.938 INFO:tasks.workunit.client.0.smithi103.stdout:2/214: dread - d6/da/d17/d26/f2c zero size 2024-09-17T01:07:09.939 INFO:tasks.workunit.client.0.smithi103.stdout:1/389: mknod d2/d1c/d28/c7d 0 2024-09-17T01:07:09.940 INFO:tasks.workunit.client.1.smithi143.stdout:3/877: truncate d6/d1c/d82/de4/ff7 859824 0 2024-09-17T01:07:09.942 INFO:tasks.workunit.client.0.smithi103.stdout:6/220: rmdir d3/d25 39 2024-09-17T01:07:09.944 INFO:tasks.workunit.client.1.smithi143.stdout:5/855: mknod d1/d46/df/d23/d4f/d7d/d102/d115/c137 0 2024-09-17T01:07:09.945 INFO:tasks.workunit.client.0.smithi103.stdout:9/328: mknod d7/d43/d48/d11/c6f 0 2024-09-17T01:07:09.946 INFO:tasks.workunit.client.1.smithi143.stdout:8/907: truncate d9/d84/f7e 444703 0 2024-09-17T01:07:09.949 INFO:tasks.workunit.client.1.smithi143.stdout:1/910: write d0/dc/d89/f113 [3298416,91261] 0 2024-09-17T01:07:09.949 INFO:tasks.workunit.client.1.smithi143.stdout:6/807: symlink d2/d19/l10e 0 2024-09-17T01:07:09.951 INFO:tasks.workunit.client.0.smithi103.stdout:9/329: mknod d7/d43/d48/d11/d21/c70 0 2024-09-17T01:07:09.952 INFO:tasks.workunit.client.1.smithi143.stdout:4/901: mknod da/d3a/d40/daa/dc3/c125 0 2024-09-17T01:07:09.952 INFO:tasks.workunit.client.0.smithi103.stdout:1/390: mknod d2/c7e 0 2024-09-17T01:07:09.953 INFO:tasks.workunit.client.0.smithi103.stdout:1/391: chown d2/de/d76 11152725 1 2024-09-17T01:07:09.953 INFO:tasks.workunit.client.1.smithi143.stdout:3/878: creat d6/d1c/d33/d41/d2e/d30/f108 x:0 0 0 2024-09-17T01:07:09.954 INFO:tasks.workunit.client.0.smithi103.stdout:1/392: write d2/d1c/d20/f2e [733323,94481] 0 2024-09-17T01:07:09.954 INFO:tasks.workunit.client.0.smithi103.stdout:2/215: link d6/da/f2f d6/da/d3f/f47 0 2024-09-17T01:07:09.955 INFO:tasks.workunit.client.1.smithi143.stdout:0/814: link d3/d5/d8/d21/f26 d3/d68/d8f/f107 0 2024-09-17T01:07:09.956 INFO:tasks.workunit.client.1.smithi143.stdout:3/879: readlink d6/d1c/d82/db1/lbd 0 2024-09-17T01:07:09.957 INFO:tasks.workunit.client.1.smithi143.stdout:5/856: symlink d1/d46/df/d1f/d9f/d124/l138 0 2024-09-17T01:07:09.957 INFO:tasks.workunit.client.0.smithi103.stdout:4/365: write d9/d2d/f4a [1552359,992] 0 2024-09-17T01:07:09.958 INFO:tasks.workunit.client.1.smithi143.stdout:0/815: stat d3/d5/d8/d21 0 2024-09-17T01:07:09.960 INFO:tasks.workunit.client.0.smithi103.stdout:1/393: mkdir d2/d16/d51/d65/d7f 0 2024-09-17T01:07:09.962 INFO:tasks.workunit.client.1.smithi143.stdout:6/808: dwrite d2/d30/d84/f108 [0,4194304] 0 2024-09-17T01:07:09.963 INFO:tasks.workunit.client.0.smithi103.stdout:6/221: getdents d3/d16/d21 0 2024-09-17T01:07:09.965 INFO:tasks.workunit.client.0.smithi103.stdout:2/216: dwrite d6/f44 [0,4194304] 0 2024-09-17T01:07:09.965 INFO:tasks.workunit.client.1.smithi143.stdout:1/911: symlink d0/d6/d43/d6d/d8b/dfe/l12d 0 2024-09-17T01:07:09.967 INFO:tasks.workunit.client.1.smithi143.stdout:8/908: dread d9/d23/db4/d55/dfe/f114 [0,4194304] 0 2024-09-17T01:07:09.968 INFO:tasks.workunit.client.0.smithi103.stdout:9/330: getdents d7/d43/d48/d11/d20 0 2024-09-17T01:07:09.968 INFO:tasks.workunit.client.0.smithi103.stdout:4/366: dwrite d9/d16/f12 [0,4194304] 0 2024-09-17T01:07:09.970 INFO:tasks.workunit.client.1.smithi143.stdout:4/902: dwrite da/d3a/d3e/d72/da3/dc0/df1/f10d [0,4194304] 0 2024-09-17T01:07:09.970 INFO:tasks.workunit.client.1.smithi143.stdout:9/841: dread d3/d39/d6a/d9/f49 [0,4194304] 0 2024-09-17T01:07:09.970 INFO:tasks.workunit.client.0.smithi103.stdout:6/222: readlink d3/d16/l31 0 2024-09-17T01:07:09.975 INFO:tasks.workunit.client.1.smithi143.stdout:2/818: dread d0/d2/d21/d22/f67 [0,4194304] 0 2024-09-17T01:07:09.977 INFO:tasks.workunit.client.0.smithi103.stdout:2/217: dwrite d6/da/d17/f20 [4194304,4194304] 0 2024-09-17T01:07:09.978 INFO:tasks.workunit.client.0.smithi103.stdout:3/336: write d3/d16/f1a [1820118,55113] 0 2024-09-17T01:07:09.978 INFO:tasks.workunit.client.0.smithi103.stdout:3/337: chown d3/f57 6304 1 2024-09-17T01:07:09.978 INFO:tasks.workunit.client.0.smithi103.stdout:6/223: mkdir d3/d16/d33/d3e/d4b 0 2024-09-17T01:07:09.979 INFO:tasks.workunit.client.0.smithi103.stdout:3/338: chown d3/d16/d1b/d3c/c4d 2 1 2024-09-17T01:07:09.980 INFO:tasks.workunit.client.1.smithi143.stdout:0/816: creat d3/d68/f108 x:0 0 0 2024-09-17T01:07:09.981 INFO:tasks.workunit.client.0.smithi103.stdout:9/331: fdatasync d7/d43/d48/f16 0 2024-09-17T01:07:09.982 INFO:tasks.workunit.client.1.smithi143.stdout:8/909: creat d9/de/d53/d75/dfa/d66/f14b x:0 0 0 2024-09-17T01:07:09.983 INFO:tasks.workunit.client.1.smithi143.stdout:9/842: mknod d3/d39/d42/dab/ddd/c115 0 2024-09-17T01:07:09.984 INFO:tasks.workunit.client.1.smithi143.stdout:7/991: write d4/fbb [475924,48661] 0 2024-09-17T01:07:09.988 INFO:tasks.workunit.client.0.smithi103.stdout:6/224: stat d3/d25/f37 0 2024-09-17T01:07:09.989 INFO:tasks.workunit.client.0.smithi103.stdout:3/339: mknod d3/d16/d1b/d36/c77 0 2024-09-17T01:07:09.993 INFO:tasks.workunit.client.0.smithi103.stdout:3/340: stat d3/d16/d1b/f74 0 2024-09-17T01:07:09.994 INFO:tasks.workunit.client.0.smithi103.stdout:2/218: dwrite d6/fb [0,4194304] 0 2024-09-17T01:07:09.995 INFO:tasks.workunit.client.1.smithi143.stdout:2/819: dread d0/d10/d58/d5a/f78 [0,4194304] 0 2024-09-17T01:07:09.996 INFO:tasks.workunit.client.0.smithi103.stdout:9/332: dwrite d7/fc [0,4194304] 0 2024-09-17T01:07:09.996 INFO:tasks.workunit.client.0.smithi103.stdout:3/341: stat d3/d44 0 2024-09-17T01:07:10.002 INFO:tasks.workunit.client.0.smithi103.stdout:4/367: link d9/d16/l29 d9/d16/d44/l65 0 2024-09-17T01:07:10.004 INFO:tasks.workunit.client.1.smithi143.stdout:8/910: creat d9/d23/db4/d55/d57/d108/f14c x:0 0 0 2024-09-17T01:07:10.006 INFO:tasks.workunit.client.0.smithi103.stdout:6/225: dwrite d3/ff [4194304,4194304] 0 2024-09-17T01:07:10.006 INFO:tasks.workunit.client.1.smithi143.stdout:8/911: fsync d9/d12/d4b/fdf 0 2024-09-17T01:07:10.007 INFO:tasks.workunit.client.0.smithi103.stdout:1/394: rmdir d2/d16/d51/d65 39 2024-09-17T01:07:10.008 INFO:tasks.workunit.client.0.smithi103.stdout:9/333: dread d7/d43/d48/d11/fe [0,4194304] 0 2024-09-17T01:07:10.009 INFO:tasks.workunit.client.1.smithi143.stdout:6/809: mknod d2/d17/d6e/db0/df6/c10f 0 2024-09-17T01:07:10.009 INFO:tasks.workunit.client.1.smithi143.stdout:8/912: truncate d9/d12/d38/d58/dda/dea/f13d 472224 0 2024-09-17T01:07:10.010 INFO:tasks.workunit.client.0.smithi103.stdout:1/395: fsync d2/d7/f37 0 2024-09-17T01:07:10.010 INFO:tasks.workunit.client.1.smithi143.stdout:8/913: chown d9/d12/ld5 87 1 2024-09-17T01:07:10.011 INFO:tasks.workunit.client.1.smithi143.stdout:8/914: write d9/d12/df4/f6e [581510,45932] 0 2024-09-17T01:07:10.012 INFO:tasks.workunit.client.0.smithi103.stdout:9/334: write d7/f19 [1850300,5716] 0 2024-09-17T01:07:10.012 INFO:tasks.workunit.client.0.smithi103.stdout:2/219: dwrite d6/f44 [0,4194304] 0 2024-09-17T01:07:10.014 INFO:tasks.workunit.client.1.smithi143.stdout:2/820: creat d0/d44/d7a/f110 x:0 0 0 2024-09-17T01:07:10.016 INFO:tasks.workunit.client.1.smithi143.stdout:3/880: link d6/f90 d6/d1c/d33/d3f/d79/d7b/dfd/f109 0 2024-09-17T01:07:10.017 INFO:tasks.workunit.client.0.smithi103.stdout:4/368: dwrite d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:10.018 INFO:tasks.workunit.client.1.smithi143.stdout:0/817: mkdir d3/d5/d8/d21/d109 0 2024-09-17T01:07:10.021 INFO:tasks.workunit.client.1.smithi143.stdout:4/903: creat da/d3a/d3e/d72/f126 x:0 0 0 2024-09-17T01:07:10.023 INFO:tasks.workunit.client.1.smithi143.stdout:5/857: dwrite d1/d46/df/d23/d4f/f1d [0,4194304] 0 2024-09-17T01:07:10.027 INFO:tasks.workunit.client.1.smithi143.stdout:2/821: dwrite d0/d10/f101 [0,4194304] 0 2024-09-17T01:07:10.028 INFO:tasks.workunit.client.0.smithi103.stdout:9/335: dread d7/f3b [0,4194304] 0 2024-09-17T01:07:10.030 INFO:tasks.workunit.client.0.smithi103.stdout:3/342: creat d3/d16/d1b/d3c/d65/d75/f78 x:0 0 0 2024-09-17T01:07:10.030 INFO:tasks.workunit.client.1.smithi143.stdout:7/992: unlink d4/d1f/f52 0 2024-09-17T01:07:10.031 INFO:tasks.workunit.client.0.smithi103.stdout:3/343: write d3/d16/f1a [2174050,43043] 0 2024-09-17T01:07:10.032 INFO:tasks.workunit.client.0.smithi103.stdout:6/226: write d3/f4 [1716542,111524] 0 2024-09-17T01:07:10.033 INFO:tasks.workunit.client.0.smithi103.stdout:2/220: chown d6/da/d17/f1e 276 1 2024-09-17T01:07:10.034 INFO:tasks.workunit.client.0.smithi103.stdout:4/369: write d9/d16/f37 [234954,120078] 0 2024-09-17T01:07:10.037 INFO:tasks.workunit.client.1.smithi143.stdout:8/915: rename d9/d12/df4/f6e to d9/d23/d32/d11f/f14d 0 2024-09-17T01:07:10.038 INFO:tasks.workunit.client.0.smithi103.stdout:6/227: fsync f1 0 2024-09-17T01:07:10.039 INFO:tasks.workunit.client.0.smithi103.stdout:2/221: fsync d6/f44 0 2024-09-17T01:07:10.040 INFO:tasks.workunit.client.0.smithi103.stdout:6/228: chown d3/f9 1 1 2024-09-17T01:07:10.043 INFO:tasks.workunit.client.1.smithi143.stdout:9/843: creat d3/d39/f116 x:0 0 0 2024-09-17T01:07:10.045 INFO:tasks.workunit.client.0.smithi103.stdout:9/336: dread d7/d43/d48/d11/fb [0,4194304] 0 2024-09-17T01:07:10.045 INFO:tasks.workunit.client.0.smithi103.stdout:6/229: rename d3/d16/d21/l40 to d3/d16/d21/l4c 0 2024-09-17T01:07:10.046 INFO:tasks.workunit.client.0.smithi103.stdout:9/337: readlink d7/d43/d48/l39 0 2024-09-17T01:07:10.046 INFO:tasks.workunit.client.0.smithi103.stdout:6/230: readlink d3/l24 0 2024-09-17T01:07:10.048 INFO:tasks.workunit.client.1.smithi143.stdout:1/912: link d0/d6/f29 d0/d6/d43/f12e 0 2024-09-17T01:07:10.049 INFO:tasks.workunit.client.0.smithi103.stdout:1/396: getdents d2 0 2024-09-17T01:07:10.049 INFO:tasks.workunit.client.0.smithi103.stdout:4/370: symlink d9/d16/d23/d32/d64/l66 0 2024-09-17T01:07:10.050 INFO:tasks.workunit.client.0.smithi103.stdout:3/344: creat d3/d16/d1b/f79 x:0 0 0 2024-09-17T01:07:10.051 INFO:tasks.workunit.client.0.smithi103.stdout:2/222: mknod d6/da/d17/d42/c48 0 2024-09-17T01:07:10.052 INFO:tasks.workunit.client.0.smithi103.stdout:1/397: chown d2/de/f58 2 1 2024-09-17T01:07:10.053 INFO:tasks.workunit.client.1.smithi143.stdout:8/916: mkdir d9/d23/db4/d14e 0 2024-09-17T01:07:10.054 INFO:tasks.workunit.client.1.smithi143.stdout:4/904: fdatasync da/f54 0 2024-09-17T01:07:10.055 INFO:tasks.workunit.client.0.smithi103.stdout:2/223: chown d6/da/d17/d26/f32 0 1 2024-09-17T01:07:10.055 INFO:tasks.workunit.client.0.smithi103.stdout:4/371: creat d9/dc/f67 x:0 0 0 2024-09-17T01:07:10.056 INFO:tasks.workunit.client.0.smithi103.stdout:6/231: dwrite d3/d25/d26/d3a/f45 [0,4194304] 0 2024-09-17T01:07:10.058 INFO:tasks.workunit.client.0.smithi103.stdout:6/232: fdatasync d3/d16/d33/d3e/f41 0 2024-09-17T01:07:10.058 INFO:tasks.workunit.client.0.smithi103.stdout:9/338: link d7/d2d/f4c d7/d2d/f71 0 2024-09-17T01:07:10.059 INFO:tasks.workunit.client.0.smithi103.stdout:1/398: fsync d2/d1c/d28/d52/d69/f6c 0 2024-09-17T01:07:10.061 INFO:tasks.workunit.client.0.smithi103.stdout:3/345: truncate d3/f1d 463644 0 2024-09-17T01:07:10.061 INFO:tasks.workunit.client.0.smithi103.stdout:6/233: dread d3/d25/f37 [0,4194304] 0 2024-09-17T01:07:10.063 INFO:tasks.workunit.client.0.smithi103.stdout:4/372: creat d9/d16/d44/f68 x:0 0 0 2024-09-17T01:07:10.065 INFO:tasks.workunit.client.0.smithi103.stdout:2/224: creat d6/da/d17/d1a/d45/f49 x:0 0 0 2024-09-17T01:07:10.068 INFO:tasks.workunit.client.1.smithi143.stdout:2/822: dread d0/d2/d21/f62 [0,4194304] 0 2024-09-17T01:07:10.068 INFO:tasks.workunit.client.0.smithi103.stdout:9/339: write d7/f18 [1731376,10484] 0 2024-09-17T01:07:10.069 INFO:tasks.workunit.client.1.smithi143.stdout:9/844: dread d3/d39/d42/f54 [0,4194304] 0 2024-09-17T01:07:10.069 INFO:tasks.workunit.client.1.smithi143.stdout:7/993: creat d4/d1f/d98/df6/f13d x:0 0 0 2024-09-17T01:07:10.073 INFO:tasks.workunit.client.1.smithi143.stdout:0/818: dread d3/d5/f84 [0,4194304] 0 2024-09-17T01:07:10.073 INFO:tasks.workunit.client.0.smithi103.stdout:1/399: symlink d2/de/l80 0 2024-09-17T01:07:10.074 INFO:tasks.workunit.client.1.smithi143.stdout:8/917: creat d9/d12/d38/d58/d79/d13f/f14f x:0 0 0 2024-09-17T01:07:10.076 INFO:tasks.workunit.client.0.smithi103.stdout:6/234: mknod d3/d25/c4d 0 2024-09-17T01:07:10.076 INFO:tasks.workunit.client.1.smithi143.stdout:6/810: dwrite d2/d17/d6e/d26/dbd/f91 [0,4194304] 0 2024-09-17T01:07:10.077 INFO:tasks.workunit.client.0.smithi103.stdout:4/373: stat d9/d16/d23/d32/d4c/l59 0 2024-09-17T01:07:10.079 INFO:tasks.workunit.client.0.smithi103.stdout:2/225: creat d6/da/d3f/f4a x:0 0 0 2024-09-17T01:07:10.079 INFO:tasks.workunit.client.1.smithi143.stdout:7/994: chown d4/d1f/d29/d65/d5d/db1/f11c 312 1 2024-09-17T01:07:10.081 INFO:tasks.workunit.client.0.smithi103.stdout:9/340: rmdir d7/d43/d48/d11/d5c 39 2024-09-17T01:07:10.083 INFO:tasks.workunit.client.0.smithi103.stdout:9/341: truncate d7/d43/d48/d11/fb 850711 0 2024-09-17T01:07:10.083 INFO:tasks.workunit.client.0.smithi103.stdout:9/342: chown d7/d43/d48/l42 1648508 1 2024-09-17T01:07:10.084 INFO:tasks.workunit.client.1.smithi143.stdout:4/905: mkdir da/d68/d9b/d127 0 2024-09-17T01:07:10.086 INFO:tasks.workunit.client.1.smithi143.stdout:0/819: dwrite d3/d5/d8/d10/db3/fe0 [0,4194304] 0 2024-09-17T01:07:10.087 INFO:tasks.workunit.client.1.smithi143.stdout:8/918: symlink d9/d12/d38/d58/d79/d10d/l150 0 2024-09-17T01:07:10.089 INFO:tasks.workunit.client.1.smithi143.stdout:1/913: getdents d0/d6/d43/d6a/d52/db2/db6 0 2024-09-17T01:07:10.090 INFO:tasks.workunit.client.0.smithi103.stdout:6/235: fdatasync d3/d17/d2f/f34 0 2024-09-17T01:07:10.091 INFO:tasks.workunit.client.1.smithi143.stdout:9/845: dread d3/d3d/d48/fa7 [0,4194304] 0 2024-09-17T01:07:10.091 INFO:tasks.workunit.client.1.smithi143.stdout:3/881: dwrite d6/f90 [0,4194304] 0 2024-09-17T01:07:10.102 INFO:tasks.workunit.client.1.smithi143.stdout:7/995: readlink d4/d1f/d29/d65/d5d/db1/lbe 0 2024-09-17T01:07:10.102 INFO:tasks.workunit.client.1.smithi143.stdout:4/906: rmdir da/d3a/d3e/d72/da3/dc0/df1 39 2024-09-17T01:07:10.104 INFO:tasks.workunit.client.1.smithi143.stdout:8/919: readlink d9/d12/d38/d7a/d8f/l11d 0 2024-09-17T01:07:10.104 INFO:tasks.workunit.client.1.smithi143.stdout:4/907: write da/d3a/d3e/d4a/d8c/fbd [2980948,16601] 0 2024-09-17T01:07:10.106 INFO:tasks.workunit.client.1.smithi143.stdout:4/908: chown da/d3a/d40/ce9 40844966 1 2024-09-17T01:07:10.106 INFO:tasks.workunit.client.1.smithi143.stdout:0/820: dread d3/d5/d8/d21/f49 [0,4194304] 0 2024-09-17T01:07:10.108 INFO:tasks.workunit.client.1.smithi143.stdout:2/823: truncate d0/d10/d58/d5a/d5b/d4c/d59/f9a 2649838 0 2024-09-17T01:07:10.110 INFO:tasks.workunit.client.1.smithi143.stdout:2/824: write d0/d2/d21/f32 [6656820,9423] 0 2024-09-17T01:07:10.110 INFO:tasks.workunit.client.1.smithi143.stdout:6/811: rename d2/df/d20/l4f to d2/l110 0 2024-09-17T01:07:10.113 INFO:tasks.workunit.client.1.smithi143.stdout:4/909: unlink da/d3a/d3e/d4a/c97 0 2024-09-17T01:07:10.114 INFO:tasks.workunit.client.1.smithi143.stdout:3/882: truncate d6/f58 537729 0 2024-09-17T01:07:10.115 INFO:tasks.workunit.client.1.smithi143.stdout:1/914: write d0/dc/fd7 [580707,38769] 0 2024-09-17T01:07:10.117 INFO:tasks.workunit.client.1.smithi143.stdout:6/812: unlink d2/d30/dc1/fc8 0 2024-09-17T01:07:10.117 INFO:tasks.workunit.client.1.smithi143.stdout:6/813: readlink d2/d17/d6e/d26/d46/lc5 0 2024-09-17T01:07:10.117 INFO:tasks.workunit.client.1.smithi143.stdout:3/883: read d6/d1c/d33/d3f/d5c/da1/fdb [2767767,86111] 0 2024-09-17T01:07:10.118 INFO:tasks.workunit.client.0.smithi103.stdout:4/374: unlink d9/f21 0 2024-09-17T01:07:10.118 INFO:tasks.workunit.client.1.smithi143.stdout:2/825: rename d0/d10/d58/d5a/d5b/d4c/d71/d99/d106 to d0/d44/d6a/d91/dc4/d111 0 2024-09-17T01:07:10.119 INFO:tasks.workunit.client.0.smithi103.stdout:9/343: rename d7/d43/f63 to d7/d2d/f72 0 2024-09-17T01:07:10.119 INFO:tasks.workunit.client.0.smithi103.stdout:1/400: dwrite d2/d16/d51/d65/f71 [0,4194304] 0 2024-09-17T01:07:10.120 INFO:tasks.workunit.client.0.smithi103.stdout:3/346: creat d3/f7a x:0 0 0 2024-09-17T01:07:10.121 INFO:tasks.workunit.client.0.smithi103.stdout:3/347: chown d3/d16/d1b 923 1 2024-09-17T01:07:10.121 INFO:tasks.workunit.client.0.smithi103.stdout:1/401: readlink d2/d7/l23 0 2024-09-17T01:07:10.122 INFO:tasks.workunit.client.1.smithi143.stdout:9/846: write d3/d3d/f10b [1185828,108519] 0 2024-09-17T01:07:10.123 INFO:tasks.workunit.client.1.smithi143.stdout:9/847: chown d3/d39/d42/d80/df3/d99 92894 1 2024-09-17T01:07:10.124 INFO:tasks.workunit.client.1.smithi143.stdout:4/910: creat da/d3a/d3e/d5e/d63/f128 x:0 0 0 2024-09-17T01:07:10.126 INFO:tasks.workunit.client.1.smithi143.stdout:5/858: sync 2024-09-17T01:07:10.127 INFO:tasks.workunit.client.1.smithi143.stdout:7/996: getdents d4/d1f/d4a/d66/db5/d139 0 2024-09-17T01:07:10.127 INFO:tasks.workunit.client.1.smithi143.stdout:5/859: dread - d1/d46/f123 zero size 2024-09-17T01:07:10.129 INFO:tasks.workunit.client.1.smithi143.stdout:5/860: write d1/d96/fef [693493,90596] 0 2024-09-17T01:07:10.131 INFO:tasks.workunit.client.1.smithi143.stdout:5/861: read d1/d46/df/d23/f4e [1090000,124746] 0 2024-09-17T01:07:10.132 INFO:tasks.workunit.client.1.smithi143.stdout:5/862: fsync d1/d46/d6e/db7/fcd 0 2024-09-17T01:07:10.137 INFO:tasks.workunit.client.1.smithi143.stdout:6/814: mknod d2/d17/d6e/db0/c111 0 2024-09-17T01:07:10.138 INFO:tasks.workunit.client.1.smithi143.stdout:2/826: dread - d0/d10/f5c zero size 2024-09-17T01:07:10.138 INFO:tasks.workunit.client.1.smithi143.stdout:0/821: dwrite d3/d5/d8/d27/d31/d85/fcf [0,4194304] 0 2024-09-17T01:07:10.138 INFO:tasks.workunit.client.1.smithi143.stdout:9/848: rmdir d3/d3d/d48 39 2024-09-17T01:07:10.143 INFO:tasks.workunit.client.1.smithi143.stdout:7/997: mknod d4/d1f/d4a/de4/d4e/c13e 0 2024-09-17T01:07:10.146 INFO:tasks.workunit.client.1.smithi143.stdout:5/863: creat d1/d46/df/d23/d4f/d82/da6/f139 x:0 0 0 2024-09-17T01:07:10.146 INFO:tasks.workunit.client.1.smithi143.stdout:8/920: getdents d9/d12 0 2024-09-17T01:07:10.147 INFO:tasks.workunit.client.1.smithi143.stdout:0/822: dread - d3/d5/d8/d27/d31/d48/d72/df3/f104 zero size 2024-09-17T01:07:10.149 INFO:tasks.workunit.client.1.smithi143.stdout:7/998: chown d4/l59 506 1 2024-09-17T01:07:10.149 INFO:tasks.workunit.client.1.smithi143.stdout:1/915: mkdir d0/d6/d43/d6a/d107/ddd/d12f 0 2024-09-17T01:07:10.150 INFO:tasks.workunit.client.1.smithi143.stdout:3/884: symlink d6/l10a 0 2024-09-17T01:07:10.152 INFO:tasks.workunit.client.1.smithi143.stdout:4/911: unlink da/c30 0 2024-09-17T01:07:10.154 INFO:tasks.workunit.client.1.smithi143.stdout:5/864: rmdir d1/d5e 39 2024-09-17T01:07:10.156 INFO:tasks.workunit.client.1.smithi143.stdout:0/823: dread d3/d5/d8/f44 [0,4194304] 0 2024-09-17T01:07:10.156 INFO:tasks.workunit.client.1.smithi143.stdout:8/921: rename d9/d23/db4/d55/d57/d108/f14c to d9/d26/f151 0 2024-09-17T01:07:10.157 INFO:tasks.workunit.client.1.smithi143.stdout:7/999: creat d4/d16/dbd/d104/f13f x:0 0 0 2024-09-17T01:07:10.158 INFO:tasks.workunit.client.1.smithi143.stdout:0/824: fdatasync d3/d14/f61 0 2024-09-17T01:07:10.158 INFO:tasks.workunit.client.1.smithi143.stdout:1/916: creat d0/d6/d43/d47/d88/da5/f130 x:0 0 0 2024-09-17T01:07:10.159 INFO:tasks.workunit.client.1.smithi143.stdout:6/815: truncate d2/df/d20/d2c/d75/f71 370925 0 2024-09-17T01:07:10.163 INFO:tasks.workunit.client.1.smithi143.stdout:2/827: getdents d0/d10/d58/d5a/d5b/d4c/d71/d9d 0 2024-09-17T01:07:10.166 INFO:tasks.workunit.client.1.smithi143.stdout:1/917: fsync d0/d6/d43/d47/dbf/deb/df9/f128 0 2024-09-17T01:07:10.166 INFO:tasks.workunit.client.1.smithi143.stdout:6/816: rmdir d2/d17 39 2024-09-17T01:07:10.174 INFO:tasks.workunit.client.1.smithi143.stdout:3/885: dwrite d6/d1c/d33/d41/d42/fb7 [4194304,4194304] 0 2024-09-17T01:07:10.175 INFO:tasks.workunit.client.1.smithi143.stdout:5/865: dwrite d1/d46/df/d1f/f30 [0,4194304] 0 2024-09-17T01:07:10.182 INFO:tasks.workunit.client.1.smithi143.stdout:8/922: dwrite d9/d23/db4/d55/dfe/f94 [4194304,4194304] 0 2024-09-17T01:07:10.183 INFO:tasks.workunit.client.1.smithi143.stdout:2/828: symlink d0/d10/d58/d5a/d5b/d4c/d71/d9f/l112 0 2024-09-17T01:07:10.185 INFO:tasks.workunit.client.1.smithi143.stdout:3/886: dread - d6/d1c/d33/d41/d2b/f100 zero size 2024-09-17T01:07:10.188 INFO:tasks.workunit.client.1.smithi143.stdout:1/918: chown d0/d6/d43/d47/d88/c97 2300 1 2024-09-17T01:07:10.189 INFO:tasks.workunit.client.1.smithi143.stdout:9/849: dwrite d3/d39/d6a/dc3/f1d [0,4194304] 0 2024-09-17T01:07:10.189 INFO:tasks.workunit.client.1.smithi143.stdout:5/866: readlink d1/d46/df/d1f/d7a/le7 0 2024-09-17T01:07:10.194 INFO:tasks.workunit.client.1.smithi143.stdout:0/825: dwrite d3/d5/d8/d27/d31/d4c/f6d [0,4194304] 0 2024-09-17T01:07:10.194 INFO:tasks.workunit.client.1.smithi143.stdout:2/829: write d0/d2/d21/d84/d8d/fbb [3919897,59466] 0 2024-09-17T01:07:10.194 INFO:tasks.workunit.client.1.smithi143.stdout:8/923: creat d9/d23/db4/d55/dbf/f152 x:0 0 0 2024-09-17T01:07:10.196 INFO:tasks.workunit.client.1.smithi143.stdout:3/887: readlink d6/d1c/d33/d41/d2b/l49 0 2024-09-17T01:07:10.197 INFO:tasks.workunit.client.1.smithi143.stdout:8/924: stat d9/d26/fec 0 2024-09-17T01:07:10.199 INFO:tasks.workunit.client.1.smithi143.stdout:8/925: symlink d9/d23/d32/l153 0 2024-09-17T01:07:10.199 INFO:tasks.workunit.client.1.smithi143.stdout:2/830: truncate d0/d44/dd6/fdb 805069 0 2024-09-17T01:07:10.200 INFO:tasks.workunit.client.1.smithi143.stdout:3/888: symlink d6/d1c/d33/d3f/d79/dc6/l10b 0 2024-09-17T01:07:10.201 INFO:tasks.workunit.client.0.smithi103.stdout:4/375: unlink d9/d16/d23/d52/l5b 0 2024-09-17T01:07:10.201 INFO:tasks.workunit.client.1.smithi143.stdout:0/826: creat d3/d68/d8f/ddb/de8/daf/dcb/f10a x:0 0 0 2024-09-17T01:07:10.202 INFO:tasks.workunit.client.1.smithi143.stdout:9/850: mknod d3/d39/d6a/dc3/c117 0 2024-09-17T01:07:10.203 INFO:tasks.workunit.client.1.smithi143.stdout:0/827: dread - d3/d14/d32/ffc zero size 2024-09-17T01:07:10.203 INFO:tasks.workunit.client.1.smithi143.stdout:2/831: rmdir d0/d10/d58/d5a 39 2024-09-17T01:07:10.203 INFO:tasks.workunit.client.0.smithi103.stdout:4/376: chown d9/d16/d23/d32/d61 15 1 2024-09-17T01:07:10.203 INFO:tasks.workunit.client.0.smithi103.stdout:3/348: symlink d3/d16/d1b/d2c/d5c/l7b 0 2024-09-17T01:07:10.204 INFO:tasks.workunit.client.1.smithi143.stdout:8/926: creat d9/d12/d4b/f154 x:0 0 0 2024-09-17T01:07:10.205 INFO:tasks.workunit.client.1.smithi143.stdout:8/927: chown d9/l13e 29119 1 2024-09-17T01:07:10.205 INFO:tasks.workunit.client.0.smithi103.stdout:1/402: mkdir d2/d7/d73/d81 0 2024-09-17T01:07:10.207 INFO:tasks.workunit.client.1.smithi143.stdout:6/817: rename d2/d30/db4/cd3 to d2/d17/d6e/d26/d46/c112 0 2024-09-17T01:07:10.207 INFO:tasks.workunit.client.0.smithi103.stdout:9/344: symlink d7/d43/d48/d11/d5c/d5e/d6c/l73 0 2024-09-17T01:07:10.208 INFO:tasks.workunit.client.0.smithi103.stdout:4/377: mknod d9/d16/d23/d52/c69 0 2024-09-17T01:07:10.209 INFO:tasks.workunit.client.1.smithi143.stdout:2/832: dwrite d0/d10/d56/f6d [0,4194304] 0 2024-09-17T01:07:10.209 INFO:tasks.workunit.client.0.smithi103.stdout:4/378: dread - d9/d16/d23/d2a/f5c zero size 2024-09-17T01:07:10.210 INFO:tasks.workunit.client.0.smithi103.stdout:4/379: fdatasync d9/d16/d23/d2a/f5c 0 2024-09-17T01:07:10.211 INFO:tasks.workunit.client.0.smithi103.stdout:3/349: mkdir d3/d16/d1b/d3c/d65/d7c 0 2024-09-17T01:07:10.214 INFO:tasks.workunit.client.0.smithi103.stdout:9/345: rename d7/d43/d48/f2f to d7/d43/d48/d11/d21/f74 0 2024-09-17T01:07:10.215 INFO:tasks.workunit.client.1.smithi143.stdout:9/851: mkdir d3/d3d/d118 0 2024-09-17T01:07:10.215 INFO:tasks.workunit.client.0.smithi103.stdout:4/380: dread d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:10.216 INFO:tasks.workunit.client.1.smithi143.stdout:6/818: mknod d2/d17/d6e/d26/d46/d66/c113 0 2024-09-17T01:07:10.218 INFO:tasks.workunit.client.1.smithi143.stdout:6/819: chown d2/d17/d6e/d26/dbd/ce1 138506 1 2024-09-17T01:07:10.218 INFO:tasks.workunit.client.0.smithi103.stdout:1/403: link d2/d1c/f38 d2/d1c/d28/d52/d69/f82 0 2024-09-17T01:07:10.220 INFO:tasks.workunit.client.1.smithi143.stdout:2/833: mknod d0/d2/d21/d84/c113 0 2024-09-17T01:07:10.221 INFO:tasks.workunit.client.0.smithi103.stdout:3/350: symlink d3/d16/d1b/l7d 0 2024-09-17T01:07:10.221 INFO:tasks.workunit.client.1.smithi143.stdout:6/820: stat d2/d17/d6e/fa7 0 2024-09-17T01:07:10.222 INFO:tasks.workunit.client.0.smithi103.stdout:1/404: dread d2/f68 [0,4194304] 0 2024-09-17T01:07:10.223 INFO:tasks.workunit.client.1.smithi143.stdout:9/852: dwrite d3/d39/d42/dab/d108/d51/db7/fec [0,4194304] 0 2024-09-17T01:07:10.223 INFO:tasks.workunit.client.1.smithi143.stdout:8/928: rename d9/d23/d32/l82 to d9/d23/l155 0 2024-09-17T01:07:10.227 INFO:tasks.workunit.client.1.smithi143.stdout:6/821: creat d2/df/d18/d69/f114 x:0 0 0 2024-09-17T01:07:10.228 INFO:tasks.workunit.client.0.smithi103.stdout:3/351: mkdir d3/d16/d1b/d3c/d65/d7e 0 2024-09-17T01:07:10.230 INFO:tasks.workunit.client.0.smithi103.stdout:1/405: readlink d2/d16/l3a 0 2024-09-17T01:07:10.230 INFO:tasks.workunit.client.1.smithi143.stdout:8/929: fdatasync d9/d23/d32/d11f/f14d 0 2024-09-17T01:07:10.232 INFO:tasks.workunit.client.1.smithi143.stdout:6/822: symlink d2/d17/d6e/d26/d46/d65/l115 0 2024-09-17T01:07:10.232 INFO:tasks.workunit.client.0.smithi103.stdout:4/381: link d9/d16/d23/d52/c69 d9/d16/d23/d2a/c6a 0 2024-09-17T01:07:10.233 INFO:tasks.workunit.client.0.smithi103.stdout:4/382: write d9/d16/d23/d2a/f50 [513908,115103] 0 2024-09-17T01:07:10.234 INFO:tasks.workunit.client.0.smithi103.stdout:3/352: unlink d3/d16/d1b/d3c/l4c 0 2024-09-17T01:07:10.235 INFO:tasks.workunit.client.0.smithi103.stdout:4/383: write d9/d16/f37 [672681,90550] 0 2024-09-17T01:07:10.235 INFO:tasks.workunit.client.0.smithi103.stdout:1/406: creat d2/d1c/d20/f83 x:0 0 0 2024-09-17T01:07:10.236 INFO:tasks.workunit.client.0.smithi103.stdout:4/384: write d9/d16/d44/f4f [1369659,95362] 0 2024-09-17T01:07:10.237 INFO:tasks.workunit.client.1.smithi143.stdout:6/823: creat d2/df/f116 x:0 0 0 2024-09-17T01:07:10.239 INFO:tasks.workunit.client.0.smithi103.stdout:6/236: dread d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:10.239 INFO:tasks.workunit.client.1.smithi143.stdout:5/867: dread d1/d46/df/d53/f85 [0,4194304] 0 2024-09-17T01:07:10.240 INFO:tasks.workunit.client.0.smithi103.stdout:6/237: dread - d3/d16/d21/f39 zero size 2024-09-17T01:07:10.240 INFO:tasks.workunit.client.1.smithi143.stdout:8/930: unlink d9/de/lf 0 2024-09-17T01:07:10.241 INFO:tasks.workunit.client.1.smithi143.stdout:9/853: link d3/d39/d42/d80/df3/d99/ff0 d3/d3d/d118/f119 0 2024-09-17T01:07:10.242 INFO:tasks.workunit.client.0.smithi103.stdout:1/407: write d2/d7/d4e/f7b [3382350,103991] 0 2024-09-17T01:07:10.243 INFO:tasks.workunit.client.0.smithi103.stdout:4/385: creat d9/d2d/d55/f6b x:0 0 0 2024-09-17T01:07:10.244 INFO:tasks.workunit.client.0.smithi103.stdout:6/238: symlink d3/d25/l4e 0 2024-09-17T01:07:10.244 INFO:tasks.workunit.client.1.smithi143.stdout:5/868: chown d1/d46/df/d23/d4f/d7d/d92/c132 68210596 1 2024-09-17T01:07:10.245 INFO:tasks.workunit.client.0.smithi103.stdout:6/239: fsync d3/d16/f2d 0 2024-09-17T01:07:10.245 INFO:tasks.workunit.client.1.smithi143.stdout:6/824: dread d2/d30/d84/f108 [0,4194304] 0 2024-09-17T01:07:10.246 INFO:tasks.workunit.client.0.smithi103.stdout:3/353: creat d3/f7f x:0 0 0 2024-09-17T01:07:10.247 INFO:tasks.workunit.client.1.smithi143.stdout:8/931: creat d9/d12/d38/d58/d79/d9b/d12b/f156 x:0 0 0 2024-09-17T01:07:10.248 INFO:tasks.workunit.client.1.smithi143.stdout:5/869: creat d1/d46/d6e/f13a x:0 0 0 2024-09-17T01:07:10.250 INFO:tasks.workunit.client.1.smithi143.stdout:2/834: dread d0/d44/f5d [0,4194304] 0 2024-09-17T01:07:10.251 INFO:tasks.workunit.client.0.smithi103.stdout:1/408: rename d2/d1c/d28/c2f to d2/d1c/d20/c84 0 2024-09-17T01:07:10.251 INFO:tasks.workunit.client.0.smithi103.stdout:4/386: chown d9/d16/d23/d52/c69 60320 1 2024-09-17T01:07:10.251 INFO:tasks.workunit.client.0.smithi103.stdout:4/387: chown d9/d16/d44 405 1 2024-09-17T01:07:10.252 INFO:tasks.workunit.client.1.smithi143.stdout:5/870: creat d1/d46/d6e/db7/f13b x:0 0 0 2024-09-17T01:07:10.252 INFO:tasks.workunit.client.0.smithi103.stdout:1/409: write d2/d1c/d20/d33/f57 [732876,116724] 0 2024-09-17T01:07:10.254 INFO:tasks.workunit.client.1.smithi143.stdout:6/825: dwrite d2/d30/d84/fe0 [0,4194304] 0 2024-09-17T01:07:10.254 INFO:tasks.workunit.client.0.smithi103.stdout:6/240: creat d3/f4f x:0 0 0 2024-09-17T01:07:10.256 INFO:tasks.workunit.client.0.smithi103.stdout:3/354: creat d3/d16/d1b/f80 x:0 0 0 2024-09-17T01:07:10.258 INFO:tasks.workunit.client.1.smithi143.stdout:5/871: chown d1/d5e/fb2 2758769 1 2024-09-17T01:07:10.259 INFO:tasks.workunit.client.0.smithi103.stdout:1/410: dread d2/d1c/d20/d33/f59 [0,4194304] 0 2024-09-17T01:07:10.260 INFO:tasks.workunit.client.0.smithi103.stdout:4/388: dwrite f3 [0,4194304] 0 2024-09-17T01:07:10.261 INFO:tasks.workunit.client.1.smithi143.stdout:8/932: creat d9/d12/d38/d7a/f157 x:0 0 0 2024-09-17T01:07:10.268 INFO:tasks.workunit.client.1.smithi143.stdout:5/872: unlink d1/d46/df/d53/l5b 0 2024-09-17T01:07:10.270 INFO:tasks.workunit.client.1.smithi143.stdout:8/933: readlink d9/d23/db4/d55/la6 0 2024-09-17T01:07:10.270 INFO:tasks.workunit.client.0.smithi103.stdout:3/355: mkdir d3/d81 0 2024-09-17T01:07:10.274 INFO:tasks.workunit.client.1.smithi143.stdout:0/828: dwrite d3/d14/f60 [0,4194304] 0 2024-09-17T01:07:10.274 INFO:tasks.workunit.client.1.smithi143.stdout:5/873: mkdir d1/d46/df/d23/d4f/d7d/dcf/dc5/d13c 0 2024-09-17T01:07:10.275 INFO:tasks.workunit.client.0.smithi103.stdout:3/356: creat d3/d16/d1b/d2c/d5c/f82 x:0 0 0 2024-09-17T01:07:10.277 INFO:tasks.workunit.client.0.smithi103.stdout:3/357: dread - d3/d16/d1b/d36/f67 zero size 2024-09-17T01:07:10.280 INFO:tasks.workunit.client.0.smithi103.stdout:9/346: creat d7/d43/d48/d11/d20/d4f/f75 x:0 0 0 2024-09-17T01:07:10.281 INFO:tasks.workunit.client.1.smithi143.stdout:6/826: creat d2/d17/d6e/f117 x:0 0 0 2024-09-17T01:07:10.282 INFO:tasks.workunit.client.1.smithi143.stdout:2/835: getdents d0/d44/d6a/d91/dc4 0 2024-09-17T01:07:10.283 INFO:tasks.workunit.client.0.smithi103.stdout:3/358: mkdir d3/d16/d1b/d3c/d65/d83 0 2024-09-17T01:07:10.287 INFO:tasks.workunit.client.0.smithi103.stdout:9/347: rename d7/f3c to d7/d43/d48/d11/d20/d4f/f76 0 2024-09-17T01:07:10.288 INFO:tasks.workunit.client.1.smithi143.stdout:0/829: creat d3/d5/d8/d27/d31/d48/d72/f10b x:0 0 0 2024-09-17T01:07:10.288 INFO:tasks.workunit.client.0.smithi103.stdout:1/411: getdents d2/d16/d51/d65 0 2024-09-17T01:07:10.289 INFO:tasks.workunit.client.1.smithi143.stdout:5/874: creat d1/d46/df/d23/d4f/d82/f13d x:0 0 0 2024-09-17T01:07:10.290 INFO:tasks.workunit.client.0.smithi103.stdout:3/359: creat d3/d16/d1b/d3c/d65/d75/f84 x:0 0 0 2024-09-17T01:07:10.291 INFO:tasks.workunit.client.0.smithi103.stdout:3/360: fsync d3/d16/f2d 0 2024-09-17T01:07:10.293 INFO:tasks.workunit.client.1.smithi143.stdout:0/830: dwrite d3/d5/d8/d27/d31/d85/fa1 [4194304,4194304] 0 2024-09-17T01:07:10.295 INFO:tasks.workunit.client.0.smithi103.stdout:9/348: read d7/d43/d48/f38 [60547,73202] 0 2024-09-17T01:07:10.297 INFO:tasks.workunit.client.0.smithi103.stdout:3/361: mkdir d3/d16/d1b/d2c/d34/d85 0 2024-09-17T01:07:10.298 INFO:tasks.workunit.client.0.smithi103.stdout:3/362: write d3/d16/d1b/f46 [4155493,63524] 0 2024-09-17T01:07:10.301 INFO:tasks.workunit.client.1.smithi143.stdout:4/912: sync 2024-09-17T01:07:10.303 INFO:tasks.workunit.client.1.smithi143.stdout:9/854: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:07:10.308 INFO:tasks.workunit.client.0.smithi103.stdout:6/241: write d3/d16/f1b [521592,45283] 0 2024-09-17T01:07:10.308 INFO:tasks.workunit.client.0.smithi103.stdout:9/349: dread d7/d43/d48/f23 [0,4194304] 0 2024-09-17T01:07:10.315 INFO:tasks.workunit.client.0.smithi103.stdout:6/242: mkdir d3/d16/d21/d50 0 2024-09-17T01:07:10.316 INFO:tasks.workunit.client.0.smithi103.stdout:6/243: readlink d3/d17/l47 0 2024-09-17T01:07:10.318 INFO:tasks.workunit.client.0.smithi103.stdout:7/293: sync 2024-09-17T01:07:10.320 INFO:tasks.workunit.client.0.smithi103.stdout:7/294: write d4/d10/d43/f57 [2828793,33268] 0 2024-09-17T01:07:10.320 INFO:tasks.workunit.client.0.smithi103.stdout:6/244: dread d3/d16/f1b [0,4194304] 0 2024-09-17T01:07:10.321 INFO:tasks.workunit.client.0.smithi103.stdout:3/363: dread d3/d16/d1b/d3c/f35 [0,4194304] 0 2024-09-17T01:07:10.325 INFO:tasks.workunit.client.1.smithi143.stdout:3/889: sync 2024-09-17T01:07:10.325 INFO:tasks.workunit.client.1.smithi143.stdout:1/919: sync 2024-09-17T01:07:10.327 INFO:tasks.workunit.client.0.smithi103.stdout:6/245: creat d3/d16/d33/d3e/f51 x:0 0 0 2024-09-17T01:07:10.332 INFO:tasks.workunit.client.0.smithi103.stdout:3/364: mkdir d3/d16/d1b/d86 0 2024-09-17T01:07:10.334 INFO:tasks.workunit.client.0.smithi103.stdout:6/246: dwrite d3/d25/d26/d3a/f45 [0,4194304] 0 2024-09-17T01:07:10.335 INFO:tasks.workunit.client.0.smithi103.stdout:6/247: write d3/f18 [890081,11014] 0 2024-09-17T01:07:10.337 INFO:tasks.workunit.client.0.smithi103.stdout:6/248: truncate d3/d25/d26/d3a/f44 306154 0 2024-09-17T01:07:10.338 INFO:tasks.workunit.client.0.smithi103.stdout:6/249: readlink d3/d16/l19 0 2024-09-17T01:07:10.338 INFO:tasks.workunit.client.0.smithi103.stdout:6/250: readlink d3/d17/l47 0 2024-09-17T01:07:10.339 INFO:tasks.workunit.client.0.smithi103.stdout:9/350: write d7/f2a [1483286,81195] 0 2024-09-17T01:07:10.342 INFO:tasks.workunit.client.0.smithi103.stdout:3/365: dread d3/d16/f3d [0,4194304] 0 2024-09-17T01:07:10.346 INFO:tasks.workunit.client.0.smithi103.stdout:6/251: symlink d3/d16/d21/d50/l52 0 2024-09-17T01:07:10.349 INFO:tasks.workunit.client.0.smithi103.stdout:3/366: unlink d3/d16/d1b/d3c/d65/f6b 0 2024-09-17T01:07:10.352 INFO:tasks.workunit.client.0.smithi103.stdout:3/367: chown d3/d16/d1b/d3c/d65/d7c 114039 1 2024-09-17T01:07:10.354 INFO:tasks.workunit.client.0.smithi103.stdout:9/351: dwrite d7/d43/d48/f23 [0,4194304] 0 2024-09-17T01:07:10.354 INFO:tasks.workunit.client.0.smithi103.stdout:6/252: unlink d3/d16/l31 0 2024-09-17T01:07:10.355 INFO:tasks.workunit.client.0.smithi103.stdout:7/295: dwrite d4/fd [4194304,4194304] 0 2024-09-17T01:07:10.365 INFO:tasks.workunit.client.0.smithi103.stdout:3/368: dwrite d3/d44/f4a [0,4194304] 0 2024-09-17T01:07:10.367 INFO:tasks.workunit.client.0.smithi103.stdout:6/253: dwrite d3/d16/d33/d3e/f43 [0,4194304] 0 2024-09-17T01:07:10.367 INFO:tasks.workunit.client.0.smithi103.stdout:7/296: rename d4/d11/d34/d3d/f45 to d4/d10/d4e/f69 0 2024-09-17T01:07:10.372 INFO:tasks.workunit.client.1.smithi143.stdout:2/836: creat d0/d44/d7a/f114 x:0 0 0 2024-09-17T01:07:10.379 INFO:tasks.workunit.client.0.smithi103.stdout:6/254: mkdir d3/d16/d33/d53 0 2024-09-17T01:07:10.380 INFO:tasks.workunit.client.1.smithi143.stdout:5/875: symlink d1/d46/df/d23/d4f/d7d/d102/d115/l13e 0 2024-09-17T01:07:10.382 INFO:tasks.workunit.client.0.smithi103.stdout:7/297: symlink d4/d11/d2b/d36/d3a/d51/d5e/l6a 0 2024-09-17T01:07:10.383 INFO:tasks.workunit.client.1.smithi143.stdout:0/831: mkdir d3/d5/d8/d21/d2e/d10c 0 2024-09-17T01:07:10.385 INFO:tasks.workunit.client.1.smithi143.stdout:4/913: write da/d3a/f10e [1232068,27971] 0 2024-09-17T01:07:10.385 INFO:tasks.workunit.client.1.smithi143.stdout:4/914: readlink da/d6d/l92 0 2024-09-17T01:07:10.386 INFO:tasks.workunit.client.0.smithi103.stdout:9/352: getdents d7 0 2024-09-17T01:07:10.387 INFO:tasks.workunit.client.1.smithi143.stdout:9/855: chown d3/d39/f4b 935 1 2024-09-17T01:07:10.388 INFO:tasks.workunit.client.1.smithi143.stdout:1/920: creat d0/d6/d43/d47/d88/f131 x:0 0 0 2024-09-17T01:07:10.389 INFO:tasks.workunit.client.0.smithi103.stdout:7/298: dwrite d4/d10/d66/f58 [0,4194304] 0 2024-09-17T01:07:10.391 INFO:tasks.workunit.client.1.smithi143.stdout:4/915: dwrite da/d3a/d3e/d5e/d63/d80/fec [0,4194304] 0 2024-09-17T01:07:10.392 INFO:tasks.workunit.client.0.smithi103.stdout:3/369: link d3/cb d3/d16/d1b/d3c/d65/c87 0 2024-09-17T01:07:10.399 INFO:tasks.workunit.client.1.smithi143.stdout:8/934: truncate d9/d12/d38/d58/dda/dea/ffc 3469519 0 2024-09-17T01:07:10.400 INFO:tasks.workunit.client.0.smithi103.stdout:6/255: truncate d3/d16/d33/d3e/f41 29187 0 2024-09-17T01:07:10.400 INFO:tasks.workunit.client.1.smithi143.stdout:4/916: dwrite da/d3a/d3e/d72/f121 [0,4194304] 0 2024-09-17T01:07:10.401 INFO:tasks.workunit.client.0.smithi103.stdout:6/256: dread - d3/d17/f32 zero size 2024-09-17T01:07:10.402 INFO:tasks.workunit.client.1.smithi143.stdout:0/832: write d3/d5/d8/f44 [2105407,73843] 0 2024-09-17T01:07:10.403 INFO:tasks.workunit.client.1.smithi143.stdout:1/921: dread d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/fa6 [0,4194304] 0 2024-09-17T01:07:10.406 INFO:tasks.workunit.client.1.smithi143.stdout:0/833: chown d3/d5/d8/d21/d2e/dda 61100 1 2024-09-17T01:07:10.406 INFO:tasks.workunit.client.1.smithi143.stdout:6/827: dwrite d2/d30/d45/d70/da5/fc3 [0,4194304] 0 2024-09-17T01:07:10.410 INFO:tasks.workunit.client.0.smithi103.stdout:7/299: mkdir d4/d10/d6b 0 2024-09-17T01:07:10.413 INFO:tasks.workunit.client.1.smithi143.stdout:8/935: fsync d9/d12/df4/f119 0 2024-09-17T01:07:10.414 INFO:tasks.workunit.client.0.smithi103.stdout:7/300: creat d4/d11/d34/d3d/f6c x:0 0 0 2024-09-17T01:07:10.415 INFO:tasks.workunit.client.0.smithi103.stdout:3/370: link d3/l76 d3/d16/d1b/d2c/l88 0 2024-09-17T01:07:10.415 INFO:tasks.workunit.client.0.smithi103.stdout:7/301: chown c3 1 1 2024-09-17T01:07:10.416 INFO:tasks.workunit.client.0.smithi103.stdout:3/371: chown d3/f59 618962 1 2024-09-17T01:07:10.416 INFO:tasks.workunit.client.0.smithi103.stdout:3/372: readlink d3/l12 0 2024-09-17T01:07:10.416 INFO:tasks.workunit.client.0.smithi103.stdout:7/302: chown d4/d10/l54 143 1 2024-09-17T01:07:10.416 INFO:tasks.workunit.client.0.smithi103.stdout:3/373: fdatasync d3/f57 0 2024-09-17T01:07:10.417 INFO:tasks.workunit.client.1.smithi143.stdout:6/828: creat d2/df/d20/d2c/f118 x:0 0 0 2024-09-17T01:07:10.417 INFO:tasks.workunit.client.0.smithi103.stdout:7/303: write d4/d10/f25 [4592767,107054] 0 2024-09-17T01:07:10.418 INFO:tasks.workunit.client.0.smithi103.stdout:3/374: dread - d3/d16/d1b/d3c/f4f zero size 2024-09-17T01:07:10.418 INFO:tasks.workunit.client.0.smithi103.stdout:7/304: dread - d4/d10/f35 zero size 2024-09-17T01:07:10.421 INFO:tasks.workunit.client.1.smithi143.stdout:3/890: rename d6/d1c/d33/d41/d2e to d6/d1c/d10c 0 2024-09-17T01:07:10.422 INFO:tasks.workunit.client.1.smithi143.stdout:4/917: symlink da/d3a/d3e/d72/da3/dc0/df1/l129 0 2024-09-17T01:07:10.423 INFO:tasks.workunit.client.1.smithi143.stdout:8/936: dwrite d9/d23/d32/f117 [0,4194304] 0 2024-09-17T01:07:10.424 INFO:tasks.workunit.client.1.smithi143.stdout:0/834: mkdir d3/d14/d10d 0 2024-09-17T01:07:10.425 INFO:tasks.workunit.client.0.smithi103.stdout:3/375: creat d3/d16/d1b/f89 x:0 0 0 2024-09-17T01:07:10.427 INFO:tasks.workunit.client.1.smithi143.stdout:5/876: rename d1/d46/df/d1f/d66/c75 to d1/d96/c13f 0 2024-09-17T01:07:10.428 INFO:tasks.workunit.client.1.smithi143.stdout:3/891: unlink d6/d1c/d10c/d30/fd6 0 2024-09-17T01:07:10.430 INFO:tasks.workunit.client.1.smithi143.stdout:6/829: mkdir d2/d17/d6e/d119 0 2024-09-17T01:07:10.431 INFO:tasks.workunit.client.1.smithi143.stdout:0/835: mkdir d3/d5/d8/d10/db3/d10e 0 2024-09-17T01:07:10.432 INFO:tasks.workunit.client.1.smithi143.stdout:4/918: dwrite da/d3a/d40/d84/db6/df2/f11d [0,4194304] 0 2024-09-17T01:07:10.433 INFO:tasks.workunit.client.1.smithi143.stdout:0/836: chown d3/d68/d8f/ddb/de8/daf/dcb 72 1 2024-09-17T01:07:10.435 INFO:tasks.workunit.client.1.smithi143.stdout:8/937: rename d9/d12/d13/lc1 to d9/d23/db4/d55/d57/d9d/l158 0 2024-09-17T01:07:10.435 INFO:tasks.workunit.client.0.smithi103.stdout:8/293: sync 2024-09-17T01:07:10.436 INFO:tasks.workunit.client.0.smithi103.stdout:5/220: sync 2024-09-17T01:07:10.436 INFO:tasks.workunit.client.0.smithi103.stdout:0/306: sync 2024-09-17T01:07:10.440 INFO:tasks.workunit.client.1.smithi143.stdout:6/830: mknod d2/df/d20/d2c/d75/c11a 0 2024-09-17T01:07:10.441 INFO:tasks.workunit.client.1.smithi143.stdout:9/856: write d3/d39/fa2 [663361,73923] 0 2024-09-17T01:07:10.443 INFO:tasks.workunit.client.1.smithi143.stdout:0/837: fdatasync d3/d68/d8f/ddb/de8/dcd/fc1 0 2024-09-17T01:07:10.445 INFO:tasks.workunit.client.0.smithi103.stdout:9/353: truncate d7/d43/d48/d11/d5c/f61 1166444 0 2024-09-17T01:07:10.445 INFO:tasks.workunit.client.0.smithi103.stdout:8/294: read d0/d6/f39 [4153375,31703] 0 2024-09-17T01:07:10.446 INFO:tasks.workunit.client.1.smithi143.stdout:8/938: rmdir d9/d12/d38/d58/d79 39 2024-09-17T01:07:10.446 INFO:tasks.workunit.client.0.smithi103.stdout:8/295: rename d0 to d0/d58 22 2024-09-17T01:07:10.447 INFO:tasks.workunit.client.0.smithi103.stdout:6/257: dwrite d3/d25/d26/f4a [0,4194304] 0 2024-09-17T01:07:10.448 INFO:tasks.workunit.client.1.smithi143.stdout:3/892: dread d6/d68/f96 [0,4194304] 0 2024-09-17T01:07:10.449 INFO:tasks.workunit.client.1.smithi143.stdout:4/919: mkdir da/d68/d9b/d12a 0 2024-09-17T01:07:10.450 INFO:tasks.workunit.client.1.smithi143.stdout:2/837: write d0/d10/d58/d5a/d5b/d4c/d71/d99/fa1 [651217,5641] 0 2024-09-17T01:07:10.450 INFO:tasks.workunit.client.1.smithi143.stdout:3/893: fdatasync d6/d1c/d82/dfe/fba 0 2024-09-17T01:07:10.450 INFO:tasks.workunit.client.0.smithi103.stdout:3/376: link d3/l4 d3/d16/l8a 0 2024-09-17T01:07:10.451 INFO:tasks.workunit.client.1.smithi143.stdout:4/920: write da/d3a/d3e/d5e/d63/f11a [500075,10685] 0 2024-09-17T01:07:10.452 INFO:tasks.workunit.client.1.smithi143.stdout:6/831: read - d2/d17/d3a/d47/d8e/f94 zero size 2024-09-17T01:07:10.453 INFO:tasks.workunit.client.0.smithi103.stdout:7/305: dread d4/d10/f2c [0,4194304] 0 2024-09-17T01:07:10.453 INFO:tasks.workunit.client.0.smithi103.stdout:6/258: read d3/d25/f29 [593122,69162] 0 2024-09-17T01:07:10.454 INFO:tasks.workunit.client.0.smithi103.stdout:3/377: truncate d3/d16/d1b/d2c/d5c/f72 994266 0 2024-09-17T01:07:10.455 INFO:tasks.workunit.client.0.smithi103.stdout:8/296: dread d0/d6/dc/f4b [0,4194304] 0 2024-09-17T01:07:10.456 INFO:tasks.workunit.client.0.smithi103.stdout:8/297: stat d0/f4c 0 2024-09-17T01:07:10.456 INFO:tasks.workunit.client.0.smithi103.stdout:5/221: getdents d6/d11/d30 0 2024-09-17T01:07:10.458 INFO:tasks.workunit.client.0.smithi103.stdout:0/307: mknod dd/df/d68/c69 0 2024-09-17T01:07:10.461 INFO:tasks.workunit.client.1.smithi143.stdout:8/939: readlink d9/d12/d38/d58/d79/l123 0 2024-09-17T01:07:10.461 INFO:tasks.workunit.client.1.smithi143.stdout:5/877: dread d1/d46/f22 [0,4194304] 0 2024-09-17T01:07:10.462 INFO:tasks.workunit.client.1.smithi143.stdout:8/940: dread - d9/d23/db4/d55/f113 zero size 2024-09-17T01:07:10.462 INFO:tasks.workunit.client.0.smithi103.stdout:9/354: readlink d7/d2d/l32 0 2024-09-17T01:07:10.462 INFO:tasks.workunit.client.0.smithi103.stdout:5/222: dwrite d6/d2c/d38/d4c/f53 [0,4194304] 0 2024-09-17T01:07:10.466 INFO:tasks.workunit.client.1.smithi143.stdout:1/922: dwrite d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/f2a [0,4194304] 0 2024-09-17T01:07:10.468 INFO:tasks.workunit.client.1.smithi143.stdout:3/894: creat d6/d1c/d4d/f10d x:0 0 0 2024-09-17T01:07:10.469 INFO:tasks.workunit.client.1.smithi143.stdout:2/838: fsync d0/d2/d21/d22/f28 0 2024-09-17T01:07:10.470 INFO:tasks.workunit.client.0.smithi103.stdout:7/306: truncate d4/d11/d2b/d36/d3a/f5d 512951 0 2024-09-17T01:07:10.470 INFO:tasks.workunit.client.0.smithi103.stdout:7/307: readlink d4/l8 0 2024-09-17T01:07:10.471 INFO:tasks.workunit.client.0.smithi103.stdout:6/259: dread d3/d25/f37 [0,4194304] 0 2024-09-17T01:07:10.472 INFO:tasks.workunit.client.1.smithi143.stdout:6/832: rmdir d2/d17/d6e/d26/dbd 39 2024-09-17T01:07:10.473 INFO:tasks.workunit.client.1.smithi143.stdout:6/833: fdatasync d2/df/d20/d2c/d38/fb6 0 2024-09-17T01:07:10.477 INFO:tasks.workunit.client.1.smithi143.stdout:0/838: symlink d3/d14/d10d/l10f 0 2024-09-17T01:07:10.478 INFO:tasks.workunit.client.0.smithi103.stdout:8/298: mkdir d0/d6/dc/d30/d2d/d32/d59 0 2024-09-17T01:07:10.479 INFO:tasks.workunit.client.1.smithi143.stdout:0/839: read d3/d5/d8/d58/f7f [436041,89715] 0 2024-09-17T01:07:10.481 INFO:tasks.workunit.client.1.smithi143.stdout:0/840: write d3/d5/d8/d27/d31/d85/fcf [1465713,96329] 0 2024-09-17T01:07:10.481 INFO:tasks.workunit.client.1.smithi143.stdout:5/878: mknod d1/d46/df/d23/d4f/d7d/dcf/c140 0 2024-09-17T01:07:10.482 INFO:tasks.workunit.client.0.smithi103.stdout:9/355: write d7/d43/d48/d11/d21/f33 [2367311,16935] 0 2024-09-17T01:07:10.483 INFO:tasks.workunit.client.1.smithi143.stdout:1/923: symlink d0/d6/d43/d6a/d107/l132 0 2024-09-17T01:07:10.485 INFO:tasks.workunit.client.1.smithi143.stdout:3/895: symlink d6/d1c/d33/d3f/df0/l10e 0 2024-09-17T01:07:10.486 INFO:tasks.workunit.client.1.smithi143.stdout:9/857: dwrite d3/d39/d42/dab/d108/fd6 [0,4194304] 0 2024-09-17T01:07:10.487 INFO:tasks.workunit.client.1.smithi143.stdout:3/896: chown d6/d1c/d33/d41/d2b/fd4 690073 1 2024-09-17T01:07:10.488 INFO:tasks.workunit.client.1.smithi143.stdout:9/858: write d3/d39/d6a/d9/fa8 [4075296,73398] 0 2024-09-17T01:07:10.490 INFO:tasks.workunit.client.1.smithi143.stdout:3/897: truncate d6/d1c/d4b/d57/f106 345077 0 2024-09-17T01:07:10.490 INFO:tasks.workunit.client.0.smithi103.stdout:7/308: creat d4/d10/d66/f6d x:0 0 0 2024-09-17T01:07:10.493 INFO:tasks.workunit.client.1.smithi143.stdout:4/921: creat da/d68/d9b/ddd/df6/f12b x:0 0 0 2024-09-17T01:07:10.495 INFO:tasks.workunit.client.1.smithi143.stdout:6/834: dread - d2/d17/d6e/d26/d46/d65/fa1 zero size 2024-09-17T01:07:10.496 INFO:tasks.workunit.client.0.smithi103.stdout:3/378: symlink d3/d81/l8b 0 2024-09-17T01:07:10.496 INFO:tasks.workunit.client.1.smithi143.stdout:8/941: write d9/d12/d13/f5d [991917,21479] 0 2024-09-17T01:07:10.500 INFO:tasks.workunit.client.1.smithi143.stdout:4/922: dwrite da/d3a/d40/d84/dd0/f107 [0,4194304] 0 2024-09-17T01:07:10.501 INFO:tasks.workunit.client.0.smithi103.stdout:5/223: link d6/db/f27 d6/d2c/d38/d4c/d54/f57 0 2024-09-17T01:07:10.502 INFO:tasks.workunit.client.1.smithi143.stdout:4/923: chown da/d3a/d40/d84/db6/df2/c119 1 1 2024-09-17T01:07:10.504 INFO:tasks.workunit.client.0.smithi103.stdout:3/379: dwrite d3/f1c [0,4194304] 0 2024-09-17T01:07:10.507 INFO:tasks.workunit.client.1.smithi143.stdout:1/924: creat d0/d6/d43/d47/d88/da5/f133 x:0 0 0 2024-09-17T01:07:10.508 INFO:tasks.workunit.client.0.smithi103.stdout:8/299: dwrite d0/d6/dc/f4b [0,4194304] 0 2024-09-17T01:07:10.510 INFO:tasks.workunit.client.0.smithi103.stdout:8/300: chown d0/d6/dc 1434576638 1 2024-09-17T01:07:10.511 INFO:tasks.workunit.client.0.smithi103.stdout:6/260: truncate f1 3386758 0 2024-09-17T01:07:10.512 INFO:tasks.workunit.client.0.smithi103.stdout:8/301: write d0/d6/dc/d30/d2d/d32/f46 [162837,61562] 0 2024-09-17T01:07:10.513 INFO:tasks.workunit.client.0.smithi103.stdout:9/356: mkdir d7/d43/d48/d11/d5c/d5e/d6c/d6e/d77 0 2024-09-17T01:07:10.515 INFO:tasks.workunit.client.1.smithi143.stdout:3/898: creat d6/d1c/d33/d3f/d5c/f10f x:0 0 0 2024-09-17T01:07:10.517 INFO:tasks.workunit.client.0.smithi103.stdout:9/357: dread d7/d43/f52 [0,4194304] 0 2024-09-17T01:07:10.517 INFO:tasks.workunit.client.1.smithi143.stdout:3/899: write d6/d1c/d10c/d30/f32 [1145535,95] 0 2024-09-17T01:07:10.518 INFO:tasks.workunit.client.1.smithi143.stdout:2/839: fdatasync d0/d10/d58/d5a/d5b/d4c/d59/f9a 0 2024-09-17T01:07:10.520 INFO:tasks.workunit.client.1.smithi143.stdout:2/840: write d0/d44/dd6/f108 [745379,93322] 0 2024-09-17T01:07:10.521 INFO:tasks.workunit.client.1.smithi143.stdout:3/900: chown d6/d1c/d33/d3f/d5c/fee 633397 1 2024-09-17T01:07:10.523 INFO:tasks.workunit.client.0.smithi103.stdout:3/380: readlink d3/d16/d1b/d2c/l88 0 2024-09-17T01:07:10.527 INFO:tasks.workunit.client.0.smithi103.stdout:6/261: rename d3/d16/d33/d3e/l49 to d3/d17/d2f/l54 0 2024-09-17T01:07:10.528 INFO:tasks.workunit.client.1.smithi143.stdout:0/841: creat d3/d5/d6b/f110 x:0 0 0 2024-09-17T01:07:10.529 INFO:tasks.workunit.client.0.smithi103.stdout:8/302: chown d0/d6/dc/d30/d2d/d32/d34/c52 10406699 1 2024-09-17T01:07:10.530 INFO:tasks.workunit.client.1.smithi143.stdout:5/879: creat d1/d46/df/d23/d4f/d7d/d92/dfd/f141 x:0 0 0 2024-09-17T01:07:10.530 INFO:tasks.workunit.client.1.smithi143.stdout:5/880: fsync d1/d46/df/d23/d4f/f20 0 2024-09-17T01:07:10.533 INFO:tasks.workunit.client.0.smithi103.stdout:7/309: dwrite d4/d11/f2a [0,4194304] 0 2024-09-17T01:07:10.533 INFO:tasks.workunit.client.1.smithi143.stdout:1/925: mkdir d0/d6/d43/d6d/d8b/dd0/de2/d79/d134 0 2024-09-17T01:07:10.534 INFO:tasks.workunit.client.0.smithi103.stdout:7/310: chown d4/d11/d2b 9 1 2024-09-17T01:07:10.534 INFO:tasks.workunit.client.1.smithi143.stdout:5/881: dread d1/d46/df/f1b [0,4194304] 0 2024-09-17T01:07:10.535 INFO:tasks.workunit.client.1.smithi143.stdout:1/926: stat d0/d6/d43/d6d/d8b/dd0/de2/d79/l114 0 2024-09-17T01:07:10.540 INFO:tasks.workunit.client.0.smithi103.stdout:3/381: write d3/f7 [3132575,97720] 0 2024-09-17T01:07:10.540 INFO:tasks.workunit.client.1.smithi143.stdout:2/841: write d0/d10/f33 [1660018,28281] 0 2024-09-17T01:07:10.543 INFO:tasks.workunit.client.0.smithi103.stdout:6/262: rename d3/l24 to d3/d16/d33/d53/l55 0 2024-09-17T01:07:10.546 INFO:tasks.workunit.client.1.smithi143.stdout:3/901: creat d6/d1c/d82/de4/f110 x:0 0 0 2024-09-17T01:07:10.547 INFO:tasks.workunit.client.0.smithi103.stdout:3/382: dwrite d3/f27 [0,4194304] 0 2024-09-17T01:07:10.547 INFO:tasks.workunit.client.1.smithi143.stdout:3/902: chown d6/d1c/d33/d41/d42/ff2 3 1 2024-09-17T01:07:10.548 INFO:tasks.workunit.client.1.smithi143.stdout:3/903: fdatasync d6/d1c/d33/f38 0 2024-09-17T01:07:10.552 INFO:tasks.workunit.client.0.smithi103.stdout:5/224: rmdir d6/d11/d30 0 2024-09-17T01:07:10.554 INFO:tasks.workunit.client.1.smithi143.stdout:4/924: symlink da/d75/d103/l12c 0 2024-09-17T01:07:10.557 INFO:tasks.workunit.client.0.smithi103.stdout:7/311: dread d4/d11/d2b/d36/d3a/d51/d5e/f60 [0,4194304] 0 2024-09-17T01:07:10.557 INFO:tasks.workunit.client.0.smithi103.stdout:9/358: dwrite d7/d43/d48/d11/fe [0,4194304] 0 2024-09-17T01:07:10.557 INFO:tasks.workunit.client.1.smithi143.stdout:5/882: mkdir d1/d46/df/d1f/d9f/d125/d142 0 2024-09-17T01:07:10.558 INFO:tasks.workunit.client.0.smithi103.stdout:7/312: truncate d4/d4a/f67 658162 0 2024-09-17T01:07:10.559 INFO:tasks.workunit.client.1.smithi143.stdout:5/883: fdatasync d1/d46/d6e/d106/f129 0 2024-09-17T01:07:10.559 INFO:tasks.workunit.client.0.smithi103.stdout:9/359: write d7/d43/d48/d11/f1f [3869483,77111] 0 2024-09-17T01:07:10.560 INFO:tasks.workunit.client.1.smithi143.stdout:1/927: unlink d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/c108 0 2024-09-17T01:07:10.561 INFO:tasks.workunit.client.0.smithi103.stdout:9/360: chown f0 870970536 1 2024-09-17T01:07:10.561 INFO:tasks.workunit.client.1.smithi143.stdout:8/942: dwrite d9/de/d53/f68 [0,4194304] 0 2024-09-17T01:07:10.562 INFO:tasks.workunit.client.0.smithi103.stdout:6/263: mkdir d3/d16/d21/d56 0 2024-09-17T01:07:10.563 INFO:tasks.workunit.client.1.smithi143.stdout:1/928: fdatasync d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/fe7 0 2024-09-17T01:07:10.565 INFO:tasks.workunit.client.0.smithi103.stdout:3/383: unlink d3/f7 0 2024-09-17T01:07:10.569 INFO:tasks.workunit.client.1.smithi143.stdout:3/904: chown d6/d1c/d33/d3f/f48 200 1 2024-09-17T01:07:10.571 INFO:tasks.workunit.client.1.smithi143.stdout:0/842: truncate d3/d68/f70 1952674 0 2024-09-17T01:07:10.573 INFO:tasks.workunit.client.1.smithi143.stdout:4/925: creat da/d3a/d40/daa/f12d x:0 0 0 2024-09-17T01:07:10.573 INFO:tasks.workunit.client.1.smithi143.stdout:1/929: dwrite d0/d6/d43/d47/dd8/f127 [0,4194304] 0 2024-09-17T01:07:10.573 INFO:tasks.workunit.client.1.smithi143.stdout:3/905: write d6/d1c/d33/d3f/d5c/f10f [168527,106795] 0 2024-09-17T01:07:10.573 INFO:tasks.workunit.client.0.smithi103.stdout:3/384: dwrite d3/d16/d1b/d3c/f4f [0,4194304] 0 2024-09-17T01:07:10.575 INFO:tasks.workunit.client.1.smithi143.stdout:1/930: stat d0/d6/d43/d47/dd8/fe5 0 2024-09-17T01:07:10.576 INFO:tasks.workunit.client.1.smithi143.stdout:3/906: write d6/d1c/d33/d41/f1a [1305973,18177] 0 2024-09-17T01:07:10.579 INFO:tasks.workunit.client.1.smithi143.stdout:0/843: dread d3/f5f [0,4194304] 0 2024-09-17T01:07:10.579 INFO:tasks.workunit.client.1.smithi143.stdout:2/842: creat d0/d44/d7a/d86/d97/dec/f115 x:0 0 0 2024-09-17T01:07:10.582 INFO:tasks.workunit.client.1.smithi143.stdout:6/835: rmdir d2/d17/d6e/d26/dbd/da3 0 2024-09-17T01:07:10.584 INFO:tasks.workunit.client.0.smithi103.stdout:3/385: mkdir d3/d16/d1b/d2c/d34/d8c 0 2024-09-17T01:07:10.586 INFO:tasks.workunit.client.0.smithi103.stdout:6/264: unlink d3/d16/d33/d3e/f41 0 2024-09-17T01:07:10.586 INFO:tasks.workunit.client.0.smithi103.stdout:8/303: dread d0/d6/f36 [0,4194304] 0 2024-09-17T01:07:10.588 INFO:tasks.workunit.client.1.smithi143.stdout:6/836: dwrite d2/df/d20/f5b [4194304,4194304] 0 2024-09-17T01:07:10.589 INFO:tasks.workunit.client.0.smithi103.stdout:7/313: creat d4/d11/d2b/d36/d3a/f6e x:0 0 0 2024-09-17T01:07:10.589 INFO:tasks.workunit.client.1.smithi143.stdout:5/884: mknod d1/d46/d9b/daa/c143 0 2024-09-17T01:07:10.590 INFO:tasks.workunit.client.1.smithi143.stdout:5/885: chown d1/d46/df/cb5 33 1 2024-09-17T01:07:10.591 INFO:tasks.workunit.client.0.smithi103.stdout:3/386: mkdir d3/d16/d1b/d3c/d65/d75/d8d 0 2024-09-17T01:07:10.595 INFO:tasks.workunit.client.1.smithi143.stdout:8/943: creat d9/d12/d38/d58/d79/d112/d143/df2/f159 x:0 0 0 2024-09-17T01:07:10.596 INFO:tasks.workunit.client.0.smithi103.stdout:7/314: creat d4/d10/d66/f6f x:0 0 0 2024-09-17T01:07:10.596 INFO:tasks.workunit.client.1.smithi143.stdout:8/944: chown d9/d12/d13/f33 260032597 1 2024-09-17T01:07:10.597 INFO:tasks.workunit.client.1.smithi143.stdout:2/843: write d0/d2/f14 [4575320,115097] 0 2024-09-17T01:07:10.597 INFO:tasks.workunit.client.1.smithi143.stdout:8/945: chown d9/d12/d13/d73/dee/c140 54 1 2024-09-17T01:07:10.597 INFO:tasks.workunit.client.0.smithi103.stdout:7/315: write d4/d10/f25 [3381072,57000] 0 2024-09-17T01:07:10.600 INFO:tasks.workunit.client.0.smithi103.stdout:3/387: rmdir d3/d44/d63 39 2024-09-17T01:07:10.601 INFO:tasks.workunit.client.0.smithi103.stdout:3/388: chown d3/f8 0 1 2024-09-17T01:07:10.604 INFO:tasks.workunit.client.1.smithi143.stdout:3/907: rename d6/d1c/d4b/f76 to d6/d1c/d33/d3f/d79/d7b/dfd/f111 0 2024-09-17T01:07:10.604 INFO:tasks.workunit.client.0.smithi103.stdout:7/316: dwrite d4/f1a [4194304,4194304] 0 2024-09-17T01:07:10.604 INFO:tasks.workunit.client.1.smithi143.stdout:3/908: fsync d6/d1c/d4b/fd9 0 2024-09-17T01:07:10.605 INFO:tasks.workunit.client.0.smithi103.stdout:7/317: chown d4/d11/d2b/d36/d3a 27467 1 2024-09-17T01:07:10.605 INFO:tasks.workunit.client.1.smithi143.stdout:3/909: write d6/d68/fb8 [5022441,87108] 0 2024-09-17T01:07:10.608 INFO:tasks.workunit.client.1.smithi143.stdout:9/859: sync 2024-09-17T01:07:10.610 INFO:tasks.workunit.client.1.smithi143.stdout:9/860: write d3/d39/d42/d58/fe2 [4349279,91525] 0 2024-09-17T01:07:10.611 INFO:tasks.workunit.client.1.smithi143.stdout:4/926: mknod da/d3a/d3e/c12e 0 2024-09-17T01:07:10.613 INFO:tasks.workunit.client.1.smithi143.stdout:4/927: chown da/d3a/d3e/d4a/d8a/fb8 42849 1 2024-09-17T01:07:10.614 INFO:tasks.workunit.client.0.smithi103.stdout:5/225: dwrite d6/d2c/d38/d4c/d54/f57 [0,4194304] 0 2024-09-17T01:07:10.616 INFO:tasks.workunit.client.0.smithi103.stdout:3/389: dread d3/d16/d1b/d3c/f40 [0,4194304] 0 2024-09-17T01:07:10.617 INFO:tasks.workunit.client.1.smithi143.stdout:1/931: mkdir d0/d6/d43/d6a/d135 0 2024-09-17T01:07:10.618 INFO:tasks.workunit.client.0.smithi103.stdout:7/318: write d4/d11/f19 [299204,74843] 0 2024-09-17T01:07:10.622 INFO:tasks.workunit.client.0.smithi103.stdout:8/304: getdents d0/d6/dc/d30 0 2024-09-17T01:07:10.622 INFO:tasks.workunit.client.0.smithi103.stdout:9/361: dwrite d7/d43/f52 [0,4194304] 0 2024-09-17T01:07:10.623 INFO:tasks.workunit.client.1.smithi143.stdout:1/932: dwrite d0/dc/f82 [0,4194304] 0 2024-09-17T01:07:10.624 INFO:tasks.workunit.client.0.smithi103.stdout:3/390: truncate d3/d16/d1b/d2c/f58 265173 0 2024-09-17T01:07:10.624 INFO:tasks.workunit.client.0.smithi103.stdout:9/362: truncate d7/f2a 2953422 0 2024-09-17T01:07:10.625 INFO:tasks.workunit.client.0.smithi103.stdout:5/226: rename d6/d2c/c4b to d6/d2c/d38/d4c/d54/c58 0 2024-09-17T01:07:10.626 INFO:tasks.workunit.client.0.smithi103.stdout:3/391: write d3/f8 [4232907,80132] 0 2024-09-17T01:07:10.629 INFO:tasks.workunit.client.0.smithi103.stdout:3/392: stat d3/f15 0 2024-09-17T01:07:10.630 INFO:tasks.workunit.client.0.smithi103.stdout:9/363: creat d7/d43/d48/d11/d20/d4f/f78 x:0 0 0 2024-09-17T01:07:10.635 INFO:tasks.workunit.client.1.smithi143.stdout:4/928: mknod da/d6d/d90/c12f 0 2024-09-17T01:07:10.636 INFO:tasks.workunit.client.0.smithi103.stdout:9/364: dread d7/d2d/f71 [0,4194304] 0 2024-09-17T01:07:10.638 INFO:tasks.workunit.client.0.smithi103.stdout:9/365: write d7/d43/d48/d11/d21/f26 [1399476,41472] 0 2024-09-17T01:07:10.642 INFO:tasks.workunit.client.0.smithi103.stdout:3/393: symlink d3/l8e 0 2024-09-17T01:07:10.643 INFO:tasks.workunit.client.1.smithi143.stdout:6/837: dread d2/d17/d6e/f3e [4194304,4194304] 0 2024-09-17T01:07:10.645 INFO:tasks.workunit.client.1.smithi143.stdout:2/844: creat d0/d2/db0/f116 x:0 0 0 2024-09-17T01:07:10.646 INFO:tasks.workunit.client.1.smithi143.stdout:8/946: truncate d9/de/f10 1064993 0 2024-09-17T01:07:10.647 INFO:tasks.workunit.client.0.smithi103.stdout:9/366: mkdir d7/d43/d79 0 2024-09-17T01:07:10.651 INFO:tasks.workunit.client.0.smithi103.stdout:3/394: unlink d3/d16/l2a 0 2024-09-17T01:07:10.653 INFO:tasks.workunit.client.0.smithi103.stdout:5/227: getdents d6/db 0 2024-09-17T01:07:10.655 INFO:tasks.workunit.client.0.smithi103.stdout:6/265: dwrite d3/d25/f29 [0,4194304] 0 2024-09-17T01:07:10.656 INFO:tasks.workunit.client.0.smithi103.stdout:7/319: dread d4/d11/f44 [0,4194304] 0 2024-09-17T01:07:10.657 INFO:tasks.workunit.client.0.smithi103.stdout:3/395: creat d3/d16/d1b/d3c/d65/f8f x:0 0 0 2024-09-17T01:07:10.660 INFO:tasks.workunit.client.1.smithi143.stdout:2/845: fdatasync d0/d44/d6a/f74 0 2024-09-17T01:07:10.661 INFO:tasks.workunit.client.1.smithi143.stdout:0/844: dwrite d3/d88/d93/f98 [4194304,4194304] 0 2024-09-17T01:07:10.662 INFO:tasks.workunit.client.0.smithi103.stdout:5/228: read d6/d2c/f3d [241687,55363] 0 2024-09-17T01:07:10.664 INFO:tasks.workunit.client.0.smithi103.stdout:6/266: mkdir d3/d16/d33/d57 0 2024-09-17T01:07:10.664 INFO:tasks.workunit.client.0.smithi103.stdout:7/320: dwrite d4/f1a [4194304,4194304] 0 2024-09-17T01:07:10.666 INFO:tasks.workunit.client.0.smithi103.stdout:7/321: fdatasync d4/d10/d66/f58 0 2024-09-17T01:07:10.667 INFO:tasks.workunit.client.0.smithi103.stdout:8/305: dread d0/d6/f4f [0,4194304] 0 2024-09-17T01:07:10.667 INFO:tasks.workunit.client.1.smithi143.stdout:4/929: dread da/d3a/d3e/d72/d9e/fd8 [0,4194304] 0 2024-09-17T01:07:10.668 INFO:tasks.workunit.client.1.smithi143.stdout:2/846: dread d0/d10/d56/f6d [0,4194304] 0 2024-09-17T01:07:10.671 INFO:tasks.workunit.client.0.smithi103.stdout:3/396: unlink d3/f14 0 2024-09-17T01:07:10.673 INFO:tasks.workunit.client.1.smithi143.stdout:6/838: dread d2/d17/d3a/fc2 [0,4194304] 0 2024-09-17T01:07:10.674 INFO:tasks.workunit.client.0.smithi103.stdout:5/229: symlink d6/d2c/d38/l59 0 2024-09-17T01:07:10.675 INFO:tasks.workunit.client.0.smithi103.stdout:6/267: dread d3/d25/d26/f4a [0,4194304] 0 2024-09-17T01:07:10.677 INFO:tasks.workunit.client.0.smithi103.stdout:6/268: fsync d3/f18 0 2024-09-17T01:07:10.677 INFO:tasks.workunit.client.0.smithi103.stdout:6/269: dread - d3/d17/f32 zero size 2024-09-17T01:07:10.677 INFO:tasks.workunit.client.1.smithi143.stdout:5/886: truncate d1/d46/df/d1f/de9/fdc 1771121 0 2024-09-17T01:07:10.682 INFO:tasks.workunit.client.1.smithi143.stdout:8/947: symlink d9/d12/d38/d7a/d109/l15a 0 2024-09-17T01:07:10.682 INFO:tasks.workunit.client.1.smithi143.stdout:8/948: fdatasync d9/d12/d4b/fdf 0 2024-09-17T01:07:10.683 INFO:tasks.workunit.client.1.smithi143.stdout:3/910: getdents d6/d1c/d82/de4 0 2024-09-17T01:07:10.685 INFO:tasks.workunit.client.0.smithi103.stdout:9/367: getdents d7/d43/d48/d11 0 2024-09-17T01:07:10.685 INFO:tasks.workunit.client.1.smithi143.stdout:9/861: truncate d3/d39/d6a/d9/f60 3850412 0 2024-09-17T01:07:10.688 INFO:tasks.workunit.client.1.smithi143.stdout:2/847: mknod d0/d44/dd6/c117 0 2024-09-17T01:07:10.689 INFO:tasks.workunit.client.0.smithi103.stdout:8/306: creat d0/d6/dc/d30/d2d/d32/d34/f5a x:0 0 0 2024-09-17T01:07:10.690 INFO:tasks.workunit.client.0.smithi103.stdout:5/230: readlink d6/d11/l23 0 2024-09-17T01:07:10.690 INFO:tasks.workunit.client.1.smithi143.stdout:0/845: fsync d3/d5/f41 0 2024-09-17T01:07:10.692 INFO:tasks.workunit.client.0.smithi103.stdout:6/270: mkdir d3/d16/d33/d3e/d58 0 2024-09-17T01:07:10.695 INFO:tasks.workunit.client.0.smithi103.stdout:9/368: unlink d7/d43/d48/d11/d20/f4a 0 2024-09-17T01:07:10.700 INFO:tasks.workunit.client.1.smithi143.stdout:4/930: mkdir da/d3a/d3e/d4a/d8a/dff/d130 0 2024-09-17T01:07:10.700 INFO:tasks.workunit.client.0.smithi103.stdout:3/397: mkdir d3/d16/d90 0 2024-09-17T01:07:10.702 INFO:tasks.workunit.client.1.smithi143.stdout:9/862: dread - d3/d39/d6a/df6/ffb zero size 2024-09-17T01:07:10.703 INFO:tasks.workunit.client.1.smithi143.stdout:9/863: readlink d3/d39/d42/dab/d108/d51/d52/lb1 0 2024-09-17T01:07:10.703 INFO:tasks.workunit.client.1.smithi143.stdout:6/839: getdents d2/df/d20/d2c/d75/d10c/dfb 0 2024-09-17T01:07:10.704 INFO:tasks.workunit.client.0.smithi103.stdout:3/398: dread d3/d16/d1b/d2c/d5c/f72 [0,4194304] 0 2024-09-17T01:07:10.705 INFO:tasks.workunit.client.1.smithi143.stdout:2/848: rename d0/d2/d21/d84/fbf to d0/d44/d6a/f118 0 2024-09-17T01:07:10.705 INFO:tasks.workunit.client.1.smithi143.stdout:9/864: read d3/d39/d6a/d9/f41 [869916,36514] 0 2024-09-17T01:07:10.707 INFO:tasks.workunit.client.1.smithi143.stdout:5/887: mkdir d1/d46/d144 0 2024-09-17T01:07:10.707 INFO:tasks.workunit.client.1.smithi143.stdout:8/949: dread d9/d23/db4/d55/dfe/f81 [0,4194304] 0 2024-09-17T01:07:10.708 INFO:tasks.workunit.client.0.smithi103.stdout:8/307: rmdir d0 39 2024-09-17T01:07:10.709 INFO:tasks.workunit.client.1.smithi143.stdout:0/846: fdatasync d3/d5/d35/f89 0 2024-09-17T01:07:10.710 INFO:tasks.workunit.client.0.smithi103.stdout:9/369: mkdir d7/d2d/d59/d7a 0 2024-09-17T01:07:10.710 INFO:tasks.workunit.client.1.smithi143.stdout:1/933: sync 2024-09-17T01:07:10.711 INFO:tasks.workunit.client.0.smithi103.stdout:7/322: link d4/d10/d66/l59 d4/d10/d4e/l70 0 2024-09-17T01:07:10.713 INFO:tasks.workunit.client.1.smithi143.stdout:6/840: dwrite d2/d30/feb [0,4194304] 0 2024-09-17T01:07:10.713 INFO:tasks.workunit.client.1.smithi143.stdout:4/931: creat da/d3a/d3e/d4a/d104/ded/f131 x:0 0 0 2024-09-17T01:07:10.715 INFO:tasks.workunit.client.1.smithi143.stdout:4/932: fsync da/d3a/d40/daa/f120 0 2024-09-17T01:07:10.716 INFO:tasks.workunit.client.1.smithi143.stdout:6/841: readlink d2/df/d20/d2c/l4e 0 2024-09-17T01:07:10.719 INFO:tasks.workunit.client.1.smithi143.stdout:3/911: dwrite d6/d1c/d33/d3f/d79/d7b/f9e [0,4194304] 0 2024-09-17T01:07:10.720 INFO:tasks.workunit.client.0.smithi103.stdout:8/308: write d0/d6/f10 [4693375,22105] 0 2024-09-17T01:07:10.725 INFO:tasks.workunit.client.1.smithi143.stdout:0/847: creat d3/d5/d8/d21/d2e/dda/f111 x:0 0 0 2024-09-17T01:07:10.726 INFO:tasks.workunit.client.1.smithi143.stdout:0/848: chown d3/d5/d8/d27/d31/d85 1001 1 2024-09-17T01:07:10.726 INFO:tasks.workunit.client.1.smithi143.stdout:5/888: dwrite d1/d46/df/d23/d4f/f1d [0,4194304] 0 2024-09-17T01:07:10.727 INFO:tasks.workunit.client.0.smithi103.stdout:6/271: dwrite d3/f9 [4194304,4194304] 0 2024-09-17T01:07:10.728 INFO:tasks.workunit.client.1.smithi143.stdout:5/889: write d1/d46/df/d23/d4f/f1d [5162087,29270] 0 2024-09-17T01:07:10.730 INFO:tasks.workunit.client.1.smithi143.stdout:8/950: rename d9/d12/d38/d58/d79/d9b/cd1 to d9/d12/d38/d58/d79/d9b/c15b 0 2024-09-17T01:07:10.733 INFO:tasks.workunit.client.0.smithi103.stdout:8/309: creat d0/d6/dc/d30/d2d/d32/f5b x:0 0 0 2024-09-17T01:07:10.735 INFO:tasks.workunit.client.0.smithi103.stdout:7/323: link d4/d11/f2a d4/d10/d43/f71 0 2024-09-17T01:07:10.735 INFO:tasks.workunit.client.1.smithi143.stdout:5/890: truncate d1/d46/df/d23/d4f/f6a 5164683 0 2024-09-17T01:07:10.735 INFO:tasks.workunit.client.1.smithi143.stdout:4/933: symlink da/d3a/d3e/d4a/l132 0 2024-09-17T01:07:10.737 INFO:tasks.workunit.client.1.smithi143.stdout:2/849: dread d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fc6 [0,4194304] 0 2024-09-17T01:07:10.737 INFO:tasks.workunit.client.1.smithi143.stdout:6/842: symlink d2/d17/d6e/d26/df7/l11b 0 2024-09-17T01:07:10.737 INFO:tasks.workunit.client.0.smithi103.stdout:5/231: getdents d6/d2c 0 2024-09-17T01:07:10.738 INFO:tasks.workunit.client.0.smithi103.stdout:6/272: symlink d3/d25/l59 0 2024-09-17T01:07:10.740 INFO:tasks.workunit.client.0.smithi103.stdout:3/399: creat d3/d16/d1b/f91 x:0 0 0 2024-09-17T01:07:10.743 INFO:tasks.workunit.client.1.smithi143.stdout:0/849: mkdir d3/d5/d8/d27/d31/d48/d8d/d112 0 2024-09-17T01:07:10.743 INFO:tasks.workunit.client.1.smithi143.stdout:6/843: write d2/df/d20/f5b [6710419,39485] 0 2024-09-17T01:07:10.744 INFO:tasks.workunit.client.0.smithi103.stdout:9/370: creat d7/d43/d48/f7b x:0 0 0 2024-09-17T01:07:10.745 INFO:tasks.workunit.client.0.smithi103.stdout:5/232: mknod d6/d2c/d38/d4c/c5a 0 2024-09-17T01:07:10.745 INFO:tasks.workunit.client.1.smithi143.stdout:9/865: dwrite d3/d39/d42/dab/d108/fe1 [0,4194304] 0 2024-09-17T01:07:10.746 INFO:tasks.workunit.client.0.smithi103.stdout:8/310: dwrite d0/f4e [0,4194304] 0 2024-09-17T01:07:10.747 INFO:tasks.workunit.client.0.smithi103.stdout:5/233: chown d6/ca 1890 1 2024-09-17T01:07:10.748 INFO:tasks.workunit.client.0.smithi103.stdout:9/371: write d7/d43/f52 [3865348,18692] 0 2024-09-17T01:07:10.750 INFO:tasks.workunit.client.1.smithi143.stdout:4/934: symlink da/d3a/d3e/d5e/l133 0 2024-09-17T01:07:10.750 INFO:tasks.workunit.client.1.smithi143.stdout:6/844: write d2/d30/d84/fe0 [1472549,83000] 0 2024-09-17T01:07:10.750 INFO:tasks.workunit.client.1.smithi143.stdout:8/951: dwrite d9/d23/d32/f117 [4194304,4194304] 0 2024-09-17T01:07:10.756 INFO:tasks.workunit.client.1.smithi143.stdout:1/934: getdents d0/dc/d74/d94 0 2024-09-17T01:07:10.758 INFO:tasks.workunit.client.0.smithi103.stdout:7/324: mkdir d4/d10/d6b/d72 0 2024-09-17T01:07:10.758 INFO:tasks.workunit.client.1.smithi143.stdout:2/850: mknod d0/d10/d58/d5a/d5b/d4c/d71/c119 0 2024-09-17T01:07:10.760 INFO:tasks.workunit.client.1.smithi143.stdout:3/912: getdents d6/d1c/d33/d3f/d5c/da1 0 2024-09-17T01:07:10.762 INFO:tasks.workunit.client.1.smithi143.stdout:6/845: unlink d2/df/d20/f61 0 2024-09-17T01:07:10.765 INFO:tasks.workunit.client.0.smithi103.stdout:9/372: mknod d7/d43/d48/d11/d20/d4f/c7c 0 2024-09-17T01:07:10.766 INFO:tasks.workunit.client.1.smithi143.stdout:9/866: rename d3/d39/d42/dab/d108/df7/cf9 to d3/d39/d6a/d9/ded/c11a 0 2024-09-17T01:07:10.766 INFO:tasks.workunit.client.0.smithi103.stdout:6/273: creat d3/d16/d33/d57/f5a x:0 0 0 2024-09-17T01:07:10.767 INFO:tasks.workunit.client.1.smithi143.stdout:5/891: link d1/d46/l15 d1/d46/df/d23/d4f/d7d/dcf/dc5/l145 0 2024-09-17T01:07:10.767 INFO:tasks.workunit.client.1.smithi143.stdout:6/846: readlink d2/df/d18/lb9 0 2024-09-17T01:07:10.767 INFO:tasks.workunit.client.1.smithi143.stdout:9/867: chown d3/d39/d6a/d9 3 1 2024-09-17T01:07:10.768 INFO:tasks.workunit.client.0.smithi103.stdout:3/400: dread d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:10.768 INFO:tasks.workunit.client.1.smithi143.stdout:0/850: creat d3/d5/d8/d27/d31/d48/d8d/de6/dec/f113 x:0 0 0 2024-09-17T01:07:10.768 INFO:tasks.workunit.client.1.smithi143.stdout:1/935: dwrite d0/d6/d43/d6a/df/f8c [0,4194304] 0 2024-09-17T01:07:10.770 INFO:tasks.workunit.client.0.smithi103.stdout:7/325: getdents d4/d10/d6b/d72 0 2024-09-17T01:07:10.770 INFO:tasks.workunit.client.0.smithi103.stdout:6/274: dread d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:10.771 INFO:tasks.workunit.client.1.smithi143.stdout:9/868: chown d3/d39/d6a/dc3/f1d 1 1 2024-09-17T01:07:10.771 INFO:tasks.workunit.client.1.smithi143.stdout:3/913: readlink d6/d1c/d33/d41/d42/l80 0 2024-09-17T01:07:10.771 INFO:tasks.workunit.client.1.smithi143.stdout:9/869: chown d3/d39/d6a/dc3 266788609 1 2024-09-17T01:07:10.772 INFO:tasks.workunit.client.0.smithi103.stdout:7/326: chown d4/l8 32746 1 2024-09-17T01:07:10.772 INFO:tasks.workunit.client.0.smithi103.stdout:3/401: mknod d3/d81/c92 0 2024-09-17T01:07:10.772 INFO:tasks.workunit.client.0.smithi103.stdout:9/373: mkdir d7/d43/d5f/d7d 0 2024-09-17T01:07:10.773 INFO:tasks.workunit.client.1.smithi143.stdout:0/851: truncate d3/f5f 4516121 0 2024-09-17T01:07:10.774 INFO:tasks.workunit.client.0.smithi103.stdout:9/374: truncate d7/d2d/d59/f66 136910 0 2024-09-17T01:07:10.774 INFO:tasks.workunit.client.0.smithi103.stdout:7/327: read d4/d4a/f67 [655706,38864] 0 2024-09-17T01:07:10.777 INFO:tasks.workunit.client.1.smithi143.stdout:6/847: symlink d2/d17/l11c 0 2024-09-17T01:07:10.778 INFO:tasks.workunit.client.0.smithi103.stdout:3/402: mknod d3/d16/d1b/d2c/d34/c93 0 2024-09-17T01:07:10.778 INFO:tasks.workunit.client.0.smithi103.stdout:9/375: dread d7/d43/d48/d11/fb [0,4194304] 0 2024-09-17T01:07:10.778 INFO:tasks.workunit.client.1.smithi143.stdout:3/914: dread d6/d1c/d33/d3f/fbc [0,4194304] 0 2024-09-17T01:07:10.779 INFO:tasks.workunit.client.0.smithi103.stdout:3/403: readlink d3/d16/d1b/d2c/l88 0 2024-09-17T01:07:10.779 INFO:tasks.workunit.client.1.smithi143.stdout:1/936: symlink d0/d6/d43/d6d/d8b/dd0/de2/d6b/d9d/l136 0 2024-09-17T01:07:10.779 INFO:tasks.workunit.client.1.smithi143.stdout:1/937: stat d0/dc/f38 0 2024-09-17T01:07:10.780 INFO:tasks.workunit.client.1.smithi143.stdout:3/915: write d6/d1c/d33/f38 [2802398,52263] 0 2024-09-17T01:07:10.781 INFO:tasks.workunit.client.1.smithi143.stdout:1/938: truncate d0/d6/d43/d47/d68/f115 742763 0 2024-09-17T01:07:10.782 INFO:tasks.workunit.client.0.smithi103.stdout:7/328: rename d4/d10/f2c to d4/d11/d3f/d63/f73 0 2024-09-17T01:07:10.783 INFO:tasks.workunit.client.1.smithi143.stdout:5/892: mknod d1/d46/df/d1f/d66/d70/de2/c146 0 2024-09-17T01:07:10.783 INFO:tasks.workunit.client.1.smithi143.stdout:5/893: stat d1/d46/df/d1f/d7a/cf3 0 2024-09-17T01:07:10.784 INFO:tasks.workunit.client.1.smithi143.stdout:6/848: rmdir d2/d17/d3a/d47 39 2024-09-17T01:07:10.785 INFO:tasks.workunit.client.1.smithi143.stdout:5/894: chown d1/d46/df/d1f/d9f/d124/d126/l127 307 1 2024-09-17T01:07:10.785 INFO:tasks.workunit.client.1.smithi143.stdout:9/870: mkdir d3/d39/d42/d80/df3/d99/dfa/d113/d11b 0 2024-09-17T01:07:10.785 INFO:tasks.workunit.client.1.smithi143.stdout:5/895: write d1/d46/f22 [3486877,32628] 0 2024-09-17T01:07:10.786 INFO:tasks.workunit.client.1.smithi143.stdout:3/916: symlink d6/d1c/d4d/dd1/l112 0 2024-09-17T01:07:10.787 INFO:tasks.workunit.client.1.smithi143.stdout:1/939: mknod d0/d6/d43/d6a/d107/c137 0 2024-09-17T01:07:10.787 INFO:tasks.workunit.client.0.smithi103.stdout:7/329: mknod d4/d11/d3f/c74 0 2024-09-17T01:07:10.788 INFO:tasks.workunit.client.0.smithi103.stdout:7/330: read d4/d10/d43/f71 [3861445,110589] 0 2024-09-17T01:07:10.789 INFO:tasks.workunit.client.1.smithi143.stdout:0/852: mkdir d3/d14/d114 0 2024-09-17T01:07:10.789 INFO:tasks.workunit.client.1.smithi143.stdout:0/853: chown d3/d5/d8/d27/l15 34175 1 2024-09-17T01:07:10.790 INFO:tasks.workunit.client.0.smithi103.stdout:9/376: mkdir d7/d43/d79/d7e 0 2024-09-17T01:07:10.790 INFO:tasks.workunit.client.1.smithi143.stdout:0/854: stat d3/d5/d8/d10/l56 0 2024-09-17T01:07:10.790 INFO:tasks.workunit.client.1.smithi143.stdout:6/849: write d2/d17/d6e/fbb [267945,47012] 0 2024-09-17T01:07:10.791 INFO:tasks.workunit.client.0.smithi103.stdout:3/404: mknod d3/d16/d1b/d3c/d65/d7c/c94 0 2024-09-17T01:07:10.794 INFO:tasks.workunit.client.1.smithi143.stdout:9/871: write d3/d39/d42/dab/d108/ff1 [3119721,118566] 0 2024-09-17T01:07:10.794 INFO:tasks.workunit.client.0.smithi103.stdout:9/377: fdatasync d7/d43/d48/d11/fb 0 2024-09-17T01:07:10.795 INFO:tasks.workunit.client.0.smithi103.stdout:9/378: stat d7/d2d/f72 0 2024-09-17T01:07:10.795 INFO:tasks.workunit.client.1.smithi143.stdout:9/872: chown d3/d39/d42/d80/lbe 5441 1 2024-09-17T01:07:10.796 INFO:tasks.workunit.client.1.smithi143.stdout:9/873: chown d3/d39/d6a/d9 206 1 2024-09-17T01:07:10.797 INFO:tasks.workunit.client.1.smithi143.stdout:3/917: unlink d6/d1c/d10c/d86/d89/fa7 0 2024-09-17T01:07:10.798 INFO:tasks.workunit.client.1.smithi143.stdout:6/850: dwrite d2/d19/f101 [0,4194304] 0 2024-09-17T01:07:10.800 INFO:tasks.workunit.client.1.smithi143.stdout:0/855: stat d3/d5/d8/l5a 0 2024-09-17T01:07:10.800 INFO:tasks.workunit.client.1.smithi143.stdout:0/856: readlink d3/d5/d8/d27/d31/l4d 0 2024-09-17T01:07:10.801 INFO:tasks.workunit.client.0.smithi103.stdout:3/405: symlink d3/d44/l95 0 2024-09-17T01:07:10.807 INFO:tasks.workunit.client.1.smithi143.stdout:0/857: read d3/d68/d8f/ddb/de8/dcd/f54 [2801847,62652] 0 2024-09-17T01:07:10.807 INFO:tasks.workunit.client.1.smithi143.stdout:1/940: symlink d0/da1/df0/l138 0 2024-09-17T01:07:10.808 INFO:tasks.workunit.client.0.smithi103.stdout:6/275: dread d3/d17/d2f/f3c [0,4194304] 0 2024-09-17T01:07:10.808 INFO:tasks.workunit.client.1.smithi143.stdout:3/918: mknod d6/d1c/d33/d3f/d5c/da1/c113 0 2024-09-17T01:07:10.809 INFO:tasks.workunit.client.1.smithi143.stdout:0/858: read - d3/d68/d8f/ddb/de8/daf/dcb/f10a zero size 2024-09-17T01:07:10.810 INFO:tasks.workunit.client.0.smithi103.stdout:7/331: link d4/d11/d34/d3d/f5b d4/d11/d2b/d36/d3a/d51/d5e/f75 0 2024-09-17T01:07:10.810 INFO:tasks.workunit.client.0.smithi103.stdout:9/379: dread d7/d43/d48/f16 [0,4194304] 0 2024-09-17T01:07:10.810 INFO:tasks.workunit.client.1.smithi143.stdout:3/919: write d6/d68/ff1 [401728,76319] 0 2024-09-17T01:07:10.811 INFO:tasks.workunit.client.1.smithi143.stdout:6/851: rmdir d2/d30/d45/d70 39 2024-09-17T01:07:10.812 INFO:tasks.workunit.client.1.smithi143.stdout:3/920: truncate d6/d1c/d82/dfe/fba 1754552 0 2024-09-17T01:07:10.813 INFO:tasks.workunit.client.0.smithi103.stdout:3/406: dwrite d3/d16/d1b/d3c/f53 [0,4194304] 0 2024-09-17T01:07:10.814 INFO:tasks.workunit.client.1.smithi143.stdout:3/921: chown d6/d1c/d4b/fe6 22192 1 2024-09-17T01:07:10.814 INFO:tasks.workunit.client.1.smithi143.stdout:9/874: truncate d3/d39/d6a/d9/d74/f97 1171479 0 2024-09-17T01:07:10.814 INFO:tasks.workunit.client.0.smithi103.stdout:9/380: write d7/d43/d48/d11/f5d [445922,124189] 0 2024-09-17T01:07:10.814 INFO:tasks.workunit.client.0.smithi103.stdout:3/407: truncate d3/f66 1026664 0 2024-09-17T01:07:10.817 INFO:tasks.workunit.client.0.smithi103.stdout:8/311: getdents d0/d6/dc/d30/d2d/d32 0 2024-09-17T01:07:10.817 INFO:tasks.workunit.client.1.smithi143.stdout:6/852: dwrite d2/d30/db4/dbc/fd1 [0,4194304] 0 2024-09-17T01:07:10.818 INFO:tasks.workunit.client.1.smithi143.stdout:8/952: sync 2024-09-17T01:07:10.818 INFO:tasks.workunit.client.1.smithi143.stdout:0/859: mknod d3/d68/d8f/ddb/de8/dcd/de5/c115 0 2024-09-17T01:07:10.820 INFO:tasks.workunit.client.0.smithi103.stdout:6/276: mknod d3/d16/d21/d50/c5b 0 2024-09-17T01:07:10.824 INFO:tasks.workunit.client.0.smithi103.stdout:7/332: mknod d4/d11/d2b/d36/d3a/d51/c76 0 2024-09-17T01:07:10.824 INFO:tasks.workunit.client.0.smithi103.stdout:3/408: dwrite d3/d16/d1b/f79 [0,4194304] 0 2024-09-17T01:07:10.825 INFO:tasks.workunit.client.1.smithi143.stdout:1/941: symlink d0/d6/d43/d6d/d8b/dd0/de2/d79/d134/l139 0 2024-09-17T01:07:10.828 INFO:tasks.workunit.client.0.smithi103.stdout:8/312: dwrite d0/d6/dc/d30/d2d/f3c [0,4194304] 0 2024-09-17T01:07:10.829 INFO:tasks.workunit.client.1.smithi143.stdout:3/922: creat d6/d1c/d33/d3f/d5c/f114 x:0 0 0 2024-09-17T01:07:10.831 INFO:tasks.workunit.client.1.smithi143.stdout:9/875: write d3/d39/d42/d80/f10a [724163,104589] 0 2024-09-17T01:07:10.832 INFO:tasks.workunit.client.0.smithi103.stdout:9/381: write d7/f3b [673674,10716] 0 2024-09-17T01:07:10.833 INFO:tasks.workunit.client.1.smithi143.stdout:9/876: chown d3/d39/d6a/f2a 1169230 1 2024-09-17T01:07:10.835 INFO:tasks.workunit.client.1.smithi143.stdout:6/853: rename d2/d30/feb to d2/d17/d6e/d26/d79/f11d 0 2024-09-17T01:07:10.836 INFO:tasks.workunit.client.0.smithi103.stdout:6/277: rmdir d3/d16/d33 39 2024-09-17T01:07:10.837 INFO:tasks.workunit.client.1.smithi143.stdout:8/953: fsync d9/de/d53/d75/f86 0 2024-09-17T01:07:10.838 INFO:tasks.workunit.client.0.smithi103.stdout:3/409: dwrite d3/d16/d1b/f89 [0,4194304] 0 2024-09-17T01:07:10.841 INFO:tasks.workunit.client.0.smithi103.stdout:7/333: dread d4/d11/d2b/d36/d3a/d51/d5e/f60 [0,4194304] 0 2024-09-17T01:07:10.842 INFO:tasks.workunit.client.0.smithi103.stdout:7/334: chown d4/d10/f2e 181 1 2024-09-17T01:07:10.843 INFO:tasks.workunit.client.1.smithi143.stdout:1/942: truncate d0/d6/d43/d6d/d8b/dd0/de2/d79/f119 4782089 0 2024-09-17T01:07:10.845 INFO:tasks.workunit.client.0.smithi103.stdout:9/382: mknod d7/d43/d48/d11/d5c/d5e/d6c/d6e/c7f 0 2024-09-17T01:07:10.845 INFO:tasks.workunit.client.1.smithi143.stdout:1/943: fsync d0/dc/d74/d94/f9a 0 2024-09-17T01:07:10.845 INFO:tasks.workunit.client.1.smithi143.stdout:1/944: readlink d0/d6/d43/l4e 0 2024-09-17T01:07:10.847 INFO:tasks.workunit.client.0.smithi103.stdout:3/410: readlink d3/d16/d1b/d2c/l3a 0 2024-09-17T01:07:10.847 INFO:tasks.workunit.client.0.smithi103.stdout:7/335: truncate d4/d11/d2b/d36/d3a/d51/d5e/f64 3563622 0 2024-09-17T01:07:10.849 INFO:tasks.workunit.client.0.smithi103.stdout:8/313: truncate d0/d6/f3b 885623 0 2024-09-17T01:07:10.853 INFO:tasks.workunit.client.0.smithi103.stdout:3/411: chown d3/d16/d1b/d3c/c39 53697656 1 2024-09-17T01:07:10.854 INFO:tasks.workunit.client.0.smithi103.stdout:7/336: symlink d4/d10/d66/l77 0 2024-09-17T01:07:10.857 INFO:tasks.workunit.client.0.smithi103.stdout:8/314: write d0/d6/f51 [120376,67642] 0 2024-09-17T01:07:10.857 INFO:tasks.workunit.client.0.smithi103.stdout:8/315: fdatasync d0/f4c 0 2024-09-17T01:07:10.858 INFO:tasks.workunit.client.1.smithi143.stdout:0/860: unlink d3/d68/d8f/ddb/de8/dcd/f100 0 2024-09-17T01:07:10.858 INFO:tasks.workunit.client.1.smithi143.stdout:0/861: readlink d3/d5/d8/d27/l15 0 2024-09-17T01:07:10.859 INFO:tasks.workunit.client.0.smithi103.stdout:8/316: read d0/d6/dc/d3d/f40 [161219,53794] 0 2024-09-17T01:07:10.859 INFO:tasks.workunit.client.1.smithi143.stdout:0/862: chown d3/d5/d8/d27/d31/d48/f5e 1133 1 2024-09-17T01:07:10.860 INFO:tasks.workunit.client.1.smithi143.stdout:0/863: chown d3/fed 19809646 1 2024-09-17T01:07:10.865 INFO:tasks.workunit.client.1.smithi143.stdout:4/935: dwrite da/d3a/d3e/d72/d9e/fbb [0,4194304] 0 2024-09-17T01:07:10.867 INFO:tasks.workunit.client.1.smithi143.stdout:9/877: rename d3/d39/d42/d80/df3/d99/l84 to d3/d39/d6a/d9/d74/def/l11c 0 2024-09-17T01:07:10.867 INFO:tasks.workunit.client.1.smithi143.stdout:4/936: fdatasync da/d3a/d40/d84/f4b 0 2024-09-17T01:07:10.868 INFO:tasks.workunit.client.0.smithi103.stdout:8/317: mknod d0/d6/dc/d3d/c5c 0 2024-09-17T01:07:10.870 INFO:tasks.workunit.client.1.smithi143.stdout:9/878: write d3/d39/d6a/dc3/f1d [440984,40909] 0 2024-09-17T01:07:10.870 INFO:tasks.workunit.client.1.smithi143.stdout:8/954: creat d9/d23/d12c/f15c x:0 0 0 2024-09-17T01:07:10.873 INFO:tasks.workunit.client.1.smithi143.stdout:0/864: chown d3/d5/d8/d21/f26 121 1 2024-09-17T01:07:10.873 INFO:tasks.workunit.client.1.smithi143.stdout:2/851: dwrite d0/d2/d21/d22/f3c [8388608,4194304] 0 2024-09-17T01:07:10.878 INFO:tasks.workunit.client.0.smithi103.stdout:8/318: rename d0/d6/dc/d30/f26 to d0/d6/dc/d30/d2d/d32/f5d 0 2024-09-17T01:07:10.883 INFO:tasks.workunit.client.0.smithi103.stdout:7/337: creat d4/d4a/f78 x:0 0 0 2024-09-17T01:07:10.883 INFO:tasks.workunit.client.0.smithi103.stdout:8/319: dread d0/d6/f4f [0,4194304] 0 2024-09-17T01:07:10.884 INFO:tasks.workunit.client.0.smithi103.stdout:3/412: dread d3/d16/f2d [0,4194304] 0 2024-09-17T01:07:10.886 INFO:tasks.workunit.client.1.smithi143.stdout:6/854: rename d2/df/d20/d2c/f118 to d2/d17/d3a/d47/d8e/d95/f11e 0 2024-09-17T01:07:10.887 INFO:tasks.workunit.client.1.smithi143.stdout:6/855: dread - d2/d30/d45/f102 zero size 2024-09-17T01:07:10.888 INFO:tasks.workunit.client.1.smithi143.stdout:6/856: fsync d2/d30/d45/d56/f60 0 2024-09-17T01:07:10.888 INFO:tasks.workunit.client.0.smithi103.stdout:9/383: getdents d7/d43/d79 0 2024-09-17T01:07:10.889 INFO:tasks.workunit.client.0.smithi103.stdout:9/384: dread - d7/d43/d48/f7b zero size 2024-09-17T01:07:10.890 INFO:tasks.workunit.client.1.smithi143.stdout:5/896: write d1/d96/fd2 [351636,77924] 0 2024-09-17T01:07:10.892 INFO:tasks.workunit.client.0.smithi103.stdout:3/413: creat d3/d16/d1b/d2c/d5c/f96 x:0 0 0 2024-09-17T01:07:10.893 INFO:tasks.workunit.client.1.smithi143.stdout:8/955: mkdir d9/d23/db4/d55/dbf/d15d 0 2024-09-17T01:07:10.894 INFO:tasks.workunit.client.1.smithi143.stdout:0/865: stat d3/d5/cac 0 2024-09-17T01:07:10.895 INFO:tasks.workunit.client.0.smithi103.stdout:9/385: unlink d7/d43/d48/d11/f5d 0 2024-09-17T01:07:10.896 INFO:tasks.workunit.client.0.smithi103.stdout:8/320: dread d0/d6/dc/d3d/f40 [0,4194304] 0 2024-09-17T01:07:10.896 INFO:tasks.workunit.client.1.smithi143.stdout:2/852: symlink d0/d2/d21/d22/l11a 0 2024-09-17T01:07:10.897 INFO:tasks.workunit.client.0.smithi103.stdout:3/414: mkdir d3/d16/d1b/d3c/d97 0 2024-09-17T01:07:10.898 INFO:tasks.workunit.client.0.smithi103.stdout:3/415: write d3/d16/d1b/d36/f67 [805401,115891] 0 2024-09-17T01:07:10.899 INFO:tasks.workunit.client.0.smithi103.stdout:7/338: creat d4/d4a/f79 x:0 0 0 2024-09-17T01:07:10.900 INFO:tasks.workunit.client.0.smithi103.stdout:7/339: stat d4/d10/d66/f6f 0 2024-09-17T01:07:10.904 INFO:tasks.workunit.client.1.smithi143.stdout:5/897: mknod d1/d46/df/d53/d74/d9a/d9c/c147 0 2024-09-17T01:07:10.909 INFO:tasks.workunit.client.1.smithi143.stdout:0/866: fdatasync d3/d14/d32/f38 0 2024-09-17T01:07:10.909 INFO:tasks.workunit.client.0.smithi103.stdout:8/321: dread d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:10.909 INFO:tasks.workunit.client.0.smithi103.stdout:7/340: fdatasync d4/d11/f23 0 2024-09-17T01:07:10.911 INFO:tasks.workunit.client.0.smithi103.stdout:8/322: write d0/d6/dc/d30/d2d/f3c [1727730,50917] 0 2024-09-17T01:07:10.911 INFO:tasks.workunit.client.0.smithi103.stdout:9/386: mkdir d7/d43/d5f/d7d/d80 0 2024-09-17T01:07:10.914 INFO:tasks.workunit.client.1.smithi143.stdout:4/937: rename da/d3a/c8e to da/d3a/d3e/d4a/d8a/dff/c134 0 2024-09-17T01:07:10.915 INFO:tasks.workunit.client.0.smithi103.stdout:3/416: creat d3/d44/d63/f98 x:0 0 0 2024-09-17T01:07:10.917 INFO:tasks.workunit.client.1.smithi143.stdout:9/879: creat d3/d39/d42/d58/d5a/f11d x:0 0 0 2024-09-17T01:07:10.918 INFO:tasks.workunit.client.1.smithi143.stdout:5/898: rmdir d1/d46/df/d1f/d66 39 2024-09-17T01:07:10.919 INFO:tasks.workunit.client.1.smithi143.stdout:5/899: chown d1/d46/cb3 356011145 1 2024-09-17T01:07:10.919 INFO:tasks.workunit.client.0.smithi103.stdout:8/323: dwrite d0/d6/dc/d30/d2d/d32/f54 [0,4194304] 0 2024-09-17T01:07:10.921 INFO:tasks.workunit.client.0.smithi103.stdout:7/341: write d4/d11/d2b/d36/d3a/d51/d5e/f64 [4141848,32324] 0 2024-09-17T01:07:10.921 INFO:tasks.workunit.client.1.smithi143.stdout:8/956: mkdir d9/d12/d38/d7a/d15e 0 2024-09-17T01:07:10.923 INFO:tasks.workunit.client.1.smithi143.stdout:3/923: write d6/d1c/d33/d41/d2b/f3d [1437382,4347] 0 2024-09-17T01:07:10.923 INFO:tasks.workunit.client.1.smithi143.stdout:8/957: chown d9/d23/db4/d55/dfe/f94 1 1 2024-09-17T01:07:10.927 INFO:tasks.workunit.client.1.smithi143.stdout:3/924: chown d6/d1c/d33/d3f/d5c/da1/fdb 111995265 1 2024-09-17T01:07:10.929 INFO:tasks.workunit.client.0.smithi103.stdout:7/342: mknod d4/d11/c7a 0 2024-09-17T01:07:10.930 INFO:tasks.workunit.client.0.smithi103.stdout:7/343: chown d4/d11/d2b/l38 861 1 2024-09-17T01:07:10.931 INFO:tasks.workunit.client.0.smithi103.stdout:3/417: creat d3/d16/d1b/d3c/d65/d83/f99 x:0 0 0 2024-09-17T01:07:10.935 INFO:tasks.workunit.client.1.smithi143.stdout:6/857: rename d2/d30/d45/f102 to d2/d17/d3a/d47/f11f 0 2024-09-17T01:07:10.935 INFO:tasks.workunit.client.1.smithi143.stdout:8/958: readlink d9/d12/d38/d58/d79/d10d/l150 0 2024-09-17T01:07:10.936 INFO:tasks.workunit.client.1.smithi143.stdout:5/900: symlink d1/d46/df/d53/de1/l148 0 2024-09-17T01:07:10.937 INFO:tasks.workunit.client.1.smithi143.stdout:3/925: fsync d6/d1c/d33/fb5 0 2024-09-17T01:07:10.937 INFO:tasks.workunit.client.1.smithi143.stdout:1/945: dwrite d0/d6/d43/f44 [0,4194304] 0 2024-09-17T01:07:10.938 INFO:tasks.workunit.client.0.smithi103.stdout:8/324: link d0/d6/c42 d0/d6/dc/d30/d25/c5e 0 2024-09-17T01:07:10.940 INFO:tasks.workunit.client.1.smithi143.stdout:8/959: write d9/d12/d38/d58/d79/d112/d143/df2/f159 [218459,102217] 0 2024-09-17T01:07:10.940 INFO:tasks.workunit.client.0.smithi103.stdout:8/325: truncate d0/d6/dc/d30/d2d/f3c 4435976 0 2024-09-17T01:07:10.946 INFO:tasks.workunit.client.1.smithi143.stdout:2/853: rename d0/d44/dd6/c117 to d0/d10/d58/d5a/d5b/d4c/d71/d99/c11b 0 2024-09-17T01:07:10.946 INFO:tasks.workunit.client.1.smithi143.stdout:1/946: dwrite d0/f19 [4194304,4194304] 0 2024-09-17T01:07:10.946 INFO:tasks.workunit.client.0.smithi103.stdout:3/418: link d3/d16/d1b/d3c/c32 d3/d16/d90/c9a 0 2024-09-17T01:07:10.947 INFO:tasks.workunit.client.0.smithi103.stdout:3/419: fdatasync d3/d16/d1b/d3c/f60 0 2024-09-17T01:07:10.949 INFO:tasks.workunit.client.1.smithi143.stdout:6/858: readlink d2/d17/d6e/le 0 2024-09-17T01:07:10.949 INFO:tasks.workunit.client.1.smithi143.stdout:3/926: dwrite d6/d1c/d82/dfe/ff4 [4194304,4194304] 0 2024-09-17T01:07:10.950 INFO:tasks.workunit.client.1.smithi143.stdout:3/927: chown d6/ffa 1375622 1 2024-09-17T01:07:10.953 INFO:tasks.workunit.client.0.smithi103.stdout:3/420: creat d3/d16/d1b/d3c/d65/f9b x:0 0 0 2024-09-17T01:07:10.963 INFO:tasks.workunit.client.1.smithi143.stdout:1/947: creat d0/dc/d89/f13a x:0 0 0 2024-09-17T01:07:10.967 INFO:tasks.workunit.client.0.smithi103.stdout:3/421: mkdir d3/d16/d1b/d3c/d65/d75/d9c 0 2024-09-17T01:07:10.970 INFO:tasks.workunit.client.0.smithi103.stdout:7/344: write d4/d11/d34/f49 [2878067,86709] 0 2024-09-17T01:07:10.970 INFO:tasks.workunit.client.0.smithi103.stdout:9/387: dread d7/d43/d48/d11/d21/f74 [0,4194304] 0 2024-09-17T01:07:10.971 INFO:tasks.workunit.client.1.smithi143.stdout:0/867: dwrite d3/d5/d8/d10/f3a [0,4194304] 0 2024-09-17T01:07:10.972 INFO:tasks.workunit.client.0.smithi103.stdout:3/422: unlink d3/d16/c61 0 2024-09-17T01:07:10.973 INFO:tasks.workunit.client.1.smithi143.stdout:6/859: mknod d2/d17/d6e/c120 0 2024-09-17T01:07:10.973 INFO:tasks.workunit.client.0.smithi103.stdout:3/423: write d3/f8 [2204948,67503] 0 2024-09-17T01:07:10.974 INFO:tasks.workunit.client.1.smithi143.stdout:1/948: dwrite d0/d6/d43/d6d/d8b/dd0/f116 [0,4194304] 0 2024-09-17T01:07:10.976 INFO:tasks.workunit.client.0.smithi103.stdout:3/424: chown d3/d16/d1b/d3c/f4f 3175764 1 2024-09-17T01:07:10.977 INFO:tasks.workunit.client.0.smithi103.stdout:9/388: symlink d7/d43/d48/d11/d5c/d5e/d6c/l81 0 2024-09-17T01:07:10.978 INFO:tasks.workunit.client.0.smithi103.stdout:7/345: dwrite d4/d10/d43/f57 [0,4194304] 0 2024-09-17T01:07:10.982 INFO:tasks.workunit.client.1.smithi143.stdout:8/960: dread d9/d12/d13/f4d [0,4194304] 0 2024-09-17T01:07:10.983 INFO:tasks.workunit.client.1.smithi143.stdout:1/949: creat d0/da1/df0/f13b x:0 0 0 2024-09-17T01:07:10.984 INFO:tasks.workunit.client.1.smithi143.stdout:3/928: dread d6/d1c/d82/dfe/ff4 [0,4194304] 0 2024-09-17T01:07:10.985 INFO:tasks.workunit.client.0.smithi103.stdout:3/425: creat d3/d16/d1b/d3c/d65/d83/f9d x:0 0 0 2024-09-17T01:07:10.986 INFO:tasks.workunit.client.1.smithi143.stdout:5/901: write d1/d46/d6e/f7c [577414,82066] 0 2024-09-17T01:07:10.986 INFO:tasks.workunit.client.1.smithi143.stdout:6/860: symlink d2/df/d20/d2c/d75/daf/d10a/l121 0 2024-09-17T01:07:10.988 INFO:tasks.workunit.client.0.smithi103.stdout:8/326: truncate d0/d6/dc/f4b 857644 0 2024-09-17T01:07:10.989 INFO:tasks.workunit.client.0.smithi103.stdout:7/346: mkdir d4/d11/d2b/d36/d3a/d51/d5e/d7b 0 2024-09-17T01:07:10.990 INFO:tasks.workunit.client.1.smithi143.stdout:3/929: mkdir d6/d1c/d10c/d86/d89/d115 0 2024-09-17T01:07:10.992 INFO:tasks.workunit.client.1.smithi143.stdout:2/854: write d0/d2/d21/d84/d8d/fb8 [335292,19096] 0 2024-09-17T01:07:10.992 INFO:tasks.workunit.client.0.smithi103.stdout:9/389: mknod d7/d2d/d59/d7a/c82 0 2024-09-17T01:07:10.993 INFO:tasks.workunit.client.1.smithi143.stdout:2/855: dread - d0/d44/d7a/d86/fef zero size 2024-09-17T01:07:10.993 INFO:tasks.workunit.client.0.smithi103.stdout:9/390: fsync d7/d43/d48/d11/d21/f33 0 2024-09-17T01:07:10.994 INFO:tasks.workunit.client.1.smithi143.stdout:0/868: getdents d3/d5/d8/d21/d9b 0 2024-09-17T01:07:10.997 INFO:tasks.workunit.client.0.smithi103.stdout:3/426: symlink d3/d16/d1b/d3c/d65/d75/d9c/l9e 0 2024-09-17T01:07:10.999 INFO:tasks.workunit.client.0.smithi103.stdout:8/327: creat d0/d6/dc/d30/d2d/d32/d59/f5f x:0 0 0 2024-09-17T01:07:11.001 INFO:tasks.workunit.client.1.smithi143.stdout:0/869: creat d3/d5/d8/d10/db3/f116 x:0 0 0 2024-09-17T01:07:11.002 INFO:tasks.workunit.client.1.smithi143.stdout:8/961: link d9/d12/lb3 d9/d23/d32/d11f/l15f 0 2024-09-17T01:07:11.004 INFO:tasks.workunit.client.1.smithi143.stdout:6/861: getdents d2/d17/d3a 0 2024-09-17T01:07:11.007 INFO:tasks.workunit.client.0.smithi103.stdout:8/328: creat d0/d6/dc/d30/d2d/f60 x:0 0 0 2024-09-17T01:07:11.007 INFO:tasks.workunit.client.1.smithi143.stdout:0/870: creat d3/d68/d75/dff/f117 x:0 0 0 2024-09-17T01:07:11.008 INFO:tasks.workunit.client.1.smithi143.stdout:0/871: stat d3/d88 0 2024-09-17T01:07:11.008 INFO:tasks.workunit.client.0.smithi103.stdout:8/329: chown d0/d6/c42 66275709 1 2024-09-17T01:07:11.008 INFO:tasks.workunit.client.1.smithi143.stdout:2/856: getdents d0/d44/d6a/d91/dc7 0 2024-09-17T01:07:11.009 INFO:tasks.workunit.client.1.smithi143.stdout:6/862: creat d2/df/d18/da8/f122 x:0 0 0 2024-09-17T01:07:11.010 INFO:tasks.workunit.client.1.smithi143.stdout:5/902: dread d1/f2 [0,4194304] 0 2024-09-17T01:07:11.011 INFO:tasks.workunit.client.1.smithi143.stdout:8/962: getdents d9/d23/d32 0 2024-09-17T01:07:11.013 INFO:tasks.workunit.client.1.smithi143.stdout:5/903: chown d1/d46/d6e/c87 1 1 2024-09-17T01:07:11.013 INFO:tasks.workunit.client.1.smithi143.stdout:8/963: chown d9/de/d53/d75/f88 5 1 2024-09-17T01:07:11.014 INFO:tasks.workunit.client.0.smithi103.stdout:8/330: dwrite d0/d6/f36 [0,4194304] 0 2024-09-17T01:07:11.017 INFO:tasks.workunit.client.1.smithi143.stdout:0/872: rename d3/d5/d8/l5a to d3/d68/l118 0 2024-09-17T01:07:11.018 INFO:tasks.workunit.client.0.smithi103.stdout:8/331: mknod d0/d6/dc/d30/c61 0 2024-09-17T01:07:11.019 INFO:tasks.workunit.client.1.smithi143.stdout:3/930: dread d6/d1c/d82/fcc [0,4194304] 0 2024-09-17T01:07:11.020 INFO:tasks.workunit.client.1.smithi143.stdout:5/904: write d1/d46/d6e/f78 [736712,103698] 0 2024-09-17T01:07:11.022 INFO:tasks.workunit.client.0.smithi103.stdout:8/332: symlink d0/d6/dc/d30/d2d/d32/d34/l62 0 2024-09-17T01:07:11.022 INFO:tasks.workunit.client.0.smithi103.stdout:7/347: truncate d4/fb 686346 0 2024-09-17T01:07:11.023 INFO:tasks.workunit.client.1.smithi143.stdout:6/863: dwrite d2/d17/d6e/d26/dbd/d5e/d7c/fdd [0,4194304] 0 2024-09-17T01:07:11.023 INFO:tasks.workunit.client.0.smithi103.stdout:8/333: read d0/d6/f1d [2512126,66409] 0 2024-09-17T01:07:11.025 INFO:tasks.workunit.client.1.smithi143.stdout:8/964: mkdir d9/d12/d38/d7a/d15e/d160 0 2024-09-17T01:07:11.026 INFO:tasks.workunit.client.0.smithi103.stdout:8/334: chown d0/d6/dc/f2c 9765 1 2024-09-17T01:07:11.026 INFO:tasks.workunit.client.1.smithi143.stdout:8/965: write d9/d12/df4/f111 [50633,124109] 0 2024-09-17T01:07:11.027 INFO:tasks.workunit.client.1.smithi143.stdout:8/966: chown d9/d23/d32/f51 1778829 1 2024-09-17T01:07:11.028 INFO:tasks.workunit.client.1.smithi143.stdout:5/905: mknod d1/d46/d9d/c149 0 2024-09-17T01:07:11.031 INFO:tasks.workunit.client.0.smithi103.stdout:9/391: dwrite d7/d43/d48/d11/d5c/f61 [0,4194304] 0 2024-09-17T01:07:11.032 INFO:tasks.workunit.client.1.smithi143.stdout:0/873: mknod d3/c119 0 2024-09-17T01:07:11.033 INFO:tasks.workunit.client.1.smithi143.stdout:9/880: sync 2024-09-17T01:07:11.033 INFO:tasks.workunit.client.1.smithi143.stdout:4/938: sync 2024-09-17T01:07:11.034 INFO:tasks.workunit.client.1.smithi143.stdout:1/950: sync 2024-09-17T01:07:11.034 INFO:tasks.workunit.client.0.smithi103.stdout:8/335: write d0/d6/f1d [1218520,127491] 0 2024-09-17T01:07:11.034 INFO:tasks.workunit.client.1.smithi143.stdout:2/857: truncate d0/d44/d7a/f89 3201347 0 2024-09-17T01:07:11.035 INFO:tasks.workunit.client.1.smithi143.stdout:1/951: dread - d0/dc/d89/f13a zero size 2024-09-17T01:07:11.035 INFO:tasks.workunit.client.1.smithi143.stdout:4/939: truncate da/d3a/d40/fe5 1202500 0 2024-09-17T01:07:11.035 INFO:tasks.workunit.client.1.smithi143.stdout:1/952: fdatasync d0/dc/f82 0 2024-09-17T01:07:11.036 INFO:tasks.workunit.client.0.smithi103.stdout:8/336: write d0/d6/dc/d30/d2d/d32/f5b [710657,118596] 0 2024-09-17T01:07:11.037 INFO:tasks.workunit.client.1.smithi143.stdout:4/940: write da/d68/d9b/feb [44754,115483] 0 2024-09-17T01:07:11.039 INFO:tasks.workunit.client.0.smithi103.stdout:7/348: link d4/d4a/f79 d4/d11/d2b/d36/d3a/d51/d5e/d7b/f7c 0 2024-09-17T01:07:11.040 INFO:tasks.workunit.client.0.smithi103.stdout:7/349: chown d4/d10/f35 38693 1 2024-09-17T01:07:11.041 INFO:tasks.workunit.client.0.smithi103.stdout:7/350: chown l0 17719376 1 2024-09-17T01:07:11.044 INFO:tasks.workunit.client.1.smithi143.stdout:5/906: rename d1/d46/df/d53/d74/d9a/d9c/fc8 to d1/d46/d6e/f14a 0 2024-09-17T01:07:11.046 INFO:tasks.workunit.client.1.smithi143.stdout:3/931: mkdir d6/d1c/d4d/da4/dea/dff/d116 0 2024-09-17T01:07:11.047 INFO:tasks.workunit.client.0.smithi103.stdout:8/337: mknod d0/d6/dc/d30/d2d/d32/c63 0 2024-09-17T01:07:11.047 INFO:tasks.workunit.client.1.smithi143.stdout:9/881: fdatasync d3/d39/d6a/d9/f87 0 2024-09-17T01:07:11.049 INFO:tasks.workunit.client.0.smithi103.stdout:8/338: truncate d0/d6/dc/d30/d2d/d32/f4d 4682111 0 2024-09-17T01:07:11.051 INFO:tasks.workunit.client.1.smithi143.stdout:8/967: mkdir d9/d161 0 2024-09-17T01:07:11.052 INFO:tasks.workunit.client.0.smithi103.stdout:2/226: sync 2024-09-17T01:07:11.053 INFO:tasks.workunit.client.1.smithi143.stdout:1/953: creat d0/d6/d43/d47/d88/da5/db1/f13c x:0 0 0 2024-09-17T01:07:11.054 INFO:tasks.workunit.client.0.smithi103.stdout:9/392: creat d7/d43/d48/f83 x:0 0 0 2024-09-17T01:07:11.058 INFO:tasks.workunit.client.0.smithi103.stdout:8/339: rename d0/d6/dc/d30/d2d/d32 to d0/d6/dc/d30/d25/d64 0 2024-09-17T01:07:11.060 INFO:tasks.workunit.client.0.smithi103.stdout:7/351: write d4/d10/f2e [808607,26490] 0 2024-09-17T01:07:11.062 INFO:tasks.workunit.client.0.smithi103.stdout:9/393: dread d7/d43/d48/f38 [0,4194304] 0 2024-09-17T01:07:11.063 INFO:tasks.workunit.client.0.smithi103.stdout:9/394: chown d7/f19 2014382 1 2024-09-17T01:07:11.066 INFO:tasks.workunit.client.1.smithi143.stdout:9/882: read d3/d39/d6a/f30 [5696279,58632] 0 2024-09-17T01:07:11.066 INFO:tasks.workunit.client.1.smithi143.stdout:8/968: creat d9/d12/f162 x:0 0 0 2024-09-17T01:07:11.069 INFO:tasks.workunit.client.0.smithi103.stdout:2/227: creat d6/f4b x:0 0 0 2024-09-17T01:07:11.070 INFO:tasks.workunit.client.1.smithi143.stdout:3/932: dwrite d6/d1c/d33/d41/d2b/fd4 [0,4194304] 0 2024-09-17T01:07:11.070 INFO:tasks.workunit.client.1.smithi143.stdout:6/864: getdents d2/df/d18/da8 0 2024-09-17T01:07:11.071 INFO:tasks.workunit.client.1.smithi143.stdout:3/933: chown d6/d1c/d33/d3f/d5c/lda 324 1 2024-09-17T01:07:11.071 INFO:tasks.workunit.client.0.smithi103.stdout:9/395: creat d7/d43/d48/d11/d5c/d5e/d6c/f84 x:0 0 0 2024-09-17T01:07:11.074 INFO:tasks.workunit.client.0.smithi103.stdout:7/352: link d4/d11/d2b/f2f d4/d11/d2b/d36/f7d 0 2024-09-17T01:07:11.075 INFO:tasks.workunit.client.0.smithi103.stdout:2/228: fdatasync d6/da/d3f/f47 0 2024-09-17T01:07:11.078 INFO:tasks.workunit.client.1.smithi143.stdout:9/883: creat d3/d39/d6a/d26/f11e x:0 0 0 2024-09-17T01:07:11.078 INFO:tasks.workunit.client.0.smithi103.stdout:8/340: creat d0/d6/dc/d30/d2d/f65 x:0 0 0 2024-09-17T01:07:11.079 INFO:tasks.workunit.client.0.smithi103.stdout:8/341: stat d0/d6/dc/d30/d25/d64/l37 0 2024-09-17T01:07:11.080 INFO:tasks.workunit.client.1.smithi143.stdout:8/969: rmdir d9/d23/db4/d55 39 2024-09-17T01:07:11.081 INFO:tasks.workunit.client.0.smithi103.stdout:7/353: fdatasync d4/d11/f44 0 2024-09-17T01:07:11.083 INFO:tasks.workunit.client.0.smithi103.stdout:7/354: truncate d4/d10/f25 5357581 0 2024-09-17T01:07:11.086 INFO:tasks.workunit.client.0.smithi103.stdout:8/342: dwrite d0/d6/dc/d30/d2d/f3c [0,4194304] 0 2024-09-17T01:07:11.089 INFO:tasks.workunit.client.1.smithi143.stdout:5/907: rename d1/d46/d9b/ce8 to d1/d46/d9b/daa/c14b 0 2024-09-17T01:07:11.090 INFO:tasks.workunit.client.0.smithi103.stdout:7/355: mknod d4/d10/d37/c7e 0 2024-09-17T01:07:11.091 INFO:tasks.workunit.client.1.smithi143.stdout:9/884: mknod d3/d39/d6a/d9/c11f 0 2024-09-17T01:07:11.093 INFO:tasks.workunit.client.1.smithi143.stdout:1/954: creat d0/d6/d43/d6d/f13d x:0 0 0 2024-09-17T01:07:11.094 INFO:tasks.workunit.client.1.smithi143.stdout:4/941: getdents da/d3a/d3e/d5e/d63/d80 0 2024-09-17T01:07:11.094 INFO:tasks.workunit.client.0.smithi103.stdout:7/356: creat d4/d11/f7f x:0 0 0 2024-09-17T01:07:11.095 INFO:tasks.workunit.client.1.smithi143.stdout:6/865: creat d2/d17/d6e/d26/dbd/d105/f123 x:0 0 0 2024-09-17T01:07:11.096 INFO:tasks.workunit.client.0.smithi103.stdout:9/396: getdents d7/d43/d5f 0 2024-09-17T01:07:11.098 INFO:tasks.workunit.client.1.smithi143.stdout:3/934: creat d6/d1c/d10c/d86/d89/d115/f117 x:0 0 0 2024-09-17T01:07:11.100 INFO:tasks.workunit.client.1.smithi143.stdout:8/970: chown d9/d12/df4/ld8 15 1 2024-09-17T01:07:11.101 INFO:tasks.workunit.client.0.smithi103.stdout:2/229: truncate d6/f7 114258 0 2024-09-17T01:07:11.102 INFO:tasks.workunit.client.0.smithi103.stdout:7/357: dwrite d4/d11/d2b/f65 [0,4194304] 0 2024-09-17T01:07:11.104 INFO:tasks.workunit.client.0.smithi103.stdout:2/230: write d6/da/d17/d1a/df/f43 [402428,124174] 0 2024-09-17T01:07:11.105 INFO:tasks.workunit.client.1.smithi143.stdout:5/908: rename d1/d46/d9b/cd4 to d1/d46/df/d23/d4f/d7d/d92/dfd/c14c 0 2024-09-17T01:07:11.105 INFO:tasks.workunit.client.0.smithi103.stdout:2/231: write d6/fb [3278855,82469] 0 2024-09-17T01:07:11.107 INFO:tasks.workunit.client.0.smithi103.stdout:7/358: mkdir d4/d11/d80 0 2024-09-17T01:07:11.109 INFO:tasks.workunit.client.1.smithi143.stdout:3/935: symlink d6/d1c/d33/d41/d42/l118 0 2024-09-17T01:07:11.112 INFO:tasks.workunit.client.1.smithi143.stdout:6/866: rename d2/d17/d6e/ddc/df1/c90 to d2/df/d18/d69/dba/c124 0 2024-09-17T01:07:11.113 INFO:tasks.workunit.client.1.smithi143.stdout:5/909: unlink d1/d46/df/d23/d4f/f1d 0 2024-09-17T01:07:11.115 INFO:tasks.workunit.client.0.smithi103.stdout:2/232: fdatasync d6/f8 0 2024-09-17T01:07:11.116 INFO:tasks.workunit.client.1.smithi143.stdout:8/971: mknod d9/d12/d38/d58/d79/d112/d143/df2/c163 0 2024-09-17T01:07:11.118 INFO:tasks.workunit.client.0.smithi103.stdout:2/233: creat d6/da/d17/d1a/df/f4c x:0 0 0 2024-09-17T01:07:11.119 INFO:tasks.workunit.client.1.smithi143.stdout:6/867: rmdir d2/d19 39 2024-09-17T01:07:11.120 INFO:tasks.workunit.client.1.smithi143.stdout:6/868: write d2/df/d18/da8/f122 [95761,46577] 0 2024-09-17T01:07:11.121 INFO:tasks.workunit.client.0.smithi103.stdout:2/234: creat d6/da/d28/f4d x:0 0 0 2024-09-17T01:07:11.124 INFO:tasks.workunit.client.1.smithi143.stdout:9/885: link d3/d39/d42/d80/df3/lba d3/d39/d42/l120 0 2024-09-17T01:07:11.128 INFO:tasks.workunit.client.0.smithi103.stdout:2/235: mkdir d6/da/d17/d26/d34/d4e 0 2024-09-17T01:07:11.128 INFO:tasks.workunit.client.0.smithi103.stdout:2/236: readlink d6/da/d17/d1a/l3a 0 2024-09-17T01:07:11.130 INFO:tasks.workunit.client.1.smithi143.stdout:6/869: rmdir d2/d30 39 2024-09-17T01:07:11.132 INFO:tasks.workunit.client.1.smithi143.stdout:5/910: creat d1/d46/df/d1f/d66/d70/dea/f14d x:0 0 0 2024-09-17T01:07:11.135 INFO:tasks.workunit.client.1.smithi143.stdout:9/886: rename d3/d39/d42/d58/l6e to d3/d39/d6a/d9/d107/l121 0 2024-09-17T01:07:11.135 INFO:tasks.workunit.client.0.smithi103.stdout:2/237: symlink d6/da/d17/d1a/l4f 0 2024-09-17T01:07:11.137 INFO:tasks.workunit.client.1.smithi143.stdout:3/936: creat d6/d1c/d82/f119 x:0 0 0 2024-09-17T01:07:11.137 INFO:tasks.workunit.client.1.smithi143.stdout:6/870: symlink d2/df/d18/l125 0 2024-09-17T01:07:11.138 INFO:tasks.workunit.client.1.smithi143.stdout:3/937: write d6/d1c/d10c/d86/ddc/fc2 [267889,59508] 0 2024-09-17T01:07:11.138 INFO:tasks.workunit.client.1.smithi143.stdout:3/938: fdatasync d6/d1c/d10c/d86/fcb 0 2024-09-17T01:07:11.139 INFO:tasks.workunit.client.1.smithi143.stdout:8/972: write d9/d12/d38/f9f [596916,33569] 0 2024-09-17T01:07:11.139 INFO:tasks.workunit.client.1.smithi143.stdout:5/911: chown d1/d46/l4b 163843 1 2024-09-17T01:07:11.140 INFO:tasks.workunit.client.0.smithi103.stdout:2/238: mknod d6/c50 0 2024-09-17T01:07:11.141 INFO:tasks.workunit.client.1.smithi143.stdout:0/874: sync 2024-09-17T01:07:11.142 INFO:tasks.workunit.client.0.smithi103.stdout:2/239: write d6/da/d17/d1a/f22 [1074315,13618] 0 2024-09-17T01:07:11.146 INFO:tasks.workunit.client.0.smithi103.stdout:2/240: chown d6/da/d17/c33 54 1 2024-09-17T01:07:11.148 INFO:tasks.workunit.client.1.smithi143.stdout:0/875: rename d3/d14/d10d to d3/d5/d8/d21/d109/d11a 0 2024-09-17T01:07:11.151 INFO:tasks.workunit.client.1.smithi143.stdout:3/939: creat d6/d1c/d4d/da4/dea/dff/d116/f11a x:0 0 0 2024-09-17T01:07:11.155 INFO:tasks.workunit.client.0.smithi103.stdout:2/241: dread f5 [0,4194304] 0 2024-09-17T01:07:11.155 INFO:tasks.workunit.client.1.smithi143.stdout:9/887: getdents d3/d39/d6a 0 2024-09-17T01:07:11.156 INFO:tasks.workunit.client.1.smithi143.stdout:3/940: creat d6/d1c/d10c/d86/f11b x:0 0 0 2024-09-17T01:07:11.156 INFO:tasks.workunit.client.1.smithi143.stdout:9/888: read - d3/d39/d6a/d26/f11e zero size 2024-09-17T01:07:11.157 INFO:tasks.workunit.client.1.smithi143.stdout:3/941: readlink d6/d1c/d4b/d57/l9f 0 2024-09-17T01:07:11.158 INFO:tasks.workunit.client.1.smithi143.stdout:0/876: rename d3/d5/d8/c2c to d3/d14/d32/c11b 0 2024-09-17T01:07:11.159 INFO:tasks.workunit.client.1.smithi143.stdout:9/889: symlink d3/d81/d9c/l122 0 2024-09-17T01:07:11.160 INFO:tasks.workunit.client.1.smithi143.stdout:0/877: chown d3/d68/d8f/ddb/de8/ff2 32840 1 2024-09-17T01:07:11.160 INFO:tasks.workunit.client.1.smithi143.stdout:3/942: creat d6/d1c/d33/d3f/d5c/f11c x:0 0 0 2024-09-17T01:07:11.161 INFO:tasks.workunit.client.0.smithi103.stdout:2/242: dwrite d6/f2d [0,4194304] 0 2024-09-17T01:07:11.164 INFO:tasks.workunit.client.1.smithi143.stdout:3/943: mkdir d6/d68/d11d 0 2024-09-17T01:07:11.166 INFO:tasks.workunit.client.1.smithi143.stdout:5/912: dread d1/d46/df/d1f/f30 [0,4194304] 0 2024-09-17T01:07:11.167 INFO:tasks.workunit.client.1.smithi143.stdout:8/973: dread d9/de/f97 [0,4194304] 0 2024-09-17T01:07:11.168 INFO:tasks.workunit.client.1.smithi143.stdout:3/944: creat d6/d1c/d4d/da4/dea/dff/d116/f11e x:0 0 0 2024-09-17T01:07:11.170 INFO:tasks.workunit.client.0.smithi103.stdout:2/243: dwrite d6/da/d17/d1a/df/f36 [0,4194304] 0 2024-09-17T01:07:11.171 INFO:tasks.workunit.client.0.smithi103.stdout:2/244: chown d6/da/d17/d42/c48 158 1 2024-09-17T01:07:11.172 INFO:tasks.workunit.client.1.smithi143.stdout:5/913: unlink d1/d46/d9b/cbe 0 2024-09-17T01:07:11.174 INFO:tasks.workunit.client.1.smithi143.stdout:6/871: dread d2/fa [0,4194304] 0 2024-09-17T01:07:11.174 INFO:tasks.workunit.client.1.smithi143.stdout:0/878: write d3/d5/d8/d58/f7f [1720970,119363] 0 2024-09-17T01:07:11.175 INFO:tasks.workunit.client.1.smithi143.stdout:5/914: chown d1/d46/le5 7 1 2024-09-17T01:07:11.176 INFO:tasks.workunit.client.1.smithi143.stdout:8/974: rename d9/d12/d38/d58/d79/d112/d143/c87 to d9/d23/d120/c164 0 2024-09-17T01:07:11.179 INFO:tasks.workunit.client.1.smithi143.stdout:5/915: creat d1/d46/df/d23/d4f/d7d/d92/f14e x:0 0 0 2024-09-17T01:07:11.180 INFO:tasks.workunit.client.1.smithi143.stdout:6/872: dread d2/d17/d3a/fc2 [0,4194304] 0 2024-09-17T01:07:11.181 INFO:tasks.workunit.client.1.smithi143.stdout:5/916: mknod d1/d96/c14f 0 2024-09-17T01:07:11.182 INFO:tasks.workunit.client.1.smithi143.stdout:0/879: link d3/d5/ca0 d3/d88/d93/dc4/c11c 0 2024-09-17T01:07:11.183 INFO:tasks.workunit.client.1.smithi143.stdout:0/880: readlink d3/d5/d8/d27/d31/d85/l9a 0 2024-09-17T01:07:11.183 INFO:tasks.workunit.client.1.smithi143.stdout:8/975: rename d9/d23/d32/d11f to d9/d12/d38/d7a/d165 0 2024-09-17T01:07:11.185 INFO:tasks.workunit.client.0.smithi103.stdout:4/389: sync 2024-09-17T01:07:11.186 INFO:tasks.workunit.client.0.smithi103.stdout:4/390: chown d9/d10/c1d 9740 1 2024-09-17T01:07:11.186 INFO:tasks.workunit.client.1.smithi143.stdout:5/917: read d1/d46/df/d23/fcc [1577621,38548] 0 2024-09-17T01:07:11.187 INFO:tasks.workunit.client.0.smithi103.stdout:4/391: rmdir d9/d2d/d55 39 2024-09-17T01:07:11.188 INFO:tasks.workunit.client.1.smithi143.stdout:0/881: getdents d3/d5/d8/d27/d31/d4c 0 2024-09-17T01:07:11.190 INFO:tasks.workunit.client.0.smithi103.stdout:2/245: write d6/da/f2f [3977312,34901] 0 2024-09-17T01:07:11.191 INFO:tasks.workunit.client.1.smithi143.stdout:6/873: dwrite d2/d17/d6e/d26/d79/f11d [0,4194304] 0 2024-09-17T01:07:11.202 INFO:tasks.workunit.client.1.smithi143.stdout:3/945: dread d6/d1c/d10c/d30/fb6 [0,4194304] 0 2024-09-17T01:07:11.205 INFO:tasks.workunit.client.1.smithi143.stdout:2/858: sync 2024-09-17T01:07:11.206 INFO:tasks.workunit.client.1.smithi143.stdout:2/859: chown d0/d10/d58/d5a/d5b/d4c/lee 186485691 1 2024-09-17T01:07:11.214 INFO:tasks.workunit.client.1.smithi143.stdout:8/976: dread d9/d26/f36 [0,4194304] 0 2024-09-17T01:07:11.214 INFO:tasks.workunit.client.1.smithi143.stdout:2/860: dread d0/d10/d58/d5a/d5b/fa4 [0,4194304] 0 2024-09-17T01:07:11.214 INFO:tasks.workunit.client.1.smithi143.stdout:2/861: write d0/d10/d58/d5a/d5b/d4c/d77/fc3 [560465,92759] 0 2024-09-17T01:07:11.214 INFO:tasks.workunit.client.1.smithi143.stdout:2/862: fdatasync d0/d2/d21/d84/d8d/fd8 0 2024-09-17T01:07:11.217 INFO:tasks.workunit.client.0.smithi103.stdout:4/392: dread d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:11.229 INFO:tasks.workunit.client.1.smithi143.stdout:4/942: sync 2024-09-17T01:07:11.229 INFO:tasks.workunit.client.1.smithi143.stdout:1/955: sync 2024-09-17T01:07:11.250 INFO:tasks.workunit.client.1.smithi143.stdout:0/882: creat d3/d5/d8/d58/f11d x:0 0 0 2024-09-17T01:07:11.253 INFO:tasks.workunit.client.1.smithi143.stdout:6/874: rmdir d2/d17/d6e/d26/dbd/d5e/d7c 39 2024-09-17T01:07:11.255 INFO:tasks.workunit.client.0.smithi103.stdout:2/246: creat d6/da/d17/d26/d34/d4e/f51 x:0 0 0 2024-09-17T01:07:11.255 INFO:tasks.workunit.client.1.smithi143.stdout:0/883: dwrite d3/d5/d8/d27/d31/d85/fa1 [0,4194304] 0 2024-09-17T01:07:11.257 INFO:tasks.workunit.client.1.smithi143.stdout:8/977: creat d9/d12/d38/d58/d79/d9b/f166 x:0 0 0 2024-09-17T01:07:11.260 INFO:tasks.workunit.client.1.smithi143.stdout:2/863: mknod d0/d10/d58/d5a/c11c 0 2024-09-17T01:07:11.261 INFO:tasks.workunit.client.1.smithi143.stdout:3/946: dwrite d6/d1c/d33/d3f/d5c/f91 [0,4194304] 0 2024-09-17T01:07:11.261 INFO:tasks.workunit.client.0.smithi103.stdout:4/393: dwrite d9/d10/f1f [0,4194304] 0 2024-09-17T01:07:11.262 INFO:tasks.workunit.client.0.smithi103.stdout:4/394: chown d9/d16/d23 68 1 2024-09-17T01:07:11.263 INFO:tasks.workunit.client.1.smithi143.stdout:3/947: fsync d6/d1c/d4d/da4/ff5 0 2024-09-17T01:07:11.263 INFO:tasks.workunit.client.1.smithi143.stdout:4/943: fsync da/d6d/f76 0 2024-09-17T01:07:11.263 INFO:tasks.workunit.client.0.smithi103.stdout:2/247: creat d6/f52 x:0 0 0 2024-09-17T01:07:11.264 INFO:tasks.workunit.client.1.smithi143.stdout:1/956: unlink d0/dc/d89/f13a 0 2024-09-17T01:07:11.264 INFO:tasks.workunit.client.1.smithi143.stdout:3/948: readlink d6/d1c/d4b/la8 0 2024-09-17T01:07:11.265 INFO:tasks.workunit.client.0.smithi103.stdout:4/395: dread - d9/d2d/d55/f60 zero size 2024-09-17T01:07:11.266 INFO:tasks.workunit.client.1.smithi143.stdout:5/918: mkdir d1/d46/df/d1f/d9f/d125/d142/d150 0 2024-09-17T01:07:11.268 INFO:tasks.workunit.client.1.smithi143.stdout:6/875: creat d2/df/d20/d2c/d38/f126 x:0 0 0 2024-09-17T01:07:11.268 INFO:tasks.workunit.client.1.smithi143.stdout:0/884: mknod d3/d5/d35/c11e 0 2024-09-17T01:07:11.269 INFO:tasks.workunit.client.1.smithi143.stdout:3/949: write d6/d1c/d33/d41/d42/ff2 [4487709,39705] 0 2024-09-17T01:07:11.269 INFO:tasks.workunit.client.0.smithi103.stdout:4/396: mkdir d9/d16/d38/d3f/d6c 0 2024-09-17T01:07:11.271 INFO:tasks.workunit.client.0.smithi103.stdout:4/397: write d9/dc/f67 [620567,105268] 0 2024-09-17T01:07:11.271 INFO:tasks.workunit.client.1.smithi143.stdout:3/950: chown d6/d1c/d33/d3f/fbc 0 1 2024-09-17T01:07:11.272 INFO:tasks.workunit.client.0.smithi103.stdout:2/248: rename d6/f18 to d6/da/d17/d26/d34/d4e/f53 0 2024-09-17T01:07:11.273 INFO:tasks.workunit.client.1.smithi143.stdout:3/951: stat d6/d1c/d10c/c92 0 2024-09-17T01:07:11.273 INFO:tasks.workunit.client.1.smithi143.stdout:2/864: truncate d0/d10/f1d 3553855 0 2024-09-17T01:07:11.276 INFO:tasks.workunit.client.0.smithi103.stdout:2/249: unlink d6/da/d28/f2e 0 2024-09-17T01:07:11.277 INFO:tasks.workunit.client.1.smithi143.stdout:4/944: chown da/d3a/c83 33 1 2024-09-17T01:07:11.283 INFO:tasks.workunit.client.1.smithi143.stdout:9/890: sync 2024-09-17T01:07:11.287 INFO:tasks.workunit.client.1.smithi143.stdout:3/952: mknod d6/d1c/d82/de4/c11f 0 2024-09-17T01:07:11.288 INFO:tasks.workunit.client.1.smithi143.stdout:2/865: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d9f/d11d 0 2024-09-17T01:07:11.289 INFO:tasks.workunit.client.1.smithi143.stdout:2/866: readlink d0/d44/l54 0 2024-09-17T01:07:11.294 INFO:tasks.workunit.client.0.smithi103.stdout:4/398: dread d9/dc/df/f20 [0,4194304] 0 2024-09-17T01:07:11.294 INFO:tasks.workunit.client.0.smithi103.stdout:4/399: fdatasync d9/d16/f37 0 2024-09-17T01:07:11.301 INFO:tasks.workunit.client.1.smithi143.stdout:4/945: dread da/d3a/d40/df0/f10f [0,4194304] 0 2024-09-17T01:07:11.301 INFO:tasks.workunit.client.1.smithi143.stdout:0/885: rename d3/d5/d6b/f90 to d3/d5/d8/d10/db3/f11f 0 2024-09-17T01:07:11.302 INFO:tasks.workunit.client.1.smithi143.stdout:9/891: fdatasync d3/d3d/f70 0 2024-09-17T01:07:11.303 INFO:tasks.workunit.client.1.smithi143.stdout:0/886: chown d3/d5/d8/d27/d31/d4c/l7c 16706998 1 2024-09-17T01:07:11.305 INFO:tasks.workunit.client.1.smithi143.stdout:9/892: write d3/d81/ff5 [289322,39140] 0 2024-09-17T01:07:11.305 INFO:tasks.workunit.client.1.smithi143.stdout:2/867: chown d0/c10a 1716 1 2024-09-17T01:07:11.308 INFO:tasks.workunit.client.1.smithi143.stdout:3/953: unlink d6/d1c/d33/d3f/d5c/da1/f8c 0 2024-09-17T01:07:11.309 INFO:tasks.workunit.client.1.smithi143.stdout:9/893: fdatasync d3/d81/f85 0 2024-09-17T01:07:11.310 INFO:tasks.workunit.client.1.smithi143.stdout:0/887: symlink d3/d5/d8/d21/d109/d11a/l120 0 2024-09-17T01:07:11.310 INFO:tasks.workunit.client.1.smithi143.stdout:4/946: dwrite da/d3a/d3e/d4a/d8a/fb8 [0,4194304] 0 2024-09-17T01:07:11.311 INFO:tasks.workunit.client.1.smithi143.stdout:0/888: fdatasync d3/d68/d75/dd0/ffe 0 2024-09-17T01:07:11.312 INFO:tasks.workunit.client.1.smithi143.stdout:4/947: fdatasync da/d3a/d40/daa/dc3/fd4 0 2024-09-17T01:07:11.319 INFO:tasks.workunit.client.1.smithi143.stdout:0/889: creat d3/d5/d105/f121 x:0 0 0 2024-09-17T01:07:11.320 INFO:tasks.workunit.client.1.smithi143.stdout:2/868: link d0/d2/d21/f2c d0/d2/d21/d84/f11e 0 2024-09-17T01:07:11.322 INFO:tasks.workunit.client.1.smithi143.stdout:3/954: getdents d6/d1c/d33/d3f/d79 0 2024-09-17T01:07:11.322 INFO:tasks.workunit.client.1.smithi143.stdout:1/957: write d0/d6/d43/d47/d68/d7b/fb0 [1381119,84362] 0 2024-09-17T01:07:11.323 INFO:tasks.workunit.client.1.smithi143.stdout:5/919: truncate d1/d46/df/d53/d74/d9a/d9c/fc4 3911443 0 2024-09-17T01:07:11.324 INFO:tasks.workunit.client.1.smithi143.stdout:4/948: dwrite da/d68/d9b/feb [0,4194304] 0 2024-09-17T01:07:11.330 INFO:tasks.workunit.client.1.smithi143.stdout:2/869: creat d0/d44/d7a/f11f x:0 0 0 2024-09-17T01:07:11.333 INFO:tasks.workunit.client.1.smithi143.stdout:8/978: dwrite d9/d12/d13/d7c/f91 [0,4194304] 0 2024-09-17T01:07:11.333 INFO:tasks.workunit.client.1.smithi143.stdout:1/958: rmdir d0/dc/d74/d94 39 2024-09-17T01:07:11.334 INFO:tasks.workunit.client.1.smithi143.stdout:0/890: rename d3/cd2 to d3/d5/d8/d21/d9b/dba/c122 0 2024-09-17T01:07:11.334 INFO:tasks.workunit.client.1.smithi143.stdout:3/955: truncate d6/d1c/d82/de4/ff7 1820944 0 2024-09-17T01:07:11.335 INFO:tasks.workunit.client.1.smithi143.stdout:6/876: dwrite d2/df/d20/d2c/d38/f72 [0,4194304] 0 2024-09-17T01:07:11.336 INFO:tasks.workunit.client.1.smithi143.stdout:8/979: chown d9/de/d53/d75/f88 7332 1 2024-09-17T01:07:11.337 INFO:tasks.workunit.client.1.smithi143.stdout:0/891: chown d3/d5/d8/d27/d31/d85 2 1 2024-09-17T01:07:11.337 INFO:tasks.workunit.client.1.smithi143.stdout:5/920: creat d1/d46/df/d23/d4f/d7d/dcf/dc5/f151 x:0 0 0 2024-09-17T01:07:11.340 INFO:tasks.workunit.client.0.smithi103.stdout:4/400: dwrite d9/d10/f14 [0,4194304] 0 2024-09-17T01:07:11.341 INFO:tasks.workunit.client.1.smithi143.stdout:1/959: chown d0/d6/d43/f12e 1594281584 1 2024-09-17T01:07:11.341 INFO:tasks.workunit.client.1.smithi143.stdout:8/980: chown d9/d12/df4/f111 0 1 2024-09-17T01:07:11.342 INFO:tasks.workunit.client.1.smithi143.stdout:4/949: fsync da/d68/d9b/feb 0 2024-09-17T01:07:11.344 INFO:tasks.workunit.client.1.smithi143.stdout:6/877: write d2/d19/f8a [2570914,12767] 0 2024-09-17T01:07:11.345 INFO:tasks.workunit.client.1.smithi143.stdout:0/892: mknod d3/d68/d8f/ddb/de8/daf/c123 0 2024-09-17T01:07:11.349 INFO:tasks.workunit.client.1.smithi143.stdout:3/956: truncate d6/d1c/d33/d41/d42/fc9 2457826 0 2024-09-17T01:07:11.349 INFO:tasks.workunit.client.1.smithi143.stdout:8/981: mkdir d9/d12/d38/dba/d167 0 2024-09-17T01:07:11.351 INFO:tasks.workunit.client.1.smithi143.stdout:1/960: dwrite d0/d6/d43/d47/dd8/ff5 [0,4194304] 0 2024-09-17T01:07:11.352 INFO:tasks.workunit.client.0.smithi103.stdout:4/401: creat d9/d16/d23/f6d x:0 0 0 2024-09-17T01:07:11.352 INFO:tasks.workunit.client.0.smithi103.stdout:4/402: chown d9/d16/d23/d32 2261 1 2024-09-17T01:07:11.354 INFO:tasks.workunit.client.1.smithi143.stdout:6/878: mkdir d2/d17/d6e/d26/d46/d66/d127 0 2024-09-17T01:07:11.354 INFO:tasks.workunit.client.1.smithi143.stdout:0/893: creat d3/d5/d8/d10/f124 x:0 0 0 2024-09-17T01:07:11.355 INFO:tasks.workunit.client.0.smithi103.stdout:4/403: write d9/dc/df/f2c [4820776,16485] 0 2024-09-17T01:07:11.356 INFO:tasks.workunit.client.1.smithi143.stdout:6/879: write d2/df/d18/d69/f114 [317227,112622] 0 2024-09-17T01:07:11.357 INFO:tasks.workunit.client.1.smithi143.stdout:4/950: creat da/d3a/df8/f135 x:0 0 0 2024-09-17T01:07:11.358 INFO:tasks.workunit.client.1.smithi143.stdout:9/894: dwrite d3/d81/fa6 [0,4194304] 0 2024-09-17T01:07:11.359 INFO:tasks.workunit.client.1.smithi143.stdout:3/957: fsync d6/d1c/d10c/d86/d89/fa6 0 2024-09-17T01:07:11.360 INFO:tasks.workunit.client.0.smithi103.stdout:4/404: dread d9/dc/f67 [0,4194304] 0 2024-09-17T01:07:11.362 INFO:tasks.workunit.client.1.smithi143.stdout:6/880: chown d2/d17/d6e/d26/dbd/d105 1 1 2024-09-17T01:07:11.363 INFO:tasks.workunit.client.1.smithi143.stdout:6/881: read d2/d17/d6e/fbb [305927,123803] 0 2024-09-17T01:07:11.365 INFO:tasks.workunit.client.0.smithi103.stdout:4/405: rename d9/d16/d38/d3f/d6c to d9/d10/d6e 0 2024-09-17T01:07:11.367 INFO:tasks.workunit.client.0.smithi103.stdout:4/406: write d9/f3a [2798414,93462] 0 2024-09-17T01:07:11.368 INFO:tasks.workunit.client.0.smithi103.stdout:4/407: chown d9/d16/d36/d42/c49 11702 1 2024-09-17T01:07:11.370 INFO:tasks.workunit.client.1.smithi143.stdout:0/894: rmdir d3/d68/d8f 39 2024-09-17T01:07:11.371 INFO:tasks.workunit.client.1.smithi143.stdout:2/870: dwrite d0/d2/d21/d22/f41 [4194304,4194304] 0 2024-09-17T01:07:11.371 INFO:tasks.workunit.client.1.smithi143.stdout:0/895: fsync d3/d5/d8/d21/f3e 0 2024-09-17T01:07:11.372 INFO:tasks.workunit.client.0.smithi103.stdout:4/408: write d9/dc/f67 [814010,11111] 0 2024-09-17T01:07:11.374 INFO:tasks.workunit.client.1.smithi143.stdout:4/951: rmdir da/d3a/d3e/d72/da3 39 2024-09-17T01:07:11.375 INFO:tasks.workunit.client.1.smithi143.stdout:1/961: mknod d0/dc/c13e 0 2024-09-17T01:07:11.381 INFO:tasks.workunit.client.1.smithi143.stdout:6/882: creat d2/df/d18/da8/f128 x:0 0 0 2024-09-17T01:07:11.382 INFO:tasks.workunit.client.0.smithi103.stdout:4/409: dwrite d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:11.382 INFO:tasks.workunit.client.1.smithi143.stdout:5/921: link d1/d46/df/d23/c88 d1/d46/df/d53/d74/d9a/dd7/d10f/c152 0 2024-09-17T01:07:11.387 INFO:tasks.workunit.client.1.smithi143.stdout:2/871: symlink d0/d10/d58/d5a/d5b/d4c/d71/dd2/l120 0 2024-09-17T01:07:11.390 INFO:tasks.workunit.client.0.smithi103.stdout:4/410: link d9/dc/df/f20 d9/d16/d38/d3f/f6f 0 2024-09-17T01:07:11.390 INFO:tasks.workunit.client.0.smithi103.stdout:4/411: readlink d9/d10/l17 0 2024-09-17T01:07:11.391 INFO:tasks.workunit.client.1.smithi143.stdout:5/922: dwrite d1/d5e/f10c [4194304,4194304] 0 2024-09-17T01:07:11.392 INFO:tasks.workunit.client.1.smithi143.stdout:3/958: mkdir d6/d1c/d33/d3f/d5c/da1/d101/d120 0 2024-09-17T01:07:11.394 INFO:tasks.workunit.client.0.smithi103.stdout:4/412: dread d9/d16/d38/d3f/f6f [0,4194304] 0 2024-09-17T01:07:11.395 INFO:tasks.workunit.client.1.smithi143.stdout:9/895: dread d3/d39/d42/d58/d5a/fbc [0,4194304] 0 2024-09-17T01:07:11.397 INFO:tasks.workunit.client.1.smithi143.stdout:9/896: chown d3/d39/d42/d58/f9f 112 1 2024-09-17T01:07:11.397 INFO:tasks.workunit.client.1.smithi143.stdout:6/883: rmdir d2/df/d18/d69/dba 39 2024-09-17T01:07:11.398 INFO:tasks.workunit.client.1.smithi143.stdout:4/952: dwrite da/d75/f7b [0,4194304] 0 2024-09-17T01:07:11.400 INFO:tasks.workunit.client.0.smithi103.stdout:4/413: mkdir d9/d16/d70 0 2024-09-17T01:07:11.401 INFO:tasks.workunit.client.1.smithi143.stdout:2/872: truncate d0/d10/d58/d5a/fd7 3717523 0 2024-09-17T01:07:11.402 INFO:tasks.workunit.client.1.smithi143.stdout:5/923: mknod d1/d46/df/d1f/d9f/d125/c153 0 2024-09-17T01:07:11.403 INFO:tasks.workunit.client.1.smithi143.stdout:8/982: getdents d9/d12/d38/d58/d79/d112/d143/df2 0 2024-09-17T01:07:11.403 INFO:tasks.workunit.client.1.smithi143.stdout:5/924: write d1/d96/fd2 [1181357,19424] 0 2024-09-17T01:07:11.406 INFO:tasks.workunit.client.1.smithi143.stdout:3/959: rename d6/d1c/d4b/f8e to d6/d1c/d4d/dd1/f121 0 2024-09-17T01:07:11.408 INFO:tasks.workunit.client.0.smithi103.stdout:4/414: creat d9/d16/d45/d5e/f71 x:0 0 0 2024-09-17T01:07:11.410 INFO:tasks.workunit.client.1.smithi143.stdout:0/896: creat d3/f125 x:0 0 0 2024-09-17T01:07:11.411 INFO:tasks.workunit.client.0.smithi103.stdout:4/415: creat d9/dc/df/f72 x:0 0 0 2024-09-17T01:07:11.412 INFO:tasks.workunit.client.1.smithi143.stdout:9/897: rmdir d3/d39/d6a/d26 39 2024-09-17T01:07:11.414 INFO:tasks.workunit.client.0.smithi103.stdout:4/416: creat d9/d16/d23/d32/d61/d47/f73 x:0 0 0 2024-09-17T01:07:11.415 INFO:tasks.workunit.client.1.smithi143.stdout:2/873: symlink d0/d2/d21/l121 0 2024-09-17T01:07:11.415 INFO:tasks.workunit.client.0.smithi103.stdout:4/417: chown d9/d16/d38/d3f/l51 0 1 2024-09-17T01:07:11.415 INFO:tasks.workunit.client.1.smithi143.stdout:8/983: chown d9/d23/db4/d55 4032078 1 2024-09-17T01:07:11.416 INFO:tasks.workunit.client.0.smithi103.stdout:4/418: write d9/dc/df/f72 [999217,43066] 0 2024-09-17T01:07:11.416 INFO:tasks.workunit.client.0.smithi103.stdout:4/419: chown d9/d2d 6 1 2024-09-17T01:07:11.417 INFO:tasks.workunit.client.1.smithi143.stdout:2/874: dread d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/fc6 [0,4194304] 0 2024-09-17T01:07:11.484 INFO:tasks.workunit.client.1.smithi143.stdout:1/962: getdents d0/d6/d43/d47/dbf/deb/dc3 0 2024-09-17T01:07:11.485 INFO:tasks.workunit.client.1.smithi143.stdout:0/897: creat d3/d5/d8/d27/d31/d48/d8d/de6/dec/f126 x:0 0 0 2024-09-17T01:07:11.486 INFO:tasks.workunit.client.1.smithi143.stdout:0/898: dread - d3/d5/d8/d58/f11d zero size 2024-09-17T01:07:11.487 INFO:tasks.workunit.client.1.smithi143.stdout:0/899: stat d3/d5/d8/d21/d109 0 2024-09-17T01:07:11.487 INFO:tasks.workunit.client.1.smithi143.stdout:9/898: symlink d3/d39/d42/d80/l123 0 2024-09-17T01:07:11.488 INFO:tasks.workunit.client.1.smithi143.stdout:0/900: readlink d3/d5/d8/d27/l15 0 2024-09-17T01:07:11.491 INFO:tasks.workunit.client.0.smithi103.stdout:4/420: creat d9/d16/f74 x:0 0 0 2024-09-17T01:07:11.494 INFO:tasks.workunit.client.1.smithi143.stdout:1/963: creat d0/d6/d43/d6a/d107/ddd/f13f x:0 0 0 2024-09-17T01:07:11.496 INFO:tasks.workunit.client.0.smithi103.stdout:4/421: creat d9/d16/d38/f75 x:0 0 0 2024-09-17T01:07:11.497 INFO:tasks.workunit.client.1.smithi143.stdout:5/925: rename d1/d46/f22 to d1/d46/df/d53/d74/d9a/f154 0 2024-09-17T01:07:11.498 INFO:tasks.workunit.client.1.smithi143.stdout:3/960: creat d6/d1c/d82/f122 x:0 0 0 2024-09-17T01:07:11.499 INFO:tasks.workunit.client.0.smithi103.stdout:4/422: mkdir d9/d16/d45/d76 0 2024-09-17T01:07:11.500 INFO:tasks.workunit.client.1.smithi143.stdout:8/984: mkdir d9/d23/db4/d55/dbf/d15d/d168 0 2024-09-17T01:07:11.500 INFO:tasks.workunit.client.0.smithi103.stdout:4/423: write d9/d16/f12 [989735,5184] 0 2024-09-17T01:07:11.502 INFO:tasks.workunit.client.1.smithi143.stdout:4/953: creat da/d3a/d3e/d72/da3/f136 x:0 0 0 2024-09-17T01:07:11.503 INFO:tasks.workunit.client.1.smithi143.stdout:4/954: write da/d3a/d3e/d5e/fa2 [1168353,39460] 0 2024-09-17T01:07:11.503 INFO:tasks.workunit.client.0.smithi103.stdout:4/424: mknod d9/d16/d23/d52/c77 0 2024-09-17T01:07:11.505 INFO:tasks.workunit.client.1.smithi143.stdout:2/875: dread d0/d10/d58/d5a/d5b/d4c/f6c [0,4194304] 0 2024-09-17T01:07:11.506 INFO:tasks.workunit.client.0.smithi103.stdout:4/425: mkdir d9/d16/d44/d78 0 2024-09-17T01:07:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:11 smithi143 ceph-mon[35452]: pgmap v16: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 56 MiB/s rd, 187 MiB/s wr, 350 op/s 2024-09-17T01:07:11.507 INFO:tasks.workunit.client.1.smithi143.stdout:3/961: symlink d6/d1c/d4d/dd1/l123 0 2024-09-17T01:07:11.508 INFO:tasks.workunit.client.1.smithi143.stdout:2/876: fsync d0/d44/d6a/d91/dc7/fea 0 2024-09-17T01:07:11.510 INFO:tasks.workunit.client.1.smithi143.stdout:1/964: dread d0/d6/d43/d47/dbf/deb/dc3/ff1 [0,4194304] 0 2024-09-17T01:07:11.511 INFO:tasks.workunit.client.0.smithi103.stdout:4/426: rmdir d9/d16/d38 39 2024-09-17T01:07:11.513 INFO:tasks.workunit.client.0.smithi103.stdout:4/427: mknod d9/dc/c79 0 2024-09-17T01:07:11.514 INFO:tasks.workunit.client.1.smithi143.stdout:4/955: dwrite da/d3a/d3e/fdf [0,4194304] 0 2024-09-17T01:07:11.514 INFO:tasks.workunit.client.1.smithi143.stdout:8/985: mkdir d9/d23/d169 0 2024-09-17T01:07:11.515 INFO:tasks.workunit.client.1.smithi143.stdout:3/962: creat d6/d1c/d82/de4/f124 x:0 0 0 2024-09-17T01:07:11.516 INFO:tasks.workunit.client.0.smithi103.stdout:4/428: creat d9/d16/d45/d5e/f7a x:0 0 0 2024-09-17T01:07:11.516 INFO:tasks.workunit.client.0.smithi103.stdout:4/429: fsync d9/f3d 0 2024-09-17T01:07:11.517 INFO:tasks.workunit.client.1.smithi143.stdout:2/877: symlink d0/d10/d58/d5a/l122 0 2024-09-17T01:07:11.518 INFO:tasks.workunit.client.1.smithi143.stdout:2/878: fdatasync d0/d10/d58/d5a/d5b/d4c/f64 0 2024-09-17T01:07:11.518 INFO:tasks.workunit.client.1.smithi143.stdout:1/965: mkdir d0/d6/d43/d6a/d8f/d140 0 2024-09-17T01:07:11.519 INFO:tasks.workunit.client.1.smithi143.stdout:0/901: write d3/d68/d8f/f107 [3028025,18304] 0 2024-09-17T01:07:11.519 INFO:tasks.workunit.client.1.smithi143.stdout:8/986: stat d9/d12/f115 0 2024-09-17T01:07:11.521 INFO:tasks.workunit.client.1.smithi143.stdout:6/884: sync 2024-09-17T01:07:11.521 INFO:tasks.workunit.client.1.smithi143.stdout:8/987: write d9/d12/d13/fed [4464299,101890] 0 2024-09-17T01:07:11.522 INFO:tasks.workunit.client.1.smithi143.stdout:0/902: truncate d3/d5/d8/d10/db3/f116 521548 0 2024-09-17T01:07:11.523 INFO:tasks.workunit.client.1.smithi143.stdout:4/956: rename da/d3a/d40/d84/f94 to da/d3a/d3e/d72/da3/da8/f137 0 2024-09-17T01:07:11.525 INFO:tasks.workunit.client.1.smithi143.stdout:6/885: truncate d2/d17/d6e/d26/dbd/df8/ffd 4938151 0 2024-09-17T01:07:11.525 INFO:tasks.workunit.client.1.smithi143.stdout:3/963: creat d6/d1c/d33/d3f/d79/f125 x:0 0 0 2024-09-17T01:07:11.529 INFO:tasks.workunit.client.1.smithi143.stdout:5/926: write d1/d5e/f65 [1624208,111964] 0 2024-09-17T01:07:11.529 INFO:tasks.workunit.client.1.smithi143.stdout:0/903: unlink d3/d5/d8/d10/f124 0 2024-09-17T01:07:11.532 INFO:tasks.workunit.client.1.smithi143.stdout:2/879: truncate d0/f4a 2207743 0 2024-09-17T01:07:11.532 INFO:tasks.workunit.client.1.smithi143.stdout:5/927: dread - d1/d96/d12e/f134 zero size 2024-09-17T01:07:11.534 INFO:tasks.workunit.client.1.smithi143.stdout:9/899: dwrite d3/d39/d6a/f2a [0,4194304] 0 2024-09-17T01:07:11.536 INFO:tasks.workunit.client.1.smithi143.stdout:0/904: chown d3/d5/d8/f44 93475110 1 2024-09-17T01:07:11.537 INFO:tasks.workunit.client.1.smithi143.stdout:6/886: dread - d2/d30/d84/f9b zero size 2024-09-17T01:07:11.539 INFO:tasks.workunit.client.1.smithi143.stdout:4/957: rmdir da/d3a/d40/d84/db6/df2/d11e 0 2024-09-17T01:07:11.539 INFO:tasks.workunit.client.1.smithi143.stdout:4/958: chown da/d3a/d3e/d72/d9e/fbb 1673 1 2024-09-17T01:07:11.540 INFO:tasks.workunit.client.1.smithi143.stdout:8/988: rename d9/d12/d38/d58/d79/d112/d143/c106 to d9/d12/d38/c16a 0 2024-09-17T01:07:11.541 INFO:tasks.workunit.client.1.smithi143.stdout:4/959: read da/f32 [2195880,58174] 0 2024-09-17T01:07:11.542 INFO:tasks.workunit.client.1.smithi143.stdout:9/900: rmdir d3/d39/d42/d58 39 2024-09-17T01:07:11.544 INFO:tasks.workunit.client.1.smithi143.stdout:0/905: unlink d3/d5/d8/d10/l2f 0 2024-09-17T01:07:11.545 INFO:tasks.workunit.client.1.smithi143.stdout:6/887: creat d2/df/d20/d2c/f129 x:0 0 0 2024-09-17T01:07:11.546 INFO:tasks.workunit.client.1.smithi143.stdout:2/880: rename d0/d44/f9e to d0/d44/d6a/d91/f123 0 2024-09-17T01:07:11.548 INFO:tasks.workunit.client.1.smithi143.stdout:1/966: dwrite d0/d6/d43/d47/d68/f92 [4194304,4194304] 0 2024-09-17T01:07:11.550 INFO:tasks.workunit.client.1.smithi143.stdout:0/906: mkdir d3/d5/d8/d21/d109/d11a/d127 0 2024-09-17T01:07:11.556 INFO:tasks.workunit.client.1.smithi143.stdout:5/928: getdents d1/d46/df/d1f/d9f/d125 0 2024-09-17T01:07:11.556 INFO:tasks.workunit.client.1.smithi143.stdout:9/901: rmdir d3/d39/d6a/d9/ded 39 2024-09-17T01:07:11.557 INFO:tasks.workunit.client.1.smithi143.stdout:3/964: dwrite d6/d1c/d4b/d57/f81 [0,4194304] 0 2024-09-17T01:07:11.558 INFO:tasks.workunit.client.1.smithi143.stdout:2/881: mkdir d0/d10/d58/d5a/d5b/d4c/d59/d124 0 2024-09-17T01:07:11.563 INFO:tasks.workunit.client.1.smithi143.stdout:4/960: write da/d3a/d40/d84/f69 [1055149,120772] 0 2024-09-17T01:07:11.563 INFO:tasks.workunit.client.1.smithi143.stdout:3/965: read - d6/d1c/d82/f122 zero size 2024-09-17T01:07:11.563 INFO:tasks.workunit.client.1.smithi143.stdout:0/907: rmdir d3/d5/d8/d21/d109/d11a 39 2024-09-17T01:07:11.564 INFO:tasks.workunit.client.1.smithi143.stdout:2/882: chown d0/d2/l3f 22991228 1 2024-09-17T01:07:11.566 INFO:tasks.workunit.client.1.smithi143.stdout:9/902: fsync d3/d39/d6a/d9/f87 0 2024-09-17T01:07:11.566 INFO:tasks.workunit.client.1.smithi143.stdout:8/989: dwrite d9/de/f121 [0,4194304] 0 2024-09-17T01:07:11.569 INFO:tasks.workunit.client.1.smithi143.stdout:0/908: readlink d3/d5/l6 0 2024-09-17T01:07:11.569 INFO:tasks.workunit.client.1.smithi143.stdout:5/929: chown d1/d46/df/d23/d4f/d7d/d102/l107 26059 1 2024-09-17T01:07:11.570 INFO:tasks.workunit.client.1.smithi143.stdout:9/903: symlink d3/d81/l124 0 2024-09-17T01:07:11.571 INFO:tasks.workunit.client.1.smithi143.stdout:6/888: truncate d2/df/d20/d2c/d38/f39 2109751 0 2024-09-17T01:07:11.571 INFO:tasks.workunit.client.1.smithi143.stdout:1/967: dwrite d0/dc/d57/dc2/ff4 [0,4194304] 0 2024-09-17T01:07:11.573 INFO:tasks.workunit.client.1.smithi143.stdout:2/883: mkdir d0/dcf/d125 0 2024-09-17T01:07:11.579 INFO:tasks.workunit.client.1.smithi143.stdout:0/909: symlink d3/d5/d8/d27/d31/d48/d72/df3/l128 0 2024-09-17T01:07:11.580 INFO:tasks.workunit.client.1.smithi143.stdout:4/961: dwrite da/d3a/d40/daa/dc3/dcd/f113 [0,4194304] 0 2024-09-17T01:07:11.582 INFO:tasks.workunit.client.1.smithi143.stdout:0/910: readlink d3/d68/d8f/ddb/de8/dcd/l7e 0 2024-09-17T01:07:11.583 INFO:tasks.workunit.client.1.smithi143.stdout:4/962: read - da/d3a/df8/f135 zero size 2024-09-17T01:07:11.583 INFO:tasks.workunit.client.1.smithi143.stdout:0/911: fsync d3/d5/d8/d21/f3e 0 2024-09-17T01:07:11.583 INFO:tasks.workunit.client.1.smithi143.stdout:2/884: rmdir d0/d10/d58/d5a/d5b/d4c/d71/d9f/de9 39 2024-09-17T01:07:11.585 INFO:tasks.workunit.client.1.smithi143.stdout:9/904: fsync d3/d39/d42/d80/df3/d99/ff0 0 2024-09-17T01:07:11.587 INFO:tasks.workunit.client.1.smithi143.stdout:6/889: mkdir d2/d30/d45/d70/d87/d74/d12a 0 2024-09-17T01:07:11.587 INFO:tasks.workunit.client.1.smithi143.stdout:9/905: chown d3/d39/d42/dab/d108/d51/d52/f9a 474 1 2024-09-17T01:07:11.587 INFO:tasks.workunit.client.1.smithi143.stdout:6/890: chown d2/d17/d6e/d26/d79 41080556 1 2024-09-17T01:07:11.589 INFO:tasks.workunit.client.1.smithi143.stdout:6/891: chown d2/df/cd7 89537 1 2024-09-17T01:07:11.590 INFO:tasks.workunit.client.1.smithi143.stdout:9/906: fdatasync d3/d39/d6a/d9/f2e 0 2024-09-17T01:07:11.592 INFO:tasks.workunit.client.1.smithi143.stdout:6/892: write d2/d17/d3a/fc2 [5008305,100288] 0 2024-09-17T01:07:11.593 INFO:tasks.workunit.client.1.smithi143.stdout:9/907: creat d3/d3d/de3/df4/f125 x:0 0 0 2024-09-17T01:07:11.594 INFO:tasks.workunit.client.1.smithi143.stdout:0/912: getdents d3/d5/d8/d27/d31/d48/d62 0 2024-09-17T01:07:11.596 INFO:tasks.workunit.client.1.smithi143.stdout:6/893: mknod d2/d30/d84/c12b 0 2024-09-17T01:07:11.600 INFO:tasks.workunit.client.1.smithi143.stdout:9/908: chown d3/d39/d6a/dc3/ca3 0 1 2024-09-17T01:07:11.603 INFO:tasks.workunit.client.1.smithi143.stdout:8/990: dwrite d9/de/f10 [0,4194304] 0 2024-09-17T01:07:11.603 INFO:tasks.workunit.client.1.smithi143.stdout:6/894: dread - d2/d17/d6e/db0/fe3 zero size 2024-09-17T01:07:11.606 INFO:tasks.workunit.client.1.smithi143.stdout:9/909: chown d3/d39/d6a/dc3 0 1 2024-09-17T01:07:11.606 INFO:tasks.workunit.client.1.smithi143.stdout:5/930: dwrite d1/d46/df/d53/f81 [0,4194304] 0 2024-09-17T01:07:11.608 INFO:tasks.workunit.client.1.smithi143.stdout:4/963: dwrite da/d6d/fa4 [0,4194304] 0 2024-09-17T01:07:11.610 INFO:tasks.workunit.client.1.smithi143.stdout:5/931: symlink d1/d46/df/d23/d4f/d82/l155 0 2024-09-17T01:07:11.613 INFO:tasks.workunit.client.1.smithi143.stdout:0/913: link d3/d5/d8/d27/d31/d48/d72/caa d3/d14/d32/c129 0 2024-09-17T01:07:11.613 INFO:tasks.workunit.client.1.smithi143.stdout:8/991: rename d9/d12/d38/d58/d79/d13f to d9/d23/db4/d55/d57/d12a/d16b 0 2024-09-17T01:07:11.615 INFO:tasks.workunit.client.1.smithi143.stdout:6/895: write d2/df/fa4 [470004,39475] 0 2024-09-17T01:07:11.616 INFO:tasks.workunit.client.0.smithi103.stdout:1/412: sync 2024-09-17T01:07:11.617 INFO:tasks.workunit.client.1.smithi143.stdout:5/932: chown d1/f3f 1089742 1 2024-09-17T01:07:11.617 INFO:tasks.workunit.client.1.smithi143.stdout:0/914: chown d3/d68/d8f/ddb/de8/dcd/c74 7901644 1 2024-09-17T01:07:11.617 INFO:tasks.workunit.client.1.smithi143.stdout:9/910: creat d3/d39/d42/d58/dbf/f126 x:0 0 0 2024-09-17T01:07:11.619 INFO:tasks.workunit.client.1.smithi143.stdout:4/964: dwrite da/d3a/d40/d84/f4b [0,4194304] 0 2024-09-17T01:07:11.620 INFO:tasks.workunit.client.0.smithi103.stdout:1/413: creat d2/de/d1f/f85 x:0 0 0 2024-09-17T01:07:11.621 INFO:tasks.workunit.client.0.smithi103.stdout:1/414: dread - d2/d1c/d20/f83 zero size 2024-09-17T01:07:11.621 INFO:tasks.workunit.client.1.smithi143.stdout:4/965: write da/d6d/f111 [1310725,29530] 0 2024-09-17T01:07:11.621 INFO:tasks.workunit.client.1.smithi143.stdout:6/896: mkdir d2/d17/d6e/ddc/df1/d12c 0 2024-09-17T01:07:11.622 INFO:tasks.workunit.client.1.smithi143.stdout:8/992: fsync d9/d23/db4/f6c 0 2024-09-17T01:07:11.624 INFO:tasks.workunit.client.0.smithi103.stdout:1/415: rename d2/d16/f3d to d2/d1c/d28/d4b/d67/f86 0 2024-09-17T01:07:11.625 INFO:tasks.workunit.client.1.smithi143.stdout:0/915: rmdir d3/d5/d8/d27/d31/d48/d62 39 2024-09-17T01:07:11.625 INFO:tasks.workunit.client.1.smithi143.stdout:9/911: truncate d3/d39/d42/d80/f10a 1728846 0 2024-09-17T01:07:11.626 INFO:tasks.workunit.client.0.smithi103.stdout:1/416: symlink d2/d1c/d28/d52/d69/l87 0 2024-09-17T01:07:11.627 INFO:tasks.workunit.client.1.smithi143.stdout:5/933: chown d1/d46/df/d1f/d9f/d124/d126/l127 19458104 1 2024-09-17T01:07:11.627 INFO:tasks.workunit.client.0.smithi103.stdout:1/417: readlink d2/d7/l9 0 2024-09-17T01:07:11.629 INFO:tasks.workunit.client.0.smithi103.stdout:1/418: creat d2/de/d76/f88 x:0 0 0 2024-09-17T01:07:11.629 INFO:tasks.workunit.client.1.smithi143.stdout:5/934: write d1/f59 [879211,8772] 0 2024-09-17T01:07:11.632 INFO:tasks.workunit.client.1.smithi143.stdout:8/993: getdents d9/d23/db4/d55/d57/d108 0 2024-09-17T01:07:11.632 INFO:tasks.workunit.client.0.smithi103.stdout:1/419: mknod d2/d1c/d28/d52/c89 0 2024-09-17T01:07:11.633 INFO:tasks.workunit.client.1.smithi143.stdout:9/912: symlink d3/d3d/d48/l127 0 2024-09-17T01:07:11.633 INFO:tasks.workunit.client.1.smithi143.stdout:6/897: dwrite d2/d19/f8a [0,4194304] 0 2024-09-17T01:07:11.633 INFO:tasks.workunit.client.1.smithi143.stdout:0/916: creat d3/d14/f12a x:0 0 0 2024-09-17T01:07:11.636 INFO:tasks.workunit.client.1.smithi143.stdout:5/935: creat d1/d46/df/d23/d4f/d7d/dcf/f156 x:0 0 0 2024-09-17T01:07:11.643 INFO:tasks.workunit.client.0.smithi103.stdout:1/420: dread d2/de/d1f/f3b [0,4194304] 0 2024-09-17T01:07:11.645 INFO:tasks.workunit.client.1.smithi143.stdout:6/898: dwrite d2/d17/f97 [0,4194304] 0 2024-09-17T01:07:11.645 INFO:tasks.workunit.client.0.smithi103.stdout:1/421: rename d2/d1c/d20/l47 to d2/d70/l8a 0 2024-09-17T01:07:11.646 INFO:tasks.workunit.client.1.smithi143.stdout:4/966: dread da/d6d/f111 [0,4194304] 0 2024-09-17T01:07:11.646 INFO:tasks.workunit.client.0.smithi103.stdout:1/422: stat d2/d1c/d54/f35 0 2024-09-17T01:07:11.647 INFO:tasks.workunit.client.1.smithi143.stdout:6/899: fdatasync d2/df/f31 0 2024-09-17T01:07:11.650 INFO:tasks.workunit.client.0.smithi103.stdout:1/423: dread d2/d1c/d28/d4b/d67/f86 [0,4194304] 0 2024-09-17T01:07:11.650 INFO:tasks.workunit.client.0.smithi103.stdout:1/424: chown d2/de 1303130 1 2024-09-17T01:07:11.651 INFO:tasks.workunit.client.1.smithi143.stdout:6/900: rmdir d2/d17/d6e/d26/dbd/d105 39 2024-09-17T01:07:11.651 INFO:tasks.workunit.client.0.smithi103.stdout:1/425: chown d2/d16/d51/d65 120 1 2024-09-17T01:07:11.652 INFO:tasks.workunit.client.0.smithi103.stdout:1/426: fdatasync d2/d7/f5a 0 2024-09-17T01:07:11.653 INFO:tasks.workunit.client.1.smithi143.stdout:6/901: stat d2/d30/d45/f50 0 2024-09-17T01:07:11.654 INFO:tasks.workunit.client.0.smithi103.stdout:1/427: creat d2/d1c/d20/d6d/f8b x:0 0 0 2024-09-17T01:07:11.657 INFO:tasks.workunit.client.0.smithi103.stdout:1/428: read d2/d1c/d28/f29 [51741,50880] 0 2024-09-17T01:07:11.657 INFO:tasks.workunit.client.1.smithi143.stdout:5/936: write d1/f3f [2265562,19373] 0 2024-09-17T01:07:11.658 INFO:tasks.workunit.client.1.smithi143.stdout:0/917: truncate d3/d5/d8/d21/f3b 1033077 0 2024-09-17T01:07:11.658 INFO:tasks.workunit.client.1.smithi143.stdout:4/967: dwrite da/d3a/df8/f135 [0,4194304] 0 2024-09-17T01:07:11.660 INFO:tasks.workunit.client.0.smithi103.stdout:1/429: rename d2/de/c60 to d2/d16/d51/d79/c8c 0 2024-09-17T01:07:11.661 INFO:tasks.workunit.client.0.smithi103.stdout:1/430: dread - d2/d1c/d20/f64 zero size 2024-09-17T01:07:11.663 INFO:tasks.workunit.client.0.smithi103.stdout:1/431: mkdir d2/d1c/d20/d6d/d8d 0 2024-09-17T01:07:11.663 INFO:tasks.workunit.client.1.smithi143.stdout:0/918: chown d3/d68/d8f/ddb/de8/daf/c123 41 1 2024-09-17T01:07:11.664 INFO:tasks.workunit.client.1.smithi143.stdout:9/913: dwrite d3/d39/d42/d58/d5a/fb6 [0,4194304] 0 2024-09-17T01:07:11.665 INFO:tasks.workunit.client.1.smithi143.stdout:8/994: dwrite d9/d12/df4/fa2 [0,4194304] 0 2024-09-17T01:07:11.667 INFO:tasks.workunit.client.0.smithi103.stdout:1/432: link d2/de/f1b d2/de/f8e 0 2024-09-17T01:07:11.668 INFO:tasks.workunit.client.1.smithi143.stdout:5/937: mknod d1/d46/df/d1f/d9f/d125/d142/d150/c157 0 2024-09-17T01:07:11.670 INFO:tasks.workunit.client.1.smithi143.stdout:0/919: mkdir d3/d5/d8/d21/d9b/dba/d12b 0 2024-09-17T01:07:11.671 INFO:tasks.workunit.client.1.smithi143.stdout:8/995: dread - d9/d23/db4/d55/dbf/fc6 zero size 2024-09-17T01:07:11.674 INFO:tasks.workunit.client.0.smithi103.stdout:1/433: dwrite d2/d16/f2a [0,4194304] 0 2024-09-17T01:07:11.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:11 smithi103 ceph-mon[28156]: pgmap v16: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 56 MiB/s rd, 187 MiB/s wr, 350 op/s 2024-09-17T01:07:11.677 INFO:tasks.workunit.client.1.smithi143.stdout:9/914: dread d3/d3d/d48/fa7 [0,4194304] 0 2024-09-17T01:07:11.681 INFO:tasks.workunit.client.1.smithi143.stdout:0/920: creat d3/d5/d8/d10/db3/f12c x:0 0 0 2024-09-17T01:07:11.682 INFO:tasks.workunit.client.0.smithi103.stdout:1/434: fsync d2/d1c/d54/f35 0 2024-09-17T01:07:11.682 INFO:tasks.workunit.client.1.smithi143.stdout:3/966: sync 2024-09-17T01:07:11.684 INFO:tasks.workunit.client.0.smithi103.stdout:1/435: creat d2/d70/f8f x:0 0 0 2024-09-17T01:07:11.686 INFO:tasks.workunit.client.0.smithi103.stdout:1/436: symlink d2/d7/d73/l90 0 2024-09-17T01:07:11.688 INFO:tasks.workunit.client.1.smithi143.stdout:0/921: mknod d3/d88/c12d 0 2024-09-17T01:07:11.688 INFO:tasks.workunit.client.0.smithi103.stdout:1/437: creat d2/d1c/d20/d33/f91 x:0 0 0 2024-09-17T01:07:11.689 INFO:tasks.workunit.client.1.smithi143.stdout:9/915: dread d3/d3d/d48/fa7 [0,4194304] 0 2024-09-17T01:07:11.691 INFO:tasks.workunit.client.1.smithi143.stdout:5/938: dwrite d1/d46/df/d53/d74/d9a/f154 [4194304,4194304] 0 2024-09-17T01:07:11.692 INFO:tasks.workunit.client.1.smithi143.stdout:3/967: creat d6/d1c/d10c/d86/ddc/f126 x:0 0 0 2024-09-17T01:07:11.695 INFO:tasks.workunit.client.0.smithi103.stdout:1/438: dread d2/d1c/d20/f2e [0,4194304] 0 2024-09-17T01:07:11.696 INFO:tasks.workunit.client.0.smithi103.stdout:1/439: chown d2/d1c/d28/d4b/d74/c4a 113926 1 2024-09-17T01:07:11.696 INFO:tasks.workunit.client.1.smithi143.stdout:9/916: stat d3/d39/d42/d80/df3/d99/dc5/fc7 0 2024-09-17T01:07:11.696 INFO:tasks.workunit.client.1.smithi143.stdout:4/968: dwrite da/f32 [0,4194304] 0 2024-09-17T01:07:11.697 INFO:tasks.workunit.client.1.smithi143.stdout:0/922: rename d3/d68/d75/dd0 to d3/d68/d8f/d12e 0 2024-09-17T01:07:11.697 INFO:tasks.workunit.client.0.smithi103.stdout:1/440: creat d2/d1c/d54/f92 x:0 0 0 2024-09-17T01:07:11.699 INFO:tasks.workunit.client.0.smithi103.stdout:1/441: mknod d2/d7/d73/d81/c93 0 2024-09-17T01:07:11.704 INFO:tasks.workunit.client.0.smithi103.stdout:1/442: unlink d2/d16/f32 0 2024-09-17T01:07:11.704 INFO:tasks.workunit.client.1.smithi143.stdout:9/917: fdatasync d3/d39/d6a/dc3/f45 0 2024-09-17T01:07:11.704 INFO:tasks.workunit.client.1.smithi143.stdout:3/968: mknod d6/d1c/d82/c127 0 2024-09-17T01:07:11.705 INFO:tasks.workunit.client.1.smithi143.stdout:5/939: mkdir d1/d46/df/d53/d74/d9a/dd7/d10f/d158 0 2024-09-17T01:07:11.707 INFO:tasks.workunit.client.0.smithi103.stdout:1/443: mkdir d2/d1c/d20/d6d/d8d/d94 0 2024-09-17T01:07:11.707 INFO:tasks.workunit.client.1.smithi143.stdout:3/969: readlink d6/d1c/d4b/d57/le1 0 2024-09-17T01:07:11.708 INFO:tasks.workunit.client.1.smithi143.stdout:5/940: dread - d1/d46/d6e/f13a zero size 2024-09-17T01:07:11.709 INFO:tasks.workunit.client.0.smithi103.stdout:1/444: truncate d2/d1c/d20/d6d/f8b 1035532 0 2024-09-17T01:07:11.709 INFO:tasks.workunit.client.1.smithi143.stdout:6/902: dread d2/f6d [0,4194304] 0 2024-09-17T01:07:11.709 INFO:tasks.workunit.client.0.smithi103.stdout:1/445: write d2/d7/f5e [715574,938] 0 2024-09-17T01:07:11.710 INFO:tasks.workunit.client.1.smithi143.stdout:0/923: dwrite d3/d5/d8/d21/d2e/f50 [0,4194304] 0 2024-09-17T01:07:11.713 INFO:tasks.workunit.client.1.smithi143.stdout:5/941: read - d1/d46/df/d23/d4f/d7d/dcf/dc5/f151 zero size 2024-09-17T01:07:11.715 INFO:tasks.workunit.client.1.smithi143.stdout:3/970: creat d6/d1c/d10c/d30/f128 x:0 0 0 2024-09-17T01:07:11.716 INFO:tasks.workunit.client.1.smithi143.stdout:5/942: chown d1/d46/d6e/f13a 4534 1 2024-09-17T01:07:11.718 INFO:tasks.workunit.client.1.smithi143.stdout:0/924: creat d3/d68/d8f/d12e/f12f x:0 0 0 2024-09-17T01:07:11.718 INFO:tasks.workunit.client.1.smithi143.stdout:9/918: dwrite d3/d39/d42/d80/df3/fb4 [4194304,4194304] 0 2024-09-17T01:07:11.721 INFO:tasks.workunit.client.1.smithi143.stdout:5/943: mkdir d1/d46/df/d1f/d9f/d124/d159 0 2024-09-17T01:07:11.721 INFO:tasks.workunit.client.1.smithi143.stdout:5/944: chown d1/d46/df/d53/d74/d9a/d101 109767253 1 2024-09-17T01:07:11.723 INFO:tasks.workunit.client.1.smithi143.stdout:0/925: mknod d3/d5/d8/d27/d31/d48/d72/df3/c130 0 2024-09-17T01:07:11.723 INFO:tasks.workunit.client.1.smithi143.stdout:3/971: dread d6/d1c/d33/d41/d2b/fd4 [0,4194304] 0 2024-09-17T01:07:11.723 INFO:tasks.workunit.client.1.smithi143.stdout:9/919: fsync d3/d39/d42/dab/d108/d51/d52/f9a 0 2024-09-17T01:07:11.726 INFO:tasks.workunit.client.1.smithi143.stdout:3/972: fdatasync d6/d1c/d10c/d86/ddc/f126 0 2024-09-17T01:07:11.726 INFO:tasks.workunit.client.1.smithi143.stdout:0/926: mkdir d3/d5/d8/d27/d31/d85/d131 0 2024-09-17T01:07:11.727 INFO:tasks.workunit.client.1.smithi143.stdout:3/973: dread - d6/d1c/d33/f5e zero size 2024-09-17T01:07:11.728 INFO:tasks.workunit.client.1.smithi143.stdout:9/920: creat d3/d39/d42/dab/ddd/f128 x:0 0 0 2024-09-17T01:07:11.730 INFO:tasks.workunit.client.1.smithi143.stdout:9/921: stat d3/d39/d42/dab/d108/d51/f63 0 2024-09-17T01:07:11.731 INFO:tasks.workunit.client.1.smithi143.stdout:5/945: dread d1/d46/df/d53/f81 [0,4194304] 0 2024-09-17T01:07:11.731 INFO:tasks.workunit.client.1.smithi143.stdout:9/922: chown d3/d3d/c64 887850 1 2024-09-17T01:07:11.732 INFO:tasks.workunit.client.1.smithi143.stdout:2/885: sync 2024-09-17T01:07:11.732 INFO:tasks.workunit.client.1.smithi143.stdout:1/968: sync 2024-09-17T01:07:11.735 INFO:tasks.workunit.client.1.smithi143.stdout:5/946: getdents d1 0 2024-09-17T01:07:11.737 INFO:tasks.workunit.client.1.smithi143.stdout:2/886: dread d0/d10/f39 [0,4194304] 0 2024-09-17T01:07:11.737 INFO:tasks.workunit.client.1.smithi143.stdout:3/974: dread d6/d1c/d33/d3f/d5c/f10f [0,4194304] 0 2024-09-17T01:07:11.738 INFO:tasks.workunit.client.1.smithi143.stdout:5/947: creat d1/d46/df/d1f/d66/f15a x:0 0 0 2024-09-17T01:07:11.739 INFO:tasks.workunit.client.1.smithi143.stdout:9/923: dread d3/d39/d42/d58/d5a/fbc [0,4194304] 0 2024-09-17T01:07:11.740 INFO:tasks.workunit.client.1.smithi143.stdout:2/887: read - d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/f10f zero size 2024-09-17T01:07:11.740 INFO:tasks.workunit.client.1.smithi143.stdout:4/969: write da/d3a/d3e/d4a/d8a/f99 [248254,70132] 0 2024-09-17T01:07:11.742 INFO:tasks.workunit.client.1.smithi143.stdout:2/888: readlink d0/d10/d56/lae 0 2024-09-17T01:07:11.744 INFO:tasks.workunit.client.1.smithi143.stdout:5/948: rename d1/d46/df/d1f/d9f/d125/c153 to d1/d46/df/d1f/de9/c15b 0 2024-09-17T01:07:11.749 INFO:tasks.workunit.client.1.smithi143.stdout:3/975: dwrite d6/d1c/d4d/da4/dea/dff/d116/f11e [0,4194304] 0 2024-09-17T01:07:11.750 INFO:tasks.workunit.client.1.smithi143.stdout:5/949: mknod d1/d46/d6e/d106/c15c 0 2024-09-17T01:07:11.751 INFO:tasks.workunit.client.1.smithi143.stdout:9/924: getdents d3/d39/d42/dab 0 2024-09-17T01:07:11.755 INFO:tasks.workunit.client.1.smithi143.stdout:3/976: chown d6/d1c/d10c/c92 0 1 2024-09-17T01:07:11.756 INFO:tasks.workunit.client.1.smithi143.stdout:4/970: dwrite da/d3a/d3e/d4a/d8a/fb8 [0,4194304] 0 2024-09-17T01:07:11.763 INFO:tasks.workunit.client.0.smithi103.stdout:1/446: rename d2/d1c/d28/l49 to d2/d7/d73/l95 0 2024-09-17T01:07:11.764 INFO:tasks.workunit.client.1.smithi143.stdout:9/925: chown d3/d39/d6a/l73 490272 1 2024-09-17T01:07:11.766 INFO:tasks.workunit.client.1.smithi143.stdout:3/977: dread d6/d1c/d4d/da4/fec [0,4194304] 0 2024-09-17T01:07:11.768 INFO:tasks.workunit.client.1.smithi143.stdout:6/903: dwrite d2/d17/d6e/fbb [0,4194304] 0 2024-09-17T01:07:11.769 INFO:tasks.workunit.client.1.smithi143.stdout:5/950: truncate d1/d46/df/d53/f85 1198493 0 2024-09-17T01:07:11.769 INFO:tasks.workunit.client.1.smithi143.stdout:1/969: dread d0/d6/d43/d47/dd8/f127 [0,4194304] 0 2024-09-17T01:07:11.770 INFO:tasks.workunit.client.0.smithi103.stdout:1/447: mknod d2/de/d1f/c96 0 2024-09-17T01:07:11.770 INFO:tasks.workunit.client.1.smithi143.stdout:0/927: dwrite d3/d5/d8/d27/f82 [4194304,4194304] 0 2024-09-17T01:07:11.771 INFO:tasks.workunit.client.1.smithi143.stdout:8/996: sync 2024-09-17T01:07:11.771 INFO:tasks.workunit.client.1.smithi143.stdout:4/971: creat da/d3a/d40/daa/f138 x:0 0 0 2024-09-17T01:07:11.776 INFO:tasks.workunit.client.1.smithi143.stdout:2/889: dwrite d0/d10/d56/f6d [0,4194304] 0 2024-09-17T01:07:11.777 INFO:tasks.workunit.client.1.smithi143.stdout:8/997: chown d9/d12/d38/d7a 39623 1 2024-09-17T01:07:11.777 INFO:tasks.workunit.client.0.smithi103.stdout:1/448: dwrite d2/f6 [0,4194304] 0 2024-09-17T01:07:11.779 INFO:tasks.workunit.client.0.smithi103.stdout:1/449: chown d2/d1c/d20/f64 193339113 1 2024-09-17T01:07:11.780 INFO:tasks.workunit.client.0.smithi103.stdout:1/450: read - d2/d1c/d54/f92 zero size 2024-09-17T01:07:11.780 INFO:tasks.workunit.client.0.smithi103.stdout:1/451: fdatasync d2/d1c/d54/f92 0 2024-09-17T01:07:11.782 INFO:tasks.workunit.client.0.smithi103.stdout:1/452: write d2/f1a [3139415,115988] 0 2024-09-17T01:07:11.783 INFO:tasks.workunit.client.1.smithi143.stdout:3/978: rename d6/d1c/d10c/d86/fcb to d6/d1c/d10c/d30/f129 0 2024-09-17T01:07:11.785 INFO:tasks.workunit.client.1.smithi143.stdout:9/926: dwrite d3/d39/d6a/dc3/ffc [0,4194304] 0 2024-09-17T01:07:11.789 INFO:tasks.workunit.client.1.smithi143.stdout:9/927: fdatasync d3/d39/d42/d80/df3/d99/f5b 0 2024-09-17T01:07:11.789 INFO:tasks.workunit.client.1.smithi143.stdout:8/998: dread - d9/d12/d38/d58/d79/f12e zero size 2024-09-17T01:07:11.791 INFO:tasks.workunit.client.1.smithi143.stdout:8/999: chown d9/d23/d32/fb0 7286 1 2024-09-17T01:07:11.792 INFO:tasks.workunit.client.1.smithi143.stdout:4/972: fdatasync da/d3a/d40/f36 0 2024-09-17T01:07:11.792 INFO:tasks.workunit.client.1.smithi143.stdout:6/904: unlink d2/d17/d6e/d26/d46/c81 0 2024-09-17T01:07:11.793 INFO:tasks.workunit.client.0.smithi103.stdout:1/453: link d2/d16/d51/d65/f71 d2/de/d1f/f97 0 2024-09-17T01:07:11.796 INFO:tasks.workunit.client.1.smithi143.stdout:0/928: symlink d3/d5/d8/d27/d31/d4c/l132 0 2024-09-17T01:07:11.796 INFO:tasks.workunit.client.1.smithi143.stdout:5/951: mknod d1/d46/df/d53/d74/d9a/d9c/c15d 0 2024-09-17T01:07:11.797 INFO:tasks.workunit.client.1.smithi143.stdout:3/979: mknod d6/d1c/d82/db1/c12a 0 2024-09-17T01:07:11.797 INFO:tasks.workunit.client.0.smithi103.stdout:1/454: fdatasync d2/d16/f30 0 2024-09-17T01:07:11.797 INFO:tasks.workunit.client.1.smithi143.stdout:1/970: mkdir d0/d6/d43/d6a/d52/db2/db6/d141 0 2024-09-17T01:07:11.798 INFO:tasks.workunit.client.1.smithi143.stdout:2/890: mkdir d0/d44/d6a/d91/dc4/d111/d126 0 2024-09-17T01:07:11.799 INFO:tasks.workunit.client.1.smithi143.stdout:9/928: creat d3/d39/d42/dab/d108/d51/d52/db3/f129 x:0 0 0 2024-09-17T01:07:11.800 INFO:tasks.workunit.client.0.smithi103.stdout:1/455: getdents d2/d1c/d20/d6d/d8d/d94 0 2024-09-17T01:07:11.801 INFO:tasks.workunit.client.1.smithi143.stdout:5/952: symlink d1/d96/dff/l15e 0 2024-09-17T01:07:11.802 INFO:tasks.workunit.client.0.smithi103.stdout:1/456: mknod d2/d70/c98 0 2024-09-17T01:07:11.802 INFO:tasks.workunit.client.1.smithi143.stdout:1/971: fdatasync d0/d6/d43/d6a/f42 0 2024-09-17T01:07:11.803 INFO:tasks.workunit.client.1.smithi143.stdout:6/905: creat d2/d17/d6e/d119/f12d x:0 0 0 2024-09-17T01:07:11.804 INFO:tasks.workunit.client.1.smithi143.stdout:3/980: fsync d6/d1c/d33/d41/f28 0 2024-09-17T01:07:11.807 INFO:tasks.workunit.client.1.smithi143.stdout:4/973: dwrite da/d3a/d3e/fb7 [0,4194304] 0 2024-09-17T01:07:11.808 INFO:tasks.workunit.client.0.smithi103.stdout:1/457: dwrite d2/d1c/f1e [8388608,4194304] 0 2024-09-17T01:07:11.808 INFO:tasks.workunit.client.1.smithi143.stdout:9/929: symlink d3/d39/d42/dab/d108/d51/d52/db3/l12a 0 2024-09-17T01:07:11.809 INFO:tasks.workunit.client.1.smithi143.stdout:6/906: chown d2/d17/d3a/dd2/ld5 5 1 2024-09-17T01:07:11.810 INFO:tasks.workunit.client.1.smithi143.stdout:0/929: dwrite d3/f125 [0,4194304] 0 2024-09-17T01:07:11.813 INFO:tasks.workunit.client.1.smithi143.stdout:3/981: chown d6/d1c/d33/d41/f1a 11192 1 2024-09-17T01:07:11.817 INFO:tasks.workunit.client.1.smithi143.stdout:5/953: symlink d1/d46/df/d23/d4f/d7d/dcf/dc5/d13c/l15f 0 2024-09-17T01:07:11.818 INFO:tasks.workunit.client.1.smithi143.stdout:4/974: chown da/d3a/d3e/d72/d9e/c118 4557291 1 2024-09-17T01:07:11.820 INFO:tasks.workunit.client.1.smithi143.stdout:3/982: symlink d6/d1c/d82/de4/l12b 0 2024-09-17T01:07:11.822 INFO:tasks.workunit.client.1.smithi143.stdout:2/891: dwrite d0/d10/d58/d5a/d5b/d4c/d71/d9d/fb4 [0,4194304] 0 2024-09-17T01:07:11.822 INFO:tasks.workunit.client.1.smithi143.stdout:6/907: mknod d2/d17/d6e/c12e 0 2024-09-17T01:07:11.823 INFO:tasks.workunit.client.1.smithi143.stdout:2/892: readlink d0/dcf/ld1 0 2024-09-17T01:07:11.829 INFO:tasks.workunit.client.1.smithi143.stdout:6/908: write d2/df/d20/d2c/d38/f72 [1605477,119167] 0 2024-09-17T01:07:11.829 INFO:tasks.workunit.client.1.smithi143.stdout:3/983: symlink d6/d1c/d10c/d86/d89/l12c 0 2024-09-17T01:07:11.829 INFO:tasks.workunit.client.1.smithi143.stdout:6/909: truncate d2/d17/d6e/d26/fda 560219 0 2024-09-17T01:07:11.832 INFO:tasks.workunit.client.1.smithi143.stdout:4/975: truncate da/d3a/d3e/d4a/d8a/fdc 1370985 0 2024-09-17T01:07:11.834 INFO:tasks.workunit.client.1.smithi143.stdout:2/893: dread d0/d10/d58/d5a/d5b/d4c/d77/fc3 [0,4194304] 0 2024-09-17T01:07:11.837 INFO:tasks.workunit.client.1.smithi143.stdout:0/930: getdents d3/d5/d6b 0 2024-09-17T01:07:11.837 INFO:tasks.workunit.client.1.smithi143.stdout:3/984: creat d6/d68/f12d x:0 0 0 2024-09-17T01:07:11.838 INFO:tasks.workunit.client.1.smithi143.stdout:4/976: mknod da/d3a/d3e/d72/dfa/c139 0 2024-09-17T01:07:11.842 INFO:tasks.workunit.client.1.smithi143.stdout:6/910: rename d2/l9e to d2/d17/d6e/d26/d79/dec/l12f 0 2024-09-17T01:07:11.843 INFO:tasks.workunit.client.1.smithi143.stdout:2/894: dwrite d0/d10/d56/fb7 [0,4194304] 0 2024-09-17T01:07:11.844 INFO:tasks.workunit.client.1.smithi143.stdout:4/977: dread da/d3a/d3e/fee [0,4194304] 0 2024-09-17T01:07:11.844 INFO:tasks.workunit.client.1.smithi143.stdout:6/911: write d2/df/fa4 [1449663,79488] 0 2024-09-17T01:07:11.845 INFO:tasks.workunit.client.1.smithi143.stdout:1/972: dread d0/d6/d43/d47/dbf/deb/d78/f90 [0,4194304] 0 2024-09-17T01:07:11.846 INFO:tasks.workunit.client.1.smithi143.stdout:4/978: dread - da/d68/d9b/ddd/df6/f12b zero size 2024-09-17T01:07:11.847 INFO:tasks.workunit.client.1.smithi143.stdout:0/931: creat d3/d14/d114/f133 x:0 0 0 2024-09-17T01:07:11.848 INFO:tasks.workunit.client.1.smithi143.stdout:3/985: chown d6/d1c/d33/d3f/d79/l88 28 1 2024-09-17T01:07:11.848 INFO:tasks.workunit.client.1.smithi143.stdout:2/895: mknod d0/dcf/c127 0 2024-09-17T01:07:11.851 INFO:tasks.workunit.client.1.smithi143.stdout:0/932: dread - d3/d68/d8f/d12e/fee zero size 2024-09-17T01:07:11.852 INFO:tasks.workunit.client.1.smithi143.stdout:9/930: write d3/d39/d6a/d9/d74/f97 [1297176,61441] 0 2024-09-17T01:07:11.853 INFO:tasks.workunit.client.1.smithi143.stdout:2/896: fsync d0/d10/d58/d5a/f78 0 2024-09-17T01:07:11.854 INFO:tasks.workunit.client.1.smithi143.stdout:1/973: dread d0/d6/d43/d47/d68/f92 [4194304,4194304] 0 2024-09-17T01:07:11.855 INFO:tasks.workunit.client.1.smithi143.stdout:0/933: read - d3/d5/d8/d27/d31/d48/d8d/de6/dec/f126 zero size 2024-09-17T01:07:11.857 INFO:tasks.workunit.client.1.smithi143.stdout:2/897: readlink d0/d2/d21/l81 0 2024-09-17T01:07:11.858 INFO:tasks.workunit.client.1.smithi143.stdout:3/986: dread d6/d1c/d33/d3f/f7d [0,4194304] 0 2024-09-17T01:07:11.858 INFO:tasks.workunit.client.1.smithi143.stdout:1/974: write d0/fce [4216363,46148] 0 2024-09-17T01:07:11.860 INFO:tasks.workunit.client.1.smithi143.stdout:9/931: rename d3/d39/d42/d80/df3/d99/ld1 to d3/d39/d42/d80/df3/d99/l12b 0 2024-09-17T01:07:11.861 INFO:tasks.workunit.client.1.smithi143.stdout:2/898: dread d0/f80 [0,4194304] 0 2024-09-17T01:07:11.862 INFO:tasks.workunit.client.1.smithi143.stdout:0/934: creat d3/d5/d8/d27/d31/d48/d8d/d112/f134 x:0 0 0 2024-09-17T01:07:11.862 INFO:tasks.workunit.client.1.smithi143.stdout:3/987: mkdir d6/d1c/d10c/d30/d12e 0 2024-09-17T01:07:11.862 INFO:tasks.workunit.client.1.smithi143.stdout:1/975: creat d0/d6/d43/d6a/d8f/f142 x:0 0 0 2024-09-17T01:07:11.863 INFO:tasks.workunit.client.1.smithi143.stdout:9/932: write d3/d39/d42/d58/ff2 [7868,1009] 0 2024-09-17T01:07:11.865 INFO:tasks.workunit.client.1.smithi143.stdout:3/988: rename d6/d1c/d82/db1 to d6/d1c/d82/db1/d12f 22 2024-09-17T01:07:11.865 INFO:tasks.workunit.client.1.smithi143.stdout:6/912: truncate d2/d19/f8a 1300102 0 2024-09-17T01:07:11.866 INFO:tasks.workunit.client.1.smithi143.stdout:2/899: write d0/d10/d58/d5a/d5b/d4c/d71/d9d/f36 [4558963,96052] 0 2024-09-17T01:07:11.866 INFO:tasks.workunit.client.1.smithi143.stdout:1/976: stat d0/d6/d43/d6d/d8b/dd0/lfb 0 2024-09-17T01:07:11.868 INFO:tasks.workunit.client.1.smithi143.stdout:9/933: creat d3/d39/d42/d58/f12c x:0 0 0 2024-09-17T01:07:11.872 INFO:tasks.workunit.client.1.smithi143.stdout:3/989: symlink d6/d1c/d10c/d105/l130 0 2024-09-17T01:07:11.873 INFO:tasks.workunit.client.1.smithi143.stdout:2/900: unlink d0/d10/d58/d5a/l85 0 2024-09-17T01:07:11.875 INFO:tasks.workunit.client.1.smithi143.stdout:0/935: dwrite d3/d68/d8f/ddb/de8/daf/dcb/f10a [0,4194304] 0 2024-09-17T01:07:11.878 INFO:tasks.workunit.client.1.smithi143.stdout:4/979: dread da/d3a/f51 [0,4194304] 0 2024-09-17T01:07:11.879 INFO:tasks.workunit.client.1.smithi143.stdout:6/913: write d2/d17/f25 [2434353,61949] 0 2024-09-17T01:07:11.879 INFO:tasks.workunit.client.1.smithi143.stdout:1/977: write d0/d6/f29 [1829819,58486] 0 2024-09-17T01:07:11.882 INFO:tasks.workunit.client.1.smithi143.stdout:0/936: dread - d3/d5/d8/d21/d2e/fd3 zero size 2024-09-17T01:07:11.883 INFO:tasks.workunit.client.1.smithi143.stdout:1/978: write d0/d6/d43/d47/d68/f115 [1126951,83472] 0 2024-09-17T01:07:11.884 INFO:tasks.workunit.client.1.smithi143.stdout:3/990: dread d6/d1c/d82/db1/f103 [0,4194304] 0 2024-09-17T01:07:11.885 INFO:tasks.workunit.client.1.smithi143.stdout:4/980: symlink da/d3a/d40/daa/l13a 0 2024-09-17T01:07:11.886 INFO:tasks.workunit.client.1.smithi143.stdout:2/901: rename d0/d10/d58/d5a/l122 to d0/d2/d21/l128 0 2024-09-17T01:07:11.886 INFO:tasks.workunit.client.1.smithi143.stdout:0/937: chown d3/d5/d8/d27/d31/d85/la3 19 1 2024-09-17T01:07:11.890 INFO:tasks.workunit.client.1.smithi143.stdout:2/902: readlink d0/d10/d58/d5a/d5b/d4c/d71/dc5/l100 0 2024-09-17T01:07:11.890 INFO:tasks.workunit.client.1.smithi143.stdout:3/991: symlink d6/d1c/d33/d41/d42/l131 0 2024-09-17T01:07:11.892 INFO:tasks.workunit.client.1.smithi143.stdout:3/992: stat d6/d1c/d10c/d30/f6c 0 2024-09-17T01:07:11.894 INFO:tasks.workunit.client.1.smithi143.stdout:6/914: dwrite d2/df/f31 [0,4194304] 0 2024-09-17T01:07:11.894 INFO:tasks.workunit.client.1.smithi143.stdout:2/903: truncate d0/d44/d6a/d91/f123 5204302 0 2024-09-17T01:07:11.901 INFO:tasks.workunit.client.1.smithi143.stdout:3/993: unlink d6/d1c/d10c/d30/f74 0 2024-09-17T01:07:11.901 INFO:tasks.workunit.client.1.smithi143.stdout:2/904: fdatasync d0/f80 0 2024-09-17T01:07:11.901 INFO:tasks.workunit.client.1.smithi143.stdout:6/915: rename d2/df/d20/f54 to d2/d17/d6e/d26/dbd/df8/f130 0 2024-09-17T01:07:11.903 INFO:tasks.workunit.client.1.smithi143.stdout:3/994: chown d6/d1c/d33/d41/l65 7 1 2024-09-17T01:07:11.904 INFO:tasks.workunit.client.1.smithi143.stdout:9/934: dread d3/d39/d6a/d9/ded/f102 [0,4194304] 0 2024-09-17T01:07:11.904 INFO:tasks.workunit.client.1.smithi143.stdout:6/916: fsync d2/df/d20/d2c/d38/fb6 0 2024-09-17T01:07:11.904 INFO:tasks.workunit.client.1.smithi143.stdout:2/905: creat d0/d44/dd6/f129 x:0 0 0 2024-09-17T01:07:11.906 INFO:tasks.workunit.client.1.smithi143.stdout:6/917: readlink d2/d17/d6e/d26/d46/lc5 0 2024-09-17T01:07:11.907 INFO:tasks.workunit.client.1.smithi143.stdout:6/918: dread - d2/d17/d3a/d47/f106 zero size 2024-09-17T01:07:11.907 INFO:tasks.workunit.client.1.smithi143.stdout:6/919: chown d2/d17/d6e/d26/dbd 38340142 1 2024-09-17T01:07:11.908 INFO:tasks.workunit.client.1.smithi143.stdout:2/906: rename d0/d44/d6a/fe4 to d0/d2/d21/d22/d109/f12a 0 2024-09-17T01:07:11.965 INFO:tasks.workunit.client.1.smithi143.stdout:5/954: sync 2024-09-17T01:07:11.967 INFO:tasks.workunit.client.1.smithi143.stdout:6/920: symlink d2/d30/d45/d70/d87/d74/d12a/l131 0 2024-09-17T01:07:11.968 INFO:tasks.workunit.client.1.smithi143.stdout:2/907: mknod d0/d44/d6a/d91/c12b 0 2024-09-17T01:07:11.968 INFO:tasks.workunit.client.1.smithi143.stdout:4/981: dread da/d3a/d40/d84/db6/df2/f11d [0,4194304] 0 2024-09-17T01:07:11.968 INFO:tasks.workunit.client.1.smithi143.stdout:1/979: dread d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/f36 [0,4194304] 0 2024-09-17T01:07:11.969 INFO:tasks.workunit.client.1.smithi143.stdout:5/955: symlink d1/d46/df/d53/d74/dc7/l160 0 2024-09-17T01:07:11.971 INFO:tasks.workunit.client.1.smithi143.stdout:6/921: mkdir d2/d30/db4/dbc/d132 0 2024-09-17T01:07:11.971 INFO:tasks.workunit.client.1.smithi143.stdout:5/956: stat d1/d46/df/d1f/d9f/d125/d142 0 2024-09-17T01:07:11.971 INFO:tasks.workunit.client.1.smithi143.stdout:2/908: creat d0/d44/d6a/d91/f12c x:0 0 0 2024-09-17T01:07:11.972 INFO:tasks.workunit.client.1.smithi143.stdout:6/922: chown d2/d17/d6e/d26/d79/c8b 1964215091 1 2024-09-17T01:07:11.974 INFO:tasks.workunit.client.1.smithi143.stdout:4/982: mknod da/d3a/d3e/d72/da3/da8/c13b 0 2024-09-17T01:07:11.975 INFO:tasks.workunit.client.1.smithi143.stdout:2/909: symlink d0/d44/d7a/d86/d97/l12d 0 2024-09-17T01:07:11.978 INFO:tasks.workunit.client.1.smithi143.stdout:4/983: fdatasync da/d3a/d40/d84/db6/df2/f112 0 2024-09-17T01:07:11.984 INFO:tasks.workunit.client.1.smithi143.stdout:4/984: chown da/d3a/d40/daa/lf5 45067701 1 2024-09-17T01:07:11.986 INFO:tasks.workunit.client.1.smithi143.stdout:6/923: dwrite d2/d17/d3a/d47/fb5 [0,4194304] 0 2024-09-17T01:07:11.986 INFO:tasks.workunit.client.1.smithi143.stdout:9/935: dread d3/d39/d6a/d9/d74/fe6 [0,4194304] 0 2024-09-17T01:07:11.986 INFO:tasks.workunit.client.1.smithi143.stdout:5/957: dwrite d1/d46/df/d23/d4f/d7d/d102/d115/f11a [0,4194304] 0 2024-09-17T01:07:11.995 INFO:tasks.workunit.client.1.smithi143.stdout:1/980: dwrite d0/d6/d99/fc0 [0,4194304] 0 2024-09-17T01:07:11.996 INFO:tasks.workunit.client.1.smithi143.stdout:4/985: truncate da/d6d/d90/fba 4355900 0 2024-09-17T01:07:11.997 INFO:tasks.workunit.client.1.smithi143.stdout:2/910: dwrite d0/d2/d21/d84/d8d/fbb [4194304,4194304] 0 2024-09-17T01:07:11.998 INFO:tasks.workunit.client.1.smithi143.stdout:9/936: creat d3/d39/d6a/d26/f12d x:0 0 0 2024-09-17T01:07:12.002 INFO:tasks.workunit.client.1.smithi143.stdout:4/986: symlink da/d3a/d3e/d72/l13c 0 2024-09-17T01:07:12.003 INFO:tasks.workunit.client.1.smithi143.stdout:2/911: truncate d0/d2/d21/f49 4855415 0 2024-09-17T01:07:12.005 INFO:tasks.workunit.client.1.smithi143.stdout:9/937: rename d3/d39/d42/d80/df3/d99/f93 to d3/d39/d6a/f12e 0 2024-09-17T01:07:12.006 INFO:tasks.workunit.client.1.smithi143.stdout:9/938: dread - d3/d39/f116 zero size 2024-09-17T01:07:12.009 INFO:tasks.workunit.client.1.smithi143.stdout:2/912: creat d0/f12e x:0 0 0 2024-09-17T01:07:12.011 INFO:tasks.workunit.client.1.smithi143.stdout:6/924: write d2/d30/d45/d70/d87/d74/f86 [1035945,120943] 0 2024-09-17T01:07:12.012 INFO:tasks.workunit.client.1.smithi143.stdout:4/987: rename da/d3a/d3e/d4a/d8c/c98 to da/d3a/d40/d84/c13d 0 2024-09-17T01:07:12.015 INFO:tasks.workunit.client.1.smithi143.stdout:2/913: mknod d0/dcf/d125/c12f 0 2024-09-17T01:07:12.017 INFO:tasks.workunit.client.1.smithi143.stdout:4/988: write da/d6d/dca/ffd [4277957,79491] 0 2024-09-17T01:07:12.019 INFO:tasks.workunit.client.1.smithi143.stdout:5/958: dwrite d1/d46/df/d23/d4f/d7d/d92/fdf [0,4194304] 0 2024-09-17T01:07:12.024 INFO:tasks.workunit.client.1.smithi143.stdout:5/959: mkdir d1/d46/d6e/d161 0 2024-09-17T01:07:12.029 INFO:tasks.workunit.client.1.smithi143.stdout:5/960: fdatasync d1/d46/f91 0 2024-09-17T01:07:12.029 INFO:tasks.workunit.client.1.smithi143.stdout:5/961: chown d1/d96/ff5 11 1 2024-09-17T01:07:12.030 INFO:tasks.workunit.client.1.smithi143.stdout:2/914: write d0/d10/d58/d5a/d5b/d4c/d77/f9b [1000699,92545] 0 2024-09-17T01:07:12.033 INFO:tasks.workunit.client.0.smithi103.stdout:5/234: sync 2024-09-17T01:07:12.033 INFO:tasks.workunit.client.0.smithi103.stdout:0/308: sync 2024-09-17T01:07:12.034 INFO:tasks.workunit.client.1.smithi143.stdout:9/939: dread d3/d39/d42/dab/d108/d51/d52/fc1 [0,4194304] 0 2024-09-17T01:07:12.034 INFO:tasks.workunit.client.1.smithi143.stdout:5/962: chown d1/d46/df/f1b 1981014 1 2024-09-17T01:07:12.036 INFO:tasks.workunit.client.1.smithi143.stdout:1/981: dread d0/d6/d43/d47/dd8/ff5 [0,4194304] 0 2024-09-17T01:07:12.036 INFO:tasks.workunit.client.0.smithi103.stdout:0/309: unlink dd/d4f/c56 0 2024-09-17T01:07:12.038 INFO:tasks.workunit.client.0.smithi103.stdout:0/310: symlink dd/d43/l6a 0 2024-09-17T01:07:12.039 INFO:tasks.workunit.client.1.smithi143.stdout:0/938: sync 2024-09-17T01:07:12.039 INFO:tasks.workunit.client.1.smithi143.stdout:4/989: dwrite da/f1c [0,4194304] 0 2024-09-17T01:07:12.039 INFO:tasks.workunit.client.1.smithi143.stdout:0/939: chown d3/d5/d8/d58 0 1 2024-09-17T01:07:12.040 INFO:tasks.workunit.client.1.smithi143.stdout:5/963: fdatasync d1/d46/df/d23/d4f/d82/da6/f117 0 2024-09-17T01:07:12.042 INFO:tasks.workunit.client.1.smithi143.stdout:4/990: chown da/d3a/d3e/d72/dfa/f106 10807 1 2024-09-17T01:07:12.044 INFO:tasks.workunit.client.1.smithi143.stdout:9/940: truncate d3/d39/d42/d58/dbf/fcd 1033265 0 2024-09-17T01:07:12.045 INFO:tasks.workunit.client.1.smithi143.stdout:1/982: getdents d0/d6/d43/d6a/d8f/dbe 0 2024-09-17T01:07:12.045 INFO:tasks.workunit.client.1.smithi143.stdout:5/964: write d1/d46/df/d23/d4f/f6a [4773262,119620] 0 2024-09-17T01:07:12.048 INFO:tasks.workunit.client.1.smithi143.stdout:6/925: dread d2/d30/db4/dbc/fd1 [0,4194304] 0 2024-09-17T01:07:12.049 INFO:tasks.workunit.client.1.smithi143.stdout:0/940: link d3/d5/f29 d3/d5/d8/d10/f135 0 2024-09-17T01:07:12.050 INFO:tasks.workunit.client.1.smithi143.stdout:4/991: rename da/d3a/d40/daa/dc3/dcd/f113 to da/d3a/d3e/d72/da3/da8/f13e 0 2024-09-17T01:07:12.052 INFO:tasks.workunit.client.1.smithi143.stdout:9/941: creat d3/d3d/d118/f12f x:0 0 0 2024-09-17T01:07:12.055 INFO:tasks.workunit.client.1.smithi143.stdout:0/941: chown d3/d68/d8f/ddb/de8/dcd/de5/c115 24611373 1 2024-09-17T01:07:12.055 INFO:tasks.workunit.client.1.smithi143.stdout:9/942: stat d3/d39/d42/d80/df3/d99/f9d 0 2024-09-17T01:07:12.057 INFO:tasks.workunit.client.1.smithi143.stdout:1/983: dwrite d0/d6/d43/d6a/d52/db2/fe9 [0,4194304] 0 2024-09-17T01:07:12.067 INFO:tasks.workunit.client.0.smithi103.stdout:5/235: dread d6/db/fd [0,4194304] 0 2024-09-17T01:07:12.067 INFO:tasks.workunit.client.0.smithi103.stdout:5/236: chown d6/d2c/d38/d4c/d50/f21 46311960 1 2024-09-17T01:07:12.071 INFO:tasks.workunit.client.1.smithi143.stdout:3/995: sync 2024-09-17T01:07:12.087 INFO:tasks.workunit.client.0.smithi103.stdout:6/278: sync 2024-09-17T01:07:12.111 INFO:tasks.workunit.client.0.smithi103.stdout:6/279: fsync d3/d16/d33/d3e/f43 0 2024-09-17T01:07:12.113 INFO:tasks.workunit.client.1.smithi143.stdout:5/965: rename d1/d46/df/d23/d4f/d7d/d102 to d1/d46/df/d23/d4f/d82/da6/d162 0 2024-09-17T01:07:12.113 INFO:tasks.workunit.client.0.smithi103.stdout:6/280: write d3/d16/d33/d57/f5a [270839,45484] 0 2024-09-17T01:07:12.113 INFO:tasks.workunit.client.1.smithi143.stdout:2/915: dwrite d0/d44/d6a/f118 [0,4194304] 0 2024-09-17T01:07:12.114 INFO:tasks.workunit.client.1.smithi143.stdout:5/966: chown d1/d46/df/d23/d4f 1354955202 1 2024-09-17T01:07:12.116 INFO:tasks.workunit.client.1.smithi143.stdout:5/967: read d1/d46/df/f62 [3060734,63756] 0 2024-09-17T01:07:12.120 INFO:tasks.workunit.client.1.smithi143.stdout:6/926: write d2/d17/d6e/d26/d46/d65/f85 [263883,104659] 0 2024-09-17T01:07:12.121 INFO:tasks.workunit.client.1.smithi143.stdout:3/996: creat d6/d1c/d4d/dd1/f132 x:0 0 0 2024-09-17T01:07:12.123 INFO:tasks.workunit.client.0.smithi103.stdout:6/281: getdents d3/d25 0 2024-09-17T01:07:12.125 INFO:tasks.workunit.client.1.smithi143.stdout:2/916: dread d0/d10/d58/d5a/d5b/d4c/d77/fc3 [0,4194304] 0 2024-09-17T01:07:12.125 INFO:tasks.workunit.client.1.smithi143.stdout:5/968: creat d1/d46/df/d1f/d9f/d125/d142/f163 x:0 0 0 2024-09-17T01:07:12.125 INFO:tasks.workunit.client.0.smithi103.stdout:5/237: dwrite d6/d2c/f35 [0,4194304] 0 2024-09-17T01:07:12.127 INFO:tasks.workunit.client.1.smithi143.stdout:5/969: write d1/d46/df/d53/d74/d9a/dd7/f11d [941141,85847] 0 2024-09-17T01:07:12.130 INFO:tasks.workunit.client.0.smithi103.stdout:6/282: rename d3/l23 to d3/d25/d26/d3a/l5c 0 2024-09-17T01:07:12.133 INFO:tasks.workunit.client.0.smithi103.stdout:5/238: creat d6/d2c/d38/d4c/f5b x:0 0 0 2024-09-17T01:07:12.136 INFO:tasks.workunit.client.0.smithi103.stdout:6/283: mknod d3/d17/d2f/c5d 0 2024-09-17T01:07:12.137 INFO:tasks.workunit.client.1.smithi143.stdout:3/997: mknod d6/d1c/d33/d3f/d5c/c133 0 2024-09-17T01:07:12.137 INFO:tasks.workunit.client.1.smithi143.stdout:9/943: dwrite d3/d81/d9c/fd2 [0,4194304] 0 2024-09-17T01:07:12.138 INFO:tasks.workunit.client.0.smithi103.stdout:5/239: rename d6/d2c/d38/d4c/f53 to d6/db/f5c 0 2024-09-17T01:07:12.139 INFO:tasks.workunit.client.1.smithi143.stdout:1/984: write d0/d6/d43/d6d/d8b/dd0/de2/d79/f119 [2189733,95614] 0 2024-09-17T01:07:12.140 INFO:tasks.workunit.client.0.smithi103.stdout:6/284: truncate d3/d17/f2a 3975398 0 2024-09-17T01:07:12.143 INFO:tasks.workunit.client.1.smithi143.stdout:5/970: rename d1/d46/d6e/da0/ffa to d1/d46/df/d1f/d9f/d125/d142/f164 0 2024-09-17T01:07:12.145 INFO:tasks.workunit.client.0.smithi103.stdout:6/285: creat d3/d16/d21/f5e x:0 0 0 2024-09-17T01:07:12.146 INFO:tasks.workunit.client.1.smithi143.stdout:2/917: read d0/d44/d6a/d91/f123 [1172338,20207] 0 2024-09-17T01:07:12.147 INFO:tasks.workunit.client.0.smithi103.stdout:6/286: write d3/d25/d26/d3a/f45 [6061,16382] 0 2024-09-17T01:07:12.147 INFO:tasks.workunit.client.0.smithi103.stdout:6/287: write d3/f36 [2516494,55168] 0 2024-09-17T01:07:12.147 INFO:tasks.workunit.client.1.smithi143.stdout:4/992: getdents da/d3a/d40/daa/dc3/dcd 0 2024-09-17T01:07:12.149 INFO:tasks.workunit.client.1.smithi143.stdout:0/942: dread d3/d5/d8/d27/f6a [0,4194304] 0 2024-09-17T01:07:12.149 INFO:tasks.workunit.client.1.smithi143.stdout:9/944: rmdir d3/d39/d42/d58 39 2024-09-17T01:07:12.150 INFO:tasks.workunit.client.0.smithi103.stdout:6/288: dread d3/d16/d33/d57/f5a [0,4194304] 0 2024-09-17T01:07:12.150 INFO:tasks.workunit.client.1.smithi143.stdout:6/927: dwrite d2/d30/d45/f50 [4194304,4194304] 0 2024-09-17T01:07:12.158 INFO:tasks.workunit.client.0.smithi103.stdout:6/289: rename d3/d16/d33/d53/l55 to d3/d25/d26/l5f 0 2024-09-17T01:07:12.166 INFO:tasks.workunit.client.1.smithi143.stdout:9/945: mkdir d3/d39/d42/dab/ddd/d130 0 2024-09-17T01:07:12.170 INFO:tasks.workunit.client.1.smithi143.stdout:6/928: rename d2/df/d20/d2c/d75/daf to d2/d17/d6e/d26/dbd/df8/d133 0 2024-09-17T01:07:12.171 INFO:tasks.workunit.client.1.smithi143.stdout:6/929: write d2/d17/d6e/fbb [3237326,74539] 0 2024-09-17T01:07:12.172 INFO:tasks.workunit.client.1.smithi143.stdout:6/930: chown d2/d30/d45/d70/da5/fc3 9541525 1 2024-09-17T01:07:12.173 INFO:tasks.workunit.client.0.smithi103.stdout:6/290: truncate d3/d17/f2a 754280 0 2024-09-17T01:07:12.174 INFO:tasks.workunit.client.1.smithi143.stdout:1/985: dread d0/d6/f20 [0,4194304] 0 2024-09-17T01:07:12.175 INFO:tasks.workunit.client.1.smithi143.stdout:9/946: write d3/d39/d6a/d9/ded/f102 [4010556,27248] 0 2024-09-17T01:07:12.175 INFO:tasks.workunit.client.1.smithi143.stdout:3/998: link d6/d1c/d82/c127 d6/d1c/d10c/d30/c134 0 2024-09-17T01:07:12.177 INFO:tasks.workunit.client.0.smithi103.stdout:6/291: mkdir d3/d16/d33/d53/d60 0 2024-09-17T01:07:12.181 INFO:tasks.workunit.client.1.smithi143.stdout:6/931: creat d2/df/d20/d2c/d75/d10c/dfb/f134 x:0 0 0 2024-09-17T01:07:12.182 INFO:tasks.workunit.client.1.smithi143.stdout:6/932: dread - d2/df/d20/d2c/d38/f126 zero size 2024-09-17T01:07:12.183 INFO:tasks.workunit.client.1.smithi143.stdout:6/933: readlink d2/df/d18/l125 0 2024-09-17T01:07:12.184 INFO:tasks.workunit.client.1.smithi143.stdout:2/918: write d0/d10/f8f [664157,75711] 0 2024-09-17T01:07:12.184 INFO:tasks.workunit.client.0.smithi103.stdout:5/240: dread d6/db/f4e [0,4194304] 0 2024-09-17T01:07:12.187 INFO:tasks.workunit.client.1.smithi143.stdout:1/986: creat d0/dc/f143 x:0 0 0 2024-09-17T01:07:12.188 INFO:tasks.workunit.client.1.smithi143.stdout:9/947: rename d3/d3d/d48/lc2 to d3/d39/d42/dab/d108/l131 0 2024-09-17T01:07:12.189 INFO:tasks.workunit.client.0.smithi103.stdout:5/241: creat d6/d2c/d32/d55/f5d x:0 0 0 2024-09-17T01:07:12.190 INFO:tasks.workunit.client.1.smithi143.stdout:2/919: dread d0/d10/d58/d5a/d5b/d4c/d71/dc5/ffa [0,4194304] 0 2024-09-17T01:07:12.190 INFO:tasks.workunit.client.1.smithi143.stdout:9/948: dread - d3/d3d/d118/f12f zero size 2024-09-17T01:07:12.191 INFO:tasks.workunit.client.0.smithi103.stdout:6/292: dread d3/f18 [0,4194304] 0 2024-09-17T01:07:12.192 INFO:tasks.workunit.client.1.smithi143.stdout:1/987: symlink d0/d6/d43/d47/d68/d7b/l144 0 2024-09-17T01:07:12.195 INFO:tasks.workunit.client.1.smithi143.stdout:1/988: chown d0/dc/fd7 13074555 1 2024-09-17T01:07:12.195 INFO:tasks.workunit.client.1.smithi143.stdout:4/993: dwrite da/f54 [0,4194304] 0 2024-09-17T01:07:12.195 INFO:tasks.workunit.client.1.smithi143.stdout:5/971: truncate d1/d5e/f10c 3979538 0 2024-09-17T01:07:12.197 INFO:tasks.workunit.client.1.smithi143.stdout:0/943: dwrite d3/d68/d75/fb1 [0,4194304] 0 2024-09-17T01:07:12.197 INFO:tasks.workunit.client.1.smithi143.stdout:6/934: rename d2/d17/d6e/d26/d46/d66/f10d to d2/d30/d45/d70/da5/f135 0 2024-09-17T01:07:12.198 INFO:tasks.workunit.client.0.smithi103.stdout:6/293: readlink d3/d16/d21/l27 0 2024-09-17T01:07:12.203 INFO:tasks.workunit.client.1.smithi143.stdout:3/999: truncate d6/d1c/d33/d41/f1a 1496257 0 2024-09-17T01:07:12.204 INFO:tasks.workunit.client.1.smithi143.stdout:2/920: mknod d0/d10/d58/d5a/d5b/d4c/d71/dd2/c130 0 2024-09-17T01:07:12.204 INFO:tasks.workunit.client.1.smithi143.stdout:0/944: write d3/d5/d8/d21/d2e/f50 [1984151,126514] 0 2024-09-17T01:07:12.205 INFO:tasks.workunit.client.1.smithi143.stdout:9/949: dwrite d3/d39/d6a/d26/f114 [0,4194304] 0 2024-09-17T01:07:12.205 INFO:tasks.workunit.client.0.smithi103.stdout:6/294: creat d3/d16/d21/d56/f61 x:0 0 0 2024-09-17T01:07:12.210 INFO:tasks.workunit.client.0.smithi103.stdout:6/295: symlink d3/d16/d21/d50/l62 0 2024-09-17T01:07:12.210 INFO:tasks.workunit.client.1.smithi143.stdout:4/994: dread da/f1b [0,4194304] 0 2024-09-17T01:07:12.211 INFO:tasks.workunit.client.0.smithi103.stdout:3/427: sync 2024-09-17T01:07:12.214 INFO:tasks.workunit.client.1.smithi143.stdout:5/972: symlink d1/d46/df/d53/de1/l165 0 2024-09-17T01:07:12.215 INFO:tasks.workunit.client.1.smithi143.stdout:6/935: dwrite d2/d30/d45/d70/d87/d74/f86 [0,4194304] 0 2024-09-17T01:07:12.216 INFO:tasks.workunit.client.0.smithi103.stdout:5/242: dwrite d6/d2c/d32/f33 [0,4194304] 0 2024-09-17T01:07:12.217 INFO:tasks.workunit.client.1.smithi143.stdout:6/936: dread - d2/df/d18/da8/f128 zero size 2024-09-17T01:07:12.219 INFO:tasks.workunit.client.1.smithi143.stdout:6/937: stat d2/d17/d6e/ddc/cf5 0 2024-09-17T01:07:12.219 INFO:tasks.workunit.client.1.smithi143.stdout:1/989: mknod d0/dc/d74/c145 0 2024-09-17T01:07:12.220 INFO:tasks.workunit.client.1.smithi143.stdout:2/921: dread d0/d10/d58/d5a/d5b/fa4 [0,4194304] 0 2024-09-17T01:07:12.220 INFO:tasks.workunit.client.0.smithi103.stdout:6/296: rename d3/d16/d33/d53 to d3/d16/d33/d57/d63 0 2024-09-17T01:07:12.226 INFO:tasks.workunit.client.0.smithi103.stdout:5/243: creat d6/d2c/d32/d55/f5e x:0 0 0 2024-09-17T01:07:12.228 INFO:tasks.workunit.client.1.smithi143.stdout:5/973: rename d1 to d1/d46/d9b/daa/d166 22 2024-09-17T01:07:12.230 INFO:tasks.workunit.client.0.smithi103.stdout:5/244: creat d6/d2c/f5f x:0 0 0 2024-09-17T01:07:12.231 INFO:tasks.workunit.client.1.smithi143.stdout:1/990: symlink d0/d6/d43/d6d/d8b/dfe/l146 0 2024-09-17T01:07:12.233 INFO:tasks.workunit.client.0.smithi103.stdout:6/297: creat d3/f64 x:0 0 0 2024-09-17T01:07:12.233 INFO:tasks.workunit.client.1.smithi143.stdout:5/974: mkdir d1/d46/df/d23/d4f/d82/d167 0 2024-09-17T01:07:12.234 INFO:tasks.workunit.client.1.smithi143.stdout:2/922: mkdir d0/d44/d6a/d91/ddf/d131 0 2024-09-17T01:07:12.235 INFO:tasks.workunit.client.0.smithi103.stdout:6/298: mkdir d3/d16/d21/d65 0 2024-09-17T01:07:12.235 INFO:tasks.workunit.client.1.smithi143.stdout:6/938: dwrite d2/d30/db4/dbc/fd1 [0,4194304] 0 2024-09-17T01:07:12.237 INFO:tasks.workunit.client.1.smithi143.stdout:5/975: rmdir d1/d96/dff 39 2024-09-17T01:07:12.238 INFO:tasks.workunit.client.1.smithi143.stdout:5/976: chown d1/d46/df/d23/d4f 116391157 1 2024-09-17T01:07:12.240 INFO:tasks.workunit.client.1.smithi143.stdout:5/977: read - d1/d46/d9b/daa/ddd/f121 zero size 2024-09-17T01:07:12.241 INFO:tasks.workunit.client.1.smithi143.stdout:5/978: read - d1/d46/f123 zero size 2024-09-17T01:07:12.242 INFO:tasks.workunit.client.0.smithi103.stdout:6/299: dwrite d3/d16/d21/f3b [0,4194304] 0 2024-09-17T01:07:12.246 INFO:tasks.workunit.client.0.smithi103.stdout:6/300: symlink d3/d16/d33/d3e/d58/l66 0 2024-09-17T01:07:12.248 INFO:tasks.workunit.client.0.smithi103.stdout:6/301: dread - d3/f64 zero size 2024-09-17T01:07:12.251 INFO:tasks.workunit.client.1.smithi143.stdout:0/945: write d3/d88/fb7 [194305,125641] 0 2024-09-17T01:07:12.253 INFO:tasks.workunit.client.1.smithi143.stdout:5/979: dwrite d1/d96/dff/f111 [0,4194304] 0 2024-09-17T01:07:12.255 INFO:tasks.workunit.client.0.smithi103.stdout:6/302: rmdir d3/d16/d21/d65 0 2024-09-17T01:07:12.257 INFO:tasks.workunit.client.1.smithi143.stdout:4/995: write da/d3a/d40/d84/db6/fc1 [1178214,123653] 0 2024-09-17T01:07:12.258 INFO:tasks.workunit.client.0.smithi103.stdout:3/428: dwrite d3/d16/d1b/d2c/f42 [0,4194304] 0 2024-09-17T01:07:12.262 INFO:tasks.workunit.client.0.smithi103.stdout:6/303: dread d3/d17/f2a [0,4194304] 0 2024-09-17T01:07:12.263 INFO:tasks.workunit.client.0.smithi103.stdout:3/429: dread d3/d16/d1b/f79 [0,4194304] 0 2024-09-17T01:07:12.267 INFO:tasks.workunit.client.0.smithi103.stdout:6/304: creat d3/d17/f67 x:0 0 0 2024-09-17T01:07:12.269 INFO:tasks.workunit.client.0.smithi103.stdout:3/430: rmdir d3/d16/d1b/d2c/d34/d85 0 2024-09-17T01:07:12.271 INFO:tasks.workunit.client.0.smithi103.stdout:6/305: symlink d3/l68 0 2024-09-17T01:07:12.274 INFO:tasks.workunit.client.0.smithi103.stdout:3/431: rename d3/d16/c47 to d3/d81/c9f 0 2024-09-17T01:07:12.274 INFO:tasks.workunit.client.1.smithi143.stdout:9/950: dwrite d3/d39/d42/d58/dbf/fcd [0,4194304] 0 2024-09-17T01:07:12.274 INFO:tasks.workunit.client.1.smithi143.stdout:6/939: dread d2/fb [0,4194304] 0 2024-09-17T01:07:12.274 INFO:tasks.workunit.client.0.smithi103.stdout:6/306: symlink d3/d16/d33/d57/d63/l69 0 2024-09-17T01:07:12.275 INFO:tasks.workunit.client.1.smithi143.stdout:9/951: write d3/f15 [1685814,42298] 0 2024-09-17T01:07:12.275 INFO:tasks.workunit.client.0.smithi103.stdout:6/307: read d3/f9 [6173617,119703] 0 2024-09-17T01:07:12.276 INFO:tasks.workunit.client.1.smithi143.stdout:6/940: chown d2/df/d18/ce5 3070492 1 2024-09-17T01:07:12.276 INFO:tasks.workunit.client.1.smithi143.stdout:1/991: dread d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/f56 [0,4194304] 0 2024-09-17T01:07:12.276 INFO:tasks.workunit.client.0.smithi103.stdout:3/432: mknod d3/d16/d1b/d36/ca0 0 2024-09-17T01:07:12.277 INFO:tasks.workunit.client.0.smithi103.stdout:3/433: fsync d3/d16/d1b/d2c/d5c/f96 0 2024-09-17T01:07:12.278 INFO:tasks.workunit.client.1.smithi143.stdout:0/946: write d3/d5/d8/d21/d2e/f91 [5553405,102072] 0 2024-09-17T01:07:12.278 INFO:tasks.workunit.client.0.smithi103.stdout:6/308: symlink d3/d16/d21/l6a 0 2024-09-17T01:07:12.279 INFO:tasks.workunit.client.1.smithi143.stdout:6/941: chown d2/d17/d6e/d26/dbd/df8 131141545 1 2024-09-17T01:07:12.280 INFO:tasks.workunit.client.1.smithi143.stdout:9/952: chown d3/d39/d42/dab/d108/l131 1 1 2024-09-17T01:07:12.285 INFO:tasks.workunit.client.0.smithi103.stdout:3/434: dwrite d3/d16/d1b/f46 [0,4194304] 0 2024-09-17T01:07:12.286 INFO:tasks.workunit.client.0.smithi103.stdout:3/435: readlink d3/d16/d1b/l38 0 2024-09-17T01:07:12.287 INFO:tasks.workunit.client.0.smithi103.stdout:3/436: chown d3/f7a 311229760 1 2024-09-17T01:07:12.287 INFO:tasks.workunit.client.0.smithi103.stdout:6/309: link d3/d17/f67 d3/d25/d26/d3a/f6b 0 2024-09-17T01:07:12.294 INFO:tasks.workunit.client.0.smithi103.stdout:3/437: rename d3/c10 to d3/d16/d1b/d36/ca1 0 2024-09-17T01:07:12.295 INFO:tasks.workunit.client.0.smithi103.stdout:3/438: dread - d3/d16/d1b/d3c/d65/f9b zero size 2024-09-17T01:07:12.296 INFO:tasks.workunit.client.0.smithi103.stdout:6/310: dread d3/d16/d33/d57/f5a [0,4194304] 0 2024-09-17T01:07:12.296 INFO:tasks.workunit.client.1.smithi143.stdout:9/953: dwrite d3/d39/d42/d58/ff2 [0,4194304] 0 2024-09-17T01:07:12.296 INFO:tasks.workunit.client.0.smithi103.stdout:3/439: write d3/d16/d1b/d3c/d65/f9b [895868,31371] 0 2024-09-17T01:07:12.297 INFO:tasks.workunit.client.1.smithi143.stdout:5/980: dwrite d1/d46/df/f36 [0,4194304] 0 2024-09-17T01:07:12.297 INFO:tasks.workunit.client.0.smithi103.stdout:3/440: read - d3/d16/d1b/d2c/d34/f48 zero size 2024-09-17T01:07:12.303 INFO:tasks.workunit.client.0.smithi103.stdout:3/441: mknod d3/d16/ca2 0 2024-09-17T01:07:12.303 INFO:tasks.workunit.client.0.smithi103.stdout:3/442: stat d3/d16/d1b/d2c 0 2024-09-17T01:07:12.304 INFO:tasks.workunit.client.0.smithi103.stdout:3/443: truncate d3/f57 798823 0 2024-09-17T01:07:12.307 INFO:tasks.workunit.client.1.smithi143.stdout:1/992: dwrite d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/f28 [0,4194304] 0 2024-09-17T01:07:12.309 INFO:tasks.workunit.client.0.smithi103.stdout:3/444: mkdir d3/d16/d1b/d3c/d65/d7e/da3 0 2024-09-17T01:07:12.311 INFO:tasks.workunit.client.1.smithi143.stdout:6/942: dread d2/d30/d84/fb1 [0,4194304] 0 2024-09-17T01:07:12.312 INFO:tasks.workunit.client.1.smithi143.stdout:6/943: dread - d2/d17/d6e/f117 zero size 2024-09-17T01:07:12.314 INFO:tasks.workunit.client.0.smithi103.stdout:3/445: dwrite d3/d16/d1b/d2c/f41 [0,4194304] 0 2024-09-17T01:07:12.316 INFO:tasks.workunit.client.0.smithi103.stdout:3/446: dread - d3/d16/d1b/d3c/d65/d83/f9d zero size 2024-09-17T01:07:12.327 INFO:tasks.workunit.client.0.smithi103.stdout:8/343: sync 2024-09-17T01:07:12.329 INFO:tasks.workunit.client.0.smithi103.stdout:8/344: truncate d0/d6/dc/d30/d25/d64/f53 500648 0 2024-09-17T01:07:12.378 INFO:tasks.workunit.client.1.smithi143.stdout:9/954: creat d3/d39/d42/d80/df3/d99/dc5/f132 x:0 0 0 2024-09-17T01:07:12.382 INFO:tasks.workunit.client.1.smithi143.stdout:1/993: mknod d0/dc/d74/c147 0 2024-09-17T01:07:12.384 INFO:tasks.workunit.client.1.smithi143.stdout:6/944: mknod d2/df/d18/d69/c136 0 2024-09-17T01:07:12.385 INFO:tasks.workunit.client.1.smithi143.stdout:6/945: stat d2/df/d20/d2c/f129 0 2024-09-17T01:07:12.387 INFO:tasks.workunit.client.1.smithi143.stdout:1/994: unlink d0/d6/d43/d6a/d107/c7e 0 2024-09-17T01:07:12.390 INFO:tasks.workunit.client.1.smithi143.stdout:5/981: link d1/d46/df/d23/f8e d1/d46/df/d23/d4f/d82/da6/f168 0 2024-09-17T01:07:12.392 INFO:tasks.workunit.client.1.smithi143.stdout:1/995: rename d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d18/d4d to d0/d6/d99/d148 0 2024-09-17T01:07:12.392 INFO:tasks.workunit.client.1.smithi143.stdout:5/982: write d1/d46/df/d23/d4f/d82/da6/d162/d115/f11a [3471810,122386] 0 2024-09-17T01:07:12.397 INFO:tasks.workunit.client.1.smithi143.stdout:6/946: dread d2/df/d20/d2c/d75/f71 [0,4194304] 0 2024-09-17T01:07:12.398 INFO:tasks.workunit.client.1.smithi143.stdout:5/983: getdents d1/d46/df/d53/d74/d9a/dd7/d10f 0 2024-09-17T01:07:12.402 INFO:tasks.workunit.client.1.smithi143.stdout:5/984: truncate d1/d96/ff5 1042808 0 2024-09-17T01:07:12.412 INFO:tasks.workunit.client.1.smithi143.stdout:2/923: sync 2024-09-17T01:07:12.414 INFO:tasks.workunit.client.1.smithi143.stdout:6/947: dread d2/df/f31 [4194304,4194304] 0 2024-09-17T01:07:12.419 INFO:tasks.workunit.client.1.smithi143.stdout:6/948: creat d2/df/d18/d69/f137 x:0 0 0 2024-09-17T01:07:12.423 INFO:tasks.workunit.client.1.smithi143.stdout:6/949: creat d2/d30/d45/d70/da5/f138 x:0 0 0 2024-09-17T01:07:12.434 INFO:tasks.workunit.client.1.smithi143.stdout:2/924: dread d0/d2/d21/f49 [0,4194304] 0 2024-09-17T01:07:12.450 INFO:tasks.workunit.client.1.smithi143.stdout:9/955: write d3/d39/d42/d80/df3/d99/fcb [1123331,47657] 0 2024-09-17T01:07:12.453 INFO:tasks.workunit.client.1.smithi143.stdout:9/956: dread - d3/d39/d42/d80/df3/fe4 zero size 2024-09-17T01:07:12.458 INFO:tasks.workunit.client.1.smithi143.stdout:9/957: creat d3/d39/d42/d58/d5a/f133 x:0 0 0 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:2/250: sync 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:7/359: sync 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:1/458: sync 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:9/397: sync 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:5/245: sync 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:4/430: sync 2024-09-17T01:07:12.469 INFO:tasks.workunit.client.0.smithi103.stdout:0/311: sync 2024-09-17T01:07:12.470 INFO:tasks.workunit.client.0.smithi103.stdout:2/251: read - d6/f4b zero size 2024-09-17T01:07:12.471 INFO:tasks.workunit.client.0.smithi103.stdout:4/431: dread - d9/d16/d44/f57 zero size 2024-09-17T01:07:12.472 INFO:tasks.workunit.client.0.smithi103.stdout:9/398: creat d7/d2d/d59/f85 x:0 0 0 2024-09-17T01:07:12.474 INFO:tasks.workunit.client.0.smithi103.stdout:4/432: write d9/d16/d45/d5e/f71 [168957,110937] 0 2024-09-17T01:07:12.476 INFO:tasks.workunit.client.0.smithi103.stdout:2/252: write d6/da/d17/d26/d34/d4e/f53 [2944442,107716] 0 2024-09-17T01:07:12.477 INFO:tasks.workunit.client.0.smithi103.stdout:7/360: dread d4/d11/d34/f41 [0,4194304] 0 2024-09-17T01:07:12.478 INFO:tasks.workunit.client.0.smithi103.stdout:2/253: write d6/f4b [191857,85234] 0 2024-09-17T01:07:12.479 INFO:tasks.workunit.client.0.smithi103.stdout:2/254: dread - d6/da/d3f/f40 zero size 2024-09-17T01:07:12.479 INFO:tasks.workunit.client.0.smithi103.stdout:0/312: symlink dd/df/d38/d62/l6b 0 2024-09-17T01:07:12.480 INFO:tasks.workunit.client.0.smithi103.stdout:2/255: readlink d6/da/d17/d1a/l4f 0 2024-09-17T01:07:12.481 INFO:tasks.workunit.client.0.smithi103.stdout:0/313: truncate dd/df/d38/f63 250913 0 2024-09-17T01:07:12.482 INFO:tasks.workunit.client.0.smithi103.stdout:2/256: rename d6/da/d3f to d6/da/d3f/d54 22 2024-09-17T01:07:12.482 INFO:tasks.workunit.client.0.smithi103.stdout:9/399: creat d7/d43/d48/d11/d5c/d5e/d6c/d6e/f86 x:0 0 0 2024-09-17T01:07:12.483 INFO:tasks.workunit.client.0.smithi103.stdout:2/257: chown d6/da/d17/d1a/l4f 18784 1 2024-09-17T01:07:12.483 INFO:tasks.workunit.client.0.smithi103.stdout:9/400: read d7/d43/d48/f16 [305175,79510] 0 2024-09-17T01:07:12.484 INFO:tasks.workunit.client.0.smithi103.stdout:2/258: readlink d6/da/d17/d1a/l10 0 2024-09-17T01:07:12.484 INFO:tasks.workunit.client.0.smithi103.stdout:4/433: creat d9/d16/d36/d42/f7b x:0 0 0 2024-09-17T01:07:12.484 INFO:tasks.workunit.client.0.smithi103.stdout:2/259: chown f5 188 1 2024-09-17T01:07:12.485 INFO:tasks.workunit.client.0.smithi103.stdout:5/246: link d6/d2c/d38/d4c/d50/f21 d6/d2c/d32/f60 0 2024-09-17T01:07:12.486 INFO:tasks.workunit.client.0.smithi103.stdout:0/314: mkdir dd/df/d68/d6c 0 2024-09-17T01:07:12.487 INFO:tasks.workunit.client.0.smithi103.stdout:9/401: chown d7/d43/d48/d11/f12 584585 1 2024-09-17T01:07:12.489 INFO:tasks.workunit.client.0.smithi103.stdout:5/247: symlink d6/d2c/d38/l61 0 2024-09-17T01:07:12.490 INFO:tasks.workunit.client.0.smithi103.stdout:0/315: write dd/df/f41 [185584,22946] 0 2024-09-17T01:07:12.492 INFO:tasks.workunit.client.0.smithi103.stdout:4/434: creat d9/d16/d38/d3f/f7c x:0 0 0 2024-09-17T01:07:12.493 INFO:tasks.workunit.client.0.smithi103.stdout:8/345: creat d0/d6/dc/d30/f66 x:0 0 0 2024-09-17T01:07:12.494 INFO:tasks.workunit.client.0.smithi103.stdout:9/402: dwrite d7/d43/d48/d11/d21/f69 [0,4194304] 0 2024-09-17T01:07:12.496 INFO:tasks.workunit.client.0.smithi103.stdout:5/248: write d6/db/f34 [3362520,63210] 0 2024-09-17T01:07:12.498 INFO:tasks.workunit.client.0.smithi103.stdout:5/249: fdatasync d6/d2c/d32/f33 0 2024-09-17T01:07:12.498 INFO:tasks.workunit.client.0.smithi103.stdout:8/346: read - d0/d6/dc/d30/d25/d64/d34/f5a zero size 2024-09-17T01:07:12.498 INFO:tasks.workunit.client.0.smithi103.stdout:2/260: rename d6/da/d28/f2b to d6/da/d17/d1a/f55 0 2024-09-17T01:07:12.500 INFO:tasks.workunit.client.0.smithi103.stdout:4/435: symlink d9/d16/d23/d32/d61/d47/l7d 0 2024-09-17T01:07:12.500 INFO:tasks.workunit.client.0.smithi103.stdout:2/261: dread - d6/da/d17/d1a/d45/f49 zero size 2024-09-17T01:07:12.503 INFO:tasks.workunit.client.0.smithi103.stdout:8/347: dread d0/d6/f36 [0,4194304] 0 2024-09-17T01:07:12.504 INFO:tasks.workunit.client.0.smithi103.stdout:9/403: unlink d7/d43/d48/d11/d21/f6b 0 2024-09-17T01:07:12.509 INFO:tasks.workunit.client.0.smithi103.stdout:8/348: rmdir d0/d6/dc/d30/d25 39 2024-09-17T01:07:12.514 INFO:tasks.workunit.client.0.smithi103.stdout:9/404: unlink d7/d43/d48/d11/c4d 0 2024-09-17T01:07:12.515 INFO:tasks.workunit.client.0.smithi103.stdout:8/349: mknod d0/d6/dc/d30/d25/d64/c67 0 2024-09-17T01:07:12.516 INFO:tasks.workunit.client.0.smithi103.stdout:8/350: fdatasync d0/d6/dc/d30/f66 0 2024-09-17T01:07:12.516 INFO:tasks.workunit.client.0.smithi103.stdout:9/405: creat d7/f87 x:0 0 0 2024-09-17T01:07:12.517 INFO:tasks.workunit.client.0.smithi103.stdout:8/351: dread - d0/d6/dc/d30/d2d/f65 zero size 2024-09-17T01:07:12.518 INFO:tasks.workunit.client.1.smithi143.stdout:6/950: creat d2/d30/f139 x:0 0 0 2024-09-17T01:07:12.518 INFO:tasks.workunit.client.0.smithi103.stdout:0/316: dread dd/f4d [0,4194304] 0 2024-09-17T01:07:12.519 INFO:tasks.workunit.client.0.smithi103.stdout:8/352: stat d0/d6/f3b 0 2024-09-17T01:07:12.520 INFO:tasks.workunit.client.0.smithi103.stdout:8/353: chown d0/d6/dc/d30/d25/d64/c63 1497 1 2024-09-17T01:07:12.522 INFO:tasks.workunit.client.1.smithi143.stdout:2/925: rename d0/d10/d58/d5a/d5b/c7f to d0/d2/db0/c132 0 2024-09-17T01:07:12.524 INFO:tasks.workunit.client.0.smithi103.stdout:0/317: dwrite dd/df/f41 [0,4194304] 0 2024-09-17T01:07:12.526 INFO:tasks.workunit.client.0.smithi103.stdout:0/318: fsync dd/d1c/d50/f66 0 2024-09-17T01:07:12.526 INFO:tasks.workunit.client.0.smithi103.stdout:8/354: dread d0/d6/f3b [0,4194304] 0 2024-09-17T01:07:12.527 INFO:tasks.workunit.client.1.smithi143.stdout:5/985: mknod d1/d46/df/d1f/c169 0 2024-09-17T01:07:12.528 INFO:tasks.workunit.client.0.smithi103.stdout:0/319: stat dd/df/f5f 0 2024-09-17T01:07:12.528 INFO:tasks.workunit.client.0.smithi103.stdout:8/355: stat d0/d6/c21 0 2024-09-17T01:07:12.529 INFO:tasks.workunit.client.0.smithi103.stdout:0/320: write dd/f42 [427981,12417] 0 2024-09-17T01:07:12.530 INFO:tasks.workunit.client.1.smithi143.stdout:5/986: unlink d1/d46/d6e/d106/c15c 0 2024-09-17T01:07:12.534 INFO:tasks.workunit.client.1.smithi143.stdout:5/987: mkdir d1/d46/df/d23/d4f/d7d/d92/dfd/d16a 0 2024-09-17T01:07:12.536 INFO:tasks.workunit.client.0.smithi103.stdout:8/356: dwrite d0/d6/f1d [0,4194304] 0 2024-09-17T01:07:12.538 INFO:tasks.workunit.client.1.smithi143.stdout:5/988: read d1/d46/df/d53/f86 [176586,35068] 0 2024-09-17T01:07:12.539 INFO:tasks.workunit.client.0.smithi103.stdout:1/459: write d2/d1c/d28/d52/d69/f82 [2237112,53947] 0 2024-09-17T01:07:12.543 INFO:tasks.workunit.client.0.smithi103.stdout:8/357: creat d0/d6/f68 x:0 0 0 2024-09-17T01:07:12.543 INFO:tasks.workunit.client.1.smithi143.stdout:6/951: dread d2/df/d40/d41/f4c [0,4194304] 0 2024-09-17T01:07:12.544 INFO:tasks.workunit.client.0.smithi103.stdout:1/460: symlink d2/d7/d4e/l99 0 2024-09-17T01:07:12.545 INFO:tasks.workunit.client.1.smithi143.stdout:5/989: mknod d1/d96/c16b 0 2024-09-17T01:07:12.545 INFO:tasks.workunit.client.1.smithi143.stdout:0/947: sync 2024-09-17T01:07:12.545 INFO:tasks.workunit.client.1.smithi143.stdout:4/996: sync 2024-09-17T01:07:12.546 INFO:tasks.workunit.client.0.smithi103.stdout:8/358: rmdir d0/d6/dc/d30/d25/d64 39 2024-09-17T01:07:12.547 INFO:tasks.workunit.client.0.smithi103.stdout:5/250: rmdir d6/d2c/d38/d4c 39 2024-09-17T01:07:12.549 INFO:tasks.workunit.client.1.smithi143.stdout:6/952: creat d2/d17/d6e/d26/d46/d65/f13a x:0 0 0 2024-09-17T01:07:12.550 INFO:tasks.workunit.client.0.smithi103.stdout:1/461: creat d2/d1c/d20/f9a x:0 0 0 2024-09-17T01:07:12.551 INFO:tasks.workunit.client.0.smithi103.stdout:1/462: write d2/d1c/d20/d6d/f8b [10882,41355] 0 2024-09-17T01:07:12.553 INFO:tasks.workunit.client.0.smithi103.stdout:1/463: chown d2/d1c/d20/d33/f3c 16266154 1 2024-09-17T01:07:12.553 INFO:tasks.workunit.client.1.smithi143.stdout:4/997: read da/d75/f8b [457762,57468] 0 2024-09-17T01:07:12.555 INFO:tasks.workunit.client.0.smithi103.stdout:1/464: truncate d2/d1c/d54/f46 953420 0 2024-09-17T01:07:12.555 INFO:tasks.workunit.client.0.smithi103.stdout:5/251: write d6/d2c/d38/d4c/d50/f4f [65873,47022] 0 2024-09-17T01:07:12.557 INFO:tasks.workunit.client.0.smithi103.stdout:1/465: dread d2/d7/d4e/f55 [0,4194304] 0 2024-09-17T01:07:12.559 INFO:tasks.workunit.client.0.smithi103.stdout:8/359: mknod d0/d6/dc/d30/d25/d64/d34/c69 0 2024-09-17T01:07:12.560 INFO:tasks.workunit.client.0.smithi103.stdout:2/262: write d6/f8 [271576,10530] 0 2024-09-17T01:07:12.560 INFO:tasks.workunit.client.0.smithi103.stdout:4/436: write d9/d16/d38/d3f/f6f [1839819,37306] 0 2024-09-17T01:07:12.562 INFO:tasks.workunit.client.0.smithi103.stdout:0/321: dread dd/df/f3d [0,4194304] 0 2024-09-17T01:07:12.562 INFO:tasks.workunit.client.0.smithi103.stdout:4/437: readlink d9/d16/d23/d32/d4c/l59 0 2024-09-17T01:07:12.563 INFO:tasks.workunit.client.1.smithi143.stdout:4/998: write da/f32 [5078488,60666] 0 2024-09-17T01:07:12.566 INFO:tasks.workunit.client.1.smithi143.stdout:6/953: truncate d2/d30/d45/d70/fef 2855110 0 2024-09-17T01:07:12.567 INFO:tasks.workunit.client.1.smithi143.stdout:6/954: fdatasync d2/d17/d3a/f51 0 2024-09-17T01:07:12.569 INFO:tasks.workunit.client.1.smithi143.stdout:5/990: creat d1/d46/df/d1f/f16c x:0 0 0 2024-09-17T01:07:12.570 INFO:tasks.workunit.client.0.smithi103.stdout:4/438: dwrite d9/d16/f74 [0,4194304] 0 2024-09-17T01:07:12.572 INFO:tasks.workunit.client.1.smithi143.stdout:4/999: symlink da/d3a/d3e/d72/d9e/dde/l13f 0 2024-09-17T01:07:12.575 INFO:tasks.workunit.client.1.smithi143.stdout:2/926: dwrite d0/d10/f17 [4194304,4194304] 0 2024-09-17T01:07:12.575 INFO:tasks.workunit.client.0.smithi103.stdout:5/252: dread d6/db/f27 [0,4194304] 0 2024-09-17T01:07:12.576 INFO:tasks.workunit.client.0.smithi103.stdout:5/253: chown d6/ca 22870063 1 2024-09-17T01:07:12.576 INFO:tasks.workunit.client.0.smithi103.stdout:0/322: mknod dd/df/d38/d55/c6d 0 2024-09-17T01:07:12.579 INFO:tasks.workunit.client.0.smithi103.stdout:9/406: dread - d7/d43/d48/f7b zero size 2024-09-17T01:07:12.582 INFO:tasks.workunit.client.1.smithi143.stdout:2/927: creat d0/d10/d58/d79/f133 x:0 0 0 2024-09-17T01:07:12.582 INFO:tasks.workunit.client.0.smithi103.stdout:4/439: readlink d9/d16/d23/d32/l63 0 2024-09-17T01:07:12.583 INFO:tasks.workunit.client.0.smithi103.stdout:1/466: write d2/f36 [2651332,82622] 0 2024-09-17T01:07:12.584 INFO:tasks.workunit.client.1.smithi143.stdout:2/928: write d0/d44/d7a/d86/fa7 [28235,29474] 0 2024-09-17T01:07:12.587 INFO:tasks.workunit.client.1.smithi143.stdout:0/948: dwrite d3/d68/d8f/ddb/de8/dcd/fc1 [0,4194304] 0 2024-09-17T01:07:12.588 INFO:tasks.workunit.client.0.smithi103.stdout:5/254: mknod d6/d2c/d32/c62 0 2024-09-17T01:07:12.588 INFO:tasks.workunit.client.0.smithi103.stdout:0/323: mkdir dd/d4f/d6e 0 2024-09-17T01:07:12.590 INFO:tasks.workunit.client.1.smithi143.stdout:1/996: sync 2024-09-17T01:07:12.591 INFO:tasks.workunit.client.0.smithi103.stdout:4/440: creat d9/d16/d23/d52/f7e x:0 0 0 2024-09-17T01:07:12.592 INFO:tasks.workunit.client.0.smithi103.stdout:8/360: dwrite d0/d6/dc/d30/d25/d64/d34/f47 [0,4194304] 0 2024-09-17T01:07:12.594 INFO:tasks.workunit.client.0.smithi103.stdout:2/263: creat d6/f56 x:0 0 0 2024-09-17T01:07:12.597 INFO:tasks.workunit.client.1.smithi143.stdout:6/955: dwrite d2/df/d40/d41/f4c [0,4194304] 0 2024-09-17T01:07:12.597 INFO:tasks.workunit.client.1.smithi143.stdout:1/997: dread d0/d6/d43/d6a/d52/db2/fe9 [0,4194304] 0 2024-09-17T01:07:12.597 INFO:tasks.workunit.client.1.smithi143.stdout:5/991: write d1/d46/df/d53/d74/d9a/d9c/fd3 [976792,18096] 0 2024-09-17T01:07:12.598 INFO:tasks.workunit.client.0.smithi103.stdout:1/467: symlink d2/d1c/d28/d4b/d67/l9b 0 2024-09-17T01:07:12.598 INFO:tasks.workunit.client.0.smithi103.stdout:4/441: chown d9/d16/d38/d3f/f7c 5199600 1 2024-09-17T01:07:12.598 INFO:tasks.workunit.client.1.smithi143.stdout:0/949: chown d3/d5/d8/c11 385234535 1 2024-09-17T01:07:12.599 INFO:tasks.workunit.client.0.smithi103.stdout:4/442: write d9/f3a [238878,14589] 0 2024-09-17T01:07:12.601 INFO:tasks.workunit.client.0.smithi103.stdout:1/468: dread - d2/d1c/d20/f9a zero size 2024-09-17T01:07:12.602 INFO:tasks.workunit.client.0.smithi103.stdout:6/311: sync 2024-09-17T01:07:12.602 INFO:tasks.workunit.client.0.smithi103.stdout:3/447: sync 2024-09-17T01:07:12.605 INFO:tasks.workunit.client.0.smithi103.stdout:9/407: dwrite d7/d43/d48/d11/f12 [0,4194304] 0 2024-09-17T01:07:12.605 INFO:tasks.workunit.client.0.smithi103.stdout:1/469: stat d2 0 2024-09-17T01:07:12.608 INFO:tasks.workunit.client.0.smithi103.stdout:0/324: creat dd/d1c/d50/f6f x:0 0 0 2024-09-17T01:07:12.608 INFO:tasks.workunit.client.0.smithi103.stdout:5/255: symlink d6/d28/l63 0 2024-09-17T01:07:12.610 INFO:tasks.workunit.client.1.smithi143.stdout:6/956: mkdir d2/df/d20/d2c/d75/d10c/d13b 0 2024-09-17T01:07:12.610 INFO:tasks.workunit.client.1.smithi143.stdout:6/957: readlink d2/d19/l10e 0 2024-09-17T01:07:12.613 INFO:tasks.workunit.client.0.smithi103.stdout:1/470: chown d2/d1c/d28/d52/d69/f82 667895 1 2024-09-17T01:07:12.614 INFO:tasks.workunit.client.1.smithi143.stdout:0/950: mkdir d3/d5/d8/d27/d31/d48/d8d/d112/d136 0 2024-09-17T01:07:12.615 INFO:tasks.workunit.client.0.smithi103.stdout:8/361: creat d0/f6a x:0 0 0 2024-09-17T01:07:12.618 INFO:tasks.workunit.client.0.smithi103.stdout:3/448: dread d3/d16/d1b/d2c/f41 [0,4194304] 0 2024-09-17T01:07:12.618 INFO:tasks.workunit.client.0.smithi103.stdout:9/408: dread - d7/d43/d48/f83 zero size 2024-09-17T01:07:12.619 INFO:tasks.workunit.client.0.smithi103.stdout:8/362: read - d0/d6/dc/d30/f66 zero size 2024-09-17T01:07:12.619 INFO:tasks.workunit.client.1.smithi143.stdout:1/998: rename d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/l105 to d0/d6/d43/d6d/d8b/dd0/de2/d79/d96/d11b/d2/l149 0 2024-09-17T01:07:12.620 INFO:tasks.workunit.client.0.smithi103.stdout:2/264: symlink d6/da/d3f/l57 0 2024-09-17T01:07:12.620 INFO:tasks.workunit.client.0.smithi103.stdout:3/449: write d3/d44/f71 [882242,64389] 0 2024-09-17T01:07:12.620 INFO:tasks.workunit.client.0.smithi103.stdout:6/312: symlink d3/d16/d33/d3e/d58/l6c 0 2024-09-17T01:07:12.621 INFO:tasks.workunit.client.1.smithi143.stdout:5/992: creat d1/d46/d6e/d161/f16d x:0 0 0 2024-09-17T01:07:12.622 INFO:tasks.workunit.client.0.smithi103.stdout:7/361: sync 2024-09-17T01:07:12.623 INFO:tasks.workunit.client.0.smithi103.stdout:4/443: readlink d9/d16/d36/l4b 0 2024-09-17T01:07:12.624 INFO:tasks.workunit.client.0.smithi103.stdout:7/362: dread - d4/d11/d34/d3d/f6c zero size 2024-09-17T01:07:12.625 INFO:tasks.workunit.client.1.smithi143.stdout:0/951: mkdir d3/d68/d75/d137 0 2024-09-17T01:07:12.625 INFO:tasks.workunit.client.0.smithi103.stdout:6/313: rename d3/d16/d33/d57/d63/d60 to d3/d16/d33/d57/d63/d60/d6d 22 2024-09-17T01:07:12.625 INFO:tasks.workunit.client.0.smithi103.stdout:5/256: mknod d6/d2c/c64 0 2024-09-17T01:07:12.632 INFO:tasks.workunit.client.1.smithi143.stdout:5/993: dread d1/d96/fef [0,4194304] 0 2024-09-17T01:07:12.632 INFO:tasks.workunit.client.1.smithi143.stdout:2/929: dread d0/d44/f61 [0,4194304] 0 2024-09-17T01:07:12.633 INFO:tasks.workunit.client.0.smithi103.stdout:9/409: rename d7/d43/d48 to d7/d43/d88 0 2024-09-17T01:07:12.635 INFO:tasks.workunit.client.0.smithi103.stdout:7/363: dwrite d4/d10/d37/f39 [0,4194304] 0 2024-09-17T01:07:12.635 INFO:tasks.workunit.client.0.smithi103.stdout:3/450: creat d3/d16/d1b/d2c/d5c/fa4 x:0 0 0 2024-09-17T01:07:12.636 INFO:tasks.workunit.client.0.smithi103.stdout:7/364: stat d4/fd 0 2024-09-17T01:07:12.637 INFO:tasks.workunit.client.1.smithi143.stdout:0/952: unlink d3/d14/d32/f38 0 2024-09-17T01:07:12.638 INFO:tasks.workunit.client.1.smithi143.stdout:0/953: fsync d3/d68/d8f/ddb/de8/ff2 0 2024-09-17T01:07:12.638 INFO:tasks.workunit.client.0.smithi103.stdout:7/365: write d4/d11/d2b/d36/d3a/f6e [441053,39588] 0 2024-09-17T01:07:12.639 INFO:tasks.workunit.client.0.smithi103.stdout:2/265: mkdir d6/da/d17/d1a/df/d58 0 2024-09-17T01:07:12.640 INFO:tasks.workunit.client.1.smithi143.stdout:0/954: dread d3/d68/f7a [0,4194304] 0 2024-09-17T01:07:12.640 INFO:tasks.workunit.client.0.smithi103.stdout:7/366: chown d4/d11/d2b/d36/d3a/f6e 104633 1 2024-09-17T01:07:12.643 INFO:tasks.workunit.client.1.smithi143.stdout:0/955: dread d3/d14/fa9 [0,4194304] 0 2024-09-17T01:07:12.645 INFO:tasks.workunit.client.0.smithi103.stdout:4/444: creat d9/d10/f7f x:0 0 0 2024-09-17T01:07:12.646 INFO:tasks.workunit.client.1.smithi143.stdout:2/930: creat d0/d44/d6a/d91/dc4/f134 x:0 0 0 2024-09-17T01:07:12.647 INFO:tasks.workunit.client.0.smithi103.stdout:4/445: dread - d9/d16/d23/d2a/f5c zero size 2024-09-17T01:07:12.647 INFO:tasks.workunit.client.0.smithi103.stdout:0/325: write f3 [4505779,31488] 0 2024-09-17T01:07:12.647 INFO:tasks.workunit.client.1.smithi143.stdout:9/958: sync 2024-09-17T01:07:12.652 INFO:tasks.workunit.client.0.smithi103.stdout:5/257: symlink d6/l65 0 2024-09-17T01:07:12.653 INFO:tasks.workunit.client.1.smithi143.stdout:5/994: mknod d1/d46/c16e 0 2024-09-17T01:07:12.654 INFO:tasks.workunit.client.1.smithi143.stdout:2/931: dwrite d0/d10/d58/d5a/d5b/d4c/d71/d99/fa1 [0,4194304] 0 2024-09-17T01:07:12.654 INFO:tasks.workunit.client.0.smithi103.stdout:6/314: rename d3/d16/d33/d3e/d58/l6c to d3/d16/d33/d57/d63/d60/l6e 0 2024-09-17T01:07:12.655 INFO:tasks.workunit.client.0.smithi103.stdout:4/446: dwrite d9/d16/f74 [0,4194304] 0 2024-09-17T01:07:12.657 INFO:tasks.workunit.client.1.smithi143.stdout:1/999: dwrite d0/dc/d74/f10c [0,4194304] 0 2024-09-17T01:07:12.657 INFO:tasks.workunit.client.1.smithi143.stdout:9/959: symlink d3/d81/l134 0 2024-09-17T01:07:12.660 INFO:tasks.workunit.client.1.smithi143.stdout:6/958: rename d2/d30/dc1/de8/de9 to d2/d17/d6e/d26/d46/d13c 0 2024-09-17T01:07:12.660 INFO:tasks.workunit.client.0.smithi103.stdout:7/367: dread d4/d10/d66/f58 [0,4194304] 0 2024-09-17T01:07:12.663 INFO:tasks.workunit.client.0.smithi103.stdout:3/451: mknod d3/d16/d1b/d3c/d65/d7c/ca5 0 2024-09-17T01:07:12.668 INFO:tasks.workunit.client.0.smithi103.stdout:7/368: dread d4/d11/d2b/f65 [0,4194304] 0 2024-09-17T01:07:12.669 INFO:tasks.workunit.client.0.smithi103.stdout:7/369: write d4/d11/f23 [2081165,14369] 0 2024-09-17T01:07:12.670 INFO:tasks.workunit.client.1.smithi143.stdout:2/932: rename d0/dcf/c127 to d0/dcf/c135 0 2024-09-17T01:07:12.672 INFO:tasks.workunit.client.0.smithi103.stdout:0/326: rmdir dd/df/d38 39 2024-09-17T01:07:12.673 INFO:tasks.workunit.client.0.smithi103.stdout:2/266: dread d6/da/d17/d26/d34/d4e/f53 [0,4194304] 0 2024-09-17T01:07:12.674 INFO:tasks.workunit.client.0.smithi103.stdout:0/327: chown dd/d4f/c35 222439 1 2024-09-17T01:07:12.675 INFO:tasks.workunit.client.0.smithi103.stdout:0/328: rename dd/d4f/d6e to dd/d4f/d6e/d70 22 2024-09-17T01:07:12.679 INFO:tasks.workunit.client.0.smithi103.stdout:6/315: rmdir d3/d25 39 2024-09-17T01:07:12.680 INFO:tasks.workunit.client.1.smithi143.stdout:5/995: creat d1/d46/d9b/daa/f16f x:0 0 0 2024-09-17T01:07:12.681 INFO:tasks.workunit.client.0.smithi103.stdout:2/267: dwrite d6/da/d17/d1a/d45/f2a [0,4194304] 0 2024-09-17T01:07:12.682 INFO:tasks.workunit.client.1.smithi143.stdout:0/956: dwrite d3/d5/d8/d21/d2e/fd3 [0,4194304] 0 2024-09-17T01:07:12.684 INFO:tasks.workunit.client.1.smithi143.stdout:5/996: mkdir d1/d5e/d170 0 2024-09-17T01:07:12.685 INFO:tasks.workunit.client.0.smithi103.stdout:9/410: creat d7/d43/d88/d11/d21/f89 x:0 0 0 2024-09-17T01:07:12.686 INFO:tasks.workunit.client.0.smithi103.stdout:7/370: stat d4/d11/d2b/d36/d3a/c5a 0 2024-09-17T01:07:12.688 INFO:tasks.workunit.client.0.smithi103.stdout:5/258: mkdir d6/db/d66 0 2024-09-17T01:07:12.689 INFO:tasks.workunit.client.1.smithi143.stdout:5/997: write d1/d46/df/d23/d4f/d7d/d100/f11f [704121,91814] 0 2024-09-17T01:07:12.692 INFO:tasks.workunit.client.0.smithi103.stdout:1/471: getdents d2/d1c/d28/d4b/d67 0 2024-09-17T01:07:12.693 INFO:tasks.workunit.client.1.smithi143.stdout:0/957: dwrite d3/fed [0,4194304] 0 2024-09-17T01:07:12.694 INFO:tasks.workunit.client.0.smithi103.stdout:6/316: creat d3/d17/f6f x:0 0 0 2024-09-17T01:07:12.696 INFO:tasks.workunit.client.0.smithi103.stdout:8/363: getdents d0/d6/dc/d30/d25/d64 0 2024-09-17T01:07:12.700 INFO:tasks.workunit.client.0.smithi103.stdout:3/452: mknod d3/d16/d90/ca6 0 2024-09-17T01:07:12.702 INFO:tasks.workunit.client.0.smithi103.stdout:1/472: dwrite d2/d1c/d20/f9a [0,4194304] 0 2024-09-17T01:07:12.702 INFO:tasks.workunit.client.0.smithi103.stdout:9/411: fdatasync d7/d43/d88/d11/d20/d4f/f78 0 2024-09-17T01:07:12.703 INFO:tasks.workunit.client.1.smithi143.stdout:0/958: rename d3/d5/f52 to d3/d5/d8/d27/d31/d48/d8d/f138 0 2024-09-17T01:07:12.703 INFO:tasks.workunit.client.1.smithi143.stdout:9/960: dwrite d3/d39/d6a/f30 [0,4194304] 0 2024-09-17T01:07:12.706 INFO:tasks.workunit.client.0.smithi103.stdout:3/453: write d3/d16/d1b/d3c/d65/f8f [767711,38146] 0 2024-09-17T01:07:12.707 INFO:tasks.workunit.client.1.smithi143.stdout:2/933: dread d0/d10/d58/d5a/d5b/d4c/d71/dc5/fdc [0,4194304] 0 2024-09-17T01:07:12.707 INFO:tasks.workunit.client.1.smithi143.stdout:9/961: dread - d3/d81/fd5 zero size 2024-09-17T01:07:12.709 INFO:tasks.workunit.client.1.smithi143.stdout:0/959: creat d3/d5/d8/d27/d31/d48/d8d/f139 x:0 0 0 2024-09-17T01:07:12.710 INFO:tasks.workunit.client.1.smithi143.stdout:2/934: read d0/d10/d58/d5a/d5b/d4c/f64 [3266097,18293] 0 2024-09-17T01:07:12.712 INFO:tasks.workunit.client.0.smithi103.stdout:3/454: dread d3/d16/d1b/d2c/d34/f5f [0,4194304] 0 2024-09-17T01:07:12.713 INFO:tasks.workunit.client.0.smithi103.stdout:8/364: rmdir d0/d6/dc 39 2024-09-17T01:07:12.713 INFO:tasks.workunit.client.0.smithi103.stdout:5/259: dread d6/db/fd [0,4194304] 0 2024-09-17T01:07:12.715 INFO:tasks.workunit.client.0.smithi103.stdout:1/473: rename d2/l21 to d2/de/l9c 0 2024-09-17T01:07:12.717 INFO:tasks.workunit.client.1.smithi143.stdout:0/960: creat d3/d88/f13a x:0 0 0 2024-09-17T01:07:12.719 INFO:tasks.workunit.client.0.smithi103.stdout:6/317: dwrite d3/d17/d2f/f3c [0,4194304] 0 2024-09-17T01:07:12.720 INFO:tasks.workunit.client.1.smithi143.stdout:2/935: rmdir d0/d44/d7a/d86 39 2024-09-17T01:07:12.721 INFO:tasks.workunit.client.0.smithi103.stdout:0/329: creat dd/df/d38/d55/f71 x:0 0 0 2024-09-17T01:07:12.727 INFO:tasks.workunit.client.1.smithi143.stdout:2/936: dread d0/d10/d58/d5a/d5b/d4c/d71/dc5/ffa [0,4194304] 0 2024-09-17T01:07:12.727 INFO:tasks.workunit.client.0.smithi103.stdout:3/455: stat d3/d16/f3d 0 2024-09-17T01:07:12.730 INFO:tasks.workunit.client.0.smithi103.stdout:4/447: dwrite f5 [0,4194304] 0 2024-09-17T01:07:12.733 INFO:tasks.workunit.client.0.smithi103.stdout:9/412: symlink d7/d43/d88/d11/d5c/d5e/d6c/l8a 0 2024-09-17T01:07:12.733 INFO:tasks.workunit.client.0.smithi103.stdout:7/371: write d4/d11/d34/d3d/f5b [976425,130802] 0 2024-09-17T01:07:12.734 INFO:tasks.workunit.client.1.smithi143.stdout:9/962: write d3/d39/d6a/f91 [3744941,120532] 0 2024-09-17T01:07:12.737 INFO:tasks.workunit.client.0.smithi103.stdout:7/372: chown d4/d11/d2b/d36/d3a 2731 1 2024-09-17T01:07:12.737 INFO:tasks.workunit.client.1.smithi143.stdout:0/961: write d3/d5/d8/f44 [211724,127609] 0 2024-09-17T01:07:12.737 INFO:tasks.workunit.client.0.smithi103.stdout:8/365: dwrite d0/d6/dc/d30/f66 [0,4194304] 0 2024-09-17T01:07:12.738 INFO:tasks.workunit.client.0.smithi103.stdout:9/413: dread - d7/d43/d88/d11/d5c/d5e/d6c/f84 zero size 2024-09-17T01:07:12.739 INFO:tasks.workunit.client.0.smithi103.stdout:5/260: creat d6/db/d66/f67 x:0 0 0 2024-09-17T01:07:12.739 INFO:tasks.workunit.client.0.smithi103.stdout:7/373: write d4/d11/f44 [2933517,60946] 0 2024-09-17T01:07:12.740 INFO:tasks.workunit.client.1.smithi143.stdout:0/962: readlink d3/d5/d8/d10/l23 0 2024-09-17T01:07:12.741 INFO:tasks.workunit.client.0.smithi103.stdout:3/456: dread d3/d16/d1b/d2c/d34/f5f [0,4194304] 0 2024-09-17T01:07:12.743 INFO:tasks.workunit.client.0.smithi103.stdout:4/448: unlink d9/dc/c79 0 2024-09-17T01:07:12.744 INFO:tasks.workunit.client.1.smithi143.stdout:9/963: dwrite d3/f111 [0,4194304] 0 2024-09-17T01:07:12.744 INFO:tasks.workunit.client.1.smithi143.stdout:0/963: rmdir d3/d5/d8/d58 39 2024-09-17T01:07:12.745 INFO:tasks.workunit.client.0.smithi103.stdout:3/457: write d3/f1c [1730818,8212] 0 2024-09-17T01:07:12.745 INFO:tasks.workunit.client.1.smithi143.stdout:9/964: write d3/d39/fa2 [749772,126827] 0 2024-09-17T01:07:12.746 INFO:tasks.workunit.client.0.smithi103.stdout:9/414: creat d7/d43/d79/f8b x:0 0 0 2024-09-17T01:07:12.748 INFO:tasks.workunit.client.0.smithi103.stdout:5/261: mknod d6/d2c/d38/d4c/d50/c68 0 2024-09-17T01:07:12.748 INFO:tasks.workunit.client.0.smithi103.stdout:0/330: rmdir dd/d1c/d50/d5c 0 2024-09-17T01:07:12.749 INFO:tasks.workunit.client.1.smithi143.stdout:0/964: truncate d3/d5/d8/d27/f1e 5074199 0 2024-09-17T01:07:12.751 INFO:tasks.workunit.client.0.smithi103.stdout:6/318: write d3/d16/f1f [1137656,123256] 0 2024-09-17T01:07:12.753 INFO:tasks.workunit.client.1.smithi143.stdout:0/965: mkdir d3/d5/d8/d10/d13b 0 2024-09-17T01:07:12.754 INFO:tasks.workunit.client.0.smithi103.stdout:1/474: mknod d2/d1c/d54/c9d 0 2024-09-17T01:07:12.754 INFO:tasks.workunit.client.0.smithi103.stdout:4/449: symlink d9/d16/d23/d52/l80 0 2024-09-17T01:07:12.757 INFO:tasks.workunit.client.0.smithi103.stdout:9/415: symlink d7/d43/l8c 0 2024-09-17T01:07:12.757 INFO:tasks.workunit.client.0.smithi103.stdout:4/450: write d9/d16/d36/d42/f7b [96723,85495] 0 2024-09-17T01:07:12.758 INFO:tasks.workunit.client.0.smithi103.stdout:3/458: dwrite d3/d16/f1a [0,4194304] 0 2024-09-17T01:07:12.758 INFO:tasks.workunit.client.0.smithi103.stdout:0/331: stat dd/df/f41 0 2024-09-17T01:07:12.759 INFO:tasks.workunit.client.1.smithi143.stdout:2/937: write d0/d2/d21/f27 [507345,11579] 0 2024-09-17T01:07:12.759 INFO:tasks.workunit.client.1.smithi143.stdout:9/965: dwrite d3/d39/d6a/f12e [0,4194304] 0 2024-09-17T01:07:12.760 INFO:tasks.workunit.client.0.smithi103.stdout:4/451: chown d9/dc/df/f20 7058573 1 2024-09-17T01:07:12.761 INFO:tasks.workunit.client.0.smithi103.stdout:4/452: chown d9/d2d/f4a 5441 1 2024-09-17T01:07:12.763 INFO:tasks.workunit.client.0.smithi103.stdout:5/262: symlink d6/d2c/l69 0 2024-09-17T01:07:12.764 INFO:tasks.workunit.client.1.smithi143.stdout:0/966: dwrite d3/d68/d75/dff/f117 [0,4194304] 0 2024-09-17T01:07:12.768 INFO:tasks.workunit.client.0.smithi103.stdout:7/374: symlink d4/d11/d2b/d36/d3a/d51/d5e/d7b/l81 0 2024-09-17T01:07:12.770 INFO:tasks.workunit.client.1.smithi143.stdout:9/966: dwrite d3/d39/d6a/d9/f5c [0,4194304] 0 2024-09-17T01:07:12.771 INFO:tasks.workunit.client.1.smithi143.stdout:2/938: creat d0/d2/d105/f136 x:0 0 0 2024-09-17T01:07:12.777 INFO:tasks.workunit.client.0.smithi103.stdout:8/366: rename d0/d6/dc/d30/d25/d64/f53 to d0/d6/f6b 0 2024-09-17T01:07:12.777 INFO:tasks.workunit.client.1.smithi143.stdout:6/959: sync 2024-09-17T01:07:12.778 INFO:tasks.workunit.client.1.smithi143.stdout:0/967: mkdir d3/d5/d8/d27/d31/d85/d131/d13c 0 2024-09-17T01:07:12.781 INFO:tasks.workunit.client.0.smithi103.stdout:3/459: read d3/d16/d1b/d3c/f68 [2940762,129527] 0 2024-09-17T01:07:12.782 INFO:tasks.workunit.client.1.smithi143.stdout:2/939: rmdir d0/d10/d58/d5a/d5b/d4c/d59 39 2024-09-17T01:07:12.782 INFO:tasks.workunit.client.0.smithi103.stdout:8/367: dread - d0/d6/dc/d30/d2d/f60 zero size 2024-09-17T01:07:12.789 INFO:tasks.workunit.client.0.smithi103.stdout:1/475: dwrite d2/d7/f5e [0,4194304] 0 2024-09-17T01:07:12.789 INFO:tasks.workunit.client.1.smithi143.stdout:6/960: readlink d2/df/d40/d41/lce 0 2024-09-17T01:07:12.789 INFO:tasks.workunit.client.1.smithi143.stdout:6/961: chown d2/d17/d3a/d47 35834 1 2024-09-17T01:07:12.790 INFO:tasks.workunit.client.0.smithi103.stdout:4/453: dread d9/d16/d23/d2a/f50 [0,4194304] 0 2024-09-17T01:07:12.792 INFO:tasks.workunit.client.1.smithi143.stdout:2/940: symlink d0/d10/d58/d5a/d5b/d4c/d71/d9d/da2/l137 0 2024-09-17T01:07:12.794 INFO:tasks.workunit.client.0.smithi103.stdout:6/319: dread d3/f11 [0,4194304] 0 2024-09-17T01:07:12.794 INFO:tasks.workunit.client.1.smithi143.stdout:9/967: creat d3/d39/f135 x:0 0 0 2024-09-17T01:07:12.795 INFO:tasks.workunit.client.1.smithi143.stdout:9/968: chown d3/d39/d6a/dc3/c117 30609097 1 2024-09-17T01:07:12.801 INFO:tasks.workunit.client.1.smithi143.stdout:2/941: mkdir d0/d44/d6a/d91/ddf/d138 0 2024-09-17T01:07:12.802 INFO:tasks.workunit.client.1.smithi143.stdout:9/969: mknod d3/d39/d6a/d26/c136 0 2024-09-17T01:07:12.806 INFO:tasks.workunit.client.1.smithi143.stdout:9/970: chown d3/d39/d6a/d9/l94 75541 1 2024-09-17T01:07:12.806 INFO:tasks.workunit.client.1.smithi143.stdout:9/971: truncate d3/d39/f135 322631 0 2024-09-17T01:07:12.812 INFO:tasks.workunit.client.0.smithi103.stdout:7/375: unlink c3 0 2024-09-17T01:07:12.812 INFO:tasks.workunit.client.1.smithi143.stdout:9/972: dwrite d3/d39/d42/dab/d108/f4d [0,4194304] 0 2024-09-17T01:07:12.813 INFO:tasks.workunit.client.0.smithi103.stdout:3/460: dread d3/f9 [0,4194304] 0 2024-09-17T01:07:12.814 INFO:tasks.workunit.client.0.smithi103.stdout:3/461: write d3/d44/f4a [4199033,122975] 0 2024-09-17T01:07:12.815 INFO:tasks.workunit.client.0.smithi103.stdout:3/462: fdatasync d3/d16/d1b/d3c/d65/d75/f78 0 2024-09-17T01:07:12.817 INFO:tasks.workunit.client.0.smithi103.stdout:0/332: rename dd/df/d38/f49 to dd/d43/f72 0 2024-09-17T01:07:12.818 INFO:tasks.workunit.client.0.smithi103.stdout:8/368: readlink d0/d6/dc/l29 0 2024-09-17T01:07:12.820 INFO:tasks.workunit.client.0.smithi103.stdout:0/333: truncate dd/d43/f72 394849 0 2024-09-17T01:07:12.821 INFO:tasks.workunit.client.1.smithi143.stdout:9/973: mkdir d3/d39/d42/dab/ddd/d130/d137 0 2024-09-17T01:07:12.822 INFO:tasks.workunit.client.1.smithi143.stdout:9/974: write d3/d3d/d118/f12f [678067,47545] 0 2024-09-17T01:07:12.823 INFO:tasks.workunit.client.1.smithi143.stdout:5/998: sync 2024-09-17T01:07:12.825 INFO:tasks.workunit.client.1.smithi143.stdout:0/968: write d3/d5/d8/d21/f42 [2340543,113312] 0 2024-09-17T01:07:12.826 INFO:tasks.workunit.client.0.smithi103.stdout:4/454: mknod d9/dc/df/c81 0 2024-09-17T01:07:12.828 INFO:tasks.workunit.client.1.smithi143.stdout:5/999: dread - d1/d46/df/d53/de1/fee zero size 2024-09-17T01:07:12.829 INFO:tasks.workunit.client.1.smithi143.stdout:6/962: truncate d2/d17/d6e/d26/d46/d13c/f99 3235632 0 2024-09-17T01:07:12.830 INFO:tasks.workunit.client.1.smithi143.stdout:9/975: creat d3/d39/d42/dab/d108/d51/d52/db3/f138 x:0 0 0 2024-09-17T01:07:12.831 INFO:tasks.workunit.client.1.smithi143.stdout:9/976: fsync d3/d39/d42/dab/ddd/f128 0 2024-09-17T01:07:12.831 INFO:tasks.workunit.client.1.smithi143.stdout:2/942: write d0/d10/d58/d5a/d5b/d4c/fbd [483774,82462] 0 2024-09-17T01:07:12.834 INFO:tasks.workunit.client.0.smithi103.stdout:7/376: unlink d4/d10/l54 0 2024-09-17T01:07:12.835 INFO:tasks.workunit.client.1.smithi143.stdout:6/963: symlink d2/d30/d45/d70/d87/d74/d12a/l13d 0 2024-09-17T01:07:12.836 INFO:tasks.workunit.client.1.smithi143.stdout:0/969: symlink d3/d5/d8/d58/l13d 0 2024-09-17T01:07:12.837 INFO:tasks.workunit.client.1.smithi143.stdout:2/943: creat d0/d2/db0/f139 x:0 0 0 2024-09-17T01:07:12.838 INFO:tasks.workunit.client.1.smithi143.stdout:2/944: chown d0/d2/d21/d22/fd4 798 1 2024-09-17T01:07:12.839 INFO:tasks.workunit.client.1.smithi143.stdout:2/945: write d0/d2/d21/d84/d8d/fd8 [20659,8673] 0 2024-09-17T01:07:12.840 INFO:tasks.workunit.client.1.smithi143.stdout:9/977: rename d3/d81/d9c/d10c to d3/d39/d6a/d9/d74/def/d139 0 2024-09-17T01:07:12.841 INFO:tasks.workunit.client.1.smithi143.stdout:9/978: stat d3/d3d/faa 0 2024-09-17T01:07:12.841 INFO:tasks.workunit.client.1.smithi143.stdout:9/979: fdatasync d3/d39/d42/dab/d108/fd6 0 2024-09-17T01:07:12.842 INFO:tasks.workunit.client.0.smithi103.stdout:5/263: rename d6/d2c/d38/d4c/d54/f57 to d6/d2c/d32/d55/f6a 0 2024-09-17T01:07:12.843 INFO:tasks.workunit.client.0.smithi103.stdout:0/334: rmdir dd/df/d38 39 2024-09-17T01:07:12.844 INFO:tasks.workunit.client.1.smithi143.stdout:2/946: mkdir d0/d44/d6a/d91/ddf/d13a 0 2024-09-17T01:07:12.847 INFO:tasks.workunit.client.1.smithi143.stdout:0/970: dread d3/d68/d8f/ddb/de8/dcd/f83 [0,4194304] 0 2024-09-17T01:07:12.850 INFO:tasks.workunit.client.0.smithi103.stdout:9/416: getdents d7/d43/d88 0 2024-09-17T01:07:12.851 INFO:tasks.workunit.client.1.smithi143.stdout:0/971: mkdir d3/d5/d8/d21/d9b/dba/d13e 0 2024-09-17T01:07:12.853 INFO:tasks.workunit.client.1.smithi143.stdout:0/972: write d3/d5/d8/d27/d31/d85/fa1 [5925577,117113] 0 2024-09-17T01:07:12.853 INFO:tasks.workunit.client.0.smithi103.stdout:7/377: mkdir d4/d11/d2b/d36/d82 0 2024-09-17T01:07:12.856 INFO:tasks.workunit.client.0.smithi103.stdout:3/463: creat d3/d16/d1b/d2c/d34/d8c/fa7 x:0 0 0 2024-09-17T01:07:12.857 INFO:tasks.workunit.client.0.smithi103.stdout:3/464: truncate d3/d16/d1b/d3c/d65/d83/f9d 524625 0 2024-09-17T01:07:12.858 INFO:tasks.workunit.client.1.smithi143.stdout:0/973: mkdir d3/d68/d8f/ddb/de8/dcd/de5/d13f 0 2024-09-17T01:07:12.859 INFO:tasks.workunit.client.1.smithi143.stdout:0/974: readlink d3/d5/d35/l94 0 2024-09-17T01:07:12.861 INFO:tasks.workunit.client.1.smithi143.stdout:2/947: dread d0/d2/d21/d22/f2d [0,4194304] 0 2024-09-17T01:07:12.864 INFO:tasks.workunit.client.1.smithi143.stdout:0/975: fsync d3/d5/d8/f13 0 2024-09-17T01:07:12.865 INFO:tasks.workunit.client.0.smithi103.stdout:5/264: dwrite d6/d2c/f37 [0,4194304] 0 2024-09-17T01:07:12.871 INFO:tasks.workunit.client.0.smithi103.stdout:6/320: rename d3/d16/l19 to d3/d16/l70 0 2024-09-17T01:07:12.872 INFO:tasks.workunit.client.1.smithi143.stdout:2/948: mknod d0/d10/d58/d5a/d5b/d4c/d71/d9f/d11d/c13b 0 2024-09-17T01:07:12.872 INFO:tasks.workunit.client.1.smithi143.stdout:2/949: stat d0/d2/d21/d22/fed 0 2024-09-17T01:07:12.873 INFO:tasks.workunit.client.0.smithi103.stdout:2/268: sync 2024-09-17T01:07:12.877 INFO:tasks.workunit.client.0.smithi103.stdout:7/378: mknod d4/d10/d4e/c83 0 2024-09-17T01:07:12.879 INFO:tasks.workunit.client.1.smithi143.stdout:2/950: rmdir d0/d44/d7a 39 2024-09-17T01:07:12.879 INFO:tasks.workunit.client.0.smithi103.stdout:7/379: dread - d4/d10/d66/f6d zero size 2024-09-17T01:07:12.880 INFO:tasks.workunit.client.0.smithi103.stdout:2/269: dwrite d6/da/d17/d1a/d45/f2a [0,4194304] 0 2024-09-17T01:07:12.880 INFO:tasks.workunit.client.1.smithi143.stdout:9/980: write d3/d39/d6a/d9/f66 [942370,68321] 0 2024-09-17T01:07:12.882 INFO:tasks.workunit.client.0.smithi103.stdout:4/455: write d9/d16/d23/f46 [5925418,20866] 0 2024-09-17T01:07:12.884 INFO:tasks.workunit.client.0.smithi103.stdout:2/270: chown d6/da/d17/d1a/d45/l37 7 1 2024-09-17T01:07:12.885 INFO:tasks.workunit.client.0.smithi103.stdout:2/271: chown d6/da/d17/d1a/f55 1354628 1 2024-09-17T01:07:12.887 INFO:tasks.workunit.client.0.smithi103.stdout:0/335: truncate dd/df/d38/d55/f59 770114 0 2024-09-17T01:07:12.889 INFO:tasks.workunit.client.0.smithi103.stdout:8/369: truncate d0/d6/dc/d30/d25/d64/d34/f47 46591 0 2024-09-17T01:07:12.891 INFO:tasks.workunit.client.1.smithi143.stdout:9/981: creat d3/d3d/d118/f13a x:0 0 0 2024-09-17T01:07:12.893 INFO:tasks.workunit.client.0.smithi103.stdout:1/476: dwrite d2/de/d1f/f34 [0,4194304] 0 2024-09-17T01:07:12.893 INFO:tasks.workunit.client.0.smithi103.stdout:5/265: creat d6/d28/f6b x:0 0 0 2024-09-17T01:07:12.895 INFO:tasks.workunit.client.0.smithi103.stdout:1/477: chown d2/d1c/d28/d52/d69 1312639 1 2024-09-17T01:07:12.898 INFO:tasks.workunit.client.1.smithi143.stdout:2/951: mkdir d0/d44/d6a/d91/ddf/d13a/d13c 0 2024-09-17T01:07:12.901 INFO:tasks.workunit.client.1.smithi143.stdout:9/982: mknod d3/d39/d6a/d9/ded/c13b 0 2024-09-17T01:07:12.902 INFO:tasks.workunit.client.1.smithi143.stdout:0/976: truncate d3/d5/d8/d21/f47 98875 0 2024-09-17T01:07:12.909 INFO:tasks.workunit.client.0.smithi103.stdout:3/465: dwrite d3/d16/f3d [4194304,4194304] 0 2024-09-17T01:07:12.909 INFO:tasks.workunit.client.0.smithi103.stdout:4/456: creat d9/d16/d45/f82 x:0 0 0 2024-09-17T01:07:12.911 INFO:tasks.workunit.client.1.smithi143.stdout:2/952: dread d0/d44/f94 [0,4194304] 0 2024-09-17T01:07:12.913 INFO:tasks.workunit.client.0.smithi103.stdout:2/272: chown d6/c1f 20 1 2024-09-17T01:07:12.915 INFO:tasks.workunit.client.1.smithi143.stdout:0/977: fdatasync d3/d5/d8/d21/f47 0 2024-09-17T01:07:12.919 INFO:tasks.workunit.client.0.smithi103.stdout:8/370: creat d0/f6c x:0 0 0 2024-09-17T01:07:12.920 INFO:tasks.workunit.client.1.smithi143.stdout:9/983: dread d3/d3d/f10b [0,4194304] 0 2024-09-17T01:07:12.924 INFO:tasks.workunit.client.1.smithi143.stdout:0/978: rename d3/d14/ce9 to d3/d68/d8f/c140 0 2024-09-17T01:07:12.925 INFO:tasks.workunit.client.0.smithi103.stdout:9/417: rmdir d7/d43/d79/d7e 0 2024-09-17T01:07:12.926 INFO:tasks.workunit.client.1.smithi143.stdout:2/953: write d0/d10/d58/d5a/d5b/d4c/d77/fc3 [1545252,73332] 0 2024-09-17T01:07:12.927 INFO:tasks.workunit.client.1.smithi143.stdout:0/979: mknod d3/d68/d8f/ddb/de8/dcd/c141 0 2024-09-17T01:07:12.931 INFO:tasks.workunit.client.0.smithi103.stdout:4/457: creat d9/d16/d38/d3f/f83 x:0 0 0 2024-09-17T01:07:12.932 INFO:tasks.workunit.client.1.smithi143.stdout:9/984: link d3/d39/d42/d58/dbf/f126 d3/d39/d42/dab/d108/f13c 0 2024-09-17T01:07:12.933 INFO:tasks.workunit.client.1.smithi143.stdout:9/985: write d3/d39/d42/dab/d108/d51/db7/f105 [1865957,21451] 0 2024-09-17T01:07:12.934 INFO:tasks.workunit.client.1.smithi143.stdout:9/986: read d3/d39/d6a/d26/f114 [1235362,33030] 0 2024-09-17T01:07:12.936 INFO:tasks.workunit.client.0.smithi103.stdout:4/458: dread d9/d16/d44/f4f [0,4194304] 0 2024-09-17T01:07:12.937 INFO:tasks.workunit.client.1.smithi143.stdout:0/980: mkdir d3/d5/d8/d27/d31/d85/d131/d13c/d142 0 2024-09-17T01:07:12.940 INFO:tasks.workunit.client.0.smithi103.stdout:8/371: mkdir d0/d6/dc/d3d/d6d 0 2024-09-17T01:07:12.941 INFO:tasks.workunit.client.1.smithi143.stdout:6/964: sync 2024-09-17T01:07:12.943 INFO:tasks.workunit.client.0.smithi103.stdout:3/466: dwrite d3/d16/d1b/d3c/f40 [0,4194304] 0 2024-09-17T01:07:12.946 INFO:tasks.workunit.client.1.smithi143.stdout:2/954: dwrite d0/d2/d21/d22/f52 [0,4194304] 0 2024-09-17T01:07:12.946 INFO:tasks.workunit.client.0.smithi103.stdout:3/467: stat d3/d16 0 2024-09-17T01:07:12.947 INFO:tasks.workunit.client.0.smithi103.stdout:9/418: mkdir d7/d43/d88/d11/d5c/d8d 0 2024-09-17T01:07:12.948 INFO:tasks.workunit.client.1.smithi143.stdout:6/965: truncate d2/d30/d45/d70/fcd 1303755 0 2024-09-17T01:07:12.950 INFO:tasks.workunit.client.0.smithi103.stdout:5/266: dwrite d6/db/f5c [0,4194304] 0 2024-09-17T01:07:12.952 INFO:tasks.workunit.client.0.smithi103.stdout:0/336: rmdir dd/d4f/d6e 0 2024-09-17T01:07:12.961 INFO:tasks.workunit.client.0.smithi103.stdout:2/273: rename d6/f19 to d6/da/d17/d1a/df/f59 0 2024-09-17T01:07:12.961 INFO:tasks.workunit.client.0.smithi103.stdout:3/468: dwrite d3/d16/f1a [0,4194304] 0 2024-09-17T01:07:12.961 INFO:tasks.workunit.client.0.smithi103.stdout:1/478: dwrite d2/d16/d51/d65/f71 [0,4194304] 0 2024-09-17T01:07:12.962 INFO:tasks.workunit.client.0.smithi103.stdout:4/459: mkdir d9/d16/d36/d42/d84 0 2024-09-17T01:07:12.970 INFO:tasks.workunit.client.1.smithi143.stdout:6/966: truncate d2/d17/d6e/d26/d46/d65/fa1 418360 0 2024-09-17T01:07:12.972 INFO:tasks.workunit.client.0.smithi103.stdout:6/321: getdents d3 0 2024-09-17T01:07:12.973 INFO:tasks.workunit.client.0.smithi103.stdout:1/479: dwrite d2/d7/d4e/f7b [0,4194304] 0 2024-09-17T01:07:12.974 INFO:tasks.workunit.client.0.smithi103.stdout:8/372: mkdir d0/d6/dc/d30/d25/d64/d34/d6e 0 2024-09-17T01:07:12.975 INFO:tasks.workunit.client.1.smithi143.stdout:9/987: creat d3/d3d/f13d x:0 0 0 2024-09-17T01:07:12.976 INFO:tasks.workunit.client.0.smithi103.stdout:6/322: fsync d3/d16/d33/d3e/f43 0 2024-09-17T01:07:12.976 INFO:tasks.workunit.client.1.smithi143.stdout:0/981: rmdir d3/d5/d8/d21/d9b/dba/d13e 0 2024-09-17T01:07:12.978 INFO:tasks.workunit.client.0.smithi103.stdout:6/323: readlink d3/d25/l59 0 2024-09-17T01:07:12.983 INFO:tasks.workunit.client.0.smithi103.stdout:2/274: dwrite d6/da/d17/d1a/d45/f2a [0,4194304] 0 2024-09-17T01:07:12.984 INFO:tasks.workunit.client.0.smithi103.stdout:0/337: mknod dd/d43/c73 0 2024-09-17T01:07:12.984 INFO:tasks.workunit.client.0.smithi103.stdout:0/338: stat dd/f3b 0 2024-09-17T01:07:12.985 INFO:tasks.workunit.client.1.smithi143.stdout:9/988: mknod d3/d39/d6a/df6/c13e 0 2024-09-17T01:07:12.985 INFO:tasks.workunit.client.0.smithi103.stdout:2/275: write d6/da/d17/d1a/f22 [1088068,13291] 0 2024-09-17T01:07:12.986 INFO:tasks.workunit.client.0.smithi103.stdout:0/339: readlink dd/df/d38/l30 0 2024-09-17T01:07:12.986 INFO:tasks.workunit.client.1.smithi143.stdout:0/982: mkdir d3/d5/d8/d21/d2e/d10c/d143 0 2024-09-17T01:07:12.987 INFO:tasks.workunit.client.0.smithi103.stdout:2/276: chown d6/da/d28/c3d 1216692 1 2024-09-17T01:07:12.989 INFO:tasks.workunit.client.1.smithi143.stdout:6/967: rmdir d2/d17/d6e/d26/d46/d66/d127 0 2024-09-17T01:07:12.989 INFO:tasks.workunit.client.0.smithi103.stdout:3/469: creat d3/d16/d1b/d3c/d65/d75/d9c/fa8 x:0 0 0 2024-09-17T01:07:12.989 INFO:tasks.workunit.client.0.smithi103.stdout:2/277: chown d6/da/d3f/l57 10119927 1 2024-09-17T01:07:12.990 INFO:tasks.workunit.client.0.smithi103.stdout:2/278: chown d6/da/d17/d1a/df 7234 1 2024-09-17T01:07:12.991 INFO:tasks.workunit.client.0.smithi103.stdout:4/460: unlink d9/d16/d23/d32/d61/l3e 0 2024-09-17T01:07:12.991 INFO:tasks.workunit.client.0.smithi103.stdout:3/470: write d3/d16/d1b/f91 [713345,29837] 0 2024-09-17T01:07:12.992 INFO:tasks.workunit.client.1.smithi143.stdout:9/989: fsync d3/d81/fd5 0 2024-09-17T01:07:12.992 INFO:tasks.workunit.client.0.smithi103.stdout:3/471: fsync d3/f27 0 2024-09-17T01:07:12.996 INFO:tasks.workunit.client.0.smithi103.stdout:6/324: symlink d3/d25/d26/d3a/l71 0 2024-09-17T01:07:12.997 INFO:tasks.workunit.client.0.smithi103.stdout:6/325: dread - d3/d16/d21/d56/f61 zero size 2024-09-17T01:07:12.998 INFO:tasks.workunit.client.1.smithi143.stdout:0/983: fdatasync d3/d5/d8/d27/d31/d4c/d65/ff4 0 2024-09-17T01:07:12.998 INFO:tasks.workunit.client.0.smithi103.stdout:5/267: write d6/db/f27 [1328730,9195] 0 2024-09-17T01:07:12.999 INFO:tasks.workunit.client.1.smithi143.stdout:6/968: fdatasync d2/d19/f8a 0 2024-09-17T01:07:13.000 INFO:tasks.workunit.client.1.smithi143.stdout:0/984: write d3/d5/d8/d27/d31/d48/d8d/d112/f134 [678794,122336] 0 2024-09-17T01:07:13.003 INFO:tasks.workunit.client.0.smithi103.stdout:2/279: creat d6/da/d17/d26/f5a x:0 0 0 2024-09-17T01:07:13.005 INFO:tasks.workunit.client.0.smithi103.stdout:4/461: mkdir d9/d16/d23/d32/d64/d85 0 2024-09-17T01:07:13.006 INFO:tasks.workunit.client.1.smithi143.stdout:2/955: dread d0/d2/d21/f62 [0,4194304] 0 2024-09-17T01:07:13.007 INFO:tasks.workunit.client.0.smithi103.stdout:2/280: write d6/da/d17/f3c [892032,92076] 0 2024-09-17T01:07:13.008 INFO:tasks.workunit.client.1.smithi143.stdout:2/956: truncate d0/d10/d58/d5a/d5b/d4c/d71/d9d/fff 358093 0 2024-09-17T01:07:13.008 INFO:tasks.workunit.client.0.smithi103.stdout:8/373: symlink d0/d6/dc/d30/d25/l6f 0 2024-09-17T01:07:13.008 INFO:tasks.workunit.client.0.smithi103.stdout:5/268: dwrite d6/d2c/f51 [0,4194304] 0 2024-09-17T01:07:13.009 INFO:tasks.workunit.client.1.smithi143.stdout:9/990: getdents d3/d39/d42/d58/dbf 0 2024-09-17T01:07:13.010 INFO:tasks.workunit.client.0.smithi103.stdout:1/480: fsync d2/d7/f19 0 2024-09-17T01:07:13.013 INFO:tasks.workunit.client.0.smithi103.stdout:5/269: write d6/f3e [267008,39354] 0 2024-09-17T01:07:13.014 INFO:tasks.workunit.client.0.smithi103.stdout:9/419: dread d7/f53 [0,4194304] 0 2024-09-17T01:07:13.015 INFO:tasks.workunit.client.1.smithi143.stdout:6/969: creat d2/d17/d6e/ddc/df1/db3/f13e x:0 0 0 2024-09-17T01:07:13.017 INFO:tasks.workunit.client.1.smithi143.stdout:2/957: creat d0/d2/d21/d84/d8d/f13d x:0 0 0 2024-09-17T01:07:13.020 INFO:tasks.workunit.client.0.smithi103.stdout:2/281: mknod d6/da/d28/c5b 0 2024-09-17T01:07:13.021 INFO:tasks.workunit.client.0.smithi103.stdout:5/270: dwrite d6/d2c/d32/d55/f5d [0,4194304] 0 2024-09-17T01:07:13.023 INFO:tasks.workunit.client.0.smithi103.stdout:5/271: chown d6/d2c/f52 7053 1 2024-09-17T01:07:13.023 INFO:tasks.workunit.client.0.smithi103.stdout:8/374: creat d0/d6/dc/d30/d25/d64/f70 x:0 0 0 2024-09-17T01:07:13.024 INFO:tasks.workunit.client.0.smithi103.stdout:5/272: chown d6/d28/f6b 54116 1 2024-09-17T01:07:13.031 INFO:tasks.workunit.client.0.smithi103.stdout:5/273: write d6/db/f5c [4879527,30423] 0 2024-09-17T01:07:13.031 INFO:tasks.workunit.client.0.smithi103.stdout:1/481: mkdir d2/d1c/d28/d4b/d67/d9e 0 2024-09-17T01:07:13.031 INFO:tasks.workunit.client.0.smithi103.stdout:2/282: dwrite d6/f52 [0,4194304] 0 2024-09-17T01:07:13.032 INFO:tasks.workunit.client.0.smithi103.stdout:9/420: mkdir d7/d43/d88/d11/d20/d8e 0 2024-09-17T01:07:13.033 INFO:tasks.workunit.client.1.smithi143.stdout:2/958: link d0/d10/d58/d5a/d5b/d4c/d71/d99/ff5 d0/d44/d6a/d91/ddf/d131/f13e 0 2024-09-17T01:07:13.034 INFO:tasks.workunit.client.0.smithi103.stdout:1/482: write d2/d7/fc [1254185,73075] 0 2024-09-17T01:07:13.037 INFO:tasks.workunit.client.1.smithi143.stdout:6/970: dread d2/d17/d6e/d26/dbd/f91 [0,4194304] 0 2024-09-17T01:07:13.042 INFO:tasks.workunit.client.0.smithi103.stdout:0/340: dwrite dd/d43/f53 [0,4194304] 0 2024-09-17T01:07:13.043 INFO:tasks.workunit.client.0.smithi103.stdout:0/341: chown dd/d4f/c35 31496872 1 2024-09-17T01:07:13.044 INFO:tasks.workunit.client.0.smithi103.stdout:3/472: dread d3/d16/f2d [0,4194304] 0 2024-09-17T01:07:13.047 INFO:tasks.workunit.client.0.smithi103.stdout:6/326: truncate d3/f36 555092 0 2024-09-17T01:07:13.048 INFO:tasks.workunit.client.0.smithi103.stdout:8/375: mknod d0/d6/c71 0 2024-09-17T01:07:13.051 INFO:tasks.workunit.client.0.smithi103.stdout:8/376: write d0/d6/dc/d30/d2d/f65 [212305,87460] 0 2024-09-17T01:07:13.051 INFO:tasks.workunit.client.0.smithi103.stdout:3/473: dread d3/d16/d1b/d2c/f58 [0,4194304] 0 2024-09-17T01:07:13.052 INFO:tasks.workunit.client.0.smithi103.stdout:6/327: read d3/d25/f37 [64653,90849] 0 2024-09-17T01:07:13.053 INFO:tasks.workunit.client.0.smithi103.stdout:0/342: symlink dd/d1c/d50/l74 0 2024-09-17T01:07:13.054 INFO:tasks.workunit.client.0.smithi103.stdout:0/343: fsync fc 0 2024-09-17T01:07:13.055 INFO:tasks.workunit.client.0.smithi103.stdout:0/344: stat dd/d5d/f61 0 2024-09-17T01:07:13.056 INFO:tasks.workunit.client.0.smithi103.stdout:5/274: dread d6/d2c/d38/d4c/d50/f21 [0,4194304] 0 2024-09-17T01:07:13.057 INFO:tasks.workunit.client.0.smithi103.stdout:9/421: mknod d7/d43/d5f/d7d/d80/c8f 0 2024-09-17T01:07:13.060 INFO:tasks.workunit.client.1.smithi143.stdout:2/959: write d0/d44/d6a/d91/ddf/d131/f13e [412654,108341] 0 2024-09-17T01:07:13.060 INFO:tasks.workunit.client.0.smithi103.stdout:2/283: dread d6/da/f2f [0,4194304] 0 2024-09-17T01:07:13.060 INFO:tasks.workunit.client.0.smithi103.stdout:2/284: fsync d6/da/d28/f35 0 2024-09-17T01:07:13.061 INFO:tasks.workunit.client.0.smithi103.stdout:8/377: unlink d0/d6/f51 0 2024-09-17T01:07:13.061 INFO:tasks.workunit.client.0.smithi103.stdout:2/285: chown d6/da/d17/d1a/f55 10 1 2024-09-17T01:07:13.061 INFO:tasks.workunit.client.0.smithi103.stdout:3/474: creat d3/d16/d1b/d36/fa9 x:0 0 0 2024-09-17T01:07:13.064 INFO:tasks.workunit.client.1.smithi143.stdout:6/971: dwrite d2/df/d20/d2c/f22 [0,4194304] 0 2024-09-17T01:07:13.064 INFO:tasks.workunit.client.1.smithi143.stdout:2/960: chown d0/d44/d7a/f11f 7968 1 2024-09-17T01:07:13.066 INFO:tasks.workunit.client.1.smithi143.stdout:6/972: chown d2/d17/d6e/d26/f3b 3 1 2024-09-17T01:07:13.069 INFO:tasks.workunit.client.1.smithi143.stdout:2/961: symlink d0/d2/l13f 0 2024-09-17T01:07:13.070 INFO:tasks.workunit.client.1.smithi143.stdout:6/973: mknod d2/d17/d6e/d119/c13f 0 2024-09-17T01:07:13.070 INFO:tasks.workunit.client.0.smithi103.stdout:2/286: dwrite d6/da/d17/f29 [0,4194304] 0 2024-09-17T01:07:13.071 INFO:tasks.workunit.client.0.smithi103.stdout:3/475: dwrite d3/f8 [4194304,4194304] 0 2024-09-17T01:07:13.071 INFO:tasks.workunit.client.1.smithi143.stdout:6/974: write d2/df/d20/d2c/f22 [4308824,36912] 0 2024-09-17T01:07:13.072 INFO:tasks.workunit.client.1.smithi143.stdout:6/975: readlink d2/df/d18/l125 0 2024-09-17T01:07:13.073 INFO:tasks.workunit.client.0.smithi103.stdout:1/483: rename d2/d16/c4c to d2/d16/d51/c9f 0 2024-09-17T01:07:13.074 INFO:tasks.workunit.client.1.smithi143.stdout:6/976: truncate d2/df/d20/d2c/d38/fb6 863240 0 2024-09-17T01:07:13.079 INFO:tasks.workunit.client.0.smithi103.stdout:3/476: dread d3/d16/d1b/d3c/d65/f9b [0,4194304] 0 2024-09-17T01:07:13.086 INFO:tasks.workunit.client.1.smithi143.stdout:6/977: creat d2/df/d18/d69/f140 x:0 0 0 2024-09-17T01:07:13.089 INFO:tasks.workunit.client.0.smithi103.stdout:2/287: rmdir d6/da/d17/d1a/d45 39 2024-09-17T01:07:13.089 INFO:tasks.workunit.client.0.smithi103.stdout:1/484: write d2/d70/f8f [879904,100914] 0 2024-09-17T01:07:13.090 INFO:tasks.workunit.client.1.smithi143.stdout:6/978: symlink d2/df/d18/da8/l141 0 2024-09-17T01:07:13.090 INFO:tasks.workunit.client.0.smithi103.stdout:6/328: dwrite d3/d25/f37 [0,4194304] 0 2024-09-17T01:07:13.092 INFO:tasks.workunit.client.0.smithi103.stdout:3/477: rename d3/d16/d1b/d3c/d65/d75/d9c/l9e to d3/d16/d1b/d3c/d65/d7c/laa 0 2024-09-17T01:07:13.093 INFO:tasks.workunit.client.0.smithi103.stdout:2/288: rename d6/da/d3f to d6/da/d3f/d5c 22 2024-09-17T01:07:13.094 INFO:tasks.workunit.client.0.smithi103.stdout:8/378: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72 0 2024-09-17T01:07:13.097 INFO:tasks.workunit.client.0.smithi103.stdout:8/379: write d0/d6/dc/d30/f66 [3183334,17755] 0 2024-09-17T01:07:13.097 INFO:tasks.workunit.client.0.smithi103.stdout:5/275: creat d6/d2c/d38/f6c x:0 0 0 2024-09-17T01:07:13.100 INFO:tasks.workunit.client.0.smithi103.stdout:9/422: getdents d7 0 2024-09-17T01:07:13.101 INFO:tasks.workunit.client.0.smithi103.stdout:1/485: mkdir d2/de/da0 0 2024-09-17T01:07:13.102 INFO:tasks.workunit.client.0.smithi103.stdout:0/345: dwrite dd/d43/f4e [0,4194304] 0 2024-09-17T01:07:13.104 INFO:tasks.workunit.client.0.smithi103.stdout:3/478: symlink d3/d16/d1b/d2c/lab 0 2024-09-17T01:07:13.107 INFO:tasks.workunit.client.0.smithi103.stdout:2/289: read d6/f25 [162004,108244] 0 2024-09-17T01:07:13.110 INFO:tasks.workunit.client.0.smithi103.stdout:3/479: write d3/d16/d1b/d3c/d65/d75/d9c/fa8 [344266,66464] 0 2024-09-17T01:07:13.111 INFO:tasks.workunit.client.0.smithi103.stdout:1/486: dread d2/d70/f8f [0,4194304] 0 2024-09-17T01:07:13.112 INFO:tasks.workunit.client.0.smithi103.stdout:9/423: rename l2 to d7/d43/d88/d11/d21/l90 0 2024-09-17T01:07:13.112 INFO:tasks.workunit.client.0.smithi103.stdout:5/276: dread d6/d2c/d38/d4c/d50/f1c [0,4194304] 0 2024-09-17T01:07:13.117 INFO:tasks.workunit.client.0.smithi103.stdout:0/346: dwrite dd/d4f/f4c [0,4194304] 0 2024-09-17T01:07:13.117 INFO:tasks.workunit.client.0.smithi103.stdout:9/424: fsync d7/d43/d88/f7b 0 2024-09-17T01:07:13.121 INFO:tasks.workunit.client.0.smithi103.stdout:5/277: creat d6/f6d x:0 0 0 2024-09-17T01:07:13.131 INFO:tasks.workunit.client.0.smithi103.stdout:0/347: getdents dd/d5d 0 2024-09-17T01:07:13.132 INFO:tasks.workunit.client.0.smithi103.stdout:6/329: dwrite d3/d25/d26/f4a [0,4194304] 0 2024-09-17T01:07:13.132 INFO:tasks.workunit.client.0.smithi103.stdout:8/380: dwrite d0/d6/dc/d30/d25/d64/f5d [0,4194304] 0 2024-09-17T01:07:13.133 INFO:tasks.workunit.client.1.smithi143.stdout:0/985: sync 2024-09-17T01:07:13.133 INFO:tasks.workunit.client.1.smithi143.stdout:9/991: sync 2024-09-17T01:07:13.141 INFO:tasks.workunit.client.0.smithi103.stdout:3/480: dread d3/d16/f3d [4194304,4194304] 0 2024-09-17T01:07:13.141 INFO:tasks.workunit.client.0.smithi103.stdout:9/425: dread d7/d43/d88/f16 [0,4194304] 0 2024-09-17T01:07:13.141 INFO:tasks.workunit.client.0.smithi103.stdout:0/348: fsync dd/f4d 0 2024-09-17T01:07:13.145 INFO:tasks.workunit.client.0.smithi103.stdout:9/426: chown d7/d43/d88/l39 6 1 2024-09-17T01:07:13.146 INFO:tasks.workunit.client.0.smithi103.stdout:5/278: dwrite d6/f3e [0,4194304] 0 2024-09-17T01:07:13.149 INFO:tasks.workunit.client.1.smithi143.stdout:9/992: getdents d3/d39/d6a/d26 0 2024-09-17T01:07:13.150 INFO:tasks.workunit.client.1.smithi143.stdout:0/986: link d3/d5/d8/d21/c59 d3/d68/d8f/ddb/de8/dcd/de5/d13f/c144 0 2024-09-17T01:07:13.151 INFO:tasks.workunit.client.0.smithi103.stdout:8/381: dread d0/d6/dc/d30/d2d/f65 [0,4194304] 0 2024-09-17T01:07:13.152 INFO:tasks.workunit.client.1.smithi143.stdout:9/993: fdatasync d3/d39/d42/dab/d108/fe1 0 2024-09-17T01:07:13.153 INFO:tasks.workunit.client.0.smithi103.stdout:3/481: mkdir d3/d16/d1b/d3c/d65/d7e/dac 0 2024-09-17T01:07:13.156 INFO:tasks.workunit.client.0.smithi103.stdout:5/279: symlink d6/d2c/d38/d4c/d54/l6e 0 2024-09-17T01:07:13.157 INFO:tasks.workunit.client.0.smithi103.stdout:6/330: dwrite d3/d17/d2f/f3c [0,4194304] 0 2024-09-17T01:07:13.158 INFO:tasks.workunit.client.0.smithi103.stdout:3/482: chown d3/d16/d1b/d3c/f26 3 1 2024-09-17T01:07:13.158 INFO:tasks.workunit.client.0.smithi103.stdout:1/487: dread d2/d16/f40 [4194304,4194304] 0 2024-09-17T01:07:13.160 INFO:tasks.workunit.client.0.smithi103.stdout:3/483: fsync d3/d16/d1b/d36/f67 0 2024-09-17T01:07:13.161 INFO:tasks.workunit.client.0.smithi103.stdout:2/290: dread d6/da/d17/d26/f32 [0,4194304] 0 2024-09-17T01:07:13.161 INFO:tasks.workunit.client.0.smithi103.stdout:9/427: creat d7/d43/d88/d11/d20/d8e/f91 x:0 0 0 2024-09-17T01:07:13.163 INFO:tasks.workunit.client.1.smithi143.stdout:9/994: getdents d3/d39/d42 0 2024-09-17T01:07:13.164 INFO:tasks.workunit.client.1.smithi143.stdout:9/995: fdatasync d3/d39/d6a/d26/f106 0 2024-09-17T01:07:13.165 INFO:tasks.workunit.client.0.smithi103.stdout:6/331: symlink d3/l72 0 2024-09-17T01:07:13.165 INFO:tasks.workunit.client.1.smithi143.stdout:9/996: fdatasync d3/d39/d6a/f12e 0 2024-09-17T01:07:13.166 INFO:tasks.workunit.client.0.smithi103.stdout:8/382: symlink d0/d6/dc/d3d/d6d/l73 0 2024-09-17T01:07:13.170 INFO:tasks.workunit.client.0.smithi103.stdout:8/383: read - d0/d6/dc/d30/d25/d64/d34/f5a zero size 2024-09-17T01:07:13.170 INFO:tasks.workunit.client.0.smithi103.stdout:0/349: link dd/df/d38/f33 dd/df/d38/f75 0 2024-09-17T01:07:13.172 INFO:tasks.workunit.client.0.smithi103.stdout:3/484: truncate d3/d16/d1b/d2c/f58 620184 0 2024-09-17T01:07:13.172 INFO:tasks.workunit.client.0.smithi103.stdout:0/350: chown dd/d1c/d50 104176 1 2024-09-17T01:07:13.172 INFO:tasks.workunit.client.0.smithi103.stdout:5/280: mkdir d6/d2c/d38/d6f 0 2024-09-17T01:07:13.173 INFO:tasks.workunit.client.0.smithi103.stdout:9/428: dwrite d7/d43/d88/d11/d21/f89 [0,4194304] 0 2024-09-17T01:07:13.173 INFO:tasks.workunit.client.1.smithi143.stdout:9/997: creat d3/d39/d42/d58/d5a/f13f x:0 0 0 2024-09-17T01:07:13.174 INFO:tasks.workunit.client.1.smithi143.stdout:9/998: chown d3/d39/d42/dab/d108/d51/d52/fc1 4 1 2024-09-17T01:07:13.175 INFO:tasks.workunit.client.0.smithi103.stdout:2/291: mkdir d6/da/d5d 0 2024-09-17T01:07:13.176 INFO:tasks.workunit.client.1.smithi143.stdout:0/987: write d3/d5/d8/d27/d31/fdf [1137054,34882] 0 2024-09-17T01:07:13.177 INFO:tasks.workunit.client.1.smithi143.stdout:0/988: chown d3/d5/d8/f44 327057 1 2024-09-17T01:07:13.178 INFO:tasks.workunit.client.0.smithi103.stdout:1/488: creat d2/d1c/d28/d4b/d67/d9e/fa1 x:0 0 0 2024-09-17T01:07:13.178 INFO:tasks.workunit.client.0.smithi103.stdout:8/384: unlink d0/d6/dc/d30/d25/d64/f70 0 2024-09-17T01:07:13.178 INFO:tasks.workunit.client.0.smithi103.stdout:2/292: write d6/da/d17/d1a/df/f36 [4304401,65300] 0 2024-09-17T01:07:13.179 INFO:tasks.workunit.client.1.smithi143.stdout:0/989: write d3/d5/f41 [2528833,54042] 0 2024-09-17T01:07:13.179 INFO:tasks.workunit.client.0.smithi103.stdout:5/281: stat d6/db/f4e 0 2024-09-17T01:07:13.181 INFO:tasks.workunit.client.1.smithi143.stdout:0/990: dread d3/d68/f7a [0,4194304] 0 2024-09-17T01:07:13.181 INFO:tasks.workunit.client.0.smithi103.stdout:5/282: truncate d6/d2c/f5f 149067 0 2024-09-17T01:07:13.182 INFO:tasks.workunit.client.0.smithi103.stdout:0/351: creat dd/df/d38/f76 x:0 0 0 2024-09-17T01:07:13.183 INFO:tasks.workunit.client.1.smithi143.stdout:2/962: sync 2024-09-17T01:07:13.183 INFO:tasks.workunit.client.0.smithi103.stdout:5/283: write d6/d11/f2f [2015109,72318] 0 2024-09-17T01:07:13.198 INFO:tasks.workunit.client.0.smithi103.stdout:3/485: mknod d3/d16/d1b/d3c/d65/d75/d8d/cad 0 2024-09-17T01:07:13.199 INFO:tasks.workunit.client.1.smithi143.stdout:9/999: truncate d3/d39/d42/dab/d108/d51/db7/fdf 186071 0 2024-09-17T01:07:13.201 INFO:tasks.workunit.client.0.smithi103.stdout:5/284: symlink d6/d2c/l70 0 2024-09-17T01:07:13.203 INFO:tasks.workunit.client.1.smithi143.stdout:2/963: truncate d0/d10/d58/d5a/d5b/d4c/d71/d9d/f73 3382437 0 2024-09-17T01:07:13.204 INFO:tasks.workunit.client.0.smithi103.stdout:9/429: dwrite d7/d2d/f71 [4194304,4194304] 0 2024-09-17T01:07:13.204 INFO:tasks.workunit.client.0.smithi103.stdout:5/285: write d6/d2c/d32/f33 [1157004,61607] 0 2024-09-17T01:07:13.204 INFO:tasks.workunit.client.1.smithi143.stdout:2/964: fsync d0/d10/f11 0 2024-09-17T01:07:13.207 INFO:tasks.workunit.client.1.smithi143.stdout:0/991: dwrite d3/d5/d8/d27/f1e [4194304,4194304] 0 2024-09-17T01:07:13.213 INFO:tasks.workunit.client.0.smithi103.stdout:2/293: creat d6/da/d17/f5e x:0 0 0 2024-09-17T01:07:13.216 INFO:tasks.workunit.client.1.smithi143.stdout:2/965: link d0/d10/f17 d0/d10/d58/d5a/d5b/d4c/d71/d9f/d11d/f140 0 2024-09-17T01:07:13.217 INFO:tasks.workunit.client.0.smithi103.stdout:2/294: write d6/f44 [4425217,50973] 0 2024-09-17T01:07:13.217 INFO:tasks.workunit.client.0.smithi103.stdout:5/286: dwrite d6/d2c/d32/d55/f5e [0,4194304] 0 2024-09-17T01:07:13.218 INFO:tasks.workunit.client.0.smithi103.stdout:0/352: dwrite dd/f3b [0,4194304] 0 2024-09-17T01:07:13.221 INFO:tasks.workunit.client.1.smithi143.stdout:0/992: mkdir d3/d5/d8/d21/d109/d145 0 2024-09-17T01:07:13.222 INFO:tasks.workunit.client.0.smithi103.stdout:6/332: creat d3/d16/d33/d57/d63/f73 x:0 0 0 2024-09-17T01:07:13.223 INFO:tasks.workunit.client.0.smithi103.stdout:0/353: chown dd/d4f/l2b 2 1 2024-09-17T01:07:13.225 INFO:tasks.workunit.client.0.smithi103.stdout:3/486: dread d3/d16/d1b/d3c/f53 [0,4194304] 0 2024-09-17T01:07:13.225 INFO:tasks.workunit.client.0.smithi103.stdout:8/385: creat d0/d6/dc/d30/d25/f74 x:0 0 0 2024-09-17T01:07:13.227 INFO:tasks.workunit.client.0.smithi103.stdout:3/487: truncate d3/f27 9273019 0 2024-09-17T01:07:13.229 INFO:tasks.workunit.client.1.smithi143.stdout:0/993: rename d3/d5/d8/d27/d31/d48/d72 to d3/d5/d35/d146 0 2024-09-17T01:07:13.231 INFO:tasks.workunit.client.0.smithi103.stdout:9/430: creat d7/d43/d88/d11/d5c/d5e/d6c/f92 x:0 0 0 2024-09-17T01:07:13.232 INFO:tasks.workunit.client.1.smithi143.stdout:6/979: sync 2024-09-17T01:07:13.233 INFO:tasks.workunit.client.1.smithi143.stdout:2/966: symlink d0/d44/d7a/d86/d97/l141 0 2024-09-17T01:07:13.233 INFO:tasks.workunit.client.0.smithi103.stdout:1/489: getdents d2/d1c/d28/d52 0 2024-09-17T01:07:13.233 INFO:tasks.workunit.client.1.smithi143.stdout:6/980: write d2/d17/d3a/f51 [3024317,17419] 0 2024-09-17T01:07:13.236 INFO:tasks.workunit.client.0.smithi103.stdout:6/333: write d3/f64 [254157,74159] 0 2024-09-17T01:07:13.237 INFO:tasks.workunit.client.0.smithi103.stdout:1/490: write d2/d1c/d28/d4b/d67/f6a [368022,68958] 0 2024-09-17T01:07:13.238 INFO:tasks.workunit.client.1.smithi143.stdout:6/981: write d2/d30/d84/f108 [2581445,13742] 0 2024-09-17T01:07:13.239 INFO:tasks.workunit.client.0.smithi103.stdout:9/431: fsync d7/d2d/f71 0 2024-09-17T01:07:13.241 INFO:tasks.workunit.client.0.smithi103.stdout:9/432: chown d7/d43/d88/d11/d20/d8e 32471518 1 2024-09-17T01:07:13.249 INFO:tasks.workunit.client.0.smithi103.stdout:6/334: write d3/d25/f37 [3224784,54655] 0 2024-09-17T01:07:13.253 INFO:tasks.workunit.client.0.smithi103.stdout:9/433: mkdir d7/d43/d5f/d7d/d80/d93 0 2024-09-17T01:07:13.253 INFO:tasks.workunit.client.0.smithi103.stdout:2/295: truncate d6/f44 629826 0 2024-09-17T01:07:13.254 INFO:tasks.workunit.client.1.smithi143.stdout:6/982: dwrite d2/d30/d45/d70/d87/fae [0,4194304] 0 2024-09-17T01:07:13.255 INFO:tasks.workunit.client.1.smithi143.stdout:6/983: chown d2/d17/d6e/d26/dbd/df8/ffd 27196740 1 2024-09-17T01:07:13.255 INFO:tasks.workunit.client.1.smithi143.stdout:2/967: truncate d0/d2/d21/d22/f3c 4979648 0 2024-09-17T01:07:13.258 INFO:tasks.workunit.client.0.smithi103.stdout:0/354: rename f5 to dd/f77 0 2024-09-17T01:07:13.258 INFO:tasks.workunit.client.0.smithi103.stdout:1/491: dwrite d2/fb [0,4194304] 0 2024-09-17T01:07:13.259 INFO:tasks.workunit.client.0.smithi103.stdout:8/386: truncate d0/d6/dc/d30/d2d/f3c 4243596 0 2024-09-17T01:07:13.261 INFO:tasks.workunit.client.0.smithi103.stdout:3/488: creat d3/d16/fae x:0 0 0 2024-09-17T01:07:13.268 INFO:tasks.workunit.client.0.smithi103.stdout:9/434: dwrite d7/d43/d88/f16 [4194304,4194304] 0 2024-09-17T01:07:13.272 INFO:tasks.workunit.client.0.smithi103.stdout:0/355: write dd/df/f13 [3384215,100430] 0 2024-09-17T01:07:13.282 INFO:tasks.workunit.client.0.smithi103.stdout:2/296: rename d6/da/d17 to d6/d5f 0 2024-09-17T01:07:13.282 INFO:tasks.workunit.client.0.smithi103.stdout:8/387: dwrite d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:13.284 INFO:tasks.workunit.client.0.smithi103.stdout:8/388: chown d0/d6/dc/d30/d25/d64 118343076 1 2024-09-17T01:07:13.285 INFO:tasks.workunit.client.0.smithi103.stdout:6/335: getdents d3/d16/d33/d57/d63 0 2024-09-17T01:07:13.289 INFO:tasks.workunit.client.0.smithi103.stdout:3/489: dwrite d3/d16/d1b/d2c/d5c/fa4 [0,4194304] 0 2024-09-17T01:07:13.289 INFO:tasks.workunit.client.0.smithi103.stdout:2/297: write d6/da/d3f/f47 [480340,71378] 0 2024-09-17T01:07:13.289 INFO:tasks.workunit.client.0.smithi103.stdout:6/336: mkdir d3/d25/d74 0 2024-09-17T01:07:13.291 INFO:tasks.workunit.client.0.smithi103.stdout:1/492: dread d2/de/f11 [0,4194304] 0 2024-09-17T01:07:13.292 INFO:tasks.workunit.client.0.smithi103.stdout:6/337: read - d3/d16/d21/f5e zero size 2024-09-17T01:07:13.293 INFO:tasks.workunit.client.1.smithi143.stdout:6/984: dread d2/d17/d6e/d26/d46/d66/f88 [0,4194304] 0 2024-09-17T01:07:13.295 INFO:tasks.workunit.client.0.smithi103.stdout:2/298: write d6/f2d [4775579,123757] 0 2024-09-17T01:07:13.298 INFO:tasks.workunit.client.1.smithi143.stdout:2/968: write d0/d10/f5c [528205,94327] 0 2024-09-17T01:07:13.298 INFO:tasks.workunit.client.0.smithi103.stdout:9/435: rename d7/d43/d88/d11/fe to d7/d43/d5f/d7d/d80/d93/f94 0 2024-09-17T01:07:13.300 INFO:tasks.workunit.client.1.smithi143.stdout:0/994: sync 2024-09-17T01:07:13.308 INFO:tasks.workunit.client.0.smithi103.stdout:1/493: dwrite d2/de/d76/f88 [0,4194304] 0 2024-09-17T01:07:13.311 INFO:tasks.workunit.client.0.smithi103.stdout:3/490: dwrite d3/d44/f71 [0,4194304] 0 2024-09-17T01:07:13.313 INFO:tasks.workunit.client.1.smithi143.stdout:6/985: dread d2/d30/d45/d70/f78 [0,4194304] 0 2024-09-17T01:07:13.313 INFO:tasks.workunit.client.1.smithi143.stdout:6/986: stat d2/d30/dc1/de8 0 2024-09-17T01:07:13.316 INFO:tasks.workunit.client.0.smithi103.stdout:0/356: dwrite dd/f14 [0,4194304] 0 2024-09-17T01:07:13.316 INFO:tasks.workunit.client.0.smithi103.stdout:0/357: read - dd/f67 zero size 2024-09-17T01:07:13.317 INFO:tasks.workunit.client.0.smithi103.stdout:0/358: stat dd/d4f/c22 0 2024-09-17T01:07:13.320 INFO:tasks.workunit.client.0.smithi103.stdout:6/338: write d3/d17/f67 [434097,11291] 0 2024-09-17T01:07:13.322 INFO:tasks.workunit.client.0.smithi103.stdout:2/299: mkdir d6/d5f/d26/d34/d4e/d60 0 2024-09-17T01:07:13.323 INFO:tasks.workunit.client.0.smithi103.stdout:9/436: mkdir d7/d43/d88/d11/d20/d4f/d95 0 2024-09-17T01:07:13.325 INFO:tasks.workunit.client.0.smithi103.stdout:3/491: rename d3/f8 to d3/d16/d1b/d2c/faf 0 2024-09-17T01:07:13.326 INFO:tasks.workunit.client.0.smithi103.stdout:0/359: mknod dd/df/d68/c78 0 2024-09-17T01:07:13.330 INFO:tasks.workunit.client.0.smithi103.stdout:2/300: truncate d6/da/d28/f4d 96154 0 2024-09-17T01:07:13.332 INFO:tasks.workunit.client.0.smithi103.stdout:1/494: rename d2/de/d1f/c96 to d2/d1c/d28/d4b/d74/ca2 0 2024-09-17T01:07:13.332 INFO:tasks.workunit.client.0.smithi103.stdout:6/339: dwrite d3/d17/f32 [0,4194304] 0 2024-09-17T01:07:13.339 INFO:tasks.workunit.client.0.smithi103.stdout:9/437: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/f96 x:0 0 0 2024-09-17T01:07:13.346 INFO:tasks.workunit.client.0.smithi103.stdout:6/340: mknod d3/d17/c75 0 2024-09-17T01:07:13.350 INFO:tasks.workunit.client.0.smithi103.stdout:0/360: creat dd/d4f/d64/f79 x:0 0 0 2024-09-17T01:07:13.351 INFO:tasks.workunit.client.0.smithi103.stdout:9/438: rename d7/d43/d88/d11/d20/c67 to d7/d43/d5f/c97 0 2024-09-17T01:07:13.353 INFO:tasks.workunit.client.0.smithi103.stdout:9/439: write d7/d43/d88/d11/d21/f26 [1983762,17947] 0 2024-09-17T01:07:13.356 INFO:tasks.workunit.client.0.smithi103.stdout:1/495: creat d2/de/da0/fa3 x:0 0 0 2024-09-17T01:07:13.356 INFO:tasks.workunit.client.0.smithi103.stdout:1/496: write d2/d7/fc [8752714,91934] 0 2024-09-17T01:07:13.358 INFO:tasks.workunit.client.0.smithi103.stdout:3/492: link d3/f57 d3/fb0 0 2024-09-17T01:07:13.363 INFO:tasks.workunit.client.0.smithi103.stdout:6/341: creat d3/d25/d74/f76 x:0 0 0 2024-09-17T01:07:13.366 INFO:tasks.workunit.client.0.smithi103.stdout:2/301: getdents d6/d5f 0 2024-09-17T01:07:13.367 INFO:tasks.workunit.client.0.smithi103.stdout:9/440: dwrite d7/d2d/f72 [0,4194304] 0 2024-09-17T01:07:13.368 INFO:tasks.workunit.client.0.smithi103.stdout:6/342: rmdir d3/d16/d33/d3e/d58 39 2024-09-17T01:07:13.370 INFO:tasks.workunit.client.0.smithi103.stdout:3/493: dread d3/d16/d1b/d3c/f26 [0,4194304] 0 2024-09-17T01:07:13.372 INFO:tasks.workunit.client.0.smithi103.stdout:2/302: readlink d6/d5f/d1a/d45/l37 0 2024-09-17T01:07:13.379 INFO:tasks.workunit.client.1.smithi143.stdout:6/987: rename d2/d30/d45/d56/f60 to d2/d19/f142 0 2024-09-17T01:07:13.380 INFO:tasks.workunit.client.1.smithi143.stdout:0/995: sync 2024-09-17T01:07:13.381 INFO:tasks.workunit.client.1.smithi143.stdout:0/996: chown d3/d5/d8/d27/f1e 214336 1 2024-09-17T01:07:13.383 INFO:tasks.workunit.client.0.smithi103.stdout:6/343: unlink d3/f4f 0 2024-09-17T01:07:13.384 INFO:tasks.workunit.client.0.smithi103.stdout:9/441: dread d7/d43/d88/d11/d21/f26 [0,4194304] 0 2024-09-17T01:07:13.386 INFO:tasks.workunit.client.1.smithi143.stdout:0/997: mkdir d3/df7/d147 0 2024-09-17T01:07:13.387 INFO:tasks.workunit.client.0.smithi103.stdout:3/494: mknod d3/d16/d1b/d3c/d65/d7e/da3/cb1 0 2024-09-17T01:07:13.390 INFO:tasks.workunit.client.1.smithi143.stdout:0/998: mkdir d3/d5/d8/d27/d31/d48/d8d/de6/dec/d148 0 2024-09-17T01:07:13.394 INFO:tasks.workunit.client.0.smithi103.stdout:2/303: dread d6/d5f/d1a/df/f36 [0,4194304] 0 2024-09-17T01:07:13.396 INFO:tasks.workunit.client.1.smithi143.stdout:0/999: rename d3/d5/d35/d146/f10b to d3/d68/d8f/ddb/de8/dcd/de5/f149 0 2024-09-17T01:07:13.396 INFO:tasks.workunit.client.0.smithi103.stdout:9/442: dread d7/f2a [0,4194304] 0 2024-09-17T01:07:13.397 INFO:tasks.workunit.client.1.smithi143.stdout:6/988: link d2/d17/d6e/d26/d79/dec/l12f d2/d30/d45/d70/d87/d74/l143 0 2024-09-17T01:07:13.399 INFO:tasks.workunit.client.1.smithi143.stdout:6/989: rmdir d2/d30/d45/d70 39 2024-09-17T01:07:13.401 INFO:tasks.workunit.client.0.smithi103.stdout:6/344: dwrite d3/d17/d2f/f3c [0,4194304] 0 2024-09-17T01:07:13.403 INFO:tasks.workunit.client.1.smithi143.stdout:6/990: fdatasync d2/d17/d6e/d26/d46/d65/f9c 0 2024-09-17T01:07:13.404 INFO:tasks.workunit.client.0.smithi103.stdout:2/304: dread f4 [0,4194304] 0 2024-09-17T01:07:13.405 INFO:tasks.workunit.client.1.smithi143.stdout:6/991: fsync d2/df/d20/d2c/d75/d10c/dfb/f134 0 2024-09-17T01:07:13.406 INFO:tasks.workunit.client.0.smithi103.stdout:9/443: dwrite d7/d43/d88/f5a [0,4194304] 0 2024-09-17T01:07:13.407 INFO:tasks.workunit.client.0.smithi103.stdout:9/444: readlink d7/d43/d88/d11/d20/l40 0 2024-09-17T01:07:13.412 INFO:tasks.workunit.client.0.smithi103.stdout:3/495: creat d3/d44/fb2 x:0 0 0 2024-09-17T01:07:13.413 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:13 smithi143 ceph-mon[35452]: pgmap v17: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 96 MiB/s rd, 306 MiB/s wr, 591 op/s 2024-09-17T01:07:13.413 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:13 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:13.413 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:13 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:13.414 INFO:tasks.workunit.client.0.smithi103.stdout:6/345: dread d3/d25/d26/d3a/f6b [0,4194304] 0 2024-09-17T01:07:13.414 INFO:tasks.workunit.client.1.smithi143.stdout:2/969: dwrite d0/dcf/ff2 [0,4194304] 0 2024-09-17T01:07:13.415 INFO:tasks.workunit.client.1.smithi143.stdout:2/970: write d0/d10/d56/f6d [3543485,68684] 0 2024-09-17T01:07:13.415 INFO:tasks.workunit.client.0.smithi103.stdout:9/445: mknod d7/d43/d88/d11/d5c/d5e/c98 0 2024-09-17T01:07:13.417 INFO:tasks.workunit.client.1.smithi143.stdout:6/992: creat d2/f144 x:0 0 0 2024-09-17T01:07:13.417 INFO:tasks.workunit.client.0.smithi103.stdout:6/346: write d3/d25/f29 [2970019,1747] 0 2024-09-17T01:07:13.420 INFO:tasks.workunit.client.0.smithi103.stdout:3/496: creat d3/d16/d1b/d3c/d65/d75/fb3 x:0 0 0 2024-09-17T01:07:13.422 INFO:tasks.workunit.client.0.smithi103.stdout:9/446: unlink d7/d2d/d59/d7a/c82 0 2024-09-17T01:07:13.424 INFO:tasks.workunit.client.1.smithi143.stdout:2/971: dread - d0/d10/d58/d5a/d5b/d4c/d71/ff0 zero size 2024-09-17T01:07:13.425 INFO:tasks.workunit.client.0.smithi103.stdout:9/447: chown d7/d43/d88/d11/d5c/f61 34047500 1 2024-09-17T01:07:13.425 INFO:tasks.workunit.client.0.smithi103.stdout:6/347: dwrite d3/d17/f32 [0,4194304] 0 2024-09-17T01:07:13.427 INFO:tasks.workunit.client.0.smithi103.stdout:2/305: dread d6/f44 [0,4194304] 0 2024-09-17T01:07:13.428 INFO:tasks.workunit.client.1.smithi143.stdout:6/993: rename d2/d17/d3a/d47/f11f to d2/df/d20/d2c/d75/d10c/d13b/f145 0 2024-09-17T01:07:13.436 INFO:tasks.workunit.client.0.smithi103.stdout:2/306: dwrite d6/d5f/d1a/df/f4c [0,4194304] 0 2024-09-17T01:07:13.436 INFO:tasks.workunit.client.1.smithi143.stdout:2/972: creat d0/d44/d6a/d91/ddf/d138/f142 x:0 0 0 2024-09-17T01:07:13.436 INFO:tasks.workunit.client.1.smithi143.stdout:6/994: read d2/d30/d45/d70/d87/fa2 [331906,130208] 0 2024-09-17T01:07:13.439 INFO:tasks.workunit.client.0.smithi103.stdout:9/448: mknod d7/d43/d88/d11/d5c/d8d/c99 0 2024-09-17T01:07:13.443 INFO:tasks.workunit.client.1.smithi143.stdout:2/973: creat d0/d10/d58/d5a/d5b/d4c/d71/dd2/f143 x:0 0 0 2024-09-17T01:07:13.445 INFO:tasks.workunit.client.0.smithi103.stdout:6/348: symlink d3/d16/d33/d3e/d4b/l77 0 2024-09-17T01:07:13.445 INFO:tasks.workunit.client.0.smithi103.stdout:2/307: getdents d6/d5f/d1a/df/d58 0 2024-09-17T01:07:13.446 INFO:tasks.workunit.client.0.smithi103.stdout:9/449: mkdir d7/d43/d88/d11/d20/d4f/d95/d9a 0 2024-09-17T01:07:13.447 INFO:tasks.workunit.client.0.smithi103.stdout:6/349: chown d3/d16/d21/d50/c5b 6 1 2024-09-17T01:07:13.447 INFO:tasks.workunit.client.0.smithi103.stdout:2/308: creat d6/da/d28/f61 x:0 0 0 2024-09-17T01:07:13.448 INFO:tasks.workunit.client.0.smithi103.stdout:9/450: dread - d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 zero size 2024-09-17T01:07:13.451 INFO:tasks.workunit.client.0.smithi103.stdout:9/451: write d7/d2d/d59/f66 [236192,120664] 0 2024-09-17T01:07:13.451 INFO:tasks.workunit.client.0.smithi103.stdout:2/309: creat d6/d5f/d26/f62 x:0 0 0 2024-09-17T01:07:13.451 INFO:tasks.workunit.client.1.smithi143.stdout:2/974: getdents d0/d10/d58/d5a/d5b/d4c/d71/d99 0 2024-09-17T01:07:13.452 INFO:tasks.workunit.client.1.smithi143.stdout:2/975: fsync d0/d10/d58/d5a/d5b/fa4 0 2024-09-17T01:07:13.453 INFO:tasks.workunit.client.0.smithi103.stdout:3/497: dread d3/f27 [0,4194304] 0 2024-09-17T01:07:13.455 INFO:tasks.workunit.client.1.smithi143.stdout:2/976: dread d0/d10/f5c [0,4194304] 0 2024-09-17T01:07:13.455 INFO:tasks.workunit.client.0.smithi103.stdout:9/452: fsync d7/d43/d88/d11/d5c/f61 0 2024-09-17T01:07:13.457 INFO:tasks.workunit.client.0.smithi103.stdout:6/350: dwrite d3/d25/d26/d3a/f45 [0,4194304] 0 2024-09-17T01:07:13.459 INFO:tasks.workunit.client.0.smithi103.stdout:9/453: read d7/d2d/f71 [2662417,129774] 0 2024-09-17T01:07:13.460 INFO:tasks.workunit.client.1.smithi143.stdout:6/995: write d2/d30/d45/d70/fef [507139,29595] 0 2024-09-17T01:07:13.461 INFO:tasks.workunit.client.1.smithi143.stdout:2/977: creat d0/d10/d58/d5a/d5b/d4c/d77/f144 x:0 0 0 2024-09-17T01:07:13.462 INFO:tasks.workunit.client.0.smithi103.stdout:3/498: creat d3/d81/fb4 x:0 0 0 2024-09-17T01:07:13.463 INFO:tasks.workunit.client.0.smithi103.stdout:6/351: mkdir d3/d16/d33/d57/d63/d78 0 2024-09-17T01:07:13.464 INFO:tasks.workunit.client.0.smithi103.stdout:3/499: truncate d3/d16/d1b/f5e 1224367 0 2024-09-17T01:07:13.465 INFO:tasks.workunit.client.0.smithi103.stdout:9/454: creat d7/d43/d88/f9b x:0 0 0 2024-09-17T01:07:13.466 INFO:tasks.workunit.client.0.smithi103.stdout:3/500: dread - d3/d16/d1b/d3c/d65/d75/f78 zero size 2024-09-17T01:07:13.470 INFO:tasks.workunit.client.1.smithi143.stdout:2/978: symlink d0/d2/d21/l145 0 2024-09-17T01:07:13.473 INFO:tasks.workunit.client.0.smithi103.stdout:2/310: truncate d6/fb 33896 0 2024-09-17T01:07:13.475 INFO:tasks.workunit.client.1.smithi143.stdout:2/979: dwrite d0/d2/d21/d84/d8d/fb8 [0,4194304] 0 2024-09-17T01:07:13.477 INFO:tasks.workunit.client.1.smithi143.stdout:6/996: link d2/d17/d6e/d26/d46/d65/f9c d2/df/d18/f146 0 2024-09-17T01:07:13.477 INFO:tasks.workunit.client.1.smithi143.stdout:2/980: write d0/d2/db0/f116 [332774,1527] 0 2024-09-17T01:07:13.478 INFO:tasks.workunit.client.0.smithi103.stdout:3/501: mknod d3/d16/d1b/d3c/d65/d7e/dac/cb5 0 2024-09-17T01:07:13.478 INFO:tasks.workunit.client.1.smithi143.stdout:6/997: read d2/d30/d45/d70/f78 [262113,106109] 0 2024-09-17T01:07:13.479 INFO:tasks.workunit.client.1.smithi143.stdout:2/981: fsync d0/d44/d7a/d86/d97/dec/f115 0 2024-09-17T01:07:13.481 INFO:tasks.workunit.client.0.smithi103.stdout:2/311: rmdir d6/d5f/d26 39 2024-09-17T01:07:13.485 INFO:tasks.workunit.client.0.smithi103.stdout:9/455: creat d7/d43/d88/d11/d20/f9c x:0 0 0 2024-09-17T01:07:13.486 INFO:tasks.workunit.client.0.smithi103.stdout:6/352: truncate d3/d25/f37 2678023 0 2024-09-17T01:07:13.488 INFO:tasks.workunit.client.0.smithi103.stdout:3/502: unlink d3/d16/d1b/d2c/d34/f5f 0 2024-09-17T01:07:13.488 INFO:tasks.workunit.client.0.smithi103.stdout:3/503: chown d3/d16/d1b/d36/c3e 124805 1 2024-09-17T01:07:13.489 INFO:tasks.workunit.client.1.smithi143.stdout:6/998: symlink d2/d17/d6e/d26/dbd/l147 0 2024-09-17T01:07:13.491 INFO:tasks.workunit.client.1.smithi143.stdout:2/982: rename d0/d2/d21/d22/d109/f12a to d0/d2/d21/d84/d8d/f146 0 2024-09-17T01:07:13.492 INFO:tasks.workunit.client.0.smithi103.stdout:9/456: fsync d7/d43/d88/f2c 0 2024-09-17T01:07:13.494 INFO:tasks.workunit.client.1.smithi143.stdout:2/983: mknod d0/d10/d58/d5a/c147 0 2024-09-17T01:07:13.498 INFO:tasks.workunit.client.0.smithi103.stdout:2/312: write f5 [1437770,58278] 0 2024-09-17T01:07:13.502 INFO:tasks.workunit.client.1.smithi143.stdout:6/999: creat d2/df/d40/d41/f148 x:0 0 0 2024-09-17T01:07:13.505 INFO:tasks.workunit.client.1.smithi143.stdout:2/984: write d0/d10/d58/d5a/d5b/d4c/d77/fcc [2771256,34838] 0 2024-09-17T01:07:13.506 INFO:tasks.workunit.client.1.smithi143.stdout:2/985: readlink d0/d2/l13 0 2024-09-17T01:07:13.507 INFO:tasks.workunit.client.0.smithi103.stdout:3/504: dread d3/d16/d1b/d2c/f42 [0,4194304] 0 2024-09-17T01:07:13.509 INFO:tasks.workunit.client.0.smithi103.stdout:6/353: link d3/d17/f2a d3/d17/d2f/f79 0 2024-09-17T01:07:13.510 INFO:tasks.workunit.client.1.smithi143.stdout:2/986: mknod d0/c148 0 2024-09-17T01:07:13.511 INFO:tasks.workunit.client.0.smithi103.stdout:2/313: readlink d6/d5f/l3e 0 2024-09-17T01:07:13.515 INFO:tasks.workunit.client.0.smithi103.stdout:3/505: rmdir d3/d16 39 2024-09-17T01:07:13.518 INFO:tasks.workunit.client.1.smithi143.stdout:2/987: creat d0/d10/d58/d5a/d5b/d4c/d71/dd2/f149 x:0 0 0 2024-09-17T01:07:13.519 INFO:tasks.workunit.client.0.smithi103.stdout:6/354: creat d3/d16/d33/d57/f7a x:0 0 0 2024-09-17T01:07:13.521 INFO:tasks.workunit.client.1.smithi143.stdout:2/988: symlink d0/d2/d21/d22/d109/l14a 0 2024-09-17T01:07:13.523 INFO:tasks.workunit.client.0.smithi103.stdout:2/314: creat d6/d5f/d26/f63 x:0 0 0 2024-09-17T01:07:13.523 INFO:tasks.workunit.client.0.smithi103.stdout:6/355: mknod d3/d16/d33/d3e/d4b/c7b 0 2024-09-17T01:07:13.524 INFO:tasks.workunit.client.0.smithi103.stdout:3/506: mknod d3/d16/d1b/d3c/d65/d83/cb6 0 2024-09-17T01:07:13.524 INFO:tasks.workunit.client.0.smithi103.stdout:9/457: link l3 d7/d43/d88/d11/l9d 0 2024-09-17T01:07:13.525 INFO:tasks.workunit.client.0.smithi103.stdout:3/507: chown d3/d16/d1b/d2c/d34 46514340 1 2024-09-17T01:07:13.526 INFO:tasks.workunit.client.0.smithi103.stdout:2/315: write d6/d5f/f29 [2198219,45704] 0 2024-09-17T01:07:13.527 INFO:tasks.workunit.client.0.smithi103.stdout:6/356: link d3/d16/f1f d3/d16/d21/d56/f7c 0 2024-09-17T01:07:13.529 INFO:tasks.workunit.client.0.smithi103.stdout:6/357: creat d3/d25/f7d x:0 0 0 2024-09-17T01:07:13.531 INFO:tasks.workunit.client.0.smithi103.stdout:9/458: dread d7/d43/d88/d11/d21/f3e [0,4194304] 0 2024-09-17T01:07:13.532 INFO:tasks.workunit.client.0.smithi103.stdout:2/316: rename d6/d5f/d1a/d45/f27 to d6/da/f64 0 2024-09-17T01:07:13.532 INFO:tasks.workunit.client.0.smithi103.stdout:6/358: creat d3/d17/d2f/f7e x:0 0 0 2024-09-17T01:07:13.533 INFO:tasks.workunit.client.0.smithi103.stdout:2/317: write d6/d5f/d26/f2c [903748,81500] 0 2024-09-17T01:07:13.533 INFO:tasks.workunit.client.0.smithi103.stdout:9/459: creat d7/d43/d88/d11/d5c/d8d/f9e x:0 0 0 2024-09-17T01:07:13.534 INFO:tasks.workunit.client.0.smithi103.stdout:6/359: creat d3/d17/f7f x:0 0 0 2024-09-17T01:07:13.536 INFO:tasks.workunit.client.0.smithi103.stdout:2/318: link d6/f4b d6/da/d3f/f65 0 2024-09-17T01:07:13.537 INFO:tasks.workunit.client.0.smithi103.stdout:2/319: chown d6/d5f/d26/f63 378 1 2024-09-17T01:07:13.568 INFO:tasks.workunit.client.0.smithi103.stdout:6/360: rename d3/d16/d33/d57/d63/d60/l6e to d3/d17/l80 0 2024-09-17T01:07:13.569 INFO:tasks.workunit.client.0.smithi103.stdout:6/361: chown d3/d16/d33/d3e/d4b 1922038616 1 2024-09-17T01:07:13.579 INFO:tasks.workunit.client.0.smithi103.stdout:4/462: sync 2024-09-17T01:07:13.580 INFO:tasks.workunit.client.0.smithi103.stdout:7/380: sync 2024-09-17T01:07:13.580 INFO:tasks.workunit.client.0.smithi103.stdout:4/463: dread - d9/d16/d23/d2a/f5c zero size 2024-09-17T01:07:13.601 INFO:tasks.workunit.client.0.smithi103.stdout:7/381: fsync d4/d11/d2b/d36/f7d 0 2024-09-17T01:07:13.602 INFO:tasks.workunit.client.0.smithi103.stdout:4/464: mknod d9/dc/c86 0 2024-09-17T01:07:13.605 INFO:tasks.workunit.client.0.smithi103.stdout:2/320: rename d6/d5f/d1a to d6/d5f/d26/d66 0 2024-09-17T01:07:13.606 INFO:tasks.workunit.client.0.smithi103.stdout:2/321: readlink d6/d5f/d26/d66/l10 0 2024-09-17T01:07:13.606 INFO:tasks.workunit.client.0.smithi103.stdout:4/465: creat d9/d16/d23/d32/d61/f87 x:0 0 0 2024-09-17T01:07:13.608 INFO:tasks.workunit.client.0.smithi103.stdout:6/362: rmdir d3/d17/d2f 39 2024-09-17T01:07:13.611 INFO:tasks.workunit.client.0.smithi103.stdout:4/466: dread d9/d16/d44/f4f [0,4194304] 0 2024-09-17T01:07:13.612 INFO:tasks.workunit.client.0.smithi103.stdout:6/363: dread d3/d17/f32 [0,4194304] 0 2024-09-17T01:07:13.613 INFO:tasks.workunit.client.0.smithi103.stdout:2/322: creat d6/d5f/d42/f67 x:0 0 0 2024-09-17T01:07:13.617 INFO:tasks.workunit.client.0.smithi103.stdout:4/467: dread d9/dc/df/f72 [0,4194304] 0 2024-09-17T01:07:13.617 INFO:tasks.workunit.client.0.smithi103.stdout:4/468: chown d9/d16/d36 2675952 1 2024-09-17T01:07:13.618 INFO:tasks.workunit.client.0.smithi103.stdout:2/323: mkdir d6/d5f/d26/d66/df/d68 0 2024-09-17T01:07:13.618 INFO:tasks.workunit.client.0.smithi103.stdout:7/382: write d4/d11/f18 [1823362,119053] 0 2024-09-17T01:07:13.619 INFO:tasks.workunit.client.0.smithi103.stdout:4/469: chown d9/d16/d36/d42/f56 65245988 1 2024-09-17T01:07:13.620 INFO:tasks.workunit.client.1.smithi143.stdout:2/989: sync 2024-09-17T01:07:13.620 INFO:tasks.workunit.client.0.smithi103.stdout:7/383: write d4/d11/f19 [5099289,61959] 0 2024-09-17T01:07:13.624 INFO:tasks.workunit.client.0.smithi103.stdout:2/324: rename d6/d5f/d26/d66/df/c1b to d6/d5f/d26/d34/d4e/c69 0 2024-09-17T01:07:13.626 INFO:tasks.workunit.client.1.smithi143.stdout:2/990: dwrite d0/d44/dd6/f129 [0,4194304] 0 2024-09-17T01:07:13.627 INFO:tasks.workunit.client.0.smithi103.stdout:2/325: chown d6/d5f/d26/d66/c1d 758 1 2024-09-17T01:07:13.628 INFO:tasks.workunit.client.0.smithi103.stdout:7/384: getdents d4/d11/d2b/d36/d3a/d51 0 2024-09-17T01:07:13.631 INFO:tasks.workunit.client.0.smithi103.stdout:2/326: chown d6/da/d28/f61 435 1 2024-09-17T01:07:13.631 INFO:tasks.workunit.client.0.smithi103.stdout:7/385: truncate d4/d10/f56 278281 0 2024-09-17T01:07:13.634 INFO:tasks.workunit.client.1.smithi143.stdout:2/991: creat d0/d10/d58/d5a/d5b/d4c/d71/f14b x:0 0 0 2024-09-17T01:07:13.635 INFO:tasks.workunit.client.0.smithi103.stdout:6/364: dwrite d3/f36 [0,4194304] 0 2024-09-17T01:07:13.639 INFO:tasks.workunit.client.0.smithi103.stdout:6/365: symlink d3/d25/d26/d3a/l81 0 2024-09-17T01:07:13.639 INFO:tasks.workunit.client.0.smithi103.stdout:4/470: dread d9/d16/f12 [0,4194304] 0 2024-09-17T01:07:13.641 INFO:tasks.workunit.client.1.smithi143.stdout:2/992: rename d0/d2/d21/l128 to d0/d2/d105/l14c 0 2024-09-17T01:07:13.641 INFO:tasks.workunit.client.0.smithi103.stdout:7/386: rename d4/d10/l29 to d4/d4a/d4b/l84 0 2024-09-17T01:07:13.641 INFO:tasks.workunit.client.0.smithi103.stdout:2/327: dread d6/f25 [0,4194304] 0 2024-09-17T01:07:13.641 INFO:tasks.workunit.client.0.smithi103.stdout:6/366: dread d3/d25/d26/d3a/f6b [0,4194304] 0 2024-09-17T01:07:13.642 INFO:tasks.workunit.client.0.smithi103.stdout:6/367: stat d3/d16/d21/l48 0 2024-09-17T01:07:13.644 INFO:tasks.workunit.client.0.smithi103.stdout:4/471: symlink d9/d16/d23/d32/d4c/l88 0 2024-09-17T01:07:13.649 INFO:tasks.workunit.client.0.smithi103.stdout:4/472: creat d9/d16/d23/d2a/f89 x:0 0 0 2024-09-17T01:07:13.650 INFO:tasks.workunit.client.0.smithi103.stdout:2/328: dwrite d6/f8 [0,4194304] 0 2024-09-17T01:07:13.653 INFO:tasks.workunit.client.0.smithi103.stdout:4/473: mknod d9/d16/d23/d32/c8a 0 2024-09-17T01:07:13.653 INFO:tasks.workunit.client.0.smithi103.stdout:2/329: stat d6/d5f/d26/d66/df/f59 0 2024-09-17T01:07:13.655 INFO:tasks.workunit.client.1.smithi143.stdout:2/993: dwrite d0/d44/d7a/d86/d97/fcd [0,4194304] 0 2024-09-17T01:07:13.657 INFO:tasks.workunit.client.0.smithi103.stdout:2/330: mknod d6/d5f/d26/d34/d4e/c6a 0 2024-09-17T01:07:13.660 INFO:tasks.workunit.client.0.smithi103.stdout:2/331: write d6/d5f/d26/f32 [2022653,65123] 0 2024-09-17T01:07:13.661 INFO:tasks.workunit.client.1.smithi143.stdout:2/994: mkdir d0/d10/d58/d5a/d5b/d4c/d71/d99/d14d 0 2024-09-17T01:07:13.663 INFO:tasks.workunit.client.0.smithi103.stdout:4/474: dwrite d9/d16/f1e [0,4194304] 0 2024-09-17T01:07:13.664 INFO:tasks.workunit.client.1.smithi143.stdout:2/995: fdatasync d0/d10/d58/d5a/d5b/d4c/d71/ff0 0 2024-09-17T01:07:13.665 INFO:tasks.workunit.client.0.smithi103.stdout:6/368: dread d3/f11 [0,4194304] 0 2024-09-17T01:07:13.667 INFO:tasks.workunit.client.1.smithi143.stdout:2/996: creat d0/d44/d7a/d86/d97/f14e x:0 0 0 2024-09-17T01:07:13.667 INFO:tasks.workunit.client.0.smithi103.stdout:4/475: rmdir d9/d16/d23/d32 39 2024-09-17T01:07:13.668 INFO:tasks.workunit.client.1.smithi143.stdout:2/997: chown d0/d10/d58/d5a/d5b/d4c/d71/d9d/f36 25 1 2024-09-17T01:07:13.668 INFO:tasks.workunit.client.0.smithi103.stdout:6/369: truncate d3/d25/f29 5015024 0 2024-09-17T01:07:13.670 INFO:tasks.workunit.client.0.smithi103.stdout:2/332: link d6/f7 d6/d5f/d26/d66/df/f6b 0 2024-09-17T01:07:13.671 INFO:tasks.workunit.client.0.smithi103.stdout:4/476: symlink d9/d16/d23/l8b 0 2024-09-17T01:07:13.672 INFO:tasks.workunit.client.1.smithi143.stdout:2/998: dread d0/d10/f39 [0,4194304] 0 2024-09-17T01:07:13.673 INFO:tasks.workunit.client.0.smithi103.stdout:2/333: write d6/d5f/d26/d66/d45/f49 [177229,67156] 0 2024-09-17T01:07:13.673 INFO:tasks.workunit.client.0.smithi103.stdout:6/370: truncate d3/d16/d33/d57/d63/f73 382939 0 2024-09-17T01:07:13.676 INFO:tasks.workunit.client.0.smithi103.stdout:6/371: chown d3/d16/d33/d57 1446791 1 2024-09-17T01:07:13.676 INFO:tasks.workunit.client.0.smithi103.stdout:2/334: chown d6/d5f/d26/d66/d45/f49 212998 1 2024-09-17T01:07:13.676 INFO:tasks.workunit.client.1.smithi143.stdout:2/999: rmdir d0/d2/d21/d84/d8d 39 2024-09-17T01:07:13.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:13 smithi103 ceph-mon[28156]: pgmap v17: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 96 MiB/s rd, 306 MiB/s wr, 591 op/s 2024-09-17T01:07:13.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:13 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:13.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:13 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:13.677 INFO:tasks.workunit.client.0.smithi103.stdout:6/372: chown d3/f9 103 1 2024-09-17T01:07:13.678 INFO:tasks.workunit.client.0.smithi103.stdout:7/387: dread d4/f7 [0,4194304] 0 2024-09-17T01:07:13.680 INFO:tasks.workunit.client.0.smithi103.stdout:4/477: dwrite d9/d16/d23/d52/f7e [0,4194304] 0 2024-09-17T01:07:13.680 INFO:tasks.workunit.client.1.smithi143.stderr:+ rm -rf -- ./tmp.bQtaDCqG6L 2024-09-17T01:07:13.684 INFO:tasks.workunit.client.0.smithi103.stdout:6/373: mkdir d3/d16/d33/d3e/d58/d82 0 2024-09-17T01:07:13.687 INFO:tasks.workunit.client.0.smithi103.stdout:2/335: dwrite d6/da/d28/f35 [0,4194304] 0 2024-09-17T01:07:13.687 INFO:tasks.workunit.client.0.smithi103.stdout:4/478: mknod d9/d16/d36/d42/d84/c8c 0 2024-09-17T01:07:13.690 INFO:tasks.workunit.client.0.smithi103.stdout:2/336: chown d6/d5f/l3e 84073 1 2024-09-17T01:07:13.694 INFO:tasks.workunit.client.0.smithi103.stdout:2/337: chown d6/d5f/d26/c31 16703 1 2024-09-17T01:07:13.696 INFO:tasks.workunit.client.0.smithi103.stdout:2/338: readlink d6/d5f/l3e 0 2024-09-17T01:07:13.697 INFO:tasks.workunit.client.0.smithi103.stdout:6/374: dwrite d3/d16/f1e [0,4194304] 0 2024-09-17T01:07:13.701 INFO:tasks.workunit.client.0.smithi103.stdout:4/479: dwrite d9/d16/d38/d3f/f7c [0,4194304] 0 2024-09-17T01:07:13.703 INFO:tasks.workunit.client.0.smithi103.stdout:2/339: symlink d6/d5f/d26/d66/d45/l6c 0 2024-09-17T01:07:13.705 INFO:tasks.workunit.client.0.smithi103.stdout:6/375: creat d3/d25/d26/f83 x:0 0 0 2024-09-17T01:07:13.709 INFO:tasks.workunit.client.0.smithi103.stdout:6/376: write d3/f28 [944775,73672] 0 2024-09-17T01:07:13.710 INFO:tasks.workunit.client.0.smithi103.stdout:4/480: symlink d9/d16/d23/d32/d61/l8d 0 2024-09-17T01:07:13.713 INFO:tasks.workunit.client.0.smithi103.stdout:2/340: dwrite f5 [0,4194304] 0 2024-09-17T01:07:13.717 INFO:tasks.workunit.client.0.smithi103.stdout:7/388: dread d4/d11/d3f/d63/f73 [0,4194304] 0 2024-09-17T01:07:13.721 INFO:tasks.workunit.client.0.smithi103.stdout:2/341: rename d6/d5f/d26/d66/l4f to d6/d5f/d26/d34/l6d 0 2024-09-17T01:07:13.721 INFO:tasks.workunit.client.0.smithi103.stdout:6/377: dwrite d3/d25/f29 [0,4194304] 0 2024-09-17T01:07:13.723 INFO:tasks.workunit.client.0.smithi103.stdout:2/342: truncate d6/da/d28/f61 714743 0 2024-09-17T01:07:13.726 INFO:tasks.workunit.client.0.smithi103.stdout:2/343: mkdir d6/d5f/d26/d6e 0 2024-09-17T01:07:13.729 INFO:tasks.workunit.client.0.smithi103.stdout:6/378: rename d3/d25/l59 to d3/l84 0 2024-09-17T01:07:13.730 INFO:tasks.workunit.client.0.smithi103.stdout:2/344: mkdir d6/d5f/d42/d6f 0 2024-09-17T01:07:13.733 INFO:tasks.workunit.client.0.smithi103.stdout:2/345: mkdir d6/d5f/d26/d66/d45/d70 0 2024-09-17T01:07:13.734 INFO:tasks.workunit.client.0.smithi103.stdout:2/346: write d6/f52 [4400957,50736] 0 2024-09-17T01:07:13.736 INFO:tasks.workunit.client.0.smithi103.stdout:6/379: rename d3/d16/d33/d3e/f43 to d3/d16/d33/d3e/f85 0 2024-09-17T01:07:13.740 INFO:tasks.workunit.client.0.smithi103.stdout:2/347: creat d6/d5f/d26/d34/d4e/f71 x:0 0 0 2024-09-17T01:07:13.743 INFO:tasks.workunit.client.0.smithi103.stdout:7/389: write d4/d10/d43/f71 [1591640,66401] 0 2024-09-17T01:07:13.748 INFO:tasks.workunit.client.0.smithi103.stdout:6/380: dwrite d3/ff [4194304,4194304] 0 2024-09-17T01:07:13.750 INFO:tasks.workunit.client.0.smithi103.stdout:2/348: creat d6/f72 x:0 0 0 2024-09-17T01:07:13.755 INFO:tasks.workunit.client.0.smithi103.stdout:6/381: rename d3/d16/l70 to d3/d16/d33/d57/d63/d60/l86 0 2024-09-17T01:07:13.756 INFO:tasks.workunit.client.0.smithi103.stdout:7/390: getdents d4/d11/d34 0 2024-09-17T01:07:13.758 INFO:tasks.workunit.client.0.smithi103.stdout:7/391: truncate d4/d11/f7f 618150 0 2024-09-17T01:07:13.759 INFO:tasks.workunit.client.0.smithi103.stdout:2/349: link d6/f56 d6/d5f/d26/d34/f73 0 2024-09-17T01:07:13.761 INFO:tasks.workunit.client.0.smithi103.stdout:6/382: rename d3/d16/d33/d57/d63/d78 to d3/d25/d26/d87 0 2024-09-17T01:07:13.764 INFO:tasks.workunit.client.0.smithi103.stdout:2/350: fsync d6/da/f64 0 2024-09-17T01:07:13.764 INFO:tasks.workunit.client.0.smithi103.stdout:6/383: mknod d3/d25/d26/d3a/c88 0 2024-09-17T01:07:13.765 INFO:tasks.workunit.client.0.smithi103.stdout:2/351: dread - d6/d5f/d26/f63 zero size 2024-09-17T01:07:13.771 INFO:tasks.workunit.client.0.smithi103.stdout:7/392: link d4/c13 d4/d11/d2b/d36/c85 0 2024-09-17T01:07:13.783 INFO:tasks.workunit.client.0.smithi103.stdout:7/393: dwrite d4/d11/d34/d3d/f6c [0,4194304] 0 2024-09-17T01:07:13.785 INFO:tasks.workunit.client.0.smithi103.stdout:7/394: read - d4/d11/d2b/d36/d3a/d51/d5e/d7b/f7c zero size 2024-09-17T01:07:13.795 INFO:tasks.workunit.client.0.smithi103.stdout:7/395: mknod d4/d11/d2b/d36/d3a/d51/d5e/c86 0 2024-09-17T01:07:13.799 INFO:tasks.workunit.client.0.smithi103.stdout:2/352: getdents d6/d5f/d26 0 2024-09-17T01:07:13.801 INFO:tasks.workunit.client.0.smithi103.stdout:7/396: rename d4/d11/d3f/c74 to d4/d11/d34/d3d/c87 0 2024-09-17T01:07:13.807 INFO:tasks.workunit.client.0.smithi103.stdout:5/287: sync 2024-09-17T01:07:13.811 INFO:tasks.workunit.client.0.smithi103.stdout:7/397: rename d4/fb to d4/d11/d2b/d36/d3a/d51/f88 0 2024-09-17T01:07:13.812 INFO:tasks.workunit.client.0.smithi103.stdout:6/384: truncate d3/d17/d2f/f3c 2778233 0 2024-09-17T01:07:13.813 INFO:tasks.workunit.client.0.smithi103.stdout:7/398: stat d4/d11/d2b/d36/d3a/d51/d5e/d7b/l81 0 2024-09-17T01:07:13.813 INFO:tasks.workunit.client.0.smithi103.stdout:6/385: chown d3/d25/d74 0 1 2024-09-17T01:07:13.814 INFO:tasks.workunit.client.0.smithi103.stdout:6/386: chown d3/d16/l22 209 1 2024-09-17T01:07:13.814 INFO:tasks.workunit.client.0.smithi103.stdout:7/399: stat d4/d11/d2b/f2f 0 2024-09-17T01:07:13.815 INFO:tasks.workunit.client.0.smithi103.stdout:2/353: dread d6/da/f2f [0,4194304] 0 2024-09-17T01:07:13.816 INFO:tasks.workunit.client.0.smithi103.stdout:5/288: getdents d6/d2c/d32/d55 0 2024-09-17T01:07:13.821 INFO:tasks.workunit.client.0.smithi103.stdout:7/400: mknod d4/d11/d80/c89 0 2024-09-17T01:07:13.823 INFO:tasks.workunit.client.0.smithi103.stdout:7/401: truncate d4/d4a/f78 207615 0 2024-09-17T01:07:13.823 INFO:tasks.workunit.client.0.smithi103.stdout:5/289: mkdir d6/d2c/d38/d4c/d71 0 2024-09-17T01:07:13.825 INFO:tasks.workunit.client.0.smithi103.stdout:6/387: symlink d3/d16/d33/d3e/l89 0 2024-09-17T01:07:13.827 INFO:tasks.workunit.client.0.smithi103.stdout:2/354: mkdir d6/d5f/d74 0 2024-09-17T01:07:13.830 INFO:tasks.workunit.client.0.smithi103.stdout:2/355: write d6/d5f/d26/d34/d4e/f51 [125344,71291] 0 2024-09-17T01:07:13.832 INFO:tasks.workunit.client.0.smithi103.stdout:7/402: dwrite d4/d10/f56 [0,4194304] 0 2024-09-17T01:07:13.832 INFO:tasks.workunit.client.0.smithi103.stdout:5/290: dwrite d6/d2c/d32/d55/f6a [0,4194304] 0 2024-09-17T01:07:13.836 INFO:tasks.workunit.client.0.smithi103.stdout:5/291: dread - d6/d2c/d38/d4c/f5b zero size 2024-09-17T01:07:13.840 INFO:tasks.workunit.client.0.smithi103.stdout:7/403: mkdir d4/d4a/d4b/d8a 0 2024-09-17T01:07:13.841 INFO:tasks.workunit.client.0.smithi103.stdout:7/404: readlink d4/le 0 2024-09-17T01:07:13.841 INFO:tasks.workunit.client.0.smithi103.stdout:7/405: chown d4/l8 107 1 2024-09-17T01:07:13.843 INFO:tasks.workunit.client.0.smithi103.stdout:2/356: rename d6/d5f/d26/d66/d45 to d6/d5f/d26/d34/d4e/d60/d75 0 2024-09-17T01:07:13.846 INFO:tasks.workunit.client.0.smithi103.stdout:6/388: getdents d3/d25 0 2024-09-17T01:07:13.848 INFO:tasks.workunit.client.0.smithi103.stdout:7/406: dread d4/d11/d2b/d36/d3a/f6e [0,4194304] 0 2024-09-17T01:07:13.849 INFO:tasks.workunit.client.0.smithi103.stdout:5/292: fsync d6/d2c/f3d 0 2024-09-17T01:07:13.853 INFO:tasks.workunit.client.0.smithi103.stdout:7/407: dwrite d4/d10/f56 [0,4194304] 0 2024-09-17T01:07:13.855 INFO:tasks.workunit.client.0.smithi103.stdout:2/357: symlink d6/da/d3f/l76 0 2024-09-17T01:07:13.856 INFO:tasks.workunit.client.0.smithi103.stdout:2/358: truncate d6/d5f/d26/f32 4398571 0 2024-09-17T01:07:13.857 INFO:tasks.workunit.client.0.smithi103.stdout:6/389: creat d3/d25/d26/f8a x:0 0 0 2024-09-17T01:07:13.858 INFO:tasks.workunit.client.0.smithi103.stdout:2/359: write d6/d5f/d26/d34/d4e/d60/d75/f49 [36072,7884] 0 2024-09-17T01:07:13.859 INFO:tasks.workunit.client.0.smithi103.stdout:2/360: chown d6/d5f/d26/d34/d4e/d60/d75/l37 939113 1 2024-09-17T01:07:13.863 INFO:tasks.workunit.client.0.smithi103.stdout:7/408: creat d4/d11/d34/d3d/f8b x:0 0 0 2024-09-17T01:07:13.866 INFO:tasks.workunit.client.0.smithi103.stdout:6/390: fdatasync d3/f4 0 2024-09-17T01:07:13.866 INFO:tasks.workunit.client.0.smithi103.stdout:6/391: read d3/d17/f67 [160016,12077] 0 2024-09-17T01:07:13.868 INFO:tasks.workunit.client.0.smithi103.stdout:2/361: chown d6/f7 11294 1 2024-09-17T01:07:13.869 INFO:tasks.workunit.client.0.smithi103.stdout:5/293: truncate d6/db/f3a 802696 0 2024-09-17T01:07:13.870 INFO:tasks.workunit.client.0.smithi103.stdout:2/362: dread d6/da/d28/f61 [0,4194304] 0 2024-09-17T01:07:13.871 INFO:tasks.workunit.client.0.smithi103.stdout:7/409: mkdir d4/d11/d80/d8c 0 2024-09-17T01:07:13.872 INFO:tasks.workunit.client.0.smithi103.stdout:2/363: write d6/d5f/d26/f2c [884254,72019] 0 2024-09-17T01:07:13.872 INFO:tasks.workunit.client.0.smithi103.stdout:2/364: readlink d6/da/d3f/l57 0 2024-09-17T01:07:13.873 INFO:tasks.workunit.client.0.smithi103.stdout:7/410: chown d4/d11/f5f 245390597 1 2024-09-17T01:07:13.874 INFO:tasks.workunit.client.0.smithi103.stdout:6/392: symlink d3/d17/d2f/l8b 0 2024-09-17T01:07:13.875 INFO:tasks.workunit.client.0.smithi103.stdout:6/393: chown d3/d16/d21/d50/c5b 14 1 2024-09-17T01:07:13.876 INFO:tasks.workunit.client.0.smithi103.stdout:6/394: truncate d3/d25/d74/f76 105306 0 2024-09-17T01:07:13.877 INFO:tasks.workunit.client.0.smithi103.stdout:6/395: dread - d3/d16/d33/d3e/f51 zero size 2024-09-17T01:07:13.880 INFO:tasks.workunit.client.0.smithi103.stdout:2/365: fdatasync d6/d5f/f3c 0 2024-09-17T01:07:13.880 INFO:tasks.workunit.client.0.smithi103.stdout:7/411: mkdir d4/d11/d2b/d8d 0 2024-09-17T01:07:13.884 INFO:tasks.workunit.client.0.smithi103.stdout:5/294: link d6/db/f4e d6/d2c/d38/d4c/d50/f72 0 2024-09-17T01:07:13.885 INFO:tasks.workunit.client.0.smithi103.stdout:5/295: chown d6/d2c/d38/d4c/d50/c68 108058066 1 2024-09-17T01:07:13.886 INFO:tasks.workunit.client.0.smithi103.stdout:6/396: write d3/f11 [421016,71096] 0 2024-09-17T01:07:13.889 INFO:tasks.workunit.client.0.smithi103.stdout:2/366: unlink d6/d5f/d26/c46 0 2024-09-17T01:07:13.890 INFO:tasks.workunit.client.0.smithi103.stdout:7/412: truncate d4/d11/d2b/d36/d3a/d51/d5e/d7b/f7c 248197 0 2024-09-17T01:07:13.892 INFO:tasks.workunit.client.0.smithi103.stdout:7/413: mknod d4/d10/d37/c8e 0 2024-09-17T01:07:13.893 INFO:tasks.workunit.client.0.smithi103.stdout:2/367: truncate d6/d5f/d26/f62 955017 0 2024-09-17T01:07:13.895 INFO:tasks.workunit.client.0.smithi103.stdout:6/397: dwrite d3/d25/f7d [0,4194304] 0 2024-09-17T01:07:13.896 INFO:tasks.workunit.client.0.smithi103.stdout:2/368: chown d6/d5f/d26/d34/d4e/d60/d75/l6c 5 1 2024-09-17T01:07:13.898 INFO:tasks.workunit.client.0.smithi103.stdout:7/414: rename d4/d10/f4d to d4/d11/d2b/d36/d82/f8f 0 2024-09-17T01:07:13.900 INFO:tasks.workunit.client.0.smithi103.stdout:6/398: symlink d3/d16/d21/d50/l8c 0 2024-09-17T01:07:13.908 INFO:tasks.workunit.client.0.smithi103.stdout:6/399: creat d3/d16/d33/f8d x:0 0 0 2024-09-17T01:07:13.909 INFO:tasks.workunit.client.0.smithi103.stdout:2/369: dwrite d6/d5f/d26/d34/d4e/f53 [0,4194304] 0 2024-09-17T01:07:13.910 INFO:tasks.workunit.client.0.smithi103.stdout:7/415: symlink d4/d4a/l90 0 2024-09-17T01:07:13.911 INFO:tasks.workunit.client.0.smithi103.stdout:6/400: write d3/d25/f7d [489198,42733] 0 2024-09-17T01:07:13.912 INFO:tasks.workunit.client.0.smithi103.stdout:6/401: write d3/ff [8290059,18438] 0 2024-09-17T01:07:13.914 INFO:tasks.workunit.client.0.smithi103.stdout:5/296: truncate d6/db/fd 269135 0 2024-09-17T01:07:13.915 INFO:tasks.workunit.client.0.smithi103.stdout:5/297: chown d6/d2c/d38/d4c/d54 316294 1 2024-09-17T01:07:13.915 INFO:tasks.workunit.client.0.smithi103.stdout:2/370: unlink d6/c50 0 2024-09-17T01:07:13.924 INFO:tasks.workunit.client.0.smithi103.stdout:2/371: dwrite f5 [0,4194304] 0 2024-09-17T01:07:13.929 INFO:tasks.workunit.client.0.smithi103.stdout:5/298: unlink d6/d2c/d38/d4c/d50/l16 0 2024-09-17T01:07:13.935 INFO:tasks.workunit.client.0.smithi103.stdout:5/299: creat d6/d2c/f73 x:0 0 0 2024-09-17T01:07:13.940 INFO:tasks.workunit.client.0.smithi103.stdout:7/416: getdents d4/d11/d2b/d36/d3a/d51 0 2024-09-17T01:07:13.941 INFO:tasks.workunit.client.0.smithi103.stdout:6/402: dwrite d3/d16/f1b [0,4194304] 0 2024-09-17T01:07:13.941 INFO:tasks.workunit.client.0.smithi103.stdout:7/417: chown d4/f7 0 1 2024-09-17T01:07:13.948 INFO:tasks.workunit.client.0.smithi103.stdout:6/403: creat d3/d25/d74/f8e x:0 0 0 2024-09-17T01:07:13.950 INFO:tasks.workunit.client.0.smithi103.stdout:2/372: rename d6/d5f/c39 to d6/c77 0 2024-09-17T01:07:13.952 INFO:tasks.workunit.client.0.smithi103.stdout:2/373: write d6/d5f/f29 [2955519,97298] 0 2024-09-17T01:07:13.954 INFO:tasks.workunit.client.0.smithi103.stdout:5/300: getdents d6/d2c/d32 0 2024-09-17T01:07:13.957 INFO:tasks.workunit.client.0.smithi103.stdout:6/404: dwrite d3/d25/d26/f2e [0,4194304] 0 2024-09-17T01:07:13.959 INFO:tasks.workunit.client.0.smithi103.stdout:8/389: sync 2024-09-17T01:07:13.959 INFO:tasks.workunit.client.0.smithi103.stdout:0/361: sync 2024-09-17T01:07:13.966 INFO:tasks.workunit.client.0.smithi103.stdout:6/405: creat d3/d16/d33/d3e/d58/f8f x:0 0 0 2024-09-17T01:07:13.968 INFO:tasks.workunit.client.0.smithi103.stdout:5/301: symlink d6/d2c/d38/d4c/d50/l74 0 2024-09-17T01:07:13.970 INFO:tasks.workunit.client.0.smithi103.stdout:2/374: mknod d6/d5f/d42/d6f/c78 0 2024-09-17T01:07:13.971 INFO:tasks.workunit.client.0.smithi103.stdout:7/418: dread d4/d11/d2b/f65 [0,4194304] 0 2024-09-17T01:07:13.975 INFO:tasks.workunit.client.0.smithi103.stdout:6/406: dread d3/d25/f7d [0,4194304] 0 2024-09-17T01:07:13.978 INFO:tasks.workunit.client.0.smithi103.stdout:5/302: mknod d6/d2c/d38/d4c/d50/c75 0 2024-09-17T01:07:13.983 INFO:tasks.workunit.client.0.smithi103.stdout:2/375: symlink d6/d5f/d26/d66/l79 0 2024-09-17T01:07:13.984 INFO:tasks.workunit.client.0.smithi103.stdout:2/376: dread - d6/da/d3f/f4a zero size 2024-09-17T01:07:13.985 INFO:tasks.workunit.client.0.smithi103.stdout:5/303: rename d6/d2c/d38/l59 to d6/d2c/d38/d6f/l76 0 2024-09-17T01:07:13.987 INFO:tasks.workunit.client.0.smithi103.stdout:6/407: dwrite d3/f36 [0,4194304] 0 2024-09-17T01:07:13.988 INFO:tasks.workunit.client.0.smithi103.stdout:8/390: write d0/d6/dc/f4b [218544,100646] 0 2024-09-17T01:07:13.989 INFO:tasks.workunit.client.0.smithi103.stdout:0/362: dread dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:13.990 INFO:tasks.workunit.client.0.smithi103.stdout:2/377: stat d6/d5f/f20 0 2024-09-17T01:07:13.993 INFO:tasks.workunit.client.0.smithi103.stdout:8/391: fdatasync d0/d6/f6b 0 2024-09-17T01:07:13.994 INFO:tasks.workunit.client.0.smithi103.stdout:2/378: read d6/d5f/d26/d66/df/f6b [2570,25294] 0 2024-09-17T01:07:13.995 INFO:tasks.workunit.client.0.smithi103.stdout:6/408: chown d3/d25/d26/f2e 39323 1 2024-09-17T01:07:13.999 INFO:tasks.workunit.client.0.smithi103.stdout:0/363: creat dd/f7a x:0 0 0 2024-09-17T01:07:14.001 INFO:tasks.workunit.client.0.smithi103.stdout:6/409: unlink d3/d16/d21/d56/f61 0 2024-09-17T01:07:14.001 INFO:tasks.workunit.client.0.smithi103.stdout:5/304: dwrite d6/d2c/d38/d4c/f5b [0,4194304] 0 2024-09-17T01:07:14.001 INFO:tasks.workunit.client.0.smithi103.stdout:2/379: readlink d6/d5f/d26/d34/l6d 0 2024-09-17T01:07:14.003 INFO:tasks.workunit.client.0.smithi103.stdout:8/392: write d0/d6/dc/d30/d25/d64/d34/f5a [521009,77161] 0 2024-09-17T01:07:14.007 INFO:tasks.workunit.client.0.smithi103.stdout:9/460: sync 2024-09-17T01:07:14.007 INFO:tasks.workunit.client.0.smithi103.stdout:3/508: sync 2024-09-17T01:07:14.007 INFO:tasks.workunit.client.0.smithi103.stdout:4/481: sync 2024-09-17T01:07:14.007 INFO:tasks.workunit.client.0.smithi103.stdout:1/497: sync 2024-09-17T01:07:14.007 INFO:tasks.workunit.client.0.smithi103.stdout:7/419: dwrite d4/f7 [0,4194304] 0 2024-09-17T01:07:14.009 INFO:tasks.workunit.client.0.smithi103.stdout:2/380: write d6/d5f/d26/d66/df/f43 [678234,84506] 0 2024-09-17T01:07:14.010 INFO:tasks.workunit.client.0.smithi103.stdout:6/410: fdatasync d3/d16/d33/d3e/f51 0 2024-09-17T01:07:14.013 INFO:tasks.workunit.client.0.smithi103.stdout:3/509: chown d3/d16/d1b/f45 7 1 2024-09-17T01:07:14.013 INFO:tasks.workunit.client.0.smithi103.stdout:4/482: write d9/d16/d45/d5e/f7a [572977,24512] 0 2024-09-17T01:07:14.013 INFO:tasks.workunit.client.0.smithi103.stdout:8/393: unlink d0/d6/f68 0 2024-09-17T01:07:14.014 INFO:tasks.workunit.client.0.smithi103.stdout:9/461: write d7/d43/d88/d11/f12 [689063,22008] 0 2024-09-17T01:07:14.014 INFO:tasks.workunit.client.0.smithi103.stdout:0/364: dread dd/df/d38/f63 [0,4194304] 0 2024-09-17T01:07:14.019 INFO:tasks.workunit.client.0.smithi103.stdout:4/483: chown d9/dc/df/f72 0 1 2024-09-17T01:07:14.020 INFO:tasks.workunit.client.0.smithi103.stdout:9/462: stat d7/d43/d88/d11/d5c/d5e/d6c/l8a 0 2024-09-17T01:07:14.021 INFO:tasks.workunit.client.0.smithi103.stdout:2/381: mknod d6/d5f/d26/d66/df/d68/c7a 0 2024-09-17T01:07:14.022 INFO:tasks.workunit.client.0.smithi103.stdout:3/510: creat d3/d16/d1b/d3c/d65/d7e/fb7 x:0 0 0 2024-09-17T01:07:14.023 INFO:tasks.workunit.client.0.smithi103.stdout:5/305: dread d6/db/f27 [0,4194304] 0 2024-09-17T01:07:14.024 INFO:tasks.workunit.client.0.smithi103.stdout:6/411: symlink d3/d25/d26/d87/l90 0 2024-09-17T01:07:14.027 INFO:tasks.workunit.client.0.smithi103.stdout:2/382: write d6/d5f/d26/f5a [85133,10463] 0 2024-09-17T01:07:14.030 INFO:tasks.workunit.client.0.smithi103.stdout:0/365: creat dd/df/d68/d6c/f7b x:0 0 0 2024-09-17T01:07:14.030 INFO:tasks.workunit.client.0.smithi103.stdout:8/394: dwrite d0/d6/dc/d30/d25/d64/d34/f5a [0,4194304] 0 2024-09-17T01:07:14.031 INFO:tasks.workunit.client.0.smithi103.stdout:3/511: creat d3/d16/d1b/d36/fb8 x:0 0 0 2024-09-17T01:07:14.038 INFO:tasks.workunit.client.0.smithi103.stdout:6/412: symlink d3/d16/d33/d57/d63/l91 0 2024-09-17T01:07:14.039 INFO:tasks.workunit.client.0.smithi103.stdout:3/512: creat d3/d16/d1b/d2c/d5c/fb9 x:0 0 0 2024-09-17T01:07:14.040 INFO:tasks.workunit.client.0.smithi103.stdout:5/306: dwrite d6/d2c/d38/d4c/d50/f4f [0,4194304] 0 2024-09-17T01:07:14.041 INFO:tasks.workunit.client.0.smithi103.stdout:4/484: getdents d9/d16/d23/d32/d64 0 2024-09-17T01:07:14.042 INFO:tasks.workunit.client.0.smithi103.stdout:2/383: mknod d6/d5f/d26/d6e/c7b 0 2024-09-17T01:07:14.043 INFO:tasks.workunit.client.0.smithi103.stdout:8/395: fdatasync d0/d6/dc/d30/d25/d64/f4d 0 2024-09-17T01:07:14.043 INFO:tasks.workunit.client.0.smithi103.stdout:9/463: getdents d7 0 2024-09-17T01:07:14.044 INFO:tasks.workunit.client.0.smithi103.stdout:5/307: dread d6/d2c/f5f [0,4194304] 0 2024-09-17T01:07:14.046 INFO:tasks.workunit.client.0.smithi103.stdout:6/413: chown d3/d25/d26/l5f 229412 1 2024-09-17T01:07:14.048 INFO:tasks.workunit.client.0.smithi103.stdout:4/485: rename d9/dc/f67 to d9/dc/f8e 0 2024-09-17T01:07:14.050 INFO:tasks.workunit.client.0.smithi103.stdout:0/366: link dd/d1c/c5a dd/d4f/d64/c7c 0 2024-09-17T01:07:14.052 INFO:tasks.workunit.client.0.smithi103.stdout:4/486: write d9/d2d/d55/f60 [96172,26626] 0 2024-09-17T01:07:14.055 INFO:tasks.workunit.client.0.smithi103.stdout:2/384: dwrite d6/d5f/f20 [8388608,4194304] 0 2024-09-17T01:07:14.058 INFO:tasks.workunit.client.0.smithi103.stdout:3/513: rename d3/f1d to d3/d16/d1b/d3c/d65/d7e/fba 0 2024-09-17T01:07:14.059 INFO:tasks.workunit.client.0.smithi103.stdout:5/308: unlink d6/d2c/d38/d4c/d50/f31 0 2024-09-17T01:07:14.061 INFO:tasks.workunit.client.0.smithi103.stdout:8/396: creat d0/d6/dc/d30/d25/d64/f75 x:0 0 0 2024-09-17T01:07:14.062 INFO:tasks.workunit.client.0.smithi103.stdout:2/385: dread f5 [0,4194304] 0 2024-09-17T01:07:14.066 INFO:tasks.workunit.client.0.smithi103.stdout:8/397: readlink d0/d6/dc/d30/d25/l6f 0 2024-09-17T01:07:14.067 INFO:tasks.workunit.client.0.smithi103.stdout:4/487: dwrite d9/d16/d23/d32/d61/f87 [0,4194304] 0 2024-09-17T01:07:14.069 INFO:tasks.workunit.client.0.smithi103.stdout:6/414: rename d3/cb to d3/d25/d74/c92 0 2024-09-17T01:07:14.070 INFO:tasks.workunit.client.0.smithi103.stdout:5/309: creat d6/d2c/d38/d4c/d54/f77 x:0 0 0 2024-09-17T01:07:14.075 INFO:tasks.workunit.client.0.smithi103.stdout:0/367: rename dd/c17 to dd/d1c/d50/c7d 0 2024-09-17T01:07:14.076 INFO:tasks.workunit.client.0.smithi103.stdout:0/368: readlink dd/d1c/l2d 0 2024-09-17T01:07:14.077 INFO:tasks.workunit.client.0.smithi103.stdout:4/488: symlink d9/d16/l8f 0 2024-09-17T01:07:14.080 INFO:tasks.workunit.client.0.smithi103.stdout:8/398: rename d0/d6/dc/f2c to d0/d6/dc/d3d/d6d/f76 0 2024-09-17T01:07:14.081 INFO:tasks.workunit.client.0.smithi103.stdout:4/489: dread d9/dc/df/f72 [0,4194304] 0 2024-09-17T01:07:14.085 INFO:tasks.workunit.client.0.smithi103.stdout:4/490: chown d9/d16/d23/d2a 12 1 2024-09-17T01:07:14.085 INFO:tasks.workunit.client.0.smithi103.stdout:6/415: rename d3/d16/d21/d50/c5b to d3/d16/d33/d3e/d58/c93 0 2024-09-17T01:07:14.085 INFO:tasks.workunit.client.0.smithi103.stdout:6/416: write d3/d16/d33/d57/f7a [683483,125733] 0 2024-09-17T01:07:14.085 INFO:tasks.workunit.client.0.smithi103.stdout:6/417: chown d3/d16/d33/c3d 69704534 1 2024-09-17T01:07:14.086 INFO:tasks.workunit.client.0.smithi103.stdout:5/310: creat d6/db/f78 x:0 0 0 2024-09-17T01:07:14.091 INFO:tasks.workunit.client.0.smithi103.stdout:0/369: creat dd/f7e x:0 0 0 2024-09-17T01:07:14.096 INFO:tasks.workunit.client.0.smithi103.stdout:4/491: mkdir d9/d16/d23/d90 0 2024-09-17T01:07:14.097 INFO:tasks.workunit.client.0.smithi103.stdout:4/492: stat d9/dc/df/c53 0 2024-09-17T01:07:14.098 INFO:tasks.workunit.client.0.smithi103.stdout:8/399: creat d0/d6/f77 x:0 0 0 2024-09-17T01:07:14.101 INFO:tasks.workunit.client.0.smithi103.stdout:6/418: rename d3/d16/d33/d57/d63/d60/l86 to d3/d17/d2f/l94 0 2024-09-17T01:07:14.102 INFO:tasks.workunit.client.0.smithi103.stdout:2/386: write d6/d5f/d26/d66/df/f6b [1056323,23864] 0 2024-09-17T01:07:14.105 INFO:tasks.workunit.client.0.smithi103.stdout:3/514: dwrite d3/f59 [0,4194304] 0 2024-09-17T01:07:14.105 INFO:tasks.workunit.client.0.smithi103.stdout:2/387: dread d6/f44 [0,4194304] 0 2024-09-17T01:07:14.107 INFO:tasks.workunit.client.0.smithi103.stdout:2/388: stat d6/d5f/d26/d66/l79 0 2024-09-17T01:07:14.108 INFO:tasks.workunit.client.0.smithi103.stdout:0/370: mknod dd/df/c7f 0 2024-09-17T01:07:14.113 INFO:tasks.workunit.client.0.smithi103.stdout:5/311: write d6/d11/f2b [680816,72976] 0 2024-09-17T01:07:14.115 INFO:tasks.workunit.client.0.smithi103.stdout:3/515: symlink d3/d16/d1b/d3c/d65/d7e/lbb 0 2024-09-17T01:07:14.115 INFO:tasks.workunit.client.0.smithi103.stdout:3/516: dread - d3/f7a zero size 2024-09-17T01:07:14.116 INFO:tasks.workunit.client.0.smithi103.stdout:2/389: chown d6/c77 29 1 2024-09-17T01:07:14.116 INFO:tasks.workunit.client.0.smithi103.stdout:3/517: readlink d3/d16/d1b/d3c/l62 0 2024-09-17T01:07:14.117 INFO:tasks.workunit.client.0.smithi103.stdout:3/518: chown d3/d16/d1b/l38 84298209 1 2024-09-17T01:07:14.117 INFO:tasks.workunit.client.0.smithi103.stdout:2/390: write d6/d5f/d26/d34/d4e/f53 [5005583,33976] 0 2024-09-17T01:07:14.118 INFO:tasks.workunit.client.0.smithi103.stdout:3/519: read - d3/d16/d1b/f80 zero size 2024-09-17T01:07:14.120 INFO:tasks.workunit.client.0.smithi103.stdout:8/400: mknod d0/d6/dc/d30/d2d/c78 0 2024-09-17T01:07:14.121 INFO:tasks.workunit.client.0.smithi103.stdout:0/371: rmdir dd/df/d68 39 2024-09-17T01:07:14.122 INFO:tasks.workunit.client.0.smithi103.stdout:0/372: chown dd/df/d38/d55 8375882 1 2024-09-17T01:07:14.123 INFO:tasks.workunit.client.0.smithi103.stdout:4/493: getdents d9/d16/d23/d32/d64 0 2024-09-17T01:07:14.128 INFO:tasks.workunit.client.0.smithi103.stdout:0/373: dwrite dd/df/f13 [0,4194304] 0 2024-09-17T01:07:14.129 INFO:tasks.workunit.client.0.smithi103.stdout:3/520: rmdir d3/d16/d1b/d3c/d65/d7e 39 2024-09-17T01:07:14.135 INFO:tasks.workunit.client.0.smithi103.stdout:8/401: mknod d0/d6/dc/d30/d25/c79 0 2024-09-17T01:07:14.138 INFO:tasks.workunit.client.0.smithi103.stdout:6/419: getdents d3/d16/d33/d57 0 2024-09-17T01:07:14.139 INFO:tasks.workunit.client.0.smithi103.stdout:5/312: write d6/d2c/d38/d4c/d50/f72 [4119657,23970] 0 2024-09-17T01:07:14.139 INFO:tasks.workunit.client.0.smithi103.stdout:3/521: dwrite d3/d16/d1b/f80 [0,4194304] 0 2024-09-17T01:07:14.139 INFO:tasks.workunit.client.0.smithi103.stdout:0/374: creat dd/df/d38/f80 x:0 0 0 2024-09-17T01:07:14.144 INFO:tasks.workunit.client.0.smithi103.stdout:8/402: dread d0/d6/f6b [0,4194304] 0 2024-09-17T01:07:14.144 INFO:tasks.workunit.client.0.smithi103.stdout:6/420: write d3/d16/d33/f8d [717175,75129] 0 2024-09-17T01:07:14.147 INFO:tasks.workunit.client.0.smithi103.stdout:5/313: fsync d6/d2c/f5f 0 2024-09-17T01:07:14.154 INFO:tasks.workunit.client.0.smithi103.stdout:4/494: dwrite d9/d16/d36/d42/f56 [0,4194304] 0 2024-09-17T01:07:14.155 INFO:tasks.workunit.client.0.smithi103.stdout:2/391: dread d6/d5f/d26/d66/df/f59 [0,4194304] 0 2024-09-17T01:07:14.155 INFO:tasks.workunit.client.0.smithi103.stdout:4/495: stat d9/dc/df/f20 0 2024-09-17T01:07:14.156 INFO:tasks.workunit.client.0.smithi103.stdout:8/403: unlink d0/d6/f6b 0 2024-09-17T01:07:14.165 INFO:tasks.workunit.client.0.smithi103.stdout:4/496: unlink d9/d2d/c54 0 2024-09-17T01:07:14.166 INFO:tasks.workunit.client.0.smithi103.stdout:2/392: mkdir d6/d5f/d42/d7c 0 2024-09-17T01:07:14.166 INFO:tasks.workunit.client.0.smithi103.stdout:4/497: write d9/d16/d38/d3f/f7c [4715827,123122] 0 2024-09-17T01:07:14.167 INFO:tasks.workunit.client.0.smithi103.stdout:2/393: fdatasync d6/d5f/d26/d34/d4e/f71 0 2024-09-17T01:07:14.171 INFO:tasks.workunit.client.0.smithi103.stdout:2/394: mknod d6/d5f/d26/d66/df/c7d 0 2024-09-17T01:07:14.171 INFO:tasks.workunit.client.0.smithi103.stdout:0/375: write dd/df/f25 [1107172,2034] 0 2024-09-17T01:07:14.172 INFO:tasks.workunit.client.0.smithi103.stdout:6/421: dread d3/d17/d2f/f79 [0,4194304] 0 2024-09-17T01:07:14.175 INFO:tasks.workunit.client.0.smithi103.stdout:0/376: dwrite f3 [0,4194304] 0 2024-09-17T01:07:14.180 INFO:tasks.workunit.client.0.smithi103.stdout:3/522: dread d3/d16/d1b/d3c/f40 [0,4194304] 0 2024-09-17T01:07:14.262 INFO:tasks.workunit.client.0.smithi103.stdout:4/498: mkdir d9/d16/d23/d52/d91 0 2024-09-17T01:07:14.262 INFO:tasks.workunit.client.0.smithi103.stdout:4/499: dread - d9/d16/d44/f68 zero size 2024-09-17T01:07:14.263 INFO:tasks.workunit.client.0.smithi103.stdout:4/500: write d9/d16/d38/d3f/f6f [273324,108318] 0 2024-09-17T01:07:14.264 INFO:tasks.workunit.client.0.smithi103.stdout:2/395: unlink d6/da/d28/f61 0 2024-09-17T01:07:14.268 INFO:tasks.workunit.client.0.smithi103.stdout:6/422: rmdir d3/d16/d21 39 2024-09-17T01:07:14.269 INFO:tasks.workunit.client.0.smithi103.stdout:8/404: write d0/d6/dc/d3d/f40 [1608440,38524] 0 2024-09-17T01:07:14.271 INFO:tasks.workunit.client.0.smithi103.stdout:0/377: creat dd/d4f/f81 x:0 0 0 2024-09-17T01:07:14.272 INFO:tasks.workunit.client.0.smithi103.stdout:3/523: write d3/d16/d1b/d3c/f40 [1529033,75141] 0 2024-09-17T01:07:14.273 INFO:tasks.workunit.client.0.smithi103.stdout:5/314: link d6/d28/l4a d6/db/l79 0 2024-09-17T01:07:14.276 INFO:tasks.workunit.client.0.smithi103.stdout:2/396: mkdir d6/d5f/d26/d66/df/d68/d7e 0 2024-09-17T01:07:14.279 INFO:tasks.workunit.client.0.smithi103.stdout:6/423: symlink d3/d16/d33/l95 0 2024-09-17T01:07:14.281 INFO:tasks.workunit.client.0.smithi103.stdout:3/524: symlink d3/d16/d1b/d2c/d34/d8c/lbc 0 2024-09-17T01:07:14.284 INFO:tasks.workunit.client.0.smithi103.stdout:2/397: unlink d6/d5f/d26/d34/d4e/c69 0 2024-09-17T01:07:14.286 INFO:tasks.workunit.client.0.smithi103.stdout:0/378: mknod dd/df/c82 0 2024-09-17T01:07:14.288 INFO:tasks.workunit.client.0.smithi103.stdout:0/379: write dd/df/d38/f80 [475968,12761] 0 2024-09-17T01:07:14.290 INFO:tasks.workunit.client.0.smithi103.stdout:8/405: creat d0/d6/dc/d30/f7a x:0 0 0 2024-09-17T01:07:14.294 INFO:tasks.workunit.client.0.smithi103.stdout:4/501: link d9/d16/d38/d3f/f83 d9/d16/d23/d32/d4c/f92 0 2024-09-17T01:07:14.299 INFO:tasks.workunit.client.0.smithi103.stdout:0/380: dread dd/d1c/f1f [0,4194304] 0 2024-09-17T01:07:14.299 INFO:tasks.workunit.client.0.smithi103.stdout:8/406: symlink d0/d6/dc/d30/d25/d64/d59/l7b 0 2024-09-17T01:07:14.302 INFO:tasks.workunit.client.0.smithi103.stdout:5/315: truncate d6/d11/f1d 2345038 0 2024-09-17T01:07:14.302 INFO:tasks.workunit.client.0.smithi103.stdout:2/398: link d6/d5f/d26/d66/c1d d6/d5f/d26/d6e/c7f 0 2024-09-17T01:07:14.303 INFO:tasks.workunit.client.0.smithi103.stdout:3/525: truncate d3/d16/d1b/d2c/f42 3293990 0 2024-09-17T01:07:14.303 INFO:tasks.workunit.client.0.smithi103.stdout:6/424: link d3/l68 d3/d25/d26/d3a/l96 0 2024-09-17T01:07:14.304 INFO:tasks.workunit.client.0.smithi103.stdout:3/526: chown d3/d16/d1b/d2c/faf 47236 1 2024-09-17T01:07:14.305 INFO:tasks.workunit.client.0.smithi103.stdout:6/425: dread - d3/d16/d33/d3e/f51 zero size 2024-09-17T01:07:14.307 INFO:tasks.workunit.client.0.smithi103.stdout:4/502: dread - d9/d16/d23/d32/d4c/f92 zero size 2024-09-17T01:07:14.311 INFO:tasks.workunit.client.0.smithi103.stdout:3/527: dwrite d3/f7a [0,4194304] 0 2024-09-17T01:07:14.313 INFO:tasks.workunit.client.0.smithi103.stdout:8/407: creat d0/d6/dc/d30/d25/d64/d34/d6e/f7c x:0 0 0 2024-09-17T01:07:14.316 INFO:tasks.workunit.client.0.smithi103.stdout:5/316: mkdir d6/d11/d7a 0 2024-09-17T01:07:14.318 INFO:tasks.workunit.client.0.smithi103.stdout:5/317: stat d6/d2c/d32/d47 0 2024-09-17T01:07:14.321 INFO:tasks.workunit.client.0.smithi103.stdout:6/426: rmdir d3/d17 39 2024-09-17T01:07:14.326 INFO:tasks.workunit.client.0.smithi103.stdout:5/318: dwrite d6/d2c/f73 [0,4194304] 0 2024-09-17T01:07:14.327 INFO:tasks.workunit.client.0.smithi103.stdout:3/528: dread d3/d44/f71 [0,4194304] 0 2024-09-17T01:07:14.328 INFO:tasks.workunit.client.0.smithi103.stdout:5/319: fsync d6/d2c/f52 0 2024-09-17T01:07:14.330 INFO:tasks.workunit.client.0.smithi103.stdout:5/320: write d6/f3e [3057993,38735] 0 2024-09-17T01:07:14.336 INFO:tasks.workunit.client.0.smithi103.stdout:4/503: creat d9/d16/d23/d2a/f93 x:0 0 0 2024-09-17T01:07:14.342 INFO:tasks.workunit.client.0.smithi103.stdout:4/504: dwrite d9/d10/f1f [0,4194304] 0 2024-09-17T01:07:14.343 INFO:tasks.workunit.client.0.smithi103.stdout:4/505: dread - d9/d16/d23/f6d zero size 2024-09-17T01:07:14.344 INFO:tasks.workunit.client.0.smithi103.stdout:0/381: truncate dd/f3b 3625158 0 2024-09-17T01:07:14.346 INFO:tasks.workunit.client.0.smithi103.stdout:3/529: symlink d3/d16/d1b/d3c/d65/d7c/lbd 0 2024-09-17T01:07:14.357 INFO:tasks.workunit.client.0.smithi103.stdout:8/408: mkdir d0/d6/dc/d30/d25/d7d 0 2024-09-17T01:07:14.358 INFO:tasks.workunit.client.0.smithi103.stdout:8/409: stat d0/d6/dc/d30/d25/d64/d34/d6e/d72 0 2024-09-17T01:07:14.361 INFO:tasks.workunit.client.0.smithi103.stdout:2/399: write d6/da/f2f [3125318,59682] 0 2024-09-17T01:07:14.363 INFO:tasks.workunit.client.0.smithi103.stdout:4/506: mknod d9/d2d/c94 0 2024-09-17T01:07:14.365 INFO:tasks.workunit.client.0.smithi103.stdout:8/410: creat d0/d6/dc/d3d/f7e x:0 0 0 2024-09-17T01:07:14.365 INFO:tasks.workunit.client.0.smithi103.stdout:4/507: truncate d9/d16/d36/d42/f7b 416297 0 2024-09-17T01:07:14.366 INFO:tasks.workunit.client.0.smithi103.stdout:0/382: mkdir dd/df/d68/d6c/d83 0 2024-09-17T01:07:14.368 INFO:tasks.workunit.client.0.smithi103.stdout:8/411: write d0/d6/dc/d30/d25/d64/f75 [32877,114072] 0 2024-09-17T01:07:14.368 INFO:tasks.workunit.client.0.smithi103.stdout:5/321: rename d6/d2c/l70 to d6/d2c/d38/l7b 0 2024-09-17T01:07:14.370 INFO:tasks.workunit.client.0.smithi103.stdout:2/400: write d6/d5f/f3c [1434869,18396] 0 2024-09-17T01:07:14.371 INFO:tasks.workunit.client.0.smithi103.stdout:6/427: getdents d3/d16/d33/d57/d63 0 2024-09-17T01:07:14.372 INFO:tasks.workunit.client.0.smithi103.stdout:4/508: creat d9/d16/d23/d32/d61/f95 x:0 0 0 2024-09-17T01:07:14.373 INFO:tasks.workunit.client.0.smithi103.stdout:0/383: mkdir dd/df/d38/d62/d84 0 2024-09-17T01:07:14.377 INFO:tasks.workunit.client.0.smithi103.stdout:3/530: rename d3/d16/d1b/d2c to d3/d16/d1b/d3c/d65/d75/dbe 0 2024-09-17T01:07:14.378 INFO:tasks.workunit.client.0.smithi103.stdout:5/322: symlink d6/d2c/d38/d4c/l7c 0 2024-09-17T01:07:14.378 INFO:tasks.workunit.client.0.smithi103.stdout:2/401: dwrite d6/d5f/d26/f63 [0,4194304] 0 2024-09-17T01:07:14.381 INFO:tasks.workunit.client.0.smithi103.stdout:2/402: chown d6/d5f/d26/d66/df/f36 135973 1 2024-09-17T01:07:14.387 INFO:tasks.workunit.client.0.smithi103.stdout:5/323: dread d6/d2c/d32/f60 [0,4194304] 0 2024-09-17T01:07:14.387 INFO:tasks.workunit.client.0.smithi103.stdout:0/384: creat dd/df/d38/d62/f85 x:0 0 0 2024-09-17T01:07:14.388 INFO:tasks.workunit.client.0.smithi103.stdout:5/324: chown d6/d2c/d32/f60 1723 1 2024-09-17T01:07:14.390 INFO:tasks.workunit.client.0.smithi103.stdout:4/509: rename d9/d16/d44/c5d to d9/d16/d23/d32/d61/c96 0 2024-09-17T01:07:14.391 INFO:tasks.workunit.client.0.smithi103.stdout:3/531: mkdir d3/d16/d1b/d3c/d65/d83/dbf 0 2024-09-17T01:07:14.395 INFO:tasks.workunit.client.0.smithi103.stdout:8/412: creat d0/d6/dc/d30/f7f x:0 0 0 2024-09-17T01:07:14.397 INFO:tasks.workunit.client.0.smithi103.stdout:2/403: rmdir d6/d5f/d26/d34/d4e/d60/d75 39 2024-09-17T01:07:14.398 INFO:tasks.workunit.client.0.smithi103.stdout:0/385: dread - dd/d4f/f2e zero size 2024-09-17T01:07:14.402 INFO:tasks.workunit.client.0.smithi103.stdout:3/532: rmdir d3/d16/d1b/d3c/d65/d75/dbe/d5c 39 2024-09-17T01:07:14.407 INFO:tasks.workunit.client.0.smithi103.stdout:2/404: mkdir d6/d5f/d26/d34/d80 0 2024-09-17T01:07:14.407 INFO:tasks.workunit.client.0.smithi103.stdout:3/533: dread d3/d16/d1b/d36/f67 [0,4194304] 0 2024-09-17T01:07:14.409 INFO:tasks.workunit.client.0.smithi103.stdout:3/534: truncate d3/d44/fb2 470625 0 2024-09-17T01:07:14.420 INFO:tasks.workunit.client.0.smithi103.stdout:3/535: rename d3/d16/f1a to d3/d16/d90/fc0 0 2024-09-17T01:07:14.421 INFO:tasks.workunit.client.0.smithi103.stdout:2/405: dread d6/d5f/f3c [0,4194304] 0 2024-09-17T01:07:14.422 INFO:tasks.workunit.client.0.smithi103.stdout:8/413: dread d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:14.426 INFO:tasks.workunit.client.0.smithi103.stdout:5/325: getdents d6/db/d66 0 2024-09-17T01:07:14.427 INFO:tasks.workunit.client.0.smithi103.stdout:3/536: write d3/d16/d1b/f74 [500550,57312] 0 2024-09-17T01:07:14.428 INFO:tasks.workunit.client.0.smithi103.stdout:6/428: write d3/d17/f30 [444798,12310] 0 2024-09-17T01:07:14.428 INFO:tasks.workunit.client.0.smithi103.stdout:7/420: sync 2024-09-17T01:07:14.428 INFO:tasks.workunit.client.0.smithi103.stdout:9/464: sync 2024-09-17T01:07:14.428 INFO:tasks.workunit.client.0.smithi103.stdout:1/498: sync 2024-09-17T01:07:14.430 INFO:tasks.workunit.client.0.smithi103.stdout:1/499: readlink d2/de/l80 0 2024-09-17T01:07:14.430 INFO:tasks.workunit.client.0.smithi103.stdout:8/414: mkdir d0/d80 0 2024-09-17T01:07:14.431 INFO:tasks.workunit.client.0.smithi103.stdout:6/429: write d3/d16/d33/f8d [1578451,99091] 0 2024-09-17T01:07:14.431 INFO:tasks.workunit.client.0.smithi103.stdout:1/500: fsync d2/d7/f37 0 2024-09-17T01:07:14.434 INFO:tasks.workunit.client.0.smithi103.stdout:9/465: write d7/d43/d88/f9b [676084,13873] 0 2024-09-17T01:07:14.434 INFO:tasks.workunit.client.0.smithi103.stdout:6/430: fdatasync d3/d17/f7f 0 2024-09-17T01:07:14.437 INFO:tasks.workunit.client.0.smithi103.stdout:8/415: read d0/d6/f4f [32129,23754] 0 2024-09-17T01:07:14.437 INFO:tasks.workunit.client.0.smithi103.stdout:5/326: dread d6/db/fd [0,4194304] 0 2024-09-17T01:07:14.439 INFO:tasks.workunit.client.0.smithi103.stdout:5/327: readlink d6/db/l79 0 2024-09-17T01:07:14.439 INFO:tasks.workunit.client.0.smithi103.stdout:7/421: mknod d4/d11/d2b/d36/d3a/d51/d5e/c91 0 2024-09-17T01:07:14.440 INFO:tasks.workunit.client.0.smithi103.stdout:8/416: readlink d0/d6/dc/l45 0 2024-09-17T01:07:14.441 INFO:tasks.workunit.client.0.smithi103.stdout:0/386: write dd/d1c/d50/f52 [110473,14953] 0 2024-09-17T01:07:14.441 INFO:tasks.workunit.client.0.smithi103.stdout:6/431: write d3/d25/d74/f76 [41560,35236] 0 2024-09-17T01:07:14.443 INFO:tasks.workunit.client.0.smithi103.stdout:4/510: truncate d9/d16/d38/d3f/f6f 3269268 0 2024-09-17T01:07:14.445 INFO:tasks.workunit.client.0.smithi103.stdout:9/466: mknod d7/d43/d88/d11/d5c/c9f 0 2024-09-17T01:07:14.445 INFO:tasks.workunit.client.0.smithi103.stdout:3/537: dwrite d3/d16/d1b/d3c/d65/f8f [0,4194304] 0 2024-09-17T01:07:14.447 INFO:tasks.workunit.client.0.smithi103.stdout:5/328: mkdir d6/d7d 0 2024-09-17T01:07:14.448 INFO:tasks.workunit.client.0.smithi103.stdout:9/467: write d7/d2d/d59/f66 [770652,52259] 0 2024-09-17T01:07:14.454 INFO:tasks.workunit.client.0.smithi103.stdout:8/417: chown d0/d6/dc/d30/d2d/f3c 42860 1 2024-09-17T01:07:14.454 INFO:tasks.workunit.client.0.smithi103.stdout:1/501: dwrite d2/d1c/d20/f64 [0,4194304] 0 2024-09-17T01:07:14.458 INFO:tasks.workunit.client.0.smithi103.stdout:0/387: symlink dd/df/d38/l86 0 2024-09-17T01:07:14.459 INFO:tasks.workunit.client.0.smithi103.stdout:1/502: readlink d2/d1c/d20/d33/l42 0 2024-09-17T01:07:14.461 INFO:tasks.workunit.client.0.smithi103.stdout:4/511: dwrite d9/d16/d45/d5e/f71 [0,4194304] 0 2024-09-17T01:07:14.464 INFO:tasks.workunit.client.0.smithi103.stdout:7/422: mkdir d4/d11/d2b/d8d/d92 0 2024-09-17T01:07:14.467 INFO:tasks.workunit.client.0.smithi103.stdout:5/329: write d6/d2c/d32/f60 [2316668,6829] 0 2024-09-17T01:07:14.469 INFO:tasks.workunit.client.0.smithi103.stdout:6/432: creat d3/d16/d21/d56/f97 x:0 0 0 2024-09-17T01:07:14.471 INFO:tasks.workunit.client.0.smithi103.stdout:8/418: rmdir d0/d6/dc/d30/d25 39 2024-09-17T01:07:14.473 INFO:tasks.workunit.client.0.smithi103.stdout:0/388: creat dd/df/d68/f87 x:0 0 0 2024-09-17T01:07:14.474 INFO:tasks.workunit.client.0.smithi103.stdout:2/406: dwrite d6/f44 [0,4194304] 0 2024-09-17T01:07:14.479 INFO:tasks.workunit.client.0.smithi103.stdout:3/538: creat d3/d44/fc1 x:0 0 0 2024-09-17T01:07:14.482 INFO:tasks.workunit.client.0.smithi103.stdout:9/468: dwrite d7/d43/d88/d11/d21/f26 [0,4194304] 0 2024-09-17T01:07:14.485 INFO:tasks.workunit.client.0.smithi103.stdout:9/469: write d7/d43/f52 [1455033,96190] 0 2024-09-17T01:07:14.490 INFO:tasks.workunit.client.0.smithi103.stdout:0/389: mknod dd/df/d68/c88 0 2024-09-17T01:07:14.492 INFO:tasks.workunit.client.0.smithi103.stdout:2/407: chown d6/d5f/d26/d34/d4e/d60/d75/l6c 0 1 2024-09-17T01:07:14.495 INFO:tasks.workunit.client.0.smithi103.stdout:7/423: link d4/d10/f35 d4/d11/d2b/d8d/d92/f93 0 2024-09-17T01:07:14.497 INFO:tasks.workunit.client.0.smithi103.stdout:3/539: read - d3/d16/d1b/d3c/d65/d75/dbe/d5c/f96 zero size 2024-09-17T01:07:14.498 INFO:tasks.workunit.client.0.smithi103.stdout:1/503: creat d2/fa4 x:0 0 0 2024-09-17T01:07:14.498 INFO:tasks.workunit.client.0.smithi103.stdout:6/433: dread d3/f18 [4194304,4194304] 0 2024-09-17T01:07:14.501 INFO:tasks.workunit.client.0.smithi103.stdout:8/419: symlink d0/d6/dc/d30/d25/d64/d34/d6e/l81 0 2024-09-17T01:07:14.504 INFO:tasks.workunit.client.0.smithi103.stdout:8/420: truncate d0/d6/dc/d30/d2d/f60 808976 0 2024-09-17T01:07:14.504 INFO:tasks.workunit.client.0.smithi103.stdout:9/470: read d7/d43/d88/f23 [2441719,66448] 0 2024-09-17T01:07:14.505 INFO:tasks.workunit.client.0.smithi103.stdout:9/471: stat d7/d43/d88/d11/f12 0 2024-09-17T01:07:14.505 INFO:tasks.workunit.client.0.smithi103.stdout:4/512: getdents d9/dc/df 0 2024-09-17T01:07:14.511 INFO:tasks.workunit.client.0.smithi103.stdout:5/330: link d6/d2c/d32/d55/c56 d6/d28/c7e 0 2024-09-17T01:07:14.511 INFO:tasks.workunit.client.0.smithi103.stdout:5/331: dread - d6/d2c/d38/f6c zero size 2024-09-17T01:07:14.512 INFO:tasks.workunit.client.0.smithi103.stdout:8/421: dread - d0/f44 zero size 2024-09-17T01:07:14.513 INFO:tasks.workunit.client.0.smithi103.stdout:8/422: read - d0/d6/dc/d30/d25/f74 zero size 2024-09-17T01:07:14.518 INFO:tasks.workunit.client.0.smithi103.stdout:1/504: mknod d2/d1c/d28/d52/ca5 0 2024-09-17T01:07:14.519 INFO:tasks.workunit.client.0.smithi103.stdout:1/505: write d2/d1c/d28/d4b/d67/f6a [1294756,104263] 0 2024-09-17T01:07:14.520 INFO:tasks.workunit.client.0.smithi103.stdout:3/540: link d3/d16/d1b/f74 d3/d16/d1b/d36/fc2 0 2024-09-17T01:07:14.521 INFO:tasks.workunit.client.0.smithi103.stdout:5/332: symlink d6/d2c/d38/d4c/l7f 0 2024-09-17T01:07:14.521 INFO:tasks.workunit.client.0.smithi103.stdout:1/506: fdatasync d2/d1c/d28/d4b/d67/d9e/fa1 0 2024-09-17T01:07:14.523 INFO:tasks.workunit.client.0.smithi103.stdout:2/408: creat d6/d5f/d26/d34/d4e/d60/f81 x:0 0 0 2024-09-17T01:07:14.523 INFO:tasks.workunit.client.0.smithi103.stdout:5/333: write d6/d2c/f73 [500124,85787] 0 2024-09-17T01:07:14.524 INFO:tasks.workunit.client.0.smithi103.stdout:2/409: readlink d6/d5f/d26/d66/l3a 0 2024-09-17T01:07:14.525 INFO:tasks.workunit.client.0.smithi103.stdout:1/507: write d2/d1c/d28/d52/d69/f6c [346431,9509] 0 2024-09-17T01:07:14.525 INFO:tasks.workunit.client.0.smithi103.stdout:8/423: creat d0/d6/dc/d30/d25/d64/d59/f82 x:0 0 0 2024-09-17T01:07:14.526 INFO:tasks.workunit.client.0.smithi103.stdout:5/334: truncate d6/d2c/d38/f6c 300717 0 2024-09-17T01:07:14.527 INFO:tasks.workunit.client.0.smithi103.stdout:4/513: fsync d9/dc/df/f20 0 2024-09-17T01:07:14.528 INFO:tasks.workunit.client.0.smithi103.stdout:7/424: creat d4/d10/f94 x:0 0 0 2024-09-17T01:07:14.529 INFO:tasks.workunit.client.0.smithi103.stdout:9/472: creat d7/d43/d88/d11/d20/d4f/d95/d9a/fa0 x:0 0 0 2024-09-17T01:07:14.530 INFO:tasks.workunit.client.0.smithi103.stdout:4/514: dread - d9/d16/d23/d32/d61/f95 zero size 2024-09-17T01:07:14.536 INFO:tasks.workunit.client.0.smithi103.stdout:2/410: dwrite d6/d5f/d26/d66/df/f4c [4194304,4194304] 0 2024-09-17T01:07:14.541 INFO:tasks.workunit.client.0.smithi103.stdout:7/425: dwrite d4/d4a/f78 [0,4194304] 0 2024-09-17T01:07:14.542 INFO:tasks.workunit.client.0.smithi103.stdout:7/426: fsync d4/d11/d34/d3d/f5b 0 2024-09-17T01:07:14.542 INFO:tasks.workunit.client.0.smithi103.stdout:5/335: creat d6/d2c/d32/d55/f80 x:0 0 0 2024-09-17T01:07:14.546 INFO:tasks.workunit.client.0.smithi103.stdout:4/515: fdatasync d9/dc/f8e 0 2024-09-17T01:07:14.546 INFO:tasks.workunit.client.0.smithi103.stdout:9/473: write d7/d43/d88/d11/fb [1792309,1932] 0 2024-09-17T01:07:14.547 INFO:tasks.workunit.client.0.smithi103.stdout:9/474: fdatasync d7/f18 0 2024-09-17T01:07:14.549 INFO:tasks.workunit.client.0.smithi103.stdout:1/508: rename d2/d1c/d54/f35 to d2/d7/d73/d81/fa6 0 2024-09-17T01:07:14.553 INFO:tasks.workunit.client.0.smithi103.stdout:8/424: mkdir d0/d6/dc/d30/d2d/d83 0 2024-09-17T01:07:14.555 INFO:tasks.workunit.client.0.smithi103.stdout:7/427: mkdir d4/d10/d37/d95 0 2024-09-17T01:07:14.556 INFO:tasks.workunit.client.0.smithi103.stdout:5/336: mkdir d6/d11/d81 0 2024-09-17T01:07:14.557 INFO:tasks.workunit.client.0.smithi103.stdout:3/541: creat d3/d16/fc3 x:0 0 0 2024-09-17T01:07:14.559 INFO:tasks.workunit.client.0.smithi103.stdout:5/337: write d6/d28/f6b [1013905,69912] 0 2024-09-17T01:07:14.562 INFO:tasks.workunit.client.0.smithi103.stdout:9/475: rename d7/f2a to d7/d43/d88/d11/d5c/fa1 0 2024-09-17T01:07:14.562 INFO:tasks.workunit.client.0.smithi103.stdout:2/411: dwrite d6/f7 [0,4194304] 0 2024-09-17T01:07:14.563 INFO:tasks.workunit.client.0.smithi103.stdout:5/338: readlink d6/l7 0 2024-09-17T01:07:14.564 INFO:tasks.workunit.client.0.smithi103.stdout:3/542: truncate d3/d16/d1b/d3c/d65/d83/f9d 989456 0 2024-09-17T01:07:14.567 INFO:tasks.workunit.client.0.smithi103.stdout:7/428: unlink d4/d11/f44 0 2024-09-17T01:07:14.569 INFO:tasks.workunit.client.0.smithi103.stdout:1/509: mkdir d2/d16/d51/d65/da7 0 2024-09-17T01:07:14.570 INFO:tasks.workunit.client.0.smithi103.stdout:9/476: symlink d7/d2d/d59/la2 0 2024-09-17T01:07:14.572 INFO:tasks.workunit.client.0.smithi103.stdout:5/339: mkdir d6/d2c/d32/d55/d82 0 2024-09-17T01:07:14.575 INFO:tasks.workunit.client.0.smithi103.stdout:4/516: link d9/d16/d44/f68 d9/d16/d23/f97 0 2024-09-17T01:07:14.576 INFO:tasks.workunit.client.0.smithi103.stdout:4/517: stat d9/d16/d23/f6d 0 2024-09-17T01:07:14.578 INFO:tasks.workunit.client.0.smithi103.stdout:3/543: getdents d3/d16/d1b/d3c/d97 0 2024-09-17T01:07:14.578 INFO:tasks.workunit.client.0.smithi103.stdout:1/510: truncate d2/de/d1f/f85 288862 0 2024-09-17T01:07:14.579 INFO:tasks.workunit.client.0.smithi103.stdout:3/544: dread - d3/d16/d1b/d3c/d65/d83/f99 zero size 2024-09-17T01:07:14.580 INFO:tasks.workunit.client.0.smithi103.stdout:8/425: link d0/d6/dc/d30/l24 d0/d6/dc/d3d/l84 0 2024-09-17T01:07:14.580 INFO:tasks.workunit.client.0.smithi103.stdout:9/477: dread d7/d43/d88/f50 [0,4194304] 0 2024-09-17T01:07:14.583 INFO:tasks.workunit.client.0.smithi103.stdout:2/412: creat d6/da/f82 x:0 0 0 2024-09-17T01:07:14.681 INFO:tasks.workunit.client.0.smithi103.stdout:2/413: dwrite d6/d5f/d26/d34/d4e/f51 [0,4194304] 0 2024-09-17T01:07:14.682 INFO:tasks.workunit.client.0.smithi103.stdout:4/518: creat d9/d16/d23/d32/f98 x:0 0 0 2024-09-17T01:07:14.685 INFO:tasks.workunit.client.0.smithi103.stdout:9/478: symlink d7/la3 0 2024-09-17T01:07:14.686 INFO:tasks.workunit.client.0.smithi103.stdout:7/429: link d4/lc d4/d11/d80/l96 0 2024-09-17T01:07:14.686 INFO:tasks.workunit.client.0.smithi103.stdout:3/545: dread d3/d16/d1b/d3c/d65/d75/dbe/d5c/fa4 [0,4194304] 0 2024-09-17T01:07:14.707 INFO:tasks.workunit.client.0.smithi103.stdout:8/426: symlink d0/d6/dc/d30/d25/d64/d34/d6e/l85 0 2024-09-17T01:07:14.711 INFO:tasks.workunit.client.0.smithi103.stdout:2/414: write d6/d5f/d26/d66/df/f36 [1812634,35510] 0 2024-09-17T01:07:14.716 INFO:tasks.workunit.client.0.smithi103.stdout:5/340: creat d6/d2c/d38/f83 x:0 0 0 2024-09-17T01:07:14.719 INFO:tasks.workunit.client.0.smithi103.stdout:4/519: dwrite d9/d16/d23/f97 [0,4194304] 0 2024-09-17T01:07:14.719 INFO:tasks.workunit.client.0.smithi103.stdout:7/430: unlink d4/d11/d3f/l47 0 2024-09-17T01:07:14.721 INFO:tasks.workunit.client.0.smithi103.stdout:7/431: write d4/d11/f5f [2374398,73272] 0 2024-09-17T01:07:14.725 INFO:tasks.workunit.client.0.smithi103.stdout:4/520: write d9/d16/d23/d2a/f89 [686058,129403] 0 2024-09-17T01:07:14.726 INFO:tasks.workunit.client.0.smithi103.stdout:3/546: rename d3/d16/d1b/d3c/d65/d75/dbe/d5c/f82 to d3/d81/fc4 0 2024-09-17T01:07:14.731 INFO:tasks.workunit.client.0.smithi103.stdout:4/521: dwrite d9/d16/d45/d5e/f71 [0,4194304] 0 2024-09-17T01:07:14.732 INFO:tasks.workunit.client.0.smithi103.stdout:5/341: creat d6/db/d66/f84 x:0 0 0 2024-09-17T01:07:14.733 INFO:tasks.workunit.client.0.smithi103.stdout:5/342: write f0 [1645955,64317] 0 2024-09-17T01:07:14.734 INFO:tasks.workunit.client.0.smithi103.stdout:5/343: chown d6/d2c/f37 20692306 1 2024-09-17T01:07:14.735 INFO:tasks.workunit.client.0.smithi103.stdout:5/344: fdatasync d6/d2c/f73 0 2024-09-17T01:07:14.737 INFO:tasks.workunit.client.0.smithi103.stdout:9/479: truncate d7/d43/d88/d11/d5c/f61 1140502 0 2024-09-17T01:07:14.743 INFO:tasks.workunit.client.0.smithi103.stdout:1/511: dwrite d2/de/f14 [0,4194304] 0 2024-09-17T01:07:14.745 INFO:tasks.workunit.client.0.smithi103.stdout:3/547: mknod d3/d44/d63/cc5 0 2024-09-17T01:07:14.745 INFO:tasks.workunit.client.0.smithi103.stdout:3/548: readlink d3/d81/l8b 0 2024-09-17T01:07:14.746 INFO:tasks.workunit.client.0.smithi103.stdout:8/427: mkdir d0/d6/dc/d30/d86 0 2024-09-17T01:07:14.749 INFO:tasks.workunit.client.0.smithi103.stdout:4/522: fdatasync d9/dc/df/f25 0 2024-09-17T01:07:14.754 INFO:tasks.workunit.client.0.smithi103.stdout:9/480: creat d7/d43/d88/d11/d21/fa4 x:0 0 0 2024-09-17T01:07:14.755 INFO:tasks.workunit.client.0.smithi103.stdout:7/432: symlink d4/d11/d2b/d8d/d92/l97 0 2024-09-17T01:07:14.758 INFO:tasks.workunit.client.0.smithi103.stdout:1/512: chown d2/de/l9c 1 1 2024-09-17T01:07:14.758 INFO:tasks.workunit.client.0.smithi103.stdout:2/415: link d6/d5f/d26/d6e/c7b d6/da/d3f/c83 0 2024-09-17T01:07:14.761 INFO:tasks.workunit.client.0.smithi103.stdout:1/513: readlink d2/d1c/d28/d4b/l7a 0 2024-09-17T01:07:14.763 INFO:tasks.workunit.client.0.smithi103.stdout:5/345: symlink d6/d2c/d38/d4c/d71/l85 0 2024-09-17T01:07:14.765 INFO:tasks.workunit.client.0.smithi103.stdout:7/433: dwrite d4/d11/d3f/f68 [0,4194304] 0 2024-09-17T01:07:14.765 INFO:tasks.workunit.client.0.smithi103.stdout:5/346: write d6/d11/f1a [152461,121311] 0 2024-09-17T01:07:14.767 INFO:tasks.workunit.client.0.smithi103.stdout:2/416: dread d6/d5f/d26/d66/df/f59 [0,4194304] 0 2024-09-17T01:07:14.770 INFO:tasks.workunit.client.0.smithi103.stdout:1/514: chown d2/d70/f8f 47094052 1 2024-09-17T01:07:14.773 INFO:tasks.workunit.client.0.smithi103.stdout:9/481: truncate d7/f18 2711312 0 2024-09-17T01:07:14.775 INFO:tasks.workunit.client.0.smithi103.stdout:7/434: dread d4/d11/d34/d3d/f6c [0,4194304] 0 2024-09-17T01:07:14.775 INFO:tasks.workunit.client.0.smithi103.stdout:3/549: dread d3/d16/d1b/d3c/f35 [0,4194304] 0 2024-09-17T01:07:14.782 INFO:tasks.workunit.client.0.smithi103.stdout:4/523: creat d9/d16/d38/f99 x:0 0 0 2024-09-17T01:07:14.783 INFO:tasks.workunit.client.0.smithi103.stdout:1/515: dread d2/de/f8e [0,4194304] 0 2024-09-17T01:07:14.783 INFO:tasks.workunit.client.0.smithi103.stdout:5/347: creat d6/d11/f86 x:0 0 0 2024-09-17T01:07:14.783 INFO:tasks.workunit.client.0.smithi103.stdout:2/417: symlink d6/d5f/d26/l84 0 2024-09-17T01:07:14.785 INFO:tasks.workunit.client.0.smithi103.stdout:4/524: write d9/dc/df/f25 [5869827,61939] 0 2024-09-17T01:07:14.786 INFO:tasks.workunit.client.0.smithi103.stdout:9/482: creat d7/d2d/fa5 x:0 0 0 2024-09-17T01:07:14.787 INFO:tasks.workunit.client.0.smithi103.stdout:4/525: write d9/d10/f62 [891551,690] 0 2024-09-17T01:07:14.788 INFO:tasks.workunit.client.0.smithi103.stdout:4/526: chown d9/d16/d38/d3f 273 1 2024-09-17T01:07:14.789 INFO:tasks.workunit.client.0.smithi103.stdout:4/527: chown d9/d16/d23/d32/f98 93701922 1 2024-09-17T01:07:14.801 INFO:tasks.workunit.client.0.smithi103.stdout:7/435: dread d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:14.802 INFO:tasks.workunit.client.0.smithi103.stdout:9/483: rename d7/d43/l8c to d7/d2d/d59/d7a/la6 0 2024-09-17T01:07:14.803 INFO:tasks.workunit.client.0.smithi103.stdout:9/484: chown d7 74590 1 2024-09-17T01:07:14.803 INFO:tasks.workunit.client.0.smithi103.stdout:9/485: readlink d7/l3d 0 2024-09-17T01:07:14.805 INFO:tasks.workunit.client.0.smithi103.stdout:4/528: creat d9/dc/f9a x:0 0 0 2024-09-17T01:07:14.805 INFO:tasks.workunit.client.0.smithi103.stdout:9/486: chown d7/d43/d88/d11/d21/f69 1 1 2024-09-17T01:07:14.805 INFO:tasks.workunit.client.0.smithi103.stdout:3/550: symlink d3/d16/d1b/d3c/d65/lc6 0 2024-09-17T01:07:14.807 INFO:tasks.workunit.client.0.smithi103.stdout:2/418: creat d6/d5f/d42/d7c/f85 x:0 0 0 2024-09-17T01:07:14.809 INFO:tasks.workunit.client.0.smithi103.stdout:7/436: creat d4/d10/d66/f98 x:0 0 0 2024-09-17T01:07:14.812 INFO:tasks.workunit.client.0.smithi103.stdout:4/529: creat d9/d16/d23/d2a/f9b x:0 0 0 2024-09-17T01:07:14.812 INFO:tasks.workunit.client.0.smithi103.stdout:3/551: fsync d3/d16/d1b/d3c/f68 0 2024-09-17T01:07:14.813 INFO:tasks.workunit.client.0.smithi103.stdout:4/530: fdatasync d9/d2d/d55/f60 0 2024-09-17T01:07:14.815 INFO:tasks.workunit.client.0.smithi103.stdout:9/487: dwrite d7/f3b [0,4194304] 0 2024-09-17T01:07:14.818 INFO:tasks.workunit.client.0.smithi103.stdout:5/348: dread d6/db/f34 [0,4194304] 0 2024-09-17T01:07:14.819 INFO:tasks.workunit.client.0.smithi103.stdout:3/552: write d3/d16/d90/fc0 [797183,94764] 0 2024-09-17T01:07:14.822 INFO:tasks.workunit.client.0.smithi103.stdout:7/437: mknod d4/d4a/c99 0 2024-09-17T01:07:14.825 INFO:tasks.workunit.client.0.smithi103.stdout:7/438: write d4/d10/d66/f98 [988279,117636] 0 2024-09-17T01:07:14.826 INFO:tasks.workunit.client.0.smithi103.stdout:3/553: symlink d3/d16/d1b/lc7 0 2024-09-17T01:07:14.828 INFO:tasks.workunit.client.0.smithi103.stdout:9/488: getdents d7 0 2024-09-17T01:07:14.830 INFO:tasks.workunit.client.0.smithi103.stdout:2/419: dwrite d6/f8 [0,4194304] 0 2024-09-17T01:07:14.831 INFO:tasks.workunit.client.0.smithi103.stdout:7/439: dread - d4/d10/d66/f6f zero size 2024-09-17T01:07:14.831 INFO:tasks.workunit.client.0.smithi103.stdout:2/420: stat d6/d5f/f3c 0 2024-09-17T01:07:14.832 INFO:tasks.workunit.client.0.smithi103.stdout:3/554: stat d3/d16/d1b/d3c/d65/d7c/lbd 0 2024-09-17T01:07:14.836 INFO:tasks.workunit.client.0.smithi103.stdout:5/349: dwrite d6/db/f5c [0,4194304] 0 2024-09-17T01:07:14.837 INFO:tasks.workunit.client.0.smithi103.stdout:3/555: write d3/d16/d1b/d3c/f60 [369699,119201] 0 2024-09-17T01:07:14.839 INFO:tasks.workunit.client.0.smithi103.stdout:2/421: symlink d6/da/l86 0 2024-09-17T01:07:14.840 INFO:tasks.workunit.client.0.smithi103.stdout:4/531: dread d9/d16/f37 [0,4194304] 0 2024-09-17T01:07:14.842 INFO:tasks.workunit.client.0.smithi103.stdout:7/440: dread d4/d11/d2b/f65 [0,4194304] 0 2024-09-17T01:07:14.842 INFO:tasks.workunit.client.0.smithi103.stdout:5/350: rename d6/d28/l63 to d6/d2c/l87 0 2024-09-17T01:07:14.844 INFO:tasks.workunit.client.0.smithi103.stdout:4/532: dread d9/dc/df/f72 [0,4194304] 0 2024-09-17T01:07:14.854 INFO:tasks.workunit.client.0.smithi103.stdout:2/422: dread d6/d5f/d26/d66/df/f43 [0,4194304] 0 2024-09-17T01:07:14.943 INFO:tasks.workunit.client.0.smithi103.stdout:5/351: symlink d6/d2c/d38/d4c/d71/l88 0 2024-09-17T01:07:14.944 INFO:tasks.workunit.client.0.smithi103.stdout:4/533: truncate d9/d16/d23/d32/d4c/f92 91055 0 2024-09-17T01:07:14.946 INFO:tasks.workunit.client.0.smithi103.stdout:2/423: write d6/f72 [544402,112496] 0 2024-09-17T01:07:14.948 INFO:tasks.workunit.client.0.smithi103.stdout:2/424: dread d6/d5f/d26/f62 [0,4194304] 0 2024-09-17T01:07:14.976 INFO:tasks.workunit.client.0.smithi103.stdout:5/352: symlink d6/d2c/d38/d4c/d54/l89 0 2024-09-17T01:07:14.978 INFO:tasks.workunit.client.0.smithi103.stdout:4/534: rmdir d9/d16/d23/d32 39 2024-09-17T01:07:14.978 INFO:tasks.workunit.client.0.smithi103.stdout:4/535: chown d9/d2d/c33 182689 1 2024-09-17T01:07:14.982 INFO:tasks.workunit.client.0.smithi103.stdout:2/425: creat d6/d5f/d42/d6f/f87 x:0 0 0 2024-09-17T01:07:14.983 INFO:tasks.workunit.client.0.smithi103.stdout:3/556: rename d3/c31 to d3/d16/d1b/d3c/d65/d75/dbe/cc8 0 2024-09-17T01:07:14.985 INFO:tasks.workunit.client.0.smithi103.stdout:7/441: link d4/c30 d4/d10/d32/c9a 0 2024-09-17T01:07:14.986 INFO:tasks.workunit.client.0.smithi103.stdout:2/426: dread d6/f7 [0,4194304] 0 2024-09-17T01:07:14.986 INFO:tasks.workunit.client.0.smithi103.stdout:5/353: unlink d6/d2c/d32/c62 0 2024-09-17T01:07:14.990 INFO:tasks.workunit.client.0.smithi103.stdout:4/536: mknod d9/d10/c9c 0 2024-09-17T01:07:14.992 INFO:tasks.workunit.client.0.smithi103.stdout:4/537: write d9/d10/f7f [161623,126131] 0 2024-09-17T01:07:14.993 INFO:tasks.workunit.client.0.smithi103.stdout:4/538: fsync d9/d16/d45/f5a 0 2024-09-17T01:07:14.994 INFO:tasks.workunit.client.0.smithi103.stdout:7/442: mknod d4/d11/c9b 0 2024-09-17T01:07:14.996 INFO:tasks.workunit.client.0.smithi103.stdout:3/557: dread d3/d16/d1b/f89 [0,4194304] 0 2024-09-17T01:07:14.997 INFO:tasks.workunit.client.0.smithi103.stdout:2/427: truncate d6/d5f/d26/d34/d4e/d60/d75/f2a 3861017 0 2024-09-17T01:07:15.006 INFO:tasks.workunit.client.0.smithi103.stdout:4/539: mknod d9/d2d/c9d 0 2024-09-17T01:07:15.007 INFO:tasks.workunit.client.0.smithi103.stdout:5/354: creat d6/d2c/d38/f8a x:0 0 0 2024-09-17T01:07:15.010 INFO:tasks.workunit.client.0.smithi103.stdout:5/355: chown d6/d2c/d38/d4c/d50/l74 131192989 1 2024-09-17T01:07:15.012 INFO:tasks.workunit.client.0.smithi103.stdout:3/558: dwrite d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:15.015 INFO:tasks.workunit.client.0.smithi103.stdout:5/356: truncate d6/db/d66/f67 779521 0 2024-09-17T01:07:15.018 INFO:tasks.workunit.client.0.smithi103.stdout:5/357: creat d6/f8b x:0 0 0 2024-09-17T01:07:15.021 INFO:tasks.workunit.client.0.smithi103.stdout:5/358: readlink d6/d2c/d38/l44 0 2024-09-17T01:07:15.022 INFO:tasks.workunit.client.0.smithi103.stdout:7/443: dwrite d4/d10/f35 [0,4194304] 0 2024-09-17T01:07:15.022 INFO:tasks.workunit.client.0.smithi103.stdout:5/359: chown d6/l7 6211 1 2024-09-17T01:07:15.024 INFO:tasks.workunit.client.0.smithi103.stdout:3/559: rename d3/d16/d1b/d3c/d65/lc6 to d3/d16/d1b/d3c/d65/d75/lc9 0 2024-09-17T01:07:15.030 INFO:tasks.workunit.client.0.smithi103.stdout:5/360: creat d6/d2c/d38/d4c/d50/f8c x:0 0 0 2024-09-17T01:07:15.035 INFO:tasks.workunit.client.0.smithi103.stdout:7/444: rename d4/d10/d66/l59 to d4/d11/d34/d3d/l9c 0 2024-09-17T01:07:15.035 INFO:tasks.workunit.client.0.smithi103.stdout:3/560: dwrite d3/d81/fb4 [0,4194304] 0 2024-09-17T01:07:15.036 INFO:tasks.workunit.client.0.smithi103.stdout:3/561: fdatasync d3/d16/d1b/f5e 0 2024-09-17T01:07:15.039 INFO:tasks.workunit.client.0.smithi103.stdout:2/428: dread d6/da/f64 [0,4194304] 0 2024-09-17T01:07:15.044 INFO:tasks.workunit.client.0.smithi103.stdout:2/429: dread - d6/d5f/d26/d34/f73 zero size 2024-09-17T01:07:15.047 INFO:tasks.workunit.client.0.smithi103.stdout:5/361: rmdir d6/d11/d7a 0 2024-09-17T01:07:15.048 INFO:tasks.workunit.client.0.smithi103.stdout:7/445: dwrite d4/d10/f56 [0,4194304] 0 2024-09-17T01:07:15.055 INFO:tasks.workunit.client.0.smithi103.stdout:3/562: getdents d3/d16/d1b/d86 0 2024-09-17T01:07:15.060 INFO:tasks.workunit.client.0.smithi103.stdout:7/446: mkdir d4/d4a/d4b/d9d 0 2024-09-17T01:07:15.066 INFO:tasks.workunit.client.0.smithi103.stdout:2/430: symlink d6/d5f/d26/d34/d4e/d60/d75/d70/l88 0 2024-09-17T01:07:15.067 INFO:tasks.workunit.client.0.smithi103.stdout:7/447: mknod d4/d4a/d4b/c9e 0 2024-09-17T01:07:15.072 INFO:tasks.workunit.client.0.smithi103.stdout:2/431: rmdir d6/da/d28 39 2024-09-17T01:07:15.073 INFO:tasks.workunit.client.0.smithi103.stdout:5/362: link d6/d2c/l87 d6/d7d/l8d 0 2024-09-17T01:07:15.074 INFO:tasks.workunit.client.0.smithi103.stdout:3/563: creat d3/d16/fca x:0 0 0 2024-09-17T01:07:15.074 INFO:tasks.workunit.client.0.smithi103.stdout:2/432: readlink d6/d5f/d26/d66/l3a 0 2024-09-17T01:07:15.074 INFO:tasks.workunit.client.0.smithi103.stdout:7/448: dwrite d4/d10/d66/f98 [0,4194304] 0 2024-09-17T01:07:15.076 INFO:tasks.workunit.client.0.smithi103.stdout:2/433: truncate d6/d5f/d42/d6f/f87 850213 0 2024-09-17T01:07:15.079 INFO:tasks.workunit.client.0.smithi103.stdout:7/449: mkdir d4/d10/d6b/d9f 0 2024-09-17T01:07:15.079 INFO:tasks.workunit.client.0.smithi103.stdout:2/434: read d6/d5f/d26/d34/d4e/f53 [4829218,84548] 0 2024-09-17T01:07:15.084 INFO:tasks.workunit.client.0.smithi103.stdout:3/564: dwrite d3/d16/d1b/d3c/d65/d75/f84 [0,4194304] 0 2024-09-17T01:07:15.088 INFO:tasks.workunit.client.0.smithi103.stdout:7/450: dread d4/d11/d34/f41 [0,4194304] 0 2024-09-17T01:07:15.089 INFO:tasks.workunit.client.0.smithi103.stdout:7/451: readlink d4/le 0 2024-09-17T01:07:15.090 INFO:tasks.workunit.client.0.smithi103.stdout:2/435: mkdir d6/d5f/d26/d34/d4e/d89 0 2024-09-17T01:07:15.092 INFO:tasks.workunit.client.0.smithi103.stdout:2/436: write d6/d5f/d26/d34/d4e/d60/d75/f49 [669104,78431] 0 2024-09-17T01:07:15.093 INFO:tasks.workunit.client.0.smithi103.stdout:3/565: dread d3/d16/d1b/f74 [0,4194304] 0 2024-09-17T01:07:15.095 INFO:tasks.workunit.client.0.smithi103.stdout:3/566: chown d3/d16/d1b/d3c/f53 20659 1 2024-09-17T01:07:15.097 INFO:tasks.workunit.client.0.smithi103.stdout:7/452: rename d4/d11/d34/c55 to d4/d10/d66/ca0 0 2024-09-17T01:07:15.099 INFO:tasks.workunit.client.0.smithi103.stdout:5/363: dwrite d6/d28/f39 [4194304,4194304] 0 2024-09-17T01:07:15.103 INFO:tasks.workunit.client.0.smithi103.stdout:3/567: fdatasync d3/d16/d1b/d3c/f53 0 2024-09-17T01:07:15.103 INFO:tasks.workunit.client.0.smithi103.stdout:6/434: sync 2024-09-17T01:07:15.103 INFO:tasks.workunit.client.0.smithi103.stdout:0/390: sync 2024-09-17T01:07:15.104 INFO:tasks.workunit.client.0.smithi103.stdout:5/364: symlink d6/d2c/d38/d4c/d71/l8e 0 2024-09-17T01:07:15.105 INFO:tasks.workunit.client.0.smithi103.stdout:7/453: mkdir d4/d11/d80/d8c/da1 0 2024-09-17T01:07:15.107 INFO:tasks.workunit.client.0.smithi103.stdout:0/391: symlink dd/d1c/l89 0 2024-09-17T01:07:15.107 INFO:tasks.workunit.client.0.smithi103.stdout:2/437: dread d6/da/f2f [0,4194304] 0 2024-09-17T01:07:15.108 INFO:tasks.workunit.client.0.smithi103.stdout:3/568: dread - d3/d16/d1b/d3c/d65/d83/f99 zero size 2024-09-17T01:07:15.111 INFO:tasks.workunit.client.0.smithi103.stdout:7/454: unlink d4/d10/d66/f58 0 2024-09-17T01:07:15.112 INFO:tasks.workunit.client.0.smithi103.stdout:7/455: read d4/d10/f56 [342154,2490] 0 2024-09-17T01:07:15.115 INFO:tasks.workunit.client.0.smithi103.stdout:2/438: creat d6/d5f/d26/d66/df/f8a x:0 0 0 2024-09-17T01:07:15.117 INFO:tasks.workunit.client.0.smithi103.stdout:3/569: readlink d3/d16/d1b/d3c/d65/d75/lc9 0 2024-09-17T01:07:15.121 INFO:tasks.workunit.client.0.smithi103.stdout:5/365: link d6/d2c/d32/d55/f5e d6/d2c/d38/d4c/f8f 0 2024-09-17T01:07:15.123 INFO:tasks.workunit.client.0.smithi103.stdout:0/392: link dd/df/d68/f87 dd/df/d38/d55/f8a 0 2024-09-17T01:07:15.125 INFO:tasks.workunit.client.0.smithi103.stdout:6/435: creat d3/d16/d33/d3e/f98 x:0 0 0 2024-09-17T01:07:15.127 INFO:tasks.workunit.client.0.smithi103.stdout:2/439: mkdir d6/d5f/d26/d66/df/d68/d7e/d8b 0 2024-09-17T01:07:15.129 INFO:tasks.workunit.client.0.smithi103.stdout:5/366: mkdir d6/d28/d90 0 2024-09-17T01:07:15.131 INFO:tasks.workunit.client.0.smithi103.stdout:0/393: mknod dd/d4f/c8b 0 2024-09-17T01:07:15.134 INFO:tasks.workunit.client.0.smithi103.stdout:2/440: dwrite d6/da/f82 [0,4194304] 0 2024-09-17T01:07:15.135 INFO:tasks.workunit.client.0.smithi103.stdout:6/436: symlink d3/d16/d21/l99 0 2024-09-17T01:07:15.136 INFO:tasks.workunit.client.0.smithi103.stdout:6/437: fsync d3/f36 0 2024-09-17T01:07:15.137 INFO:tasks.workunit.client.0.smithi103.stdout:6/438: stat d3/d16/d21/d56 0 2024-09-17T01:07:15.141 INFO:tasks.workunit.client.0.smithi103.stdout:3/570: creat d3/d16/fcb x:0 0 0 2024-09-17T01:07:15.146 INFO:tasks.workunit.client.0.smithi103.stdout:6/439: mkdir d3/d16/d21/d56/d9a 0 2024-09-17T01:07:15.148 INFO:tasks.workunit.client.0.smithi103.stdout:3/571: unlink d3/d16/d1b/d3c/d65/d75/dbe/lab 0 2024-09-17T01:07:15.150 INFO:tasks.workunit.client.0.smithi103.stdout:3/572: write d3/d16/d1b/d3c/f4f [3718573,99598] 0 2024-09-17T01:07:15.152 INFO:tasks.workunit.client.0.smithi103.stdout:6/440: rename d3/d17/d2f/l38 to d3/d25/d74/l9b 0 2024-09-17T01:07:15.154 INFO:tasks.workunit.client.0.smithi103.stdout:5/367: link d6/db/fd d6/d2c/f91 0 2024-09-17T01:07:15.157 INFO:tasks.workunit.client.0.smithi103.stdout:7/456: dwrite d4/d4a/f79 [0,4194304] 0 2024-09-17T01:07:15.159 INFO:tasks.workunit.client.0.smithi103.stdout:2/441: creat d6/da/f8c x:0 0 0 2024-09-17T01:07:15.164 INFO:tasks.workunit.client.0.smithi103.stdout:3/573: read - d3/d16/d1b/d3c/d65/d7e/fb7 zero size 2024-09-17T01:07:15.167 INFO:tasks.workunit.client.0.smithi103.stdout:6/441: dwrite d3/d16/f1b [0,4194304] 0 2024-09-17T01:07:15.168 INFO:tasks.workunit.client.0.smithi103.stdout:5/368: readlink d6/d2c/l87 0 2024-09-17T01:07:15.170 INFO:tasks.workunit.client.0.smithi103.stdout:5/369: chown d6/d2c/f35 71 1 2024-09-17T01:07:15.172 INFO:tasks.workunit.client.0.smithi103.stdout:2/442: rename d6/d5f/d26/d34/d4e to d6/da/d5d/d8d 0 2024-09-17T01:07:15.174 INFO:tasks.workunit.client.0.smithi103.stdout:0/394: dwrite dd/d4f/f2e [0,4194304] 0 2024-09-17T01:07:15.174 INFO:tasks.workunit.client.0.smithi103.stdout:2/443: write d6/d5f/d26/f2c [613548,12531] 0 2024-09-17T01:07:15.183 INFO:tasks.workunit.client.0.smithi103.stdout:5/370: fsync d6/db/f27 0 2024-09-17T01:07:15.184 INFO:tasks.workunit.client.0.smithi103.stdout:7/457: rename d4/d10/d37/c8e to d4/d11/d80/ca2 0 2024-09-17T01:07:15.184 INFO:tasks.workunit.client.0.smithi103.stdout:3/574: dwrite d3/d16/d1b/f79 [0,4194304] 0 2024-09-17T01:07:15.189 INFO:tasks.workunit.client.0.smithi103.stdout:5/371: symlink d6/d2c/d32/d55/l92 0 2024-09-17T01:07:15.192 INFO:tasks.workunit.client.0.smithi103.stdout:2/444: mknod d6/da/c8e 0 2024-09-17T01:07:15.193 INFO:tasks.workunit.client.0.smithi103.stdout:2/445: fdatasync d6/da/f82 0 2024-09-17T01:07:15.193 INFO:tasks.workunit.client.0.smithi103.stdout:3/575: dwrite d3/d16/d1b/d3c/f68 [0,4194304] 0 2024-09-17T01:07:15.194 INFO:tasks.workunit.client.0.smithi103.stdout:3/576: stat d3/d16/l5b 0 2024-09-17T01:07:15.196 INFO:tasks.workunit.client.0.smithi103.stdout:7/458: creat d4/d4a/d4b/d8a/fa3 x:0 0 0 2024-09-17T01:07:15.196 INFO:tasks.workunit.client.0.smithi103.stdout:3/577: chown d3/d16/d1b/f46 54315401 1 2024-09-17T01:07:15.196 INFO:tasks.workunit.client.0.smithi103.stdout:7/459: readlink l0 0 2024-09-17T01:07:15.200 INFO:tasks.workunit.client.0.smithi103.stdout:0/395: getdents dd/d1c 0 2024-09-17T01:07:15.200 INFO:tasks.workunit.client.0.smithi103.stdout:5/372: mkdir d6/d7d/d93 0 2024-09-17T01:07:15.203 INFO:tasks.workunit.client.0.smithi103.stdout:2/446: mknod d6/da/d5d/d8d/d60/d75/d70/c8f 0 2024-09-17T01:07:15.204 INFO:tasks.workunit.client.0.smithi103.stdout:7/460: stat d4/d10/d66/ca0 0 2024-09-17T01:07:15.204 INFO:tasks.workunit.client.0.smithi103.stdout:7/461: stat d4/d11/c9b 0 2024-09-17T01:07:15.205 INFO:tasks.workunit.client.0.smithi103.stdout:3/578: mknod d3/d16/d1b/d3c/d65/d75/d9c/ccc 0 2024-09-17T01:07:15.206 INFO:tasks.workunit.client.0.smithi103.stdout:6/442: write d3/d16/d33/d57/f5a [786426,45707] 0 2024-09-17T01:07:15.209 INFO:tasks.workunit.client.0.smithi103.stdout:2/447: rename d6/d5f/d26/d66/df/f36 to d6/d5f/d26/d66/df/d58/f90 0 2024-09-17T01:07:15.212 INFO:tasks.workunit.client.0.smithi103.stdout:0/396: link fc dd/df/d38/d62/f8c 0 2024-09-17T01:07:15.213 INFO:tasks.workunit.client.0.smithi103.stdout:7/462: dread d4/d11/d3f/d63/f73 [0,4194304] 0 2024-09-17T01:07:15.216 INFO:tasks.workunit.client.0.smithi103.stdout:3/579: mknod d3/d16/d1b/d36/ccd 0 2024-09-17T01:07:15.218 INFO:tasks.workunit.client.0.smithi103.stdout:3/580: dread - d3/d16/d1b/d36/fa9 zero size 2024-09-17T01:07:15.219 INFO:tasks.workunit.client.0.smithi103.stdout:6/443: mkdir d3/d25/d9c 0 2024-09-17T01:07:15.221 INFO:tasks.workunit.client.0.smithi103.stdout:7/463: dwrite d4/f7 [0,4194304] 0 2024-09-17T01:07:15.221 INFO:tasks.workunit.client.0.smithi103.stdout:2/448: truncate d6/d5f/f5e 15217 0 2024-09-17T01:07:15.223 INFO:tasks.workunit.client.0.smithi103.stdout:7/464: chown d4/d4a/f79 1 1 2024-09-17T01:07:15.225 INFO:tasks.workunit.client.0.smithi103.stdout:2/449: creat d6/da/d5d/d8d/d60/d75/f91 x:0 0 0 2024-09-17T01:07:15.226 INFO:tasks.workunit.client.0.smithi103.stdout:7/465: write d4/d11/d2b/d36/d3a/d51/d5e/f64 [4823460,26953] 0 2024-09-17T01:07:15.228 INFO:tasks.workunit.client.0.smithi103.stdout:3/581: rename d3/d16/d1b/d3c/d65/d75/dbe/d5c to d3/d16/d1b/d3c/d65/d7e/dac/dce 0 2024-09-17T01:07:15.230 INFO:tasks.workunit.client.0.smithi103.stdout:3/582: write d3/d16/d1b/d3c/d65/d7e/fb7 [114021,84211] 0 2024-09-17T01:07:15.234 INFO:tasks.workunit.client.0.smithi103.stdout:7/466: symlink d4/d11/d80/la4 0 2024-09-17T01:07:15.238 INFO:tasks.workunit.client.0.smithi103.stdout:3/583: creat d3/d16/d1b/d3c/d65/d7e/dac/fcf x:0 0 0 2024-09-17T01:07:15.241 INFO:tasks.workunit.client.0.smithi103.stdout:3/584: stat d3/d16/d1b/d3c/d65/d7e 0 2024-09-17T01:07:15.242 INFO:tasks.workunit.client.0.smithi103.stdout:7/467: truncate d4/d11/d2b/d36/f7d 711353 0 2024-09-17T01:07:15.243 INFO:tasks.workunit.client.0.smithi103.stdout:6/444: dread d3/d25/d26/f4a [0,4194304] 0 2024-09-17T01:07:15.243 INFO:tasks.workunit.client.0.smithi103.stdout:2/450: dwrite d6/da/d28/f4d [0,4194304] 0 2024-09-17T01:07:15.243 INFO:tasks.workunit.client.0.smithi103.stdout:3/585: chown d3/d44/d63/f98 62 1 2024-09-17T01:07:15.245 INFO:tasks.workunit.client.0.smithi103.stdout:0/397: write dd/f4d [1073494,112798] 0 2024-09-17T01:07:15.250 INFO:tasks.workunit.client.0.smithi103.stdout:2/451: creat d6/d5f/d26/d6e/f92 x:0 0 0 2024-09-17T01:07:15.250 INFO:tasks.workunit.client.0.smithi103.stdout:6/445: mknod d3/d25/d74/c9d 0 2024-09-17T01:07:15.250 INFO:tasks.workunit.client.0.smithi103.stdout:7/468: dread d4/d11/f23 [0,4194304] 0 2024-09-17T01:07:15.250 INFO:tasks.workunit.client.0.smithi103.stdout:6/446: readlink d3/d25/d26/l5f 0 2024-09-17T01:07:15.251 INFO:tasks.workunit.client.0.smithi103.stdout:7/469: dread - d4/d10/f94 zero size 2024-09-17T01:07:15.253 INFO:tasks.workunit.client.0.smithi103.stdout:3/586: symlink d3/d16/d1b/d36/ld0 0 2024-09-17T01:07:15.255 INFO:tasks.workunit.client.0.smithi103.stdout:0/398: symlink dd/df/d38/d55/l8d 0 2024-09-17T01:07:15.256 INFO:tasks.workunit.client.0.smithi103.stdout:2/452: mknod d6/d5f/d26/d6e/c93 0 2024-09-17T01:07:15.258 INFO:tasks.workunit.client.0.smithi103.stdout:6/447: mknod d3/d16/d33/d3e/d58/c9e 0 2024-09-17T01:07:15.260 INFO:tasks.workunit.client.0.smithi103.stdout:6/448: fdatasync d3/d25/d74/f76 0 2024-09-17T01:07:15.261 INFO:tasks.workunit.client.0.smithi103.stdout:7/470: symlink d4/d11/d2b/d36/d82/la5 0 2024-09-17T01:07:15.263 INFO:tasks.workunit.client.0.smithi103.stdout:0/399: truncate dd/d1c/f1d 147909 0 2024-09-17T01:07:15.267 INFO:tasks.workunit.client.0.smithi103.stdout:6/449: creat d3/d16/d33/f9f x:0 0 0 2024-09-17T01:07:15.273 INFO:tasks.workunit.client.0.smithi103.stdout:2/453: link d6/d5f/d42/f67 d6/da/d5d/d8d/d60/d75/d70/f94 0 2024-09-17T01:07:15.273 INFO:tasks.workunit.client.0.smithi103.stdout:3/587: dread d3/d16/d1b/f80 [0,4194304] 0 2024-09-17T01:07:15.275 INFO:tasks.workunit.client.0.smithi103.stdout:0/400: mkdir dd/df/d68/d6c/d8e 0 2024-09-17T01:07:15.275 INFO:tasks.workunit.client.0.smithi103.stdout:0/401: read - dd/d4f/d64/f79 zero size 2024-09-17T01:07:15.277 INFO:tasks.workunit.client.0.smithi103.stdout:6/450: creat d3/d17/d2f/fa0 x:0 0 0 2024-09-17T01:07:15.277 INFO:tasks.workunit.client.0.smithi103.stdout:0/402: fsync dd/d4f/f2e 0 2024-09-17T01:07:15.278 INFO:tasks.workunit.client.0.smithi103.stdout:6/451: chown d3/d16/d33/d3e/d58/l66 8974 1 2024-09-17T01:07:15.278 INFO:tasks.workunit.client.0.smithi103.stdout:7/471: truncate d4/d11/d2b/d36/d3a/d51/d5e/f75 243254 0 2024-09-17T01:07:15.280 INFO:tasks.workunit.client.0.smithi103.stdout:3/588: fdatasync d3/d16/d1b/f74 0 2024-09-17T01:07:15.284 INFO:tasks.workunit.client.0.smithi103.stdout:0/403: unlink dd/f67 0 2024-09-17T01:07:15.286 INFO:tasks.workunit.client.0.smithi103.stdout:0/404: write dd/df/d38/f80 [384714,79722] 0 2024-09-17T01:07:15.287 INFO:tasks.workunit.client.0.smithi103.stdout:6/452: unlink d3/d16/d33/d3e/d58/f8f 0 2024-09-17T01:07:15.288 INFO:tasks.workunit.client.0.smithi103.stdout:2/454: mknod d6/d5f/d26/d66/df/d68/d7e/d8b/c95 0 2024-09-17T01:07:15.289 INFO:tasks.workunit.client.0.smithi103.stdout:6/453: fsync d3/d16/d33/d57/d63/f73 0 2024-09-17T01:07:15.290 INFO:tasks.workunit.client.0.smithi103.stdout:7/472: symlink d4/d11/d2b/d36/d3a/d51/d5e/la6 0 2024-09-17T01:07:15.291 INFO:tasks.workunit.client.0.smithi103.stdout:3/589: dwrite d3/d16/d1b/d3c/f60 [0,4194304] 0 2024-09-17T01:07:15.297 INFO:tasks.workunit.client.0.smithi103.stdout:2/455: dread d6/da/d5d/d8d/d60/d75/f49 [0,4194304] 0 2024-09-17T01:07:15.303 INFO:tasks.workunit.client.0.smithi103.stdout:3/590: write d3/d16/d1b/f80 [5127493,119553] 0 2024-09-17T01:07:15.304 INFO:tasks.workunit.client.0.smithi103.stdout:7/473: creat d4/d11/d2b/d36/d3a/d51/d5e/d7b/fa7 x:0 0 0 2024-09-17T01:07:15.306 INFO:tasks.workunit.client.0.smithi103.stdout:2/456: mknod d6/d5f/d26/d66/df/d68/d7e/d8b/c96 0 2024-09-17T01:07:15.311 INFO:tasks.workunit.client.0.smithi103.stdout:3/591: dwrite d3/d16/d1b/d3c/d65/d83/f9d [0,4194304] 0 2024-09-17T01:07:15.317 INFO:tasks.workunit.client.0.smithi103.stdout:7/474: read d4/d11/d2b/f2f [55586,9454] 0 2024-09-17T01:07:15.318 INFO:tasks.workunit.client.0.smithi103.stdout:7/475: write d4/d4a/d4b/d8a/fa3 [113890,16357] 0 2024-09-17T01:07:15.324 INFO:tasks.workunit.client.0.smithi103.stdout:3/592: mkdir d3/d16/d1b/d3c/d65/d75/dd1 0 2024-09-17T01:07:15.325 INFO:tasks.workunit.client.0.smithi103.stdout:7/476: unlink d4/d10/d66/f98 0 2024-09-17T01:07:15.329 INFO:tasks.workunit.client.0.smithi103.stdout:6/454: link d3/d17/d2f/l54 d3/d25/d74/la1 0 2024-09-17T01:07:15.329 INFO:tasks.workunit.client.0.smithi103.stdout:6/455: fdatasync d3/f18 0 2024-09-17T01:07:15.332 INFO:tasks.workunit.client.0.smithi103.stdout:7/477: creat d4/d11/d3f/d63/fa8 x:0 0 0 2024-09-17T01:07:15.337 INFO:tasks.workunit.client.0.smithi103.stdout:2/457: rename d6/f2d to d6/f97 0 2024-09-17T01:07:15.339 INFO:tasks.workunit.client.0.smithi103.stdout:7/478: rename d4/l3b to d4/d11/d2b/d36/d3a/d51/d5e/la9 0 2024-09-17T01:07:15.339 INFO:tasks.workunit.client.0.smithi103.stdout:7/479: readlink d4/d11/l5c 0 2024-09-17T01:07:15.350 INFO:tasks.workunit.client.0.smithi103.stdout:7/480: rename d4/lc to d4/laa 0 2024-09-17T01:07:15.355 INFO:tasks.workunit.client.0.smithi103.stdout:0/405: write dd/d1c/f1d [176476,114299] 0 2024-09-17T01:07:15.355 INFO:tasks.workunit.client.0.smithi103.stdout:6/456: dwrite d3/d16/f1f [0,4194304] 0 2024-09-17T01:07:15.363 INFO:tasks.workunit.client.0.smithi103.stdout:7/481: link d4/d10/f2e d4/d4a/d4b/d8a/fab 0 2024-09-17T01:07:15.364 INFO:tasks.workunit.client.0.smithi103.stdout:2/458: dread d6/da/f2f [0,4194304] 0 2024-09-17T01:07:15.365 INFO:tasks.workunit.client.0.smithi103.stdout:7/482: write d4/d11/d2b/d8d/d92/f93 [2744382,115545] 0 2024-09-17T01:07:15.371 INFO:tasks.workunit.client.0.smithi103.stdout:2/459: dwrite d6/da/d5d/d8d/f51 [0,4194304] 0 2024-09-17T01:07:15.374 INFO:tasks.workunit.client.0.smithi103.stdout:0/406: fsync dd/f15 0 2024-09-17T01:07:15.376 INFO:tasks.workunit.client.0.smithi103.stdout:7/483: mkdir d4/d11/d80/d8c/dac 0 2024-09-17T01:07:15.377 INFO:tasks.workunit.client.0.smithi103.stdout:7/484: read d4/d11/d34/f49 [631786,36790] 0 2024-09-17T01:07:15.383 INFO:tasks.workunit.client.0.smithi103.stdout:0/407: write dd/df/f26 [4696738,64586] 0 2024-09-17T01:07:15.386 INFO:tasks.workunit.client.0.smithi103.stdout:7/485: write d4/d11/d34/f41 [1297804,95390] 0 2024-09-17T01:07:15.388 INFO:tasks.workunit.client.0.smithi103.stdout:6/457: getdents d3/d16/d33/d57/d63/d60 0 2024-09-17T01:07:15.389 INFO:tasks.workunit.client.0.smithi103.stdout:0/408: truncate dd/d1c/f4a 635069 0 2024-09-17T01:07:15.390 INFO:tasks.workunit.client.0.smithi103.stdout:2/460: getdents d6/d5f/d26/d34/d80 0 2024-09-17T01:07:15.393 INFO:tasks.workunit.client.0.smithi103.stdout:0/409: truncate dd/df/d38/f63 340307 0 2024-09-17T01:07:15.394 INFO:tasks.workunit.client.0.smithi103.stdout:7/486: symlink d4/d11/d2b/d36/d3a/lad 0 2024-09-17T01:07:15.395 INFO:tasks.workunit.client.0.smithi103.stdout:6/458: getdents d3/d16/d33/d57/d63/d60 0 2024-09-17T01:07:15.396 INFO:tasks.workunit.client.0.smithi103.stdout:6/459: truncate d3/d16/f1f 4920151 0 2024-09-17T01:07:15.399 INFO:tasks.workunit.client.0.smithi103.stdout:7/487: creat d4/d11/d2b/fae x:0 0 0 2024-09-17T01:07:15.405 INFO:tasks.workunit.client.0.smithi103.stdout:7/488: truncate d4/d11/d2b/f2f 419951 0 2024-09-17T01:07:15.406 INFO:tasks.workunit.client.0.smithi103.stdout:7/489: write d4/d11/d2b/fae [676351,21586] 0 2024-09-17T01:07:15.411 INFO:tasks.workunit.client.0.smithi103.stdout:7/490: dwrite d4/f1a [0,4194304] 0 2024-09-17T01:07:15.412 INFO:tasks.workunit.client.0.smithi103.stdout:6/460: getdents d3/d25/d26/d87 0 2024-09-17T01:07:15.413 INFO:tasks.workunit.client.0.smithi103.stdout:6/461: read d3/d16/d21/d56/f7c [217442,83227] 0 2024-09-17T01:07:15.417 INFO:tasks.workunit.client.0.smithi103.stdout:7/491: rename d4/fd to d4/d10/d32/faf 0 2024-09-17T01:07:15.418 INFO:tasks.workunit.client.0.smithi103.stdout:7/492: chown d4/d11/d34/f41 3 1 2024-09-17T01:07:15.424 INFO:tasks.workunit.client.0.smithi103.stdout:2/461: truncate d6/d5f/d26/f32 2966392 0 2024-09-17T01:07:15.425 INFO:tasks.workunit.client.0.smithi103.stdout:0/410: dwrite dd/d1c/f28 [4194304,4194304] 0 2024-09-17T01:07:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: pgmap v18: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 68 MiB/s rd, 214 MiB/s wr, 420 op/s 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: Adjusting osd_memory_target on smithi103 to 1216M 2024-09-17T01:07:15.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:07:15.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:15 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:07:15.429 INFO:tasks.workunit.client.0.smithi103.stdout:7/493: creat d4/d11/d34/d3d/fb0 x:0 0 0 2024-09-17T01:07:15.433 INFO:tasks.workunit.client.0.smithi103.stdout:2/462: creat d6/d5f/d26/d6e/f98 x:0 0 0 2024-09-17T01:07:15.434 INFO:tasks.workunit.client.0.smithi103.stdout:2/463: truncate d6/da/d5d/d8d/d60/f81 365205 0 2024-09-17T01:07:15.435 INFO:tasks.workunit.client.0.smithi103.stdout:0/411: creat dd/d43/f8f x:0 0 0 2024-09-17T01:07:15.436 INFO:tasks.workunit.client.0.smithi103.stdout:7/494: mkdir d4/d11/d80/db1 0 2024-09-17T01:07:15.437 INFO:tasks.workunit.client.0.smithi103.stdout:2/464: dread d6/da/d5d/d8d/d60/f81 [0,4194304] 0 2024-09-17T01:07:15.438 INFO:tasks.workunit.client.0.smithi103.stdout:2/465: read - d6/da/f8c zero size 2024-09-17T01:07:15.456 INFO:tasks.workunit.client.0.smithi103.stdout:1/516: sync 2024-09-17T01:07:15.456 INFO:tasks.workunit.client.0.smithi103.stdout:8/428: sync 2024-09-17T01:07:15.466 INFO:tasks.workunit.client.0.smithi103.stdout:7/495: symlink d4/d11/d34/lb2 0 2024-09-17T01:07:15.469 INFO:tasks.workunit.client.0.smithi103.stdout:6/462: dread d3/d25/f29 [0,4194304] 0 2024-09-17T01:07:15.469 INFO:tasks.workunit.client.0.smithi103.stdout:0/412: creat dd/df/f90 x:0 0 0 2024-09-17T01:07:15.469 INFO:tasks.workunit.client.0.smithi103.stdout:2/466: creat d6/d5f/d26/d66/df/f99 x:0 0 0 2024-09-17T01:07:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: pgmap v18: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 68 MiB/s rd, 214 MiB/s wr, 420 op/s 2024-09-17T01:07:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: Adjusting osd_memory_target on smithi103 to 1216M 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:07:15.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:07:15.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:15.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:07:15.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:15 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:07:15.587 INFO:tasks.workunit.client.0.smithi103.stdout:6/463: read d3/f28 [917760,38992] 0 2024-09-17T01:07:15.587 INFO:tasks.workunit.client.0.smithi103.stdout:8/429: creat d0/d6/dc/d30/d25/d64/f87 x:0 0 0 2024-09-17T01:07:15.588 INFO:tasks.workunit.client.0.smithi103.stdout:4/540: sync 2024-09-17T01:07:15.588 INFO:tasks.workunit.client.0.smithi103.stdout:9/489: sync 2024-09-17T01:07:15.590 INFO:tasks.workunit.client.0.smithi103.stdout:1/517: creat d2/d1c/d20/d6d/d8d/d94/fa8 x:0 0 0 2024-09-17T01:07:15.591 INFO:tasks.workunit.client.0.smithi103.stdout:1/518: chown d2/d16/d51/d65 1 1 2024-09-17T01:07:15.591 INFO:tasks.workunit.client.0.smithi103.stdout:1/519: dread - d2/fa4 zero size 2024-09-17T01:07:15.599 INFO:tasks.workunit.client.0.smithi103.stdout:0/413: dread dd/df/f24 [0,4194304] 0 2024-09-17T01:07:15.660 INFO:tasks.workunit.client.0.smithi103.stdout:2/467: rename d6/d5f/d42 to d6/d5f/d26/d66/df/d68/d9a 0 2024-09-17T01:07:15.661 INFO:tasks.workunit.client.0.smithi103.stdout:2/468: read d6/da/d28/f4d [3711225,5894] 0 2024-09-17T01:07:15.663 INFO:tasks.workunit.client.0.smithi103.stdout:2/469: write d6/d5f/d26/f2c [1745649,42432] 0 2024-09-17T01:07:15.663 INFO:tasks.workunit.client.0.smithi103.stdout:8/430: mkdir d0/d6/dc/d3d/d88 0 2024-09-17T01:07:15.665 INFO:tasks.workunit.client.0.smithi103.stdout:2/470: chown d6/d5f/d26/d66/df/f43 123626141 1 2024-09-17T01:07:15.665 INFO:tasks.workunit.client.0.smithi103.stdout:4/541: symlink d9/d16/d38/d3f/l9e 0 2024-09-17T01:07:15.666 INFO:tasks.workunit.client.0.smithi103.stdout:9/490: mknod d7/d43/d88/d11/d5c/d8d/ca7 0 2024-09-17T01:07:15.668 INFO:tasks.workunit.client.0.smithi103.stdout:7/496: rmdir d4/d11/d80/d8c/da1 0 2024-09-17T01:07:15.673 INFO:tasks.workunit.client.0.smithi103.stdout:6/464: rename d3/d25/d26/f83 to d3/d16/d21/fa2 0 2024-09-17T01:07:15.679 INFO:tasks.workunit.client.0.smithi103.stdout:8/431: rmdir d0/d6/dc/d30 39 2024-09-17T01:07:15.683 INFO:tasks.workunit.client.0.smithi103.stdout:4/542: rename d9/d16/d36/d42/f56 to d9/d16/d36/d42/f9f 0 2024-09-17T01:07:15.684 INFO:tasks.workunit.client.0.smithi103.stdout:9/491: symlink d7/d43/d88/d11/d20/d4f/la8 0 2024-09-17T01:07:15.687 INFO:tasks.workunit.client.0.smithi103.stdout:7/497: mkdir d4/d11/d2b/d8d/d92/db3 0 2024-09-17T01:07:15.688 INFO:tasks.workunit.client.0.smithi103.stdout:0/414: dwrite dd/f15 [0,4194304] 0 2024-09-17T01:07:15.689 INFO:tasks.workunit.client.0.smithi103.stdout:6/465: dread d3/d25/d26/d3a/f45 [0,4194304] 0 2024-09-17T01:07:15.689 INFO:tasks.workunit.client.0.smithi103.stdout:1/520: link d2/d16/f2a d2/d1c/d28/d52/d69/fa9 0 2024-09-17T01:07:15.781 INFO:tasks.workunit.client.0.smithi103.stdout:0/415: dread dd/df/d38/f80 [0,4194304] 0 2024-09-17T01:07:15.782 INFO:tasks.workunit.client.0.smithi103.stdout:1/521: readlink d2/l5 0 2024-09-17T01:07:15.782 INFO:tasks.workunit.client.0.smithi103.stdout:6/466: mkdir d3/d16/d33/d3e/d58/da3 0 2024-09-17T01:07:15.782 INFO:tasks.workunit.client.0.smithi103.stdout:8/432: write d0/d6/dc/d30/d25/d64/f5b [176833,98624] 0 2024-09-17T01:07:15.788 INFO:tasks.workunit.client.0.smithi103.stdout:7/498: write d4/d4a/f67 [773023,103600] 0 2024-09-17T01:07:15.788 INFO:tasks.workunit.client.0.smithi103.stdout:2/471: creat d6/d5f/f9b x:0 0 0 2024-09-17T01:07:15.789 INFO:tasks.workunit.client.0.smithi103.stdout:4/543: unlink d9/d16/d23/d32/d61/d47/l7d 0 2024-09-17T01:07:15.795 INFO:tasks.workunit.client.0.smithi103.stdout:2/472: dwrite d6/d5f/d26/f63 [4194304,4194304] 0 2024-09-17T01:07:15.800 INFO:tasks.workunit.client.0.smithi103.stdout:2/473: dread d6/da/d5d/d8d/d60/d75/f2a [0,4194304] 0 2024-09-17T01:07:15.803 INFO:tasks.workunit.client.0.smithi103.stdout:7/499: chown d4/l1c 53602560 1 2024-09-17T01:07:15.807 INFO:tasks.workunit.client.0.smithi103.stdout:4/544: creat d9/d16/d23/d52/fa0 x:0 0 0 2024-09-17T01:07:15.808 INFO:tasks.workunit.client.0.smithi103.stdout:1/522: dread d2/d1c/d28/d4b/f66 [0,4194304] 0 2024-09-17T01:07:15.809 INFO:tasks.workunit.client.0.smithi103.stdout:6/467: unlink d3/l84 0 2024-09-17T01:07:15.810 INFO:tasks.workunit.client.0.smithi103.stdout:1/523: write d2/d7/f19 [2608603,16541] 0 2024-09-17T01:07:15.815 INFO:tasks.workunit.client.0.smithi103.stdout:2/474: rmdir d6/d5f/d26/d66/df/d58 39 2024-09-17T01:07:15.815 INFO:tasks.workunit.client.0.smithi103.stdout:2/475: chown d6/da/d28/f35 813 1 2024-09-17T01:07:15.818 INFO:tasks.workunit.client.0.smithi103.stdout:7/500: mknod d4/d11/d80/d8c/cb4 0 2024-09-17T01:07:15.820 INFO:tasks.workunit.client.0.smithi103.stdout:1/524: mknod d2/d1c/d28/d4b/d67/caa 0 2024-09-17T01:07:15.822 INFO:tasks.workunit.client.0.smithi103.stdout:1/525: truncate d2/d1c/d20/f9a 4235517 0 2024-09-17T01:07:15.822 INFO:tasks.workunit.client.0.smithi103.stdout:6/468: rename d3/d16/d33/d3e/d58/da3 to d3/d16/d33/d57/d63/d60/da4 0 2024-09-17T01:07:15.823 INFO:tasks.workunit.client.0.smithi103.stdout:8/433: creat d0/d6/f89 x:0 0 0 2024-09-17T01:07:15.823 INFO:tasks.workunit.client.0.smithi103.stdout:6/469: dread - d3/d16/d33/f9f zero size 2024-09-17T01:07:15.824 INFO:tasks.workunit.client.0.smithi103.stdout:2/476: stat d6/d5f/d26/d6e/c7f 0 2024-09-17T01:07:15.825 INFO:tasks.workunit.client.0.smithi103.stdout:7/501: dread - d4/d11/d2b/d36/d82/f8f zero size 2024-09-17T01:07:15.826 INFO:tasks.workunit.client.0.smithi103.stdout:2/477: chown d6/da/d3f/l57 40 1 2024-09-17T01:07:15.828 INFO:tasks.workunit.client.0.smithi103.stdout:2/478: write d6/da/d5d/d8d/f51 [4987244,109570] 0 2024-09-17T01:07:15.829 INFO:tasks.workunit.client.0.smithi103.stdout:8/434: mknod d0/d6/dc/d3d/c8a 0 2024-09-17T01:07:15.830 INFO:tasks.workunit.client.0.smithi103.stdout:8/435: readlink d0/d6/dc/d3d/l4a 0 2024-09-17T01:07:15.832 INFO:tasks.workunit.client.0.smithi103.stdout:1/526: dread d2/d1c/d20/d33/f3c [0,4194304] 0 2024-09-17T01:07:15.834 INFO:tasks.workunit.client.0.smithi103.stdout:1/527: read d2/de/f14 [1740115,25888] 0 2024-09-17T01:07:15.834 INFO:tasks.workunit.client.0.smithi103.stdout:4/545: dread f3 [4194304,4194304] 0 2024-09-17T01:07:15.835 INFO:tasks.workunit.client.0.smithi103.stdout:2/479: write d6/f52 [3938980,43410] 0 2024-09-17T01:07:15.840 INFO:tasks.workunit.client.0.smithi103.stdout:6/470: rename d3/f4 to d3/d16/fa5 0 2024-09-17T01:07:15.842 INFO:tasks.workunit.client.0.smithi103.stdout:0/416: dwrite dd/d4f/f32 [0,4194304] 0 2024-09-17T01:07:15.843 INFO:tasks.workunit.client.0.smithi103.stdout:1/528: dwrite d2/d7/d4e/f7b [0,4194304] 0 2024-09-17T01:07:15.846 INFO:tasks.workunit.client.0.smithi103.stdout:8/436: mknod d0/d6/dc/d30/d2d/c8b 0 2024-09-17T01:07:15.847 INFO:tasks.workunit.client.0.smithi103.stdout:8/437: stat d0/d6/dc/d30/d25/d7d 0 2024-09-17T01:07:15.852 INFO:tasks.workunit.client.0.smithi103.stdout:8/438: dwrite d0/d6/dc/f4b [0,4194304] 0 2024-09-17T01:07:15.856 INFO:tasks.workunit.client.0.smithi103.stdout:2/480: rename d6/d5f/d26/d66/df/d68/d9a to d6/d5f/d26/d66/df/d68/d7e/d9c 0 2024-09-17T01:07:15.858 INFO:tasks.workunit.client.0.smithi103.stdout:8/439: dread d0/d6/dc/f9 [0,4194304] 0 2024-09-17T01:07:15.859 INFO:tasks.workunit.client.0.smithi103.stdout:6/471: unlink d3/d17/l47 0 2024-09-17T01:07:15.861 INFO:tasks.workunit.client.0.smithi103.stdout:7/502: getdents d4/d11/d3f 0 2024-09-17T01:07:15.865 INFO:tasks.workunit.client.0.smithi103.stdout:4/546: truncate d9/d16/d23/d32/d4c/f92 1112768 0 2024-09-17T01:07:15.866 INFO:tasks.workunit.client.0.smithi103.stdout:6/472: dwrite d3/d25/d74/f76 [0,4194304] 0 2024-09-17T01:07:15.875 INFO:tasks.workunit.client.0.smithi103.stdout:3/593: sync 2024-09-17T01:07:15.875 INFO:tasks.workunit.client.0.smithi103.stdout:5/373: sync 2024-09-17T01:07:15.880 INFO:tasks.workunit.client.0.smithi103.stdout:0/417: link c1 dd/df/d68/c91 0 2024-09-17T01:07:15.883 INFO:tasks.workunit.client.0.smithi103.stdout:6/473: getdents d3/d25/d26/d87 0 2024-09-17T01:07:15.883 INFO:tasks.workunit.client.0.smithi103.stdout:5/374: dwrite d6/d11/f2b [0,4194304] 0 2024-09-17T01:07:15.885 INFO:tasks.workunit.client.0.smithi103.stdout:8/440: rmdir d0/d6/dc/d30/d2d/d83 0 2024-09-17T01:07:15.887 INFO:tasks.workunit.client.0.smithi103.stdout:8/441: write d0/d6/dc/d30/f7a [814375,97348] 0 2024-09-17T01:07:15.889 INFO:tasks.workunit.client.0.smithi103.stdout:3/594: mknod d3/d16/d1b/d3c/d65/d7e/cd2 0 2024-09-17T01:07:15.891 INFO:tasks.workunit.client.0.smithi103.stdout:1/529: truncate d2/d1c/d28/d4b/d67/f86 216798 0 2024-09-17T01:07:15.892 INFO:tasks.workunit.client.0.smithi103.stdout:0/418: symlink dd/d1c/d50/l92 0 2024-09-17T01:07:15.893 INFO:tasks.workunit.client.0.smithi103.stdout:4/547: write d9/d16/d44/f4f [1270387,73155] 0 2024-09-17T01:07:15.895 INFO:tasks.workunit.client.0.smithi103.stdout:6/474: mknod d3/d16/d21/d50/ca6 0 2024-09-17T01:07:15.897 INFO:tasks.workunit.client.0.smithi103.stdout:8/442: creat d0/d6/dc/d3d/d6d/f8c x:0 0 0 2024-09-17T01:07:15.898 INFO:tasks.workunit.client.0.smithi103.stdout:1/530: symlink d2/d7/d73/lab 0 2024-09-17T01:07:15.900 INFO:tasks.workunit.client.0.smithi103.stdout:0/419: rmdir dd/df/d68/d6c 39 2024-09-17T01:07:15.902 INFO:tasks.workunit.client.0.smithi103.stdout:5/375: fdatasync d6/d11/f1d 0 2024-09-17T01:07:15.902 INFO:tasks.workunit.client.0.smithi103.stdout:4/548: truncate d9/d2d/d55/f60 929511 0 2024-09-17T01:07:15.905 INFO:tasks.workunit.client.0.smithi103.stdout:6/475: write d3/f18 [6745006,36170] 0 2024-09-17T01:07:15.905 INFO:tasks.workunit.client.0.smithi103.stdout:1/531: mkdir d2/d70/dac 0 2024-09-17T01:07:15.905 INFO:tasks.workunit.client.0.smithi103.stdout:2/481: dwrite d6/f4b [0,4194304] 0 2024-09-17T01:07:15.905 INFO:tasks.workunit.client.0.smithi103.stdout:8/443: stat d0/d6/dc/d30/d25/d64/c67 0 2024-09-17T01:07:15.908 INFO:tasks.workunit.client.0.smithi103.stdout:1/532: stat d2/de/d1f/f34 0 2024-09-17T01:07:15.908 INFO:tasks.workunit.client.0.smithi103.stdout:7/503: dwrite d4/d11/d2b/d36/d3a/f5d [0,4194304] 0 2024-09-17T01:07:15.911 INFO:tasks.workunit.client.0.smithi103.stdout:5/376: mknod d6/db/d66/c94 0 2024-09-17T01:07:15.913 INFO:tasks.workunit.client.0.smithi103.stdout:8/444: write d0/d6/dc/d3d/d6d/f8c [875198,76154] 0 2024-09-17T01:07:15.915 INFO:tasks.workunit.client.0.smithi103.stdout:0/420: mkdir dd/d5d/d93 0 2024-09-17T01:07:15.920 INFO:tasks.workunit.client.0.smithi103.stdout:7/504: rename d4/d11/d34/d3d to d4/d11/d34/db5 0 2024-09-17T01:07:15.921 INFO:tasks.workunit.client.0.smithi103.stdout:5/377: symlink d6/d2c/d38/d4c/d54/l95 0 2024-09-17T01:07:15.921 INFO:tasks.workunit.client.0.smithi103.stdout:8/445: write d0/d6/dc/d3d/f40 [809735,59840] 0 2024-09-17T01:07:15.922 INFO:tasks.workunit.client.0.smithi103.stdout:6/476: symlink d3/la7 0 2024-09-17T01:07:15.923 INFO:tasks.workunit.client.0.smithi103.stdout:0/421: creat dd/d5d/f94 x:0 0 0 2024-09-17T01:07:15.923 INFO:tasks.workunit.client.0.smithi103.stdout:5/378: read d6/d2c/f51 [292763,21617] 0 2024-09-17T01:07:15.925 INFO:tasks.workunit.client.0.smithi103.stdout:0/422: chown dd/df/d38/d62/f85 12534 1 2024-09-17T01:07:15.932 INFO:tasks.workunit.client.0.smithi103.stdout:5/379: dread d6/d28/f6b [0,4194304] 0 2024-09-17T01:07:15.933 INFO:tasks.workunit.client.0.smithi103.stdout:6/477: write d3/d25/d26/f2e [4489194,50557] 0 2024-09-17T01:07:15.933 INFO:tasks.workunit.client.0.smithi103.stdout:5/380: stat d6/db/f4e 0 2024-09-17T01:07:15.933 INFO:tasks.workunit.client.0.smithi103.stdout:1/533: mknod d2/d16/d51/d65/d7f/cad 0 2024-09-17T01:07:15.936 INFO:tasks.workunit.client.0.smithi103.stdout:2/482: creat d6/da/d5d/d8d/d60/f9d x:0 0 0 2024-09-17T01:07:15.940 INFO:tasks.workunit.client.0.smithi103.stdout:8/446: dread d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:15.944 INFO:tasks.workunit.client.0.smithi103.stdout:1/534: creat d2/d1c/d28/d4b/d74/fae x:0 0 0 2024-09-17T01:07:15.947 INFO:tasks.workunit.client.0.smithi103.stdout:6/478: write d3/d16/f1f [4954658,78939] 0 2024-09-17T01:07:15.951 INFO:tasks.workunit.client.0.smithi103.stdout:1/535: write d2/d16/f40 [7438196,28231] 0 2024-09-17T01:07:15.953 INFO:tasks.workunit.client.0.smithi103.stdout:0/423: dwrite dd/d43/f58 [0,4194304] 0 2024-09-17T01:07:15.954 INFO:tasks.workunit.client.0.smithi103.stdout:2/483: rename d6/da/d5d/d8d/d60/d75/d70/c8f to d6/da/c9e 0 2024-09-17T01:07:15.956 INFO:tasks.workunit.client.0.smithi103.stdout:2/484: stat d6/da/d5d/d8d/d60/d75 0 2024-09-17T01:07:15.956 INFO:tasks.workunit.client.0.smithi103.stdout:8/447: creat d0/d6/dc/d30/d25/f8d x:0 0 0 2024-09-17T01:07:15.958 INFO:tasks.workunit.client.0.smithi103.stdout:1/536: mkdir d2/d1c/d28/d4b/d67/d9e/daf 0 2024-09-17T01:07:15.958 INFO:tasks.workunit.client.0.smithi103.stdout:6/479: dread d3/d16/f1b [0,4194304] 0 2024-09-17T01:07:15.958 INFO:tasks.workunit.client.0.smithi103.stdout:6/480: chown d3/d17/f6f 384 1 2024-09-17T01:07:15.961 INFO:tasks.workunit.client.0.smithi103.stdout:8/448: read d0/d6/dc/d30/d2d/f3c [3167786,40747] 0 2024-09-17T01:07:15.962 INFO:tasks.workunit.client.0.smithi103.stdout:8/449: dread - d0/f44 zero size 2024-09-17T01:07:15.962 INFO:tasks.workunit.client.0.smithi103.stdout:6/481: truncate d3/d16/d21/fa2 1006455 0 2024-09-17T01:07:15.964 INFO:tasks.workunit.client.0.smithi103.stdout:1/537: creat d2/d16/fb0 x:0 0 0 2024-09-17T01:07:15.968 INFO:tasks.workunit.client.0.smithi103.stdout:6/482: symlink d3/d25/d74/la8 0 2024-09-17T01:07:15.971 INFO:tasks.workunit.client.0.smithi103.stdout:6/483: rmdir d3/d16/d33/d57 39 2024-09-17T01:07:15.972 INFO:tasks.workunit.client.0.smithi103.stdout:1/538: symlink d2/d1c/d28/lb1 0 2024-09-17T01:07:15.972 INFO:tasks.workunit.client.0.smithi103.stdout:8/450: rmdir d0/d6 39 2024-09-17T01:07:15.974 INFO:tasks.workunit.client.0.smithi103.stdout:6/484: rmdir d3/d17/d2f 39 2024-09-17T01:07:15.975 INFO:tasks.workunit.client.0.smithi103.stdout:6/485: fdatasync d3/d25/d26/f4a 0 2024-09-17T01:07:15.976 INFO:tasks.workunit.client.0.smithi103.stdout:6/486: write d3/f36 [187987,16634] 0 2024-09-17T01:07:15.977 INFO:tasks.workunit.client.0.smithi103.stdout:0/424: write dd/df/d38/d55/f8a [605280,126362] 0 2024-09-17T01:07:15.977 INFO:tasks.workunit.client.0.smithi103.stdout:1/539: fdatasync d2/f8 0 2024-09-17T01:07:15.979 INFO:tasks.workunit.client.0.smithi103.stdout:6/487: fsync d3/d16/d21/d56/f97 0 2024-09-17T01:07:15.981 INFO:tasks.workunit.client.0.smithi103.stdout:1/540: mknod d2/de/d1f/cb2 0 2024-09-17T01:07:15.982 INFO:tasks.workunit.client.0.smithi103.stdout:6/488: write d3/d25/d26/f8a [77684,117442] 0 2024-09-17T01:07:15.985 INFO:tasks.workunit.client.0.smithi103.stdout:8/451: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e 0 2024-09-17T01:07:15.986 INFO:tasks.workunit.client.0.smithi103.stdout:2/485: dwrite d6/d5f/f1e [0,4194304] 0 2024-09-17T01:07:15.986 INFO:tasks.workunit.client.0.smithi103.stdout:0/425: creat dd/f95 x:0 0 0 2024-09-17T01:07:15.987 INFO:tasks.workunit.client.0.smithi103.stdout:0/426: chown dd/d1c/f1d 14 1 2024-09-17T01:07:15.991 INFO:tasks.workunit.client.0.smithi103.stdout:2/486: creat d6/da/d5d/d8d/d60/d75/d70/f9f x:0 0 0 2024-09-17T01:07:15.991 INFO:tasks.workunit.client.0.smithi103.stdout:6/489: getdents d3/d16/d33/d3e/d58/d82 0 2024-09-17T01:07:15.992 INFO:tasks.workunit.client.0.smithi103.stdout:6/490: dread - d3/d16/d33/f9f zero size 2024-09-17T01:07:15.993 INFO:tasks.workunit.client.0.smithi103.stdout:0/427: mkdir dd/d4f/d96 0 2024-09-17T01:07:15.995 INFO:tasks.workunit.client.0.smithi103.stdout:8/452: creat d0/d6/dc/f8f x:0 0 0 2024-09-17T01:07:15.996 INFO:tasks.workunit.client.0.smithi103.stdout:2/487: unlink d6/d5f/d26/d6e/f92 0 2024-09-17T01:07:15.997 INFO:tasks.workunit.client.0.smithi103.stdout:8/453: write d0/d6/dc/d30/d25/d64/d34/f5a [3374846,81792] 0 2024-09-17T01:07:15.999 INFO:tasks.workunit.client.0.smithi103.stdout:8/454: chown d0/d6/dc/d30/d2d/f65 8858574 1 2024-09-17T01:07:16.000 INFO:tasks.workunit.client.0.smithi103.stdout:2/488: read d6/d5f/d26/d66/df/f59 [3933740,64616] 0 2024-09-17T01:07:16.001 INFO:tasks.workunit.client.0.smithi103.stdout:2/489: chown d6/da/d28/f35 38414 1 2024-09-17T01:07:16.002 INFO:tasks.workunit.client.0.smithi103.stdout:6/491: rename d3/d25/d74/la1 to d3/d16/d21/d56/la9 0 2024-09-17T01:07:16.007 INFO:tasks.workunit.client.0.smithi103.stdout:6/492: symlink d3/d16/d33/d3e/d58/laa 0 2024-09-17T01:07:16.009 INFO:tasks.workunit.client.0.smithi103.stdout:2/490: creat d6/d5f/d26/d34/d80/fa0 x:0 0 0 2024-09-17T01:07:16.010 INFO:tasks.workunit.client.0.smithi103.stdout:6/493: mkdir d3/d16/d21/dab 0 2024-09-17T01:07:16.012 INFO:tasks.workunit.client.0.smithi103.stdout:2/491: mkdir d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1 0 2024-09-17T01:07:16.014 INFO:tasks.workunit.client.0.smithi103.stdout:6/494: fdatasync d3/d16/d33/d57/f7a 0 2024-09-17T01:07:16.016 INFO:tasks.workunit.client.0.smithi103.stdout:8/455: write d0/d6/f4f [2927793,117959] 0 2024-09-17T01:07:16.018 INFO:tasks.workunit.client.0.smithi103.stdout:0/428: dwrite dd/d4f/f2a [0,4194304] 0 2024-09-17T01:07:16.019 INFO:tasks.workunit.client.0.smithi103.stdout:8/456: stat d0/d6/dc/d30/d25/d64/f4d 0 2024-09-17T01:07:16.021 INFO:tasks.workunit.client.0.smithi103.stdout:6/495: symlink d3/d17/d2f/lac 0 2024-09-17T01:07:16.023 INFO:tasks.workunit.client.0.smithi103.stdout:2/492: creat d6/da/d5d/d8d/d60/fa2 x:0 0 0 2024-09-17T01:07:16.024 INFO:tasks.workunit.client.0.smithi103.stdout:2/493: chown d6/d5f/d26/d66/df/d68/d7e/d8b 11 1 2024-09-17T01:07:16.035 INFO:tasks.workunit.client.0.smithi103.stdout:2/494: creat d6/d5f/d26/d66/df/d68/d7e/d9c/fa3 x:0 0 0 2024-09-17T01:07:16.039 INFO:tasks.workunit.client.0.smithi103.stdout:6/496: unlink d3/d25/d74/c92 0 2024-09-17T01:07:16.040 INFO:tasks.workunit.client.0.smithi103.stdout:6/497: chown d3/d25/d74/f76 827 1 2024-09-17T01:07:16.041 INFO:tasks.workunit.client.0.smithi103.stdout:8/457: dwrite d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:16.042 INFO:tasks.workunit.client.0.smithi103.stdout:0/429: rmdir dd/d4f/d96 0 2024-09-17T01:07:16.046 INFO:tasks.workunit.client.0.smithi103.stdout:0/430: readlink dd/df/d38/l5b 0 2024-09-17T01:07:16.048 INFO:tasks.workunit.client.0.smithi103.stdout:2/495: creat d6/d5f/d26/d66/df/fa4 x:0 0 0 2024-09-17T01:07:16.056 INFO:tasks.workunit.client.0.smithi103.stdout:6/498: fsync d3/d16/d21/fa2 0 2024-09-17T01:07:16.057 INFO:tasks.workunit.client.0.smithi103.stdout:2/496: dwrite d6/d5f/d26/f5a [0,4194304] 0 2024-09-17T01:07:16.059 INFO:tasks.workunit.client.0.smithi103.stdout:2/497: chown d6/d5f/d26/d6e/c93 33138 1 2024-09-17T01:07:16.062 INFO:tasks.workunit.client.0.smithi103.stdout:2/498: chown d6 220 1 2024-09-17T01:07:16.062 INFO:tasks.workunit.client.0.smithi103.stdout:2/499: fdatasync d6/d5f/d26/d66/df/fa4 0 2024-09-17T01:07:16.062 INFO:tasks.workunit.client.0.smithi103.stdout:8/458: dwrite d0/f4e [0,4194304] 0 2024-09-17T01:07:16.066 INFO:tasks.workunit.client.0.smithi103.stdout:6/499: rename d3/d17 to d3/d16/dad 0 2024-09-17T01:07:16.067 INFO:tasks.workunit.client.0.smithi103.stdout:6/500: write d3/ff [8645795,71963] 0 2024-09-17T01:07:16.069 INFO:tasks.workunit.client.0.smithi103.stdout:6/501: chown d3/d25/d74/c9d 2 1 2024-09-17T01:07:16.070 INFO:tasks.workunit.client.0.smithi103.stdout:8/459: truncate d0/d6/f36 2915124 0 2024-09-17T01:07:16.072 INFO:tasks.workunit.client.0.smithi103.stdout:6/502: mkdir d3/d25/dae 0 2024-09-17T01:07:16.076 INFO:tasks.workunit.client.0.smithi103.stdout:0/431: dread dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:16.077 INFO:tasks.workunit.client.0.smithi103.stdout:2/500: dwrite d6/da/d28/f4d [0,4194304] 0 2024-09-17T01:07:16.080 INFO:tasks.workunit.client.0.smithi103.stdout:8/460: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90 0 2024-09-17T01:07:16.082 INFO:tasks.workunit.client.0.smithi103.stdout:8/461: fdatasync d0/d6/dc/d30/d25/d64/f75 0 2024-09-17T01:07:16.084 INFO:tasks.workunit.client.0.smithi103.stdout:6/503: creat d3/d16/d21/d50/faf x:0 0 0 2024-09-17T01:07:16.084 INFO:tasks.workunit.client.0.smithi103.stdout:0/432: truncate dd/df/d38/d55/f71 189428 0 2024-09-17T01:07:16.085 INFO:tasks.workunit.client.0.smithi103.stdout:6/504: chown d3/d16/d21/d56 1006088 1 2024-09-17T01:07:16.086 INFO:tasks.workunit.client.0.smithi103.stdout:6/505: stat d3/d16/d33/d3e/f98 0 2024-09-17T01:07:16.090 INFO:tasks.workunit.client.0.smithi103.stdout:0/433: write dd/df/f41 [8667957,101624] 0 2024-09-17T01:07:16.091 INFO:tasks.workunit.client.0.smithi103.stdout:0/434: write dd/f77 [1117515,25921] 0 2024-09-17T01:07:16.094 INFO:tasks.workunit.client.0.smithi103.stdout:8/462: mknod d0/d6/dc/d30/d25/d7d/c91 0 2024-09-17T01:07:16.098 INFO:tasks.workunit.client.0.smithi103.stdout:0/435: mkdir dd/d4f/d97 0 2024-09-17T01:07:16.099 INFO:tasks.workunit.client.0.smithi103.stdout:6/506: creat d3/d16/d33/d3e/fb0 x:0 0 0 2024-09-17T01:07:16.104 INFO:tasks.workunit.client.0.smithi103.stdout:2/501: truncate d6/f4b 2284440 0 2024-09-17T01:07:16.105 INFO:tasks.workunit.client.0.smithi103.stdout:0/436: dwrite dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:16.107 INFO:tasks.workunit.client.0.smithi103.stdout:0/437: readlink l7 0 2024-09-17T01:07:16.112 INFO:tasks.workunit.client.0.smithi103.stdout:6/507: creat d3/d16/d21/d50/fb1 x:0 0 0 2024-09-17T01:07:16.114 INFO:tasks.workunit.client.0.smithi103.stdout:9/492: sync 2024-09-17T01:07:16.116 INFO:tasks.workunit.client.0.smithi103.stdout:8/463: write d0/f44 [196858,61312] 0 2024-09-17T01:07:16.121 INFO:tasks.workunit.client.0.smithi103.stdout:6/508: readlink d3/d25/d26/d3a/l46 0 2024-09-17T01:07:16.122 INFO:tasks.workunit.client.0.smithi103.stdout:2/502: write d6/d5f/d26/d66/df/f59 [2517261,49244] 0 2024-09-17T01:07:16.126 INFO:tasks.workunit.client.0.smithi103.stdout:6/509: fsync d3/f9 0 2024-09-17T01:07:16.128 INFO:tasks.workunit.client.0.smithi103.stdout:2/503: write d6/da/d5d/d8d/d60/d75/d70/f9f [832533,2872] 0 2024-09-17T01:07:16.131 INFO:tasks.workunit.client.0.smithi103.stdout:9/493: dwrite d7/d43/d88/d11/d21/f69 [0,4194304] 0 2024-09-17T01:07:16.131 INFO:tasks.workunit.client.0.smithi103.stdout:8/464: dwrite d0/d6/dc/d30/d25/d64/f4d [0,4194304] 0 2024-09-17T01:07:16.137 INFO:tasks.workunit.client.0.smithi103.stdout:2/504: creat d6/d5f/d26/d66/df/d68/d7e/d9c/fa5 x:0 0 0 2024-09-17T01:07:16.138 INFO:tasks.workunit.client.0.smithi103.stdout:2/505: write d6/d5f/f5e [618206,91696] 0 2024-09-17T01:07:16.141 INFO:tasks.workunit.client.0.smithi103.stdout:2/506: write d6/d5f/d26/d66/df/d68/d7e/d9c/fa5 [228718,99788] 0 2024-09-17T01:07:16.142 INFO:tasks.workunit.client.0.smithi103.stdout:9/494: creat d7/d43/d88/d11/d20/d4f/fa9 x:0 0 0 2024-09-17T01:07:16.143 INFO:tasks.workunit.client.0.smithi103.stdout:6/510: symlink d3/d16/d21/d56/d9a/lb2 0 2024-09-17T01:07:16.144 INFO:tasks.workunit.client.0.smithi103.stdout:8/465: rmdir d0/d6/dc/d30/d2d 39 2024-09-17T01:07:16.147 INFO:tasks.workunit.client.0.smithi103.stdout:2/507: creat d6/d5f/d26/d34/d80/fa6 x:0 0 0 2024-09-17T01:07:16.149 INFO:tasks.workunit.client.0.smithi103.stdout:6/511: chown d3/l68 1258005 1 2024-09-17T01:07:16.151 INFO:tasks.workunit.client.0.smithi103.stdout:9/495: creat d7/d43/d5f/d7d/d80/d93/faa x:0 0 0 2024-09-17T01:07:16.152 INFO:tasks.workunit.client.0.smithi103.stdout:8/466: mknod d0/d6/dc/d30/d25/d64/c92 0 2024-09-17T01:07:16.153 INFO:tasks.workunit.client.0.smithi103.stdout:8/467: chown d0/d6/dc/d30 0 1 2024-09-17T01:07:16.154 INFO:tasks.workunit.client.0.smithi103.stdout:8/468: write d0/d6/f77 [1009949,97915] 0 2024-09-17T01:07:16.154 INFO:tasks.workunit.client.0.smithi103.stdout:2/508: symlink d6/d5f/d26/d66/df/d68/la7 0 2024-09-17T01:07:16.157 INFO:tasks.workunit.client.0.smithi103.stdout:8/469: write d0/f44 [775502,17480] 0 2024-09-17T01:07:16.158 INFO:tasks.workunit.client.0.smithi103.stdout:0/438: dread dd/df/d38/f33 [0,4194304] 0 2024-09-17T01:07:16.159 INFO:tasks.workunit.client.0.smithi103.stdout:9/496: symlink d7/d43/d5f/d7d/d80/d93/lab 0 2024-09-17T01:07:16.161 INFO:tasks.workunit.client.0.smithi103.stdout:9/497: dread - d7/f87 zero size 2024-09-17T01:07:16.166 INFO:tasks.workunit.client.0.smithi103.stdout:0/439: dwrite dd/df/d38/d55/f8a [0,4194304] 0 2024-09-17T01:07:16.172 INFO:tasks.workunit.client.0.smithi103.stdout:8/470: dwrite d0/d6/dc/d30/d25/d64/d59/f5f [0,4194304] 0 2024-09-17T01:07:16.173 INFO:tasks.workunit.client.0.smithi103.stdout:6/512: link d3/d16/d33/d57/d63/l69 d3/d16/d33/d3e/d58/lb3 0 2024-09-17T01:07:16.174 INFO:tasks.workunit.client.0.smithi103.stdout:9/498: readlink d7/d2d/d59/la2 0 2024-09-17T01:07:16.185 INFO:tasks.workunit.client.0.smithi103.stdout:9/499: mkdir d7/d43/d88/d11/d5c/d8d/dac 0 2024-09-17T01:07:16.186 INFO:tasks.workunit.client.0.smithi103.stdout:2/509: rename d6/d5f/d74 to d6/d5f/d26/d66/da8 0 2024-09-17T01:07:16.187 INFO:tasks.workunit.client.0.smithi103.stdout:9/500: fdatasync d7/f55 0 2024-09-17T01:07:16.190 INFO:tasks.workunit.client.0.smithi103.stdout:2/510: mknod d6/da/d5d/d8d/d60/d75/ca9 0 2024-09-17T01:07:16.193 INFO:tasks.workunit.client.0.smithi103.stdout:8/471: getdents d0 0 2024-09-17T01:07:16.193 INFO:tasks.workunit.client.0.smithi103.stdout:2/511: dread - d6/d5f/d26/d66/df/d68/d7e/d9c/f67 zero size 2024-09-17T01:07:16.200 INFO:tasks.workunit.client.0.smithi103.stdout:8/472: creat d0/f93 x:0 0 0 2024-09-17T01:07:16.213 INFO:tasks.workunit.client.0.smithi103.stdout:2/512: dread d6/d5f/d26/f32 [0,4194304] 0 2024-09-17T01:07:16.213 INFO:tasks.workunit.client.0.smithi103.stdout:9/501: dread d7/f55 [4194304,4194304] 0 2024-09-17T01:07:16.218 INFO:tasks.workunit.client.0.smithi103.stdout:9/502: rename l3 to d7/d43/d88/d11/d5c/lad 0 2024-09-17T01:07:16.220 INFO:tasks.workunit.client.0.smithi103.stdout:9/503: truncate d7/d43/d88/f38 69152 0 2024-09-17T01:07:16.221 INFO:tasks.workunit.client.0.smithi103.stdout:9/504: fdatasync d7/d43/d88/d11/fb 0 2024-09-17T01:07:16.225 INFO:tasks.workunit.client.0.smithi103.stdout:9/505: mkdir d7/d43/d88/d11/d5c/d8d/dac/dae 0 2024-09-17T01:07:16.228 INFO:tasks.workunit.client.0.smithi103.stdout:0/440: dwrite dd/df/f5f [0,4194304] 0 2024-09-17T01:07:16.228 INFO:tasks.workunit.client.0.smithi103.stdout:6/513: truncate d3/d16/d21/f3b 1931288 0 2024-09-17T01:07:16.230 INFO:tasks.workunit.client.0.smithi103.stdout:6/514: chown d3/d16/dad/f32 1547621 1 2024-09-17T01:07:16.234 INFO:tasks.workunit.client.0.smithi103.stdout:2/513: write d6/d5f/d26/d34/f73 [575026,100643] 0 2024-09-17T01:07:16.238 INFO:tasks.workunit.client.0.smithi103.stdout:0/441: creat dd/d4f/d97/f98 x:0 0 0 2024-09-17T01:07:16.240 INFO:tasks.workunit.client.0.smithi103.stdout:6/515: dwrite d3/f18 [4194304,4194304] 0 2024-09-17T01:07:16.243 INFO:tasks.workunit.client.0.smithi103.stdout:8/473: chown d0/d6/dc/d30/d25/d64/d59 1775385961 1 2024-09-17T01:07:16.252 INFO:tasks.workunit.client.0.smithi103.stdout:8/474: mkdir d0/d6/dc/d3d/d6d/d94 0 2024-09-17T01:07:16.252 INFO:tasks.workunit.client.0.smithi103.stdout:0/442: fsync dd/df/f3d 0 2024-09-17T01:07:16.256 INFO:tasks.workunit.client.0.smithi103.stdout:9/506: dwrite d7/d43/d88/d11/d21/f5b [0,4194304] 0 2024-09-17T01:07:16.257 INFO:tasks.workunit.client.0.smithi103.stdout:0/443: creat dd/d1c/d50/f99 x:0 0 0 2024-09-17T01:07:16.257 INFO:tasks.workunit.client.0.smithi103.stdout:9/507: chown d7/d43/d88/d11/d21/l28 22891269 1 2024-09-17T01:07:16.258 INFO:tasks.workunit.client.0.smithi103.stdout:8/475: mknod d0/d6/dc/d30/d25/d7d/c95 0 2024-09-17T01:07:16.261 INFO:tasks.workunit.client.0.smithi103.stdout:9/508: dread - d7/d43/d88/d11/d20/d8e/f91 zero size 2024-09-17T01:07:16.268 INFO:tasks.workunit.client.0.smithi103.stdout:6/516: write d3/f9 [4253131,35767] 0 2024-09-17T01:07:16.271 INFO:tasks.workunit.client.0.smithi103.stdout:8/476: unlink d0/d6/f36 0 2024-09-17T01:07:16.271 INFO:tasks.workunit.client.0.smithi103.stdout:2/514: dread d6/d5f/d26/f63 [0,4194304] 0 2024-09-17T01:07:16.273 INFO:tasks.workunit.client.0.smithi103.stdout:6/517: truncate d3/d16/d21/d50/faf 871919 0 2024-09-17T01:07:16.274 INFO:tasks.workunit.client.0.smithi103.stdout:0/444: rmdir dd 39 2024-09-17T01:07:16.275 INFO:tasks.workunit.client.0.smithi103.stdout:9/509: dwrite d7/d43/d88/f83 [0,4194304] 0 2024-09-17T01:07:16.280 INFO:tasks.workunit.client.0.smithi103.stdout:8/477: dread d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:16.281 INFO:tasks.workunit.client.0.smithi103.stdout:2/515: creat d6/d5f/d26/d66/df/d68/d7e/faa x:0 0 0 2024-09-17T01:07:16.281 INFO:tasks.workunit.client.0.smithi103.stdout:6/518: rmdir d3/d16/d33/d57 39 2024-09-17T01:07:16.282 INFO:tasks.workunit.client.0.smithi103.stdout:2/516: chown d6/da/d5d/d8d/d89 384077 1 2024-09-17T01:07:16.282 INFO:tasks.workunit.client.0.smithi103.stdout:6/519: fdatasync d3/d25/d26/f2e 0 2024-09-17T01:07:16.286 INFO:tasks.workunit.client.0.smithi103.stdout:8/478: unlink d0/d6/dc/l29 0 2024-09-17T01:07:16.286 INFO:tasks.workunit.client.0.smithi103.stdout:6/520: dread d3/d16/d21/d50/faf [0,4194304] 0 2024-09-17T01:07:16.287 INFO:tasks.workunit.client.0.smithi103.stdout:0/445: mkdir dd/d5d/d93/d9a 0 2024-09-17T01:07:16.289 INFO:tasks.workunit.client.0.smithi103.stdout:0/446: write f3 [3200993,120414] 0 2024-09-17T01:07:16.290 INFO:tasks.workunit.client.0.smithi103.stdout:2/517: symlink d6/d5f/d26/d6e/lab 0 2024-09-17T01:07:16.296 INFO:tasks.workunit.client.0.smithi103.stdout:9/510: dread d7/d43/d5f/d7d/d80/d93/f94 [0,4194304] 0 2024-09-17T01:07:16.296 INFO:tasks.workunit.client.0.smithi103.stdout:6/521: creat d3/d16/d21/dab/fb4 x:0 0 0 2024-09-17T01:07:16.298 INFO:tasks.workunit.client.0.smithi103.stdout:8/479: truncate d0/d6/dc/d30/d25/d64/d34/f47 751775 0 2024-09-17T01:07:16.299 INFO:tasks.workunit.client.0.smithi103.stdout:2/518: creat d6/d5f/fac x:0 0 0 2024-09-17T01:07:16.301 INFO:tasks.workunit.client.0.smithi103.stdout:9/511: unlink d7/d43/d88/f2c 0 2024-09-17T01:07:16.305 INFO:tasks.workunit.client.0.smithi103.stdout:8/480: write d0/f4e [2992251,50341] 0 2024-09-17T01:07:16.307 INFO:tasks.workunit.client.0.smithi103.stdout:6/522: mkdir d3/d16/d33/d57/d63/d60/db5 0 2024-09-17T01:07:16.311 INFO:tasks.workunit.client.0.smithi103.stdout:8/481: chown d0/d80 298757 1 2024-09-17T01:07:16.311 INFO:tasks.workunit.client.0.smithi103.stdout:0/447: dwrite dd/df/d38/f60 [0,4194304] 0 2024-09-17T01:07:16.316 INFO:tasks.workunit.client.0.smithi103.stdout:2/519: mkdir d6/d5f/dad 0 2024-09-17T01:07:16.318 INFO:tasks.workunit.client.0.smithi103.stdout:6/523: dwrite d3/d16/dad/f7f [0,4194304] 0 2024-09-17T01:07:16.325 INFO:tasks.workunit.client.0.smithi103.stdout:8/482: dread d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:16.330 INFO:tasks.workunit.client.0.smithi103.stdout:6/524: creat d3/d25/dae/fb6 x:0 0 0 2024-09-17T01:07:16.332 INFO:tasks.workunit.client.0.smithi103.stdout:2/520: dread d6/f97 [4194304,4194304] 0 2024-09-17T01:07:16.336 INFO:tasks.workunit.client.0.smithi103.stdout:9/512: dread d7/d2d/f37 [0,4194304] 0 2024-09-17T01:07:16.339 INFO:tasks.workunit.client.0.smithi103.stdout:8/483: creat d0/f96 x:0 0 0 2024-09-17T01:07:16.341 INFO:tasks.workunit.client.0.smithi103.stdout:0/448: dread dd/df/f26 [0,4194304] 0 2024-09-17T01:07:16.343 INFO:tasks.workunit.client.0.smithi103.stdout:2/521: rename d6/f7 to d6/da/d3f/fae 0 2024-09-17T01:07:16.345 INFO:tasks.workunit.client.0.smithi103.stdout:6/525: link d3/d16/f1f d3/d16/d33/d3e/fb7 0 2024-09-17T01:07:16.345 INFO:tasks.workunit.client.0.smithi103.stdout:6/526: dread - d3/d16/d33/f9f zero size 2024-09-17T01:07:16.347 INFO:tasks.workunit.client.0.smithi103.stdout:8/484: chown d0/d6/dc/d30/d25/d64/f87 7583 1 2024-09-17T01:07:16.350 INFO:tasks.workunit.client.0.smithi103.stdout:0/449: creat dd/d5d/f9b x:0 0 0 2024-09-17T01:07:16.354 INFO:tasks.workunit.client.0.smithi103.stdout:6/527: rmdir d3/d16/d21 39 2024-09-17T01:07:16.361 INFO:tasks.workunit.client.0.smithi103.stdout:9/513: dwrite d7/fc [4194304,4194304] 0 2024-09-17T01:07:16.362 INFO:tasks.workunit.client.0.smithi103.stdout:8/485: dwrite d0/d6/dc/d30/f1f [0,4194304] 0 2024-09-17T01:07:16.362 INFO:tasks.workunit.client.0.smithi103.stdout:6/528: creat d3/d16/d21/d50/fb8 x:0 0 0 2024-09-17T01:07:16.363 INFO:tasks.workunit.client.0.smithi103.stdout:6/529: readlink d3/d16/d21/l6a 0 2024-09-17T01:07:16.363 INFO:tasks.workunit.client.0.smithi103.stdout:9/514: write d7/d43/d88/d11/d21/f5b [3209204,22485] 0 2024-09-17T01:07:16.364 INFO:tasks.workunit.client.0.smithi103.stdout:9/515: stat d7/d43/d88/d11/d20/d4f/f75 0 2024-09-17T01:07:16.366 INFO:tasks.workunit.client.0.smithi103.stdout:9/516: read - d7/d43/d79/f8b zero size 2024-09-17T01:07:16.373 INFO:tasks.workunit.client.0.smithi103.stdout:6/530: dwrite d3/d16/d21/dab/fb4 [0,4194304] 0 2024-09-17T01:07:16.377 INFO:tasks.workunit.client.0.smithi103.stdout:9/517: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/faf x:0 0 0 2024-09-17T01:07:16.378 INFO:tasks.workunit.client.0.smithi103.stdout:9/518: chown d7/d43/d88/d11/d5c/d5e/d6c/d6e 379644719 1 2024-09-17T01:07:16.378 INFO:tasks.workunit.client.0.smithi103.stdout:8/486: fsync d0/d6/dc/d30/d2d/f65 0 2024-09-17T01:07:16.380 INFO:tasks.workunit.client.0.smithi103.stdout:8/487: chown d0/f96 87012745 1 2024-09-17T01:07:16.385 INFO:tasks.workunit.client.0.smithi103.stdout:6/531: mknod d3/cb9 0 2024-09-17T01:07:16.386 INFO:tasks.workunit.client.0.smithi103.stdout:9/519: dwrite d7/fc [4194304,4194304] 0 2024-09-17T01:07:16.389 INFO:tasks.workunit.client.0.smithi103.stdout:8/488: mknod d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90/c97 0 2024-09-17T01:07:16.392 INFO:tasks.workunit.client.0.smithi103.stdout:6/532: dwrite d3/d16/d21/dab/fb4 [0,4194304] 0 2024-09-17T01:07:16.394 INFO:tasks.workunit.client.0.smithi103.stdout:9/520: creat d7/d43/d88/d11/d20/d8e/fb0 x:0 0 0 2024-09-17T01:07:16.399 INFO:tasks.workunit.client.0.smithi103.stdout:9/521: write d7/d43/d88/d11/d5c/d5e/d6c/d6e/f96 [723460,70511] 0 2024-09-17T01:07:16.400 INFO:tasks.workunit.client.0.smithi103.stdout:6/533: readlink d3/la 0 2024-09-17T01:07:16.400 INFO:tasks.workunit.client.0.smithi103.stdout:2/522: dwrite d6/f4b [0,4194304] 0 2024-09-17T01:07:16.409 INFO:tasks.workunit.client.0.smithi103.stdout:9/522: dwrite d7/d43/d88/d11/d20/d8e/fb0 [0,4194304] 0 2024-09-17T01:07:16.413 INFO:tasks.workunit.client.0.smithi103.stdout:2/523: write d6/d5f/d26/f63 [5073570,54797] 0 2024-09-17T01:07:16.416 INFO:tasks.workunit.client.0.smithi103.stdout:9/523: mkdir d7/d43/d88/d11/d5c/d5e/d6c/d6e/db1 0 2024-09-17T01:07:16.420 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:07:16.420 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:07:16.420 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:07:16.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:07:16.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:16 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.424 INFO:tasks.workunit.client.0.smithi103.stdout:9/524: fsync d7/d43/d88/d11/d5c/fa1 0 2024-09-17T01:07:16.429 INFO:tasks.workunit.client.0.smithi103.stdout:6/534: dwrite d3/d16/dad/f2a [0,4194304] 0 2024-09-17T01:07:16.431 INFO:tasks.workunit.client.0.smithi103.stdout:9/525: creat d7/d43/d88/d11/d5c/d8d/fb2 x:0 0 0 2024-09-17T01:07:16.434 INFO:tasks.workunit.client.0.smithi103.stdout:9/526: write d7/d43/d5f/d7d/d80/d93/f94 [4823556,70973] 0 2024-09-17T01:07:16.436 INFO:tasks.workunit.client.0.smithi103.stdout:6/535: symlink d3/d16/d33/d3e/d58/d82/lba 0 2024-09-17T01:07:16.437 INFO:tasks.workunit.client.0.smithi103.stdout:2/524: truncate d6/da/d28/f35 1478091 0 2024-09-17T01:07:16.441 INFO:tasks.workunit.client.0.smithi103.stdout:6/536: rmdir d3/d25/d74 39 2024-09-17T01:07:16.445 INFO:tasks.workunit.client.0.smithi103.stdout:9/527: dwrite d7/d2d/d59/f68 [0,4194304] 0 2024-09-17T01:07:16.447 INFO:tasks.workunit.client.0.smithi103.stdout:6/537: unlink d3/d16/d33/c3d 0 2024-09-17T01:07:16.449 INFO:tasks.workunit.client.0.smithi103.stdout:2/525: mknod d6/d5f/dad/caf 0 2024-09-17T01:07:16.450 INFO:tasks.workunit.client.0.smithi103.stdout:9/528: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/fb3 x:0 0 0 2024-09-17T01:07:16.453 INFO:tasks.workunit.client.0.smithi103.stdout:6/538: unlink d3/d16/d21/l99 0 2024-09-17T01:07:16.460 INFO:tasks.workunit.client.0.smithi103.stdout:6/539: symlink d3/d25/d26/d3a/lbb 0 2024-09-17T01:07:16.462 INFO:tasks.workunit.client.0.smithi103.stdout:6/540: chown d3/d25/c4d 1254 1 2024-09-17T01:07:16.465 INFO:tasks.workunit.client.0.smithi103.stdout:9/529: dwrite d7/f53 [4194304,4194304] 0 2024-09-17T01:07:16.469 INFO:tasks.workunit.client.0.smithi103.stdout:9/530: mkdir d7/db4 0 2024-09-17T01:07:16.472 INFO:tasks.workunit.client.0.smithi103.stdout:2/526: dwrite d6/da/d5d/d8d/d60/d75/f49 [0,4194304] 0 2024-09-17T01:07:16.475 INFO:tasks.workunit.client.0.smithi103.stdout:2/527: truncate d6/d5f/d26/d34/d80/fa0 514301 0 2024-09-17T01:07:16.480 INFO:tasks.workunit.client.0.smithi103.stdout:6/541: dread d3/f11 [0,4194304] 0 2024-09-17T01:07:16.481 INFO:tasks.workunit.client.0.smithi103.stdout:9/531: link c4 d7/d43/cb5 0 2024-09-17T01:07:16.488 INFO:tasks.workunit.client.0.smithi103.stdout:9/532: dread d7/d43/d88/d11/d20/d8e/fb0 [0,4194304] 0 2024-09-17T01:07:16.492 INFO:tasks.workunit.client.0.smithi103.stdout:6/542: dwrite d3/d25/d26/d3a/f6b [0,4194304] 0 2024-09-17T01:07:16.496 INFO:tasks.workunit.client.0.smithi103.stdout:6/543: rmdir d3/d16/d33/d57/d63/d60 39 2024-09-17T01:07:16.502 INFO:tasks.workunit.client.0.smithi103.stdout:6/544: creat d3/d16/fbc x:0 0 0 2024-09-17T01:07:16.504 INFO:tasks.workunit.client.0.smithi103.stdout:2/528: dwrite d6/da/d28/f35 [0,4194304] 0 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:16 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:16.508 INFO:tasks.workunit.client.0.smithi103.stdout:6/545: fsync d3/d16/d21/d50/faf 0 2024-09-17T01:07:16.509 INFO:tasks.workunit.client.0.smithi103.stdout:2/529: read - d6/da/d5d/d8d/d60/d75/f91 zero size 2024-09-17T01:07:16.510 INFO:tasks.workunit.client.0.smithi103.stdout:9/533: dwrite d7/d43/d88/f50 [0,4194304] 0 2024-09-17T01:07:16.513 INFO:tasks.workunit.client.0.smithi103.stdout:6/546: unlink d3/d25/d26/d3a/l81 0 2024-09-17T01:07:16.519 INFO:tasks.workunit.client.0.smithi103.stdout:9/534: mkdir d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6 0 2024-09-17T01:07:16.520 INFO:tasks.workunit.client.0.smithi103.stdout:6/547: mknod d3/d16/d21/d56/cbd 0 2024-09-17T01:07:16.523 INFO:tasks.workunit.client.0.smithi103.stdout:2/530: dwrite d6/da/f64 [0,4194304] 0 2024-09-17T01:07:16.524 INFO:tasks.workunit.client.0.smithi103.stdout:6/548: unlink d3/d16/d21/f5e 0 2024-09-17T01:07:16.529 INFO:tasks.workunit.client.0.smithi103.stdout:9/535: dwrite d7/d43/d88/d11/d5c/d5e/d6c/f92 [0,4194304] 0 2024-09-17T01:07:16.531 INFO:tasks.workunit.client.0.smithi103.stdout:2/531: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/cb0 0 2024-09-17T01:07:16.534 INFO:tasks.workunit.client.0.smithi103.stdout:2/532: write d6/d5f/d26/d6e/f98 [678653,105223] 0 2024-09-17T01:07:16.534 INFO:tasks.workunit.client.0.smithi103.stdout:9/536: creat d7/d43/d5f/fb7 x:0 0 0 2024-09-17T01:07:16.542 INFO:tasks.workunit.client.0.smithi103.stdout:2/533: dwrite d6/da/d5d/d8d/d60/f9d [0,4194304] 0 2024-09-17T01:07:16.544 INFO:tasks.workunit.client.0.smithi103.stdout:6/549: write d3/d16/dad/d2f/f34 [941916,105703] 0 2024-09-17T01:07:16.546 INFO:tasks.workunit.client.0.smithi103.stdout:2/534: mknod d6/da/cb1 0 2024-09-17T01:07:16.548 INFO:tasks.workunit.client.0.smithi103.stdout:2/535: write d6/da/d3f/f4a [93615,51704] 0 2024-09-17T01:07:16.555 INFO:tasks.workunit.client.0.smithi103.stdout:2/536: dwrite d6/f72 [0,4194304] 0 2024-09-17T01:07:16.558 INFO:tasks.workunit.client.0.smithi103.stdout:2/537: creat d6/d5f/d26/d34/d80/fb2 x:0 0 0 2024-09-17T01:07:16.566 INFO:tasks.workunit.client.0.smithi103.stdout:2/538: dwrite d6/da/d5d/d8d/d60/fa2 [0,4194304] 0 2024-09-17T01:07:16.571 INFO:tasks.workunit.client.0.smithi103.stdout:2/539: mkdir d6/d5f/d26/d66/df/d68/db3 0 2024-09-17T01:07:16.572 INFO:tasks.workunit.client.0.smithi103.stdout:2/540: readlink d6/d5f/d26/l84 0 2024-09-17T01:07:16.573 INFO:tasks.workunit.client.0.smithi103.stdout:6/550: dread d3/d16/dad/d2f/f3c [0,4194304] 0 2024-09-17T01:07:16.575 INFO:tasks.workunit.client.0.smithi103.stdout:3/595: sync 2024-09-17T01:07:16.581 INFO:tasks.workunit.client.0.smithi103.stdout:3/596: mkdir d3/d16/d1b/d3c/d65/d75/d9c/dd3 0 2024-09-17T01:07:16.583 INFO:tasks.workunit.client.0.smithi103.stdout:2/541: dwrite d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/f87 [0,4194304] 0 2024-09-17T01:07:16.585 INFO:tasks.workunit.client.0.smithi103.stdout:6/551: dwrite d3/d16/dad/d2f/f79 [4194304,4194304] 0 2024-09-17T01:07:16.585 INFO:tasks.workunit.client.0.smithi103.stdout:3/597: chown d3/d16/d1b/d3c/d65/d75/dbe/faf 4 1 2024-09-17T01:07:16.591 INFO:tasks.workunit.client.0.smithi103.stdout:2/542: mkdir d6/d5f/d26/d66/df/d68/d7e/d9c/db4 0 2024-09-17T01:07:16.593 INFO:tasks.workunit.client.0.smithi103.stdout:6/552: creat d3/d16/d33/d57/fbe x:0 0 0 2024-09-17T01:07:16.594 INFO:tasks.workunit.client.0.smithi103.stdout:6/553: chown d3/d16/d21/d56 1007700 1 2024-09-17T01:07:16.596 INFO:tasks.workunit.client.0.smithi103.stdout:6/554: mkdir d3/d25/d74/dbf 0 2024-09-17T01:07:16.597 INFO:tasks.workunit.client.0.smithi103.stdout:2/543: getdents d6/da/d5d 0 2024-09-17T01:07:16.598 INFO:tasks.workunit.client.0.smithi103.stdout:2/544: dread - d6/d5f/d26/d66/df/f99 zero size 2024-09-17T01:07:16.598 INFO:tasks.workunit.client.0.smithi103.stdout:6/555: truncate d3/d25/d74/f8e 133000 0 2024-09-17T01:07:16.601 INFO:tasks.workunit.client.0.smithi103.stdout:2/545: unlink d6/da/d5d/d8d/d60/d75/f49 0 2024-09-17T01:07:16.602 INFO:tasks.workunit.client.0.smithi103.stdout:6/556: rename d3/d16/d21/d50/ca6 to d3/d16/dad/d2f/cc0 0 2024-09-17T01:07:16.603 INFO:tasks.workunit.client.0.smithi103.stdout:6/557: chown d3/d16/d33/d57/d63 4427 1 2024-09-17T01:07:16.606 INFO:tasks.workunit.client.0.smithi103.stdout:6/558: mkdir d3/d16/dad/d2f/dc1 0 2024-09-17T01:07:16.607 INFO:tasks.workunit.client.0.smithi103.stdout:2/546: dwrite d6/da/f82 [0,4194304] 0 2024-09-17T01:07:16.609 INFO:tasks.workunit.client.0.smithi103.stdout:6/559: creat d3/d16/d33/d3e/d58/d82/fc2 x:0 0 0 2024-09-17T01:07:16.614 INFO:tasks.workunit.client.0.smithi103.stdout:2/547: creat d6/da/d5d/d8d/d60/fb5 x:0 0 0 2024-09-17T01:07:16.617 INFO:tasks.workunit.client.0.smithi103.stdout:2/548: creat d6/d5f/d26/d6e/fb6 x:0 0 0 2024-09-17T01:07:16.618 INFO:tasks.workunit.client.0.smithi103.stdout:6/560: dwrite d3/d25/d74/f8e [0,4194304] 0 2024-09-17T01:07:16.622 INFO:tasks.workunit.client.0.smithi103.stdout:2/549: mkdir d6/d5f/d26/d66/df/db7 0 2024-09-17T01:07:16.622 INFO:tasks.workunit.client.0.smithi103.stdout:6/561: mkdir d3/d16/dad/d2f/dc1/dc3 0 2024-09-17T01:07:16.630 INFO:tasks.workunit.client.0.smithi103.stdout:6/562: dwrite d3/d16/f1e [0,4194304] 0 2024-09-17T01:07:16.633 INFO:tasks.workunit.client.0.smithi103.stdout:6/563: truncate d3/d16/f2d 2192743 0 2024-09-17T01:07:16.640 INFO:tasks.workunit.client.0.smithi103.stdout:2/550: dread d6/d5f/d26/f2c [0,4194304] 0 2024-09-17T01:07:16.640 INFO:tasks.workunit.client.0.smithi103.stdout:6/564: dwrite d3/d16/d33/d57/fbe [0,4194304] 0 2024-09-17T01:07:16.649 INFO:tasks.workunit.client.0.smithi103.stdout:6/565: rmdir d3/d25/d74/dbf 0 2024-09-17T01:07:16.654 INFO:tasks.workunit.client.0.smithi103.stdout:6/566: mkdir d3/d16/d33/d57/d63/dc4 0 2024-09-17T01:07:16.657 INFO:tasks.workunit.client.0.smithi103.stdout:2/551: dwrite d6/fb [0,4194304] 0 2024-09-17T01:07:16.659 INFO:tasks.workunit.client.0.smithi103.stdout:2/552: truncate d6/d5f/d26/d66/df/fa4 396456 0 2024-09-17T01:07:16.663 INFO:tasks.workunit.client.0.smithi103.stdout:2/553: write d6/d5f/d26/d66/f55 [2285636,3834] 0 2024-09-17T01:07:16.667 INFO:tasks.workunit.client.0.smithi103.stdout:2/554: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/db4/cb8 0 2024-09-17T01:07:16.674 INFO:tasks.workunit.client.0.smithi103.stdout:2/555: dwrite d6/da/d3f/f47 [0,4194304] 0 2024-09-17T01:07:16.679 INFO:tasks.workunit.client.0.smithi103.stdout:6/567: dread d3/d16/d33/d3e/f85 [0,4194304] 0 2024-09-17T01:07:16.680 INFO:tasks.workunit.client.0.smithi103.stdout:2/556: link d6/d5f/d26/d66/df/d68/d7e/faa d6/d5f/d26/d34/d80/fb9 0 2024-09-17T01:07:16.681 INFO:tasks.workunit.client.0.smithi103.stdout:2/557: stat d6/d5f/d26/d66/df/d68/d7e/d8b 0 2024-09-17T01:07:16.682 INFO:tasks.workunit.client.0.smithi103.stdout:6/568: creat d3/d16/d21/d56/d9a/fc5 x:0 0 0 2024-09-17T01:07:16.682 INFO:tasks.workunit.client.0.smithi103.stdout:6/569: chown d3/d16/dad/f67 58365884 1 2024-09-17T01:07:16.687 INFO:tasks.workunit.client.0.smithi103.stdout:6/570: dread d3/d25/d74/f8e [0,4194304] 0 2024-09-17T01:07:16.691 INFO:tasks.workunit.client.0.smithi103.stdout:6/571: dwrite d3/d25/d26/f4a [0,4194304] 0 2024-09-17T01:07:16.719 INFO:tasks.workunit.client.0.smithi103.stdout:2/558: dread d6/d5f/d26/f5a [0,4194304] 0 2024-09-17T01:07:16.719 INFO:tasks.workunit.client.0.smithi103.stdout:6/572: dread d3/d16/dad/f2a [0,4194304] 0 2024-09-17T01:07:16.720 INFO:tasks.workunit.client.0.smithi103.stdout:2/559: truncate d6/d5f/d26/d34/d80/fa6 557626 0 2024-09-17T01:07:16.720 INFO:tasks.workunit.client.0.smithi103.stdout:6/573: creat d3/d25/d26/fc6 x:0 0 0 2024-09-17T01:07:16.721 INFO:tasks.workunit.client.0.smithi103.stdout:6/574: chown d3/d16/d21/d56/d9a/fc5 2082 1 2024-09-17T01:07:16.722 INFO:tasks.workunit.client.0.smithi103.stdout:6/575: write d3/f18 [3834900,106875] 0 2024-09-17T01:07:16.745 INFO:tasks.workunit.client.0.smithi103.stdout:4/549: sync 2024-09-17T01:07:16.748 INFO:tasks.workunit.client.0.smithi103.stdout:6/576: chown d3/d16/d21/d50/l52 20794655 1 2024-09-17T01:07:16.748 INFO:tasks.workunit.client.0.smithi103.stdout:4/550: chown d9/d16/d23/d2a/f89 11310736 1 2024-09-17T01:07:16.752 INFO:tasks.workunit.client.0.smithi103.stdout:4/551: write d9/d16/d23/d32/f98 [992821,98147] 0 2024-09-17T01:07:16.752 INFO:tasks.workunit.client.0.smithi103.stdout:4/552: read d9/d16/f74 [3975000,2296] 0 2024-09-17T01:07:16.757 INFO:tasks.workunit.client.0.smithi103.stdout:4/553: unlink d9/d16/d23/f46 0 2024-09-17T01:07:16.759 INFO:tasks.workunit.client.0.smithi103.stdout:2/560: dread d6/f8 [0,4194304] 0 2024-09-17T01:07:16.762 INFO:tasks.workunit.client.0.smithi103.stdout:6/577: dread d3/d16/d33/d3e/fb7 [0,4194304] 0 2024-09-17T01:07:16.762 INFO:tasks.workunit.client.0.smithi103.stdout:2/561: creat d6/da/d5d/d8d/fba x:0 0 0 2024-09-17T01:07:16.763 INFO:tasks.workunit.client.0.smithi103.stdout:4/554: getdents d9/d16/d36 0 2024-09-17T01:07:16.765 INFO:tasks.workunit.client.0.smithi103.stdout:4/555: write d9/d16/d44/f57 [146129,53759] 0 2024-09-17T01:07:16.766 INFO:tasks.workunit.client.0.smithi103.stdout:2/562: mkdir d6/d5f/d26/d66/df/d68/d7e/d9c/dbb 0 2024-09-17T01:07:16.767 INFO:tasks.workunit.client.0.smithi103.stdout:2/563: readlink d6/d5f/d26/d34/l6d 0 2024-09-17T01:07:16.767 INFO:tasks.workunit.client.0.smithi103.stdout:6/578: creat d3/d16/d33/d57/d63/d60/da4/fc7 x:0 0 0 2024-09-17T01:07:16.768 INFO:tasks.workunit.client.0.smithi103.stdout:2/564: chown d6/d5f/fac 32212 1 2024-09-17T01:07:16.769 INFO:tasks.workunit.client.0.smithi103.stdout:2/565: fdatasync d6/da/d3f/f4a 0 2024-09-17T01:07:16.770 INFO:tasks.workunit.client.0.smithi103.stdout:2/566: dread - d6/da/d5d/d8d/d60/fb5 zero size 2024-09-17T01:07:16.771 INFO:tasks.workunit.client.0.smithi103.stdout:4/556: rename d9/d16/d23/d32/d61/c96 to d9/d16/d45/ca1 0 2024-09-17T01:07:16.772 INFO:tasks.workunit.client.0.smithi103.stdout:4/557: chown d9/d16/d38/d3f/l9e 2089233 1 2024-09-17T01:07:16.777 INFO:tasks.workunit.client.0.smithi103.stdout:4/558: creat d9/d16/d23/d90/fa2 x:0 0 0 2024-09-17T01:07:16.778 INFO:tasks.workunit.client.0.smithi103.stdout:6/579: link d3/d25/d26/d3a/f45 d3/d16/d33/d3e/fc8 0 2024-09-17T01:07:16.780 INFO:tasks.workunit.client.0.smithi103.stdout:4/559: creat d9/dc/df/fa3 x:0 0 0 2024-09-17T01:07:16.781 INFO:tasks.workunit.client.0.smithi103.stdout:6/580: symlink d3/d25/d74/lc9 0 2024-09-17T01:07:16.782 INFO:tasks.workunit.client.0.smithi103.stdout:4/560: mknod d9/d16/d36/d42/d84/ca4 0 2024-09-17T01:07:16.783 INFO:tasks.workunit.client.0.smithi103.stdout:6/581: fsync d3/d25/d74/f8e 0 2024-09-17T01:07:16.784 INFO:tasks.workunit.client.0.smithi103.stdout:2/567: dread f5 [0,4194304] 0 2024-09-17T01:07:16.791 INFO:tasks.workunit.client.0.smithi103.stdout:4/561: dread d9/d16/d38/d3f/f83 [0,4194304] 0 2024-09-17T01:07:16.793 INFO:tasks.workunit.client.0.smithi103.stdout:2/568: dwrite d6/d5f/d26/d66/df/f59 [0,4194304] 0 2024-09-17T01:07:16.811 INFO:tasks.workunit.client.0.smithi103.stdout:6/582: creat d3/d25/fca x:0 0 0 2024-09-17T01:07:16.811 INFO:tasks.workunit.client.0.smithi103.stdout:6/583: chown d3/f28 0 1 2024-09-17T01:07:16.812 INFO:tasks.workunit.client.0.smithi103.stdout:4/562: creat d9/d16/d45/d5e/fa5 x:0 0 0 2024-09-17T01:07:16.813 INFO:tasks.workunit.client.0.smithi103.stdout:6/584: creat d3/d16/d33/d57/fcb x:0 0 0 2024-09-17T01:07:16.815 INFO:tasks.workunit.client.0.smithi103.stdout:6/585: write d3/d16/dad/d2f/f34 [313849,84816] 0 2024-09-17T01:07:16.817 INFO:tasks.workunit.client.0.smithi103.stdout:2/569: creat d6/d5f/d26/d66/fbc x:0 0 0 2024-09-17T01:07:16.819 INFO:tasks.workunit.client.0.smithi103.stdout:6/586: fsync d3/d25/f29 0 2024-09-17T01:07:16.821 INFO:tasks.workunit.client.0.smithi103.stdout:2/570: symlink d6/da/d5d/d8d/d60/d75/lbd 0 2024-09-17T01:07:16.822 INFO:tasks.workunit.client.0.smithi103.stdout:6/587: creat d3/d16/d33/d3e/d4b/fcc x:0 0 0 2024-09-17T01:07:16.826 INFO:tasks.workunit.client.0.smithi103.stdout:2/571: dread d6/da/d5d/d8d/d60/fa2 [0,4194304] 0 2024-09-17T01:07:16.827 INFO:tasks.workunit.client.0.smithi103.stdout:6/588: rename d3/d25/d26/d3a/lbb to d3/d25/d9c/lcd 0 2024-09-17T01:07:16.830 INFO:tasks.workunit.client.0.smithi103.stdout:6/589: truncate d3/d16/dad/d2f/f3c 524185 0 2024-09-17T01:07:16.830 INFO:tasks.workunit.client.0.smithi103.stdout:6/590: chown d3/d25/f7d 54458415 1 2024-09-17T01:07:16.831 INFO:tasks.workunit.client.0.smithi103.stdout:2/572: rename d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/c78 to d6/d5f/d26/d66/df/d58/cbe 0 2024-09-17T01:07:16.831 INFO:tasks.workunit.client.0.smithi103.stdout:2/573: fdatasync d6/d5f/f29 0 2024-09-17T01:07:16.834 INFO:tasks.workunit.client.0.smithi103.stdout:2/574: mknod d6/da/d5d/d8d/cbf 0 2024-09-17T01:07:16.834 INFO:tasks.workunit.client.0.smithi103.stdout:2/575: fdatasync d6/da/d28/f4d 0 2024-09-17T01:07:16.835 INFO:tasks.workunit.client.0.smithi103.stdout:6/591: creat d3/d16/d33/d3e/fce x:0 0 0 2024-09-17T01:07:16.840 INFO:tasks.workunit.client.0.smithi103.stdout:2/576: dwrite d6/da/f2f [0,4194304] 0 2024-09-17T01:07:16.846 INFO:tasks.workunit.client.0.smithi103.stdout:4/563: write d9/d16/f74 [3377255,72596] 0 2024-09-17T01:07:16.849 INFO:tasks.workunit.client.0.smithi103.stdout:2/577: dwrite d6/d5f/d26/d34/d80/fa0 [0,4194304] 0 2024-09-17T01:07:16.855 INFO:tasks.workunit.client.0.smithi103.stdout:4/564: creat d9/d16/d23/d32/d64/d85/fa6 x:0 0 0 2024-09-17T01:07:16.859 INFO:tasks.workunit.client.0.smithi103.stdout:2/578: symlink d6/da/d5d/d8d/d60/lc0 0 2024-09-17T01:07:16.860 INFO:tasks.workunit.client.0.smithi103.stdout:4/565: creat d9/d10/fa7 x:0 0 0 2024-09-17T01:07:16.861 INFO:tasks.workunit.client.0.smithi103.stdout:2/579: fdatasync d6/d5f/f1e 0 2024-09-17T01:07:16.862 INFO:tasks.workunit.client.0.smithi103.stdout:4/566: symlink d9/d10/la8 0 2024-09-17T01:07:16.865 INFO:tasks.workunit.client.0.smithi103.stdout:2/580: creat d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/fc1 x:0 0 0 2024-09-17T01:07:16.869 INFO:tasks.workunit.client.0.smithi103.stdout:4/567: link d9/d16/d45/d5e/fa5 d9/d16/d44/d78/fa9 0 2024-09-17T01:07:16.870 INFO:tasks.workunit.client.0.smithi103.stdout:2/581: creat d6/da/d5d/fc2 x:0 0 0 2024-09-17T01:07:16.873 INFO:tasks.workunit.client.0.smithi103.stdout:4/568: link d9/d16/d23/l8b d9/d16/d23/d90/laa 0 2024-09-17T01:07:16.875 INFO:tasks.workunit.client.0.smithi103.stdout:2/582: rename d6/d5f/d26/d66/df/f59 to d6/d5f/d26/d66/df/d68/d7e/d8b/fc3 0 2024-09-17T01:07:16.879 INFO:tasks.workunit.client.0.smithi103.stdout:4/569: dwrite d9/d16/d36/d42/f7b [0,4194304] 0 2024-09-17T01:07:16.884 INFO:tasks.workunit.client.0.smithi103.stdout:4/570: stat d9/d16/d23/d32/d4c/l59 0 2024-09-17T01:07:16.886 INFO:tasks.workunit.client.0.smithi103.stdout:2/583: dwrite d6/f56 [0,4194304] 0 2024-09-17T01:07:16.888 INFO:tasks.workunit.client.0.smithi103.stdout:4/571: creat d9/d2d/d55/fab x:0 0 0 2024-09-17T01:07:16.889 INFO:tasks.workunit.client.0.smithi103.stdout:2/584: chown d6/f44 373595 1 2024-09-17T01:07:16.893 INFO:tasks.workunit.client.0.smithi103.stdout:2/585: unlink d6/da/c8e 0 2024-09-17T01:07:16.894 INFO:tasks.workunit.client.0.smithi103.stdout:4/572: rename d9/d16/d44/l65 to d9/dc/lac 0 2024-09-17T01:07:16.894 INFO:tasks.workunit.client.0.smithi103.stdout:2/586: write d6/d5f/d26/d66/fbc [293894,24641] 0 2024-09-17T01:07:16.897 INFO:tasks.workunit.client.0.smithi103.stdout:4/573: creat d9/d16/d23/d2a/fad x:0 0 0 2024-09-17T01:07:16.897 INFO:tasks.workunit.client.0.smithi103.stdout:4/574: readlink d9/d16/d38/d3f/l4d 0 2024-09-17T01:07:16.899 INFO:tasks.workunit.client.0.smithi103.stdout:2/587: dread d6/da/d3f/f65 [0,4194304] 0 2024-09-17T01:07:16.900 INFO:tasks.workunit.client.0.smithi103.stdout:2/588: chown d6/d5f/d26/d66/df/d68/d7e/d9c/d6f 2777875 1 2024-09-17T01:07:16.902 INFO:tasks.workunit.client.0.smithi103.stdout:4/575: rename d9/d16/d23/f6d to d9/d16/d23/d32/d64/fae 0 2024-09-17T01:07:16.906 INFO:tasks.workunit.client.0.smithi103.stdout:2/589: link d6/fb d6/d5f/d26/d66/df/d68/d7e/fc4 0 2024-09-17T01:07:16.908 INFO:tasks.workunit.client.0.smithi103.stdout:2/590: creat d6/d5f/d26/d34/d80/fc5 x:0 0 0 2024-09-17T01:07:16.916 INFO:tasks.workunit.client.0.smithi103.stdout:4/576: write d9/f3d [504005,72187] 0 2024-09-17T01:07:16.925 INFO:tasks.workunit.client.0.smithi103.stdout:4/577: dwrite d9/d16/d23/d32/d64/fae [0,4194304] 0 2024-09-17T01:07:16.926 INFO:tasks.workunit.client.0.smithi103.stdout:2/591: dread d6/d5f/f29 [0,4194304] 0 2024-09-17T01:07:16.928 INFO:tasks.workunit.client.0.smithi103.stdout:4/578: rmdir d9/d16 39 2024-09-17T01:07:16.932 INFO:tasks.workunit.client.0.smithi103.stdout:2/592: link d6/da/d5d/d8d/fba d6/d5f/d26/d34/d80/fc6 0 2024-09-17T01:07:16.933 INFO:tasks.workunit.client.0.smithi103.stdout:2/593: readlink d6/da/l86 0 2024-09-17T01:07:16.933 INFO:tasks.workunit.client.0.smithi103.stdout:4/579: creat d9/d16/d23/d90/faf x:0 0 0 2024-09-17T01:07:16.934 INFO:tasks.workunit.client.0.smithi103.stdout:2/594: write d6/d5f/d26/d66/df/f99 [839023,50008] 0 2024-09-17T01:07:16.935 INFO:tasks.workunit.client.0.smithi103.stdout:2/595: chown d6/d5f/d26/d66/df/d68/d7e/faa 207 1 2024-09-17T01:07:16.938 INFO:tasks.workunit.client.0.smithi103.stdout:2/596: symlink d6/da/d3f/lc7 0 2024-09-17T01:07:16.941 INFO:tasks.workunit.client.0.smithi103.stdout:4/580: dwrite d9/d16/d23/d32/f98 [0,4194304] 0 2024-09-17T01:07:16.942 INFO:tasks.workunit.client.0.smithi103.stdout:2/597: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/db4/cc8 0 2024-09-17T01:07:16.948 INFO:tasks.workunit.client.0.smithi103.stdout:4/581: dwrite d9/d16/d44/f4f [0,4194304] 0 2024-09-17T01:07:16.956 INFO:tasks.workunit.client.0.smithi103.stdout:2/598: dwrite d6/da/d5d/d8d/d60/d75/f91 [0,4194304] 0 2024-09-17T01:07:16.957 INFO:tasks.workunit.client.0.smithi103.stdout:4/582: mknod d9/d16/d36/d42/cb0 0 2024-09-17T01:07:16.958 INFO:tasks.workunit.client.0.smithi103.stdout:4/583: unlink d9/d16/d23/d32/d64/fae 0 2024-09-17T01:07:16.959 INFO:tasks.workunit.client.0.smithi103.stdout:2/599: fdatasync d6/d5f/d26/d66/df/d68/d7e/faa 0 2024-09-17T01:07:16.967 INFO:tasks.workunit.client.0.smithi103.stdout:2/600: getdents d6/d5f/d26/d66/df/d68 0 2024-09-17T01:07:16.969 INFO:tasks.workunit.client.0.smithi103.stdout:2/601: creat d6/da/d3f/fc9 x:0 0 0 2024-09-17T01:07:16.981 INFO:tasks.workunit.client.0.smithi103.stdout:4/584: dread d9/d16/d44/f68 [0,4194304] 0 2024-09-17T01:07:16.983 INFO:tasks.workunit.client.0.smithi103.stdout:4/585: mknod d9/dc/df/cb1 0 2024-09-17T01:07:16.984 INFO:tasks.workunit.client.0.smithi103.stdout:4/586: stat d9/d16/d23/d2a 0 2024-09-17T01:07:16.990 INFO:tasks.workunit.client.0.smithi103.stdout:4/587: dwrite d9/d16/f12 [0,4194304] 0 2024-09-17T01:07:16.995 INFO:tasks.workunit.client.0.smithi103.stdout:4/588: getdents d9/d16/d23/d32/d64 0 2024-09-17T01:07:16.999 INFO:tasks.workunit.client.0.smithi103.stdout:4/589: rename d9/dc/df/fa3 to d9/d16/d45/fb2 0 2024-09-17T01:07:17.000 INFO:tasks.workunit.client.0.smithi103.stdout:4/590: write d9/d16/d23/d90/faf [658831,47937] 0 2024-09-17T01:07:17.005 INFO:tasks.workunit.client.0.smithi103.stdout:4/591: rename d9/dc/lac to d9/dc/lb3 0 2024-09-17T01:07:17.009 INFO:tasks.workunit.client.0.smithi103.stdout:4/592: dread d9/d16/d45/d5e/f7a [0,4194304] 0 2024-09-17T01:07:17.010 INFO:tasks.workunit.client.0.smithi103.stdout:4/593: mknod d9/d16/d38/d3f/cb4 0 2024-09-17T01:07:17.012 INFO:tasks.workunit.client.0.smithi103.stdout:4/594: mknod d9/dc/df/cb5 0 2024-09-17T01:07:17.015 INFO:tasks.workunit.client.0.smithi103.stdout:4/595: rename d9/d16/d45/l48 to d9/d16/d23/d32/d61/lb6 0 2024-09-17T01:07:17.028 INFO:tasks.workunit.client.0.smithi103.stdout:4/596: dread d9/d16/f74 [0,4194304] 0 2024-09-17T01:07:17.028 INFO:tasks.workunit.client.0.smithi103.stdout:4/597: stat d9/d16/d23/f97 0 2024-09-17T01:07:17.033 INFO:tasks.workunit.client.0.smithi103.stdout:4/598: write d9/d10/f14 [154320,31818] 0 2024-09-17T01:07:17.038 INFO:tasks.workunit.client.0.smithi103.stdout:4/599: link d9/d16/d36/d42/d84/ca4 d9/dc/df/cb7 0 2024-09-17T01:07:17.038 INFO:tasks.workunit.client.0.smithi103.stdout:4/600: chown d9/d16/d23/d32/c40 17 1 2024-09-17T01:07:17.040 INFO:tasks.workunit.client.0.smithi103.stdout:4/601: symlink d9/d16/d23/d32/d61/lb8 0 2024-09-17T01:07:17.043 INFO:tasks.workunit.client.0.smithi103.stdout:4/602: rename d9/d16/d45/f5a to d9/fb9 0 2024-09-17T01:07:17.043 INFO:tasks.workunit.client.0.smithi103.stdout:4/603: chown d9/d16/d23/d90 7403029 1 2024-09-17T01:07:17.044 INFO:tasks.workunit.client.0.smithi103.stdout:4/604: read - d9/d16/d23/d2a/f93 zero size 2024-09-17T01:07:17.050 INFO:tasks.workunit.client.0.smithi103.stdout:4/605: dwrite d9/dc/f9a [0,4194304] 0 2024-09-17T01:07:17.056 INFO:tasks.workunit.client.0.smithi103.stdout:4/606: creat d9/d16/d23/d52/d91/fba x:0 0 0 2024-09-17T01:07:17.057 INFO:tasks.workunit.client.0.smithi103.stdout:4/607: write d9/d16/d23/d52/fa0 [542840,17003] 0 2024-09-17T01:07:17.058 INFO:tasks.workunit.client.0.smithi103.stdout:4/608: chown d9/d16/d38/d3f/l51 1091 1 2024-09-17T01:07:17.064 INFO:tasks.workunit.client.0.smithi103.stdout:4/609: rename d9/d16/d45/ca1 to d9/d16/d36/d42/d84/cbb 0 2024-09-17T01:07:17.068 INFO:tasks.workunit.client.0.smithi103.stdout:4/610: fsync d9/d16/d23/d52/d91/fba 0 2024-09-17T01:07:17.070 INFO:tasks.workunit.client.0.smithi103.stdout:4/611: creat d9/d2d/d55/fbc x:0 0 0 2024-09-17T01:07:17.073 INFO:tasks.workunit.client.0.smithi103.stdout:4/612: mknod d9/d16/d23/d32/cbd 0 2024-09-17T01:07:17.075 INFO:tasks.workunit.client.0.smithi103.stdout:4/613: mknod d9/d16/d23/d32/d64/d85/cbe 0 2024-09-17T01:07:17.077 INFO:tasks.workunit.client.0.smithi103.stdout:4/614: rename d9/d16/d45/fb2 to d9/d16/d44/fbf 0 2024-09-17T01:07:17.083 INFO:tasks.workunit.client.0.smithi103.stdout:4/615: truncate d9/f3a 1173693 0 2024-09-17T01:07:17.085 INFO:tasks.workunit.client.0.smithi103.stdout:4/616: mkdir d9/d16/d70/dc0 0 2024-09-17T01:07:17.093 INFO:tasks.workunit.client.0.smithi103.stdout:4/617: truncate d9/d16/d23/d52/f7e 2304399 0 2024-09-17T01:07:17.099 INFO:tasks.workunit.client.0.smithi103.stdout:4/618: dwrite d9/d16/d23/d32/f98 [0,4194304] 0 2024-09-17T01:07:17.107 INFO:tasks.workunit.client.0.smithi103.stdout:4/619: dwrite d9/d16/d36/d42/f7b [0,4194304] 0 2024-09-17T01:07:17.109 INFO:tasks.workunit.client.0.smithi103.stdout:4/620: chown d9/d16/d23/d52/l80 74 1 2024-09-17T01:07:17.120 INFO:tasks.workunit.client.0.smithi103.stdout:4/621: write d9/dc/df/f20 [3314998,70198] 0 2024-09-17T01:07:17.123 INFO:tasks.workunit.client.0.smithi103.stdout:4/622: creat d9/d16/d45/d76/fc1 x:0 0 0 2024-09-17T01:07:17.124 INFO:tasks.workunit.client.0.smithi103.stdout:4/623: creat d9/d10/fc2 x:0 0 0 2024-09-17T01:07:17.125 INFO:tasks.workunit.client.0.smithi103.stdout:4/624: fdatasync d9/d2d/d55/fab 0 2024-09-17T01:07:17.127 INFO:tasks.workunit.client.0.smithi103.stdout:4/625: fsync d9/d16/d44/d78/fa9 0 2024-09-17T01:07:17.128 INFO:tasks.workunit.client.0.smithi103.stdout:4/626: readlink d9/d16/d23/d32/l63 0 2024-09-17T01:07:17.131 INFO:tasks.workunit.client.0.smithi103.stdout:4/627: getdents d9/d2d/d55 0 2024-09-17T01:07:17.152 INFO:tasks.workunit.client.0.smithi103.stdout:4/628: mknod d9/d16/d44/d78/cc3 0 2024-09-17T01:07:17.153 INFO:tasks.workunit.client.0.smithi103.stdout:4/629: symlink d9/d16/d70/lc4 0 2024-09-17T01:07:17.154 INFO:tasks.workunit.client.0.smithi103.stdout:4/630: chown d9/d2d/d55/fab 0 1 2024-09-17T01:07:17.158 INFO:tasks.workunit.client.0.smithi103.stdout:4/631: dread d9/d16/d23/d90/faf [0,4194304] 0 2024-09-17T01:07:17.164 INFO:tasks.workunit.client.0.smithi103.stdout:4/632: link d9/d16/d45/d5e/f71 d9/dc/df/fc5 0 2024-09-17T01:07:17.164 INFO:tasks.workunit.client.0.smithi103.stdout:4/633: chown d9/dc 0 1 2024-09-17T01:07:17.169 INFO:tasks.workunit.client.0.smithi103.stdout:4/634: link d9/d10/l17 d9/d16/d23/d32/d61/d47/lc6 0 2024-09-17T01:07:17.175 INFO:tasks.workunit.client.0.smithi103.stdout:4/635: dwrite d9/d16/d23/d2a/f89 [0,4194304] 0 2024-09-17T01:07:17.178 INFO:tasks.workunit.client.0.smithi103.stdout:4/636: creat d9/d16/d45/d76/fc7 x:0 0 0 2024-09-17T01:07:17.207 INFO:tasks.workunit.client.0.smithi103.stdout:4/637: truncate d9/d16/d23/d32/f98 817770 0 2024-09-17T01:07:17.210 INFO:tasks.workunit.client.0.smithi103.stdout:4/638: creat d9/d16/d44/fc8 x:0 0 0 2024-09-17T01:07:17.214 INFO:tasks.workunit.client.0.smithi103.stdout:4/639: mknod d9/d16/d36/cc9 0 2024-09-17T01:07:17.219 INFO:tasks.workunit.client.0.smithi103.stdout:4/640: rename d9/dc/df/c53 to d9/d16/d23/d2a/cca 0 2024-09-17T01:07:17.223 INFO:tasks.workunit.client.0.smithi103.stdout:4/641: creat d9/d10/d6e/fcb x:0 0 0 2024-09-17T01:07:17.224 INFO:tasks.workunit.client.0.smithi103.stdout:4/642: readlink d9/d16/d70/lc4 0 2024-09-17T01:07:17.233 INFO:tasks.workunit.client.0.smithi103.stdout:4/643: link d9/d16/d44/d78/fa9 d9/d10/fcc 0 2024-09-17T01:07:17.236 INFO:tasks.workunit.client.0.smithi103.stdout:4/644: truncate d9/d16/d23/d32/d4c/f92 1669442 0 2024-09-17T01:07:17.244 INFO:tasks.workunit.client.0.smithi103.stdout:4/645: dwrite d9/d2d/d55/fbc [0,4194304] 0 2024-09-17T01:07:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:17 smithi143 ceph-mon[35452]: Reconfiguring prometheus.smithi103 (dependencies changed)... 2024-09-17T01:07:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:17 smithi143 ceph-mon[35452]: pgmap v19: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 107 MiB/s rd, 314 MiB/s wr, 628 op/s 2024-09-17T01:07:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:17 smithi143 ceph-mon[35452]: Reconfiguring daemon prometheus.smithi103 on smithi103 2024-09-17T01:07:17.277 INFO:tasks.workunit.client.0.smithi103.stdout:4/646: dwrite d9/d16/d23/d2a/f50 [0,4194304] 0 2024-09-17T01:07:17.280 INFO:tasks.workunit.client.0.smithi103.stdout:4/647: mknod d9/d16/d23/d2a/ccd 0 2024-09-17T01:07:17.283 INFO:tasks.workunit.client.0.smithi103.stdout:4/648: rename d9/d2d/d55/fbc to d9/d16/d23/d52/fce 0 2024-09-17T01:07:17.284 INFO:tasks.workunit.client.0.smithi103.stdout:4/649: dread - d9/d16/d45/d76/fc7 zero size 2024-09-17T01:07:17.291 INFO:tasks.workunit.client.0.smithi103.stdout:4/650: write d9/d16/d45/d5e/fa5 [710329,89164] 0 2024-09-17T01:07:17.341 INFO:tasks.workunit.client.0.smithi103.stdout:7/505: sync 2024-09-17T01:07:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:17 smithi103 ceph-mon[28156]: Reconfiguring prometheus.smithi103 (dependencies changed)... 2024-09-17T01:07:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:17 smithi103 ceph-mon[28156]: pgmap v19: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 107 MiB/s rd, 314 MiB/s wr, 628 op/s 2024-09-17T01:07:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:17 smithi103 ceph-mon[28156]: Reconfiguring daemon prometheus.smithi103 on smithi103 2024-09-17T01:07:17.495 INFO:tasks.workunit.client.0.smithi103.stdout:7/506: rename d4/d11/d2b/f2f to d4/d4a/d4b/d9d/fb6 0 2024-09-17T01:07:17.500 INFO:tasks.workunit.client.0.smithi103.stdout:7/507: symlink d4/d11/d80/d8c/dac/lb7 0 2024-09-17T01:07:17.637 INFO:tasks.workunit.client.0.smithi103.stdout:7/508: rmdir d4/d11/d2b/d36/d3a/d51/d5e/d7b 39 2024-09-17T01:07:17.640 INFO:tasks.workunit.client.0.smithi103.stdout:7/509: mkdir d4/d10/d6b/d72/db8 0 2024-09-17T01:07:17.647 INFO:tasks.workunit.client.0.smithi103.stdout:7/510: dwrite d4/d11/d2b/d36/d3a/d51/d5e/f64 [0,4194304] 0 2024-09-17T01:07:17.649 INFO:tasks.workunit.client.0.smithi103.stdout:7/511: read - d4/d11/d34/db5/f8b zero size 2024-09-17T01:07:17.649 INFO:tasks.workunit.client.0.smithi103.stdout:7/512: readlink d4/l8 0 2024-09-17T01:07:17.652 INFO:tasks.workunit.client.0.smithi103.stdout:7/513: creat d4/d11/d2b/d36/d82/fb9 x:0 0 0 2024-09-17T01:07:17.655 INFO:tasks.workunit.client.0.smithi103.stdout:7/514: symlink d4/d4a/d4b/d8a/lba 0 2024-09-17T01:07:17.656 INFO:tasks.workunit.client.0.smithi103.stdout:7/515: truncate d4/d4a/f67 1854360 0 2024-09-17T01:07:17.660 INFO:tasks.workunit.client.0.smithi103.stdout:7/516: creat d4/d11/d2b/fbb x:0 0 0 2024-09-17T01:07:17.761 INFO:tasks.workunit.client.0.smithi103.stdout:7/517: getdents d4/d11/d2b 0 2024-09-17T01:07:17.765 INFO:tasks.workunit.client.0.smithi103.stdout:7/518: read d4/d11/d2b/d36/d3a/d51/d5e/d7b/f7c [755428,34148] 0 2024-09-17T01:07:17.766 INFO:tasks.workunit.client.0.smithi103.stdout:7/519: stat d4/d10/f2e 0 2024-09-17T01:07:17.770 INFO:tasks.workunit.client.0.smithi103.stdout:7/520: creat d4/d11/d2b/d8d/fbc x:0 0 0 2024-09-17T01:07:17.789 INFO:tasks.workunit.client.0.smithi103.stdout:7/521: write d4/d11/d2b/d36/d3a/d51/d5e/f75 [371671,17150] 0 2024-09-17T01:07:17.796 INFO:tasks.workunit.client.0.smithi103.stdout:7/522: dwrite d4/d11/f19 [0,4194304] 0 2024-09-17T01:07:17.816 INFO:tasks.workunit.client.0.smithi103.stdout:7/523: symlink d4/d10/d37/lbd 0 2024-09-17T01:07:17.820 INFO:tasks.workunit.client.0.smithi103.stdout:7/524: link d4/d11/d2b/d36/d3a/d51/d5e/f75 d4/d11/d80/d8c/fbe 0 2024-09-17T01:07:17.821 INFO:tasks.workunit.client.0.smithi103.stdout:7/525: truncate d4/d4a/d4b/d8a/fab 1651545 0 2024-09-17T01:07:17.824 INFO:tasks.workunit.client.0.smithi103.stdout:7/526: creat d4/d11/d80/d8c/dac/fbf x:0 0 0 2024-09-17T01:07:17.829 INFO:tasks.workunit.client.0.smithi103.stdout:7/527: rename d4/laa to d4/d11/d2b/d36/d3a/lc0 0 2024-09-17T01:07:17.838 INFO:tasks.workunit.client.0.smithi103.stdout:7/528: truncate d4/d11/f23 2396630 0 2024-09-17T01:07:17.839 INFO:tasks.workunit.client.0.smithi103.stdout:7/529: mknod d4/d10/d6b/d72/cc1 0 2024-09-17T01:07:17.840 INFO:tasks.workunit.client.0.smithi103.stdout:7/530: dread - d4/d10/f94 zero size 2024-09-17T01:07:17.847 INFO:tasks.workunit.client.0.smithi103.stdout:7/531: write d4/d11/d2b/f65 [988189,45963] 0 2024-09-17T01:07:17.868 INFO:tasks.workunit.client.0.smithi103.stdout:7/532: dwrite d4/d11/f23 [0,4194304] 0 2024-09-17T01:07:17.870 INFO:tasks.workunit.client.0.smithi103.stdout:7/533: symlink d4/d4a/d4b/d8a/lc2 0 2024-09-17T01:07:17.871 INFO:tasks.workunit.client.0.smithi103.stdout:7/534: truncate d4/d11/f23 4278935 0 2024-09-17T01:07:17.873 INFO:tasks.workunit.client.0.smithi103.stdout:7/535: truncate d4/d11/d3f/d63/fa8 903034 0 2024-09-17T01:07:17.877 INFO:tasks.workunit.client.0.smithi103.stdout:5/381: sync 2024-09-17T01:07:17.880 INFO:tasks.workunit.client.0.smithi103.stdout:5/382: truncate d6/d2c/f91 227788 0 2024-09-17T01:07:17.881 INFO:tasks.workunit.client.0.smithi103.stdout:5/383: creat d6/d28/f96 x:0 0 0 2024-09-17T01:07:17.883 INFO:tasks.workunit.client.0.smithi103.stdout:5/384: creat d6/d7d/d93/f97 x:0 0 0 2024-09-17T01:07:17.884 INFO:tasks.workunit.client.0.smithi103.stdout:5/385: chown d6/d2c/f52 209495 1 2024-09-17T01:07:17.888 INFO:tasks.workunit.client.0.smithi103.stdout:5/386: getdents d6/d2c/d38 0 2024-09-17T01:07:17.889 INFO:tasks.workunit.client.0.smithi103.stdout:5/387: rmdir d6/d7d 39 2024-09-17T01:07:17.894 INFO:tasks.workunit.client.0.smithi103.stdout:7/536: dread d4/d10/d43/f57 [0,4194304] 0 2024-09-17T01:07:17.898 INFO:tasks.workunit.client.0.smithi103.stdout:7/537: read d4/d4a/d4b/d9d/fb6 [376205,78038] 0 2024-09-17T01:07:17.910 INFO:tasks.workunit.client.0.smithi103.stdout:5/388: truncate d6/d2c/d38/d4c/d50/f4f 3669945 0 2024-09-17T01:07:17.913 INFO:tasks.workunit.client.0.smithi103.stdout:7/538: dread d4/d11/d3f/f68 [0,4194304] 0 2024-09-17T01:07:17.916 INFO:tasks.workunit.client.0.smithi103.stdout:7/539: symlink d4/d4a/d4b/lc3 0 2024-09-17T01:07:17.917 INFO:tasks.workunit.client.0.smithi103.stdout:7/540: dread - d4/d11/d34/db5/f8b zero size 2024-09-17T01:07:17.918 INFO:tasks.workunit.client.0.smithi103.stdout:7/541: write d4/d10/f35 [997343,58504] 0 2024-09-17T01:07:17.921 INFO:tasks.workunit.client.0.smithi103.stdout:5/389: rmdir d6/d2c/d32/d47 0 2024-09-17T01:07:17.922 INFO:tasks.workunit.client.0.smithi103.stdout:5/390: write d6/d2c/d38/f8a [511622,32172] 0 2024-09-17T01:07:17.924 INFO:tasks.workunit.client.0.smithi103.stdout:7/542: creat d4/d10/d32/fc4 x:0 0 0 2024-09-17T01:07:17.931 INFO:tasks.workunit.client.0.smithi103.stdout:5/391: write d6/d2c/f3d [585710,95364] 0 2024-09-17T01:07:17.932 INFO:tasks.workunit.client.0.smithi103.stdout:5/392: stat d6/d2c/d38/d4c/d54/l89 0 2024-09-17T01:07:17.932 INFO:tasks.workunit.client.0.smithi103.stdout:5/393: fsync d6/f8b 0 2024-09-17T01:07:17.943 INFO:tasks.workunit.client.0.smithi103.stdout:5/394: dwrite d6/db/fd [0,4194304] 0 2024-09-17T01:07:17.948 INFO:tasks.workunit.client.0.smithi103.stdout:5/395: unlink d6/db/f27 0 2024-09-17T01:07:17.950 INFO:tasks.workunit.client.0.smithi103.stdout:5/396: mknod d6/d2c/d38/d6f/c98 0 2024-09-17T01:07:17.953 INFO:tasks.workunit.client.0.smithi103.stdout:5/397: rename d6/db/l40 to d6/d2c/d32/l99 0 2024-09-17T01:07:17.956 INFO:tasks.workunit.client.0.smithi103.stdout:5/398: rename d6/d2c/d32/d55/d82 to d6/d2c/d38/d4c/d9a 0 2024-09-17T01:07:17.974 INFO:tasks.workunit.client.0.smithi103.stdout:5/399: dwrite d6/d2c/d32/d55/f5e [0,4194304] 0 2024-09-17T01:07:17.981 INFO:tasks.workunit.client.0.smithi103.stdout:5/400: dwrite d6/d2c/d38/d4c/d50/f72 [0,4194304] 0 2024-09-17T01:07:17.985 INFO:tasks.workunit.client.0.smithi103.stdout:5/401: rename d6/d2c/d38/d4c/d50/c68 to d6/d28/d90/c9b 0 2024-09-17T01:07:17.986 INFO:tasks.workunit.client.0.smithi103.stdout:5/402: write f0 [5011400,94954] 0 2024-09-17T01:07:17.994 INFO:tasks.workunit.client.0.smithi103.stdout:5/403: link d6/d2c/d38/d4c/d50/f4f d6/d2c/d38/d6f/f9c 0 2024-09-17T01:07:17.997 INFO:tasks.workunit.client.0.smithi103.stdout:5/404: creat d6/d7d/d93/f9d x:0 0 0 2024-09-17T01:07:17.997 INFO:tasks.workunit.client.0.smithi103.stdout:5/405: stat d6/f3e 0 2024-09-17T01:07:18.003 INFO:tasks.workunit.client.0.smithi103.stdout:5/406: dwrite d6/d28/f96 [0,4194304] 0 2024-09-17T01:07:18.005 INFO:tasks.workunit.client.0.smithi103.stdout:5/407: read d6/d2c/d38/d4c/d50/f72 [3525502,113598] 0 2024-09-17T01:07:18.012 INFO:tasks.workunit.client.0.smithi103.stdout:5/408: link d6/d28/d90/c9b d6/d2c/d38/d4c/d54/c9e 0 2024-09-17T01:07:18.014 INFO:tasks.workunit.client.0.smithi103.stdout:5/409: rmdir d6/d28/d90 39 2024-09-17T01:07:18.015 INFO:tasks.workunit.client.0.smithi103.stdout:5/410: truncate d6/d11/f86 366564 0 2024-09-17T01:07:18.021 INFO:tasks.workunit.client.0.smithi103.stdout:5/411: write d6/d11/f1d [3170326,2691] 0 2024-09-17T01:07:18.026 INFO:tasks.workunit.client.0.smithi103.stdout:5/412: creat d6/d28/f9f x:0 0 0 2024-09-17T01:07:18.033 INFO:tasks.workunit.client.0.smithi103.stdout:5/413: truncate d6/d2c/f37 677001 0 2024-09-17T01:07:18.043 INFO:tasks.workunit.client.0.smithi103.stdout:5/414: truncate d6/d2c/d38/f6c 107115 0 2024-09-17T01:07:18.043 INFO:tasks.workunit.client.0.smithi103.stdout:5/415: write d6/d7d/d93/f9d [360373,94230] 0 2024-09-17T01:07:18.044 INFO:tasks.workunit.client.0.smithi103.stdout:5/416: stat d6/d28/f6b 0 2024-09-17T01:07:18.044 INFO:tasks.workunit.client.0.smithi103.stdout:5/417: read - d6/d2c/d38/f83 zero size 2024-09-17T01:07:18.056 INFO:tasks.workunit.client.0.smithi103.stdout:5/418: write d6/d2c/d32/d55/f6a [4632131,104616] 0 2024-09-17T01:07:18.072 INFO:tasks.workunit.client.0.smithi103.stdout:5/419: dread d6/d2c/f51 [0,4194304] 0 2024-09-17T01:07:18.073 INFO:tasks.workunit.client.0.smithi103.stdout:5/420: stat d6/d2c/d38/l7b 0 2024-09-17T01:07:18.074 INFO:tasks.workunit.client.0.smithi103.stdout:5/421: write d6/d2c/f35 [266231,61841] 0 2024-09-17T01:07:18.083 INFO:tasks.workunit.client.0.smithi103.stdout:5/422: write d6/d2c/d38/d4c/d50/f1c [1145652,17428] 0 2024-09-17T01:07:18.084 INFO:tasks.workunit.client.0.smithi103.stdout:5/423: mkdir d6/d2c/d38/da0 0 2024-09-17T01:07:18.090 INFO:tasks.workunit.client.0.smithi103.stdout:5/424: mknod d6/d2c/d38/d4c/ca1 0 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:0/450: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:6/592: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:1/541: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:8/489: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:2/602: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:4/651: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:3/598: sync 2024-09-17T01:07:18.202 INFO:tasks.workunit.client.0.smithi103.stdout:9/537: sync 2024-09-17T01:07:18.205 INFO:tasks.workunit.client.0.smithi103.stdout:2/603: readlink d6/da/d5d/d8d/d60/d75/l6c 0 2024-09-17T01:07:18.209 INFO:tasks.workunit.client.0.smithi103.stdout:4/652: write d9/d16/f74 [3952263,70667] 0 2024-09-17T01:07:18.210 INFO:tasks.workunit.client.0.smithi103.stdout:4/653: fdatasync d9/d16/f12 0 2024-09-17T01:07:18.213 INFO:tasks.workunit.client.0.smithi103.stdout:8/490: creat d0/d6/dc/d30/d25/d64/d59/f98 x:0 0 0 2024-09-17T01:07:18.214 INFO:tasks.workunit.client.0.smithi103.stdout:6/593: truncate d3/d16/f2d 2007522 0 2024-09-17T01:07:18.216 INFO:tasks.workunit.client.0.smithi103.stdout:2/604: rmdir d6/d5f/dad 39 2024-09-17T01:07:18.217 INFO:tasks.workunit.client.0.smithi103.stdout:9/538: dwrite f0 [4194304,4194304] 0 2024-09-17T01:07:18.219 INFO:tasks.workunit.client.0.smithi103.stdout:8/491: dread d0/d6/f3b [0,4194304] 0 2024-09-17T01:07:18.219 INFO:tasks.workunit.client.0.smithi103.stdout:0/451: getdents dd/df/d38/d62/d84 0 2024-09-17T01:07:18.219 INFO:tasks.workunit.client.0.smithi103.stdout:3/599: dread d3/d16/d1b/f79 [0,4194304] 0 2024-09-17T01:07:18.223 INFO:tasks.workunit.client.0.smithi103.stdout:0/452: stat dd/df/d38/d62/d84 0 2024-09-17T01:07:18.224 INFO:tasks.workunit.client.0.smithi103.stdout:9/539: dread - d7/d43/d88/d11/d5c/d8d/f9e zero size 2024-09-17T01:07:18.225 INFO:tasks.workunit.client.0.smithi103.stdout:2/605: mkdir d6/d5f/d26/d66/df/db7/dca 0 2024-09-17T01:07:18.225 INFO:tasks.workunit.client.0.smithi103.stdout:2/606: stat d6/da/d5d/d8d/d60 0 2024-09-17T01:07:18.226 INFO:tasks.workunit.client.0.smithi103.stdout:8/492: mkdir d0/d6/dc/d30/d25/d7d/d99 0 2024-09-17T01:07:18.227 INFO:tasks.workunit.client.0.smithi103.stdout:2/607: fsync d6/d5f/d26/f63 0 2024-09-17T01:07:18.232 INFO:tasks.workunit.client.0.smithi103.stdout:6/594: dread d3/d25/f29 [0,4194304] 0 2024-09-17T01:07:18.259 INFO:tasks.workunit.client.0.smithi103.stdout:9/540: unlink d7/d43/c49 0 2024-09-17T01:07:18.259 INFO:tasks.workunit.client.0.smithi103.stdout:1/542: truncate d2/de/d76/f88 2908009 0 2024-09-17T01:07:18.263 INFO:tasks.workunit.client.0.smithi103.stdout:2/608: write d6/da/d5d/d8d/d60/fa2 [1035903,73788] 0 2024-09-17T01:07:18.267 INFO:tasks.workunit.client.0.smithi103.stdout:9/541: chown d7/d43/d88/d11/d5c/f61 4375506 1 2024-09-17T01:07:18.272 INFO:tasks.workunit.client.0.smithi103.stdout:8/493: mknod d0/d6/dc/d30/d86/c9a 0 2024-09-17T01:07:18.272 INFO:tasks.workunit.client.0.smithi103.stdout:6/595: write d3/d16/d21/d50/faf [697820,68611] 0 2024-09-17T01:07:18.274 INFO:tasks.workunit.client.0.smithi103.stdout:6/596: read d3/d16/fa5 [6488118,23807] 0 2024-09-17T01:07:18.275 INFO:tasks.workunit.client.0.smithi103.stdout:2/609: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/ccb 0 2024-09-17T01:07:18.278 INFO:tasks.workunit.client.0.smithi103.stdout:2/610: chown d6/d5f/d26/d6e/c7f 217 1 2024-09-17T01:07:18.279 INFO:tasks.workunit.client.0.smithi103.stdout:9/542: mkdir d7/db8 0 2024-09-17T01:07:18.280 INFO:tasks.workunit.client.0.smithi103.stdout:8/494: dwrite d0/d6/dc/d30/d25/d64/d59/f82 [0,4194304] 0 2024-09-17T01:07:18.287 INFO:tasks.workunit.client.0.smithi103.stdout:6/597: chown d3/c20 862278 1 2024-09-17T01:07:18.289 INFO:tasks.workunit.client.0.smithi103.stdout:3/600: getdents d3/d16/d1b/d3c/d65/d75/dbe 0 2024-09-17T01:07:18.289 INFO:tasks.workunit.client.0.smithi103.stdout:3/601: fsync d3/d16/fcb 0 2024-09-17T01:07:18.293 INFO:tasks.workunit.client.0.smithi103.stdout:0/453: getdents dd/d4f/d64 0 2024-09-17T01:07:18.297 INFO:tasks.workunit.client.0.smithi103.stdout:9/543: chown d7/d43/d88/l41 2011 1 2024-09-17T01:07:18.299 INFO:tasks.workunit.client.0.smithi103.stdout:9/544: readlink d7/la3 0 2024-09-17T01:07:18.300 INFO:tasks.workunit.client.0.smithi103.stdout:1/543: dwrite d2/d1c/d28/d4b/d67/f86 [0,4194304] 0 2024-09-17T01:07:18.302 INFO:tasks.workunit.client.0.smithi103.stdout:3/602: dwrite d3/d16/d1b/d3c/d65/d75/f78 [0,4194304] 0 2024-09-17T01:07:18.305 INFO:tasks.workunit.client.0.smithi103.stdout:0/454: symlink dd/d5d/d93/l9c 0 2024-09-17T01:07:18.306 INFO:tasks.workunit.client.0.smithi103.stdout:6/598: read d3/d16/d33/d3e/fc8 [2099605,62215] 0 2024-09-17T01:07:18.306 INFO:tasks.workunit.client.0.smithi103.stdout:2/611: symlink d6/d5f/d26/d66/df/lcc 0 2024-09-17T01:07:18.307 INFO:tasks.workunit.client.0.smithi103.stdout:8/495: rename d0/f6a to d0/d6/dc/d30/d86/f9b 0 2024-09-17T01:07:18.309 INFO:tasks.workunit.client.0.smithi103.stdout:1/544: symlink d2/de/d1f/lb3 0 2024-09-17T01:07:18.309 INFO:tasks.workunit.client.0.smithi103.stdout:3/603: dread - d3/d16/d1b/d3c/d65/d75/dbe/d34/f48 zero size 2024-09-17T01:07:18.310 INFO:tasks.workunit.client.0.smithi103.stdout:6/599: write d3/d16/d33/d3e/d58/d82/fc2 [697465,103471] 0 2024-09-17T01:07:18.314 INFO:tasks.workunit.client.0.smithi103.stdout:1/545: rmdir d2/d1c/d20/d33 39 2024-09-17T01:07:18.316 INFO:tasks.workunit.client.0.smithi103.stdout:3/604: symlink d3/d16/d1b/d3c/ld4 0 2024-09-17T01:07:18.317 INFO:tasks.workunit.client.0.smithi103.stdout:2/612: mknod d6/d5f/d26/d66/da8/ccd 0 2024-09-17T01:07:18.326 INFO:tasks.workunit.client.0.smithi103.stdout:3/605: dwrite d3/d16/f2d [4194304,4194304] 0 2024-09-17T01:07:18.327 INFO:tasks.workunit.client.0.smithi103.stdout:0/455: creat dd/df/d68/d6c/d8e/f9d x:0 0 0 2024-09-17T01:07:18.332 INFO:tasks.workunit.client.0.smithi103.stdout:2/613: dwrite d6/d5f/d26/d66/fbc [0,4194304] 0 2024-09-17T01:07:18.339 INFO:tasks.workunit.client.0.smithi103.stdout:0/456: dwrite dd/d1c/d50/f99 [0,4194304] 0 2024-09-17T01:07:18.341 INFO:tasks.workunit.client.0.smithi103.stdout:8/496: write d0/f3e [296419,1257] 0 2024-09-17T01:07:18.343 INFO:tasks.workunit.client.0.smithi103.stdout:2/614: write d6/d5f/d26/d66/f22 [1470939,86189] 0 2024-09-17T01:07:18.343 INFO:tasks.workunit.client.0.smithi103.stdout:8/497: chown d0/d6/dc/d3d/f7e 1464745603 1 2024-09-17T01:07:18.344 INFO:tasks.workunit.client.0.smithi103.stdout:2/615: chown d6/d5f/d26/d66/l79 723 1 2024-09-17T01:07:18.345 INFO:tasks.workunit.client.0.smithi103.stdout:8/498: write d0/d6/dc/d3d/f40 [1959102,85319] 0 2024-09-17T01:07:18.346 INFO:tasks.workunit.client.0.smithi103.stdout:0/457: rmdir dd 39 2024-09-17T01:07:18.348 INFO:tasks.workunit.client.0.smithi103.stdout:8/499: chown d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90 3 1 2024-09-17T01:07:18.351 INFO:tasks.workunit.client.0.smithi103.stdout:3/606: read d3/d16/d1b/d3c/d65/d7e/fba [116132,63674] 0 2024-09-17T01:07:18.354 INFO:tasks.workunit.client.0.smithi103.stdout:3/607: write d3/d16/d90/fc0 [730737,127004] 0 2024-09-17T01:07:18.357 INFO:tasks.workunit.client.0.smithi103.stdout:1/546: dwrite d2/d1c/d20/d33/f57 [0,4194304] 0 2024-09-17T01:07:18.357 INFO:tasks.workunit.client.0.smithi103.stdout:3/608: readlink d3/d16/d1b/d36/l55 0 2024-09-17T01:07:18.370 INFO:tasks.workunit.client.0.smithi103.stdout:2/616: link d6/da/d5d/d8d/d60/d75/d70/l88 d6/d5f/d26/d66/df/d58/lce 0 2024-09-17T01:07:18.372 INFO:tasks.workunit.client.0.smithi103.stdout:8/500: creat d0/d80/f9c x:0 0 0 2024-09-17T01:07:18.373 INFO:tasks.workunit.client.0.smithi103.stdout:8/501: stat d0/d6/dc/d30/d2d/c78 0 2024-09-17T01:07:18.377 INFO:tasks.workunit.client.0.smithi103.stdout:3/609: dread d3/f9 [0,4194304] 0 2024-09-17T01:07:18.386 INFO:tasks.workunit.client.0.smithi103.stdout:3/610: creat d3/d16/d1b/d3c/d65/d83/fd5 x:0 0 0 2024-09-17T01:07:18.387 INFO:tasks.workunit.client.0.smithi103.stdout:1/547: write d2/de/f11 [1874564,8553] 0 2024-09-17T01:07:18.387 INFO:tasks.workunit.client.0.smithi103.stdout:3/611: chown d3/d16/d1b/l7d 6 1 2024-09-17T01:07:18.390 INFO:tasks.workunit.client.0.smithi103.stdout:3/612: fdatasync d3/d16/d1b/d3c/d65/d75/d9c/fa8 0 2024-09-17T01:07:18.391 INFO:tasks.workunit.client.0.smithi103.stdout:1/548: creat d2/d7/d4e/fb4 x:0 0 0 2024-09-17T01:07:18.392 INFO:tasks.workunit.client.0.smithi103.stdout:0/458: write dd/d1c/f4a [1121330,130645] 0 2024-09-17T01:07:18.397 INFO:tasks.workunit.client.0.smithi103.stdout:1/549: rmdir d2/d1c/d28/d4b 39 2024-09-17T01:07:18.399 INFO:tasks.workunit.client.0.smithi103.stdout:2/617: dwrite d6/d5f/d26/d34/d80/fc6 [0,4194304] 0 2024-09-17T01:07:18.401 INFO:tasks.workunit.client.0.smithi103.stdout:8/502: truncate d0/d6/dc/d3d/f40 1293944 0 2024-09-17T01:07:18.402 INFO:tasks.workunit.client.0.smithi103.stdout:8/503: readlink d0/d6/dc/d30/d2d/l2f 0 2024-09-17T01:07:18.407 INFO:tasks.workunit.client.0.smithi103.stdout:2/618: dwrite d6/d5f/f1e [0,4194304] 0 2024-09-17T01:07:18.414 INFO:tasks.workunit.client.0.smithi103.stdout:1/550: fsync d2/f5d 0 2024-09-17T01:07:18.416 INFO:tasks.workunit.client.0.smithi103.stdout:0/459: link f8 dd/df/d38/d55/f9e 0 2024-09-17T01:07:18.417 INFO:tasks.workunit.client.0.smithi103.stdout:3/613: dwrite d3/d16/d1b/d3c/d65/d75/dbe/f42 [0,4194304] 0 2024-09-17T01:07:18.420 INFO:tasks.workunit.client.0.smithi103.stdout:8/504: dwrite d0/d6/dc/d30/d25/d64/d59/f5f [0,4194304] 0 2024-09-17T01:07:18.421 INFO:tasks.workunit.client.0.smithi103.stdout:3/614: fdatasync d3/d16/d1b/d3c/f40 0 2024-09-17T01:07:18.427 INFO:tasks.workunit.client.0.smithi103.stdout:0/460: dwrite dd/d4f/f4c [0,4194304] 0 2024-09-17T01:07:18.439 INFO:tasks.workunit.client.0.smithi103.stdout:1/551: write d2/d1c/d54/f92 [439302,79904] 0 2024-09-17T01:07:18.446 INFO:tasks.workunit.client.0.smithi103.stdout:3/615: dread d3/d81/fb4 [0,4194304] 0 2024-09-17T01:07:18.448 INFO:tasks.workunit.client.0.smithi103.stdout:3/616: write d3/f27 [2463320,5186] 0 2024-09-17T01:07:18.451 INFO:tasks.workunit.client.0.smithi103.stdout:3/617: mkdir d3/d81/dd6 0 2024-09-17T01:07:18.455 INFO:tasks.workunit.client.0.smithi103.stdout:3/618: mkdir d3/dd7 0 2024-09-17T01:07:18.457 INFO:tasks.workunit.client.0.smithi103.stdout:2/619: truncate d6/d5f/d26/d34/d80/fc6 3830737 0 2024-09-17T01:07:18.458 INFO:tasks.workunit.client.0.smithi103.stdout:3/619: mknod d3/d44/d63/cd8 0 2024-09-17T01:07:18.462 INFO:tasks.workunit.client.0.smithi103.stdout:2/620: mknod d6/da/d5d/d8d/d60/ccf 0 2024-09-17T01:07:18.466 INFO:tasks.workunit.client.0.smithi103.stdout:1/552: dread d2/f8 [0,4194304] 0 2024-09-17T01:07:18.469 INFO:tasks.workunit.client.0.smithi103.stdout:2/621: dwrite d6/d5f/d26/d66/f55 [0,4194304] 0 2024-09-17T01:07:18.471 INFO:tasks.workunit.client.0.smithi103.stdout:2/622: fdatasync d6/da/d3f/f4a 0 2024-09-17T01:07:18.476 INFO:tasks.workunit.client.0.smithi103.stdout:1/553: dwrite d2/d7/fc [8388608,4194304] 0 2024-09-17T01:07:18.476 INFO:tasks.workunit.client.0.smithi103.stdout:2/623: dread - d6/d5f/d26/d66/df/d68/d7e/d9c/fa3 zero size 2024-09-17T01:07:18.481 INFO:tasks.workunit.client.0.smithi103.stdout:1/554: creat d2/d16/d51/d65/fb5 x:0 0 0 2024-09-17T01:07:18.482 INFO:tasks.workunit.client.0.smithi103.stdout:1/555: readlink d2/d7/d73/lab 0 2024-09-17T01:07:18.483 INFO:tasks.workunit.client.0.smithi103.stdout:2/624: mknod d6/da/d5d/d8d/d89/cd0 0 2024-09-17T01:07:18.484 INFO:tasks.workunit.client.0.smithi103.stdout:2/625: read d6/da/d5d/d8d/d60/fa2 [1143454,81157] 0 2024-09-17T01:07:18.490 INFO:tasks.workunit.client.0.smithi103.stdout:2/626: unlink d6/da/d5d/d8d/c6a 0 2024-09-17T01:07:18.492 INFO:tasks.workunit.client.0.smithi103.stdout:2/627: creat d6/da/d28/fd1 x:0 0 0 2024-09-17T01:07:18.494 INFO:tasks.workunit.client.0.smithi103.stdout:3/620: write d3/d16/d1b/d3c/f26 [1345550,66319] 0 2024-09-17T01:07:18.500 INFO:tasks.workunit.client.0.smithi103.stdout:3/621: link d3/d16/f3d d3/d81/fd9 0 2024-09-17T01:07:18.503 INFO:tasks.workunit.client.0.smithi103.stdout:3/622: symlink d3/d16/d1b/lda 0 2024-09-17T01:07:18.506 INFO:tasks.workunit.client.0.smithi103.stdout:3/623: rename d3/d16/d1b/lc7 to d3/d16/d1b/d3c/d65/d75/d9c/ldb 0 2024-09-17T01:07:18.507 INFO:tasks.workunit.client.0.smithi103.stdout:2/628: dread d6/d5f/d26/d66/f22 [0,4194304] 0 2024-09-17T01:07:18.507 INFO:tasks.workunit.client.0.smithi103.stdout:3/624: fdatasync d3/d44/fb2 0 2024-09-17T01:07:18.508 INFO:tasks.workunit.client.0.smithi103.stdout:2/629: write d6/da/d3f/f4a [383024,95326] 0 2024-09-17T01:07:18.509 INFO:tasks.workunit.client.0.smithi103.stdout:2/630: fsync d6/da/f64 0 2024-09-17T01:07:18.511 INFO:tasks.workunit.client.0.smithi103.stdout:3/625: mknod d3/d44/cdc 0 2024-09-17T01:07:18.522 INFO:tasks.workunit.client.0.smithi103.stdout:3/626: getdents d3/d16/d1b/d3c/d65 0 2024-09-17T01:07:18.524 INFO:tasks.workunit.client.0.smithi103.stdout:3/627: symlink d3/dd7/ldd 0 2024-09-17T01:07:18.525 INFO:tasks.workunit.client.0.smithi103.stdout:2/631: dread d6/da/d5d/d8d/d60/f9d [0,4194304] 0 2024-09-17T01:07:18.526 INFO:tasks.workunit.client.0.smithi103.stdout:2/632: stat d6/da 0 2024-09-17T01:07:18.527 INFO:tasks.workunit.client.0.smithi103.stdout:3/628: creat d3/d16/d1b/d3c/d65/d75/d9c/fde x:0 0 0 2024-09-17T01:07:18.528 INFO:tasks.workunit.client.0.smithi103.stdout:2/633: mknod d6/da/d5d/d8d/cd2 0 2024-09-17T01:07:18.528 INFO:tasks.workunit.client.0.smithi103.stdout:3/629: truncate d3/d81/fc4 852898 0 2024-09-17T01:07:18.530 INFO:tasks.workunit.client.0.smithi103.stdout:2/634: dread - d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/fc1 zero size 2024-09-17T01:07:18.535 INFO:tasks.workunit.client.0.smithi103.stdout:3/630: dwrite d3/d44/fb2 [0,4194304] 0 2024-09-17T01:07:18.537 INFO:tasks.workunit.client.0.smithi103.stdout:2/635: link d6/d5f/f3c d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/fd3 0 2024-09-17T01:07:18.545 INFO:tasks.workunit.client.0.smithi103.stdout:2/636: dwrite d6/da/d5d/d8d/d60/d75/f2a [4194304,4194304] 0 2024-09-17T01:07:18.550 INFO:tasks.workunit.client.0.smithi103.stdout:2/637: rename d6/da/d3f/l57 to d6/da/d28/ld4 0 2024-09-17T01:07:18.551 INFO:tasks.workunit.client.0.smithi103.stdout:3/631: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:07:18.556 INFO:tasks.workunit.client.0.smithi103.stdout:3/632: fsync d3/f57 0 2024-09-17T01:07:18.557 INFO:tasks.workunit.client.0.smithi103.stdout:2/638: write d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/f85 [597934,112801] 0 2024-09-17T01:07:18.560 INFO:tasks.workunit.client.0.smithi103.stdout:3/633: write d3/f9 [162535,54940] 0 2024-09-17T01:07:18.561 INFO:tasks.workunit.client.0.smithi103.stdout:2/639: creat d6/d5f/d26/d66/df/d68/d7e/d8b/fd5 x:0 0 0 2024-09-17T01:07:18.564 INFO:tasks.workunit.client.0.smithi103.stdout:3/634: creat d3/d16/d1b/d3c/d65/d83/fdf x:0 0 0 2024-09-17T01:07:18.565 INFO:tasks.workunit.client.0.smithi103.stdout:3/635: chown d3/d16/d1b/l38 8 1 2024-09-17T01:07:18.568 INFO:tasks.workunit.client.0.smithi103.stdout:2/640: dwrite d6/da/d28/f4d [4194304,4194304] 0 2024-09-17T01:07:18.570 INFO:tasks.workunit.client.0.smithi103.stdout:3/636: rename d3/f27 to d3/d16/d1b/d3c/d97/fe0 0 2024-09-17T01:07:18.578 INFO:tasks.workunit.client.0.smithi103.stdout:3/637: dwrite d3/f15 [4194304,4194304] 0 2024-09-17T01:07:18.581 INFO:tasks.workunit.client.0.smithi103.stdout:2/641: dwrite d6/d5f/d26/f5a [0,4194304] 0 2024-09-17T01:07:18.582 INFO:tasks.workunit.client.0.smithi103.stdout:3/638: symlink d3/d16/d1b/d3c/d65/d75/le1 0 2024-09-17T01:07:18.589 INFO:tasks.workunit.client.0.smithi103.stdout:3/639: symlink d3/d16/d1b/d3c/d65/d75/dd1/le2 0 2024-09-17T01:07:18.589 INFO:tasks.workunit.client.0.smithi103.stdout:2/642: getdents d6/d5f/d26/d66/da8 0 2024-09-17T01:07:18.595 INFO:tasks.workunit.client.0.smithi103.stdout:2/643: dread d6/da/d5d/d8d/d60/d75/d70/f9f [0,4194304] 0 2024-09-17T01:07:18.601 INFO:tasks.workunit.client.0.smithi103.stdout:2/644: dwrite d6/f8 [0,4194304] 0 2024-09-17T01:07:18.608 INFO:tasks.workunit.client.0.smithi103.stdout:3/640: dread d3/d16/d1b/d3c/f4f [0,4194304] 0 2024-09-17T01:07:18.608 INFO:tasks.workunit.client.0.smithi103.stdout:2/645: link d6/da/d5d/d8d/f53 d6/d5f/dad/fd6 0 2024-09-17T01:07:18.614 INFO:tasks.workunit.client.0.smithi103.stdout:2/646: rename d6/f97 to d6/d5f/d26/d34/fd7 0 2024-09-17T01:07:18.616 INFO:tasks.workunit.client.0.smithi103.stdout:3/641: link d3/d44/f4a d3/d16/d1b/d3c/d65/d83/fe3 0 2024-09-17T01:07:18.620 INFO:tasks.workunit.client.0.smithi103.stdout:3/642: creat d3/d16/d1b/d3c/d65/d75/d9c/dd3/fe4 x:0 0 0 2024-09-17T01:07:18.624 INFO:tasks.workunit.client.0.smithi103.stdout:3/643: truncate d3/d16/d1b/d3c/d65/d75/dbe/d34/f48 716046 0 2024-09-17T01:07:18.625 INFO:tasks.workunit.client.0.smithi103.stdout:3/644: dread - d3/d16/d1b/d3c/d65/d75/d9c/fde zero size 2024-09-17T01:07:18.632 INFO:tasks.workunit.client.0.smithi103.stdout:3/645: dwrite d3/d16/d1b/d3c/d65/d83/f9d [4194304,4194304] 0 2024-09-17T01:07:18.632 INFO:tasks.workunit.client.0.smithi103.stdout:2/647: mknod d6/da/d5d/cd8 0 2024-09-17T01:07:18.637 INFO:tasks.workunit.client.0.smithi103.stdout:2/648: chown d6/d5f/f3c 1 1 2024-09-17T01:07:18.638 INFO:tasks.workunit.client.0.smithi103.stdout:3/646: symlink d3/le5 0 2024-09-17T01:07:18.638 INFO:tasks.workunit.client.0.smithi103.stdout:3/647: fsync d3/d16/f2d 0 2024-09-17T01:07:18.640 INFO:tasks.workunit.client.0.smithi103.stdout:3/648: chown d3/d16/d1b/d3c/d65/d7c/lbd 23674 1 2024-09-17T01:07:18.640 INFO:tasks.workunit.client.0.smithi103.stdout:3/649: dread - d3/d44/fc1 zero size 2024-09-17T01:07:18.642 INFO:tasks.workunit.client.0.smithi103.stdout:3/650: fdatasync d3/d16/d1b/d3c/d65/d75/d9c/dd3/fe4 0 2024-09-17T01:07:18.715 INFO:tasks.workunit.client.0.smithi103.stdout:7/543: sync 2024-09-17T01:07:18.722 INFO:tasks.workunit.client.0.smithi103.stdout:3/651: fsync d3/d16/d1b/d3c/f68 0 2024-09-17T01:07:18.725 INFO:tasks.workunit.client.0.smithi103.stdout:7/544: rename d4/d11/d2b to d4/d10/d6b/dc5 0 2024-09-17T01:07:18.726 INFO:tasks.workunit.client.0.smithi103.stdout:3/652: symlink d3/d16/d1b/d36/le6 0 2024-09-17T01:07:18.727 INFO:tasks.workunit.client.0.smithi103.stdout:7/545: mknod d4/d11/d80/d8c/dac/cc6 0 2024-09-17T01:07:18.728 INFO:tasks.workunit.client.0.smithi103.stdout:7/546: chown d4/d10/d6b/dc5/f65 5 1 2024-09-17T01:07:18.730 INFO:tasks.workunit.client.0.smithi103.stdout:7/547: write d4/d10/d6b/dc5/fbb [608802,43859] 0 2024-09-17T01:07:18.732 INFO:tasks.workunit.client.0.smithi103.stdout:2/649: dread d6/d5f/d26/f63 [0,4194304] 0 2024-09-17T01:07:18.733 INFO:tasks.workunit.client.0.smithi103.stdout:7/548: creat d4/d10/d6b/d72/fc7 x:0 0 0 2024-09-17T01:07:18.739 INFO:tasks.workunit.client.0.smithi103.stdout:2/650: dwrite d6/da/d5d/d8d/f51 [0,4194304] 0 2024-09-17T01:07:18.743 INFO:tasks.workunit.client.0.smithi103.stdout:7/549: rename d4/d11/d80/d8c/dac to d4/d10/d43/dc8 0 2024-09-17T01:07:18.743 INFO:tasks.workunit.client.0.smithi103.stdout:3/653: truncate d3/d16/d1b/d3c/d65/d75/dbe/faf 5344628 0 2024-09-17T01:07:18.744 INFO:tasks.workunit.client.0.smithi103.stdout:2/651: mkdir d6/d5f/d26/d66/df/d68/d7e/dd9 0 2024-09-17T01:07:18.746 INFO:tasks.workunit.client.0.smithi103.stdout:3/654: truncate d3/d16/d1b/d3c/d65/d83/fd5 109590 0 2024-09-17T01:07:18.747 INFO:tasks.workunit.client.0.smithi103.stdout:2/652: creat d6/d5f/d26/d66/df/d68/d7e/d9c/fda x:0 0 0 2024-09-17T01:07:18.748 INFO:tasks.workunit.client.0.smithi103.stdout:3/655: rmdir d3/d16/d1b/d3c/d97 39 2024-09-17T01:07:18.750 INFO:tasks.workunit.client.0.smithi103.stdout:2/653: unlink d6/da/d28/f35 0 2024-09-17T01:07:18.755 INFO:tasks.workunit.client.0.smithi103.stdout:3/656: dwrite d3/d16/fca [0,4194304] 0 2024-09-17T01:07:18.763 INFO:tasks.workunit.client.0.smithi103.stdout:7/550: truncate d4/d4a/d4b/d8a/fab 52886 0 2024-09-17T01:07:18.763 INFO:tasks.workunit.client.0.smithi103.stdout:3/657: dwrite d3/d16/d1b/f45 [0,4194304] 0 2024-09-17T01:07:18.763 INFO:tasks.workunit.client.0.smithi103.stdout:2/654: link d6/d5f/d26/d66/df/d58/cbe d6/da/d5d/d8d/d60/d75/d70/cdb 0 2024-09-17T01:07:18.764 INFO:tasks.workunit.client.0.smithi103.stdout:7/551: chown d4/d11/l5c 82 1 2024-09-17T01:07:18.765 INFO:tasks.workunit.client.0.smithi103.stdout:2/655: write d6/da/d5d/d8d/f51 [4848827,33524] 0 2024-09-17T01:07:18.769 INFO:tasks.workunit.client.0.smithi103.stdout:3/658: mkdir d3/dd7/de7 0 2024-09-17T01:07:18.775 INFO:tasks.workunit.client.0.smithi103.stdout:7/552: symlink d4/d4a/lc9 0 2024-09-17T01:07:18.780 INFO:tasks.workunit.client.0.smithi103.stdout:3/659: rename d3/d16/l8a to d3/d44/le8 0 2024-09-17T01:07:18.782 INFO:tasks.workunit.client.0.smithi103.stdout:3/660: write d3/d16/d1b/d3c/d65/d75/d9c/dd3/fe4 [565635,63099] 0 2024-09-17T01:07:18.796 INFO:tasks.workunit.client.0.smithi103.stdout:2/656: write d6/d5f/d26/d66/df/f43 [132962,45033] 0 2024-09-17T01:07:18.797 INFO:tasks.workunit.client.0.smithi103.stdout:7/553: write d4/d10/d6b/dc5/d36/d3a/f6e [1012256,106826] 0 2024-09-17T01:07:18.797 INFO:tasks.workunit.client.0.smithi103.stdout:7/554: chown d4/d10/f94 10 1 2024-09-17T01:07:18.802 INFO:tasks.workunit.client.0.smithi103.stdout:3/661: write d3/d16/d1b/f74 [220075,107169] 0 2024-09-17T01:07:18.830 INFO:tasks.workunit.client.0.smithi103.stdout:7/555: readlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/la9 0 2024-09-17T01:07:18.831 INFO:tasks.workunit.client.0.smithi103.stdout:7/556: readlink d4/d10/l1b 0 2024-09-17T01:07:18.831 INFO:tasks.workunit.client.0.smithi103.stdout:7/557: dread - d4/d10/d66/f6f zero size 2024-09-17T01:07:18.833 INFO:tasks.workunit.client.0.smithi103.stdout:7/558: read d4/d11/f5f [471719,121385] 0 2024-09-17T01:07:18.835 INFO:tasks.workunit.client.0.smithi103.stdout:2/657: truncate d6/d5f/f29 2462813 0 2024-09-17T01:07:18.836 INFO:tasks.workunit.client.0.smithi103.stdout:3/662: mknod d3/d16/d1b/d3c/d97/ce9 0 2024-09-17T01:07:18.837 INFO:tasks.workunit.client.0.smithi103.stdout:3/663: chown d3/d16/d1b/d3c/d65/d83 10 1 2024-09-17T01:07:18.841 INFO:tasks.workunit.client.0.smithi103.stdout:2/658: dwrite d6/da/d5d/d8d/d60/d75/f91 [0,4194304] 0 2024-09-17T01:07:18.843 INFO:tasks.workunit.client.0.smithi103.stdout:3/664: fdatasync d3/d16/fae 0 2024-09-17T01:07:18.845 INFO:tasks.workunit.client.0.smithi103.stdout:2/659: mkdir d6/d5f/d26/d34/ddc 0 2024-09-17T01:07:18.849 INFO:tasks.workunit.client.0.smithi103.stdout:3/665: mknod d3/dd7/de7/cea 0 2024-09-17T01:07:18.850 INFO:tasks.workunit.client.0.smithi103.stdout:3/666: write d3/d16/d90/fc0 [894452,121355] 0 2024-09-17T01:07:18.851 INFO:tasks.workunit.client.0.smithi103.stdout:2/660: dread d6/d5f/d26/d34/d80/fc6 [0,4194304] 0 2024-09-17T01:07:18.854 INFO:tasks.workunit.client.0.smithi103.stdout:3/667: read d3/d16/d1b/d3c/d65/d75/dbe/f42 [1688271,108499] 0 2024-09-17T01:07:18.854 INFO:tasks.workunit.client.0.smithi103.stdout:3/668: chown d3 593 1 2024-09-17T01:07:18.858 INFO:tasks.workunit.client.0.smithi103.stdout:3/669: creat d3/dd7/feb x:0 0 0 2024-09-17T01:07:18.861 INFO:tasks.workunit.client.0.smithi103.stdout:2/661: mkdir d6/d5f/d26/d66/df/ddd 0 2024-09-17T01:07:18.866 INFO:tasks.workunit.client.0.smithi103.stdout:2/662: creat d6/d5f/fde x:0 0 0 2024-09-17T01:07:18.870 INFO:tasks.workunit.client.0.smithi103.stdout:2/663: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/cdf 0 2024-09-17T01:07:18.874 INFO:tasks.workunit.client.0.smithi103.stdout:2/664: dread f4 [0,4194304] 0 2024-09-17T01:07:18.874 INFO:tasks.workunit.client.0.smithi103.stdout:3/670: getdents d3/dd7/de7 0 2024-09-17T01:07:18.877 INFO:tasks.workunit.client.0.smithi103.stdout:3/671: write d3/d44/f71 [2445468,8451] 0 2024-09-17T01:07:18.883 INFO:tasks.workunit.client.0.smithi103.stdout:2/665: rename d6/d5f/d26/d66/df/f99 to d6/d5f/fe0 0 2024-09-17T01:07:18.883 INFO:tasks.workunit.client.0.smithi103.stdout:7/559: write d4/d4a/d4b/d8a/fab [378756,37486] 0 2024-09-17T01:07:18.887 INFO:tasks.workunit.client.0.smithi103.stdout:2/666: truncate d6/d5f/d26/d66/df/d68/d7e/d8b/fd5 270614 0 2024-09-17T01:07:18.887 INFO:tasks.workunit.client.0.smithi103.stdout:7/560: write d4/d10/d32/faf [551514,91348] 0 2024-09-17T01:07:18.888 INFO:tasks.workunit.client.0.smithi103.stdout:2/667: dread - d6/da/f8c zero size 2024-09-17T01:07:18.891 INFO:tasks.workunit.client.0.smithi103.stdout:3/672: dwrite d3/d44/d63/f98 [0,4194304] 0 2024-09-17T01:07:18.894 INFO:tasks.workunit.client.0.smithi103.stdout:3/673: rmdir d3/d16/d1b/d3c/d65/d7e/da3 39 2024-09-17T01:07:18.897 INFO:tasks.workunit.client.0.smithi103.stdout:3/674: mknod d3/d16/d1b/d3c/d65/d7e/dac/cec 0 2024-09-17T01:07:18.899 INFO:tasks.workunit.client.0.smithi103.stdout:3/675: creat d3/d16/d1b/d3c/d65/d75/d8d/fed x:0 0 0 2024-09-17T01:07:18.901 INFO:tasks.workunit.client.0.smithi103.stdout:3/676: dread - d3/d44/d63/f6c zero size 2024-09-17T01:07:18.901 INFO:tasks.workunit.client.0.smithi103.stdout:3/677: chown d3/d16/l29 35917 1 2024-09-17T01:07:18.905 INFO:tasks.workunit.client.0.smithi103.stdout:3/678: dread d3/d16/d1b/d3c/d65/d75/dbe/f42 [0,4194304] 0 2024-09-17T01:07:18.908 INFO:tasks.workunit.client.0.smithi103.stdout:3/679: unlink d3/d16/d1b/d36/f67 0 2024-09-17T01:07:18.909 INFO:tasks.workunit.client.0.smithi103.stdout:3/680: rmdir d3/d16/d1b/d3c/d65/d75/dbe/d34/d8c 39 2024-09-17T01:07:18.911 INFO:tasks.workunit.client.0.smithi103.stdout:3/681: symlink d3/d16/d1b/d3c/d65/d83/lee 0 2024-09-17T01:07:18.912 INFO:tasks.workunit.client.0.smithi103.stdout:3/682: rmdir d3/d16/d1b/d3c/d65/d75 39 2024-09-17T01:07:18.912 INFO:tasks.workunit.client.0.smithi103.stdout:3/683: write d3/d16/fae [381446,86106] 0 2024-09-17T01:07:18.918 INFO:tasks.workunit.client.0.smithi103.stdout:3/684: rename d3/d16/d1b/d3c/d65/d75/dbe/d34/d8c/lbc to d3/d16/d1b/d3c/d65/d75/d9c/lef 0 2024-09-17T01:07:18.923 INFO:tasks.workunit.client.0.smithi103.stdout:2/668: truncate d6/da/f82 640556 0 2024-09-17T01:07:18.924 INFO:tasks.workunit.client.0.smithi103.stdout:3/685: creat d3/d16/d1b/d3c/d65/d83/dbf/ff0 x:0 0 0 2024-09-17T01:07:18.926 INFO:tasks.workunit.client.0.smithi103.stdout:2/669: fdatasync d6/da/d5d/d8d/d60/f9d 0 2024-09-17T01:07:18.929 INFO:tasks.workunit.client.0.smithi103.stdout:7/561: dread d4/d10/d6b/dc5/d36/d3a/d51/d5e/f60 [0,4194304] 0 2024-09-17T01:07:18.929 INFO:tasks.workunit.client.0.smithi103.stdout:2/670: rename d6/d5f/d26/d66/l3a to d6/d5f/d26/d6e/le1 0 2024-09-17T01:07:18.939 INFO:tasks.workunit.client.0.smithi103.stdout:2/671: rename d6/d5f/d26/d66/df/d58/lce to d6/d5f/d26/d66/df/d68/d7e/d8b/le2 0 2024-09-17T01:07:18.941 INFO:tasks.workunit.client.0.smithi103.stdout:3/686: write d3/d16/d1b/d3c/d65/d75/dbe/d34/d8c/fa7 [256418,77264] 0 2024-09-17T01:07:18.943 INFO:tasks.workunit.client.0.smithi103.stdout:2/672: symlink d6/d5f/le3 0 2024-09-17T01:07:18.944 INFO:tasks.workunit.client.0.smithi103.stdout:3/687: creat d3/d16/d1b/d3c/d65/d83/ff1 x:0 0 0 2024-09-17T01:07:18.944 INFO:tasks.workunit.client.0.smithi103.stdout:2/673: chown d6/d5f/d26/d6e/lab 2 1 2024-09-17T01:07:18.948 INFO:tasks.workunit.client.0.smithi103.stdout:2/674: creat d6/da/d3f/fe4 x:0 0 0 2024-09-17T01:07:18.949 INFO:tasks.workunit.client.0.smithi103.stdout:7/562: dwrite d4/d4a/d4b/d9d/fb6 [0,4194304] 0 2024-09-17T01:07:18.954 INFO:tasks.workunit.client.0.smithi103.stdout:2/675: symlink d6/da/d5d/le5 0 2024-09-17T01:07:18.955 INFO:tasks.workunit.client.0.smithi103.stdout:7/563: creat d4/d10/d6b/dc5/d36/d3a/d51/fca x:0 0 0 2024-09-17T01:07:18.959 INFO:tasks.workunit.client.0.smithi103.stdout:3/688: dwrite d3/d44/d63/f6c [0,4194304] 0 2024-09-17T01:07:18.960 INFO:tasks.workunit.client.0.smithi103.stdout:7/564: dread - d4/d10/d66/f6d zero size 2024-09-17T01:07:18.960 INFO:tasks.workunit.client.0.smithi103.stdout:2/676: creat d6/d5f/d26/d66/df/ddd/fe6 x:0 0 0 2024-09-17T01:07:18.962 INFO:tasks.workunit.client.0.smithi103.stdout:3/689: fdatasync d3/d16/d1b/d3c/f4f 0 2024-09-17T01:07:18.964 INFO:tasks.workunit.client.0.smithi103.stdout:2/677: write d6/d5f/d26/d66/df/d68/d7e/d8b/fd5 [853872,27123] 0 2024-09-17T01:07:18.970 INFO:tasks.workunit.client.0.smithi103.stdout:7/565: dwrite d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:18.971 INFO:tasks.workunit.client.0.smithi103.stdout:7/566: stat d4/d11/d34/db5/f5b 0 2024-09-17T01:07:18.973 INFO:tasks.workunit.client.0.smithi103.stdout:2/678: dread d6/d5f/f1e [0,4194304] 0 2024-09-17T01:07:18.973 INFO:tasks.workunit.client.0.smithi103.stdout:7/567: write d4/f1a [3140483,113044] 0 2024-09-17T01:07:18.975 INFO:tasks.workunit.client.0.smithi103.stdout:3/690: dwrite d3/d16/d1b/f89 [0,4194304] 0 2024-09-17T01:07:18.989 INFO:tasks.workunit.client.0.smithi103.stdout:2/679: getdents d6/d5f 0 2024-09-17T01:07:19.141 INFO:tasks.workunit.client.0.smithi103.stdout:7/568: write d4/d10/d6b/dc5/d36/d82/f8f [941497,33633] 0 2024-09-17T01:07:19.149 INFO:tasks.workunit.client.0.smithi103.stdout:7/569: readlink d4/d11/d34/lb2 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:7/570: readlink d4/d11/l61 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:2/680: rename d6/da/d3f/l76 to d6/d5f/d26/d6e/le7 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:7/571: creat d4/d10/d37/fcb x:0 0 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:2/681: unlink d6/da/d5d/d8d/d60/f9d 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:2/682: dread d6/d5f/d26/f62 [0,4194304] 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:3/691: dwrite d3/d16/d1b/d3c/d65/d75/dbe/faf [0,4194304] 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:2/683: truncate d6/d5f/d26/d66/df/d68/d7e/d9c/fa3 563411 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:7/572: write d4/d10/d6b/dc5/d36/d3a/d51/d5e/f60 [1883602,21834] 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:7/573: write d4/f7 [1251595,118218] 0 2024-09-17T01:07:19.150 INFO:tasks.workunit.client.0.smithi103.stdout:3/692: getdents d3/d81/dd6 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:2/684: truncate d6/d5f/d26/d66/df/d68/d7e/fc4 3217443 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:2/685: fdatasync d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/f87 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:7/574: dread d4/d10/d6b/dc5/d36/d3a/f6e [0,4194304] 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:3/693: mknod d3/d16/d1b/d3c/cf2 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:3/694: write d3/d16/d1b/d3c/f4f [2700797,126038] 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:2/686: mkdir d6/da/d5d/d8d/d89/de8 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:2/687: write d6/da/f2f [1439219,102060] 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:2/688: dwrite d6/da/f64 [4194304,4194304] 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:3/695: rename d3/d16/d1b/d3c/d65/d7e/dac/cb5 to d3/d16/d1b/cf3 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:3/696: stat d3/d16/d1b/d3c/d65/d75/d8d 0 2024-09-17T01:07:19.151 INFO:tasks.workunit.client.0.smithi103.stdout:7/575: dread d4/d10/d43/f57 [0,4194304] 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:2/689: rename d6/da/d3f/lc7 to d6/da/d5d/d8d/d60/d75/le9 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:2/690: chown d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/ccb 368 1 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:2/691: fsync d6/d5f/d26/d34/f73 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:3/697: mknod d3/d16/d1b/cf4 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:3/698: stat d3/d16/l29 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:2/692: fsync d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/f87 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:3/699: write d3/d16/d1b/d3c/d65/d75/d9c/dd3/fe4 [176258,37793] 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:7/576: getdents d4/d11/d80 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:7/577: creat d4/d10/d6b/fcc x:0 0 0 2024-09-17T01:07:19.152 INFO:tasks.workunit.client.0.smithi103.stdout:7/578: chown d4/d10/d6b/dc5/d36/d3a/d51/c76 181595722 1 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:9/545: sync 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:7/579: dread d4/d4a/d4b/d9d/fb6 [0,4194304] 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:2/693: dwrite d6/da/d5d/d8d/d60/fa2 [0,4194304] 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:7/580: chown d4/d11/d80/d8c/fbe 154 1 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:3/700: dwrite d3/d16/f3d [4194304,4194304] 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:9/546: link d7/d43/d88/d11/d5c/d5e/d6c/l81 d7/d43/d88/d11/lb9 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:7/581: creat d4/d4a/d4b/fcd x:0 0 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:7/582: rename d4/d11/c14 to d4/d11/d80/db1/cce 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:2/694: link d6/d5f/d26/d66/df/d68/d7e/d8b/le2 d6/d5f/d26/d66/df/d68/d7e/d9c/lea 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:3/701: dwrite d3/d16/d1b/d36/fc2 [0,4194304] 0 2024-09-17T01:07:19.153 INFO:tasks.workunit.client.0.smithi103.stdout:9/547: creat d7/d43/d88/d11/fba x:0 0 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:2/695: rename d6/d5f/d26/d34/d80/fb9 to d6/d5f/d26/d66/da8/feb 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:3/702: dread d3/d16/d1b/f89 [0,4194304] 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:3/703: fsync d3/f1c 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:3/704: read d3/d16/d1b/d3c/d65/d7e/fb7 [39467,101755] 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:9/548: getdents d7/d43/d88/d11/d20/d4f 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:2/696: rename d6/d5f/dad/caf to d6/cec 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:9/549: rename d7/d43/d88/d11/d21 to d7/db8/dbb 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:7/583: truncate d4/d10/f35 1939066 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:9/550: fdatasync d7/d2d/f37 0 2024-09-17T01:07:19.154 INFO:tasks.workunit.client.0.smithi103.stdout:2/697: getdents d6/da/d5d/d8d/d89/de8 0 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:6/600: sync 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:8/505: sync 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:5/425: sync 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:0/461: sync 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:1/556: sync 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:4/654: sync 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:1/557: chown d2/d1c/d28/d52/d69 329 1 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:3/705: dread d3/d44/f71 [0,4194304] 0 2024-09-17T01:07:19.155 INFO:tasks.workunit.client.0.smithi103.stdout:5/426: unlink d6/d11/f26 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:6/601: truncate d3/d16/d33/d57/fcb 3286 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:5/427: chown d6/d2c/f51 448 1 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:8/506: dread d0/d6/dc/d30/d25/d64/d59/f82 [0,4194304] 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:7/584: rename d4/d11/d80/d8c/fbe to d4/d10/d6b/dc5/d36/d3a/fcf 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:0/462: mkdir dd/d1c/d9f 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:1/558: mknod d2/de/d76/cb6 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:4/655: dread d9/d10/f1f [0,4194304] 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:3/706: read d3/d16/d1b/d3c/d65/d7e/fb7 [116804,17273] 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:3/707: chown d3/d16/d1b/d3c/d65/d75/d9c 26342 1 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:6/602: symlink d3/d25/d26/d87/lcf 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:3/708: write d3/d16/d1b/d3c/d65/d83/fd5 [42255,122068] 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:0/463: unlink dd/df/f26 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:0/464: write dd/df/d38/f60 [3490746,72141] 0 2024-09-17T01:07:19.156 INFO:tasks.workunit.client.0.smithi103.stdout:0/465: write dd/f15 [2374225,118561] 0 2024-09-17T01:07:19.157 INFO:tasks.workunit.client.0.smithi103.stdout:0/466: dwrite dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:19.157 INFO:tasks.workunit.client.0.smithi103.stdout:5/428: dwrite d6/d2c/f51 [0,4194304] 0 2024-09-17T01:07:19.157 INFO:tasks.workunit.client.0.smithi103.stdout:2/698: mkdir d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/ded 0 2024-09-17T01:07:19.157 INFO:tasks.workunit.client.0.smithi103.stdout:4/656: rename d9/d16/d38/d3f/l41 to d9/dc/df/lcf 0 2024-09-17T01:07:19.157 INFO:tasks.workunit.client.0.smithi103.stdout:6/603: dread d3/d25/d26/f2e [0,4194304] 0 2024-09-17T01:07:19.157 INFO:tasks.workunit.client.0.smithi103.stdout:4/657: write d9/d16/d38/d3f/f6f [2854923,61830] 0 2024-09-17T01:07:19.158 INFO:tasks.workunit.client.0.smithi103.stdout:2/699: dwrite d6/d5f/d26/d34/d80/fb2 [0,4194304] 0 2024-09-17T01:07:19.158 INFO:tasks.workunit.client.0.smithi103.stdout:9/551: truncate d7/d43/d88/d11/d5c/d5e/d6c/d6e/f96 791797 0 2024-09-17T01:07:19.164 INFO:tasks.workunit.client.0.smithi103.stdout:8/507: mknod d0/d6/dc/c9d 0 2024-09-17T01:07:19.169 INFO:tasks.workunit.client.0.smithi103.stdout:3/709: truncate d3/d16/d1b/d3c/d65/d7e/dac/dce/f72 419347 0 2024-09-17T01:07:19.169 INFO:tasks.workunit.client.0.smithi103.stdout:3/710: stat d3/c2e 0 2024-09-17T01:07:19.174 INFO:tasks.workunit.client.0.smithi103.stdout:1/559: truncate d2/d1c/d20/d33/f59 3936078 0 2024-09-17T01:07:19.187 INFO:tasks.workunit.client.0.smithi103.stdout:4/658: dread d9/d16/d23/d32/d61/f87 [0,4194304] 0 2024-09-17T01:07:19.192 INFO:tasks.workunit.client.0.smithi103.stdout:1/560: unlink d2/d1c/f38 0 2024-09-17T01:07:19.200 INFO:tasks.workunit.client.0.smithi103.stdout:3/711: mkdir d3/d16/d1b/d3c/d65/d7e/da3/df5 0 2024-09-17T01:07:19.204 INFO:tasks.workunit.client.0.smithi103.stdout:2/700: creat d6/d5f/d26/d66/df/fee x:0 0 0 2024-09-17T01:07:19.205 INFO:tasks.workunit.client.0.smithi103.stdout:7/585: dwrite d4/d10/d6b/dc5/d36/d3a/d51/f88 [0,4194304] 0 2024-09-17T01:07:19.212 INFO:tasks.workunit.client.0.smithi103.stdout:3/712: link d3/d16/d1b/d3c/d65/d7e/dac/dce/fb9 d3/d16/d1b/d3c/d65/d75/dbe/ff6 0 2024-09-17T01:07:19.213 INFO:tasks.workunit.client.0.smithi103.stdout:7/586: dread d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:19.216 INFO:tasks.workunit.client.0.smithi103.stdout:7/587: truncate d4/d10/d6b/dc5/d36/d3a/d51/fca 779358 0 2024-09-17T01:07:19.216 INFO:tasks.workunit.client.0.smithi103.stdout:3/713: mkdir d3/d16/d1b/d3c/d65/df7 0 2024-09-17T01:07:19.217 INFO:tasks.workunit.client.0.smithi103.stdout:0/467: write dd/f3e [1826541,36252] 0 2024-09-17T01:07:19.223 INFO:tasks.workunit.client.0.smithi103.stdout:7/588: mkdir d4/d10/d6b/dc5/d8d/d92/db3/dd0 0 2024-09-17T01:07:19.228 INFO:tasks.workunit.client.0.smithi103.stdout:7/589: dwrite d4/d10/d6b/dc5/f65 [0,4194304] 0 2024-09-17T01:07:19.229 INFO:tasks.workunit.client.0.smithi103.stdout:0/468: truncate dd/d43/f53 1312465 0 2024-09-17T01:07:19.229 INFO:tasks.workunit.client.0.smithi103.stdout:0/469: dread - dd/f95 zero size 2024-09-17T01:07:19.232 INFO:tasks.workunit.client.0.smithi103.stdout:7/590: write d4/d10/d6b/dc5/d36/f7d [3324169,84756] 0 2024-09-17T01:07:19.234 INFO:tasks.workunit.client.0.smithi103.stdout:7/591: dread - d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/fa7 zero size 2024-09-17T01:07:19.235 INFO:tasks.workunit.client.0.smithi103.stdout:0/470: creat dd/df/d38/d55/fa0 x:0 0 0 2024-09-17T01:07:19.238 INFO:tasks.workunit.client.0.smithi103.stdout:7/592: creat d4/d10/d66/fd1 x:0 0 0 2024-09-17T01:07:19.242 INFO:tasks.workunit.client.0.smithi103.stdout:0/471: dwrite dd/df/d38/d62/f85 [0,4194304] 0 2024-09-17T01:07:19.244 INFO:tasks.workunit.client.0.smithi103.stdout:9/552: truncate d7/d2d/d59/f66 26945 0 2024-09-17T01:07:19.250 INFO:tasks.workunit.client.0.smithi103.stdout:9/553: fdatasync d7/db8/dbb/f33 0 2024-09-17T01:07:19.253 INFO:tasks.workunit.client.0.smithi103.stdout:0/472: link dd/d4f/c22 dd/df/d68/d6c/ca1 0 2024-09-17T01:07:19.257 INFO:tasks.workunit.client.0.smithi103.stdout:0/473: fsync dd/d4f/d64/f79 0 2024-09-17T01:07:19.259 INFO:tasks.workunit.client.0.smithi103.stdout:5/429: truncate d6/d11/f2b 128853 0 2024-09-17T01:07:19.266 INFO:tasks.workunit.client.0.smithi103.stdout:8/508: dwrite d0/d6/f1c [0,4194304] 0 2024-09-17T01:07:19.267 INFO:tasks.workunit.client.0.smithi103.stdout:0/474: write dd/d4f/f81 [222029,48145] 0 2024-09-17T01:07:19.269 INFO:tasks.workunit.client.0.smithi103.stdout:9/554: dwrite d7/d43/d88/d11/d5c/d8d/f9e [0,4194304] 0 2024-09-17T01:07:19.270 INFO:tasks.workunit.client.0.smithi103.stdout:3/714: write d3/d16/d1b/d3c/d65/f9b [1418133,81164] 0 2024-09-17T01:07:19.272 INFO:tasks.workunit.client.0.smithi103.stdout:4/659: dwrite d9/d16/d23/d32/d61/d47/f73 [0,4194304] 0 2024-09-17T01:07:19.276 INFO:tasks.workunit.client.0.smithi103.stdout:0/475: dread dd/d1c/d50/f52 [0,4194304] 0 2024-09-17T01:07:19.276 INFO:tasks.workunit.client.0.smithi103.stdout:4/660: truncate d9/d10/fcc 1749275 0 2024-09-17T01:07:19.276 INFO:tasks.workunit.client.0.smithi103.stdout:1/561: dwrite d2/d1c/d28/d52/f5c [0,4194304] 0 2024-09-17T01:07:19.281 INFO:tasks.workunit.client.0.smithi103.stdout:0/476: chown dd/d5d/f9b 1 1 2024-09-17T01:07:19.284 INFO:tasks.workunit.client.0.smithi103.stdout:3/715: mkdir d3/d16/df8 0 2024-09-17T01:07:19.285 INFO:tasks.workunit.client.0.smithi103.stdout:1/562: read - d2/d1c/d20/d33/f62 zero size 2024-09-17T01:07:19.286 INFO:tasks.workunit.client.0.smithi103.stdout:4/661: dread d9/d16/d23/d32/d61/d47/f73 [0,4194304] 0 2024-09-17T01:07:19.290 INFO:tasks.workunit.client.0.smithi103.stdout:3/716: unlink d3/d16/d1b/d3c/d65/d83/fd5 0 2024-09-17T01:07:19.290 INFO:tasks.workunit.client.0.smithi103.stdout:1/563: mknod d2/d1c/d28/d52/cb7 0 2024-09-17T01:07:19.291 INFO:tasks.workunit.client.0.smithi103.stdout:1/564: dread - d2/fa4 zero size 2024-09-17T01:07:19.291 INFO:tasks.workunit.client.0.smithi103.stdout:1/565: chown d2/d1c/d20/d33/f91 127 1 2024-09-17T01:07:19.293 INFO:tasks.workunit.client.0.smithi103.stdout:8/509: link d0/d6/dc/d30/d86/f9b d0/d6/dc/d30/d86/f9e 0 2024-09-17T01:07:19.293 INFO:tasks.workunit.client.0.smithi103.stdout:5/430: dread f0 [0,4194304] 0 2024-09-17T01:07:19.295 INFO:tasks.workunit.client.0.smithi103.stdout:4/662: symlink d9/d16/d38/ld0 0 2024-09-17T01:07:19.296 INFO:tasks.workunit.client.0.smithi103.stdout:1/566: mkdir d2/d7/d73/db8 0 2024-09-17T01:07:19.301 INFO:tasks.workunit.client.0.smithi103.stdout:4/663: rename d9/dc/df/c27 to d9/d10/cd1 0 2024-09-17T01:07:19.301 INFO:tasks.workunit.client.0.smithi103.stdout:4/664: chown d9/d10 0 1 2024-09-17T01:07:19.304 INFO:tasks.workunit.client.0.smithi103.stdout:3/717: creat d3/ff9 x:0 0 0 2024-09-17T01:07:19.308 INFO:tasks.workunit.client.0.smithi103.stdout:1/567: dread d2/d16/f30 [0,4194304] 0 2024-09-17T01:07:19.311 INFO:tasks.workunit.client.0.smithi103.stdout:3/718: dwrite d3/d16/d1b/d3c/d65/d83/ff1 [0,4194304] 0 2024-09-17T01:07:19.313 INFO:tasks.workunit.client.0.smithi103.stdout:3/719: write d3/d16/d1b/d3c/f60 [4086229,97948] 0 2024-09-17T01:07:19.314 INFO:tasks.workunit.client.0.smithi103.stdout:3/720: stat d3/d16/d1b/d36/ccd 0 2024-09-17T01:07:19.315 INFO:tasks.workunit.client.0.smithi103.stdout:3/721: chown d3/d16/d1b/d36 725 1 2024-09-17T01:07:19.318 INFO:tasks.workunit.client.0.smithi103.stdout:3/722: creat d3/d16/d1b/d3c/d65/df7/ffa x:0 0 0 2024-09-17T01:07:19.319 INFO:tasks.workunit.client.0.smithi103.stdout:3/723: chown d3/d44/l95 31910 1 2024-09-17T01:07:19.319 INFO:tasks.workunit.client.0.smithi103.stdout:3/724: fdatasync d3/d16/d1b/f45 0 2024-09-17T01:07:19.325 INFO:tasks.workunit.client.0.smithi103.stdout:3/725: dwrite d3/d44/fb2 [0,4194304] 0 2024-09-17T01:07:19.330 INFO:tasks.workunit.client.0.smithi103.stdout:3/726: rename d3/l18 to d3/d16/d1b/d3c/d65/d75/dd1/lfb 0 2024-09-17T01:07:19.365 INFO:tasks.workunit.client.0.smithi103.stdout:7/593: dread d4/d10/d6b/dc5/d8d/d92/f93 [0,4194304] 0 2024-09-17T01:07:19.365 INFO:tasks.workunit.client.0.smithi103.stdout:7/594: dread - d4/d10/d6b/dc5/d36/d82/fb9 zero size 2024-09-17T01:07:19.375 INFO:tasks.workunit.client.0.smithi103.stdout:9/555: write d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 [70245,111827] 0 2024-09-17T01:07:19.383 INFO:tasks.workunit.client.0.smithi103.stdout:8/510: rmdir d0/d6 39 2024-09-17T01:07:19.389 INFO:tasks.workunit.client.0.smithi103.stdout:0/477: dwrite dd/f42 [0,4194304] 0 2024-09-17T01:07:19.395 INFO:tasks.workunit.client.0.smithi103.stdout:8/511: rename d0/d6/dc/d30/d25/d64/d59/f98 to d0/d6/dc/d30/d25/d64/d34/f9f 0 2024-09-17T01:07:19.400 INFO:tasks.workunit.client.0.smithi103.stdout:1/568: write d2/d7/d4e/f7b [901819,53061] 0 2024-09-17T01:07:19.401 INFO:tasks.workunit.client.0.smithi103.stdout:8/512: creat d0/d6/dc/d30/d25/d7d/fa0 x:0 0 0 2024-09-17T01:07:19.405 INFO:tasks.workunit.client.0.smithi103.stdout:5/431: dwrite d6/d2c/d38/d4c/d50/f4f [0,4194304] 0 2024-09-17T01:07:19.406 INFO:tasks.workunit.client.0.smithi103.stdout:8/513: readlink d0/d6/dc/d3d/d6d/l73 0 2024-09-17T01:07:19.408 INFO:tasks.workunit.client.0.smithi103.stdout:4/665: dwrite d9/d16/d23/d32/d4c/f92 [0,4194304] 0 2024-09-17T01:07:19.414 INFO:tasks.workunit.client.0.smithi103.stdout:8/514: link d0/d6/dc/d30/d2d/f65 d0/d6/dc/d30/d25/d64/d34/fa1 0 2024-09-17T01:07:19.419 INFO:tasks.workunit.client.0.smithi103.stdout:8/515: getdents d0/d6/dc/d30/d86 0 2024-09-17T01:07:19.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:19 smithi103 ceph-mon[28156]: pgmap v20: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 220 MiB/s wr, 449 op/s 2024-09-17T01:07:19.430 INFO:tasks.workunit.client.0.smithi103.stdout:7/595: write d4/d10/f25 [3121544,24702] 0 2024-09-17T01:07:19.432 INFO:tasks.workunit.client.0.smithi103.stdout:8/516: dread d0/d6/f77 [0,4194304] 0 2024-09-17T01:07:19.434 INFO:tasks.workunit.client.0.smithi103.stdout:9/556: truncate d7/f55 947140 0 2024-09-17T01:07:19.438 INFO:tasks.workunit.client.0.smithi103.stdout:9/557: mkdir d7/d43/d88/d11/d20/dbc 0 2024-09-17T01:07:19.440 INFO:tasks.workunit.client.0.smithi103.stdout:8/517: truncate d0/f4c 454933 0 2024-09-17T01:07:19.440 INFO:tasks.workunit.client.0.smithi103.stdout:1/569: write d2/d1c/d20/f83 [756834,70849] 0 2024-09-17T01:07:19.443 INFO:tasks.workunit.client.0.smithi103.stdout:9/558: symlink d7/db8/dbb/lbd 0 2024-09-17T01:07:19.443 INFO:tasks.workunit.client.0.smithi103.stdout:8/518: chown d0/d6/f77 0 1 2024-09-17T01:07:19.445 INFO:tasks.workunit.client.0.smithi103.stdout:1/570: rmdir d2/d16/d51/d65/d7f 39 2024-09-17T01:07:19.446 INFO:tasks.workunit.client.0.smithi103.stdout:8/519: readlink d0/d6/dc/d30/d25/l33 0 2024-09-17T01:07:19.447 INFO:tasks.workunit.client.0.smithi103.stdout:0/478: dwrite dd/d1c/f1f [0,4194304] 0 2024-09-17T01:07:19.449 INFO:tasks.workunit.client.0.smithi103.stdout:0/479: chown dd/d1c/d50 14924 1 2024-09-17T01:07:19.450 INFO:tasks.workunit.client.0.smithi103.stdout:7/596: dread d4/d10/d66/f50 [0,4194304] 0 2024-09-17T01:07:19.451 INFO:tasks.workunit.client.0.smithi103.stdout:9/559: truncate d7/d43/d88/d11/d5c/d5e/d6c/d6e/faf 703638 0 2024-09-17T01:07:19.452 INFO:tasks.workunit.client.0.smithi103.stdout:1/571: dread - d2/d1c/d20/d33/f91 zero size 2024-09-17T01:07:19.452 INFO:tasks.workunit.client.0.smithi103.stdout:7/597: chown d4/d11/c20 1 1 2024-09-17T01:07:19.454 INFO:tasks.workunit.client.0.smithi103.stdout:7/598: read - d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/fa7 zero size 2024-09-17T01:07:19.459 INFO:tasks.workunit.client.0.smithi103.stdout:1/572: mkdir d2/d1c/db9 0 2024-09-17T01:07:19.461 INFO:tasks.workunit.client.0.smithi103.stdout:0/480: mknod dd/df/ca2 0 2024-09-17T01:07:19.464 INFO:tasks.workunit.client.0.smithi103.stdout:8/520: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2 0 2024-09-17T01:07:19.465 INFO:tasks.workunit.client.0.smithi103.stdout:7/599: mkdir d4/d10/d66/dd2 0 2024-09-17T01:07:19.466 INFO:tasks.workunit.client.0.smithi103.stdout:8/521: write d0/d6/dc/d30/d25/d64/d34/d6e/f7c [422030,48546] 0 2024-09-17T01:07:19.467 INFO:tasks.workunit.client.0.smithi103.stdout:7/600: dread - d4/d10/d6b/fcc zero size 2024-09-17T01:07:19.468 INFO:tasks.workunit.client.0.smithi103.stdout:1/573: symlink d2/d1c/lba 0 2024-09-17T01:07:19.471 INFO:tasks.workunit.client.0.smithi103.stdout:0/481: unlink dd/d5d/f94 0 2024-09-17T01:07:19.472 INFO:tasks.workunit.client.0.smithi103.stdout:0/482: dread - dd/df/d68/d6c/d8e/f9d zero size 2024-09-17T01:07:19.474 INFO:tasks.workunit.client.0.smithi103.stdout:8/522: creat d0/d6/dc/d3d/d6d/fa3 x:0 0 0 2024-09-17T01:07:19.476 INFO:tasks.workunit.client.0.smithi103.stdout:7/601: dread d4/d10/d4e/f69 [0,4194304] 0 2024-09-17T01:07:19.476 INFO:tasks.workunit.client.0.smithi103.stdout:1/574: truncate d2/de/d1f/f3b 2673772 0 2024-09-17T01:07:19.476 INFO:tasks.workunit.client.0.smithi103.stdout:9/560: dread d7/d43/d88/d11/f12 [0,4194304] 0 2024-09-17T01:07:19.479 INFO:tasks.workunit.client.0.smithi103.stdout:7/602: chown d4/d10/d6b/dc5/d36/d3a/d51 19 1 2024-09-17T01:07:19.481 INFO:tasks.workunit.client.0.smithi103.stdout:0/483: dwrite dd/d4f/f2a [0,4194304] 0 2024-09-17T01:07:19.484 INFO:tasks.workunit.client.0.smithi103.stdout:1/575: mknod d2/d70/dac/cbb 0 2024-09-17T01:07:19.485 INFO:tasks.workunit.client.0.smithi103.stdout:7/603: rmdir d4/d10/d4e 39 2024-09-17T01:07:19.494 INFO:tasks.workunit.client.0.smithi103.stdout:1/576: dread d2/d70/f8f [0,4194304] 0 2024-09-17T01:07:19.495 INFO:tasks.workunit.client.0.smithi103.stdout:9/561: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/fbe x:0 0 0 2024-09-17T01:07:19.496 INFO:tasks.workunit.client.0.smithi103.stdout:0/484: mkdir dd/d1c/d9f/da3 0 2024-09-17T01:07:19.497 INFO:tasks.workunit.client.0.smithi103.stdout:0/485: stat ca 0 2024-09-17T01:07:19.498 INFO:tasks.workunit.client.0.smithi103.stdout:0/486: stat l9 0 2024-09-17T01:07:19.501 INFO:tasks.workunit.client.0.smithi103.stdout:7/604: creat d4/d10/fd3 x:0 0 0 2024-09-17T01:07:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:9/562: mknod d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/cbf 0 2024-09-17T01:07:19.503 INFO:tasks.workunit.client.0.smithi103.stdout:8/523: dwrite d0/f4c [0,4194304] 0 2024-09-17T01:07:19.504 INFO:tasks.workunit.client.0.smithi103.stdout:7/605: write d4/d4a/f78 [922637,119421] 0 2024-09-17T01:07:19.506 INFO:tasks.workunit.client.0.smithi103.stdout:0/487: fsync dd/d4f/f48 0 2024-09-17T01:07:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:19 smithi143 ceph-mon[35452]: pgmap v20: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 220 MiB/s wr, 449 op/s 2024-09-17T01:07:19.510 INFO:tasks.workunit.client.0.smithi103.stdout:9/563: mkdir d7/d43/d88/d11/d20/d4f/d95/d9a/dc0 0 2024-09-17T01:07:19.512 INFO:tasks.workunit.client.0.smithi103.stdout:0/488: mkdir dd/df/d68/d6c/da4 0 2024-09-17T01:07:19.513 INFO:tasks.workunit.client.0.smithi103.stdout:1/577: getdents d2/d1c/d28/d4b/d67/d9e/daf 0 2024-09-17T01:07:19.515 INFO:tasks.workunit.client.0.smithi103.stdout:7/606: mknod d4/d10/d6b/d9f/cd4 0 2024-09-17T01:07:19.516 INFO:tasks.workunit.client.0.smithi103.stdout:9/564: unlink d7/d43/d88/d11/d20/d4f/d95/d9a/fa0 0 2024-09-17T01:07:19.517 INFO:tasks.workunit.client.0.smithi103.stdout:9/565: truncate d7/d43/f52 4697353 0 2024-09-17T01:07:19.518 INFO:tasks.workunit.client.0.smithi103.stdout:1/578: creat d2/d1c/d28/d4b/d67/d9e/fbc x:0 0 0 2024-09-17T01:07:19.520 INFO:tasks.workunit.client.0.smithi103.stdout:7/607: symlink d4/d10/d6b/ld5 0 2024-09-17T01:07:19.521 INFO:tasks.workunit.client.0.smithi103.stdout:9/566: creat d7/d43/d5f/d7d/d80/fc1 x:0 0 0 2024-09-17T01:07:19.522 INFO:tasks.workunit.client.0.smithi103.stdout:0/489: creat dd/d43/fa5 x:0 0 0 2024-09-17T01:07:19.523 INFO:tasks.workunit.client.0.smithi103.stdout:7/608: fsync d4/d10/d66/f6d 0 2024-09-17T01:07:19.525 INFO:tasks.workunit.client.0.smithi103.stdout:9/567: mkdir d7/d43/d88/d11/d5c/d8d/dac/dc2 0 2024-09-17T01:07:19.530 INFO:tasks.workunit.client.0.smithi103.stdout:7/609: dwrite d4/d10/f2e [0,4194304] 0 2024-09-17T01:07:19.531 INFO:tasks.workunit.client.0.smithi103.stdout:7/610: stat d4/d4a/d4b/d8a/lba 0 2024-09-17T01:07:19.532 INFO:tasks.workunit.client.0.smithi103.stdout:0/490: creat dd/df/d68/d6c/da4/fa6 x:0 0 0 2024-09-17T01:07:19.533 INFO:tasks.workunit.client.0.smithi103.stdout:0/491: readlink dd/d5d/d93/l9c 0 2024-09-17T01:07:19.533 INFO:tasks.workunit.client.0.smithi103.stdout:1/579: getdents d2/d16/d51 0 2024-09-17T01:07:19.537 INFO:tasks.workunit.client.0.smithi103.stdout:9/568: truncate d7/d2d/d59/f66 293087 0 2024-09-17T01:07:19.538 INFO:tasks.workunit.client.0.smithi103.stdout:0/492: mknod dd/d4f/d97/ca7 0 2024-09-17T01:07:19.538 INFO:tasks.workunit.client.0.smithi103.stdout:9/569: chown d7/d43/d5f/d7d/d80/c8f 3808 1 2024-09-17T01:07:19.541 INFO:tasks.workunit.client.0.smithi103.stdout:9/570: creat d7/d43/fc3 x:0 0 0 2024-09-17T01:07:19.543 INFO:tasks.workunit.client.0.smithi103.stdout:1/580: mkdir d2/d1c/d28/d52/d69/dbd 0 2024-09-17T01:07:19.544 INFO:tasks.workunit.client.0.smithi103.stdout:9/571: dread d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 [0,4194304] 0 2024-09-17T01:07:19.549 INFO:tasks.workunit.client.0.smithi103.stdout:9/572: creat d7/db8/fc4 x:0 0 0 2024-09-17T01:07:19.551 INFO:tasks.workunit.client.0.smithi103.stdout:9/573: creat d7/db8/fc5 x:0 0 0 2024-09-17T01:07:19.555 INFO:tasks.workunit.client.0.smithi103.stdout:9/574: creat d7/db4/fc6 x:0 0 0 2024-09-17T01:07:19.556 INFO:tasks.workunit.client.0.smithi103.stdout:1/581: write d2/d16/d51/d65/f71 [4602629,24073] 0 2024-09-17T01:07:19.559 INFO:tasks.workunit.client.0.smithi103.stdout:0/493: dwrite dd/d1c/f65 [0,4194304] 0 2024-09-17T01:07:19.562 INFO:tasks.workunit.client.0.smithi103.stdout:1/582: creat d2/d1c/d20/d6d/d8d/d94/fbe x:0 0 0 2024-09-17T01:07:19.563 INFO:tasks.workunit.client.0.smithi103.stdout:9/575: symlink d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/lc7 0 2024-09-17T01:07:19.566 INFO:tasks.workunit.client.0.smithi103.stdout:1/583: mkdir d2/d16/dbf 0 2024-09-17T01:07:19.566 INFO:tasks.workunit.client.0.smithi103.stdout:0/494: dread dd/d43/f72 [0,4194304] 0 2024-09-17T01:07:19.567 INFO:tasks.workunit.client.0.smithi103.stdout:9/576: fsync d7/db8/dbb/f3e 0 2024-09-17T01:07:19.571 INFO:tasks.workunit.client.0.smithi103.stdout:0/495: rename dd/d1c/d50 to dd/df/d38/da8 0 2024-09-17T01:07:19.571 INFO:tasks.workunit.client.0.smithi103.stdout:0/496: dread - dd/f7e zero size 2024-09-17T01:07:19.580 INFO:tasks.workunit.client.0.smithi103.stdout:1/584: write d2/de/d1f/f3b [1089745,127775] 0 2024-09-17T01:07:19.581 INFO:tasks.workunit.client.0.smithi103.stdout:1/585: readlink d2/d1c/d28/d4b/l7a 0 2024-09-17T01:07:19.584 INFO:tasks.workunit.client.0.smithi103.stdout:1/586: fdatasync d2/d16/f30 0 2024-09-17T01:07:19.589 INFO:tasks.workunit.client.0.smithi103.stdout:9/577: dwrite d7/d43/d88/f5a [0,4194304] 0 2024-09-17T01:07:19.589 INFO:tasks.workunit.client.0.smithi103.stdout:0/497: dwrite dd/df/f46 [0,4194304] 0 2024-09-17T01:07:19.590 INFO:tasks.workunit.client.0.smithi103.stdout:1/587: creat d2/de/d1f/fc0 x:0 0 0 2024-09-17T01:07:19.596 INFO:tasks.workunit.client.0.smithi103.stdout:0/498: mkdir dd/df/d38/d62/d84/da9 0 2024-09-17T01:07:19.597 INFO:tasks.workunit.client.0.smithi103.stdout:0/499: fdatasync dd/df/d68/f87 0 2024-09-17T01:07:19.597 INFO:tasks.workunit.client.0.smithi103.stdout:1/588: symlink d2/d1c/d28/d52/d69/dbd/lc1 0 2024-09-17T01:07:19.600 INFO:tasks.workunit.client.0.smithi103.stdout:0/500: write dd/d5d/f9b [434352,62057] 0 2024-09-17T01:07:19.601 INFO:tasks.workunit.client.0.smithi103.stdout:1/589: write d2/d1c/d28/d4b/d67/d9e/fbc [984955,120423] 0 2024-09-17T01:07:19.602 INFO:tasks.workunit.client.0.smithi103.stdout:1/590: stat d2/de/da0/fa3 0 2024-09-17T01:07:19.603 INFO:tasks.workunit.client.0.smithi103.stdout:1/591: chown d2/de/f11 494 1 2024-09-17T01:07:19.604 INFO:tasks.workunit.client.0.smithi103.stdout:1/592: chown d2/d1c/d28/d4b/l7a 47139400 1 2024-09-17T01:07:19.604 INFO:tasks.workunit.client.0.smithi103.stdout:0/501: creat dd/d5d/d93/d9a/faa x:0 0 0 2024-09-17T01:07:19.606 INFO:tasks.workunit.client.0.smithi103.stdout:0/502: truncate dd/df/d38/da8/f52 874721 0 2024-09-17T01:07:19.608 INFO:tasks.workunit.client.0.smithi103.stdout:1/593: dread d2/d1c/d28/d52/d69/f6c [0,4194304] 0 2024-09-17T01:07:19.609 INFO:tasks.workunit.client.0.smithi103.stdout:1/594: readlink d2/d70/l8a 0 2024-09-17T01:07:19.613 INFO:tasks.workunit.client.0.smithi103.stdout:0/503: dread f8 [0,4194304] 0 2024-09-17T01:07:19.615 INFO:tasks.workunit.client.0.smithi103.stdout:0/504: mknod dd/d1c/d9f/cab 0 2024-09-17T01:07:19.615 INFO:tasks.workunit.client.0.smithi103.stdout:9/578: dread d7/f55 [0,4194304] 0 2024-09-17T01:07:19.617 INFO:tasks.workunit.client.0.smithi103.stdout:0/505: mknod dd/df/d68/d6c/d8e/cac 0 2024-09-17T01:07:19.619 INFO:tasks.workunit.client.0.smithi103.stdout:9/579: rename d7/d43/d88/d11/d20/d8e/f91 to d7/d2d/d59/d7a/fc8 0 2024-09-17T01:07:19.620 INFO:tasks.workunit.client.0.smithi103.stdout:0/506: truncate f6 2993117 0 2024-09-17T01:07:19.623 INFO:tasks.workunit.client.0.smithi103.stdout:0/507: read dd/d5d/f61 [268260,75979] 0 2024-09-17T01:07:19.638 INFO:tasks.workunit.client.0.smithi103.stdout:0/508: dread dd/d4f/f4c [0,4194304] 0 2024-09-17T01:07:19.639 INFO:tasks.workunit.client.0.smithi103.stdout:0/509: write dd/df/d38/d62/f85 [1850761,8273] 0 2024-09-17T01:07:19.642 INFO:tasks.workunit.client.0.smithi103.stdout:0/510: symlink dd/df/d38/d55/lad 0 2024-09-17T01:07:19.645 INFO:tasks.workunit.client.0.smithi103.stdout:0/511: rename dd/f3e to dd/d1c/d9f/da3/fae 0 2024-09-17T01:07:19.646 INFO:tasks.workunit.client.0.smithi103.stdout:0/512: read - dd/df/d38/da8/f66 zero size 2024-09-17T01:07:19.649 INFO:tasks.workunit.client.0.smithi103.stdout:0/513: rename dd/d4f/f37 to dd/df/d38/d62/faf 0 2024-09-17T01:07:19.651 INFO:tasks.workunit.client.0.smithi103.stdout:0/514: mkdir dd/df/d38/d62/db0 0 2024-09-17T01:07:19.651 INFO:tasks.workunit.client.0.smithi103.stdout:0/515: readlink l9 0 2024-09-17T01:07:19.653 INFO:tasks.workunit.client.0.smithi103.stdout:0/516: unlink dd/df/d38/da8/f52 0 2024-09-17T01:07:19.665 INFO:tasks.workunit.client.0.smithi103.stdout:0/517: dwrite f6 [0,4194304] 0 2024-09-17T01:07:19.669 INFO:tasks.workunit.client.0.smithi103.stdout:0/518: link dd/f7e dd/df/d68/d6c/da4/fb1 0 2024-09-17T01:07:19.671 INFO:tasks.workunit.client.0.smithi103.stdout:0/519: mkdir dd/df/d38/d62/d84/db2 0 2024-09-17T01:07:19.672 INFO:tasks.workunit.client.0.smithi103.stdout:0/520: chown dd/df/d38/f80 457039327 1 2024-09-17T01:07:19.674 INFO:tasks.workunit.client.0.smithi103.stdout:0/521: creat dd/d1c/d9f/fb3 x:0 0 0 2024-09-17T01:07:19.677 INFO:tasks.workunit.client.0.smithi103.stdout:0/522: dread dd/d1c/f65 [0,4194304] 0 2024-09-17T01:07:19.678 INFO:tasks.workunit.client.0.smithi103.stdout:0/523: write dd/df/f3d [95149,57966] 0 2024-09-17T01:07:19.680 INFO:tasks.workunit.client.0.smithi103.stdout:0/524: creat dd/df/d68/d6c/d8e/fb4 x:0 0 0 2024-09-17T01:07:19.683 INFO:tasks.workunit.client.0.smithi103.stdout:0/525: truncate dd/df/d38/d62/f8c 1806233 0 2024-09-17T01:07:19.684 INFO:tasks.workunit.client.0.smithi103.stdout:0/526: fdatasync dd/df/d68/d6c/d8e/fb4 0 2024-09-17T01:07:19.687 INFO:tasks.workunit.client.0.smithi103.stdout:0/527: unlink dd/d4f/c8b 0 2024-09-17T01:07:19.693 INFO:tasks.workunit.client.0.smithi103.stdout:0/528: dwrite dd/df/d68/f87 [0,4194304] 0 2024-09-17T01:07:19.697 INFO:tasks.workunit.client.0.smithi103.stdout:0/529: readlink dd/d43/l6a 0 2024-09-17T01:07:19.699 INFO:tasks.workunit.client.0.smithi103.stdout:0/530: mkdir dd/df/d68/db5 0 2024-09-17T01:07:19.702 INFO:tasks.workunit.client.0.smithi103.stdout:0/531: rename dd/df/d38/d62/l6b to dd/d4f/d64/lb6 0 2024-09-17T01:07:19.704 INFO:tasks.workunit.client.0.smithi103.stdout:0/532: creat dd/df/d68/d6c/d83/fb7 x:0 0 0 2024-09-17T01:07:19.717 INFO:tasks.workunit.client.0.smithi103.stdout:0/533: write dd/df/d38/da8/f66 [67305,44945] 0 2024-09-17T01:07:19.725 INFO:tasks.workunit.client.0.smithi103.stdout:0/534: dwrite dd/d43/f72 [0,4194304] 0 2024-09-17T01:07:19.726 INFO:tasks.workunit.client.0.smithi103.stdout:0/535: stat dd/df/d38/d62/f85 0 2024-09-17T01:07:19.728 INFO:tasks.workunit.client.0.smithi103.stdout:0/536: creat dd/df/d38/d55/fb8 x:0 0 0 2024-09-17T01:07:19.732 INFO:tasks.workunit.client.0.smithi103.stdout:0/537: getdents dd/df/d68 0 2024-09-17T01:07:19.733 INFO:tasks.workunit.client.0.smithi103.stdout:0/538: readlink dd/df/d38/l86 0 2024-09-17T01:07:19.734 INFO:tasks.workunit.client.0.smithi103.stdout:0/539: creat dd/df/d68/d6c/fb9 x:0 0 0 2024-09-17T01:07:19.736 INFO:tasks.workunit.client.0.smithi103.stdout:0/540: write dd/df/d68/d6c/d8e/f9d [1001253,12148] 0 2024-09-17T01:07:19.746 INFO:tasks.workunit.client.0.smithi103.stdout:0/541: write dd/df/d38/da8/f6f [394183,111407] 0 2024-09-17T01:07:19.753 INFO:tasks.workunit.client.0.smithi103.stdout:0/542: truncate dd/d1c/d9f/da3/fae 1342734 0 2024-09-17T01:07:19.753 INFO:tasks.workunit.client.0.smithi103.stdout:0/543: fdatasync dd/df/f90 0 2024-09-17T01:07:19.758 INFO:tasks.workunit.client.0.smithi103.stdout:0/544: write f8 [1219314,74274] 0 2024-09-17T01:07:19.764 INFO:tasks.workunit.client.0.smithi103.stdout:0/545: dwrite dd/df/d38/da8/f99 [0,4194304] 0 2024-09-17T01:07:19.773 INFO:tasks.workunit.client.0.smithi103.stdout:0/546: rename dd/d1c/c5a to dd/cba 0 2024-09-17T01:07:19.775 INFO:tasks.workunit.client.0.smithi103.stdout:0/547: mkdir dd/d1c/d9f/dbb 0 2024-09-17T01:07:19.778 INFO:tasks.workunit.client.0.smithi103.stdout:0/548: rename dd/d1c/c54 to dd/df/d38/d55/cbc 0 2024-09-17T01:07:19.794 INFO:tasks.workunit.client.0.smithi103.stdout:0/549: dread dd/f14 [0,4194304] 0 2024-09-17T01:07:19.794 INFO:tasks.workunit.client.0.smithi103.stdout:0/550: chown dd/f15 207697 1 2024-09-17T01:07:19.796 INFO:tasks.workunit.client.0.smithi103.stdout:0/551: creat dd/df/d38/d62/fbd x:0 0 0 2024-09-17T01:07:19.833 INFO:tasks.workunit.client.0.smithi103.stdout:0/552: fdatasync fc 0 2024-09-17T01:07:19.835 INFO:tasks.workunit.client.0.smithi103.stdout:0/553: rmdir dd/d1c/d9f 39 2024-09-17T01:07:19.864 INFO:tasks.workunit.client.0.smithi103.stdout:0/554: dwrite dd/f7e [0,4194304] 0 2024-09-17T01:07:19.865 INFO:tasks.workunit.client.0.smithi103.stdout:0/555: stat dd/df/d68/d6c/d83 0 2024-09-17T01:07:19.865 INFO:tasks.workunit.client.0.smithi103.stdout:0/556: chown dd/d4f/d64 1494927 1 2024-09-17T01:07:19.866 INFO:tasks.workunit.client.0.smithi103.stdout:0/557: readlink dd/d5d/d93/l9c 0 2024-09-17T01:07:19.871 INFO:tasks.workunit.client.0.smithi103.stdout:0/558: link dd/df/d38/da8/f6f dd/df/d38/fbe 0 2024-09-17T01:07:19.874 INFO:tasks.workunit.client.0.smithi103.stdout:0/559: rename dd/df/d68/d6c/da4 to dd/df/d38/d62/dbf 0 2024-09-17T01:07:19.875 INFO:tasks.workunit.client.0.smithi103.stdout:0/560: creat dd/df/d68/d6c/d83/fc0 x:0 0 0 2024-09-17T01:07:19.877 INFO:tasks.workunit.client.0.smithi103.stdout:0/561: dread - dd/d1c/d9f/fb3 zero size 2024-09-17T01:07:19.877 INFO:tasks.workunit.client.0.smithi103.stdout:0/562: readlink dd/d5d/d93/l9c 0 2024-09-17T01:07:19.879 INFO:tasks.workunit.client.0.smithi103.stdout:0/563: symlink dd/df/d38/lc1 0 2024-09-17T01:07:19.882 INFO:tasks.workunit.client.0.smithi103.stdout:0/564: link dd/df/f25 dd/df/d68/db5/fc2 0 2024-09-17T01:07:19.884 INFO:tasks.workunit.client.0.smithi103.stdout:0/565: mkdir dd/df/d68/d6c/dc3 0 2024-09-17T01:07:19.886 INFO:tasks.workunit.client.0.smithi103.stdout:0/566: write dd/df/f25 [5623890,52262] 0 2024-09-17T01:07:19.899 INFO:tasks.workunit.client.0.smithi103.stdout:0/567: dwrite dd/df/f57 [0,4194304] 0 2024-09-17T01:07:19.902 INFO:tasks.workunit.client.0.smithi103.stdout:0/568: mknod dd/d5d/d93/d9a/cc4 0 2024-09-17T01:07:19.905 INFO:tasks.workunit.client.0.smithi103.stdout:0/569: creat dd/df/d38/d62/dbf/fc5 x:0 0 0 2024-09-17T01:07:19.909 INFO:tasks.workunit.client.0.smithi103.stdout:0/570: dread dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:19.927 INFO:tasks.workunit.client.0.smithi103.stdout:0/571: dwrite dd/df/d38/f33 [0,4194304] 0 2024-09-17T01:07:19.930 INFO:tasks.workunit.client.0.smithi103.stdout:0/572: rename dd/d4f/c44 to dd/d4f/d97/cc6 0 2024-09-17T01:07:19.933 INFO:tasks.workunit.client.0.smithi103.stdout:0/573: link dd/df/d38/d55/f8a dd/d1c/d9f/da3/fc7 0 2024-09-17T01:07:19.936 INFO:tasks.workunit.client.0.smithi103.stdout:0/574: getdents dd/d4f/d64 0 2024-09-17T01:07:19.938 INFO:tasks.workunit.client.0.smithi103.stdout:0/575: mknod dd/d43/cc8 0 2024-09-17T01:07:19.938 INFO:tasks.workunit.client.0.smithi103.stdout:0/576: readlink l9 0 2024-09-17T01:07:19.939 INFO:tasks.workunit.client.0.smithi103.stdout:0/577: write dd/d1c/f4a [2247045,62037] 0 2024-09-17T01:07:19.941 INFO:tasks.workunit.client.0.smithi103.stdout:0/578: truncate dd/d43/f8f 820991 0 2024-09-17T01:07:19.943 INFO:tasks.workunit.client.0.smithi103.stdout:0/579: link l9 dd/d5d/lc9 0 2024-09-17T01:07:19.946 INFO:tasks.workunit.client.0.smithi103.stdout:0/580: mkdir dd/df/d68/d6c/d8e/dca 0 2024-09-17T01:07:19.949 INFO:tasks.workunit.client.0.smithi103.stdout:0/581: creat dd/d43/fcb x:0 0 0 2024-09-17T01:07:19.951 INFO:tasks.workunit.client.0.smithi103.stdout:0/582: mkdir dd/df/d38/d55/dcc 0 2024-09-17T01:07:19.957 INFO:tasks.workunit.client.0.smithi103.stdout:0/583: dwrite dd/f7e [4194304,4194304] 0 2024-09-17T01:07:19.973 INFO:tasks.workunit.client.0.smithi103.stdout:0/584: write dd/df/f13 [248142,78860] 0 2024-09-17T01:07:19.974 INFO:tasks.workunit.client.0.smithi103.stdout:0/585: dread - dd/df/d38/d62/fbd zero size 2024-09-17T01:07:19.976 INFO:tasks.workunit.client.0.smithi103.stdout:0/586: creat dd/df/d38/d62/d84/fcd x:0 0 0 2024-09-17T01:07:19.976 INFO:tasks.workunit.client.0.smithi103.stdout:0/587: chown dd/d4f 86661753 1 2024-09-17T01:07:20.133 INFO:tasks.workunit.client.0.smithi103.stdout:0/588: write dd/df/f24 [1712771,11022] 0 2024-09-17T01:07:20.135 INFO:tasks.workunit.client.0.smithi103.stdout:0/589: symlink dd/df/d38/d55/lce 0 2024-09-17T01:07:20.138 INFO:tasks.workunit.client.0.smithi103.stdout:0/590: link dd/d5d/f9b dd/df/d68/d6c/d83/fcf 0 2024-09-17T01:07:20.139 INFO:tasks.workunit.client.0.smithi103.stdout:0/591: write dd/df/f24 [2123124,86613] 0 2024-09-17T01:07:20.140 INFO:tasks.workunit.client.0.smithi103.stdout:0/592: chown dd/df/d38/d55/dcc 4164447 1 2024-09-17T01:07:20.146 INFO:tasks.workunit.client.0.smithi103.stdout:0/593: fsync dd/df/d68/d6c/d83/fcf 0 2024-09-17T01:07:20.153 INFO:tasks.workunit.client.0.smithi103.stdout:0/594: dread dd/d1c/d9f/da3/fae [0,4194304] 0 2024-09-17T01:07:20.155 INFO:tasks.workunit.client.0.smithi103.stdout:0/595: unlink dd/df/d68/d6c/d8e/cac 0 2024-09-17T01:07:20.170 INFO:tasks.workunit.client.0.smithi103.stdout:0/596: dwrite dd/df/d68/d6c/d83/fcf [0,4194304] 0 2024-09-17T01:07:20.171 INFO:tasks.workunit.client.0.smithi103.stdout:0/597: write dd/df/d38/d62/f85 [4608807,829] 0 2024-09-17T01:07:20.173 INFO:tasks.workunit.client.0.smithi103.stdout:0/598: fsync dd/df/d68/d6c/d8e/fb4 0 2024-09-17T01:07:20.174 INFO:tasks.workunit.client.0.smithi103.stdout:0/599: chown dd/df/d38/d55/fb8 693427239 1 2024-09-17T01:07:20.176 INFO:tasks.workunit.client.0.smithi103.stdout:0/600: rename dd/df to dd/df/d68/d6c/dc3/dd0 22 2024-09-17T01:07:20.183 INFO:tasks.workunit.client.0.smithi103.stdout:0/601: dwrite dd/df/d68/d6c/fb9 [0,4194304] 0 2024-09-17T01:07:20.200 INFO:tasks.workunit.client.0.smithi103.stdout:0/602: write dd/df/d68/d6c/fb9 [4431016,113283] 0 2024-09-17T01:07:20.203 INFO:tasks.workunit.client.0.smithi103.stdout:0/603: unlink dd/d1c/f65 0 2024-09-17T01:07:20.204 INFO:tasks.workunit.client.0.smithi103.stdout:0/604: dread - dd/d4f/d64/f79 zero size 2024-09-17T01:07:20.209 INFO:tasks.workunit.client.0.smithi103.stdout:0/605: rename dd/d4f/d64/c7c to dd/cd1 0 2024-09-17T01:07:20.210 INFO:tasks.workunit.client.0.smithi103.stdout:0/606: read dd/df/d38/d55/f9e [11548,92806] 0 2024-09-17T01:07:20.211 INFO:tasks.workunit.client.0.smithi103.stdout:0/607: dread - dd/d5d/d93/d9a/faa zero size 2024-09-17T01:07:20.213 INFO:tasks.workunit.client.0.smithi103.stdout:0/608: write dd/d4f/f48 [3177155,14645] 0 2024-09-17T01:07:20.215 INFO:tasks.workunit.client.0.smithi103.stdout:0/609: symlink dd/d5d/d93/ld2 0 2024-09-17T01:07:20.224 INFO:tasks.workunit.client.0.smithi103.stdout:0/610: creat dd/df/d68/db5/fd3 x:0 0 0 2024-09-17T01:07:20.225 INFO:tasks.workunit.client.0.smithi103.stdout:0/611: dread dd/df/d38/fbe [0,4194304] 0 2024-09-17T01:07:20.228 INFO:tasks.workunit.client.0.smithi103.stdout:0/612: creat dd/d5d/d93/d9a/fd4 x:0 0 0 2024-09-17T01:07:20.228 INFO:tasks.workunit.client.0.smithi103.stdout:0/613: fsync fc 0 2024-09-17T01:07:20.229 INFO:tasks.workunit.client.0.smithi103.stdout:0/614: fdatasync dd/d4f/f48 0 2024-09-17T01:07:20.233 INFO:tasks.workunit.client.0.smithi103.stdout:0/615: stat dd/df/d38/f63 0 2024-09-17T01:07:20.234 INFO:tasks.workunit.client.0.smithi103.stdout:0/616: write dd/df/d38/d62/dbf/fb1 [5766708,4379] 0 2024-09-17T01:07:20.235 INFO:tasks.workunit.client.0.smithi103.stdout:0/617: chown dd/f4d 0 1 2024-09-17T01:07:20.239 INFO:tasks.workunit.client.0.smithi103.stdout:0/618: creat dd/d4f/d64/fd5 x:0 0 0 2024-09-17T01:07:20.241 INFO:tasks.workunit.client.0.smithi103.stdout:0/619: rmdir dd/df/d38 39 2024-09-17T01:07:20.242 INFO:tasks.workunit.client.0.smithi103.stdout:0/620: fsync dd/d4f/d97/f98 0 2024-09-17T01:07:20.243 INFO:tasks.workunit.client.0.smithi103.stdout:0/621: chown dd/df/d38/lc1 6 1 2024-09-17T01:07:20.249 INFO:tasks.workunit.client.0.smithi103.stdout:0/622: dwrite dd/f95 [0,4194304] 0 2024-09-17T01:07:20.249 INFO:tasks.workunit.client.0.smithi103.stdout:0/623: chown dd/d4f/d64/fd5 28902379 1 2024-09-17T01:07:20.250 INFO:tasks.workunit.client.0.smithi103.stdout:0/624: chown dd/df/f3d 54360995 1 2024-09-17T01:07:20.253 INFO:tasks.workunit.client.0.smithi103.stdout:0/625: truncate dd/df/d38/d62/dbf/fc5 40886 0 2024-09-17T01:07:20.255 INFO:tasks.workunit.client.0.smithi103.stdout:0/626: mkdir dd/d1c/d9f/dd6 0 2024-09-17T01:07:20.256 INFO:tasks.workunit.client.0.smithi103.stdout:0/627: read dd/df/d38/d62/f85 [3968137,127061] 0 2024-09-17T01:07:20.259 INFO:tasks.workunit.client.0.smithi103.stdout:0/628: mknod dd/d1c/cd7 0 2024-09-17T01:07:20.262 INFO:tasks.workunit.client.0.smithi103.stdout:0/629: rename dd/d1c/d9f/da3/fae to dd/df/d68/d6c/fd8 0 2024-09-17T01:07:20.263 INFO:tasks.workunit.client.0.smithi103.stdout:0/630: fdatasync dd/df/f24 0 2024-09-17T01:07:20.265 INFO:tasks.workunit.client.0.smithi103.stdout:0/631: mknod dd/df/d38/d62/d84/da9/cd9 0 2024-09-17T01:07:20.268 INFO:tasks.workunit.client.0.smithi103.stdout:0/632: getdents dd/d1c/d9f/dd6 0 2024-09-17T01:07:20.270 INFO:tasks.workunit.client.0.smithi103.stdout:0/633: chown dd/cd1 44231 1 2024-09-17T01:07:20.273 INFO:tasks.workunit.client.0.smithi103.stdout:0/634: rename dd/df/d68/d6c/d83/fc0 to dd/d1c/d9f/dbb/fda 0 2024-09-17T01:07:20.278 INFO:tasks.workunit.client.0.smithi103.stdout:0/635: dwrite dd/d4f/f32 [0,4194304] 0 2024-09-17T01:07:20.289 INFO:tasks.workunit.client.0.smithi103.stdout:6/604: sync 2024-09-17T01:07:20.291 INFO:tasks.workunit.client.0.smithi103.stdout:0/636: dread dd/d4f/f2e [0,4194304] 0 2024-09-17T01:07:20.292 INFO:tasks.workunit.client.0.smithi103.stdout:0/637: chown dd/df/d38/d55/c6d 627 1 2024-09-17T01:07:20.293 INFO:tasks.workunit.client.0.smithi103.stdout:6/605: symlink d3/d16/d33/d57/d63/d60/db5/ld0 0 2024-09-17T01:07:20.295 INFO:tasks.workunit.client.0.smithi103.stdout:6/606: rmdir d3/d16/d21/d56 39 2024-09-17T01:07:20.312 INFO:tasks.workunit.client.0.smithi103.stdout:0/638: dread dd/df/f3d [0,4194304] 0 2024-09-17T01:07:20.312 INFO:tasks.workunit.client.0.smithi103.stdout:0/639: write dd/d5d/d93/d9a/faa [885800,904] 0 2024-09-17T01:07:20.314 INFO:tasks.workunit.client.0.smithi103.stdout:0/640: truncate dd/df/d38/d55/fa0 286799 0 2024-09-17T01:07:20.320 INFO:tasks.workunit.client.0.smithi103.stdout:0/641: write dd/f3b [2651058,14061] 0 2024-09-17T01:07:20.324 INFO:tasks.workunit.client.0.smithi103.stdout:0/642: dread dd/f14 [0,4194304] 0 2024-09-17T01:07:20.325 INFO:tasks.workunit.client.0.smithi103.stdout:0/643: read dd/d4f/f32 [618320,8901] 0 2024-09-17T01:07:20.328 INFO:tasks.workunit.client.0.smithi103.stdout:0/644: read dd/d43/f53 [1131090,25457] 0 2024-09-17T01:07:20.330 INFO:tasks.workunit.client.0.smithi103.stdout:0/645: unlink dd/d1c/d9f/da3/fc7 0 2024-09-17T01:07:20.334 INFO:tasks.workunit.client.0.smithi103.stdout:0/646: dwrite f3 [0,4194304] 0 2024-09-17T01:07:20.351 INFO:tasks.workunit.client.0.smithi103.stdout:0/647: dwrite dd/df/d38/d55/f9e [0,4194304] 0 2024-09-17T01:07:20.353 INFO:tasks.workunit.client.0.smithi103.stdout:0/648: readlink dd/df/d38/da8/l92 0 2024-09-17T01:07:20.373 INFO:tasks.workunit.client.0.smithi103.stdout:0/649: dwrite dd/df/d68/f87 [4194304,4194304] 0 2024-09-17T01:07:20.380 INFO:tasks.workunit.client.0.smithi103.stdout:0/650: dread dd/d5d/f61 [0,4194304] 0 2024-09-17T01:07:20.392 INFO:tasks.workunit.client.0.smithi103.stdout:0/651: truncate dd/d43/f8f 437079 0 2024-09-17T01:07:20.400 INFO:tasks.workunit.client.0.smithi103.stdout:0/652: truncate dd/d43/f58 3403870 0 2024-09-17T01:07:20.401 INFO:tasks.workunit.client.0.smithi103.stdout:0/653: readlink dd/d5d/d93/ld2 0 2024-09-17T01:07:20.409 INFO:tasks.workunit.client.0.smithi103.stdout:0/654: dwrite dd/d4f/d64/f79 [0,4194304] 0 2024-09-17T01:07:20.415 INFO:tasks.workunit.client.0.smithi103.stdout:0/655: dwrite dd/d1c/d9f/fb3 [0,4194304] 0 2024-09-17T01:07:20.418 INFO:tasks.workunit.client.0.smithi103.stdout:0/656: fdatasync dd/d5d/f61 0 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:7/611: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:3/727: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:2/701: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:1/595: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:9/580: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:5/432: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:4/666: sync 2024-09-17T01:07:20.423 INFO:tasks.workunit.client.0.smithi103.stdout:8/524: sync 2024-09-17T01:07:20.432 INFO:tasks.workunit.client.0.smithi103.stdout:0/657: dwrite dd/df/f25 [4194304,4194304] 0 2024-09-17T01:07:20.433 INFO:tasks.workunit.client.0.smithi103.stdout:3/728: read d3/d16/d1b/d36/fc2 [2513634,50439] 0 2024-09-17T01:07:20.446 INFO:tasks.workunit.client.0.smithi103.stdout:5/433: dread d6/db/f5c [0,4194304] 0 2024-09-17T01:07:20.456 INFO:tasks.workunit.client.0.smithi103.stdout:4/667: dread d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:20.482 INFO:tasks.workunit.client.0.smithi103.stdout:1/596: unlink d2/f68 0 2024-09-17T01:07:20.483 INFO:tasks.workunit.client.0.smithi103.stdout:9/581: mkdir d7/d43/d5f/dc9 0 2024-09-17T01:07:20.483 INFO:tasks.workunit.client.0.smithi103.stdout:1/597: fsync d2/d7/fc 0 2024-09-17T01:07:20.487 INFO:tasks.workunit.client.0.smithi103.stdout:8/525: unlink d0/d6/dc/d30/d25/d7d/c91 0 2024-09-17T01:07:20.488 INFO:tasks.workunit.client.0.smithi103.stdout:0/658: creat dd/df/d68/d6c/d8e/fdb x:0 0 0 2024-09-17T01:07:20.490 INFO:tasks.workunit.client.0.smithi103.stdout:3/729: mknod d3/d81/cfc 0 2024-09-17T01:07:20.497 INFO:tasks.workunit.client.0.smithi103.stdout:7/612: creat d4/d10/d6b/d72/db8/fd6 x:0 0 0 2024-09-17T01:07:20.504 INFO:tasks.workunit.client.0.smithi103.stdout:0/659: rename dd/d5d to dd/df/d68/ddc 0 2024-09-17T01:07:20.540 INFO:tasks.workunit.client.0.smithi103.stdout:1/598: symlink d2/lc2 0 2024-09-17T01:07:20.541 INFO:tasks.workunit.client.0.smithi103.stdout:4/668: dwrite f5 [0,4194304] 0 2024-09-17T01:07:20.545 INFO:tasks.workunit.client.0.smithi103.stdout:5/434: mkdir d6/d11/d81/da2 0 2024-09-17T01:07:20.546 INFO:tasks.workunit.client.0.smithi103.stdout:9/582: link d7/d43/d88/d11/d5c/f61 d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/fca 0 2024-09-17T01:07:20.547 INFO:tasks.workunit.client.0.smithi103.stdout:2/702: link d6/da/d5d/d8d/d60/d75/d70/cdb d6/d5f/d26/d66/df/d68/d7e/dd9/cef 0 2024-09-17T01:07:20.548 INFO:tasks.workunit.client.0.smithi103.stdout:0/660: symlink dd/d1c/d9f/da3/ldd 0 2024-09-17T01:07:20.548 INFO:tasks.workunit.client.0.smithi103.stdout:1/599: rmdir d2/d16/d51/d79 39 2024-09-17T01:07:20.553 INFO:tasks.workunit.client.0.smithi103.stdout:7/613: dwrite d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:20.555 INFO:tasks.workunit.client.0.smithi103.stdout:7/614: fsync d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/fa7 0 2024-09-17T01:07:20.556 INFO:tasks.workunit.client.0.smithi103.stdout:0/661: read dd/d4f/f2c [297595,80508] 0 2024-09-17T01:07:20.557 INFO:tasks.workunit.client.0.smithi103.stdout:5/435: mkdir d6/d2c/d38/d6f/da3 0 2024-09-17T01:07:20.558 INFO:tasks.workunit.client.0.smithi103.stdout:4/669: dwrite d9/d16/d38/d3f/f6f [0,4194304] 0 2024-09-17T01:07:20.560 INFO:tasks.workunit.client.0.smithi103.stdout:3/730: rename d3/d16/c21 to d3/d16/d1b/d3c/d65/d75/dbe/d34/cfd 0 2024-09-17T01:07:20.561 INFO:tasks.workunit.client.0.smithi103.stdout:3/731: readlink d3/dd7/ldd 0 2024-09-17T01:07:20.562 INFO:tasks.workunit.client.0.smithi103.stdout:5/436: read d6/d28/f96 [2587654,42178] 0 2024-09-17T01:07:20.567 INFO:tasks.workunit.client.0.smithi103.stdout:7/615: truncate d4/d10/d6b/d72/db8/fd6 235970 0 2024-09-17T01:07:20.567 INFO:tasks.workunit.client.0.smithi103.stdout:5/437: fsync d6/d2c/d38/d4c/f8f 0 2024-09-17T01:07:20.569 INFO:tasks.workunit.client.0.smithi103.stdout:3/732: read d3/fb0 [391134,87321] 0 2024-09-17T01:07:20.571 INFO:tasks.workunit.client.0.smithi103.stdout:2/703: rename d6/f25 to d6/da/d5d/ff0 0 2024-09-17T01:07:20.572 INFO:tasks.workunit.client.0.smithi103.stdout:3/733: write d3/d16/d1b/f5e [1421720,94024] 0 2024-09-17T01:07:20.574 INFO:tasks.workunit.client.0.smithi103.stdout:7/616: unlink d4/d10/d37/f39 0 2024-09-17T01:07:20.574 INFO:tasks.workunit.client.0.smithi103.stdout:0/662: dwrite dd/df/d68/ddc/d93/d9a/faa [0,4194304] 0 2024-09-17T01:07:20.577 INFO:tasks.workunit.client.0.smithi103.stdout:4/670: dread d9/d16/d38/d3f/f6f [0,4194304] 0 2024-09-17T01:07:20.579 INFO:tasks.workunit.client.0.smithi103.stdout:2/704: creat d6/da/d5d/d8d/d60/d75/d70/ff1 x:0 0 0 2024-09-17T01:07:20.580 INFO:tasks.workunit.client.0.smithi103.stdout:7/617: readlink d4/d4a/d4b/d8a/lba 0 2024-09-17T01:07:20.582 INFO:tasks.workunit.client.0.smithi103.stdout:1/600: rename d2/d16/d51/d79/c8c to d2/d1c/d28/cc3 0 2024-09-17T01:07:20.582 INFO:tasks.workunit.client.0.smithi103.stdout:0/663: write dd/d43/f72 [5211871,120810] 0 2024-09-17T01:07:20.584 INFO:tasks.workunit.client.0.smithi103.stdout:4/671: fdatasync d9/dc/df/fc5 0 2024-09-17T01:07:20.586 INFO:tasks.workunit.client.0.smithi103.stdout:7/618: unlink d4/d11/d3f/f68 0 2024-09-17T01:07:20.588 INFO:tasks.workunit.client.0.smithi103.stdout:9/583: dread d7/d2d/d59/f68 [0,4194304] 0 2024-09-17T01:07:20.588 INFO:tasks.workunit.client.0.smithi103.stdout:0/664: truncate dd/d4f/f48 5228675 0 2024-09-17T01:07:20.590 INFO:tasks.workunit.client.0.smithi103.stdout:5/438: dwrite d6/d2c/d38/d4c/d50/f8c [0,4194304] 0 2024-09-17T01:07:20.593 INFO:tasks.workunit.client.0.smithi103.stdout:7/619: read d4/d10/d6b/dc5/d36/d3a/f5d [993559,56701] 0 2024-09-17T01:07:20.594 INFO:tasks.workunit.client.0.smithi103.stdout:4/672: dread f5 [0,4194304] 0 2024-09-17T01:07:20.594 INFO:tasks.workunit.client.0.smithi103.stdout:2/705: rename d6/d5f/f3c to d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/ff2 0 2024-09-17T01:07:20.595 INFO:tasks.workunit.client.0.smithi103.stdout:0/665: rmdir dd 39 2024-09-17T01:07:20.595 INFO:tasks.workunit.client.0.smithi103.stdout:4/673: chown d9/d16/d45/d76 67071584 1 2024-09-17T01:07:20.598 INFO:tasks.workunit.client.0.smithi103.stdout:9/584: dwrite d7/d43/d88/d11/d5c/d8d/f9e [0,4194304] 0 2024-09-17T01:07:20.610 INFO:tasks.workunit.client.0.smithi103.stdout:4/674: unlink d9/d10/f7f 0 2024-09-17T01:07:20.613 INFO:tasks.workunit.client.0.smithi103.stdout:1/601: creat d2/d16/d51/d65/d7f/fc4 x:0 0 0 2024-09-17T01:07:20.614 INFO:tasks.workunit.client.0.smithi103.stdout:1/602: fdatasync d2/d1c/d28/d52/f5c 0 2024-09-17T01:07:20.617 INFO:tasks.workunit.client.0.smithi103.stdout:9/585: fdatasync d7/d43/d88/d11/d5c/f61 0 2024-09-17T01:07:20.623 INFO:tasks.workunit.client.0.smithi103.stdout:0/666: creat dd/d1c/d9f/da3/fde x:0 0 0 2024-09-17T01:07:20.624 INFO:tasks.workunit.client.0.smithi103.stdout:0/667: write dd/df/f90 [914266,5127] 0 2024-09-17T01:07:20.624 INFO:tasks.workunit.client.0.smithi103.stdout:4/675: fsync d9/d16/d36/d42/f9f 0 2024-09-17T01:07:20.626 INFO:tasks.workunit.client.0.smithi103.stdout:1/603: truncate d2/d1c/d28/f29 1680726 0 2024-09-17T01:07:20.630 INFO:tasks.workunit.client.0.smithi103.stdout:9/586: rename d7/d43/d88/d11/d20/f9c to d7/d43/d88/d11/d20/dbc/fcb 0 2024-09-17T01:07:20.631 INFO:tasks.workunit.client.0.smithi103.stdout:9/587: write d7/d43/d88/d11/fba [512110,41797] 0 2024-09-17T01:07:20.633 INFO:tasks.workunit.client.0.smithi103.stdout:0/668: creat dd/df/d38/d62/d84/da9/fdf x:0 0 0 2024-09-17T01:07:20.637 INFO:tasks.workunit.client.0.smithi103.stdout:5/439: link d6/d2c/f52 d6/d28/d90/fa4 0 2024-09-17T01:07:20.638 INFO:tasks.workunit.client.0.smithi103.stdout:2/706: dwrite d6/d5f/fde [0,4194304] 0 2024-09-17T01:07:20.641 INFO:tasks.workunit.client.0.smithi103.stdout:7/620: getdents d4/d4a/d4b 0 2024-09-17T01:07:20.644 INFO:tasks.workunit.client.0.smithi103.stdout:9/588: symlink d7/d43/d88/d11/d5c/lcc 0 2024-09-17T01:07:20.646 INFO:tasks.workunit.client.0.smithi103.stdout:9/589: chown d7/d43/d88/d11/d20/d4f/f75 23320248 1 2024-09-17T01:07:20.648 INFO:tasks.workunit.client.0.smithi103.stdout:1/604: write d2/d1c/d20/d33/f3c [650672,31622] 0 2024-09-17T01:07:20.649 INFO:tasks.workunit.client.0.smithi103.stdout:1/605: dread - d2/d1c/d20/d33/f62 zero size 2024-09-17T01:07:20.650 INFO:tasks.workunit.client.0.smithi103.stdout:5/440: mknod d6/d2c/d38/d4c/d71/ca5 0 2024-09-17T01:07:20.651 INFO:tasks.workunit.client.0.smithi103.stdout:1/606: truncate d2/de/d1f/f3b 3303315 0 2024-09-17T01:07:20.652 INFO:tasks.workunit.client.0.smithi103.stdout:7/621: creat d4/d10/d6b/dc5/d8d/fd7 x:0 0 0 2024-09-17T01:07:20.654 INFO:tasks.workunit.client.0.smithi103.stdout:9/590: rename d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/cbf to d7/ccd 0 2024-09-17T01:07:20.657 INFO:tasks.workunit.client.0.smithi103.stdout:5/441: truncate d6/d2c/d38/d4c/d50/f21 795157 0 2024-09-17T01:07:20.657 INFO:tasks.workunit.client.0.smithi103.stdout:7/622: truncate d4/d10/d4e/f69 1550573 0 2024-09-17T01:07:20.661 INFO:tasks.workunit.client.0.smithi103.stdout:0/669: write dd/df/d38/fbe [1190724,41484] 0 2024-09-17T01:07:20.662 INFO:tasks.workunit.client.0.smithi103.stdout:0/670: stat dd/d1c/f1d 0 2024-09-17T01:07:20.663 INFO:tasks.workunit.client.0.smithi103.stdout:5/442: rename d6/d2c/d38/d4c/d50/l15 to d6/d2c/d38/d4c/la6 0 2024-09-17T01:07:20.664 INFO:tasks.workunit.client.0.smithi103.stdout:0/671: dread dd/df/d38/f63 [0,4194304] 0 2024-09-17T01:07:20.665 INFO:tasks.workunit.client.0.smithi103.stdout:7/623: mknod d4/d4a/cd8 0 2024-09-17T01:07:20.666 INFO:tasks.workunit.client.0.smithi103.stdout:0/672: write dd/f77 [9199564,21848] 0 2024-09-17T01:07:20.667 INFO:tasks.workunit.client.0.smithi103.stdout:0/673: fdatasync dd/df/f24 0 2024-09-17T01:07:20.672 INFO:tasks.workunit.client.0.smithi103.stdout:5/443: dwrite d6/db/fd [0,4194304] 0 2024-09-17T01:07:20.673 INFO:tasks.workunit.client.0.smithi103.stdout:9/591: write d7/d2d/f72 [4443274,97280] 0 2024-09-17T01:07:20.673 INFO:tasks.workunit.client.0.smithi103.stdout:2/707: truncate d6/f4b 1692049 0 2024-09-17T01:07:20.676 INFO:tasks.workunit.client.0.smithi103.stdout:9/592: chown d7/db8/dbb/f33 0 1 2024-09-17T01:07:20.678 INFO:tasks.workunit.client.0.smithi103.stdout:7/624: dwrite d4/d11/d34/db5/fb0 [0,4194304] 0 2024-09-17T01:07:20.681 INFO:tasks.workunit.client.0.smithi103.stdout:0/674: link dd/df/d68/f87 dd/df/d38/fe0 0 2024-09-17T01:07:20.685 INFO:tasks.workunit.client.0.smithi103.stdout:1/607: dwrite d2/d7/d73/d81/fa6 [0,4194304] 0 2024-09-17T01:07:20.690 INFO:tasks.workunit.client.0.smithi103.stdout:5/444: truncate d6/d11/f1d 957349 0 2024-09-17T01:07:20.697 INFO:tasks.workunit.client.0.smithi103.stdout:5/445: truncate d6/f6d 74838 0 2024-09-17T01:07:20.698 INFO:tasks.workunit.client.0.smithi103.stdout:7/625: dwrite d4/d11/d34/db5/f6c [0,4194304] 0 2024-09-17T01:07:20.699 INFO:tasks.workunit.client.0.smithi103.stdout:9/593: mknod d7/d43/d88/d11/d5c/d8d/dac/dae/cce 0 2024-09-17T01:07:20.701 INFO:tasks.workunit.client.0.smithi103.stdout:2/708: creat d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/ff3 x:0 0 0 2024-09-17T01:07:20.702 INFO:tasks.workunit.client.0.smithi103.stdout:0/675: dwrite dd/df/d38/d55/f8a [4194304,4194304] 0 2024-09-17T01:07:20.702 INFO:tasks.workunit.client.0.smithi103.stdout:9/594: write d7/d43/d88/d11/fba [1557171,28851] 0 2024-09-17T01:07:20.703 INFO:tasks.workunit.client.0.smithi103.stdout:5/446: creat d6/d7d/d93/fa7 x:0 0 0 2024-09-17T01:07:20.706 INFO:tasks.workunit.client.0.smithi103.stdout:2/709: write d6/d5f/fac [578421,30090] 0 2024-09-17T01:07:20.706 INFO:tasks.workunit.client.0.smithi103.stdout:5/447: write d6/d2c/d38/d4c/d50/f8c [4479688,106102] 0 2024-09-17T01:07:20.706 INFO:tasks.workunit.client.0.smithi103.stdout:9/595: mkdir d7/d43/dcf 0 2024-09-17T01:07:20.708 INFO:tasks.workunit.client.0.smithi103.stdout:0/676: rmdir dd/d4f/d64 39 2024-09-17T01:07:20.714 INFO:tasks.workunit.client.0.smithi103.stdout:7/626: getdents d4/d10/d6b/d72/db8 0 2024-09-17T01:07:20.715 INFO:tasks.workunit.client.0.smithi103.stdout:5/448: creat d6/d2c/d38/da0/fa8 x:0 0 0 2024-09-17T01:07:20.717 INFO:tasks.workunit.client.0.smithi103.stdout:7/627: write d4/d10/d32/faf [2141686,119888] 0 2024-09-17T01:07:20.718 INFO:tasks.workunit.client.0.smithi103.stdout:5/449: readlink d6/d2c/d38/d4c/d54/l95 0 2024-09-17T01:07:20.719 INFO:tasks.workunit.client.0.smithi103.stdout:1/608: write d2/de/d1f/f34 [4181952,15988] 0 2024-09-17T01:07:20.727 INFO:tasks.workunit.client.0.smithi103.stdout:5/450: dread - d6/d2c/d38/d4c/d54/f77 zero size 2024-09-17T01:07:20.727 INFO:tasks.workunit.client.0.smithi103.stdout:5/451: chown d6/db/d66/f67 463462 1 2024-09-17T01:07:20.731 INFO:tasks.workunit.client.0.smithi103.stdout:2/710: write d6/da/d5d/d8d/f71 [208095,119178] 0 2024-09-17T01:07:20.732 INFO:tasks.workunit.client.0.smithi103.stdout:7/628: getdents d4/d11/d80 0 2024-09-17T01:07:20.733 INFO:tasks.workunit.client.0.smithi103.stdout:7/629: write d4/d10/fd3 [793570,15004] 0 2024-09-17T01:07:20.735 INFO:tasks.workunit.client.0.smithi103.stdout:2/711: chown d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/ded 39875 1 2024-09-17T01:07:20.736 INFO:tasks.workunit.client.0.smithi103.stdout:2/712: write d6/da/d28/fd1 [986353,120553] 0 2024-09-17T01:07:20.738 INFO:tasks.workunit.client.0.smithi103.stdout:5/452: link d6/d2c/d38/d4c/l7f d6/db/la9 0 2024-09-17T01:07:20.740 INFO:tasks.workunit.client.0.smithi103.stdout:7/630: rename d4/d10/d6b/dc5/d36/l46 to d4/d10/d37/ld9 0 2024-09-17T01:07:20.742 INFO:tasks.workunit.client.0.smithi103.stdout:0/677: truncate dd/df/d38/d55/f8a 7386581 0 2024-09-17T01:07:20.744 INFO:tasks.workunit.client.0.smithi103.stdout:1/609: dread d2/de/d76/f88 [0,4194304] 0 2024-09-17T01:07:20.744 INFO:tasks.workunit.client.0.smithi103.stdout:5/453: chown d6/d2c/d38/d4c/d54/c9e 1028468 1 2024-09-17T01:07:20.745 INFO:tasks.workunit.client.0.smithi103.stdout:9/596: dread d7/d43/d88/d11/d20/f44 [4194304,4194304] 0 2024-09-17T01:07:20.747 INFO:tasks.workunit.client.0.smithi103.stdout:2/713: write d6/d5f/f1e [134537,101230] 0 2024-09-17T01:07:20.752 INFO:tasks.workunit.client.0.smithi103.stdout:9/597: read d7/d2d/d59/f66 [189810,28879] 0 2024-09-17T01:07:20.754 INFO:tasks.workunit.client.0.smithi103.stdout:1/610: dwrite d2/d7/d4e/fb4 [0,4194304] 0 2024-09-17T01:07:20.755 INFO:tasks.workunit.client.0.smithi103.stdout:1/611: stat d2/de/d1f/f3b 0 2024-09-17T01:07:20.763 INFO:tasks.workunit.client.0.smithi103.stdout:0/678: dwrite dd/df/d38/d55/f8a [0,4194304] 0 2024-09-17T01:07:20.763 INFO:tasks.workunit.client.0.smithi103.stdout:7/631: truncate d4/d10/d4e/f69 1260740 0 2024-09-17T01:07:20.764 INFO:tasks.workunit.client.0.smithi103.stdout:7/632: stat d4/d11/l5c 0 2024-09-17T01:07:20.766 INFO:tasks.workunit.client.0.smithi103.stdout:2/714: rename d6/d5f/d26/d66/df/d68/db3 to d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4 0 2024-09-17T01:07:20.767 INFO:tasks.workunit.client.0.smithi103.stdout:1/612: unlink d2/d1c/d28/d4b/d74/c4a 0 2024-09-17T01:07:20.770 INFO:tasks.workunit.client.0.smithi103.stdout:5/454: write d6/d11/f1d [1673363,106226] 0 2024-09-17T01:07:20.836 INFO:tasks.workunit.client.0.smithi103.stdout:0/679: dwrite dd/f4d [0,4194304] 0 2024-09-17T01:07:20.838 INFO:tasks.workunit.client.0.smithi103.stdout:7/633: write d4/d10/d66/f6d [549346,17333] 0 2024-09-17T01:07:20.842 INFO:tasks.workunit.client.0.smithi103.stdout:9/598: dwrite d7/db8/dbb/f33 [0,4194304] 0 2024-09-17T01:07:20.849 INFO:tasks.workunit.client.0.smithi103.stdout:5/455: dwrite d6/d2c/f3d [0,4194304] 0 2024-09-17T01:07:20.852 INFO:tasks.workunit.client.0.smithi103.stdout:1/613: dread d2/d1c/d28/d52/d69/fa9 [0,4194304] 0 2024-09-17T01:07:20.861 INFO:tasks.workunit.client.0.smithi103.stdout:1/614: dwrite d2/d16/fb0 [0,4194304] 0 2024-09-17T01:07:20.861 INFO:tasks.workunit.client.0.smithi103.stdout:1/615: stat d2/d1c/d28/d4b/d67/f86 0 2024-09-17T01:07:20.863 INFO:tasks.workunit.client.0.smithi103.stdout:2/715: mkdir d6/d5f/df5 0 2024-09-17T01:07:20.865 INFO:tasks.workunit.client.0.smithi103.stdout:7/634: creat d4/d10/d6b/d9f/fda x:0 0 0 2024-09-17T01:07:20.866 INFO:tasks.workunit.client.0.smithi103.stdout:9/599: creat d7/d43/d88/d11/d20/d8e/fd0 x:0 0 0 2024-09-17T01:07:20.867 INFO:tasks.workunit.client.0.smithi103.stdout:5/456: mknod d6/d2c/d38/d4c/caa 0 2024-09-17T01:07:20.869 INFO:tasks.workunit.client.0.smithi103.stdout:7/635: truncate d4/d10/d6b/dc5/d36/d3a/d51/d5e/f60 5059212 0 2024-09-17T01:07:20.871 INFO:tasks.workunit.client.0.smithi103.stdout:2/716: fsync d6/d5f/d26/d66/df/ddd/fe6 0 2024-09-17T01:07:20.872 INFO:tasks.workunit.client.0.smithi103.stdout:0/680: creat dd/fe1 x:0 0 0 2024-09-17T01:07:20.874 INFO:tasks.workunit.client.0.smithi103.stdout:7/636: mknod d4/d10/d6b/dc5/d36/d3a/d51/d5e/cdb 0 2024-09-17T01:07:20.876 INFO:tasks.workunit.client.0.smithi103.stdout:7/637: fsync d4/d10/f56 0 2024-09-17T01:07:20.877 INFO:tasks.workunit.client.0.smithi103.stdout:0/681: creat dd/d4f/d64/fe2 x:0 0 0 2024-09-17T01:07:20.879 INFO:tasks.workunit.client.0.smithi103.stdout:7/638: unlink d4/d11/f2a 0 2024-09-17T01:07:20.880 INFO:tasks.workunit.client.0.smithi103.stdout:2/717: dread d6/d5f/d26/d6e/f98 [0,4194304] 0 2024-09-17T01:07:20.884 INFO:tasks.workunit.client.0.smithi103.stdout:7/639: creat d4/d10/d37/d95/fdc x:0 0 0 2024-09-17T01:07:20.885 INFO:tasks.workunit.client.0.smithi103.stdout:2/718: mkdir d6/da/d5d/d8d/d60/d75/d70/df6 0 2024-09-17T01:07:20.886 INFO:tasks.workunit.client.0.smithi103.stdout:0/682: dwrite dd/f42 [4194304,4194304] 0 2024-09-17T01:07:20.890 INFO:tasks.workunit.client.0.smithi103.stdout:5/457: dread f0 [0,4194304] 0 2024-09-17T01:07:20.891 INFO:tasks.workunit.client.0.smithi103.stdout:0/683: creat dd/df/d38/d62/d84/da9/fe3 x:0 0 0 2024-09-17T01:07:20.892 INFO:tasks.workunit.client.0.smithi103.stdout:0/684: chown dd/d4f/l2b 1993 1 2024-09-17T01:07:20.892 INFO:tasks.workunit.client.0.smithi103.stdout:7/640: dread d4/d11/d34/db5/f6c [0,4194304] 0 2024-09-17T01:07:20.892 INFO:tasks.workunit.client.0.smithi103.stdout:2/719: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/cf7 0 2024-09-17T01:07:20.900 INFO:tasks.workunit.client.0.smithi103.stdout:7/641: dwrite d4/d4a/f67 [0,4194304] 0 2024-09-17T01:07:20.902 INFO:tasks.workunit.client.0.smithi103.stdout:2/720: dwrite d6/d5f/d26/d66/df/ddd/fe6 [0,4194304] 0 2024-09-17T01:07:20.905 INFO:tasks.workunit.client.0.smithi103.stdout:2/721: dread d6/d5f/d26/d34/d80/fa6 [0,4194304] 0 2024-09-17T01:07:20.914 INFO:tasks.workunit.client.0.smithi103.stdout:1/616: truncate d2/d7/d4e/fb4 2509001 0 2024-09-17T01:07:20.917 INFO:tasks.workunit.client.0.smithi103.stdout:2/722: dread d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/fd3 [0,4194304] 0 2024-09-17T01:07:20.921 INFO:tasks.workunit.client.0.smithi103.stdout:2/723: mknod d6/d5f/d26/d66/df/d68/d7e/dd9/cf8 0 2024-09-17T01:07:20.925 INFO:tasks.workunit.client.0.smithi103.stdout:7/642: write d4/d10/d6b/dc5/d36/d3a/d51/d5e/f75 [1074504,27922] 0 2024-09-17T01:07:20.927 INFO:tasks.workunit.client.0.smithi103.stdout:5/458: dwrite d6/d2c/d32/f33 [0,4194304] 0 2024-09-17T01:07:20.933 INFO:tasks.workunit.client.0.smithi103.stdout:2/724: dwrite d6/d5f/d26/d66/df/d68/d7e/d8b/fc3 [0,4194304] 0 2024-09-17T01:07:20.935 INFO:tasks.workunit.client.0.smithi103.stdout:5/459: rename d6/d2c/l69 to d6/d11/d81/da2/lab 0 2024-09-17T01:07:20.941 INFO:tasks.workunit.client.0.smithi103.stdout:7/643: getdents d4/d11/d3f/d63 0 2024-09-17T01:07:20.943 INFO:tasks.workunit.client.0.smithi103.stdout:7/644: creat d4/d11/d80/d8c/fdd x:0 0 0 2024-09-17T01:07:20.947 INFO:tasks.workunit.client.0.smithi103.stdout:7/645: creat d4/d10/d66/dd2/fde x:0 0 0 2024-09-17T01:07:20.952 INFO:tasks.workunit.client.0.smithi103.stdout:7/646: creat d4/d10/d6b/dc5/d36/d3a/d51/d5e/fdf x:0 0 0 2024-09-17T01:07:20.953 INFO:tasks.workunit.client.0.smithi103.stdout:7/647: write d4/d10/d32/faf [5894907,2253] 0 2024-09-17T01:07:20.959 INFO:tasks.workunit.client.0.smithi103.stdout:2/725: dread d6/d5f/d26/d34/d80/fb2 [0,4194304] 0 2024-09-17T01:07:20.962 INFO:tasks.workunit.client.0.smithi103.stdout:2/726: mknod d6/da/d3f/cf9 0 2024-09-17T01:07:20.966 INFO:tasks.workunit.client.0.smithi103.stdout:2/727: symlink d6/d5f/d26/d66/df/lfa 0 2024-09-17T01:07:20.968 INFO:tasks.workunit.client.0.smithi103.stdout:7/648: dwrite d4/d11/f5f [0,4194304] 0 2024-09-17T01:07:20.968 INFO:tasks.workunit.client.0.smithi103.stdout:2/728: creat d6/d5f/d26/d66/df/d68/ffb x:0 0 0 2024-09-17T01:07:20.970 INFO:tasks.workunit.client.0.smithi103.stdout:2/729: chown d6/d5f/d26/d66/df/d68/d7e/dd9 5318 1 2024-09-17T01:07:20.977 INFO:tasks.workunit.client.0.smithi103.stdout:7/649: dwrite d4/d10/d6b/dc5/d36/d3a/d51/fca [0,4194304] 0 2024-09-17T01:07:20.983 INFO:tasks.workunit.client.0.smithi103.stdout:7/650: dwrite d4/d10/d32/faf [4194304,4194304] 0 2024-09-17T01:07:20.990 INFO:tasks.workunit.client.0.smithi103.stdout:7/651: mkdir d4/d4a/de0 0 2024-09-17T01:07:20.991 INFO:tasks.workunit.client.0.smithi103.stdout:7/652: readlink d4/d10/d6b/ld5 0 2024-09-17T01:07:20.993 INFO:tasks.workunit.client.0.smithi103.stdout:7/653: symlink d4/d10/d37/le1 0 2024-09-17T01:07:21.005 INFO:tasks.workunit.client.0.smithi103.stdout:7/654: write d4/d10/d6b/dc5/d36/d3a/f5d [4655153,128692] 0 2024-09-17T01:07:21.009 INFO:tasks.workunit.client.0.smithi103.stdout:7/655: chown d4/d10/d43/f57 10086830 1 2024-09-17T01:07:21.011 INFO:tasks.workunit.client.0.smithi103.stdout:7/656: creat d4/d4a/d4b/fe2 x:0 0 0 2024-09-17T01:07:21.013 INFO:tasks.workunit.client.0.smithi103.stdout:7/657: truncate d4/d10/d6b/dc5/d8d/d92/f93 1408186 0 2024-09-17T01:07:21.014 INFO:tasks.workunit.client.0.smithi103.stdout:7/658: rmdir d4/d10/d6b/dc5/d36 39 2024-09-17T01:07:21.016 INFO:tasks.workunit.client.0.smithi103.stdout:7/659: mkdir d4/d10/d6b/de3 0 2024-09-17T01:07:21.261 INFO:tasks.workunit.client.0.smithi103.stdout:6/607: sync 2024-09-17T01:07:21.265 INFO:tasks.workunit.client.0.smithi103.stdout:8/526: sync 2024-09-17T01:07:21.267 INFO:tasks.workunit.client.0.smithi103.stdout:6/608: dwrite d3/d16/d21/d50/faf [0,4194304] 0 2024-09-17T01:07:21.268 INFO:tasks.workunit.client.0.smithi103.stdout:8/527: write d0/d6/dc/d30/d25/d64/d34/f9f [846084,115788] 0 2024-09-17T01:07:21.271 INFO:tasks.workunit.client.0.smithi103.stdout:6/609: symlink d3/d16/d33/d57/d63/d60/db5/ld1 0 2024-09-17T01:07:21.331 INFO:tasks.workunit.client.0.smithi103.stdout:8/528: truncate d0/d6/dc/d30/d2d/f65 271183 0 2024-09-17T01:07:21.332 INFO:tasks.workunit.client.0.smithi103.stdout:8/529: truncate d0/f3e 1263584 0 2024-09-17T01:07:21.334 INFO:tasks.workunit.client.0.smithi103.stdout:8/530: mknod d0/d80/ca4 0 2024-09-17T01:07:21.336 INFO:tasks.workunit.client.0.smithi103.stdout:8/531: getdents d0/d6/dc/d3d/d88 0 2024-09-17T01:07:21.337 INFO:tasks.workunit.client.0.smithi103.stdout:8/532: dread - d0/d6/dc/d3d/f7e zero size 2024-09-17T01:07:21.338 INFO:tasks.workunit.client.0.smithi103.stdout:8/533: write d0/d6/f1c [4408002,7153] 0 2024-09-17T01:07:21.426 INFO:tasks.workunit.client.0.smithi103.stdout:6/610: dwrite d3/d25/f7d [0,4194304] 0 2024-09-17T01:07:21.430 INFO:tasks.workunit.client.0.smithi103.stdout:6/611: fsync d3/d16/d21/d56/f97 0 2024-09-17T01:07:21.435 INFO:tasks.workunit.client.0.smithi103.stdout:8/534: dwrite d0/d6/f77 [0,4194304] 0 2024-09-17T01:07:21.438 INFO:tasks.workunit.client.0.smithi103.stdout:6/612: dwrite d3/d16/d33/d57/fcb [0,4194304] 0 2024-09-17T01:07:21.440 INFO:tasks.workunit.client.0.smithi103.stdout:6/613: chown d3/d16/d21/d56/d9a/lb2 26117584 1 2024-09-17T01:07:21.483 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:21 smithi103 ceph-mon[28156]: pgmap v21: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 220 MiB/s wr, 449 op/s 2024-09-17T01:07:21.507 INFO:tasks.workunit.client.0.smithi103.stdout:8/535: creat d0/d6/dc/d3d/d88/fa5 x:0 0 0 2024-09-17T01:07:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:21 smithi143 ceph-mon[35452]: pgmap v21: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 220 MiB/s wr, 449 op/s 2024-09-17T01:07:21.510 INFO:tasks.workunit.client.0.smithi103.stdout:8/536: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/da6 0 2024-09-17T01:07:21.514 INFO:tasks.workunit.client.0.smithi103.stdout:8/537: link d0/d6/dc/d30/d25/d64/d34/c52 d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/ca7 0 2024-09-17T01:07:21.515 INFO:tasks.workunit.client.0.smithi103.stdout:8/538: chown d0/d6/dc/f8f 147905 1 2024-09-17T01:07:21.522 INFO:tasks.workunit.client.0.smithi103.stdout:8/539: dwrite d0/d6/dc/d30/d25/d64/f75 [0,4194304] 0 2024-09-17T01:07:21.526 INFO:tasks.workunit.client.0.smithi103.stdout:8/540: write d0/f44 [1340056,81769] 0 2024-09-17T01:07:21.600 INFO:tasks.workunit.client.0.smithi103.stdout:3/734: sync 2024-09-17T01:07:21.600 INFO:tasks.workunit.client.0.smithi103.stdout:9/600: sync 2024-09-17T01:07:21.600 INFO:tasks.workunit.client.0.smithi103.stdout:4/676: sync 2024-09-17T01:07:21.601 INFO:tasks.workunit.client.0.smithi103.stdout:3/735: read - d3/dd7/feb zero size 2024-09-17T01:07:21.602 INFO:tasks.workunit.client.0.smithi103.stdout:4/677: fsync d9/d16/d45/d5e/f7a 0 2024-09-17T01:07:21.604 INFO:tasks.workunit.client.0.smithi103.stdout:4/678: fsync d9/d10/fa7 0 2024-09-17T01:07:21.604 INFO:tasks.workunit.client.0.smithi103.stdout:3/736: rmdir d3/d16/d1b 39 2024-09-17T01:07:21.607 INFO:tasks.workunit.client.0.smithi103.stdout:9/601: dwrite d7/d43/d88/f5a [0,4194304] 0 2024-09-17T01:07:21.611 INFO:tasks.workunit.client.0.smithi103.stdout:4/679: creat d9/d16/d23/d32/d4c/fd2 x:0 0 0 2024-09-17T01:07:21.615 INFO:tasks.workunit.client.0.smithi103.stdout:4/680: creat d9/d16/d70/fd3 x:0 0 0 2024-09-17T01:07:21.620 INFO:tasks.workunit.client.0.smithi103.stdout:4/681: rename d9/d2d to d9/d16/d23/d52/d91/dd4 0 2024-09-17T01:07:21.622 INFO:tasks.workunit.client.0.smithi103.stdout:4/682: write d9/fb9 [792427,100698] 0 2024-09-17T01:07:21.624 INFO:tasks.workunit.client.0.smithi103.stdout:4/683: symlink d9/d16/d36/d42/ld5 0 2024-09-17T01:07:21.628 INFO:tasks.workunit.client.0.smithi103.stdout:3/737: dread d3/d16/d1b/f89 [0,4194304] 0 2024-09-17T01:07:21.634 INFO:tasks.workunit.client.0.smithi103.stdout:3/738: unlink d3/d16/d1b/d3c/f53 0 2024-09-17T01:07:21.637 INFO:tasks.workunit.client.0.smithi103.stdout:3/739: symlink d3/d44/d63/lfe 0 2024-09-17T01:07:21.639 INFO:tasks.workunit.client.0.smithi103.stdout:4/684: dread d9/d16/d23/d52/fce [0,4194304] 0 2024-09-17T01:07:21.642 INFO:tasks.workunit.client.0.smithi103.stdout:3/740: creat d3/d16/d1b/d3c/d65/d7e/fff x:0 0 0 2024-09-17T01:07:21.645 INFO:tasks.workunit.client.0.smithi103.stdout:3/741: unlink d3/d16/d1b/d3c/c51 0 2024-09-17T01:07:21.646 INFO:tasks.workunit.client.0.smithi103.stdout:4/685: link d9/d10/c1d d9/d16/cd6 0 2024-09-17T01:07:21.646 INFO:tasks.workunit.client.0.smithi103.stdout:3/742: dread - d3/d16/d1b/d3c/d65/df7/ffa zero size 2024-09-17T01:07:21.648 INFO:tasks.workunit.client.0.smithi103.stdout:4/686: read - d9/d16/d23/d32/d61/f95 zero size 2024-09-17T01:07:21.650 INFO:tasks.workunit.client.0.smithi103.stdout:4/687: write d9/d16/d36/d42/f7b [2018523,10986] 0 2024-09-17T01:07:21.651 INFO:tasks.workunit.client.0.smithi103.stdout:3/743: dread d3/d16/d1b/d3c/d65/d75/dbe/d34/f48 [0,4194304] 0 2024-09-17T01:07:21.653 INFO:tasks.workunit.client.0.smithi103.stdout:4/688: creat d9/d16/d44/fd7 x:0 0 0 2024-09-17T01:07:21.654 INFO:tasks.workunit.client.0.smithi103.stdout:3/744: mknod d3/d16/d1b/d3c/d65/d75/dbe/c100 0 2024-09-17T01:07:21.655 INFO:tasks.workunit.client.0.smithi103.stdout:4/689: creat d9/d16/d36/d42/fd8 x:0 0 0 2024-09-17T01:07:21.656 INFO:tasks.workunit.client.0.smithi103.stdout:4/690: write d9/d16/d23/d2a/f50 [3023034,114953] 0 2024-09-17T01:07:21.659 INFO:tasks.workunit.client.0.smithi103.stdout:3/745: getdents d3/d16/d1b/d3c/d65/d7e/da3 0 2024-09-17T01:07:21.664 INFO:tasks.workunit.client.0.smithi103.stdout:3/746: rename d3/d16/d1b/d3c/d65/d75/dbe/l88 to d3/d16/d1b/d3c/d65/d75/dbe/d34/d8c/l101 0 2024-09-17T01:07:21.664 INFO:tasks.workunit.client.0.smithi103.stdout:4/691: dread d9/d16/d23/d52/d91/dd4/f39 [0,4194304] 0 2024-09-17T01:07:21.665 INFO:tasks.workunit.client.0.smithi103.stdout:4/692: chown d9/d16/d36/d42/f9f 0 1 2024-09-17T01:07:21.665 INFO:tasks.workunit.client.0.smithi103.stdout:4/693: chown d9/d16/d36/l4b 9 1 2024-09-17T01:07:21.666 INFO:tasks.workunit.client.0.smithi103.stdout:3/747: chown d3/d16/d1b/d3c/d65/d75/dbe/d34/cfd 438 1 2024-09-17T01:07:21.667 INFO:tasks.workunit.client.0.smithi103.stdout:4/694: fdatasync d9/d16/d23/d52/d91/dd4/d55/f60 0 2024-09-17T01:07:21.669 INFO:tasks.workunit.client.0.smithi103.stdout:3/748: creat d3/d16/d1b/d36/f102 x:0 0 0 2024-09-17T01:07:21.671 INFO:tasks.workunit.client.0.smithi103.stdout:3/749: unlink d3/d16/d1b/d3c/d65/d7c/c94 0 2024-09-17T01:07:21.681 INFO:tasks.workunit.client.0.smithi103.stdout:3/750: write d3/d16/d1b/d36/fb8 [780771,20699] 0 2024-09-17T01:07:21.684 INFO:tasks.workunit.client.0.smithi103.stdout:3/751: dread d3/d16/d1b/d3c/d65/d7e/dac/dce/f72 [0,4194304] 0 2024-09-17T01:07:21.686 INFO:tasks.workunit.client.0.smithi103.stdout:3/752: symlink d3/d16/d1b/l103 0 2024-09-17T01:07:21.686 INFO:tasks.workunit.client.0.smithi103.stdout:3/753: write d3/d16/d1b/d3c/f40 [4534223,29517] 0 2024-09-17T01:07:21.688 INFO:tasks.workunit.client.0.smithi103.stdout:3/754: write d3/d16/d1b/d3c/d65/f9b [2044913,30899] 0 2024-09-17T01:07:21.690 INFO:tasks.workunit.client.0.smithi103.stdout:3/755: dread - d3/d16/d1b/d3c/d65/d75/d9c/fde zero size 2024-09-17T01:07:21.691 INFO:tasks.workunit.client.0.smithi103.stdout:3/756: chown d3/d16/d1b/f74 925 1 2024-09-17T01:07:21.692 INFO:tasks.workunit.client.0.smithi103.stdout:3/757: creat d3/d16/d1b/d3c/d65/df7/f104 x:0 0 0 2024-09-17T01:07:21.693 INFO:tasks.workunit.client.0.smithi103.stdout:3/758: chown d3/d16/d1b/c24 1 1 2024-09-17T01:07:21.698 INFO:tasks.workunit.client.0.smithi103.stdout:3/759: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:07:21.712 INFO:tasks.workunit.client.0.smithi103.stdout:3/760: dwrite d3/d16/d1b/d3c/d65/d75/dbe/d34/f48 [0,4194304] 0 2024-09-17T01:07:21.714 INFO:tasks.workunit.client.0.smithi103.stdout:3/761: readlink d3/l69 0 2024-09-17T01:07:21.736 INFO:tasks.workunit.client.0.smithi103.stdout:3/762: dread d3/d16/d1b/d3c/d65/d83/ff1 [0,4194304] 0 2024-09-17T01:07:21.746 INFO:tasks.workunit.client.0.smithi103.stdout:3/763: dwrite d3/d16/d1b/d3c/d65/d7e/dac/dce/f72 [0,4194304] 0 2024-09-17T01:07:21.748 INFO:tasks.workunit.client.0.smithi103.stdout:3/764: write d3/f9 [1064162,103914] 0 2024-09-17T01:07:21.752 INFO:tasks.workunit.client.0.smithi103.stdout:3/765: mkdir d3/d16/d1b/d3c/d65/d83/dbf/d105 0 2024-09-17T01:07:21.755 INFO:tasks.workunit.client.0.smithi103.stdout:3/766: mkdir d3/d16/d90/d106 0 2024-09-17T01:07:21.760 INFO:tasks.workunit.client.0.smithi103.stdout:3/767: creat d3/d16/d1b/d3c/d65/d75/dbe/d34/f107 x:0 0 0 2024-09-17T01:07:21.763 INFO:tasks.workunit.client.0.smithi103.stdout:3/768: mkdir d3/d16/d1b/d3c/d65/d75/dd1/d108 0 2024-09-17T01:07:21.765 INFO:tasks.workunit.client.0.smithi103.stdout:3/769: creat d3/d16/d1b/d3c/d65/d75/dd1/f109 x:0 0 0 2024-09-17T01:07:21.766 INFO:tasks.workunit.client.0.smithi103.stdout:3/770: symlink d3/dd7/de7/l10a 0 2024-09-17T01:07:21.769 INFO:tasks.workunit.client.0.smithi103.stdout:3/771: mkdir d3/d16/d1b/d3c/d10b 0 2024-09-17T01:07:21.775 INFO:tasks.workunit.client.0.smithi103.stdout:3/772: dwrite d3/d44/f71 [0,4194304] 0 2024-09-17T01:07:21.783 INFO:tasks.workunit.client.0.smithi103.stdout:3/773: dwrite d3/d16/d1b/d3c/d65/d75/dbe/faf [4194304,4194304] 0 2024-09-17T01:07:21.784 INFO:tasks.workunit.client.0.smithi103.stdout:3/774: chown d3/d16/d1b/d3c/f68 4699317 1 2024-09-17T01:07:21.788 INFO:tasks.workunit.client.0.smithi103.stdout:3/775: getdents d3/d16/d1b/d3c/d65/d83/dbf/d105 0 2024-09-17T01:07:21.838 INFO:tasks.workunit.client.0.smithi103.stdout:0/685: sync 2024-09-17T01:07:21.884 INFO:tasks.workunit.client.0.smithi103.stdout:0/686: rename dd/df/d68/ddc/d93/d9a to dd/df/d68/d6c/d83/de4 0 2024-09-17T01:07:21.884 INFO:tasks.workunit.client.0.smithi103.stdout:0/687: readlink dd/df/d38/d55/lad 0 2024-09-17T01:07:21.898 INFO:tasks.workunit.client.0.smithi103.stdout:0/688: dread dd/df/f41 [0,4194304] 0 2024-09-17T01:07:21.899 INFO:tasks.workunit.client.0.smithi103.stdout:0/689: read dd/f15 [4058685,116978] 0 2024-09-17T01:07:21.900 INFO:tasks.workunit.client.0.smithi103.stdout:0/690: fsync dd/df/d38/f33 0 2024-09-17T01:07:21.902 INFO:tasks.workunit.client.0.smithi103.stdout:0/691: symlink dd/df/d68/le5 0 2024-09-17T01:07:21.907 INFO:tasks.workunit.client.0.smithi103.stdout:0/692: dwrite dd/f3b [0,4194304] 0 2024-09-17T01:07:21.909 INFO:tasks.workunit.client.0.smithi103.stdout:0/693: symlink dd/df/d68/d6c/d8e/dca/le6 0 2024-09-17T01:07:21.912 INFO:tasks.workunit.client.0.smithi103.stdout:0/694: mknod dd/df/d38/d62/dbf/ce7 0 2024-09-17T01:07:21.934 INFO:tasks.workunit.client.0.smithi103.stdout:0/695: dread dd/d4f/d64/f79 [0,4194304] 0 2024-09-17T01:07:21.945 INFO:tasks.workunit.client.0.smithi103.stdout:0/696: dwrite dd/df/d68/ddc/f61 [0,4194304] 0 2024-09-17T01:07:21.953 INFO:tasks.workunit.client.0.smithi103.stdout:0/697: rename dd/df/d38/d62/d84/da9 to dd/d1c/d9f/dd6/de8 0 2024-09-17T01:07:21.954 INFO:tasks.workunit.client.0.smithi103.stdout:0/698: chown dd/f77 0 1 2024-09-17T01:07:21.974 INFO:tasks.workunit.client.0.smithi103.stdout:0/699: dread dd/d4f/f2a [0,4194304] 0 2024-09-17T01:07:21.976 INFO:tasks.workunit.client.0.smithi103.stdout:0/700: symlink dd/df/le9 0 2024-09-17T01:07:21.988 INFO:tasks.workunit.client.0.smithi103.stdout:0/701: dread f6 [0,4194304] 0 2024-09-17T01:07:21.990 INFO:tasks.workunit.client.0.smithi103.stdout:0/702: chown c0 320865 1 2024-09-17T01:07:21.991 INFO:tasks.workunit.client.0.smithi103.stdout:0/703: write f3 [4119072,11919] 0 2024-09-17T01:07:21.992 INFO:tasks.workunit.client.0.smithi103.stdout:0/704: stat dd/df/d68/ddc/d93/l9c 0 2024-09-17T01:07:21.992 INFO:tasks.workunit.client.0.smithi103.stdout:0/705: stat dd/df/f13 0 2024-09-17T01:07:21.997 INFO:tasks.workunit.client.0.smithi103.stdout:0/706: link dd/df/c82 dd/d1c/cea 0 2024-09-17T01:07:21.998 INFO:tasks.workunit.client.0.smithi103.stdout:0/707: readlink dd/df/d38/da8/l92 0 2024-09-17T01:07:21.999 INFO:tasks.workunit.client.0.smithi103.stdout:0/708: symlink dd/d1c/d9f/dd6/leb 0 2024-09-17T01:07:22.000 INFO:tasks.workunit.client.0.smithi103.stdout:0/709: write dd/d4f/f48 [3998653,82656] 0 2024-09-17T01:07:22.002 INFO:tasks.workunit.client.0.smithi103.stdout:0/710: dread dd/df/d38/da8/f66 [0,4194304] 0 2024-09-17T01:07:22.003 INFO:tasks.workunit.client.0.smithi103.stdout:0/711: chown dd/d1c/d9f/dd6/de8 11 1 2024-09-17T01:07:22.004 INFO:tasks.workunit.client.0.smithi103.stdout:0/712: chown c2 25343 1 2024-09-17T01:07:22.005 INFO:tasks.workunit.client.0.smithi103.stdout:0/713: dread - dd/f7a zero size 2024-09-17T01:07:22.016 INFO:tasks.workunit.client.0.smithi103.stdout:0/714: dread dd/df/f5f [0,4194304] 0 2024-09-17T01:07:22.017 INFO:tasks.workunit.client.0.smithi103.stdout:0/715: read dd/f42 [4569473,107762] 0 2024-09-17T01:07:22.017 INFO:tasks.workunit.client.0.smithi103.stdout:0/716: chown dd/f77 526969662 1 2024-09-17T01:07:22.021 INFO:tasks.workunit.client.0.smithi103.stdout:0/717: mknod dd/df/d38/d55/dcc/cec 0 2024-09-17T01:07:22.022 INFO:tasks.workunit.client.0.smithi103.stdout:0/718: chown dd/d1c/l2d 351646917 1 2024-09-17T01:07:22.023 INFO:tasks.workunit.client.0.smithi103.stdout:0/719: chown dd/df/d38/d55/fb8 87940092 1 2024-09-17T01:07:22.024 INFO:tasks.workunit.client.0.smithi103.stdout:0/720: read dd/df/f46 [1264894,103482] 0 2024-09-17T01:07:22.025 INFO:tasks.workunit.client.0.smithi103.stdout:0/721: readlink dd/d1c/d9f/da3/ldd 0 2024-09-17T01:07:22.026 INFO:tasks.workunit.client.0.smithi103.stdout:0/722: stat dd/df/d38/d55/fa0 0 2024-09-17T01:07:22.030 INFO:tasks.workunit.client.0.smithi103.stdout:0/723: mknod dd/d43/ced 0 2024-09-17T01:07:22.030 INFO:tasks.workunit.client.0.smithi103.stdout:0/724: dread - dd/d4f/d64/fd5 zero size 2024-09-17T01:07:22.031 INFO:tasks.workunit.client.0.smithi103.stdout:2/730: sync 2024-09-17T01:07:22.031 INFO:tasks.workunit.client.0.smithi103.stdout:1/617: sync 2024-09-17T01:07:22.031 INFO:tasks.workunit.client.0.smithi103.stdout:5/460: sync 2024-09-17T01:07:22.033 INFO:tasks.workunit.client.0.smithi103.stdout:0/725: creat dd/df/d68/fee x:0 0 0 2024-09-17T01:07:22.034 INFO:tasks.workunit.client.0.smithi103.stdout:5/461: write d6/d28/f96 [818681,99361] 0 2024-09-17T01:07:22.039 INFO:tasks.workunit.client.0.smithi103.stdout:5/462: creat d6/d11/d81/fac x:0 0 0 2024-09-17T01:07:22.043 INFO:tasks.workunit.client.0.smithi103.stdout:1/618: creat d2/d1c/d28/fc5 x:0 0 0 2024-09-17T01:07:22.048 INFO:tasks.workunit.client.0.smithi103.stdout:2/731: getdents d6/d5f/d26/d66/df/d68/d7e/d9c/dbb 0 2024-09-17T01:07:22.049 INFO:tasks.workunit.client.0.smithi103.stdout:5/463: write d6/f1e [500654,121442] 0 2024-09-17T01:07:22.050 INFO:tasks.workunit.client.0.smithi103.stdout:0/726: dread f8 [0,4194304] 0 2024-09-17T01:07:22.050 INFO:tasks.workunit.client.0.smithi103.stdout:5/464: readlink d6/db/l79 0 2024-09-17T01:07:22.052 INFO:tasks.workunit.client.0.smithi103.stdout:0/727: mknod dd/d1c/d9f/dbb/cef 0 2024-09-17T01:07:22.053 INFO:tasks.workunit.client.0.smithi103.stdout:0/728: readlink dd/df/d38/l30 0 2024-09-17T01:07:22.053 INFO:tasks.workunit.client.0.smithi103.stdout:1/619: link d2/d1c/d54/f46 d2/de/da0/fc6 0 2024-09-17T01:07:22.054 INFO:tasks.workunit.client.0.smithi103.stdout:5/465: read d6/d2c/d38/d4c/f5b [4054583,16936] 0 2024-09-17T01:07:22.054 INFO:tasks.workunit.client.0.smithi103.stdout:2/732: creat d6/d5f/d26/d66/df/ffc x:0 0 0 2024-09-17T01:07:22.055 INFO:tasks.workunit.client.0.smithi103.stdout:5/466: fsync d6/d2c/f35 0 2024-09-17T01:07:22.055 INFO:tasks.workunit.client.0.smithi103.stdout:0/729: creat dd/df/d68/ddc/d93/ff0 x:0 0 0 2024-09-17T01:07:22.056 INFO:tasks.workunit.client.0.smithi103.stdout:1/620: symlink d2/d16/lc7 0 2024-09-17T01:07:22.057 INFO:tasks.workunit.client.0.smithi103.stdout:2/733: chown d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/cdf 6967 1 2024-09-17T01:07:22.058 INFO:tasks.workunit.client.0.smithi103.stdout:0/730: read dd/d1c/d9f/fb3 [1502787,125302] 0 2024-09-17T01:07:22.058 INFO:tasks.workunit.client.0.smithi103.stdout:5/467: rmdir d6/d2c/d38/d4c/d54 39 2024-09-17T01:07:22.059 INFO:tasks.workunit.client.0.smithi103.stdout:0/731: write fc [3068099,107239] 0 2024-09-17T01:07:22.065 INFO:tasks.workunit.client.0.smithi103.stdout:5/468: chown d6/d2c/d32/d55/f5e 8 1 2024-09-17T01:07:22.069 INFO:tasks.workunit.client.0.smithi103.stdout:1/621: creat d2/d1c/d20/fc8 x:0 0 0 2024-09-17T01:07:22.069 INFO:tasks.workunit.client.0.smithi103.stdout:5/469: chown d6/d11/l41 0 1 2024-09-17T01:07:22.073 INFO:tasks.workunit.client.0.smithi103.stdout:0/732: dwrite dd/df/d38/d62/faf [4194304,4194304] 0 2024-09-17T01:07:22.077 INFO:tasks.workunit.client.0.smithi103.stdout:5/470: mknod d6/d2c/d38/cad 0 2024-09-17T01:07:22.077 INFO:tasks.workunit.client.0.smithi103.stdout:2/734: dwrite d6/d5f/d26/d6e/fb6 [0,4194304] 0 2024-09-17T01:07:22.088 INFO:tasks.workunit.client.0.smithi103.stdout:5/471: write d6/d2c/f5f [219724,98737] 0 2024-09-17T01:07:22.091 INFO:tasks.workunit.client.0.smithi103.stdout:1/622: dwrite d2/d16/f30 [0,4194304] 0 2024-09-17T01:07:22.092 INFO:tasks.workunit.client.0.smithi103.stdout:2/735: dread d6/da/f82 [0,4194304] 0 2024-09-17T01:07:22.093 INFO:tasks.workunit.client.0.smithi103.stdout:1/623: chown d2/d70/dac 15225 1 2024-09-17T01:07:22.096 INFO:tasks.workunit.client.0.smithi103.stdout:0/733: dwrite dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:22.104 INFO:tasks.workunit.client.0.smithi103.stdout:1/624: dread d2/d1c/d20/f2e [0,4194304] 0 2024-09-17T01:07:22.104 INFO:tasks.workunit.client.0.smithi103.stdout:5/472: creat d6/d2c/d38/d4c/d54/fae x:0 0 0 2024-09-17T01:07:22.106 INFO:tasks.workunit.client.0.smithi103.stdout:2/736: dwrite d6/d5f/d26/d66/df/d68/d7e/d9c/fda [0,4194304] 0 2024-09-17T01:07:22.107 INFO:tasks.workunit.client.0.smithi103.stdout:0/734: mknod dd/df/cf1 0 2024-09-17T01:07:22.108 INFO:tasks.workunit.client.0.smithi103.stdout:0/735: chown dd/d1c 57 1 2024-09-17T01:07:22.111 INFO:tasks.workunit.client.0.smithi103.stdout:1/625: chown d2/d1c/d28/d4b/d74/ca2 101032133 1 2024-09-17T01:07:22.113 INFO:tasks.workunit.client.0.smithi103.stdout:0/736: creat dd/d1c/d9f/dbb/ff2 x:0 0 0 2024-09-17T01:07:22.115 INFO:tasks.workunit.client.0.smithi103.stdout:1/626: creat d2/d70/dac/fc9 x:0 0 0 2024-09-17T01:07:22.118 INFO:tasks.workunit.client.0.smithi103.stdout:5/473: creat d6/d2c/d38/d6f/da3/faf x:0 0 0 2024-09-17T01:07:22.119 INFO:tasks.workunit.client.0.smithi103.stdout:5/474: fdatasync d6/d2c/f51 0 2024-09-17T01:07:22.121 INFO:tasks.workunit.client.0.smithi103.stdout:1/627: read d2/d16/f40 [428067,49945] 0 2024-09-17T01:07:22.126 INFO:tasks.workunit.client.0.smithi103.stdout:5/475: dwrite d6/d11/d81/fac [0,4194304] 0 2024-09-17T01:07:22.129 INFO:tasks.workunit.client.0.smithi103.stdout:5/476: readlink d6/d2c/d32/l99 0 2024-09-17T01:07:22.130 INFO:tasks.workunit.client.0.smithi103.stdout:5/477: chown d6/ca 469903 1 2024-09-17T01:07:22.130 INFO:tasks.workunit.client.0.smithi103.stdout:1/628: getdents d2/d7/d4e 0 2024-09-17T01:07:22.133 INFO:tasks.workunit.client.0.smithi103.stdout:5/478: creat d6/d2c/d38/d6f/da3/fb0 x:0 0 0 2024-09-17T01:07:22.136 INFO:tasks.workunit.client.0.smithi103.stdout:1/629: rename d2/d16/d51/d65/d7f/cad to d2/d7/d73/cca 0 2024-09-17T01:07:22.137 INFO:tasks.workunit.client.0.smithi103.stdout:2/737: write d6/da/d5d/d8d/f53 [1647974,85197] 0 2024-09-17T01:07:22.139 INFO:tasks.workunit.client.0.smithi103.stdout:0/737: truncate dd/df/d68/db5/fc2 782920 0 2024-09-17T01:07:22.145 INFO:tasks.workunit.client.0.smithi103.stdout:0/738: rmdir dd/df/d38/d62/d84 39 2024-09-17T01:07:22.148 INFO:tasks.workunit.client.0.smithi103.stdout:2/738: rename d6/d5f/d26/d66/df/d68/d7e/d9c/fa5 to d6/da/d5d/ffd 0 2024-09-17T01:07:22.149 INFO:tasks.workunit.client.0.smithi103.stdout:2/739: truncate d6/d5f/d26/d34/d80/fb2 4337397 0 2024-09-17T01:07:22.150 INFO:tasks.workunit.client.0.smithi103.stdout:5/479: link d6/d2c/d38/da0/fa8 d6/d28/fb1 0 2024-09-17T01:07:22.151 INFO:tasks.workunit.client.0.smithi103.stdout:5/480: fsync d6/d2c/d38/d6f/f9c 0 2024-09-17T01:07:22.152 INFO:tasks.workunit.client.0.smithi103.stdout:0/739: write dd/df/f41 [1860025,47601] 0 2024-09-17T01:07:22.156 INFO:tasks.workunit.client.0.smithi103.stdout:2/740: mkdir d6/da/d28/dfe 0 2024-09-17T01:07:22.160 INFO:tasks.workunit.client.0.smithi103.stdout:2/741: dread - d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/ff3 zero size 2024-09-17T01:07:22.161 INFO:tasks.workunit.client.0.smithi103.stdout:1/630: dwrite d2/d7/f1d [0,4194304] 0 2024-09-17T01:07:22.164 INFO:tasks.workunit.client.0.smithi103.stdout:2/742: dread d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/ff2 [0,4194304] 0 2024-09-17T01:07:22.167 INFO:tasks.workunit.client.0.smithi103.stdout:1/631: truncate d2/d16/f2a 284120 0 2024-09-17T01:07:22.179 INFO:tasks.workunit.client.0.smithi103.stdout:5/481: rename d6/d2c/d38/da0 to d6/d2c/d38/db2 0 2024-09-17T01:07:22.182 INFO:tasks.workunit.client.0.smithi103.stdout:2/743: write d6/da/d5d/d8d/d60/f81 [141843,119408] 0 2024-09-17T01:07:22.183 INFO:tasks.workunit.client.0.smithi103.stdout:1/632: symlink d2/d16/lcb 0 2024-09-17T01:07:22.187 INFO:tasks.workunit.client.0.smithi103.stdout:5/482: mkdir d6/d2c/db3 0 2024-09-17T01:07:22.191 INFO:tasks.workunit.client.0.smithi103.stdout:1/633: creat d2/de/d1f/fcc x:0 0 0 2024-09-17T01:07:22.197 INFO:tasks.workunit.client.0.smithi103.stdout:1/634: mkdir d2/d1c/d20/d6d/dcd 0 2024-09-17T01:07:22.198 INFO:tasks.workunit.client.0.smithi103.stdout:2/744: dread d6/da/d5d/d8d/f51 [0,4194304] 0 2024-09-17T01:07:22.199 INFO:tasks.workunit.client.0.smithi103.stdout:2/745: write d6/d5f/d26/d66/fbc [3584915,61629] 0 2024-09-17T01:07:22.202 INFO:tasks.workunit.client.0.smithi103.stdout:0/740: write dd/df/d68/db5/fc2 [971952,104500] 0 2024-09-17T01:07:22.203 INFO:tasks.workunit.client.0.smithi103.stdout:2/746: write d6/d5f/f1e [1200219,111073] 0 2024-09-17T01:07:22.204 INFO:tasks.workunit.client.0.smithi103.stdout:0/741: chown dd/df/f13 85370 1 2024-09-17T01:07:22.205 INFO:tasks.workunit.client.0.smithi103.stdout:2/747: chown d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/ff3 31520507 1 2024-09-17T01:07:22.206 INFO:tasks.workunit.client.0.smithi103.stdout:5/483: write d6/d2c/d38/d4c/d54/f77 [504412,12735] 0 2024-09-17T01:07:22.212 INFO:tasks.workunit.client.0.smithi103.stdout:2/748: rename d6/da/d3f/cf9 to d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/ded/cff 0 2024-09-17T01:07:22.213 INFO:tasks.workunit.client.0.smithi103.stdout:0/742: dread dd/d43/f53 [0,4194304] 0 2024-09-17T01:07:22.214 INFO:tasks.workunit.client.0.smithi103.stdout:5/484: dwrite d6/f1e [4194304,4194304] 0 2024-09-17T01:07:22.215 INFO:tasks.workunit.client.0.smithi103.stdout:5/485: write d6/d28/f96 [635440,92992] 0 2024-09-17T01:07:22.216 INFO:tasks.workunit.client.0.smithi103.stdout:5/486: stat d6/db/d66/f67 0 2024-09-17T01:07:22.219 INFO:tasks.workunit.client.0.smithi103.stdout:2/749: creat d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/f100 x:0 0 0 2024-09-17T01:07:22.220 INFO:tasks.workunit.client.0.smithi103.stdout:5/487: stat d6/d11/l49 0 2024-09-17T01:07:22.223 INFO:tasks.workunit.client.0.smithi103.stdout:2/750: fdatasync d6/da/d3f/fae 0 2024-09-17T01:07:22.226 INFO:tasks.workunit.client.0.smithi103.stdout:0/743: dwrite f8 [4194304,4194304] 0 2024-09-17T01:07:22.227 INFO:tasks.workunit.client.0.smithi103.stdout:0/744: truncate dd/f3b 4535795 0 2024-09-17T01:07:22.228 INFO:tasks.workunit.client.0.smithi103.stdout:5/488: mkdir d6/d2c/d38/d4c/d71/db4 0 2024-09-17T01:07:22.228 INFO:tasks.workunit.client.0.smithi103.stdout:1/635: dwrite d2/d1c/d20/d6d/f8b [0,4194304] 0 2024-09-17T01:07:22.232 INFO:tasks.workunit.client.0.smithi103.stdout:2/751: dread - d6/d5f/d26/d66/df/d68/d7e/d9c/f67 zero size 2024-09-17T01:07:22.235 INFO:tasks.workunit.client.0.smithi103.stdout:1/636: symlink d2/d1c/lce 0 2024-09-17T01:07:22.237 INFO:tasks.workunit.client.0.smithi103.stdout:0/745: unlink dd/df/d68/d6c/d83/de4/cc4 0 2024-09-17T01:07:22.241 INFO:tasks.workunit.client.0.smithi103.stdout:2/752: creat d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/f101 x:0 0 0 2024-09-17T01:07:22.243 INFO:tasks.workunit.client.0.smithi103.stdout:1/637: mknod d2/d1c/d28/d4b/ccf 0 2024-09-17T01:07:22.244 INFO:tasks.workunit.client.0.smithi103.stdout:0/746: creat dd/d1c/d9f/da3/ff3 x:0 0 0 2024-09-17T01:07:22.246 INFO:tasks.workunit.client.0.smithi103.stdout:5/489: rename d6/d2c/d38/l4d to d6/d2c/db3/lb5 0 2024-09-17T01:07:22.253 INFO:tasks.workunit.client.0.smithi103.stdout:5/490: symlink d6/d2c/lb6 0 2024-09-17T01:07:22.260 INFO:tasks.workunit.client.0.smithi103.stdout:0/747: symlink dd/d1c/lf4 0 2024-09-17T01:07:22.264 INFO:tasks.workunit.client.0.smithi103.stdout:5/491: rename d6/d2c/d38/d4c/l7c to d6/d2c/d38/d4c/d50/lb7 0 2024-09-17T01:07:22.265 INFO:tasks.workunit.client.0.smithi103.stdout:5/492: stat d6/d28/f9f 0 2024-09-17T01:07:22.270 INFO:tasks.workunit.client.0.smithi103.stdout:0/748: creat dd/df/d68/d6c/d8e/dca/ff5 x:0 0 0 2024-09-17T01:07:22.272 INFO:tasks.workunit.client.0.smithi103.stdout:5/493: dwrite d6/d2c/f35 [0,4194304] 0 2024-09-17T01:07:22.273 INFO:tasks.workunit.client.0.smithi103.stdout:1/638: link d2/d7/d73/lab d2/d1c/d20/d6d/dcd/ld0 0 2024-09-17T01:07:22.278 INFO:tasks.workunit.client.0.smithi103.stdout:5/494: creat d6/d2c/d38/d4c/d50/fb8 x:0 0 0 2024-09-17T01:07:22.295 INFO:tasks.workunit.client.0.smithi103.stdout:2/753: write d6/d5f/d26/d66/df/d68/d7e/faa [656497,10967] 0 2024-09-17T01:07:22.297 INFO:tasks.workunit.client.0.smithi103.stdout:2/754: truncate d6/da/d28/fd1 1992379 0 2024-09-17T01:07:22.298 INFO:tasks.workunit.client.0.smithi103.stdout:2/755: readlink d6/d5f/d26/d66/df/lcc 0 2024-09-17T01:07:22.299 INFO:tasks.workunit.client.0.smithi103.stdout:2/756: chown d6/d5f/d26/d66/c1d 31 1 2024-09-17T01:07:22.302 INFO:tasks.workunit.client.0.smithi103.stdout:0/749: write dd/d1c/f28 [1540057,99006] 0 2024-09-17T01:07:22.304 INFO:tasks.workunit.client.0.smithi103.stdout:1/639: write d2/d1c/d20/d33/f91 [183296,86508] 0 2024-09-17T01:07:22.307 INFO:tasks.workunit.client.0.smithi103.stdout:0/750: creat dd/df/d68/d6c/d8e/dca/ff6 x:0 0 0 2024-09-17T01:07:22.311 INFO:tasks.workunit.client.0.smithi103.stdout:5/495: dwrite d6/d2c/d38/d4c/f5b [0,4194304] 0 2024-09-17T01:07:22.311 INFO:tasks.workunit.client.0.smithi103.stdout:0/751: mknod dd/df/d38/da8/cf7 0 2024-09-17T01:07:22.312 INFO:tasks.workunit.client.0.smithi103.stdout:5/496: stat d6 0 2024-09-17T01:07:22.312 INFO:tasks.workunit.client.0.smithi103.stdout:0/752: chown l7 100 1 2024-09-17T01:07:22.314 INFO:tasks.workunit.client.0.smithi103.stdout:5/497: symlink d6/d11/d81/da2/lb9 0 2024-09-17T01:07:22.315 INFO:tasks.workunit.client.0.smithi103.stdout:7/660: sync 2024-09-17T01:07:22.315 INFO:tasks.workunit.client.0.smithi103.stdout:0/753: creat dd/d1c/d9f/dd6/de8/ff8 x:0 0 0 2024-09-17T01:07:22.323 INFO:tasks.workunit.client.0.smithi103.stdout:7/661: mknod d4/d10/d6b/dc5/ce4 0 2024-09-17T01:07:22.323 INFO:tasks.workunit.client.0.smithi103.stdout:2/757: dwrite d6/d5f/f9b [0,4194304] 0 2024-09-17T01:07:22.329 INFO:tasks.workunit.client.0.smithi103.stdout:1/640: dwrite d2/d7/d4e/fb4 [0,4194304] 0 2024-09-17T01:07:22.341 INFO:tasks.workunit.client.0.smithi103.stdout:5/498: dread d6/d2c/d38/d4c/d50/f8c [0,4194304] 0 2024-09-17T01:07:22.346 INFO:tasks.workunit.client.0.smithi103.stdout:5/499: dread d6/d11/d81/fac [0,4194304] 0 2024-09-17T01:07:22.346 INFO:tasks.workunit.client.0.smithi103.stdout:5/500: fsync d6/d11/f1d 0 2024-09-17T01:07:22.397 INFO:tasks.workunit.client.0.smithi103.stdout:7/662: mknod d4/d10/d6b/d9f/ce5 0 2024-09-17T01:07:22.398 INFO:tasks.workunit.client.0.smithi103.stdout:7/663: chown d4/d10/d6b/dc5/d8d/d92/l97 57 1 2024-09-17T01:07:22.400 INFO:tasks.workunit.client.0.smithi103.stdout:7/664: write d4/d4a/d4b/d9d/fb6 [888273,43321] 0 2024-09-17T01:07:22.401 INFO:tasks.workunit.client.0.smithi103.stdout:7/665: fdatasync d4/d10/d6b/dc5/d8d/fbc 0 2024-09-17T01:07:22.403 INFO:tasks.workunit.client.0.smithi103.stdout:2/758: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/db4/c102 0 2024-09-17T01:07:22.412 INFO:tasks.workunit.client.0.smithi103.stdout:5/501: mkdir d6/d2c/d38/db2/dba 0 2024-09-17T01:07:22.421 INFO:tasks.workunit.client.0.smithi103.stdout:1/641: fsync d2/f8 0 2024-09-17T01:07:22.424 INFO:tasks.workunit.client.0.smithi103.stdout:5/502: creat d6/d2c/db3/fbb x:0 0 0 2024-09-17T01:07:22.437 INFO:tasks.workunit.client.0.smithi103.stdout:5/503: symlink d6/d11/lbc 0 2024-09-17T01:07:22.439 INFO:tasks.workunit.client.0.smithi103.stdout:1/642: dwrite d2/de/f1b [0,4194304] 0 2024-09-17T01:07:22.440 INFO:tasks.workunit.client.0.smithi103.stdout:2/759: getdents d6/da/d5d/d8d/d60 0 2024-09-17T01:07:22.442 INFO:tasks.workunit.client.0.smithi103.stdout:2/760: dread - d6/d5f/d26/d34/d80/fc5 zero size 2024-09-17T01:07:22.445 INFO:tasks.workunit.client.0.smithi103.stdout:1/643: dread d2/d1c/d20/d6d/f8b [0,4194304] 0 2024-09-17T01:07:22.447 INFO:tasks.workunit.client.0.smithi103.stdout:5/504: unlink d6/d2c/d38/d4c/ca1 0 2024-09-17T01:07:22.453 INFO:tasks.workunit.client.0.smithi103.stdout:1/644: symlink d2/d70/dac/ld1 0 2024-09-17T01:07:22.454 INFO:tasks.workunit.client.0.smithi103.stdout:5/505: dwrite d6/db/fd [0,4194304] 0 2024-09-17T01:07:22.468 INFO:tasks.workunit.client.0.smithi103.stdout:1/645: mkdir d2/d70/dac/dd2 0 2024-09-17T01:07:22.469 INFO:tasks.workunit.client.0.smithi103.stdout:1/646: chown d2/de/f58 12667 1 2024-09-17T01:07:22.476 INFO:tasks.workunit.client.0.smithi103.stdout:1/647: dwrite d2/d7/d4e/fb4 [0,4194304] 0 2024-09-17T01:07:22.480 INFO:tasks.workunit.client.0.smithi103.stdout:5/506: getdents d6/d2c 0 2024-09-17T01:07:22.480 INFO:tasks.workunit.client.0.smithi103.stdout:1/648: fsync d2/d16/f30 0 2024-09-17T01:07:22.485 INFO:tasks.workunit.client.0.smithi103.stdout:1/649: fsync d2/f1a 0 2024-09-17T01:07:22.486 INFO:tasks.workunit.client.0.smithi103.stdout:1/650: readlink d2/d16/lc7 0 2024-09-17T01:07:22.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/651: mknod d2/d7/d73/cd3 0 2024-09-17T01:07:22.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/652: stat d2/d7/l9 0 2024-09-17T01:07:22.491 INFO:tasks.workunit.client.0.smithi103.stdout:1/653: truncate d2/d1c/d28/fc5 732618 0 2024-09-17T01:07:22.532 INFO:tasks.workunit.client.0.smithi103.stdout:7/666: truncate d4/d10/d6b/dc5/fbb 395976 0 2024-09-17T01:07:22.538 INFO:tasks.workunit.client.0.smithi103.stdout:7/667: write d4/d10/d6b/dc5/d36/d3a/f6e [2126005,69467] 0 2024-09-17T01:07:22.545 INFO:tasks.workunit.client.0.smithi103.stdout:7/668: link d4/d4a/f79 d4/d4a/d4b/d9d/fe6 0 2024-09-17T01:07:22.549 INFO:tasks.workunit.client.0.smithi103.stdout:7/669: rmdir d4/d4a/de0 0 2024-09-17T01:07:22.553 INFO:tasks.workunit.client.0.smithi103.stdout:4/695: sync 2024-09-17T01:07:22.553 INFO:tasks.workunit.client.0.smithi103.stdout:8/541: sync 2024-09-17T01:07:22.553 INFO:tasks.workunit.client.0.smithi103.stdout:9/602: sync 2024-09-17T01:07:22.553 INFO:tasks.workunit.client.0.smithi103.stdout:3/776: sync 2024-09-17T01:07:22.553 INFO:tasks.workunit.client.0.smithi103.stdout:6/614: sync 2024-09-17T01:07:22.554 INFO:tasks.workunit.client.0.smithi103.stdout:6/615: readlink d3/d25/d74/la8 0 2024-09-17T01:07:22.558 INFO:tasks.workunit.client.0.smithi103.stdout:9/603: symlink d7/d43/d5f/ld1 0 2024-09-17T01:07:22.561 INFO:tasks.workunit.client.0.smithi103.stdout:6/616: fsync d3/f18 0 2024-09-17T01:07:22.563 INFO:tasks.workunit.client.0.smithi103.stdout:3/777: fdatasync d3/d16/d1b/d3c/d65/d75/dbe/ff6 0 2024-09-17T01:07:22.566 INFO:tasks.workunit.client.0.smithi103.stdout:4/696: dwrite d9/d10/d6e/fcb [0,4194304] 0 2024-09-17T01:07:22.567 INFO:tasks.workunit.client.0.smithi103.stdout:4/697: chown d9/d16/d70/lc4 14354 1 2024-09-17T01:07:22.571 INFO:tasks.workunit.client.0.smithi103.stdout:7/670: dread d4/d4a/d4b/d9d/fe6 [0,4194304] 0 2024-09-17T01:07:22.572 INFO:tasks.workunit.client.0.smithi103.stdout:6/617: mkdir d3/d16/d33/d57/d63/dd2 0 2024-09-17T01:07:22.572 INFO:tasks.workunit.client.0.smithi103.stdout:4/698: chown d9/d10/l17 2447 1 2024-09-17T01:07:22.574 INFO:tasks.workunit.client.0.smithi103.stdout:7/671: chown d4/d10/d6b/dc5/d8d/d92/db3/dd0 668010 1 2024-09-17T01:07:22.575 INFO:tasks.workunit.client.0.smithi103.stdout:3/778: getdents d3/dd7 0 2024-09-17T01:07:22.576 INFO:tasks.workunit.client.0.smithi103.stdout:4/699: unlink d9/d16/d23/d32/d4c/l88 0 2024-09-17T01:07:22.581 INFO:tasks.workunit.client.0.smithi103.stdout:5/507: rename d6/f3e to d6/d2c/d38/d6f/fbd 0 2024-09-17T01:07:22.583 INFO:tasks.workunit.client.0.smithi103.stdout:6/618: rename d3/d25 to d3/d25/dae/dd3 22 2024-09-17T01:07:22.583 INFO:tasks.workunit.client.0.smithi103.stdout:2/761: mknod d6/d5f/d26/d66/c103 0 2024-09-17T01:07:22.584 INFO:tasks.workunit.client.0.smithi103.stdout:9/604: dread d7/d43/d88/f16 [0,4194304] 0 2024-09-17T01:07:22.584 INFO:tasks.workunit.client.0.smithi103.stdout:4/700: creat d9/d16/d38/fd9 x:0 0 0 2024-09-17T01:07:22.585 INFO:tasks.workunit.client.0.smithi103.stdout:7/672: dwrite d4/d10/d6b/dc5/d36/d3a/d51/d5e/f75 [0,4194304] 0 2024-09-17T01:07:22.586 INFO:tasks.workunit.client.0.smithi103.stdout:5/508: readlink d6/db/lc 0 2024-09-17T01:07:22.588 INFO:tasks.workunit.client.0.smithi103.stdout:5/509: dread - d6/f8b zero size 2024-09-17T01:07:22.588 INFO:tasks.workunit.client.0.smithi103.stdout:6/619: dread - d3/d16/fbc zero size 2024-09-17T01:07:22.592 INFO:tasks.workunit.client.0.smithi103.stdout:7/673: rmdir d4/d10/d6b/dc5/d8d/d92 39 2024-09-17T01:07:22.592 INFO:tasks.workunit.client.0.smithi103.stdout:2/762: read d6/d5f/d26/d66/df/d68/d7e/d8b/fc3 [3828652,111707] 0 2024-09-17T01:07:22.595 INFO:tasks.workunit.client.0.smithi103.stdout:2/763: chown d6/d5f/d26/d34/d80/fa0 1840 1 2024-09-17T01:07:22.596 INFO:tasks.workunit.client.0.smithi103.stdout:9/605: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/fd2 x:0 0 0 2024-09-17T01:07:22.599 INFO:tasks.workunit.client.0.smithi103.stdout:6/620: creat d3/d16/d33/d57/d63/d60/fd4 x:0 0 0 2024-09-17T01:07:22.604 INFO:tasks.workunit.client.0.smithi103.stdout:2/764: dwrite d6/da/f8c [0,4194304] 0 2024-09-17T01:07:22.606 INFO:tasks.workunit.client.0.smithi103.stdout:7/674: stat d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/f7c 0 2024-09-17T01:07:22.606 INFO:tasks.workunit.client.0.smithi103.stdout:7/675: chown d4/d10/d32 17145137 1 2024-09-17T01:07:22.607 INFO:tasks.workunit.client.0.smithi103.stdout:7/676: truncate d4/d10/d37/d95/fdc 889768 0 2024-09-17T01:07:22.730 INFO:tasks.workunit.client.0.smithi103.stdout:6/621: creat d3/d25/dae/fd5 x:0 0 0 2024-09-17T01:07:22.731 INFO:tasks.workunit.client.0.smithi103.stdout:8/542: write d0/d6/dc/d30/f1f [3244876,98667] 0 2024-09-17T01:07:22.733 INFO:tasks.workunit.client.0.smithi103.stdout:2/765: mkdir d6/da/d5d/d8d/d60/d104 0 2024-09-17T01:07:22.734 INFO:tasks.workunit.client.0.smithi103.stdout:7/677: mkdir d4/d10/d66/dd2/de7 0 2024-09-17T01:07:22.736 INFO:tasks.workunit.client.0.smithi103.stdout:5/510: getdents d6/d2c/d38/d4c/d54 0 2024-09-17T01:07:22.738 INFO:tasks.workunit.client.0.smithi103.stdout:2/766: mknod d6/da/d5d/d8d/d89/c105 0 2024-09-17T01:07:22.741 INFO:tasks.workunit.client.0.smithi103.stdout:6/622: dread d3/d16/d33/d57/f5a [0,4194304] 0 2024-09-17T01:07:22.742 INFO:tasks.workunit.client.0.smithi103.stdout:8/543: rename d0/d6/dc/d30/d25/d64/d34/c69 to d0/d6/dc/d30/d25/ca8 0 2024-09-17T01:07:22.744 INFO:tasks.workunit.client.0.smithi103.stdout:7/678: dwrite d4/d10/d37/fcb [0,4194304] 0 2024-09-17T01:07:22.749 INFO:tasks.workunit.client.0.smithi103.stdout:6/623: creat d3/d16/d33/d3e/d58/d82/fd6 x:0 0 0 2024-09-17T01:07:22.750 INFO:tasks.workunit.client.0.smithi103.stdout:4/701: write d9/d16/d23/d2a/f5c [204939,43881] 0 2024-09-17T01:07:22.754 INFO:tasks.workunit.client.0.smithi103.stdout:8/544: symlink d0/d6/dc/d30/d25/d64/d34/d6e/la9 0 2024-09-17T01:07:22.755 INFO:tasks.workunit.client.0.smithi103.stdout:9/606: write d7/db8/dbb/f89 [5111996,115767] 0 2024-09-17T01:07:22.757 INFO:tasks.workunit.client.0.smithi103.stdout:3/779: dwrite d3/d16/d1b/f80 [4194304,4194304] 0 2024-09-17T01:07:22.763 INFO:tasks.workunit.client.0.smithi103.stdout:6/624: symlink d3/d16/d33/d3e/ld7 0 2024-09-17T01:07:22.764 INFO:tasks.workunit.client.0.smithi103.stdout:4/702: symlink d9/d16/d23/d32/d4c/lda 0 2024-09-17T01:07:22.765 INFO:tasks.workunit.client.0.smithi103.stdout:3/780: dread d3/d16/d1b/d3c/d65/d75/d9c/fa8 [0,4194304] 0 2024-09-17T01:07:22.774 INFO:tasks.workunit.client.0.smithi103.stdout:7/679: truncate d4/d10/d6b/dc5/d36/d3a/f6e 1775591 0 2024-09-17T01:07:22.776 INFO:tasks.workunit.client.0.smithi103.stdout:4/703: rmdir d9/d16/d23/d52 39 2024-09-17T01:07:22.777 INFO:tasks.workunit.client.0.smithi103.stdout:3/781: dwrite d3/d16/fcb [0,4194304] 0 2024-09-17T01:07:22.779 INFO:tasks.workunit.client.0.smithi103.stdout:5/511: dwrite d6/d2c/d38/d4c/d50/f21 [0,4194304] 0 2024-09-17T01:07:22.781 INFO:tasks.workunit.client.0.smithi103.stdout:3/782: chown d3/d16/d1b/d3c/d65/d83/cb6 2388073 1 2024-09-17T01:07:22.783 INFO:tasks.workunit.client.0.smithi103.stdout:8/545: rename d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/ca7 to d0/d6/dc/d30/d25/d64/d34/d6e/d72/caa 0 2024-09-17T01:07:22.786 INFO:tasks.workunit.client.0.smithi103.stdout:8/546: chown d0/d6/dc/d30/d2d/c78 975 1 2024-09-17T01:07:22.792 INFO:tasks.workunit.client.0.smithi103.stdout:6/625: mknod d3/d16/d33/cd8 0 2024-09-17T01:07:22.794 INFO:tasks.workunit.client.0.smithi103.stdout:3/783: creat d3/d16/d1b/d3c/d65/d7e/dac/f10c x:0 0 0 2024-09-17T01:07:22.795 INFO:tasks.workunit.client.0.smithi103.stdout:9/607: dwrite d7/d2d/f37 [0,4194304] 0 2024-09-17T01:07:22.796 INFO:tasks.workunit.client.0.smithi103.stdout:4/704: dwrite d9/d10/fcc [0,4194304] 0 2024-09-17T01:07:22.802 INFO:tasks.workunit.client.0.smithi103.stdout:2/767: link d6/da/d5d/d8d/d60/d75/l37 d6/d5f/d26/d66/df/d68/d7e/l106 0 2024-09-17T01:07:22.807 INFO:tasks.workunit.client.0.smithi103.stdout:2/768: readlink d6/d5f/d26/d66/df/lfa 0 2024-09-17T01:07:22.811 INFO:tasks.workunit.client.0.smithi103.stdout:9/608: dread d7/d43/d88/d11/fba [0,4194304] 0 2024-09-17T01:07:22.813 INFO:tasks.workunit.client.0.smithi103.stdout:2/769: dread - d6/da/d5d/d8d/d60/d75/d70/f94 zero size 2024-09-17T01:07:22.815 INFO:tasks.workunit.client.0.smithi103.stdout:7/680: write d4/d4a/d4b/d8a/fab [4401107,20474] 0 2024-09-17T01:07:22.821 INFO:tasks.workunit.client.0.smithi103.stdout:2/770: write d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/f87 [4728637,107485] 0 2024-09-17T01:07:22.823 INFO:tasks.workunit.client.0.smithi103.stdout:3/784: write d3/d44/f4a [1826874,34623] 0 2024-09-17T01:07:22.827 INFO:tasks.workunit.client.0.smithi103.stdout:5/512: dread d6/db/f34 [0,4194304] 0 2024-09-17T01:07:22.828 INFO:tasks.workunit.client.0.smithi103.stdout:9/609: write d7/d43/d5f/d7d/d80/d93/f94 [4243942,13577] 0 2024-09-17T01:07:22.830 INFO:tasks.workunit.client.0.smithi103.stdout:7/681: unlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/f7c 0 2024-09-17T01:07:22.833 INFO:tasks.workunit.client.0.smithi103.stdout:2/771: rmdir d6/d5f/d26/d66/df/d68/d7e/d9c/d6f 39 2024-09-17T01:07:22.837 INFO:tasks.workunit.client.0.smithi103.stdout:4/705: dread d9/d16/d23/f97 [0,4194304] 0 2024-09-17T01:07:22.838 INFO:tasks.workunit.client.0.smithi103.stdout:6/626: getdents d3/d16/d33/d57/d63 0 2024-09-17T01:07:22.841 INFO:tasks.workunit.client.0.smithi103.stdout:7/682: symlink d4/d11/d80/le8 0 2024-09-17T01:07:22.849 INFO:tasks.workunit.client.0.smithi103.stdout:4/706: creat d9/d16/d23/d32/d64/fdb x:0 0 0 2024-09-17T01:07:22.859 INFO:tasks.workunit.client.0.smithi103.stdout:5/513: truncate d6/d2c/d32/f33 2298721 0 2024-09-17T01:07:22.861 INFO:tasks.workunit.client.0.smithi103.stdout:3/785: dwrite d3/d16/d1b/d3c/d65/d7e/dac/dce/fb9 [0,4194304] 0 2024-09-17T01:07:22.862 INFO:tasks.workunit.client.0.smithi103.stdout:9/610: dwrite d7/d43/d5f/d7d/d80/d93/faa [0,4194304] 0 2024-09-17T01:07:22.869 INFO:tasks.workunit.client.0.smithi103.stdout:6/627: dwrite d3/d16/d21/d50/fb8 [0,4194304] 0 2024-09-17T01:07:22.872 INFO:tasks.workunit.client.0.smithi103.stdout:2/772: dread d6/fb [0,4194304] 0 2024-09-17T01:07:22.874 INFO:tasks.workunit.client.0.smithi103.stdout:7/683: mkdir d4/d11/d34/db5/de9 0 2024-09-17T01:07:22.876 INFO:tasks.workunit.client.0.smithi103.stdout:3/786: truncate d3/fb0 1026496 0 2024-09-17T01:07:22.877 INFO:tasks.workunit.client.0.smithi103.stdout:4/707: read d9/d16/d23/d32/f98 [678801,32805] 0 2024-09-17T01:07:22.878 INFO:tasks.workunit.client.0.smithi103.stdout:7/684: write d4/d10/d6b/d72/db8/fd6 [995989,48379] 0 2024-09-17T01:07:22.880 INFO:tasks.workunit.client.0.smithi103.stdout:5/514: dwrite d6/f8b [0,4194304] 0 2024-09-17T01:07:22.882 INFO:tasks.workunit.client.0.smithi103.stdout:6/628: creat d3/d16/d33/d3e/d58/fd9 x:0 0 0 2024-09-17T01:07:22.885 INFO:tasks.workunit.client.0.smithi103.stdout:9/611: creat d7/d43/d88/d11/d20/d4f/fd3 x:0 0 0 2024-09-17T01:07:22.888 INFO:tasks.workunit.client.0.smithi103.stdout:3/787: truncate d3/d16/d1b/f91 1155424 0 2024-09-17T01:07:22.888 INFO:tasks.workunit.client.0.smithi103.stdout:7/685: creat d4/d10/d43/fea x:0 0 0 2024-09-17T01:07:22.890 INFO:tasks.workunit.client.0.smithi103.stdout:6/629: rename d3/d16/d33/d3e/d58/laa to d3/d16/dad/d2f/lda 0 2024-09-17T01:07:22.892 INFO:tasks.workunit.client.0.smithi103.stdout:2/773: truncate d6/d5f/d26/d66/df/f6b 2037946 0 2024-09-17T01:07:22.893 INFO:tasks.workunit.client.0.smithi103.stdout:3/788: chown d3/d16/d1b/d3c/d65/f9b 3015844 1 2024-09-17T01:07:22.894 INFO:tasks.workunit.client.0.smithi103.stdout:7/686: unlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/fa7 0 2024-09-17T01:07:22.895 INFO:tasks.workunit.client.0.smithi103.stdout:9/612: dwrite d7/db8/dbb/f89 [4194304,4194304] 0 2024-09-17T01:07:22.901 INFO:tasks.workunit.client.0.smithi103.stdout:3/789: mkdir d3/d16/d1b/d3c/d65/d7c/d10d 0 2024-09-17T01:07:22.903 INFO:tasks.workunit.client.0.smithi103.stdout:2/774: truncate d6/da/d5d/d8d/fba 4282874 0 2024-09-17T01:07:22.903 INFO:tasks.workunit.client.0.smithi103.stdout:9/613: dread d7/d43/d88/f38 [0,4194304] 0 2024-09-17T01:07:22.904 INFO:tasks.workunit.client.0.smithi103.stdout:3/790: creat d3/d16/d1b/d36/f10e x:0 0 0 2024-09-17T01:07:22.907 INFO:tasks.workunit.client.0.smithi103.stdout:6/630: creat d3/d16/d33/d3e/fdb x:0 0 0 2024-09-17T01:07:22.914 INFO:tasks.workunit.client.0.smithi103.stdout:6/631: truncate d3/d25/d74/f8e 4668839 0 2024-09-17T01:07:22.915 INFO:tasks.workunit.client.0.smithi103.stdout:2/775: mknod d6/da/d5d/d8d/d60/d75/d70/df6/c107 0 2024-09-17T01:07:22.918 INFO:tasks.workunit.client.0.smithi103.stdout:2/776: stat d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4 0 2024-09-17T01:07:22.921 INFO:tasks.workunit.client.0.smithi103.stdout:2/777: write d6/da/d5d/d8d/d60/fa2 [2530154,81688] 0 2024-09-17T01:07:22.923 INFO:tasks.workunit.client.0.smithi103.stdout:2/778: write d6/da/f64 [2998320,65620] 0 2024-09-17T01:07:22.924 INFO:tasks.workunit.client.0.smithi103.stdout:4/708: write d9/dc/df/f72 [1932078,56763] 0 2024-09-17T01:07:22.925 INFO:tasks.workunit.client.0.smithi103.stdout:4/709: chown f3 69 1 2024-09-17T01:07:22.927 INFO:tasks.workunit.client.0.smithi103.stdout:2/779: dread d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/ff2 [0,4194304] 0 2024-09-17T01:07:22.931 INFO:tasks.workunit.client.0.smithi103.stdout:3/791: dread d3/d16/fca [0,4194304] 0 2024-09-17T01:07:22.934 INFO:tasks.workunit.client.0.smithi103.stdout:3/792: dread - d3/d16/d1b/d3c/d65/d75/dbe/d34/f107 zero size 2024-09-17T01:07:22.936 INFO:tasks.workunit.client.0.smithi103.stdout:2/780: dread d6/d5f/d26/d66/df/d68/d7e/d8b/fd5 [0,4194304] 0 2024-09-17T01:07:22.938 INFO:tasks.workunit.client.0.smithi103.stdout:4/710: dwrite d9/d16/d23/d52/d91/dd4/f39 [0,4194304] 0 2024-09-17T01:07:22.940 INFO:tasks.workunit.client.0.smithi103.stdout:3/793: truncate d3/d16/d1b/d3c/f60 4302210 0 2024-09-17T01:07:22.941 INFO:tasks.workunit.client.0.smithi103.stdout:6/632: write d3/d25/d26/f2e [2872058,61285] 0 2024-09-17T01:07:22.944 INFO:tasks.workunit.client.0.smithi103.stdout:9/614: dwrite d7/db8/dbb/f69 [4194304,4194304] 0 2024-09-17T01:07:22.945 INFO:tasks.workunit.client.0.smithi103.stdout:4/711: rmdir d9/d16/d23/d2a 39 2024-09-17T01:07:22.952 INFO:tasks.workunit.client.0.smithi103.stdout:4/712: write d9/d16/d23/d32/d61/f87 [2603860,15474] 0 2024-09-17T01:07:22.953 INFO:tasks.workunit.client.0.smithi103.stdout:4/713: chown d9/d16/d45/d76/fc1 162989315 1 2024-09-17T01:07:22.954 INFO:tasks.workunit.client.0.smithi103.stdout:3/794: symlink d3/d16/d1b/d86/l10f 0 2024-09-17T01:07:22.955 INFO:tasks.workunit.client.0.smithi103.stdout:6/633: symlink d3/d16/dad/d2f/dc1/dc3/ldc 0 2024-09-17T01:07:22.956 INFO:tasks.workunit.client.0.smithi103.stdout:9/615: symlink d7/d43/d88/d11/d20/d4f/d95/d9a/dc0/ld4 0 2024-09-17T01:07:22.959 INFO:tasks.workunit.client.0.smithi103.stdout:6/634: dread - d3/d16/d21/f39 zero size 2024-09-17T01:07:22.961 INFO:tasks.workunit.client.0.smithi103.stdout:3/795: fdatasync d3/fb0 0 2024-09-17T01:07:22.962 INFO:tasks.workunit.client.0.smithi103.stdout:4/714: dwrite d9/d16/d23/d32/d4c/f92 [0,4194304] 0 2024-09-17T01:07:22.965 INFO:tasks.workunit.client.0.smithi103.stdout:9/616: creat d7/d43/d88/d11/d5c/fd5 x:0 0 0 2024-09-17T01:07:22.965 INFO:tasks.workunit.client.0.smithi103.stdout:3/796: read d3/d16/d1b/d3c/d65/d75/d9c/dd3/fe4 [459167,2734] 0 2024-09-17T01:07:22.969 INFO:tasks.workunit.client.0.smithi103.stdout:6/635: dread d3/f64 [0,4194304] 0 2024-09-17T01:07:22.970 INFO:tasks.workunit.client.0.smithi103.stdout:6/636: readlink d3/l68 0 2024-09-17T01:07:22.973 INFO:tasks.workunit.client.0.smithi103.stdout:3/797: rename d3/d16/d1b/d3c/d65/d75/fb3 to d3/d16/d1b/d36/f110 0 2024-09-17T01:07:22.975 INFO:tasks.workunit.client.0.smithi103.stdout:9/617: dwrite d7/d2d/d59/f68 [0,4194304] 0 2024-09-17T01:07:22.978 INFO:tasks.workunit.client.0.smithi103.stdout:6/637: symlink d3/d25/ldd 0 2024-09-17T01:07:22.981 INFO:tasks.workunit.client.0.smithi103.stdout:4/715: link d9/d16/d23/d32/d61/f95 d9/d16/d23/d52/d91/dd4/fdc 0 2024-09-17T01:07:22.982 INFO:tasks.workunit.client.0.smithi103.stdout:6/638: unlink d3/d16/d33/d3e/f85 0 2024-09-17T01:07:22.984 INFO:tasks.workunit.client.0.smithi103.stdout:3/798: getdents d3/d16/d90 0 2024-09-17T01:07:22.985 INFO:tasks.workunit.client.0.smithi103.stdout:6/639: symlink d3/d16/d33/d57/d63/lde 0 2024-09-17T01:07:22.986 INFO:tasks.workunit.client.0.smithi103.stdout:9/618: getdents d7/d43/d88/d11/d20/d4f/d95 0 2024-09-17T01:07:22.987 INFO:tasks.workunit.client.0.smithi103.stdout:9/619: chown d7/d43/d88/d11/d5c/c9f 3 1 2024-09-17T01:07:22.988 INFO:tasks.workunit.client.0.smithi103.stdout:3/799: unlink d3/d16/d1b/d3c/d65/d75/dbe/ff6 0 2024-09-17T01:07:22.989 INFO:tasks.workunit.client.0.smithi103.stdout:6/640: mknod d3/d25/d74/cdf 0 2024-09-17T01:07:22.990 INFO:tasks.workunit.client.0.smithi103.stdout:3/800: write d3/d16/d1b/d3c/d65/d7e/dac/f10c [898046,18240] 0 2024-09-17T01:07:22.995 INFO:tasks.workunit.client.0.smithi103.stdout:3/801: symlink d3/d16/d1b/d86/l111 0 2024-09-17T01:07:22.996 INFO:tasks.workunit.client.0.smithi103.stdout:3/802: chown d3/f73 786764879 1 2024-09-17T01:07:22.996 INFO:tasks.workunit.client.0.smithi103.stdout:4/716: getdents d9/d16/d23/d2a 0 2024-09-17T01:07:23.000 INFO:tasks.workunit.client.0.smithi103.stdout:3/803: unlink d3/d16/d1b/d3c/d65/f8f 0 2024-09-17T01:07:23.005 INFO:tasks.workunit.client.0.smithi103.stdout:3/804: dwrite d3/ff9 [0,4194304] 0 2024-09-17T01:07:23.017 INFO:tasks.workunit.client.0.smithi103.stdout:9/620: dwrite d7/d43/d88/d11/f12 [0,4194304] 0 2024-09-17T01:07:23.020 INFO:tasks.workunit.client.0.smithi103.stdout:6/641: dwrite d3/d16/d33/d3e/f98 [0,4194304] 0 2024-09-17T01:07:23.021 INFO:tasks.workunit.client.0.smithi103.stdout:9/621: dread - d7/d43/d5f/fb7 zero size 2024-09-17T01:07:23.023 INFO:tasks.workunit.client.0.smithi103.stdout:3/805: truncate d3/d16/d90/fc0 2901906 0 2024-09-17T01:07:23.026 INFO:tasks.workunit.client.0.smithi103.stdout:9/622: truncate d7/db8/dbb/f26 1291688 0 2024-09-17T01:07:23.028 INFO:tasks.workunit.client.0.smithi103.stdout:9/623: write d7/d43/d88/d11/d20/d4f/f76 [71934,58948] 0 2024-09-17T01:07:23.028 INFO:tasks.workunit.client.0.smithi103.stdout:6/642: rename d3/d25/f29 to d3/d16/dad/fe0 0 2024-09-17T01:07:23.029 INFO:tasks.workunit.client.0.smithi103.stdout:9/624: stat d7/d2d/d59/f66 0 2024-09-17T01:07:23.033 INFO:tasks.workunit.client.0.smithi103.stdout:9/625: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/db1/fd6 x:0 0 0 2024-09-17T01:07:23.034 INFO:tasks.workunit.client.0.smithi103.stdout:3/806: rename d3/d16/d1b/d3c/c32 to d3/d16/d1b/d3c/d65/d75/d9c/dd3/c112 0 2024-09-17T01:07:23.035 INFO:tasks.workunit.client.0.smithi103.stdout:9/626: readlink d7/db8/dbb/l90 0 2024-09-17T01:07:23.041 INFO:tasks.workunit.client.0.smithi103.stdout:3/807: dwrite d3/d16/d1b/d3c/f60 [0,4194304] 0 2024-09-17T01:07:23.052 INFO:tasks.workunit.client.0.smithi103.stdout:3/808: write d3/fb0 [1611172,124203] 0 2024-09-17T01:07:23.054 INFO:tasks.workunit.client.0.smithi103.stdout:3/809: mknod d3/d16/d1b/d3c/d65/d75/dd1/c113 0 2024-09-17T01:07:23.056 INFO:tasks.workunit.client.0.smithi103.stdout:1/654: sync 2024-09-17T01:07:23.056 INFO:tasks.workunit.client.0.smithi103.stdout:0/754: sync 2024-09-17T01:07:23.058 INFO:tasks.workunit.client.0.smithi103.stdout:6/643: dread d3/d16/f1f [0,4194304] 0 2024-09-17T01:07:23.059 INFO:tasks.workunit.client.0.smithi103.stdout:6/644: readlink d3/d16/dad/d2f/lac 0 2024-09-17T01:07:23.060 INFO:tasks.workunit.client.0.smithi103.stdout:6/645: stat d3/d16/dad/d2f/f79 0 2024-09-17T01:07:23.061 INFO:tasks.workunit.client.0.smithi103.stdout:6/646: stat d3/d16/d33/d3e/d4b/l77 0 2024-09-17T01:07:23.061 INFO:tasks.workunit.client.0.smithi103.stdout:0/755: mknod dd/d1c/d9f/dbb/cf9 0 2024-09-17T01:07:23.063 INFO:tasks.workunit.client.0.smithi103.stdout:9/627: dread d7/f3b [0,4194304] 0 2024-09-17T01:07:23.066 INFO:tasks.workunit.client.0.smithi103.stdout:1/655: rename d2/d16/d51/d65/f71 to d2/d1c/d20/d6d/d8d/fd4 0 2024-09-17T01:07:23.067 INFO:tasks.workunit.client.0.smithi103.stdout:0/756: creat dd/df/d68/ddc/ffa x:0 0 0 2024-09-17T01:07:23.068 INFO:tasks.workunit.client.0.smithi103.stdout:6/647: truncate d3/d16/dad/d2f/fa0 540656 0 2024-09-17T01:07:23.069 INFO:tasks.workunit.client.0.smithi103.stdout:6/648: chown d3/d16/dad/f67 26989 1 2024-09-17T01:07:23.070 INFO:tasks.workunit.client.0.smithi103.stdout:3/810: dread d3/d16/d1b/d3c/d97/fe0 [4194304,4194304] 0 2024-09-17T01:07:23.071 INFO:tasks.workunit.client.0.smithi103.stdout:9/628: mknod d7/d43/d88/d11/d20/d4f/d95/d9a/cd7 0 2024-09-17T01:07:23.074 INFO:tasks.workunit.client.0.smithi103.stdout:3/811: read d3/d16/d1b/d3c/d65/d7e/dac/dce/f72 [789710,60584] 0 2024-09-17T01:07:23.074 INFO:tasks.workunit.client.0.smithi103.stdout:0/757: unlink dd/df/d68/fee 0 2024-09-17T01:07:23.075 INFO:tasks.workunit.client.0.smithi103.stdout:0/758: chown dd/d1c/d9f 25 1 2024-09-17T01:07:23.075 INFO:tasks.workunit.client.0.smithi103.stdout:0/759: chown dd/df/d38/d62/db0 0 1 2024-09-17T01:07:23.087 INFO:tasks.workunit.client.0.smithi103.stdout:1/656: write d2/d16/f40 [763126,88093] 0 2024-09-17T01:07:23.088 INFO:tasks.workunit.client.0.smithi103.stdout:0/760: symlink dd/df/lfb 0 2024-09-17T01:07:23.089 INFO:tasks.workunit.client.0.smithi103.stdout:6/649: write d3/d16/d33/d57/f7a [1075793,73573] 0 2024-09-17T01:07:23.093 INFO:tasks.workunit.client.0.smithi103.stdout:6/650: read - d3/d25/fca zero size 2024-09-17T01:07:23.096 INFO:tasks.workunit.client.0.smithi103.stdout:9/629: getdents d7/db8/dbb 0 2024-09-17T01:07:23.097 INFO:tasks.workunit.client.0.smithi103.stdout:6/651: dread - d3/d16/d33/d3e/d58/d82/fd6 zero size 2024-09-17T01:07:23.098 INFO:tasks.workunit.client.0.smithi103.stdout:0/761: mkdir dd/d43/dfc 0 2024-09-17T01:07:23.099 INFO:tasks.workunit.client.0.smithi103.stdout:3/812: dwrite d3/d16/fc3 [0,4194304] 0 2024-09-17T01:07:23.101 INFO:tasks.workunit.client.0.smithi103.stdout:9/630: write d7/d43/d88/d11/d5c/d8d/f9e [1171150,115435] 0 2024-09-17T01:07:23.105 INFO:tasks.workunit.client.0.smithi103.stdout:1/657: write d2/d1c/d54/f46 [561890,57467] 0 2024-09-17T01:07:23.106 INFO:tasks.workunit.client.0.smithi103.stdout:6/652: chown d3/d25/d26/c2c 232719 1 2024-09-17T01:07:23.107 INFO:tasks.workunit.client.0.smithi103.stdout:6/653: chown d3/d16/d33/d3e/l89 158779 1 2024-09-17T01:07:23.110 INFO:tasks.workunit.client.0.smithi103.stdout:9/631: creat d7/d43/d88/d11/d5c/d8d/dac/fd8 x:0 0 0 2024-09-17T01:07:23.112 INFO:tasks.workunit.client.0.smithi103.stdout:3/813: getdents d3/d16/df8 0 2024-09-17T01:07:23.112 INFO:tasks.workunit.client.0.smithi103.stdout:9/632: chown d7/d43/d88/d11/d20/d4f/c7c 63936 1 2024-09-17T01:07:23.114 INFO:tasks.workunit.client.0.smithi103.stdout:0/762: link dd/d1c/f1d dd/d43/dfc/ffd 0 2024-09-17T01:07:23.114 INFO:tasks.workunit.client.0.smithi103.stdout:6/654: mkdir d3/d16/de1 0 2024-09-17T01:07:23.115 INFO:tasks.workunit.client.0.smithi103.stdout:6/655: fsync d3/d16/d33/d3e/f98 0 2024-09-17T01:07:23.116 INFO:tasks.workunit.client.0.smithi103.stdout:0/763: read dd/df/d68/ddc/f61 [311224,69416] 0 2024-09-17T01:07:23.117 INFO:tasks.workunit.client.0.smithi103.stdout:3/814: dread d3/d16/d1b/d3c/d65/d7e/fba [0,4194304] 0 2024-09-17T01:07:23.119 INFO:tasks.workunit.client.0.smithi103.stdout:1/658: write d2/f5d [66062,5896] 0 2024-09-17T01:07:23.120 INFO:tasks.workunit.client.0.smithi103.stdout:6/656: read - d3/d16/d33/f9f zero size 2024-09-17T01:07:23.121 INFO:tasks.workunit.client.0.smithi103.stdout:1/659: fsync d2/f5d 0 2024-09-17T01:07:23.125 INFO:tasks.workunit.client.0.smithi103.stdout:6/657: dread d3/d16/d21/d56/f7c [0,4194304] 0 2024-09-17T01:07:23.126 INFO:tasks.workunit.client.0.smithi103.stdout:0/764: symlink dd/d43/dfc/lfe 0 2024-09-17T01:07:23.132 INFO:tasks.workunit.client.0.smithi103.stdout:6/658: symlink d3/d25/d26/d3a/le2 0 2024-09-17T01:07:23.133 INFO:tasks.workunit.client.0.smithi103.stdout:9/633: dread d7/d2d/f71 [4194304,4194304] 0 2024-09-17T01:07:23.134 INFO:tasks.workunit.client.0.smithi103.stdout:3/815: rmdir d3/d16/df8 0 2024-09-17T01:07:23.136 INFO:tasks.workunit.client.0.smithi103.stdout:6/659: fsync d3/f36 0 2024-09-17T01:07:23.136 INFO:tasks.workunit.client.0.smithi103.stdout:0/765: dread dd/d4f/d64/f79 [0,4194304] 0 2024-09-17T01:07:23.138 INFO:tasks.workunit.client.0.smithi103.stdout:3/816: creat d3/d16/d90/f114 x:0 0 0 2024-09-17T01:07:23.139 INFO:tasks.workunit.client.0.smithi103.stdout:0/766: chown dd/df/d38/fe0 748927 1 2024-09-17T01:07:23.140 INFO:tasks.workunit.client.0.smithi103.stdout:1/660: link d2/d7/f5e d2/d1c/d20/fd5 0 2024-09-17T01:07:23.140 INFO:tasks.workunit.client.0.smithi103.stdout:9/634: dread d7/d43/d88/f9b [0,4194304] 0 2024-09-17T01:07:23.146 INFO:tasks.workunit.client.0.smithi103.stdout:0/767: rmdir dd/d1c/d9f/dbb 39 2024-09-17T01:07:23.154 INFO:tasks.workunit.client.0.smithi103.stdout:1/661: dread d2/d16/fb0 [0,4194304] 0 2024-09-17T01:07:23.158 INFO:tasks.workunit.client.0.smithi103.stdout:0/768: symlink dd/df/d38/da8/lff 0 2024-09-17T01:07:23.158 INFO:tasks.workunit.client.0.smithi103.stdout:9/635: write d7/d43/d88/f16 [4129679,97205] 0 2024-09-17T01:07:23.160 INFO:tasks.workunit.client.0.smithi103.stdout:6/660: truncate d3/d25/d26/f2e 389609 0 2024-09-17T01:07:23.160 INFO:tasks.workunit.client.0.smithi103.stdout:6/661: readlink d3/la 0 2024-09-17T01:07:23.161 INFO:tasks.workunit.client.0.smithi103.stdout:6/662: readlink d3/d25/l4e 0 2024-09-17T01:07:23.163 INFO:tasks.workunit.client.0.smithi103.stdout:6/663: write d3/d16/d33/d57/f7a [1058033,104360] 0 2024-09-17T01:07:23.163 INFO:tasks.workunit.client.0.smithi103.stdout:1/662: rmdir d2/d1c/d54 39 2024-09-17T01:07:23.165 INFO:tasks.workunit.client.0.smithi103.stdout:0/769: unlink dd/df/f57 0 2024-09-17T01:07:23.166 INFO:tasks.workunit.client.0.smithi103.stdout:6/664: fsync d3/d16/d33/d3e/d58/fd9 0 2024-09-17T01:07:23.167 INFO:tasks.workunit.client.0.smithi103.stdout:9/636: fsync d7/f87 0 2024-09-17T01:07:23.168 INFO:tasks.workunit.client.0.smithi103.stdout:3/817: dwrite d3/d16/d1b/d36/f110 [0,4194304] 0 2024-09-17T01:07:23.178 INFO:tasks.workunit.client.0.smithi103.stdout:6/665: dwrite d3/d16/d33/d3e/d58/d82/fc2 [0,4194304] 0 2024-09-17T01:07:23.185 INFO:tasks.workunit.client.0.smithi103.stdout:0/770: mknod dd/d1c/d9f/da3/c100 0 2024-09-17T01:07:23.185 INFO:tasks.workunit.client.0.smithi103.stdout:9/637: readlink d7/d43/d88/l39 0 2024-09-17T01:07:23.190 INFO:tasks.workunit.client.0.smithi103.stdout:3/818: creat d3/d16/d90/f115 x:0 0 0 2024-09-17T01:07:23.192 INFO:tasks.workunit.client.0.smithi103.stdout:3/819: write d3/d16/d1b/d3c/d65/d75/d9c/fde [283073,10035] 0 2024-09-17T01:07:23.195 INFO:tasks.workunit.client.0.smithi103.stdout:9/638: creat d7/fd9 x:0 0 0 2024-09-17T01:07:23.197 INFO:tasks.workunit.client.0.smithi103.stdout:0/771: mkdir dd/df/d68/d6c/d8e/dca/d101 0 2024-09-17T01:07:23.199 INFO:tasks.workunit.client.0.smithi103.stdout:0/772: write dd/df/d68/d6c/d8e/dca/ff6 [245816,66340] 0 2024-09-17T01:07:23.199 INFO:tasks.workunit.client.0.smithi103.stdout:1/663: write d2/d16/f2a [436969,55459] 0 2024-09-17T01:07:23.200 INFO:tasks.workunit.client.0.smithi103.stdout:6/666: mkdir d3/d16/de3 0 2024-09-17T01:07:23.203 INFO:tasks.workunit.client.0.smithi103.stdout:3/820: symlink d3/d44/l116 0 2024-09-17T01:07:23.206 INFO:tasks.workunit.client.0.smithi103.stdout:6/667: truncate d3/d25/fca 84501 0 2024-09-17T01:07:23.206 INFO:tasks.workunit.client.0.smithi103.stdout:1/664: dwrite d2/d1c/d20/f83 [0,4194304] 0 2024-09-17T01:07:23.234 INFO:tasks.workunit.client.0.smithi103.stdout:9/639: link d7/d43/d88/d11/d5c/d5e/d6c/d6e/fd2 d7/d43/d88/d11/d5c/d8d/dac/dc2/fda 0 2024-09-17T01:07:23.234 INFO:tasks.workunit.client.0.smithi103.stdout:3/821: creat d3/d16/d1b/d3c/d65/df7/f117 x:0 0 0 2024-09-17T01:07:23.236 INFO:tasks.workunit.client.0.smithi103.stdout:6/668: dread d3/d16/d33/d57/f5a [0,4194304] 0 2024-09-17T01:07:23.237 INFO:tasks.workunit.client.0.smithi103.stdout:1/665: rmdir d2/d1c 39 2024-09-17T01:07:23.241 INFO:tasks.workunit.client.0.smithi103.stdout:9/640: write d7/f53 [1643756,92306] 0 2024-09-17T01:07:23.243 INFO:tasks.workunit.client.0.smithi103.stdout:6/669: creat d3/d16/d21/d56/fe4 x:0 0 0 2024-09-17T01:07:23.244 INFO:tasks.workunit.client.0.smithi103.stdout:6/670: chown d3/d16/d33/d57/f5a 16927485 1 2024-09-17T01:07:23.250 INFO:tasks.workunit.client.0.smithi103.stdout:9/641: symlink d7/db8/ldb 0 2024-09-17T01:07:23.251 INFO:tasks.workunit.client.0.smithi103.stdout:1/666: dread d2/d16/f2a [0,4194304] 0 2024-09-17T01:07:23.252 INFO:tasks.workunit.client.0.smithi103.stdout:3/822: creat d3/d16/d1b/d3c/d65/d7e/da3/df5/f118 x:0 0 0 2024-09-17T01:07:23.253 INFO:tasks.workunit.client.0.smithi103.stdout:6/671: truncate d3/d16/d33/d3e/fce 809735 0 2024-09-17T01:07:23.257 INFO:tasks.workunit.client.0.smithi103.stdout:9/642: dread - d7/d43/d88/d11/d5c/d5e/d6c/d6e/fb3 zero size 2024-09-17T01:07:23.258 INFO:tasks.workunit.client.0.smithi103.stdout:9/643: readlink d7/d2d/l32 0 2024-09-17T01:07:23.259 INFO:tasks.workunit.client.0.smithi103.stdout:6/672: rename d3/d16/d21/d50/l8c to d3/d16/d33/d3e/d58/le5 0 2024-09-17T01:07:23.260 INFO:tasks.workunit.client.0.smithi103.stdout:6/673: chown d3/d25/d74/cdf 1212 1 2024-09-17T01:07:23.261 INFO:tasks.workunit.client.0.smithi103.stdout:1/667: symlink d2/d1c/d28/d4b/d67/d9e/ld6 0 2024-09-17T01:07:23.263 INFO:tasks.workunit.client.0.smithi103.stdout:3/823: mkdir d3/d16/d119 0 2024-09-17T01:07:23.265 INFO:tasks.workunit.client.0.smithi103.stdout:9/644: mkdir d7/db4/ddc 0 2024-09-17T01:07:23.266 INFO:tasks.workunit.client.0.smithi103.stdout:6/674: write d3/d16/d33/d3e/fb7 [1160790,106669] 0 2024-09-17T01:07:23.267 INFO:tasks.workunit.client.0.smithi103.stdout:3/824: read d3/fb0 [126813,66155] 0 2024-09-17T01:07:23.269 INFO:tasks.workunit.client.0.smithi103.stdout:1/668: mkdir d2/d1c/d20/dd7 0 2024-09-17T01:07:23.270 INFO:tasks.workunit.client.0.smithi103.stdout:1/669: chown d2/d1c/d28 513379756 1 2024-09-17T01:07:23.271 INFO:tasks.workunit.client.0.smithi103.stdout:6/675: mknod d3/d16/d33/d57/ce6 0 2024-09-17T01:07:23.272 INFO:tasks.workunit.client.0.smithi103.stdout:6/676: fsync d3/d25/dae/fd5 0 2024-09-17T01:07:23.274 INFO:tasks.workunit.client.0.smithi103.stdout:9/645: mkdir d7/d43/d88/ddd 0 2024-09-17T01:07:23.276 INFO:tasks.workunit.client.0.smithi103.stdout:3/825: creat d3/d16/d1b/d3c/d65/d83/dbf/f11a x:0 0 0 2024-09-17T01:07:23.279 INFO:tasks.workunit.client.0.smithi103.stdout:6/677: truncate d3/d16/fa5 5391154 0 2024-09-17T01:07:23.280 INFO:tasks.workunit.client.0.smithi103.stdout:9/646: mknod d7/d43/d88/d11/d20/d4f/cde 0 2024-09-17T01:07:23.282 INFO:tasks.workunit.client.0.smithi103.stdout:9/647: stat d7/f18 0 2024-09-17T01:07:23.289 INFO:tasks.workunit.client.0.smithi103.stdout:6/678: dwrite d3/d16/d21/d56/f97 [0,4194304] 0 2024-09-17T01:07:23.289 INFO:tasks.workunit.client.0.smithi103.stdout:3/826: dwrite d3/d16/d1b/d3c/d65/d83/f9d [0,4194304] 0 2024-09-17T01:07:23.291 INFO:tasks.workunit.client.0.smithi103.stdout:6/679: dread - d3/d16/d33/f9f zero size 2024-09-17T01:07:23.297 INFO:tasks.workunit.client.0.smithi103.stdout:9/648: truncate d7/d43/d88/f7b 499923 0 2024-09-17T01:07:23.298 INFO:tasks.workunit.client.0.smithi103.stdout:3/827: creat d3/d16/d1b/d3c/d65/d83/f11b x:0 0 0 2024-09-17T01:07:23.304 INFO:tasks.workunit.client.0.smithi103.stdout:9/649: rename d7/d43/d88/d11/d5c/lad to d7/db4/ddc/ldf 0 2024-09-17T01:07:23.307 INFO:tasks.workunit.client.0.smithi103.stdout:6/680: mkdir d3/d16/d33/d57/d63/d60/de7 0 2024-09-17T01:07:23.311 INFO:tasks.workunit.client.0.smithi103.stdout:3/828: rename d3/dd7/de7/cea to d3/d16/d1b/d3c/d65/d83/dbf/d105/c11c 0 2024-09-17T01:07:23.312 INFO:tasks.workunit.client.0.smithi103.stdout:3/829: read d3/f57 [251275,9264] 0 2024-09-17T01:07:23.314 INFO:tasks.workunit.client.0.smithi103.stdout:3/830: fsync d3/d16/d1b/d3c/d65/d83/dbf/ff0 0 2024-09-17T01:07:23.317 INFO:tasks.workunit.client.0.smithi103.stdout:6/681: dread - d3/d16/d21/d50/fb1 zero size 2024-09-17T01:07:23.321 INFO:tasks.workunit.client.0.smithi103.stdout:1/670: write d2/d7/f19 [3420845,20129] 0 2024-09-17T01:07:23.322 INFO:tasks.workunit.client.0.smithi103.stdout:3/831: dwrite d3/d16/d90/f115 [0,4194304] 0 2024-09-17T01:07:23.324 INFO:tasks.workunit.client.0.smithi103.stdout:1/671: write d2/d7/f19 [3675670,127419] 0 2024-09-17T01:07:23.334 INFO:tasks.workunit.client.0.smithi103.stdout:6/682: dread f1 [0,4194304] 0 2024-09-17T01:07:23.347 INFO:tasks.workunit.client.0.smithi103.stdout:1/672: dread d2/d1c/d20/d33/f59 [0,4194304] 0 2024-09-17T01:07:23.394 INFO:tasks.workunit.client.0.smithi103.stdout:9/650: write d7/d43/d88/d11/d5c/d8d/dac/dc2/fda [226637,34966] 0 2024-09-17T01:07:23.394 INFO:tasks.workunit.client.0.smithi103.stdout:9/651: readlink d7/d43/d88/d11/d5c/d5e/d6c/l73 0 2024-09-17T01:07:23.396 INFO:tasks.workunit.client.0.smithi103.stdout:9/652: fdatasync d7/d43/d88/d11/d5c/d5e/d6c/d6e/db1/fd6 0 2024-09-17T01:07:23.404 INFO:tasks.workunit.client.0.smithi103.stdout:1/673: creat d2/d7/d73/db8/fd8 x:0 0 0 2024-09-17T01:07:23.404 INFO:tasks.workunit.client.0.smithi103.stdout:9/653: dread - d7/d43/d88/d11/d5c/f65 zero size 2024-09-17T01:07:23.406 INFO:tasks.workunit.client.0.smithi103.stdout:3/832: truncate d3/d16/d1b/d3c/d65/d75/f78 4032585 0 2024-09-17T01:07:23.410 INFO:tasks.workunit.client.0.smithi103.stdout:3/833: write d3/d81/fc4 [1530501,5493] 0 2024-09-17T01:07:23.411 INFO:tasks.workunit.client.0.smithi103.stdout:1/674: fdatasync d2/d1c/d20/fd5 0 2024-09-17T01:07:23.418 INFO:tasks.workunit.client.0.smithi103.stdout:1/675: creat d2/d1c/db9/fd9 x:0 0 0 2024-09-17T01:07:23.422 INFO:tasks.workunit.client.0.smithi103.stdout:9/654: dwrite d7/d43/d88/d11/d5c/d5e/d6c/d6e/fb3 [0,4194304] 0 2024-09-17T01:07:23.430 INFO:tasks.workunit.client.0.smithi103.stdout:6/683: dread d3/f18 [0,4194304] 0 2024-09-17T01:07:23.432 INFO:tasks.workunit.client.0.smithi103.stdout:1/676: truncate d2/d7/d4e/f7b 2263587 0 2024-09-17T01:07:23.432 INFO:tasks.workunit.client.0.smithi103.stdout:6/684: rmdir d3 39 2024-09-17T01:07:23.436 INFO:tasks.workunit.client.0.smithi103.stdout:6/685: chown d3/d16/dad/f32 4 1 2024-09-17T01:07:23.436 INFO:tasks.workunit.client.0.smithi103.stdout:1/677: creat d2/d1c/d28/d4b/d67/d9e/daf/fda x:0 0 0 2024-09-17T01:07:23.437 INFO:tasks.workunit.client.0.smithi103.stdout:9/655: dwrite d7/d43/d88/d11/d20/d8e/fb0 [0,4194304] 0 2024-09-17T01:07:23.438 INFO:tasks.workunit.client.0.smithi103.stdout:1/678: write d2/de/f1b [203793,83700] 0 2024-09-17T01:07:23.440 INFO:tasks.workunit.client.0.smithi103.stdout:6/686: fsync d3/d25/d74/f76 0 2024-09-17T01:07:23.441 INFO:tasks.workunit.client.0.smithi103.stdout:6/687: chown d3/d16/d33/d3e/d4b 16140153 1 2024-09-17T01:07:23.444 INFO:tasks.workunit.client.0.smithi103.stdout:1/679: mkdir d2/d1c/d28/d52/ddb 0 2024-09-17T01:07:23.445 INFO:tasks.workunit.client.0.smithi103.stdout:6/688: mknod d3/d25/d9c/ce8 0 2024-09-17T01:07:23.448 INFO:tasks.workunit.client.0.smithi103.stdout:9/656: link d7/d43/d88/d11/d20/d4f/f76 d7/db8/dbb/fe0 0 2024-09-17T01:07:23.449 INFO:tasks.workunit.client.0.smithi103.stdout:1/680: dread - d2/d1c/d28/d4b/d67/d9e/fa1 zero size 2024-09-17T01:07:23.450 INFO:tasks.workunit.client.0.smithi103.stdout:6/689: fsync d3/d25/d26/d3a/f6b 0 2024-09-17T01:07:23.455 INFO:tasks.workunit.client.0.smithi103.stdout:1/681: creat d2/de/fdc x:0 0 0 2024-09-17T01:07:23.457 INFO:tasks.workunit.client.0.smithi103.stdout:9/657: dwrite d7/d43/d88/d11/d5c/d5e/d6c/d6e/fb3 [4194304,4194304] 0 2024-09-17T01:07:23.458 INFO:tasks.workunit.client.0.smithi103.stdout:6/690: creat d3/d16/d21/fe9 x:0 0 0 2024-09-17T01:07:23.458 INFO:tasks.workunit.client.0.smithi103.stdout:6/691: chown d3/la7 5517406 1 2024-09-17T01:07:23.460 INFO:tasks.workunit.client.0.smithi103.stdout:9/658: readlink d7/d43/d88/d11/lb9 0 2024-09-17T01:07:23.462 INFO:tasks.workunit.client.0.smithi103.stdout:6/692: unlink d3/la7 0 2024-09-17T01:07:23.462 INFO:tasks.workunit.client.0.smithi103.stdout:1/682: symlink d2/d16/dbf/ldd 0 2024-09-17T01:07:23.465 INFO:tasks.workunit.client.0.smithi103.stdout:9/659: unlink d7/d43/d88/d11/d5c/d5e/c98 0 2024-09-17T01:07:23.468 INFO:tasks.workunit.client.0.smithi103.stdout:9/660: dread - d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/fbe zero size 2024-09-17T01:07:23.470 INFO:tasks.workunit.client.0.smithi103.stdout:1/683: rename d2/fa4 to d2/d1c/d28/fde 0 2024-09-17T01:07:23.472 INFO:tasks.workunit.client.0.smithi103.stdout:9/661: unlink d7/d43/d88/l39 0 2024-09-17T01:07:23.474 INFO:tasks.workunit.client.0.smithi103.stdout:1/684: symlink d2/de/ldf 0 2024-09-17T01:07:23.475 INFO:tasks.workunit.client.0.smithi103.stdout:9/662: unlink d7/fc 0 2024-09-17T01:07:23.475 INFO:tasks.workunit.client.0.smithi103.stdout:1/685: read - d2/d70/dac/fc9 zero size 2024-09-17T01:07:23.479 INFO:tasks.workunit.client.0.smithi103.stdout:9/663: mkdir d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/de1 0 2024-09-17T01:07:23.479 INFO:tasks.workunit.client.0.smithi103.stdout:6/693: dread d3/d16/d21/f3b [0,4194304] 0 2024-09-17T01:07:23.480 INFO:tasks.workunit.client.0.smithi103.stdout:6/694: chown d3/d16/dad/f6f 340044 1 2024-09-17T01:07:23.484 INFO:tasks.workunit.client.0.smithi103.stdout:6/695: truncate d3/f11 1652506 0 2024-09-17T01:07:23.487 INFO:tasks.workunit.client.0.smithi103.stdout:1/686: write d2/d1c/d28/d4b/d67/f6a [1792848,119091] 0 2024-09-17T01:07:23.488 INFO:tasks.workunit.client.0.smithi103.stdout:6/696: creat d3/d25/dae/fea x:0 0 0 2024-09-17T01:07:23.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/687: chown d2/d1c/d20/d6d/d8d/d94/fa8 91 1 2024-09-17T01:07:23.489 INFO:tasks.workunit.client.0.smithi103.stdout:6/697: chown d3/d16/d33 11940302 1 2024-09-17T01:07:23.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/688: chown d2/d70 1 1 2024-09-17T01:07:23.492 INFO:tasks.workunit.client.0.smithi103.stdout:9/664: truncate d7/d43/d88/f5a 2401208 0 2024-09-17T01:07:23.494 INFO:tasks.workunit.client.0.smithi103.stdout:6/698: symlink d3/d16/d33/d57/d63/d60/db5/leb 0 2024-09-17T01:07:23.495 INFO:tasks.workunit.client.0.smithi103.stdout:1/689: mkdir d2/d16/d51/d65/de0 0 2024-09-17T01:07:23.497 INFO:tasks.workunit.client.0.smithi103.stdout:9/665: creat d7/d43/d88/d11/d20/d4f/d95/fe2 x:0 0 0 2024-09-17T01:07:23.498 INFO:tasks.workunit.client.0.smithi103.stdout:6/699: mknod d3/d16/dad/d2f/dc1/dc3/cec 0 2024-09-17T01:07:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:23 smithi143 ceph-mon[35452]: pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 99 MiB/s rd, 276 MiB/s wr, 593 op/s 2024-09-17T01:07:23.516 INFO:tasks.workunit.client.0.smithi103.stdout:1/690: dread d2/d7/d73/d81/fa6 [0,4194304] 0 2024-09-17T01:07:23.521 INFO:tasks.workunit.client.0.smithi103.stdout:9/666: dwrite d7/d43/d88/d11/fb [0,4194304] 0 2024-09-17T01:07:23.521 INFO:tasks.workunit.client.0.smithi103.stdout:1/691: creat d2/d7/d4e/fe1 x:0 0 0 2024-09-17T01:07:23.526 INFO:tasks.workunit.client.0.smithi103.stdout:6/700: dwrite d3/d25/d26/d3a/f44 [0,4194304] 0 2024-09-17T01:07:23.530 INFO:tasks.workunit.client.0.smithi103.stdout:6/701: creat d3/d16/d21/d50/fed x:0 0 0 2024-09-17T01:07:23.533 INFO:tasks.workunit.client.0.smithi103.stdout:1/692: write d2/d1c/d20/d33/f62 [398345,77631] 0 2024-09-17T01:07:23.536 INFO:tasks.workunit.client.0.smithi103.stdout:6/702: mknod d3/d16/d33/cee 0 2024-09-17T01:07:23.537 INFO:tasks.workunit.client.0.smithi103.stdout:9/667: getdents d7/d2d/d59/d7a 0 2024-09-17T01:07:23.540 INFO:tasks.workunit.client.0.smithi103.stdout:1/693: creat d2/d1c/d28/fe2 x:0 0 0 2024-09-17T01:07:23.546 INFO:tasks.workunit.client.0.smithi103.stdout:1/694: write d2/de/d1f/f27 [1357413,17318] 0 2024-09-17T01:07:23.549 INFO:tasks.workunit.client.0.smithi103.stdout:1/695: creat d2/d1c/d20/d6d/dcd/fe3 x:0 0 0 2024-09-17T01:07:23.551 INFO:tasks.workunit.client.0.smithi103.stdout:9/668: dread d7/d43/d88/d11/d5c/fa1 [0,4194304] 0 2024-09-17T01:07:23.556 INFO:tasks.workunit.client.0.smithi103.stdout:9/669: rmdir d7/d43/d88/ddd 0 2024-09-17T01:07:23.558 INFO:tasks.workunit.client.0.smithi103.stdout:9/670: creat d7/d43/d5f/fe3 x:0 0 0 2024-09-17T01:07:23.559 INFO:tasks.workunit.client.0.smithi103.stdout:9/671: chown d7/d43/d88/d11/d20/l40 1 1 2024-09-17T01:07:23.561 INFO:tasks.workunit.client.0.smithi103.stdout:6/703: dread d3/d16/dad/f7f [0,4194304] 0 2024-09-17T01:07:23.563 INFO:tasks.workunit.client.0.smithi103.stdout:9/672: symlink d7/d43/d88/d11/d5c/d5e/d6c/d6e/db1/le4 0 2024-09-17T01:07:23.566 INFO:tasks.workunit.client.0.smithi103.stdout:6/704: mknod d3/d16/d33/cef 0 2024-09-17T01:07:23.567 INFO:tasks.workunit.client.0.smithi103.stdout:1/696: dread d2/d1c/d20/f9a [0,4194304] 0 2024-09-17T01:07:23.567 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:23 smithi103 ceph-mon[28156]: pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 99 MiB/s rd, 276 MiB/s wr, 593 op/s 2024-09-17T01:07:23.568 INFO:tasks.workunit.client.0.smithi103.stdout:6/705: write d3/d16/d33/d57/d63/d60/fd4 [229129,44672] 0 2024-09-17T01:07:23.572 INFO:tasks.workunit.client.0.smithi103.stdout:6/706: mknod d3/d25/d26/cf0 0 2024-09-17T01:07:23.573 INFO:tasks.workunit.client.0.smithi103.stdout:1/697: creat d2/d1c/d28/d52/ddb/fe4 x:0 0 0 2024-09-17T01:07:23.575 INFO:tasks.workunit.client.0.smithi103.stdout:6/707: fdatasync d3/d16/d33/d57/d63/d60/da4/fc7 0 2024-09-17T01:07:23.578 INFO:tasks.workunit.client.0.smithi103.stdout:1/698: creat d2/d1c/db9/fe5 x:0 0 0 2024-09-17T01:07:23.579 INFO:tasks.workunit.client.0.smithi103.stdout:9/673: dwrite d7/d43/d88/f9b [0,4194304] 0 2024-09-17T01:07:23.580 INFO:tasks.workunit.client.0.smithi103.stdout:9/674: fsync d7/d43/fc3 0 2024-09-17T01:07:23.585 INFO:tasks.workunit.client.0.smithi103.stdout:1/699: truncate d2/d7/d4e/f55 842004 0 2024-09-17T01:07:23.588 INFO:tasks.workunit.client.0.smithi103.stdout:1/700: fsync d2/d1c/d28/d4b/d67/f6a 0 2024-09-17T01:07:23.589 INFO:tasks.workunit.client.0.smithi103.stdout:9/675: dwrite d7/db4/fc6 [0,4194304] 0 2024-09-17T01:07:23.590 INFO:tasks.workunit.client.0.smithi103.stdout:6/708: write d3/d16/dad/f2a [2611704,300] 0 2024-09-17T01:07:23.597 INFO:tasks.workunit.client.0.smithi103.stdout:9/676: mkdir d7/d43/d88/d11/d20/d4f/d95/d9a/de5 0 2024-09-17T01:07:23.597 INFO:tasks.workunit.client.0.smithi103.stdout:1/701: fdatasync d2/d7/d4e/f55 0 2024-09-17T01:07:23.599 INFO:tasks.workunit.client.0.smithi103.stdout:6/709: unlink d3/d16/d21/l27 0 2024-09-17T01:07:23.604 INFO:tasks.workunit.client.0.smithi103.stdout:9/677: getdents d7/d43/d88/d11/d20/d4f/d95/d9a/de5 0 2024-09-17T01:07:23.604 INFO:tasks.workunit.client.0.smithi103.stdout:6/710: symlink d3/d16/d33/d3e/lf1 0 2024-09-17T01:07:23.605 INFO:tasks.workunit.client.0.smithi103.stdout:6/711: chown d3/d16/d21/d56/cbd 2010 1 2024-09-17T01:07:23.608 INFO:tasks.workunit.client.0.smithi103.stdout:9/678: creat d7/d43/d88/fe6 x:0 0 0 2024-09-17T01:07:23.615 INFO:tasks.workunit.client.0.smithi103.stdout:6/712: write d3/d16/d21/f3b [2947828,62178] 0 2024-09-17T01:07:23.618 INFO:tasks.workunit.client.0.smithi103.stdout:9/679: write d7/f3b [3070070,92682] 0 2024-09-17T01:07:23.621 INFO:tasks.workunit.client.0.smithi103.stdout:1/702: dread d2/f36 [0,4194304] 0 2024-09-17T01:07:23.622 INFO:tasks.workunit.client.0.smithi103.stdout:1/703: truncate d2/d7/d4e/fe1 571605 0 2024-09-17T01:07:23.623 INFO:tasks.workunit.client.0.smithi103.stdout:1/704: chown d2/d7/f1d 123 1 2024-09-17T01:07:23.625 INFO:tasks.workunit.client.0.smithi103.stdout:6/713: write d3/d16/fbc [522450,24684] 0 2024-09-17T01:07:23.627 INFO:tasks.workunit.client.0.smithi103.stdout:6/714: truncate d3/d16/d21/fe9 1046450 0 2024-09-17T01:07:23.628 INFO:tasks.workunit.client.0.smithi103.stdout:1/705: mkdir d2/d1c/d28/d52/d69/de6 0 2024-09-17T01:07:23.629 INFO:tasks.workunit.client.0.smithi103.stdout:1/706: chown d2/d1c/d28/d4b/f66 1101752 1 2024-09-17T01:07:23.630 INFO:tasks.workunit.client.0.smithi103.stdout:6/715: creat d3/d16/d33/d57/d63/d60/db5/ff2 x:0 0 0 2024-09-17T01:07:23.634 INFO:tasks.workunit.client.0.smithi103.stdout:9/680: dwrite d7/d43/d88/d11/d5c/d8d/fb2 [0,4194304] 0 2024-09-17T01:07:23.635 INFO:tasks.workunit.client.0.smithi103.stdout:1/707: symlink d2/d70/dac/dd2/le7 0 2024-09-17T01:07:23.646 INFO:tasks.workunit.client.0.smithi103.stdout:1/708: creat d2/d1c/d28/fe8 x:0 0 0 2024-09-17T01:07:23.648 INFO:tasks.workunit.client.0.smithi103.stdout:9/681: getdents d7/d43/d5f/d7d 0 2024-09-17T01:07:23.650 INFO:tasks.workunit.client.0.smithi103.stdout:6/716: dwrite d3/d25/dae/fb6 [0,4194304] 0 2024-09-17T01:07:23.724 INFO:tasks.workunit.client.0.smithi103.stdout:6/717: write d3/d16/d33/d57/f7a [903848,110071] 0 2024-09-17T01:07:23.766 INFO:tasks.workunit.client.0.smithi103.stdout:1/709: mkdir d2/de/de9 0 2024-09-17T01:07:23.767 INFO:tasks.workunit.client.0.smithi103.stdout:1/710: write d2/d1c/d28/d4b/d67/f6a [192266,43786] 0 2024-09-17T01:07:23.768 INFO:tasks.workunit.client.0.smithi103.stdout:1/711: chown d2 442 1 2024-09-17T01:07:23.769 INFO:tasks.workunit.client.0.smithi103.stdout:6/718: rename d3/d16/dad/d2f to d3/d25/dae/df3 0 2024-09-17T01:07:23.772 INFO:tasks.workunit.client.0.smithi103.stdout:6/719: rmdir d3/d16/d33 39 2024-09-17T01:07:23.775 INFO:tasks.workunit.client.0.smithi103.stdout:9/682: getdents d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6 0 2024-09-17T01:07:23.778 INFO:tasks.workunit.client.0.smithi103.stdout:6/720: rename d3/d25/d26/d3a to d3/d25/dae/df3/dc1/dc3/df4 0 2024-09-17T01:07:23.781 INFO:tasks.workunit.client.0.smithi103.stdout:6/721: mkdir d3/d16/df5 0 2024-09-17T01:07:23.783 INFO:tasks.workunit.client.0.smithi103.stdout:6/722: rmdir d3/d25/d26/d87 39 2024-09-17T01:07:23.783 INFO:tasks.workunit.client.0.smithi103.stdout:1/712: dread d2/de/f14 [0,4194304] 0 2024-09-17T01:07:23.793 INFO:tasks.workunit.client.0.smithi103.stdout:6/723: creat d3/d16/d33/d57/d63/d60/de7/ff6 x:0 0 0 2024-09-17T01:07:23.795 INFO:tasks.workunit.client.0.smithi103.stdout:6/724: dread - d3/d16/d33/d57/d63/d60/db5/ff2 zero size 2024-09-17T01:07:23.797 INFO:tasks.workunit.client.0.smithi103.stdout:1/713: dwrite d2/d1c/d28/d4b/d74/fae [0,4194304] 0 2024-09-17T01:07:23.800 INFO:tasks.workunit.client.0.smithi103.stdout:6/725: symlink d3/d16/d33/d3e/d4b/lf7 0 2024-09-17T01:07:23.802 INFO:tasks.workunit.client.0.smithi103.stdout:1/714: write d2/d1c/d28/d52/d69/fa9 [1031419,27982] 0 2024-09-17T01:07:23.805 INFO:tasks.workunit.client.0.smithi103.stdout:1/715: rmdir d2/d7/d73 39 2024-09-17T01:07:23.807 INFO:tasks.workunit.client.0.smithi103.stdout:1/716: rmdir d2/d16/d51 39 2024-09-17T01:07:23.808 INFO:tasks.workunit.client.0.smithi103.stdout:1/717: stat d2/f6 0 2024-09-17T01:07:23.810 INFO:tasks.workunit.client.0.smithi103.stdout:6/726: rename d3/c13 to d3/cf8 0 2024-09-17T01:07:23.812 INFO:tasks.workunit.client.0.smithi103.stdout:6/727: fsync d3/d16/dad/fe0 0 2024-09-17T01:07:23.819 INFO:tasks.workunit.client.0.smithi103.stdout:1/718: dread d2/d1c/d28/f29 [0,4194304] 0 2024-09-17T01:07:23.827 INFO:tasks.workunit.client.0.smithi103.stdout:6/728: dread d3/d16/d33/d57/fcb [0,4194304] 0 2024-09-17T01:07:23.828 INFO:tasks.workunit.client.0.smithi103.stdout:6/729: write d3/d16/d33/d57/d63/d60/fd4 [675937,66476] 0 2024-09-17T01:07:23.838 INFO:tasks.workunit.client.0.smithi103.stdout:6/730: dwrite d3/d16/d33/d57/fbe [0,4194304] 0 2024-09-17T01:07:23.843 INFO:tasks.workunit.client.0.smithi103.stdout:6/731: link d3/d16/dad/f32 d3/d25/ff9 0 2024-09-17T01:07:23.845 INFO:tasks.workunit.client.0.smithi103.stdout:6/732: chown d3/d16/d33/d3e/d58/c93 9200596 1 2024-09-17T01:07:23.848 INFO:tasks.workunit.client.0.smithi103.stdout:8/547: sync 2024-09-17T01:07:23.852 INFO:tasks.workunit.client.0.smithi103.stdout:6/733: chown d3/d16/d33/d3e/fce 365862324 1 2024-09-17T01:07:23.869 INFO:tasks.workunit.client.0.smithi103.stdout:6/734: dread d3/d16/d33/d3e/fc8 [0,4194304] 0 2024-09-17T01:07:23.878 INFO:tasks.workunit.client.0.smithi103.stdout:6/735: symlink d3/d16/d33/d3e/d4b/lfa 0 2024-09-17T01:07:23.879 INFO:tasks.workunit.client.0.smithi103.stdout:6/736: read d3/d25/dae/df3/dc1/dc3/df4/f44 [928520,67334] 0 2024-09-17T01:07:23.881 INFO:tasks.workunit.client.0.smithi103.stdout:8/548: mknod d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/cab 0 2024-09-17T01:07:23.885 INFO:tasks.workunit.client.0.smithi103.stdout:6/737: symlink d3/d16/d21/d50/lfb 0 2024-09-17T01:07:23.887 INFO:tasks.workunit.client.0.smithi103.stdout:8/549: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/dac 0 2024-09-17T01:07:23.889 INFO:tasks.workunit.client.0.smithi103.stdout:6/738: creat d3/d16/d33/d57/d63/d60/de7/ffc x:0 0 0 2024-09-17T01:07:23.890 INFO:tasks.workunit.client.0.smithi103.stdout:6/739: chown d3/d16/d33/d3e/d4b 38873 1 2024-09-17T01:07:23.891 INFO:tasks.workunit.client.0.smithi103.stdout:6/740: read d3/f28 [588792,71736] 0 2024-09-17T01:07:23.892 INFO:tasks.workunit.client.0.smithi103.stdout:8/550: truncate d0/d80/f9c 414337 0 2024-09-17T01:07:23.896 INFO:tasks.workunit.client.0.smithi103.stdout:8/551: rename d0/d6/dc/d30/d25/d64/d34/f5a to d0/d6/dc/d3d/fad 0 2024-09-17T01:07:23.898 INFO:tasks.workunit.client.0.smithi103.stdout:8/552: mknod d0/d6/dc/d3d/cae 0 2024-09-17T01:07:23.898 INFO:tasks.workunit.client.0.smithi103.stdout:8/553: write d0/f4c [3881381,20349] 0 2024-09-17T01:07:23.912 INFO:tasks.workunit.client.0.smithi103.stdout:6/741: dwrite d3/d16/d21/f39 [0,4194304] 0 2024-09-17T01:07:23.915 INFO:tasks.workunit.client.0.smithi103.stdout:6/742: truncate d3/d16/f1b 1864282 0 2024-09-17T01:07:23.921 INFO:tasks.workunit.client.0.smithi103.stdout:6/743: write d3/d25/dae/df3/f34 [59307,45830] 0 2024-09-17T01:07:23.924 INFO:tasks.workunit.client.0.smithi103.stdout:6/744: mknod d3/d16/d33/d57/cfd 0 2024-09-17T01:07:23.931 INFO:tasks.workunit.client.0.smithi103.stdout:6/745: rename d3/d25/dae/df3 to d3/dfe 0 2024-09-17T01:07:23.949 INFO:tasks.workunit.client.0.smithi103.stdout:6/746: dwrite d3/f18 [0,4194304] 0 2024-09-17T01:07:23.950 INFO:tasks.workunit.client.0.smithi103.stdout:6/747: dread - d3/d16/d33/d3e/d58/fd9 zero size 2024-09-17T01:07:23.955 INFO:tasks.workunit.client.0.smithi103.stdout:6/748: dread d3/d16/d33/d3e/f98 [0,4194304] 0 2024-09-17T01:07:23.957 INFO:tasks.workunit.client.0.smithi103.stdout:6/749: mkdir d3/d16/d33/d57/d63/dff 0 2024-09-17T01:07:23.961 INFO:tasks.workunit.client.0.smithi103.stdout:6/750: getdents d3/d16/d33/d57/d63/d60/de7 0 2024-09-17T01:07:23.967 INFO:tasks.workunit.client.0.smithi103.stdout:6/751: dwrite d3/d16/d21/d50/faf [0,4194304] 0 2024-09-17T01:07:23.968 INFO:tasks.workunit.client.0.smithi103.stdout:6/752: chown d3/d16/fbc 2 1 2024-09-17T01:07:23.971 INFO:tasks.workunit.client.0.smithi103.stdout:6/753: unlink d3/d25/d26/l5f 0 2024-09-17T01:07:23.975 INFO:tasks.workunit.client.0.smithi103.stdout:6/754: mkdir d3/d16/de1/d100 0 2024-09-17T01:07:23.976 INFO:tasks.workunit.client.0.smithi103.stdout:6/755: mkdir d3/d16/d21/d56/d9a/d101 0 2024-09-17T01:07:23.982 INFO:tasks.workunit.client.0.smithi103.stdout:6/756: dwrite d3/d16/d33/d57/fcb [0,4194304] 0 2024-09-17T01:07:23.984 INFO:tasks.workunit.client.0.smithi103.stdout:6/757: mkdir d3/dfe/dc1/d102 0 2024-09-17T01:07:23.987 INFO:tasks.workunit.client.0.smithi103.stdout:6/758: unlink d3/d16/fa5 0 2024-09-17T01:07:23.990 INFO:tasks.workunit.client.0.smithi103.stdout:6/759: creat d3/dfe/dc1/f103 x:0 0 0 2024-09-17T01:07:24.004 INFO:tasks.workunit.client.0.smithi103.stdout:6/760: write d3/d16/d33/d3e/fb0 [695478,36104] 0 2024-09-17T01:07:24.006 INFO:tasks.workunit.client.0.smithi103.stdout:6/761: readlink d3/d25/d26/d87/l90 0 2024-09-17T01:07:24.010 INFO:tasks.workunit.client.0.smithi103.stdout:6/762: getdents d3/d25/d9c 0 2024-09-17T01:07:24.012 INFO:tasks.workunit.client.0.smithi103.stdout:6/763: mknod d3/d25/c104 0 2024-09-17T01:07:24.015 INFO:tasks.workunit.client.0.smithi103.stdout:6/764: mkdir d3/d16/dad/d105 0 2024-09-17T01:07:24.021 INFO:tasks.workunit.client.0.smithi103.stdout:6/765: creat d3/d25/d26/f106 x:0 0 0 2024-09-17T01:07:24.029 INFO:tasks.workunit.client.0.smithi103.stdout:6/766: write d3/f11 [1651371,91750] 0 2024-09-17T01:07:24.033 INFO:tasks.workunit.client.0.smithi103.stdout:6/767: rename d3/dfe/lac to d3/d16/d33/d3e/d58/d82/l107 0 2024-09-17T01:07:24.033 INFO:tasks.workunit.client.0.smithi103.stdout:6/768: chown d3/c20 11561392 1 2024-09-17T01:07:24.040 INFO:tasks.workunit.client.0.smithi103.stdout:6/769: dwrite d3/d16/d33/d3e/d58/fd9 [0,4194304] 0 2024-09-17T01:07:24.044 INFO:tasks.workunit.client.0.smithi103.stdout:6/770: getdents d3/d16/d33/d57/d63/dff 0 2024-09-17T01:07:24.047 INFO:tasks.workunit.client.0.smithi103.stdout:6/771: creat d3/d16/d33/d57/d63/d60/da4/f108 x:0 0 0 2024-09-17T01:07:24.051 INFO:tasks.workunit.client.0.smithi103.stdout:6/772: dread d3/d16/d21/d50/faf [0,4194304] 0 2024-09-17T01:07:24.054 INFO:tasks.workunit.client.0.smithi103.stdout:6/773: creat d3/d16/d33/d3e/d58/d82/f109 x:0 0 0 2024-09-17T01:07:24.059 INFO:tasks.workunit.client.0.smithi103.stdout:6/774: link d3/d16/d33/d3e/d58/d82/lba d3/d16/dad/l10a 0 2024-09-17T01:07:24.061 INFO:tasks.workunit.client.0.smithi103.stdout:6/775: fdatasync d3/dfe/f7e 0 2024-09-17T01:07:24.063 INFO:tasks.workunit.client.0.smithi103.stdout:6/776: rmdir d3/d16/d21/d56/d9a 39 2024-09-17T01:07:24.063 INFO:tasks.workunit.client.0.smithi103.stdout:6/777: readlink d3/d16/d33/d57/d63/d60/db5/ld1 0 2024-09-17T01:07:24.064 INFO:tasks.workunit.client.0.smithi103.stdout:6/778: chown d3/d16/d33/d57/d63/d60/da4/fc7 0 1 2024-09-17T01:07:24.068 INFO:tasks.workunit.client.0.smithi103.stdout:6/779: mkdir d3/d25/d26/d10b 0 2024-09-17T01:07:24.088 INFO:tasks.workunit.client.0.smithi103.stdout:5/515: sync 2024-09-17T01:07:24.088 INFO:tasks.workunit.client.0.smithi103.stdout:2/781: sync 2024-09-17T01:07:24.091 INFO:tasks.workunit.client.0.smithi103.stdout:5/516: mkdir d6/db/d66/dbe 0 2024-09-17T01:07:24.092 INFO:tasks.workunit.client.0.smithi103.stdout:2/782: creat d6/da/f108 x:0 0 0 2024-09-17T01:07:24.095 INFO:tasks.workunit.client.0.smithi103.stdout:5/517: dread d6/d2c/f37 [0,4194304] 0 2024-09-17T01:07:24.096 INFO:tasks.workunit.client.0.smithi103.stdout:5/518: stat d6/d11/d81/fac 0 2024-09-17T01:07:24.097 INFO:tasks.workunit.client.0.smithi103.stdout:2/783: getdents d6/d5f/d26/d66/df/db7 0 2024-09-17T01:07:24.100 INFO:tasks.workunit.client.0.smithi103.stdout:5/519: rename d6/db/f3a to d6/d2c/d38/d4c/d71/fbf 0 2024-09-17T01:07:24.103 INFO:tasks.workunit.client.0.smithi103.stdout:2/784: mknod d6/da/d5d/d8d/d60/d104/c109 0 2024-09-17T01:07:24.104 INFO:tasks.workunit.client.0.smithi103.stdout:5/520: truncate d6/d2c/f73 388017 0 2024-09-17T01:07:24.105 INFO:tasks.workunit.client.0.smithi103.stdout:2/785: dread - d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/f100 zero size 2024-09-17T01:07:24.108 INFO:tasks.workunit.client.0.smithi103.stdout:2/786: symlink d6/d5f/dad/l10a 0 2024-09-17T01:07:24.110 INFO:tasks.workunit.client.0.smithi103.stdout:5/521: dwrite d6/d2c/db3/fbb [0,4194304] 0 2024-09-17T01:07:24.113 INFO:tasks.workunit.client.0.smithi103.stdout:2/787: symlink d6/d5f/d26/d66/l10b 0 2024-09-17T01:07:24.116 INFO:tasks.workunit.client.0.smithi103.stdout:5/522: fsync d6/d2c/d38/d4c/d50/f72 0 2024-09-17T01:07:24.116 INFO:tasks.workunit.client.0.smithi103.stdout:5/523: chown f0 1074 1 2024-09-17T01:07:24.122 INFO:tasks.workunit.client.0.smithi103.stdout:5/524: dwrite d6/db/fd [0,4194304] 0 2024-09-17T01:07:24.125 INFO:tasks.workunit.client.0.smithi103.stdout:2/788: fsync d6/d5f/f20 0 2024-09-17T01:07:24.128 INFO:tasks.workunit.client.0.smithi103.stdout:5/525: read d6/d28/f39 [1946972,125898] 0 2024-09-17T01:07:24.137 INFO:tasks.workunit.client.0.smithi103.stdout:2/789: write d6/da/d3f/fc9 [901487,104154] 0 2024-09-17T01:07:24.138 INFO:tasks.workunit.client.0.smithi103.stdout:5/526: truncate d6/d2c/d38/d4c/d50/f21 1972254 0 2024-09-17T01:07:24.140 INFO:tasks.workunit.client.0.smithi103.stdout:5/527: creat d6/d28/d90/fc0 x:0 0 0 2024-09-17T01:07:24.140 INFO:tasks.workunit.client.0.smithi103.stdout:2/790: creat d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/f10c x:0 0 0 2024-09-17T01:07:24.144 INFO:tasks.workunit.client.0.smithi103.stdout:5/528: creat d6/d11/fc1 x:0 0 0 2024-09-17T01:07:24.146 INFO:tasks.workunit.client.0.smithi103.stdout:5/529: creat d6/d2c/d38/d4c/d54/fc2 x:0 0 0 2024-09-17T01:07:24.147 INFO:tasks.workunit.client.0.smithi103.stdout:5/530: creat d6/d2c/db3/fc3 x:0 0 0 2024-09-17T01:07:24.148 INFO:tasks.workunit.client.0.smithi103.stdout:5/531: mkdir d6/d7d/dc4 0 2024-09-17T01:07:24.151 INFO:tasks.workunit.client.0.smithi103.stdout:5/532: unlink d6/db/la9 0 2024-09-17T01:07:24.154 INFO:tasks.workunit.client.0.smithi103.stdout:5/533: rename d6/d28/l2a to d6/d2c/d38/lc5 0 2024-09-17T01:07:24.156 INFO:tasks.workunit.client.0.smithi103.stdout:5/534: creat d6/d2c/d38/d4c/d9a/fc6 x:0 0 0 2024-09-17T01:07:24.158 INFO:tasks.workunit.client.0.smithi103.stdout:2/791: dread d6/da/d5d/d8d/f51 [0,4194304] 0 2024-09-17T01:07:24.161 INFO:tasks.workunit.client.0.smithi103.stdout:5/535: link d6/d11/f86 d6/fc7 0 2024-09-17T01:07:24.164 INFO:tasks.workunit.client.0.smithi103.stdout:2/792: dwrite d6/da/d3f/fc9 [0,4194304] 0 2024-09-17T01:07:24.164 INFO:tasks.workunit.client.0.smithi103.stdout:5/536: symlink d6/d2c/d38/lc8 0 2024-09-17T01:07:24.165 INFO:tasks.workunit.client.0.smithi103.stdout:5/537: chown d6/l24 284 1 2024-09-17T01:07:24.172 INFO:tasks.workunit.client.0.smithi103.stdout:2/793: dwrite d6/d5f/d26/d6e/fb6 [4194304,4194304] 0 2024-09-17T01:07:24.176 INFO:tasks.workunit.client.0.smithi103.stdout:2/794: mknod d6/d5f/d26/d66/df/ddd/c10d 0 2024-09-17T01:07:24.201 INFO:tasks.workunit.client.0.smithi103.stdout:7/687: sync 2024-09-17T01:07:24.202 INFO:tasks.workunit.client.0.smithi103.stdout:2/795: mknod d6/d5f/d26/d66/df/ddd/c10e 0 2024-09-17T01:07:24.209 INFO:tasks.workunit.client.0.smithi103.stdout:2/796: dwrite d6/d5f/d26/d66/df/ddd/fe6 [0,4194304] 0 2024-09-17T01:07:24.215 INFO:tasks.workunit.client.0.smithi103.stdout:2/797: truncate d6/da/f82 835373 0 2024-09-17T01:07:24.217 INFO:tasks.workunit.client.0.smithi103.stdout:7/688: mknod d4/ceb 0 2024-09-17T01:07:24.219 INFO:tasks.workunit.client.0.smithi103.stdout:2/798: symlink d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4/l10f 0 2024-09-17T01:07:24.221 INFO:tasks.workunit.client.0.smithi103.stdout:2/799: write d6/d5f/d26/d66/df/d68/d7e/d9c/fda [4082837,26732] 0 2024-09-17T01:07:24.222 INFO:tasks.workunit.client.0.smithi103.stdout:2/800: chown d6/da/d28/dfe 30464 1 2024-09-17T01:07:24.224 INFO:tasks.workunit.client.0.smithi103.stdout:7/689: link d4/d11/d80/d8c/cb4 d4/d11/d34/cec 0 2024-09-17T01:07:24.226 INFO:tasks.workunit.client.0.smithi103.stdout:2/801: mkdir d6/d5f/d26/d66/df/ddd/d110 0 2024-09-17T01:07:24.229 INFO:tasks.workunit.client.0.smithi103.stdout:7/690: mknod d4/d10/d6b/dc5/d8d/d92/ced 0 2024-09-17T01:07:24.236 INFO:tasks.workunit.client.0.smithi103.stdout:2/802: dread f4 [0,4194304] 0 2024-09-17T01:07:24.249 INFO:tasks.workunit.client.0.smithi103.stdout:7/691: truncate d4/d11/f5f 3164696 0 2024-09-17T01:07:24.254 INFO:tasks.workunit.client.0.smithi103.stdout:2/803: write d6/d5f/d26/f2c [1845384,130965] 0 2024-09-17T01:07:24.256 INFO:tasks.workunit.client.0.smithi103.stdout:7/692: getdents d4/d10/d6b/dc5/d36/d3a/d51 0 2024-09-17T01:07:24.256 INFO:tasks.workunit.client.0.smithi103.stdout:2/804: fdatasync d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/ff3 0 2024-09-17T01:07:24.259 INFO:tasks.workunit.client.0.smithi103.stdout:2/805: truncate d6/d5f/f20 11671759 0 2024-09-17T01:07:24.262 INFO:tasks.workunit.client.0.smithi103.stdout:2/806: symlink d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4/l111 0 2024-09-17T01:07:24.263 INFO:tasks.workunit.client.0.smithi103.stdout:7/693: link d4/l1c d4/d10/d37/lee 0 2024-09-17T01:07:24.267 INFO:tasks.workunit.client.0.smithi103.stdout:7/694: symlink d4/lef 0 2024-09-17T01:07:24.267 INFO:tasks.workunit.client.0.smithi103.stdout:2/807: dwrite d6/da/d5d/d8d/d60/fa2 [0,4194304] 0 2024-09-17T01:07:24.271 INFO:tasks.workunit.client.0.smithi103.stdout:7/695: read d4/d10/d6b/dc5/d36/d3a/f6e [901441,7382] 0 2024-09-17T01:07:24.273 INFO:tasks.workunit.client.0.smithi103.stdout:2/808: creat d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/f112 x:0 0 0 2024-09-17T01:07:24.281 INFO:tasks.workunit.client.0.smithi103.stdout:7/696: link d4/d10/d6b/dc5/d36/d3a/d51/d5e/cdb d4/d4a/d4b/d8a/cf0 0 2024-09-17T01:07:24.282 INFO:tasks.workunit.client.0.smithi103.stdout:2/809: link d6/d5f/d26/d66/df/d58/cbe d6/d5f/d26/d66/df/db7/c113 0 2024-09-17T01:07:24.288 INFO:tasks.workunit.client.0.smithi103.stdout:7/697: dwrite d4/d10/d6b/dc5/d36/d3a/d51/fca [0,4194304] 0 2024-09-17T01:07:24.308 INFO:tasks.workunit.client.0.smithi103.stdout:2/810: write d6/d5f/f29 [2069498,122895] 0 2024-09-17T01:07:24.311 INFO:tasks.workunit.client.0.smithi103.stdout:2/811: creat d6/da/d3f/f114 x:0 0 0 2024-09-17T01:07:24.320 INFO:tasks.workunit.client.0.smithi103.stdout:2/812: mknod d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/c115 0 2024-09-17T01:07:24.324 INFO:tasks.workunit.client.0.smithi103.stdout:2/813: rename d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/f85 to d6/d5f/d26/d6e/f116 0 2024-09-17T01:07:24.329 INFO:tasks.workunit.client.0.smithi103.stdout:7/698: dwrite d4/d10/d43/f71 [0,4194304] 0 2024-09-17T01:07:24.330 INFO:tasks.workunit.client.0.smithi103.stdout:2/814: symlink d6/d5f/l117 0 2024-09-17T01:07:24.332 INFO:tasks.workunit.client.0.smithi103.stdout:2/815: stat d6/d5f/d26/d66/df/d68/d7e/dd9 0 2024-09-17T01:07:24.337 INFO:tasks.workunit.client.0.smithi103.stdout:2/816: dread d6/da/d5d/d8d/d60/fa2 [0,4194304] 0 2024-09-17T01:07:24.352 INFO:tasks.workunit.client.0.smithi103.stdout:7/699: write d4/d10/d66/f6f [208988,33140] 0 2024-09-17T01:07:24.352 INFO:tasks.workunit.client.0.smithi103.stdout:2/817: link d6/da/d5d/d8d/d60/lc0 d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/l118 0 2024-09-17T01:07:24.354 INFO:tasks.workunit.client.0.smithi103.stdout:7/700: write d4/d10/fd3 [923442,127428] 0 2024-09-17T01:07:24.355 INFO:tasks.workunit.client.0.smithi103.stdout:7/701: chown d4/d10/d6b/dc5/d36/c62 7067690 1 2024-09-17T01:07:24.368 INFO:tasks.workunit.client.0.smithi103.stdout:2/818: dread d6/d5f/d26/d66/df/d68/d7e/fc4 [0,4194304] 0 2024-09-17T01:07:24.378 INFO:tasks.workunit.client.0.smithi103.stdout:2/819: dread d6/d5f/d26/d66/df/d58/f90 [0,4194304] 0 2024-09-17T01:07:24.468 INFO:tasks.workunit.client.0.smithi103.stdout:7/702: creat d4/d4a/d4b/d9d/ff1 x:0 0 0 2024-09-17T01:07:24.470 INFO:tasks.workunit.client.0.smithi103.stdout:7/703: mkdir d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/df2 0 2024-09-17T01:07:24.476 INFO:tasks.workunit.client.0.smithi103.stdout:7/704: link d4/d11/d34/db5/c87 d4/d10/d6b/dc5/d8d/d92/db3/dd0/cf3 0 2024-09-17T01:07:24.478 INFO:tasks.workunit.client.0.smithi103.stdout:7/705: mknod d4/d10/d66/dd2/cf4 0 2024-09-17T01:07:24.479 INFO:tasks.workunit.client.0.smithi103.stdout:7/706: fsync d4/d10/d6b/dc5/d36/d3a/d51/d5e/fdf 0 2024-09-17T01:07:24.482 INFO:tasks.workunit.client.0.smithi103.stdout:7/707: unlink d4/d10/d6b/dc5/l2d 0 2024-09-17T01:07:24.485 INFO:tasks.workunit.client.0.smithi103.stdout:7/708: mkdir d4/d10/d43/df5 0 2024-09-17T01:07:24.487 INFO:tasks.workunit.client.0.smithi103.stdout:7/709: creat d4/d11/d34/ff6 x:0 0 0 2024-09-17T01:07:24.489 INFO:tasks.workunit.client.0.smithi103.stdout:7/710: mknod d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/cf7 0 2024-09-17T01:07:24.492 INFO:tasks.workunit.client.0.smithi103.stdout:7/711: write d4/d10/d6b/dc5/d8d/fbc [900224,116709] 0 2024-09-17T01:07:24.504 INFO:tasks.workunit.client.0.smithi103.stdout:7/712: dwrite d4/d10/d6b/dc5/d36/d3a/fcf [4194304,4194304] 0 2024-09-17T01:07:24.515 INFO:tasks.workunit.client.0.smithi103.stdout:7/713: dwrite d4/d11/f5f [0,4194304] 0 2024-09-17T01:07:24.523 INFO:tasks.workunit.client.0.smithi103.stdout:7/714: dwrite d4/d11/d34/db5/fb0 [0,4194304] 0 2024-09-17T01:07:24.530 INFO:tasks.workunit.client.0.smithi103.stdout:7/715: creat d4/ff8 x:0 0 0 2024-09-17T01:07:24.530 INFO:tasks.workunit.client.0.smithi103.stdout:7/716: mknod d4/d4a/d4b/d9d/cf9 0 2024-09-17T01:07:24.533 INFO:tasks.workunit.client.0.smithi103.stdout:7/717: fsync d4/d11/f19 0 2024-09-17T01:07:24.535 INFO:tasks.workunit.client.0.smithi103.stdout:7/718: readlink d4/d10/d37/lee 0 2024-09-17T01:07:24.539 INFO:tasks.workunit.client.0.smithi103.stdout:7/719: dread d4/d10/d6b/dc5/d36/d3a/d51/fca [0,4194304] 0 2024-09-17T01:07:24.541 INFO:tasks.workunit.client.0.smithi103.stdout:7/720: rename d4/d4a/d4b/d9d/ff1 to d4/d4a/d4b/ffa 0 2024-09-17T01:07:24.542 INFO:tasks.workunit.client.0.smithi103.stdout:7/721: stat d4/d10/d6b/dc5/d36/d3a/d51 0 2024-09-17T01:07:24.543 INFO:tasks.workunit.client.0.smithi103.stdout:7/722: write d4/d10/d37/fcb [4826180,80963] 0 2024-09-17T01:07:24.546 INFO:tasks.workunit.client.0.smithi103.stdout:7/723: unlink d4/d11/c21 0 2024-09-17T01:07:24.547 INFO:tasks.workunit.client.0.smithi103.stdout:7/724: read d4/d10/d6b/d72/db8/fd6 [413718,41402] 0 2024-09-17T01:07:24.548 INFO:tasks.workunit.client.0.smithi103.stdout:7/725: write d4/d10/d6b/fcc [524955,812] 0 2024-09-17T01:07:24.553 INFO:tasks.workunit.client.0.smithi103.stdout:7/726: dread d4/d10/d6b/dc5/d36/d3a/d51/d5e/f75 [4194304,4194304] 0 2024-09-17T01:07:24.561 INFO:tasks.workunit.client.0.smithi103.stdout:7/727: dwrite d4/d11/d34/f41 [0,4194304] 0 2024-09-17T01:07:24.564 INFO:tasks.workunit.client.0.smithi103.stdout:7/728: symlink d4/d11/d3f/d63/lfb 0 2024-09-17T01:07:24.567 INFO:tasks.workunit.client.0.smithi103.stdout:7/729: mkdir d4/d11/d80/d8c/dfc 0 2024-09-17T01:07:24.567 INFO:tasks.workunit.client.0.smithi103.stdout:7/730: read - d4/d10/d6b/d9f/fda zero size 2024-09-17T01:07:24.572 INFO:tasks.workunit.client.0.smithi103.stdout:7/731: dread d4/d11/f5f [0,4194304] 0 2024-09-17T01:07:24.573 INFO:tasks.workunit.client.0.smithi103.stdout:7/732: write d4/d11/d34/f41 [2865625,48523] 0 2024-09-17T01:07:24.577 INFO:tasks.workunit.client.0.smithi103.stdout:7/733: mkdir d4/d10/d6b/dc5/d36/d3a/d51/d5e/dfd 0 2024-09-17T01:07:24.580 INFO:tasks.workunit.client.0.smithi103.stdout:7/734: creat d4/d10/d37/d95/ffe x:0 0 0 2024-09-17T01:07:24.581 INFO:tasks.workunit.client.0.smithi103.stdout:7/735: write d4/d10/d6b/dc5/f65 [2165629,6849] 0 2024-09-17T01:07:24.586 INFO:tasks.workunit.client.0.smithi103.stdout:7/736: rename d4/d10/d6b/d72 to d4/d4a/d4b/d8a/dff 0 2024-09-17T01:07:24.588 INFO:tasks.workunit.client.0.smithi103.stdout:7/737: mkdir d4/d11/d80/d100 0 2024-09-17T01:07:24.589 INFO:tasks.workunit.client.0.smithi103.stdout:7/738: fsync d4/d4a/f78 0 2024-09-17T01:07:24.593 INFO:tasks.workunit.client.0.smithi103.stdout:7/739: dread d4/d10/d6b/dc5/d8d/fbc [0,4194304] 0 2024-09-17T01:07:24.611 INFO:tasks.workunit.client.0.smithi103.stdout:7/740: dwrite d4/d4a/d4b/d8a/dff/db8/fd6 [0,4194304] 0 2024-09-17T01:07:24.616 INFO:tasks.workunit.client.0.smithi103.stdout:7/741: mknod d4/d11/d34/db5/de9/c101 0 2024-09-17T01:07:24.620 INFO:tasks.workunit.client.0.smithi103.stdout:7/742: read d4/d11/d3f/d63/fa8 [666810,74263] 0 2024-09-17T01:07:24.629 INFO:tasks.workunit.client.0.smithi103.stdout:7/743: write d4/d10/d43/dc8/fbf [217146,66703] 0 2024-09-17T01:07:24.631 INFO:tasks.workunit.client.0.smithi103.stdout:7/744: creat d4/d10/d43/df5/f102 x:0 0 0 2024-09-17T01:07:24.632 INFO:tasks.workunit.client.0.smithi103.stdout:7/745: readlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/la6 0 2024-09-17T01:07:24.633 INFO:tasks.workunit.client.0.smithi103.stdout:7/746: rename d4/d10/d6b/dc5/d36/d3a to d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/df2/d103 22 2024-09-17T01:07:24.635 INFO:tasks.workunit.client.0.smithi103.stdout:7/747: symlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/l104 0 2024-09-17T01:07:24.639 INFO:tasks.workunit.client.0.smithi103.stdout:7/748: getdents d4/d11/d80/d8c 0 2024-09-17T01:07:24.642 INFO:tasks.workunit.client.0.smithi103.stdout:7/749: creat d4/d11/d80/f105 x:0 0 0 2024-09-17T01:07:24.646 INFO:tasks.workunit.client.0.smithi103.stdout:7/750: creat d4/d10/d66/f106 x:0 0 0 2024-09-17T01:07:24.650 INFO:tasks.workunit.client.0.smithi103.stdout:7/751: truncate d4/d10/d6b/dc5/d8d/d92/f93 2302235 0 2024-09-17T01:07:24.654 INFO:tasks.workunit.client.0.smithi103.stdout:7/752: creat d4/d10/d6b/dc5/d8d/f107 x:0 0 0 2024-09-17T01:07:24.655 INFO:tasks.workunit.client.0.smithi103.stdout:7/753: dread - d4/d10/d32/fc4 zero size 2024-09-17T01:07:24.656 INFO:tasks.workunit.client.0.smithi103.stdout:7/754: fsync d4/d10/f56 0 2024-09-17T01:07:24.658 INFO:tasks.workunit.client.0.smithi103.stdout:7/755: read d4/d10/d37/d95/fdc [763594,112663] 0 2024-09-17T01:07:24.659 INFO:tasks.workunit.client.0.smithi103.stdout:7/756: dread - d4/d10/d43/fea zero size 2024-09-17T01:07:24.663 INFO:tasks.workunit.client.0.smithi103.stdout:7/757: rename d4/d10/d6b/dc5/d8d/d92/f93 to d4/d11/d80/db1/f108 0 2024-09-17T01:07:24.802 INFO:tasks.workunit.client.0.smithi103.stdout:4/717: sync 2024-09-17T01:07:24.802 INFO:tasks.workunit.client.0.smithi103.stdout:9/683: sync 2024-09-17T01:07:24.803 INFO:tasks.workunit.client.0.smithi103.stdout:0/773: sync 2024-09-17T01:07:24.803 INFO:tasks.workunit.client.0.smithi103.stdout:3/834: sync 2024-09-17T01:07:24.803 INFO:tasks.workunit.client.0.smithi103.stdout:0/774: stat dd/df/d68/d6c/fb9 0 2024-09-17T01:07:24.805 INFO:tasks.workunit.client.0.smithi103.stdout:9/684: write d7/d43/d88/d11/f12 [4780010,29591] 0 2024-09-17T01:07:24.809 INFO:tasks.workunit.client.0.smithi103.stdout:3/835: symlink d3/d16/d1b/d3c/d65/d75/dd1/l11d 0 2024-09-17T01:07:24.810 INFO:tasks.workunit.client.0.smithi103.stdout:3/836: truncate d3/d16/d90/f114 166816 0 2024-09-17T01:07:24.816 INFO:tasks.workunit.client.0.smithi103.stdout:4/718: write d9/d16/d23/d52/d91/dd4/fdc [1016726,57848] 0 2024-09-17T01:07:24.817 INFO:tasks.workunit.client.0.smithi103.stdout:0/775: getdents dd/df/d68/d6c/d8e/dca/d101 0 2024-09-17T01:07:24.818 INFO:tasks.workunit.client.0.smithi103.stdout:4/719: write d9/fb9 [1380595,95010] 0 2024-09-17T01:07:24.820 INFO:tasks.workunit.client.0.smithi103.stdout:4/720: read - d9/d10/fa7 zero size 2024-09-17T01:07:24.821 INFO:tasks.workunit.client.0.smithi103.stdout:9/685: link d7/f19 d7/d43/d88/d11/d5c/d8d/fe7 0 2024-09-17T01:07:24.822 INFO:tasks.workunit.client.0.smithi103.stdout:3/837: dwrite d3/d16/fca [0,4194304] 0 2024-09-17T01:07:24.823 INFO:tasks.workunit.client.0.smithi103.stdout:9/686: chown d7/d43/d5f/d7d/d80/c8f 13 1 2024-09-17T01:07:24.825 INFO:tasks.workunit.client.0.smithi103.stdout:0/776: mkdir dd/df/d38/d62/d102 0 2024-09-17T01:07:24.827 INFO:tasks.workunit.client.0.smithi103.stdout:3/838: write d3/d16/d1b/f89 [5235926,48495] 0 2024-09-17T01:07:24.828 INFO:tasks.workunit.client.0.smithi103.stdout:1/719: sync 2024-09-17T01:07:24.828 INFO:tasks.workunit.client.0.smithi103.stdout:5/538: sync 2024-09-17T01:07:24.828 INFO:tasks.workunit.client.0.smithi103.stdout:6/780: sync 2024-09-17T01:07:24.828 INFO:tasks.workunit.client.0.smithi103.stdout:7/758: sync 2024-09-17T01:07:24.828 INFO:tasks.workunit.client.0.smithi103.stdout:8/554: sync 2024-09-17T01:07:24.828 INFO:tasks.workunit.client.0.smithi103.stdout:2/820: sync 2024-09-17T01:07:24.832 INFO:tasks.workunit.client.0.smithi103.stdout:0/777: rmdir dd/df/d68/db5 39 2024-09-17T01:07:24.833 INFO:tasks.workunit.client.0.smithi103.stdout:5/539: write d6/d2c/d38/d4c/d50/f4f [2636185,124669] 0 2024-09-17T01:07:24.839 INFO:tasks.workunit.client.0.smithi103.stdout:6/781: dwrite d3/d16/fbc [0,4194304] 0 2024-09-17T01:07:24.848 INFO:tasks.workunit.client.0.smithi103.stdout:4/721: link d9/d16/d38/d3f/l4d d9/d16/d23/d2a/ldd 0 2024-09-17T01:07:24.850 INFO:tasks.workunit.client.0.smithi103.stdout:8/555: creat d0/d6/dc/d30/d25/d7d/faf x:0 0 0 2024-09-17T01:07:24.851 INFO:tasks.workunit.client.0.smithi103.stdout:9/687: truncate d7/d43/d88/f9b 1294266 0 2024-09-17T01:07:24.858 INFO:tasks.workunit.client.0.smithi103.stdout:6/782: truncate f1 3413626 0 2024-09-17T01:07:24.860 INFO:tasks.workunit.client.0.smithi103.stdout:9/688: chown d7/d43/d88/d11/d5c/d5e/d6c/f84 2096 1 2024-09-17T01:07:24.860 INFO:tasks.workunit.client.0.smithi103.stdout:6/783: chown d3/d25/d74/c9d 663574 1 2024-09-17T01:07:24.861 INFO:tasks.workunit.client.0.smithi103.stdout:3/839: dwrite d3/d16/d1b/d3c/d65/d75/d9c/dd3/fe4 [0,4194304] 0 2024-09-17T01:07:24.864 INFO:tasks.workunit.client.0.smithi103.stdout:5/540: dread d6/d2c/f3d [0,4194304] 0 2024-09-17T01:07:24.864 INFO:tasks.workunit.client.0.smithi103.stdout:3/840: chown d3/d16/d1b/d3c/d65/d75/f84 51835 1 2024-09-17T01:07:24.864 INFO:tasks.workunit.client.0.smithi103.stdout:4/722: dread d9/d16/d45/d5e/f7a [0,4194304] 0 2024-09-17T01:07:24.865 INFO:tasks.workunit.client.0.smithi103.stdout:5/541: stat d6/d2c/d38/d4c/d54/c9e 0 2024-09-17T01:07:24.909 INFO:tasks.workunit.client.0.smithi103.stdout:2/821: mkdir d6/da/d5d/d8d/d60/d119 0 2024-09-17T01:07:24.910 INFO:tasks.workunit.client.0.smithi103.stdout:2/822: write d6/d5f/f29 [1634276,42160] 0 2024-09-17T01:07:24.911 INFO:tasks.workunit.client.0.smithi103.stdout:0/778: mknod dd/d1c/c103 0 2024-09-17T01:07:24.913 INFO:tasks.workunit.client.0.smithi103.stdout:1/720: symlink d2/d16/d51/d65/lea 0 2024-09-17T01:07:24.917 INFO:tasks.workunit.client.0.smithi103.stdout:0/779: dread dd/d4f/f48 [4194304,4194304] 0 2024-09-17T01:07:24.917 INFO:tasks.workunit.client.0.smithi103.stdout:3/841: dread - d3/d16/d1b/d3c/d65/d7e/dac/dce/f96 zero size 2024-09-17T01:07:24.918 INFO:tasks.workunit.client.0.smithi103.stdout:0/780: write dd/df/d38/fbe [308681,30446] 0 2024-09-17T01:07:24.922 INFO:tasks.workunit.client.0.smithi103.stdout:8/556: symlink d0/d6/dc/d30/d25/d7d/d99/lb0 0 2024-09-17T01:07:24.923 INFO:tasks.workunit.client.0.smithi103.stdout:1/721: symlink d2/de/leb 0 2024-09-17T01:07:24.931 INFO:tasks.workunit.client.0.smithi103.stdout:7/759: getdents d4/d10/d6b/dc5/d8d 0 2024-09-17T01:07:24.932 INFO:tasks.workunit.client.0.smithi103.stdout:2/823: symlink d6/d5f/d26/d66/l11a 0 2024-09-17T01:07:24.937 INFO:tasks.workunit.client.0.smithi103.stdout:8/557: mknod d0/d6/dc/d30/d25/d64/cb1 0 2024-09-17T01:07:24.937 INFO:tasks.workunit.client.0.smithi103.stdout:0/781: dwrite f6 [0,4194304] 0 2024-09-17T01:07:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 -- 172.21.15.103:0/2661258692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 msgr2=0x7f90080fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 --2- 172.21.15.103:0/2661258692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f90080fee30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009880 tx=0x7f8ffc02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:07:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 -- 172.21.15.103:0/2661258692 shutdown_connections 2024-09-17T01:07:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 --2- 172.21.15.103:0/2661258692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90080ffc30 0x7f90081000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:24.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 --2- 172.21.15.103:0/2661258692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f90080fee30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:24.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 -- 172.21.15.103:0/2661258692 >> 172.21.15.103:0/2661258692 conn(0x7f90080fa1c0 msgr2=0x7f90080fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:24.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.946+0000 7f900e00d640 1 -- 172.21.15.103:0/2661258692 shutdown_connections 2024-09-17T01:07:24.945 INFO:tasks.workunit.client.0.smithi103.stdout:4/723: creat d9/fde x:0 0 0 2024-09-17T01:07:24.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.947+0000 7f900e00d640 1 -- 172.21.15.103:0/2661258692 wait complete. 2024-09-17T01:07:24.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.948+0000 7f900e00d640 1 Processor -- start 2024-09-17T01:07:24.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.948+0000 7f900e00d640 1 -- start start 2024-09-17T01:07:24.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.948+0000 7f900e00d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f9008194330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:24.947 INFO:tasks.workunit.client.0.smithi103.stdout:5/542: rename d6/db/fd to d6/fc9 0 2024-09-17T01:07:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.948+0000 7f900e00d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90080ffc30 0x7f9008194870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.948+0000 7f900e00d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9008194e40 con 0x7f90080ffc30 2024-09-17T01:07:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.948+0000 7f900e00d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9008194fb0 con 0x7f90080fea30 2024-09-17T01:07:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f9008194330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f9008194330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:59054/0 (socket says 172.21.15.103:59054) 2024-09-17T01:07:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 -- 172.21.15.103:0/2251186818 learned_addr learned my addr 172.21.15.103:0/2251186818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f9006ffd640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90080ffc30 0x7f9008194870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:24.948 INFO:tasks.workunit.client.0.smithi103.stdout:6/784: write d3/d25/d26/f2e [1370370,62856] 0 2024-09-17T01:07:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 -- 172.21.15.103:0/2251186818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90080ffc30 msgr2=0x7f9008194870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90080ffc30 0x7f9008194870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 -- 172.21.15.103:0/2251186818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009560 con 0x7f90080fea30 2024-09-17T01:07:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.949+0000 7f90077fe640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f9008194330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009230 tx=0x7f8ffc0048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.950+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ffc03c8e0 con 0x7f90080fea30 2024-09-17T01:07:24.949 INFO:tasks.workunit.client.0.smithi103.stdout:6/785: readlink d3/l72 0 2024-09-17T01:07:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.950+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ffc031440 con 0x7f90080fea30 2024-09-17T01:07:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.950+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ffc0445b0 con 0x7f90080fea30 2024-09-17T01:07:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.950+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9008067d20 con 0x7f90080fea30 2024-09-17T01:07:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.950+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90080681d0 con 0x7f90080fea30 2024-09-17T01:07:24.950 INFO:tasks.workunit.client.0.smithi103.stdout:3/842: creat d3/d81/dd6/f11e x:0 0 0 2024-09-17T01:07:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.952+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9008107770 con 0x7f90080fea30 2024-09-17T01:07:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.952+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f8ffc03ca40 con 0x7f90080fea30 2024-09-17T01:07:24.951 INFO:tasks.workunit.client.0.smithi103.stdout:3/843: stat d3/d16/d1b/d36/c77 0 2024-09-17T01:07:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.953+0000 7f9004ff9640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8ff006d9a0 0x7f8ff006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.953+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f8ffc0ae2b0 con 0x7f90080fea30 2024-09-17T01:07:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.953+0000 7f9006ffd640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8ff006d9a0 0x7f8ff006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.954+0000 7f9006ffd640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8ff006d9a0 0x7f8ff006fe60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9008195850 tx=0x7f9000009680 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:24.953 INFO:tasks.workunit.client.0.smithi103.stdout:0/782: fsync dd/df/d38/f63 0 2024-09-17T01:07:24.954 INFO:tasks.workunit.client.0.smithi103.stdout:2/824: read d6/d5f/d26/d66/df/f4c [2644549,17325] 0 2024-09-17T01:07:24.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:24.958+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f8ffc077920 con 0x7f90080fea30 2024-09-17T01:07:24.956 INFO:tasks.workunit.client.0.smithi103.stdout:9/689: getdents d7/d43/d88/d11/d5c/d8d/dac 0 2024-09-17T01:07:24.958 INFO:tasks.workunit.client.0.smithi103.stdout:4/724: dread d9/d16/d23/d32/f98 [0,4194304] 0 2024-09-17T01:07:24.959 INFO:tasks.workunit.client.0.smithi103.stdout:0/783: write dd/d43/f72 [2388099,61948] 0 2024-09-17T01:07:24.964 INFO:tasks.workunit.client.0.smithi103.stdout:0/784: stat dd/df/d68/ddc/ffa 0 2024-09-17T01:07:24.967 INFO:tasks.workunit.client.0.smithi103.stdout:3/844: dwrite d3/d16/d1b/d3c/d65/d75/dbe/d34/f107 [0,4194304] 0 2024-09-17T01:07:24.968 INFO:tasks.workunit.client.0.smithi103.stdout:5/543: dread - d6/d2c/d32/d55/f80 zero size 2024-09-17T01:07:24.969 INFO:tasks.workunit.client.0.smithi103.stdout:1/722: dwrite d2/d1c/d20/f64 [0,4194304] 0 2024-09-17T01:07:24.972 INFO:tasks.workunit.client.0.smithi103.stdout:7/760: creat d4/d10/d6b/dc5/d36/d3a/d51/d5e/f109 x:0 0 0 2024-09-17T01:07:24.973 INFO:tasks.workunit.client.0.smithi103.stdout:3/845: chown d3/d16/d1b/d3c/d65/f9b 2682 1 2024-09-17T01:07:24.976 INFO:tasks.workunit.client.0.smithi103.stdout:8/558: rename d0/d80/ca4 to d0/d6/dc/cb2 0 2024-09-17T01:07:24.978 INFO:tasks.workunit.client.0.smithi103.stdout:6/786: mknod d3/d16/d33/d57/d63/dc4/c10c 0 2024-09-17T01:07:24.979 INFO:tasks.workunit.client.0.smithi103.stdout:6/787: chown d3/d16/de3 527029391 1 2024-09-17T01:07:24.980 INFO:tasks.workunit.client.0.smithi103.stdout:0/785: mknod dd/df/d38/c104 0 2024-09-17T01:07:24.981 INFO:tasks.workunit.client.0.smithi103.stdout:6/788: stat d3/f64 0 2024-09-17T01:07:24.984 INFO:tasks.workunit.client.0.smithi103.stdout:1/723: creat d2/d16/d51/d79/fec x:0 0 0 2024-09-17T01:07:24.985 INFO:tasks.workunit.client.0.smithi103.stdout:2/825: write d6/da/f82 [2535,127486] 0 2024-09-17T01:07:24.985 INFO:tasks.workunit.client.0.smithi103.stdout:6/789: chown d3/d16/d33/f8d 882303760 1 2024-09-17T01:07:24.989 INFO:tasks.workunit.client.0.smithi103.stdout:7/761: dwrite d4/d4a/d4b/fe2 [0,4194304] 0 2024-09-17T01:07:24.991 INFO:tasks.workunit.client.0.smithi103.stdout:3/846: fdatasync d3/f57 0 2024-09-17T01:07:24.994 INFO:tasks.workunit.client.0.smithi103.stdout:9/690: dwrite d7/db8/dbb/f5b [4194304,4194304] 0 2024-09-17T01:07:24.995 INFO:tasks.workunit.client.0.smithi103.stdout:2/826: truncate d6/d5f/f29 3191071 0 2024-09-17T01:07:24.996 INFO:tasks.workunit.client.0.smithi103.stdout:8/559: creat d0/d6/dc/d3d/d88/fb3 x:0 0 0 2024-09-17T01:07:25.002 INFO:tasks.workunit.client.0.smithi103.stdout:0/786: dread dd/d4f/f81 [0,4194304] 0 2024-09-17T01:07:25.004 INFO:tasks.workunit.client.0.smithi103.stdout:2/827: mkdir d6/d5f/d26/d34/d11b 0 2024-09-17T01:07:25.006 INFO:tasks.workunit.client.0.smithi103.stdout:9/691: dwrite d7/d43/d88/d11/f12 [0,4194304] 0 2024-09-17T01:07:25.008 INFO:tasks.workunit.client.0.smithi103.stdout:8/560: fsync d0/d6/f4f 0 2024-09-17T01:07:25.014 INFO:tasks.workunit.client.0.smithi103.stdout:3/847: read - d3/d16/d1b/d3c/d65/d75/d8d/fed zero size 2024-09-17T01:07:25.020 INFO:tasks.workunit.client.0.smithi103.stdout:6/790: dwrite d3/d16/dad/f7f [0,4194304] 0 2024-09-17T01:07:25.023 INFO:tasks.workunit.client.0.smithi103.stdout:4/725: rename d9/d16/d45/d76/fc7 to d9/d16/fdf 0 2024-09-17T01:07:25.023 INFO:tasks.workunit.client.0.smithi103.stdout:2/828: dwrite d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/f10c [0,4194304] 0 2024-09-17T01:07:25.027 INFO:tasks.workunit.client.0.smithi103.stdout:5/544: dread d6/d11/d81/fac [0,4194304] 0 2024-09-17T01:07:25.028 INFO:tasks.workunit.client.0.smithi103.stdout:7/762: fsync d4/d10/d4e/f69 0 2024-09-17T01:07:25.031 INFO:tasks.workunit.client.0.smithi103.stdout:2/829: read d6/d5f/dad/fd6 [2830904,114421] 0 2024-09-17T01:07:25.031 INFO:tasks.workunit.client.0.smithi103.stdout:1/724: creat d2/d16/d51/d65/da7/fed x:0 0 0 2024-09-17T01:07:25.037 INFO:tasks.workunit.client.0.smithi103.stdout:3/848: symlink d3/d16/d1b/d3c/d65/d75/d8d/l11f 0 2024-09-17T01:07:25.038 INFO:tasks.workunit.client.0.smithi103.stdout:0/787: rename dd/d1c/cd7 to dd/d4f/d97/c105 0 2024-09-17T01:07:25.039 INFO:tasks.workunit.client.0.smithi103.stdout:4/726: unlink d9/d16/d23/d52/c77 0 2024-09-17T01:07:25.041 INFO:tasks.workunit.client.0.smithi103.stdout:2/830: rmdir d6/d5f/d26/d66/da8 39 2024-09-17T01:07:25.042 INFO:tasks.workunit.client.0.smithi103.stdout:2/831: chown d6/d5f/d26/d66/df/d68/la7 0 1 2024-09-17T01:07:25.046 INFO:tasks.workunit.client.0.smithi103.stdout:1/725: unlink d2/d7/l9 0 2024-09-17T01:07:25.047 INFO:tasks.workunit.client.0.smithi103.stdout:1/726: read - d2/d1c/d28/d4b/d67/d9e/daf/fda zero size 2024-09-17T01:07:25.050 INFO:tasks.workunit.client.0.smithi103.stdout:7/763: rename d4/d11/d80 to d4/d4a/d4b/d8a/dff/db8/d10a 0 2024-09-17T01:07:25.052 INFO:tasks.workunit.client.0.smithi103.stdout:7/764: write d4/d11/d34/db5/fb0 [2101595,24173] 0 2024-09-17T01:07:25.056 INFO:tasks.workunit.client.0.smithi103.stdout:5/545: mkdir d6/db/dca 0 2024-09-17T01:07:25.058 INFO:tasks.workunit.client.0.smithi103.stdout:7/765: dwrite d4/d10/fd3 [0,4194304] 0 2024-09-17T01:07:25.061 INFO:tasks.workunit.client.0.smithi103.stdout:9/692: truncate d7/d43/d88/d11/d5c/d5e/d6c/d6e/fd2 201790 0 2024-09-17T01:07:25.065 INFO:tasks.workunit.client.0.smithi103.stdout:4/727: creat d9/d16/d45/d76/fe0 x:0 0 0 2024-09-17T01:07:25.066 INFO:tasks.workunit.client.0.smithi103.stdout:2/832: fdatasync d6/fb 0 2024-09-17T01:07:25.068 INFO:tasks.workunit.client.0.smithi103.stdout:8/561: creat d0/d6/dc/fb4 x:0 0 0 2024-09-17T01:07:25.072 INFO:tasks.workunit.client.0.smithi103.stdout:0/788: dwrite dd/df/d38/f60 [0,4194304] 0 2024-09-17T01:07:25.075 INFO:tasks.workunit.client.0.smithi103.stdout:4/728: creat d9/d16/d45/fe1 x:0 0 0 2024-09-17T01:07:25.080 INFO:tasks.workunit.client.0.smithi103.stdout:3/849: creat d3/d16/f120 x:0 0 0 2024-09-17T01:07:25.082 INFO:tasks.workunit.client.0.smithi103.stdout:6/791: getdents d3/d16/d21/dab 0 2024-09-17T01:07:25.086 INFO:tasks.workunit.client.0.smithi103.stdout:1/727: creat d2/d7/d73/db8/fee x:0 0 0 2024-09-17T01:07:25.090 INFO:tasks.workunit.client.0.smithi103.stdout:7/766: creat d4/d10/d66/dd2/de7/f10b x:0 0 0 2024-09-17T01:07:25.093 INFO:tasks.workunit.client.0.smithi103.stdout:4/729: dread d9/d16/d38/d3f/f6f [0,4194304] 0 2024-09-17T01:07:25.094 INFO:tasks.workunit.client.0.smithi103.stdout:2/833: mknod d6/da/d5d/d8d/d60/d75/c11c 0 2024-09-17T01:07:25.095 INFO:tasks.workunit.client.0.smithi103.stdout:3/850: mknod d3/dd7/c121 0 2024-09-17T01:07:25.099 INFO:tasks.workunit.client.0.smithi103.stdout:5/546: rename d6/d7d to d6/d28/dcb 0 2024-09-17T01:07:25.100 INFO:tasks.workunit.client.0.smithi103.stdout:1/728: mknod d2/d1c/d28/d4b/d67/d9e/daf/cef 0 2024-09-17T01:07:25.101 INFO:tasks.workunit.client.0.smithi103.stdout:0/789: symlink dd/d43/l106 0 2024-09-17T01:07:25.103 INFO:tasks.workunit.client.0.smithi103.stdout:7/767: truncate d4/d11/d3f/d63/fa8 977698 0 2024-09-17T01:07:25.105 INFO:tasks.workunit.client.0.smithi103.stdout:9/693: link d7/d43/d88/d11/d20/d4f/d95/d9a/dc0/ld4 d7/db4/ddc/le8 0 2024-09-17T01:07:25.108 INFO:tasks.workunit.client.0.smithi103.stdout:6/792: symlink d3/d16/d33/l10d 0 2024-09-17T01:07:25.113 INFO:tasks.workunit.client.0.smithi103.stdout:1/729: dread d2/d1c/d20/d33/f59 [0,4194304] 0 2024-09-17T01:07:25.114 INFO:tasks.workunit.client.0.smithi103.stdout:4/730: dwrite d9/d16/d38/d3f/f6f [0,4194304] 0 2024-09-17T01:07:25.116 INFO:tasks.workunit.client.0.smithi103.stdout:2/834: rename d6/d5f/f29 to d6/d5f/d26/d66/df/db7/f11d 0 2024-09-17T01:07:25.121 INFO:tasks.workunit.client.0.smithi103.stdout:9/694: dread d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 [0,4194304] 0 2024-09-17T01:07:25.124 INFO:tasks.workunit.client.0.smithi103.stdout:3/851: write d3/d16/d1b/d3c/d65/d7e/fb7 [990680,54814] 0 2024-09-17T01:07:25.125 INFO:tasks.workunit.client.0.smithi103.stdout:3/852: chown d3/d16/fcb 0 1 2024-09-17T01:07:25.126 INFO:tasks.workunit.client.0.smithi103.stdout:1/730: truncate d2/d7/d4e/f7b 1962576 0 2024-09-17T01:07:25.126 INFO:tasks.workunit.client.0.smithi103.stdout:3/853: write d3/f9 [474752,25724] 0 2024-09-17T01:07:25.129 INFO:tasks.workunit.client.0.smithi103.stdout:0/790: mkdir dd/df/d68/d6c/dc3/d107 0 2024-09-17T01:07:25.129 INFO:tasks.workunit.client.0.smithi103.stdout:0/791: stat dd/df/d38/d55/fb8 0 2024-09-17T01:07:25.132 INFO:tasks.workunit.client.0.smithi103.stdout:7/768: rename d4/d4a/d4b/l84 to d4/d10/d6b/d9f/l10c 0 2024-09-17T01:07:25.135 INFO:tasks.workunit.client.0.smithi103.stdout:2/835: mkdir d6/da/d5d/d8d/d89/d11e 0 2024-09-17T01:07:25.140 INFO:tasks.workunit.client.0.smithi103.stdout:2/836: write d6/da/f8c [3610728,71636] 0 2024-09-17T01:07:25.140 INFO:tasks.workunit.client.0.smithi103.stdout:0/792: dwrite dd/f77 [0,4194304] 0 2024-09-17T01:07:25.143 INFO:tasks.workunit.client.0.smithi103.stdout:9/695: unlink d7/d43/d88/d11/d5c/fa1 0 2024-09-17T01:07:25.144 INFO:tasks.workunit.client.0.smithi103.stdout:2/837: readlink d6/d5f/d26/l84 0 2024-09-17T01:07:25.145 INFO:tasks.workunit.client.0.smithi103.stdout:4/731: dwrite d9/d16/d38/d3f/f7c [0,4194304] 0 2024-09-17T01:07:25.147 INFO:tasks.workunit.client.0.smithi103.stdout:9/696: write d7/db8/dbb/f69 [2484572,110352] 0 2024-09-17T01:07:25.149 INFO:tasks.workunit.client.0.smithi103.stdout:3/854: dread d3/d44/f71 [0,4194304] 0 2024-09-17T01:07:25.150 INFO:tasks.workunit.client.0.smithi103.stdout:9/697: readlink d7/d43/d88/d11/d5c/d5e/d6c/l81 0 2024-09-17T01:07:25.157 INFO:tasks.workunit.client.0.smithi103.stdout:5/547: link d6/d2c/d38/d6f/l76 d6/d2c/d38/d4c/d9a/lcc 0 2024-09-17T01:07:25.160 INFO:tasks.workunit.client.0.smithi103.stdout:2/838: creat d6/da/d5d/d8d/d60/d104/f11f x:0 0 0 2024-09-17T01:07:25.160 INFO:tasks.workunit.client.0.smithi103.stdout:0/793: dread dd/df/f39 [0,4194304] 0 2024-09-17T01:07:25.162 INFO:tasks.workunit.client.0.smithi103.stdout:3/855: symlink d3/d16/d1b/d86/l122 0 2024-09-17T01:07:25.163 INFO:tasks.workunit.client.0.smithi103.stdout:0/794: read - dd/d4f/d64/fd5 zero size 2024-09-17T01:07:25.169 INFO:tasks.workunit.client.0.smithi103.stdout:5/548: mknod d6/d2c/d38/d6f/ccd 0 2024-09-17T01:07:25.170 INFO:tasks.workunit.client.0.smithi103.stdout:5/549: chown d6/d28/f9f 33794 1 2024-09-17T01:07:25.171 INFO:tasks.workunit.client.0.smithi103.stdout:3/856: dwrite d3/d16/d1b/d3c/d65/d83/dbf/ff0 [0,4194304] 0 2024-09-17T01:07:25.175 INFO:tasks.workunit.client.0.smithi103.stdout:4/732: write d9/dc/df/fc5 [106009,118694] 0 2024-09-17T01:07:25.179 INFO:tasks.workunit.client.0.smithi103.stdout:6/793: link d3/d16/f1b d3/d16/f10e 0 2024-09-17T01:07:25.181 INFO:tasks.workunit.client.0.smithi103.stdout:7/769: link d4/d10/d6b/dc5/d36/d3a/d51/d5e/c86 d4/d4a/d4b/d8a/dff/c10d 0 2024-09-17T01:07:25.184 INFO:tasks.workunit.client.0.smithi103.stdout:6/794: fdatasync d3/d16/d33/d57/d63/d60/de7/ff6 0 2024-09-17T01:07:25.186 INFO:tasks.workunit.client.0.smithi103.stdout:1/731: getdents d2/d7 0 2024-09-17T01:07:25.186 INFO:tasks.workunit.client.0.smithi103.stdout:2/839: dwrite d6/d5f/d26/d66/df/d68/d7e/d8b/fd5 [0,4194304] 0 2024-09-17T01:07:25.188 INFO:tasks.workunit.client.0.smithi103.stdout:0/795: mkdir dd/df/d108 0 2024-09-17T01:07:25.190 INFO:tasks.workunit.client.0.smithi103.stdout:7/770: fsync d4/d11/f5f 0 2024-09-17T01:07:25.191 INFO:tasks.workunit.client.0.smithi103.stdout:9/698: dwrite d7/d43/d88/f38 [0,4194304] 0 2024-09-17T01:07:25.203 INFO:tasks.workunit.client.0.smithi103.stdout:4/733: symlink d9/le2 0 2024-09-17T01:07:25.204 INFO:tasks.workunit.client.0.smithi103.stdout:7/771: fdatasync d4/d10/d6b/dc5/d36/d82/f8f 0 2024-09-17T01:07:25.206 INFO:tasks.workunit.client.0.smithi103.stdout:2/840: mkdir d6/da/d3f/d120 0 2024-09-17T01:07:25.209 INFO:tasks.workunit.client.0.smithi103.stdout:2/841: stat d6/d5f/d26/d66/df/d68/d7e/d9c/db4/cb8 0 2024-09-17T01:07:25.210 INFO:tasks.workunit.client.0.smithi103.stdout:1/732: symlink d2/d1c/d28/lf0 0 2024-09-17T01:07:25.211 INFO:tasks.workunit.client.0.smithi103.stdout:5/550: write d6/d2c/d38/f6c [339613,130310] 0 2024-09-17T01:07:25.211 INFO:tasks.workunit.client.0.smithi103.stdout:0/796: mkdir dd/d1c/d109 0 2024-09-17T01:07:25.219 INFO:tasks.workunit.client.0.smithi103.stdout:3/857: dread d3/d16/d1b/d3c/f35 [0,4194304] 0 2024-09-17T01:07:25.221 INFO:tasks.workunit.client.0.smithi103.stdout:6/795: dwrite d3/d25/d26/f8a [0,4194304] 0 2024-09-17T01:07:25.227 INFO:tasks.workunit.client.0.smithi103.stdout:6/796: write d3/d16/d33/d3e/f98 [281823,41480] 0 2024-09-17T01:07:25.232 INFO:tasks.workunit.client.0.smithi103.stdout:9/699: dwrite d7/d43/d88/d11/d5c/d5e/d6c/f84 [0,4194304] 0 2024-09-17T01:07:25.233 INFO:tasks.workunit.client.0.smithi103.stdout:4/734: dread d9/d16/d44/f68 [0,4194304] 0 2024-09-17T01:07:25.237 INFO:tasks.workunit.client.0.smithi103.stdout:4/735: read d9/d16/d45/d5e/fa5 [1468367,80992] 0 2024-09-17T01:07:25.239 INFO:tasks.workunit.client.0.smithi103.stdout:0/797: rmdir dd/d1c/d9f/dbb 39 2024-09-17T01:07:25.239 INFO:tasks.workunit.client.0.smithi103.stdout:4/736: chown d9/d16/d23/d52/fce 47 1 2024-09-17T01:07:25.245 INFO:tasks.workunit.client.0.smithi103.stdout:5/551: dread d6/d2c/d38/d4c/d50/f72 [0,4194304] 0 2024-09-17T01:07:25.246 INFO:tasks.workunit.client.0.smithi103.stdout:3/858: mknod d3/d16/d119/c123 0 2024-09-17T01:07:25.248 INFO:tasks.workunit.client.0.smithi103.stdout:4/737: read - d9/d10/fc2 zero size 2024-09-17T01:07:25.248 INFO:tasks.workunit.client.0.smithi103.stdout:7/772: dwrite d4/d10/d66/f50 [4194304,4194304] 0 2024-09-17T01:07:25.250 INFO:tasks.workunit.client.0.smithi103.stdout:3/859: chown d3/d16/d1b/d3c/d65/d83/dbf/ff0 8 1 2024-09-17T01:07:25.253 INFO:tasks.workunit.client.0.smithi103.stdout:1/733: creat d2/d1c/d28/d52/d69/ff1 x:0 0 0 2024-09-17T01:07:25.255 INFO:tasks.workunit.client.0.smithi103.stdout:9/700: fsync d7/f19 0 2024-09-17T01:07:25.259 INFO:tasks.workunit.client.0.smithi103.stdout:5/552: creat d6/d28/dcb/fce x:0 0 0 2024-09-17T01:07:25.260 INFO:tasks.workunit.client.0.smithi103.stdout:5/553: chown d6/d28/f9f 24394367 1 2024-09-17T01:07:25.261 INFO:tasks.workunit.client.0.smithi103.stdout:5/554: write d6/d28/d90/fc0 [249276,21069] 0 2024-09-17T01:07:25.262 INFO:tasks.workunit.client.0.smithi103.stdout:0/798: mknod dd/df/d38/d62/c10a 0 2024-09-17T01:07:25.263 INFO:tasks.workunit.client.0.smithi103.stdout:0/799: chown dd/d1c/d9f/dd6/de8/fdf 3794 1 2024-09-17T01:07:25.264 INFO:tasks.workunit.client.0.smithi103.stdout:7/773: fsync d4/d10/f56 0 2024-09-17T01:07:25.265 INFO:tasks.workunit.client.0.smithi103.stdout:4/738: dread d9/dc/f8e [0,4194304] 0 2024-09-17T01:07:25.266 INFO:tasks.workunit.client.0.smithi103.stdout:3/860: creat d3/d16/d1b/d3c/d65/d7e/da3/df5/f124 x:0 0 0 2024-09-17T01:07:25.266 INFO:tasks.workunit.client.0.smithi103.stdout:7/774: read d4/d4a/d4b/d8a/fab [3088220,21925] 0 2024-09-17T01:07:25.270 INFO:tasks.workunit.client.0.smithi103.stdout:9/701: mknod d7/d43/d88/d11/d5c/d5e/d6c/ce9 0 2024-09-17T01:07:25.272 INFO:tasks.workunit.client.0.smithi103.stdout:2/842: write d6/da/d5d/d8d/d60/fa2 [2535190,29670] 0 2024-09-17T01:07:25.275 INFO:tasks.workunit.client.0.smithi103.stdout:0/800: dwrite dd/d1c/f28 [4194304,4194304] 0 2024-09-17T01:07:25.275 INFO:tasks.workunit.client.0.smithi103.stdout:9/702: stat d7/d43/d88/d11/d20/d4f/f75 0 2024-09-17T01:07:25.275 INFO:tasks.workunit.client.0.smithi103.stdout:1/734: symlink d2/lf2 0 2024-09-17T01:07:25.279 INFO:tasks.workunit.client.0.smithi103.stdout:6/797: dwrite d3/d16/d33/f9f [0,4194304] 0 2024-09-17T01:07:25.279 INFO:tasks.workunit.client.0.smithi103.stdout:9/703: chown d7/d43/d88/d11/d20/d4f/la8 2248973 1 2024-09-17T01:07:25.287 INFO:tasks.workunit.client.0.smithi103.stdout:5/555: mknod d6/d11/ccf 0 2024-09-17T01:07:25.287 INFO:tasks.workunit.client.0.smithi103.stdout:6/798: read d3/dfe/f34 [95515,20836] 0 2024-09-17T01:07:25.288 INFO:tasks.workunit.client.0.smithi103.stdout:6/799: readlink d3/d16/d21/l6a 0 2024-09-17T01:07:25.296 INFO:tasks.workunit.client.0.smithi103.stdout:1/735: rename d2/d1c/d28/d52/c89 to d2/d16/dbf/cf3 0 2024-09-17T01:07:25.297 INFO:tasks.workunit.client.0.smithi103.stdout:1/736: fsync d2/d1c/d20/f83 0 2024-09-17T01:07:25.298 INFO:tasks.workunit.client.0.smithi103.stdout:1/737: readlink d2/d16/lcb 0 2024-09-17T01:07:25.303 INFO:tasks.workunit.client.0.smithi103.stdout:6/800: mkdir d3/d16/d33/d57/d63/d60/da4/d10f 0 2024-09-17T01:07:25.304 INFO:tasks.workunit.client.0.smithi103.stdout:3/861: write d3/f59 [1627273,89899] 0 2024-09-17T01:07:25.305 INFO:tasks.workunit.client.0.smithi103.stdout:6/801: chown d3/l68 47 1 2024-09-17T01:07:25.307 INFO:tasks.workunit.client.0.smithi103.stdout:4/739: write d9/d10/f62 [1667535,89575] 0 2024-09-17T01:07:25.308 INFO:tasks.workunit.client.0.smithi103.stdout:0/801: mkdir dd/df/d68/d10b 0 2024-09-17T01:07:25.311 INFO:tasks.workunit.client.0.smithi103.stdout:1/738: mkdir d2/de/d76/df4 0 2024-09-17T01:07:25.312 INFO:tasks.workunit.client.0.smithi103.stdout:3/862: mknod d3/dd7/c125 0 2024-09-17T01:07:25.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.316+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f900818e530 con 0x7f8ff006d9a0 2024-09-17T01:07:25.314 INFO:tasks.workunit.client.0.smithi103.stdout:4/740: fsync d9/d16/d23/d2a/f93 0 2024-09-17T01:07:25.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.318+0000 7f9004ff9640 1 -- 172.21.15.103:0/2251186818 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f900818e530 con 0x7f8ff006d9a0 2024-09-17T01:07:25.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.321+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8ff006d9a0 msgr2=0x7f8ff006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.321+0000 7f900e00d640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8ff006d9a0 0x7f8ff006fe60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9008195850 tx=0x7f9000009680 comp rx=0 tx=0).stop 2024-09-17T01:07:25.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.321+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 msgr2=0x7f9008194330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.321+0000 7f900e00d640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f9008194330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009230 tx=0x7f8ffc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.321 INFO:tasks.workunit.client.0.smithi103.stdout:4/741: truncate d9/d16/d23/d32/d64/fdb 970089 0 2024-09-17T01:07:25.322 INFO:tasks.workunit.client.0.smithi103.stdout:6/802: mknod d3/d25/d26/c110 0 2024-09-17T01:07:25.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.324+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 shutdown_connections 2024-09-17T01:07:25.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.324+0000 7f900e00d640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90080ffc30 0x7f9008194870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.324+0000 7f900e00d640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8ff006d9a0 0x7f8ff006fe60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.324+0000 7f900e00d640 1 --2- 172.21.15.103:0/2251186818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90080fea30 0x7f9008194330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.325+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 >> 172.21.15.103:0/2251186818 conn(0x7f90080fa1c0 msgr2=0x7f90081031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:25.323 INFO:tasks.workunit.client.0.smithi103.stdout:2/843: dwrite d6/d5f/d26/d66/f55 [0,4194304] 0 2024-09-17T01:07:25.324 INFO:tasks.workunit.client.0.smithi103.stdout:9/704: write d7/d2d/fa5 [730322,78764] 0 2024-09-17T01:07:25.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.327+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 shutdown_connections 2024-09-17T01:07:25.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.327+0000 7f900e00d640 1 -- 172.21.15.103:0/2251186818 wait complete. 2024-09-17T01:07:25.325 INFO:tasks.workunit.client.0.smithi103.stdout:1/739: symlink d2/d1c/d20/d6d/d8d/d94/lf5 0 2024-09-17T01:07:25.326 INFO:tasks.workunit.client.0.smithi103.stdout:2/844: chown d6/da/d5d/d8d/d60/d75/f2a 4 1 2024-09-17T01:07:25.326 INFO:tasks.workunit.client.0.smithi103.stdout:4/742: creat d9/d16/d45/fe3 x:0 0 0 2024-09-17T01:07:25.328 INFO:tasks.workunit.client.0.smithi103.stdout:2/845: stat d6/da/d5d/d8d/d60/d75 0 2024-09-17T01:07:25.328 INFO:tasks.workunit.client.0.smithi103.stdout:5/556: getdents d6/d28/dcb 0 2024-09-17T01:07:25.330 INFO:tasks.workunit.client.0.smithi103.stdout:9/705: chown d7/db8/dbb/c70 264 1 2024-09-17T01:07:25.331 INFO:tasks.workunit.client.0.smithi103.stdout:5/557: chown d6/d2c/d38/d4c/d54/c9e 67 1 2024-09-17T01:07:25.331 INFO:tasks.workunit.client.0.smithi103.stdout:6/803: symlink d3/dfe/dc1/dc3/l111 0 2024-09-17T01:07:25.333 INFO:tasks.workunit.client.0.smithi103.stdout:0/802: rename dd/df/d38/d55/f8a to dd/df/d38/d62/f10c 0 2024-09-17T01:07:25.333 INFO:tasks.workunit.client.0.smithi103.stdout:2/846: chown d6/d5f/d26/d66/df/d68/d7e/d9c/db4 28 1 2024-09-17T01:07:25.334 INFO:tasks.workunit.client.0.smithi103.stdout:4/743: creat d9/d10/d6e/fe4 x:0 0 0 2024-09-17T01:07:25.336 INFO:tasks.workunit.client.0.smithi103.stdout:9/706: unlink d7/d2d/f37 0 2024-09-17T01:07:25.338 INFO:tasks.workunit.client.0.smithi103.stdout:1/740: rename d2/f5d to d2/d1c/d20/dd7/ff6 0 2024-09-17T01:07:25.339 INFO:tasks.workunit.client.0.smithi103.stdout:3/863: write d3/d44/d63/f6c [2347401,128606] 0 2024-09-17T01:07:25.340 INFO:tasks.workunit.client.0.smithi103.stdout:3/864: chown d3/d16/d1b/d3c/d65/df7 5 1 2024-09-17T01:07:25.341 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:07:25.348 INFO:tasks.workunit.client.0.smithi103.stdout:5/558: symlink d6/d2c/d38/d6f/da3/ld0 0 2024-09-17T01:07:25.348 INFO:tasks.workunit.client.0.smithi103.stdout:4/744: fdatasync d9/d16/d44/f57 0 2024-09-17T01:07:25.354 INFO:tasks.workunit.client.0.smithi103.stdout:0/803: mknod dd/df/d108/c10d 0 2024-09-17T01:07:25.355 INFO:tasks.workunit.client.0.smithi103.stdout:4/745: dwrite d9/d16/d23/d32/d61/f95 [0,4194304] 0 2024-09-17T01:07:25.356 INFO:tasks.workunit.client.0.smithi103.stdout:0/804: chown dd/df/d38/d55/dcc 19728 1 2024-09-17T01:07:25.357 INFO:tasks.workunit.client.0.smithi103.stdout:0/805: stat dd/df/d38/d62/fbd 0 2024-09-17T01:07:25.359 INFO:tasks.workunit.client.0.smithi103.stdout:6/804: symlink d3/d16/d33/d57/d63/dff/l112 0 2024-09-17T01:07:25.367 INFO:tasks.workunit.client.0.smithi103.stdout:3/865: fsync d3/d16/d1b/d3c/d65/d7e/dac/fcf 0 2024-09-17T01:07:25.370 INFO:tasks.workunit.client.0.smithi103.stdout:4/746: mkdir d9/d10/de5 0 2024-09-17T01:07:25.375 INFO:tasks.workunit.client.0.smithi103.stdout:9/707: dwrite d7/d43/d88/d11/d20/d4f/f78 [0,4194304] 0 2024-09-17T01:07:25.376 INFO:tasks.workunit.client.0.smithi103.stdout:1/741: dwrite d2/d7/f5a [0,4194304] 0 2024-09-17T01:07:25.377 INFO:tasks.workunit.client.0.smithi103.stdout:1/742: chown d2/d1c/d20 47791 1 2024-09-17T01:07:25.378 INFO:tasks.workunit.client.0.smithi103.stdout:9/708: write d7/d43/d5f/d7d/d80/d93/f94 [2193408,115752] 0 2024-09-17T01:07:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/2066770706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0fea30 msgr2=0x7f8a9c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/2066770706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0fea30 0x7f8a9c0fee30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009880 tx=0x7f8a8c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/2066770706 shutdown_connections 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/2066770706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/2066770706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0fea30 0x7f8a9c0fee30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/2066770706 >> 172.21.15.103:0/2066770706 conn(0x7f8a9c0fa1c0 msgr2=0x7f8a9c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/2066770706 shutdown_connections 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/2066770706 wait complete. 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.433+0000 7f8aa1f3d640 1 Processor -- start 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8aa1f3d640 1 -- start start 2024-09-17T01:07:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8aa1f3d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a9c0fea30 0x7f8a9c195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8aa1f3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8aa1f3d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c196210 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8aa1f3d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c196380 con 0x7f8a9c0fea30 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39080/0 (socket says 172.21.15.103:39080) 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 -- 172.21.15.103:0/3587689124 learned_addr learned my addr 172.21.15.103:0/3587689124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9b7fe640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a9c0fea30 0x7f8a9c195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 -- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a9c0fea30 msgr2=0x7f8a9c195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a9c0fea30 0x7f8a9c195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 -- 172.21.15.103:0/3587689124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c009560 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.434+0000 7f8a9affd640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c195c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000b450 tx=0x7f8a9000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.435+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a90011860 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.435+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a90011e80 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.435+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c19ae20 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.435+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9000f570 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.435+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c19b3c0 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.436+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c0feeb0 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.436+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f8a900103e0 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.437+0000 7f8a98ff9640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8a8406d8a0 0x7f8a8406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:25.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.437+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f8a9008d190 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.437+0000 7f8a9b7fe640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8a8406d8a0 0x7f8a8406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:25.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.437+0000 7f8a9b7fe640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8a8406d8a0 0x7f8a8406fd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009230 tx=0x7f8a8c0314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:25.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.441+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f8a90056800 con 0x7f8a9c0ffc30 2024-09-17T01:07:25.447 INFO:tasks.workunit.client.0.smithi103.stdout:2/847: truncate d6/d5f/f9b 3446858 0 2024-09-17T01:07:25.449 INFO:tasks.workunit.client.0.smithi103.stdout:2/848: write d6/d5f/d26/d66/df/ffc [291272,88942] 0 2024-09-17T01:07:25.450 INFO:tasks.workunit.client.0.smithi103.stdout:6/805: stat d3/dfe/dc1/dc3/df4/l5c 0 2024-09-17T01:07:25.456 INFO:tasks.workunit.client.0.smithi103.stdout:9/709: mkdir d7/dea 0 2024-09-17T01:07:25.461 INFO:tasks.workunit.client.0.smithi103.stdout:0/806: truncate dd/df/d38/f60 1063815 0 2024-09-17T01:07:25.465 INFO:tasks.workunit.client.0.smithi103.stdout:3/866: link d3/d16/d1b/d3c/d65/d83/dbf/ff0 d3/d16/d1b/d3c/d65/d7e/dac/f126 0 2024-09-17T01:07:25.467 INFO:tasks.workunit.client.0.smithi103.stdout:4/747: dwrite d9/d16/d38/f75 [0,4194304] 0 2024-09-17T01:07:25.469 INFO:tasks.workunit.client.0.smithi103.stdout:1/743: rename d2/d1c/d54/f92 to d2/de/d76/df4/ff7 0 2024-09-17T01:07:25.469 INFO:tasks.workunit.client.0.smithi103.stdout:9/710: truncate d7/d43/d88/d11/d5c/d8d/fe7 951147 0 2024-09-17T01:07:25.471 INFO:tasks.workunit.client.0.smithi103.stdout:5/559: getdents d6 0 2024-09-17T01:07:25.472 INFO:tasks.workunit.client.0.smithi103.stdout:2/849: getdents d6/d5f/d26/d34/ddc 0 2024-09-17T01:07:25.476 INFO:tasks.workunit.client.0.smithi103.stdout:4/748: unlink d9/d16/d36/d42/cb0 0 2024-09-17T01:07:25.477 INFO:tasks.workunit.client.0.smithi103.stdout:4/749: stat d9/d16/d38/d3f 0 2024-09-17T01:07:25.478 INFO:tasks.workunit.client.0.smithi103.stdout:1/744: mkdir d2/d16/dbf/df8 0 2024-09-17T01:07:25.480 INFO:tasks.workunit.client.0.smithi103.stdout:0/807: unlink dd/df/d68/ddc/lc9 0 2024-09-17T01:07:25.482 INFO:tasks.workunit.client.0.smithi103.stdout:5/560: unlink d6/d2c/d38/d4c/d54/c58 0 2024-09-17T01:07:25.483 INFO:tasks.workunit.client.0.smithi103.stdout:2/850: fsync d6/da/d28/f4d 0 2024-09-17T01:07:25.486 INFO:tasks.workunit.client.0.smithi103.stdout:2/851: read d6/da/d5d/d8d/f71 [176326,115445] 0 2024-09-17T01:07:25.488 INFO:tasks.workunit.client.0.smithi103.stdout:4/750: creat d9/d16/d23/d32/fe6 x:0 0 0 2024-09-17T01:07:25.489 INFO:tasks.workunit.client.0.smithi103.stdout:9/711: fsync d7/d43/d88/f7b 0 2024-09-17T01:07:25.495 INFO:tasks.workunit.client.0.smithi103.stdout:4/751: dwrite d9/dc/df/f20 [0,4194304] 0 2024-09-17T01:07:25.495 INFO:tasks.workunit.client.0.smithi103.stdout:0/808: mknod dd/df/d38/c10e 0 2024-09-17T01:07:25.496 INFO:tasks.workunit.client.0.smithi103.stdout:4/752: read d9/d16/d44/f68 [2446419,72173] 0 2024-09-17T01:07:25.498 INFO:tasks.workunit.client.0.smithi103.stdout:5/561: chown d6/d11/f1a 91346 1 2024-09-17T01:07:25.500 INFO:tasks.workunit.client.0.smithi103.stdout:0/809: dread dd/df/f25 [0,4194304] 0 2024-09-17T01:07:25.503 INFO:tasks.workunit.client.0.smithi103.stdout:3/867: write d3/d16/d1b/d3c/d65/d7e/dac/dce/fa4 [4896325,49829] 0 2024-09-17T01:07:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:25 smithi143 ceph-mon[35452]: pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 59 MiB/s rd, 156 MiB/s wr, 352 op/s 2024-09-17T01:07:25.508 INFO:tasks.workunit.client.0.smithi103.stdout:9/712: mknod d7/db4/ddc/ceb 0 2024-09-17T01:07:25.508 INFO:tasks.workunit.client.0.smithi103.stdout:0/810: dwrite f3 [4194304,4194304] 0 2024-09-17T01:07:25.510 INFO:tasks.workunit.client.0.smithi103.stdout:0/811: read - dd/df/d68/d6c/d83/de4/fd4 zero size 2024-09-17T01:07:25.511 INFO:tasks.workunit.client.0.smithi103.stdout:4/753: dread - d9/d16/fdf zero size 2024-09-17T01:07:25.512 INFO:tasks.workunit.client.0.smithi103.stdout:5/562: chown d6/d2c/d38/d4c/d71/fbf 12256167 1 2024-09-17T01:07:25.515 INFO:tasks.workunit.client.0.smithi103.stdout:2/852: mknod d6/d5f/d26/d66/da8/c121 0 2024-09-17T01:07:25.517 INFO:tasks.workunit.client.0.smithi103.stdout:9/713: dread - d7/d43/d79/f8b zero size 2024-09-17T01:07:25.517 INFO:tasks.workunit.client.0.smithi103.stdout:9/714: chown d7 4 1 2024-09-17T01:07:25.523 INFO:tasks.workunit.client.0.smithi103.stdout:1/745: dwrite d2/d1c/d20/d6d/f8b [0,4194304] 0 2024-09-17T01:07:25.527 INFO:tasks.workunit.client.0.smithi103.stdout:5/563: mkdir d6/d2c/d32/dd1 0 2024-09-17T01:07:25.528 INFO:tasks.workunit.client.0.smithi103.stdout:3/868: mkdir d3/d16/d1b/d3c/d10b/d127 0 2024-09-17T01:07:25.529 INFO:tasks.workunit.client.0.smithi103.stdout:3/869: chown d3/d16/d1b/l38 166028086 1 2024-09-17T01:07:25.530 INFO:tasks.workunit.client.0.smithi103.stdout:3/870: chown d3/d16/d1b/d36 390 1 2024-09-17T01:07:25.532 INFO:tasks.workunit.client.0.smithi103.stdout:2/853: mkdir d6/da/d5d/d8d/d60/d75/d122 0 2024-09-17T01:07:25.533 INFO:tasks.workunit.client.0.smithi103.stdout:2/854: readlink d6/d5f/d26/d66/df/lcc 0 2024-09-17T01:07:25.535 INFO:tasks.workunit.client.0.smithi103.stdout:0/812: mkdir dd/d1c/d109/d10f 0 2024-09-17T01:07:25.537 INFO:tasks.workunit.client.0.smithi103.stdout:5/564: symlink d6/ld2 0 2024-09-17T01:07:25.539 INFO:tasks.workunit.client.0.smithi103.stdout:0/813: truncate dd/f14 765953 0 2024-09-17T01:07:25.540 INFO:tasks.workunit.client.0.smithi103.stdout:1/746: truncate d2/d1c/d20/d33/f59 1480360 0 2024-09-17T01:07:25.541 INFO:tasks.workunit.client.0.smithi103.stdout:9/715: dread d7/d43/d88/d11/d20/d4f/f76 [0,4194304] 0 2024-09-17T01:07:25.542 INFO:tasks.workunit.client.0.smithi103.stdout:4/754: dread d9/d16/d44/d78/fa9 [0,4194304] 0 2024-09-17T01:07:25.545 INFO:tasks.workunit.client.0.smithi103.stdout:1/747: creat d2/d70/ff9 x:0 0 0 2024-09-17T01:07:25.547 INFO:tasks.workunit.client.0.smithi103.stdout:3/871: dwrite d3/d44/d63/f6c [4194304,4194304] 0 2024-09-17T01:07:25.547 INFO:tasks.workunit.client.0.smithi103.stdout:0/814: rmdir dd/df/d68/d6c/d8e 39 2024-09-17T01:07:25.551 INFO:tasks.workunit.client.0.smithi103.stdout:9/716: mknod d7/d43/d88/d11/d5c/cec 0 2024-09-17T01:07:25.551 INFO:tasks.workunit.client.0.smithi103.stdout:4/755: creat d9/d16/d44/d78/fe7 x:0 0 0 2024-09-17T01:07:25.553 INFO:tasks.workunit.client.0.smithi103.stdout:0/815: symlink dd/df/d68/ddc/d93/l110 0 2024-09-17T01:07:25.557 INFO:tasks.workunit.client.0.smithi103.stdout:0/816: readlink dd/df/d38/l5b 0 2024-09-17T01:07:25.558 INFO:tasks.workunit.client.0.smithi103.stdout:9/717: read d7/db8/dbb/f89 [6639699,69133] 0 2024-09-17T01:07:25.558 INFO:tasks.workunit.client.0.smithi103.stdout:3/872: mknod d3/d16/d1b/d3c/d65/d75/d8d/c128 0 2024-09-17T01:07:25.558 INFO:tasks.workunit.client.0.smithi103.stdout:1/748: dwrite d2/d1c/d28/d52/ddb/fe4 [0,4194304] 0 2024-09-17T01:07:25.568 INFO:tasks.workunit.client.0.smithi103.stdout:9/718: dwrite d7/db8/dbb/f5b [4194304,4194304] 0 2024-09-17T01:07:25.572 INFO:tasks.workunit.client.0.smithi103.stdout:2/855: dwrite d6/d5f/d26/d34/d80/fc6 [0,4194304] 0 2024-09-17T01:07:25.576 INFO:tasks.workunit.client.0.smithi103.stdout:2/856: dread d6/fb [0,4194304] 0 2024-09-17T01:07:25.577 INFO:tasks.workunit.client.0.smithi103.stdout:2/857: stat d6/d5f/d26/d66/df/ddd/c10e 0 2024-09-17T01:07:25.583 INFO:tasks.workunit.client.0.smithi103.stdout:4/756: creat d9/d16/d70/dc0/fe8 x:0 0 0 2024-09-17T01:07:25.585 INFO:tasks.workunit.client.0.smithi103.stdout:4/757: readlink d9/d10/l17 0 2024-09-17T01:07:25.585 INFO:tasks.workunit.client.0.smithi103.stdout:2/858: dwrite d6/da/d5d/ff0 [0,4194304] 0 2024-09-17T01:07:25.586 INFO:tasks.workunit.client.0.smithi103.stdout:4/758: stat d9/d16/d36 0 2024-09-17T01:07:25.589 INFO:tasks.workunit.client.0.smithi103.stdout:5/565: unlink d6/db/d66/c94 0 2024-09-17T01:07:25.591 INFO:tasks.workunit.client.0.smithi103.stdout:9/719: dread d7/d43/d88/d11/d5c/d5e/d6c/d6e/faf [0,4194304] 0 2024-09-17T01:07:25.593 INFO:tasks.workunit.client.0.smithi103.stdout:0/817: link dd/d1c/f4a dd/d1c/d109/f111 0 2024-09-17T01:07:25.597 INFO:tasks.workunit.client.0.smithi103.stdout:3/873: dread d3/d16/d1b/d3c/f40 [0,4194304] 0 2024-09-17T01:07:25.598 INFO:tasks.workunit.client.0.smithi103.stdout:3/874: chown d3/d81/fd9 37138977 1 2024-09-17T01:07:25.599 INFO:tasks.workunit.client.0.smithi103.stdout:4/759: mkdir d9/d16/d36/d42/d84/de9 0 2024-09-17T01:07:25.602 INFO:tasks.workunit.client.0.smithi103.stdout:9/720: mknod d7/db8/ced 0 2024-09-17T01:07:25.604 INFO:tasks.workunit.client.0.smithi103.stdout:9/721: write d7/d43/d88/d11/d5c/d5e/d6c/f84 [3201515,31689] 0 2024-09-17T01:07:25.604 INFO:tasks.workunit.client.0.smithi103.stdout:0/818: write dd/df/d38/da8/f66 [1120625,8127] 0 2024-09-17T01:07:25.605 INFO:tasks.workunit.client.0.smithi103.stdout:1/749: creat d2/d1c/d28/ffa x:0 0 0 2024-09-17T01:07:25.608 INFO:tasks.workunit.client.0.smithi103.stdout:3/875: read d3/d81/fd9 [5922181,83740] 0 2024-09-17T01:07:25.611 INFO:tasks.workunit.client.0.smithi103.stdout:5/566: dread d6/d28/dcb/d93/f9d [0,4194304] 0 2024-09-17T01:07:25.612 INFO:tasks.workunit.client.0.smithi103.stdout:0/819: creat dd/df/d38/d55/f112 x:0 0 0 2024-09-17T01:07:25.616 INFO:tasks.workunit.client.0.smithi103.stdout:2/859: creat d6/f123 x:0 0 0 2024-09-17T01:07:25.617 INFO:tasks.workunit.client.0.smithi103.stdout:4/760: mknod d9/d10/de5/cea 0 2024-09-17T01:07:25.617 INFO:tasks.workunit.client.0.smithi103.stdout:4/761: stat d9/d16/f1e 0 2024-09-17T01:07:25.619 INFO:tasks.workunit.client.0.smithi103.stdout:3/876: unlink d3/ff9 0 2024-09-17T01:07:25.623 INFO:tasks.workunit.client.0.smithi103.stdout:0/820: mknod dd/d1c/d9f/dd6/c113 0 2024-09-17T01:07:25.633 INFO:tasks.workunit.client.0.smithi103.stdout:4/762: symlink d9/d16/d36/d42/d84/de9/leb 0 2024-09-17T01:07:25.633 INFO:tasks.workunit.client.0.smithi103.stdout:3/877: mkdir d3/d44/d129 0 2024-09-17T01:07:25.635 INFO:tasks.workunit.client.0.smithi103.stdout:5/567: creat d6/db/fd3 x:0 0 0 2024-09-17T01:07:25.637 INFO:tasks.workunit.client.0.smithi103.stdout:4/763: rmdir d9/d16/d23/d90 39 2024-09-17T01:07:25.639 INFO:tasks.workunit.client.0.smithi103.stdout:3/878: mknod d3/d16/d1b/d3c/d65/d7e/dac/dce/c12a 0 2024-09-17T01:07:25.641 INFO:tasks.workunit.client.0.smithi103.stdout:5/568: write d6/d2c/d38/d4c/f8f [1876306,109665] 0 2024-09-17T01:07:25.644 INFO:tasks.workunit.client.0.smithi103.stdout:4/764: mkdir d9/d16/d23/d90/dec 0 2024-09-17T01:07:25.646 INFO:tasks.workunit.client.0.smithi103.stdout:1/750: write d2/d1c/d20/f9a [3658612,90614] 0 2024-09-17T01:07:25.647 INFO:tasks.workunit.client.0.smithi103.stdout:5/569: symlink d6/d2c/d32/dd1/ld4 0 2024-09-17T01:07:25.649 INFO:tasks.workunit.client.0.smithi103.stdout:4/765: symlink d9/d16/d36/d42/led 0 2024-09-17T01:07:25.650 INFO:tasks.workunit.client.0.smithi103.stdout:4/766: stat d9/d10/c9c 0 2024-09-17T01:07:25.654 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:25 smithi103 ceph-mon[28156]: pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 59 MiB/s rd, 156 MiB/s wr, 352 op/s 2024-09-17T01:07:25.660 INFO:tasks.workunit.client.0.smithi103.stdout:3/879: dread d3/d16/d1b/d3c/d65/d75/dbe/f41 [0,4194304] 0 2024-09-17T01:07:25.662 INFO:tasks.workunit.client.0.smithi103.stdout:9/722: dwrite d7/f19 [0,4194304] 0 2024-09-17T01:07:25.663 INFO:tasks.workunit.client.0.smithi103.stdout:1/751: link d2/d1c/d28/c41 d2/d1c/d20/d6d/cfb 0 2024-09-17T01:07:25.667 INFO:tasks.workunit.client.0.smithi103.stdout:5/570: getdents d6/d2c/d32/d55 0 2024-09-17T01:07:25.668 INFO:tasks.workunit.client.0.smithi103.stdout:4/767: dwrite d9/d16/d45/fe3 [0,4194304] 0 2024-09-17T01:07:25.669 INFO:tasks.workunit.client.0.smithi103.stdout:3/880: mkdir d3/d16/d90/d12b 0 2024-09-17T01:07:25.673 INFO:tasks.workunit.client.0.smithi103.stdout:2/860: dwrite d6/d5f/d26/d66/df/d68/d7e/fc4 [0,4194304] 0 2024-09-17T01:07:25.674 INFO:tasks.workunit.client.0.smithi103.stdout:0/821: dwrite dd/f77 [0,4194304] 0 2024-09-17T01:07:25.678 INFO:tasks.workunit.client.0.smithi103.stdout:4/768: chown d9/d16/d36/d42/d84/ca4 24653 1 2024-09-17T01:07:25.680 INFO:tasks.workunit.client.0.smithi103.stdout:5/571: fdatasync d6/fc7 0 2024-09-17T01:07:25.684 INFO:tasks.workunit.client.0.smithi103.stdout:3/881: dwrite d3/d16/d1b/d3c/d65/d7e/dac/dce/fa4 [0,4194304] 0 2024-09-17T01:07:25.686 INFO:tasks.workunit.client.0.smithi103.stdout:2/861: dread - d6/da/d5d/d8d/d60/fb5 zero size 2024-09-17T01:07:25.687 INFO:tasks.workunit.client.0.smithi103.stdout:4/769: creat d9/d16/d70/dc0/fee x:0 0 0 2024-09-17T01:07:25.690 INFO:tasks.workunit.client.0.smithi103.stdout:4/770: chown d9/d16/d23/d32/d61/d47/lc6 13705 1 2024-09-17T01:07:25.692 INFO:tasks.workunit.client.0.smithi103.stdout:5/572: unlink d6/d2c/db3/lb5 0 2024-09-17T01:07:25.692 INFO:tasks.workunit.client.0.smithi103.stdout:0/822: creat dd/d4f/f114 x:0 0 0 2024-09-17T01:07:25.693 INFO:tasks.workunit.client.0.smithi103.stdout:3/882: read d3/d16/d1b/d3c/d65/d75/dbe/f58 [88681,30772] 0 2024-09-17T01:07:25.697 INFO:tasks.workunit.client.0.smithi103.stdout:5/573: fsync d6/d28/dcb/d93/f9d 0 2024-09-17T01:07:25.699 INFO:tasks.workunit.client.0.smithi103.stdout:2/862: link d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/f100 d6/d5f/d26/d66/df/f124 0 2024-09-17T01:07:25.702 INFO:tasks.workunit.client.0.smithi103.stdout:3/883: creat d3/f12c x:0 0 0 2024-09-17T01:07:25.702 INFO:tasks.workunit.client.0.smithi103.stdout:0/823: getdents dd/df/d68/d10b 0 2024-09-17T01:07:25.703 INFO:tasks.workunit.client.0.smithi103.stdout:0/824: readlink dd/df/lfb 0 2024-09-17T01:07:25.704 INFO:tasks.workunit.client.0.smithi103.stdout:2/863: creat d6/da/d3f/f125 x:0 0 0 2024-09-17T01:07:25.706 INFO:tasks.workunit.client.0.smithi103.stdout:0/825: read dd/f3b [1935880,5023] 0 2024-09-17T01:07:25.709 INFO:tasks.workunit.client.0.smithi103.stdout:3/884: rename d3/d16/d1b/d3c/d65/d83/lee to d3/d16/d1b/d3c/d65/d83/l12d 0 2024-09-17T01:07:25.710 INFO:tasks.workunit.client.0.smithi103.stdout:3/885: chown d3/d16/d1b/d3c/d65/d7e/dac/f10c 57365 1 2024-09-17T01:07:25.713 INFO:tasks.workunit.client.0.smithi103.stdout:3/886: mknod d3/d44/d63/c12e 0 2024-09-17T01:07:25.714 INFO:tasks.workunit.client.0.smithi103.stdout:3/887: creat d3/d81/f12f x:0 0 0 2024-09-17T01:07:25.715 INFO:tasks.workunit.client.0.smithi103.stdout:0/826: rename dd/df/d38/f33 to dd/d1c/d9f/f115 0 2024-09-17T01:07:25.717 INFO:tasks.workunit.client.0.smithi103.stdout:3/888: mkdir d3/d16/d1b/d3c/d97/d130 0 2024-09-17T01:07:25.718 INFO:tasks.workunit.client.0.smithi103.stdout:0/827: truncate dd/df/f39 1106189 0 2024-09-17T01:07:25.721 INFO:tasks.workunit.client.0.smithi103.stdout:3/889: unlink d3/d16/d1b/d3c/d65/d7e/dac/f10c 0 2024-09-17T01:07:25.723 INFO:tasks.workunit.client.0.smithi103.stdout:1/752: truncate d2/d7/d73/d81/fa6 1317769 0 2024-09-17T01:07:25.727 INFO:tasks.workunit.client.0.smithi103.stdout:1/753: creat d2/de/d1f/ffc x:0 0 0 2024-09-17T01:07:25.728 INFO:tasks.workunit.client.0.smithi103.stdout:1/754: write d2/d70/ff9 [819359,106330] 0 2024-09-17T01:07:25.729 INFO:tasks.workunit.client.0.smithi103.stdout:3/890: fdatasync d3/d16/d1b/d3c/d65/d75/f78 0 2024-09-17T01:07:25.737 INFO:tasks.workunit.client.0.smithi103.stdout:3/891: dwrite d3/f57 [0,4194304] 0 2024-09-17T01:07:25.739 INFO:tasks.workunit.client.0.smithi103.stdout:5/574: dwrite d6/db/f34 [0,4194304] 0 2024-09-17T01:07:25.741 INFO:tasks.workunit.client.0.smithi103.stdout:2/864: write d6/da/d3f/f65 [178429,22551] 0 2024-09-17T01:07:25.745 INFO:tasks.workunit.client.0.smithi103.stdout:3/892: unlink d3/d16/d1b/d3c/f40 0 2024-09-17T01:07:25.747 INFO:tasks.workunit.client.0.smithi103.stdout:3/893: chown d3/d81/fb4 1728234919 1 2024-09-17T01:07:25.750 INFO:tasks.workunit.client.0.smithi103.stdout:1/755: getdents d2/d1c/d20/d6d 0 2024-09-17T01:07:25.751 INFO:tasks.workunit.client.0.smithi103.stdout:1/756: chown d2/de/fdc 2 1 2024-09-17T01:07:25.757 INFO:tasks.workunit.client.0.smithi103.stdout:5/575: mkdir d6/d2c/d38/d4c/dd5 0 2024-09-17T01:07:25.759 INFO:tasks.workunit.client.0.smithi103.stdout:1/757: mkdir d2/d7/d73/dfd 0 2024-09-17T01:07:25.763 INFO:tasks.workunit.client.0.smithi103.stdout:0/828: dwrite dd/d43/f58 [0,4194304] 0 2024-09-17T01:07:25.763 INFO:tasks.workunit.client.0.smithi103.stdout:1/758: chown d2/d1c/d28/d52/d69/f82 0 1 2024-09-17T01:07:25.766 INFO:tasks.workunit.client.0.smithi103.stdout:1/759: write d2/d1c/d28/fc5 [1496949,40650] 0 2024-09-17T01:07:25.774 INFO:tasks.workunit.client.0.smithi103.stdout:0/829: dread dd/d43/f53 [0,4194304] 0 2024-09-17T01:07:25.780 INFO:tasks.workunit.client.0.smithi103.stdout:1/760: rename d2/d1c/d28/d52/d69/de6 to d2/d1c/d20/dfe 0 2024-09-17T01:07:25.781 INFO:tasks.workunit.client.0.smithi103.stdout:0/830: truncate dd/d43/fa5 436757 0 2024-09-17T01:07:25.789 INFO:tasks.workunit.client.0.smithi103.stdout:2/865: dwrite d6/d5f/d26/d34/d80/fa6 [0,4194304] 0 2024-09-17T01:07:25.790 INFO:tasks.workunit.client.0.smithi103.stdout:1/761: mkdir d2/d16/d51/d65/dff 0 2024-09-17T01:07:25.791 INFO:tasks.workunit.client.0.smithi103.stdout:3/894: dwrite d3/d16/d1b/d3c/d65/d83/fdf [0,4194304] 0 2024-09-17T01:07:25.793 INFO:tasks.workunit.client.0.smithi103.stdout:3/895: chown d3/d44 125107 1 2024-09-17T01:07:25.796 INFO:tasks.workunit.client.0.smithi103.stdout:0/831: creat dd/d1c/d109/d10f/f116 x:0 0 0 2024-09-17T01:07:25.796 INFO:tasks.workunit.client.0.smithi103.stdout:5/576: dwrite d6/d2c/d38/d4c/d50/f21 [0,4194304] 0 2024-09-17T01:07:25.800 INFO:tasks.workunit.client.0.smithi103.stdout:2/866: creat d6/d5f/d26/d66/df/d68/f126 x:0 0 0 2024-09-17T01:07:25.801 INFO:tasks.workunit.client.0.smithi103.stdout:1/762: mknod d2/d16/c100 0 2024-09-17T01:07:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.804+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a9c0682f0 con 0x7f8a8406d8a0 2024-09-17T01:07:25.804 INFO:tasks.workunit.client.0.smithi103.stdout:0/832: rename dd/f4d to dd/df/d38/f117 0 2024-09-17T01:07:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.806+0000 7f8a98ff9640 1 -- 172.21.15.103:0/3587689124 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8a9c0682f0 con 0x7f8a8406d8a0 2024-09-17T01:07:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.810+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8a8406d8a0 msgr2=0x7f8a8406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.810+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8a8406d8a0 0x7f8a8406fd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009230 tx=0x7f8a8c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.810+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 msgr2=0x7f8a9c195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.810+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c195c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000b450 tx=0x7f8a9000b910 comp rx=0 tx=0).stop 2024-09-17T01:07:25.810 INFO:tasks.workunit.client.0.smithi103.stdout:3/896: dwrite d3/d16/d1b/d3c/d65/d75/d9c/fde [0,4194304] 0 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.812+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 shutdown_connections 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.812+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a9c0ffc30 0x7f8a9c195c40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.812+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f8a8406d8a0 0x7f8a8406fd60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.812+0000 7f8aa1f3d640 1 --2- 172.21.15.103:0/3587689124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a9c0fea30 0x7f8a9c195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.812+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 >> 172.21.15.103:0/3587689124 conn(0x7f8a9c0fa1c0 msgr2=0x7f8a9c067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.812+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 shutdown_connections 2024-09-17T01:07:25.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.813+0000 7f8aa1f3d640 1 -- 172.21.15.103:0/3587689124 wait complete. 2024-09-17T01:07:25.814 INFO:tasks.workunit.client.0.smithi103.stdout:5/577: dread d6/d2c/f73 [0,4194304] 0 2024-09-17T01:07:25.816 INFO:tasks.workunit.client.0.smithi103.stdout:3/897: mknod d3/d16/d1b/d3c/d65/d75/dd1/c131 0 2024-09-17T01:07:25.819 INFO:tasks.workunit.client.0.smithi103.stdout:5/578: write d6/db/f5c [1178109,93033] 0 2024-09-17T01:07:25.822 INFO:tasks.workunit.client.0.smithi103.stdout:3/898: truncate d3/d16/d1b/f91 1262955 0 2024-09-17T01:07:25.825 INFO:tasks.workunit.client.0.smithi103.stdout:3/899: mkdir d3/d44/d129/d132 0 2024-09-17T01:07:25.827 INFO:tasks.workunit.client.0.smithi103.stdout:3/900: creat d3/d81/f133 x:0 0 0 2024-09-17T01:07:25.828 INFO:tasks.workunit.client.0.smithi103.stdout:3/901: chown d3/c43 673467286 1 2024-09-17T01:07:25.831 INFO:tasks.workunit.client.0.smithi103.stdout:3/902: mknod d3/d16/d90/c134 0 2024-09-17T01:07:25.834 INFO:tasks.workunit.client.0.smithi103.stdout:1/763: write d2/d1c/d20/d33/f57 [106013,113360] 0 2024-09-17T01:07:25.838 INFO:tasks.workunit.client.0.smithi103.stdout:2/867: dwrite d6/d5f/d26/d66/df/d68/d7e/d9c/d7c/f100 [0,4194304] 0 2024-09-17T01:07:25.839 INFO:tasks.workunit.client.0.smithi103.stdout:3/903: rename d3/d44/l95 to d3/d16/d1b/d3c/d10b/d127/l135 0 2024-09-17T01:07:25.839 INFO:tasks.workunit.client.0.smithi103.stdout:1/764: truncate d2/d1c/d28/fc5 2382871 0 2024-09-17T01:07:25.841 INFO:tasks.workunit.client.0.smithi103.stdout:3/904: stat d3/d16/f2d 0 2024-09-17T01:07:25.846 INFO:tasks.workunit.client.0.smithi103.stdout:2/868: rmdir d6/da/d5d/d8d/d60 39 2024-09-17T01:07:25.848 INFO:tasks.workunit.client.0.smithi103.stdout:0/833: dread dd/f3b [0,4194304] 0 2024-09-17T01:07:25.853 INFO:tasks.workunit.client.0.smithi103.stdout:2/869: rename d6/da/cb1 to d6/d5f/dad/c127 0 2024-09-17T01:07:25.854 INFO:tasks.workunit.client.0.smithi103.stdout:3/905: link d3/d16/d1b/d3c/d65/d7e/da3/df5/f118 d3/d44/d129/d132/f136 0 2024-09-17T01:07:25.863 INFO:tasks.workunit.client.0.smithi103.stdout:1/765: getdents d2/d1c/db9 0 2024-09-17T01:07:25.864 INFO:tasks.workunit.client.0.smithi103.stdout:3/906: creat d3/d16/d1b/d36/f137 x:0 0 0 2024-09-17T01:07:25.866 INFO:tasks.workunit.client.0.smithi103.stdout:3/907: write d3/d16/d1b/d3c/d65/d75/d9c/fde [3487684,52167] 0 2024-09-17T01:07:25.886 INFO:tasks.workunit.client.0.smithi103.stdout:0/834: symlink dd/df/d68/l118 0 2024-09-17T01:07:25.893 INFO:tasks.workunit.client.0.smithi103.stdout:1/766: creat d2/d7/d73/dfd/f101 x:0 0 0 2024-09-17T01:07:25.895 INFO:tasks.workunit.client.0.smithi103.stdout:0/835: read dd/df/d68/d6c/d83/de4/faa [817661,130051] 0 2024-09-17T01:07:25.897 INFO:tasks.workunit.client.0.smithi103.stdout:2/870: rename d6/da/d3f/c83 to d6/d5f/c128 0 2024-09-17T01:07:25.899 INFO:tasks.workunit.client.0.smithi103.stdout:2/871: readlink d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4/l10f 0 2024-09-17T01:07:25.901 INFO:tasks.workunit.client.0.smithi103.stdout:1/767: mkdir d2/d1c/d28/d52/ddb/d102 0 2024-09-17T01:07:25.905 INFO:tasks.workunit.client.0.smithi103.stdout:2/872: dwrite d6/da/d28/fd1 [0,4194304] 0 2024-09-17T01:07:25.908 INFO:tasks.workunit.client.0.smithi103.stdout:0/836: symlink dd/df/d108/l119 0 2024-09-17T01:07:25.910 INFO:tasks.workunit.client.0.smithi103.stdout:1/768: dread d2/f8 [0,4194304] 0 2024-09-17T01:07:25.918 INFO:tasks.workunit.client.0.smithi103.stdout:0/837: mknod dd/d1c/d9f/dbb/c11a 0 2024-09-17T01:07:25.919 INFO:tasks.workunit.client.0.smithi103.stdout:0/838: write dd/f77 [2459739,72388] 0 2024-09-17T01:07:25.929 INFO:tasks.workunit.client.0.smithi103.stdout:0/839: getdents dd 0 2024-09-17T01:07:25.931 INFO:tasks.workunit.client.0.smithi103.stdout:0/840: creat dd/df/d38/da8/f11b x:0 0 0 2024-09-17T01:07:25.933 INFO:tasks.workunit.client.0.smithi103.stdout:0/841: stat dd/d1c/cea 0 2024-09-17T01:07:25.936 INFO:tasks.workunit.client.0.smithi103.stdout:3/908: write d3/d16/d1b/d3c/d65/d75/f78 [4983111,115939] 0 2024-09-17T01:07:25.938 INFO:tasks.workunit.client.0.smithi103.stdout:3/909: mkdir d3/d81/d138 0 2024-09-17T01:07:25.939 INFO:tasks.workunit.client.0.smithi103.stdout:3/910: chown d3/f15 1709474 1 2024-09-17T01:07:25.941 INFO:tasks.workunit.client.0.smithi103.stdout:3/911: rmdir d3/dd7 39 2024-09-17T01:07:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.942+0000 7f138bb22640 1 -- 172.21.15.103:0/601314905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 msgr2=0x7f13841003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.942+0000 7f138bb22640 1 --2- 172.21.15.103:0/601314905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f13841003e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1380009880 tx=0x7f138002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.942+0000 7f138bb22640 1 -- 172.21.15.103:0/601314905 shutdown_connections 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.942+0000 7f138bb22640 1 --2- 172.21.15.103:0/601314905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840fec40 0x7f13840ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.942+0000 7f138bb22640 1 --2- 172.21.15.103:0/601314905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f13841003e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.942+0000 7f138bb22640 1 -- 172.21.15.103:0/601314905 >> 172.21.15.103:0/601314905 conn(0x7f13840f9940 msgr2=0x7f13840fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.943+0000 7f138bb22640 1 -- 172.21.15.103:0/601314905 shutdown_connections 2024-09-17T01:07:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.943+0000 7f138bb22640 1 -- 172.21.15.103:0/601314905 wait complete. 2024-09-17T01:07:25.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.943+0000 7f138bb22640 1 Processor -- start 2024-09-17T01:07:25.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f138bb22640 1 -- start start 2024-09-17T01:07:25.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f138bb22640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840fec40 0x7f13841944d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f138bb22640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f1384194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f138bb22640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384195030 con 0x7f13840fffe0 2024-09-17T01:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f138bb22640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13841951a0 con 0x7f13840fec40 2024-09-17T01:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f13890bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f1384194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f13890bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f1384194a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39084/0 (socket says 172.21.15.103:39084) 2024-09-17T01:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f13890bd640 1 -- 172.21.15.103:0/47223506 learned_addr learned my addr 172.21.15.103:0/47223506 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.944+0000 7f13898be640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840fec40 0x7f13841944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f13890bd640 1 -- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840fec40 msgr2=0x7f13841944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f13890bd640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840fec40 0x7f13841944d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f13890bd640 1 -- 172.21.15.103:0/47223506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380009560 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f13890bd640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f1384194a10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d80 tx=0x7f137400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13740051f0 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1374012050 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1374004cc0 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13840fdca0 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.945+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13840fe240 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.947+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13840ff0a0 con 0x7f13840fffe0 2024-09-17T01:07:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.948+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f13740121c0 con 0x7f13840fffe0 2024-09-17T01:07:25.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.948+0000 7f137affd640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f137006d8a0 0x7f137006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.948+0000 7f13898be640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f137006d8a0 0x7f137006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.948+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f13740914b0 con 0x7f13840fffe0 2024-09-17T01:07:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.949+0000 7f13898be640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f137006d8a0 0x7f137006fd60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1380000c00 tx=0x7f13800314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:25.948 INFO:tasks.workunit.client.0.smithi103.stdout:2/873: dwrite d6/d5f/d26/d66/df/f6b [0,4194304] 0 2024-09-17T01:07:25.951 INFO:tasks.workunit.client.0.smithi103.stdout:3/912: truncate d3/d16/d1b/d3c/d65/d75/d9c/fa8 207866 0 2024-09-17T01:07:25.951 INFO:tasks.workunit.client.0.smithi103.stdout:0/842: write dd/df/f5f [3718112,106821] 0 2024-09-17T01:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:25.958+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f137405aaa0 con 0x7f13840fffe0 2024-09-17T01:07:25.959 INFO:tasks.workunit.client.0.smithi103.stdout:3/913: mknod d3/d16/d1b/d3c/d65/d83/dbf/c139 0 2024-09-17T01:07:25.961 INFO:tasks.workunit.client.0.smithi103.stdout:2/874: creat d6/da/d5d/d8d/d89/de8/f129 x:0 0 0 2024-09-17T01:07:25.964 INFO:tasks.workunit.client.0.smithi103.stdout:3/914: write d3/d16/d1b/d3c/d65/d75/dbe/faf [841811,90693] 0 2024-09-17T01:07:25.964 INFO:tasks.workunit.client.0.smithi103.stdout:2/875: chown d6/d5f/d26/d34/d80 108022 1 2024-09-17T01:07:25.977 INFO:tasks.workunit.client.0.smithi103.stdout:0/843: dwrite dd/d1c/f1d [0,4194304] 0 2024-09-17T01:07:25.981 INFO:tasks.workunit.client.0.smithi103.stdout:0/844: rmdir dd/d1c/d9f/dd6/de8 39 2024-09-17T01:07:25.985 INFO:tasks.workunit.client.0.smithi103.stdout:3/915: dread d3/d16/d1b/d36/fc2 [0,4194304] 0 2024-09-17T01:07:25.988 INFO:tasks.workunit.client.0.smithi103.stdout:2/876: dread d6/d5f/dad/fd6 [0,4194304] 0 2024-09-17T01:07:25.993 INFO:tasks.workunit.client.0.smithi103.stdout:0/845: link dd/f14 dd/d1c/d9f/dd6/f11c 0 2024-09-17T01:07:25.994 INFO:tasks.workunit.client.0.smithi103.stdout:2/877: dwrite d6/fb [0,4194304] 0 2024-09-17T01:07:25.995 INFO:tasks.workunit.client.0.smithi103.stdout:3/916: write d3/d16/fae [588562,90758] 0 2024-09-17T01:07:25.996 INFO:tasks.workunit.client.0.smithi103.stdout:0/846: dread dd/d43/f53 [0,4194304] 0 2024-09-17T01:07:26.002 INFO:tasks.workunit.client.0.smithi103.stdout:2/878: truncate d6/d5f/f20 7743423 0 2024-09-17T01:07:26.003 INFO:tasks.workunit.client.0.smithi103.stdout:2/879: chown d6/d5f/d26/f5a 3 1 2024-09-17T01:07:26.004 INFO:tasks.workunit.client.0.smithi103.stdout:3/917: truncate d3/d16/d1b/d3c/d65/d7e/dac/f126 289292 0 2024-09-17T01:07:26.006 INFO:tasks.workunit.client.0.smithi103.stdout:2/880: mkdir d6/da/d5d/d8d/d89/de8/d12a 0 2024-09-17T01:07:26.007 INFO:tasks.workunit.client.0.smithi103.stdout:2/881: readlink d6/d5f/d26/l84 0 2024-09-17T01:07:26.011 INFO:tasks.workunit.client.0.smithi103.stdout:0/847: write dd/d4f/f48 [5778654,38957] 0 2024-09-17T01:07:26.028 INFO:tasks.workunit.client.0.smithi103.stdout:3/918: getdents d3/d16/d1b/d3c/d65/df7 0 2024-09-17T01:07:26.031 INFO:tasks.workunit.client.0.smithi103.stdout:0/848: fdatasync dd/f7a 0 2024-09-17T01:07:26.036 INFO:tasks.workunit.client.0.smithi103.stdout:3/919: dwrite d3/d16/d1b/d3c/d65/d83/f11b [0,4194304] 0 2024-09-17T01:07:26.044 INFO:tasks.workunit.client.0.smithi103.stdout:0/849: mkdir dd/df/d68/db5/d11d 0 2024-09-17T01:07:26.051 INFO:tasks.workunit.client.0.smithi103.stdout:0/850: mknod dd/d4f/d64/c11e 0 2024-09-17T01:07:26.052 INFO:tasks.workunit.client.0.smithi103.stdout:2/882: link d6/da/d5d/d8d/d60/ccf d6/d5f/d26/d66/df/c12b 0 2024-09-17T01:07:26.055 INFO:tasks.workunit.client.0.smithi103.stdout:0/851: read dd/f7e [4639692,7301] 0 2024-09-17T01:07:26.057 INFO:tasks.workunit.client.0.smithi103.stdout:2/883: mknod d6/da/d3f/d120/c12c 0 2024-09-17T01:07:26.058 INFO:tasks.workunit.client.0.smithi103.stdout:3/920: truncate d3/d44/f71 3598656 0 2024-09-17T01:07:26.059 INFO:tasks.workunit.client.0.smithi103.stdout:2/884: mkdir d6/da/d5d/d8d/d89/de8/d12d 0 2024-09-17T01:07:26.061 INFO:tasks.workunit.client.0.smithi103.stdout:0/852: symlink dd/df/d68/d10b/l11f 0 2024-09-17T01:07:26.063 INFO:tasks.workunit.client.0.smithi103.stdout:3/921: mknod d3/d16/d1b/d3c/d65/d7e/da3/df5/c13a 0 2024-09-17T01:07:26.064 INFO:tasks.workunit.client.0.smithi103.stdout:0/853: creat dd/d1c/d109/f120 x:0 0 0 2024-09-17T01:07:26.065 INFO:tasks.workunit.client.0.smithi103.stdout:3/922: write d3/d16/d1b/d3c/d65/d75/dbe/faf [5340761,49059] 0 2024-09-17T01:07:26.070 INFO:tasks.workunit.client.0.smithi103.stdout:3/923: mkdir d3/d81/dd6/d13b 0 2024-09-17T01:07:26.073 INFO:tasks.workunit.client.0.smithi103.stdout:2/885: write d6/f52 [1450450,101223] 0 2024-09-17T01:07:26.074 INFO:tasks.workunit.client.0.smithi103.stdout:3/924: unlink d3/d16/d1b/f45 0 2024-09-17T01:07:26.076 INFO:tasks.workunit.client.0.smithi103.stdout:3/925: write d3/d16/d1b/d3c/d65/d7e/dac/dce/fa4 [1582802,13619] 0 2024-09-17T01:07:26.077 INFO:tasks.workunit.client.0.smithi103.stdout:0/854: write dd/df/d68/d6c/d83/fcf [4092887,26907] 0 2024-09-17T01:07:26.077 INFO:tasks.workunit.client.0.smithi103.stdout:2/886: truncate d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/f101 1027988 0 2024-09-17T01:07:26.083 INFO:tasks.workunit.client.0.smithi103.stdout:0/855: dread - dd/df/d68/d6c/d8e/fdb zero size 2024-09-17T01:07:26.083 INFO:tasks.workunit.client.0.smithi103.stdout:2/887: dread d6/d5f/f5e [0,4194304] 0 2024-09-17T01:07:26.086 INFO:tasks.workunit.client.0.smithi103.stdout:0/856: truncate dd/df/d68/d6c/d8e/dca/ff6 972604 0 2024-09-17T01:07:26.087 INFO:tasks.workunit.client.0.smithi103.stdout:0/857: write f6 [812549,12549] 0 2024-09-17T01:07:26.088 INFO:tasks.workunit.client.0.smithi103.stdout:2/888: read d6/da/d5d/d8d/d60/fa2 [2512204,78965] 0 2024-09-17T01:07:26.090 INFO:tasks.workunit.client.0.smithi103.stdout:0/858: fdatasync dd/df/d68/d6c/f7b 0 2024-09-17T01:07:26.091 INFO:tasks.workunit.client.0.smithi103.stdout:0/859: chown dd/df/d38/f80 85 1 2024-09-17T01:07:26.093 INFO:tasks.workunit.client.0.smithi103.stdout:3/926: dread d3/d16/d1b/d3c/d65/d83/f9d [4194304,4194304] 0 2024-09-17T01:07:26.093 INFO:tasks.workunit.client.0.smithi103.stdout:3/927: chown d3/d16/d90/d12b 6633173 1 2024-09-17T01:07:26.095 INFO:tasks.workunit.client.0.smithi103.stdout:3/928: write d3/d16/d1b/d3c/d65/f9b [1239011,41696] 0 2024-09-17T01:07:26.100 INFO:tasks.workunit.client.0.smithi103.stdout:3/929: mkdir d3/d16/d1b/d3c/d65/d75/d9c/dd3/d13c 0 2024-09-17T01:07:26.101 INFO:tasks.workunit.client.0.smithi103.stdout:2/889: rename d6/d5f/d26/d66/df/d68/d7e/d9c/fda to d6/d5f/f12e 0 2024-09-17T01:07:26.106 INFO:tasks.workunit.client.0.smithi103.stdout:0/860: dread dd/d1c/d9f/fb3 [0,4194304] 0 2024-09-17T01:07:26.107 INFO:tasks.workunit.client.0.smithi103.stdout:3/930: creat d3/d16/f13d x:0 0 0 2024-09-17T01:07:26.110 INFO:tasks.workunit.client.0.smithi103.stdout:2/890: dwrite d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/f10c [0,4194304] 0 2024-09-17T01:07:26.117 INFO:tasks.workunit.client.0.smithi103.stdout:0/861: rename dd/d43/f4e to dd/d4f/d97/f121 0 2024-09-17T01:07:26.121 INFO:tasks.workunit.client.0.smithi103.stdout:3/931: truncate d3/d16/d1b/d3c/d65/d7e/dac/dce/fb9 702458 0 2024-09-17T01:07:26.123 INFO:tasks.workunit.client.0.smithi103.stdout:3/932: rmdir d3/d16/d90 39 2024-09-17T01:07:26.127 INFO:tasks.workunit.client.0.smithi103.stdout:3/933: creat d3/d44/d63/f13e x:0 0 0 2024-09-17T01:07:26.129 INFO:tasks.workunit.client.0.smithi103.stdout:2/891: getdents d6/d5f/d26/d6e 0 2024-09-17T01:07:26.131 INFO:tasks.workunit.client.0.smithi103.stdout:3/934: mknod d3/d16/d1b/d3c/d65/d7c/c13f 0 2024-09-17T01:07:26.136 INFO:tasks.workunit.client.0.smithi103.stdout:0/862: getdents dd 0 2024-09-17T01:07:26.138 INFO:tasks.workunit.client.0.smithi103.stdout:3/935: dwrite d3/d16/d1b/d36/f110 [4194304,4194304] 0 2024-09-17T01:07:26.142 INFO:tasks.workunit.client.0.smithi103.stdout:0/863: rmdir dd/df/d38/d62 39 2024-09-17T01:07:26.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.229+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f13840fe820 con 0x7f137006d8a0 2024-09-17T01:07:26.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.240+0000 7f137affd640 1 -- 172.21.15.103:0/47223506 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f13840fe820 con 0x7f137006d8a0 2024-09-17T01:07:26.239 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:07:26.239 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (6m) 13s ago 8m 24.7M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:07:26.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (8m) 13s ago 8m 7914k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:07:26.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (7m) 34s ago 7m 7578k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (8m) 13s ago 8m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (7m) 34s ago 7m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (6m) 13s ago 8m 87.1M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (3m) 13s ago 3m 169M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (2m) 13s ago 2m 103M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (2m) 34s ago 2m 13.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (3m) 34s ago 3m 15.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:07:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:9283,8765,8443 running (9m) 13s ago 9m 231M - 18.2.4-855-g19e2a2be 980a0bfcd684 29c1c8578f11 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (68s) 34s ago 7m 479M - 19.1.1-330-gc2ddf972 ebb0615149de e4a4ae03730a 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (9m) 13s ago 9m 49.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (7m) 34s ago 7m 40.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (8m) 13s ago 8m 15.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (7m) 34s ago 7m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (6m) 13s ago 6m 124M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (6m) 13s ago 6m 127M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:07:26.241 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (5m) 13s ago 5m 116M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:07:26.242 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (5m) 34s ago 5m 135M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:07:26.242 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (4m) 34s ago 4m 124M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:07:26.242 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (4m) 34s ago 4m 126M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:07:26.242 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (6m) 13s ago 7m 62.7M - 2.43.0 a07b618ecd1d e84d3109ab0e 2024-09-17T01:07:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f137006d8a0 msgr2=0x7f137006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f137006d8a0 0x7f137006fd60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1380000c00 tx=0x7f13800314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 msgr2=0x7f1384194a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f1384194a10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d80 tx=0x7f137400c6a0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 shutdown_connections 2024-09-17T01:07:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13840fffe0 0x7f1384194a10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f137006d8a0 0x7f137006fd60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 --2- 172.21.15.103:0/47223506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13840fec40 0x7f13841944d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 >> 172.21.15.103:0/47223506 conn(0x7f13840f9940 msgr2=0x7f1384102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:26.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 shutdown_connections 2024-09-17T01:07:26.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.243+0000 7f138bb22640 1 -- 172.21.15.103:0/47223506 wait complete. 2024-09-17T01:07:26.279 INFO:tasks.workunit.client.0.smithi103.stdout:0/864: symlink dd/d1c/d109/l122 0 2024-09-17T01:07:26.286 INFO:tasks.workunit.client.0.smithi103.stdout:0/865: mknod dd/df/d68/d6c/d83/de4/c123 0 2024-09-17T01:07:26.290 INFO:tasks.workunit.client.0.smithi103.stdout:0/866: creat dd/df/d68/d6c/d8e/f124 x:0 0 0 2024-09-17T01:07:26.295 INFO:tasks.workunit.client.0.smithi103.stdout:0/867: mknod dd/d1c/d9f/dd6/de8/c125 0 2024-09-17T01:07:26.297 INFO:tasks.workunit.client.0.smithi103.stdout:3/936: dread d3/d44/d63/f6c [0,4194304] 0 2024-09-17T01:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 -- 172.21.15.103:0/3952292896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680ffc30 msgr2=0x7fee681000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/3952292896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680ffc30 0x7fee681000b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009880 tx=0x7fee5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 -- 172.21.15.103:0/3952292896 shutdown_connections 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/3952292896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680ffc30 0x7fee681000b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/3952292896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680fea30 0x7fee680fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 -- 172.21.15.103:0/3952292896 >> 172.21.15.103:0/3952292896 conn(0x7fee680fa1c0 msgr2=0x7fee680fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 -- 172.21.15.103:0/3952292896 shutdown_connections 2024-09-17T01:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.349+0000 7fee6dd2c640 1 -- 172.21.15.103:0/3952292896 wait complete. 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.350+0000 7fee6dd2c640 1 Processor -- start 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.350+0000 7fee6dd2c640 1 -- start start 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee6dd2c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680fea30 0x7fee68194500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee6dd2c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680ffc30 0x7fee68194a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee6dd2c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68195010 con 0x7fee680fea30 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee6dd2c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68195180 con 0x7fee680ffc30 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680fea30 0x7fee68194500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680fea30 0x7fee68194500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39100/0 (socket says 172.21.15.103:39100) 2024-09-17T01:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee677fe640 1 -- 172.21.15.103:0/51447455 learned_addr learned my addr 172.21.15.103:0/51447455 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee66ffd640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680ffc30 0x7fee68194a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee66ffd640 1 -- 172.21.15.103:0/51447455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680fea30 msgr2=0x7fee68194500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee66ffd640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680fea30 0x7fee68194500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee66ffd640 1 -- 172.21.15.103:0/51447455 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c009560 con 0x7fee680ffc30 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.351+0000 7fee66ffd640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680ffc30 0x7fee68194a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009850 tx=0x7fee5c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.352+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee5c004aa0 con 0x7fee680ffc30 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.352+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee5c004c00 con 0x7fee680ffc30 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.352+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee68067d20 con 0x7fee680ffc30 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.352+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee5c003980 con 0x7fee680ffc30 2024-09-17T01:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.352+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68068290 con 0x7fee680ffc30 2024-09-17T01:07:26.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.353+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68107640 con 0x7fee680ffc30 2024-09-17T01:07:26.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.354+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fee5c031b90 con 0x7fee680ffc30 2024-09-17T01:07:26.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.354+0000 7fee64ff9640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fee5006d8e0 0x7fee5006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:26.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.354+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fee5c0ae490 con 0x7fee680ffc30 2024-09-17T01:07:26.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.354+0000 7fee677fe640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fee5006d8e0 0x7fee5006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:26.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.355+0000 7fee677fe640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fee5006d8e0 0x7fee5006fda0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fee580058c0 tx=0x7fee58005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:26.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.359+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fee5c077aa0 con 0x7fee680ffc30 2024-09-17T01:07:26.363 INFO:tasks.workunit.client.0.smithi103.stdout:3/937: truncate d3/d16/d1b/d3c/f35 3883925 0 2024-09-17T01:07:26.366 INFO:tasks.workunit.client.0.smithi103.stdout:0/868: dwrite dd/df/f46 [4194304,4194304] 0 2024-09-17T01:07:26.376 INFO:tasks.workunit.client.0.smithi103.stdout:3/938: write d3/d16/d1b/d3c/d65/d7e/da3/df5/f118 [531274,100189] 0 2024-09-17T01:07:26.377 INFO:tasks.workunit.client.0.smithi103.stdout:0/869: mknod dd/df/d38/d62/db0/c126 0 2024-09-17T01:07:26.380 INFO:tasks.workunit.client.0.smithi103.stdout:0/870: write dd/d1c/d9f/fb3 [1081764,120042] 0 2024-09-17T01:07:26.383 INFO:tasks.workunit.client.0.smithi103.stdout:3/939: mkdir d3/d16/d1b/d3c/d65/d75/dbe/d34/d140 0 2024-09-17T01:07:26.393 INFO:tasks.workunit.client.0.smithi103.stdout:0/871: getdents dd 0 2024-09-17T01:07:26.393 INFO:tasks.workunit.client.0.smithi103.stdout:3/940: write d3/d16/f3d [8796079,43924] 0 2024-09-17T01:07:26.402 INFO:tasks.workunit.client.0.smithi103.stdout:0/872: getdents dd/df/d68 0 2024-09-17T01:07:26.404 INFO:tasks.workunit.client.0.smithi103.stdout:3/941: dwrite d3/d16/d1b/d3c/d65/d75/dbe/f58 [0,4194304] 0 2024-09-17T01:07:26.408 INFO:tasks.workunit.client.0.smithi103.stdout:0/873: creat dd/df/d68/db5/f127 x:0 0 0 2024-09-17T01:07:26.413 INFO:tasks.workunit.client.0.smithi103.stdout:0/874: dread dd/df/f25 [0,4194304] 0 2024-09-17T01:07:26.416 INFO:tasks.workunit.client.0.smithi103.stdout:3/942: truncate d3/d16/d1b/d3c/d65/d83/fe3 863318 0 2024-09-17T01:07:26.417 INFO:tasks.workunit.client.0.smithi103.stdout:0/875: dread - dd/df/d68/d6c/d83/fb7 zero size 2024-09-17T01:07:26.418 INFO:tasks.workunit.client.0.smithi103.stdout:0/876: stat dd/d1c/d9f/cab 0 2024-09-17T01:07:26.420 INFO:tasks.workunit.client.0.smithi103.stdout:0/877: write dd/df/d38/f117 [235556,40598] 0 2024-09-17T01:07:26.420 INFO:tasks.workunit.client.0.smithi103.stdout:0/878: stat dd/d43/dfc 0 2024-09-17T01:07:26.425 INFO:tasks.workunit.client.0.smithi103.stdout:0/879: symlink dd/d1c/l128 0 2024-09-17T01:07:26.426 INFO:tasks.workunit.client.0.smithi103.stdout:3/943: write d3/f73 [60343,111679] 0 2024-09-17T01:07:26.426 INFO:tasks.workunit.client.0.smithi103.stdout:0/880: dread - dd/df/d38/d55/f112 zero size 2024-09-17T01:07:26.427 INFO:tasks.workunit.client.0.smithi103.stdout:3/944: chown d3/d16/d1b/d86/l122 863 1 2024-09-17T01:07:26.430 INFO:tasks.workunit.client.0.smithi103.stdout:0/881: creat dd/f129 x:0 0 0 2024-09-17T01:07:26.433 INFO:tasks.workunit.client.0.smithi103.stdout:0/882: stat dd/d4f/c22 0 2024-09-17T01:07:26.435 INFO:tasks.workunit.client.0.smithi103.stdout:3/945: write d3/d81/fb4 [92710,66368] 0 2024-09-17T01:07:26.435 INFO:tasks.workunit.client.0.smithi103.stdout:0/883: dread - dd/df/d38/d62/dbf/fa6 zero size 2024-09-17T01:07:26.446 INFO:tasks.workunit.client.0.smithi103.stdout:8/562: sync 2024-09-17T01:07:26.446 INFO:tasks.workunit.client.0.smithi103.stdout:3/946: truncate d3/d16/d1b/d3c/d65/d75/dbe/f58 1769344 0 2024-09-17T01:07:26.447 INFO:tasks.workunit.client.0.smithi103.stdout:0/884: link dd/d1c/l89 dd/df/d38/d62/d84/db2/l12a 0 2024-09-17T01:07:26.452 INFO:tasks.workunit.client.0.smithi103.stdout:0/885: rmdir dd/df/d68/d6c 39 2024-09-17T01:07:26.456 INFO:tasks.workunit.client.0.smithi103.stdout:3/947: dwrite d3/d81/fb4 [0,4194304] 0 2024-09-17T01:07:26.457 INFO:tasks.workunit.client.0.smithi103.stdout:8/563: dwrite d0/d6/dc/fb4 [0,4194304] 0 2024-09-17T01:07:26.467 INFO:tasks.workunit.client.0.smithi103.stdout:0/886: getdents dd/df/d38/d62/db0 0 2024-09-17T01:07:26.472 INFO:tasks.workunit.client.0.smithi103.stdout:0/887: readlink dd/df/d68/le5 0 2024-09-17T01:07:26.472 INFO:tasks.workunit.client.0.smithi103.stdout:0/888: read - dd/d1c/d9f/dbb/ff2 zero size 2024-09-17T01:07:26.475 INFO:tasks.workunit.client.0.smithi103.stdout:0/889: chown dd/df/d68/d6c/d8e/fdb 16370 1 2024-09-17T01:07:26.476 INFO:tasks.workunit.client.0.smithi103.stdout:0/890: dread - dd/df/d68/db5/f127 zero size 2024-09-17T01:07:26.477 INFO:tasks.workunit.client.0.smithi103.stdout:0/891: dread - dd/df/d68/d6c/d8e/dca/ff5 zero size 2024-09-17T01:07:26.479 INFO:tasks.workunit.client.0.smithi103.stdout:0/892: mknod dd/df/d38/d62/d84/db2/c12b 0 2024-09-17T01:07:26.482 INFO:tasks.workunit.client.0.smithi103.stdout:0/893: rename dd/df/d38/d62/dbf/fc5 to dd/d4f/d97/f12c 0 2024-09-17T01:07:26.484 INFO:tasks.workunit.client.0.smithi103.stdout:8/564: truncate d0/d6/dc/d30/d25/d64/f75 2335430 0 2024-09-17T01:07:26.488 INFO:tasks.workunit.client.0.smithi103.stdout:3/948: dwrite d3/d16/d1b/f46 [4194304,4194304] 0 2024-09-17T01:07:26.489 INFO:tasks.workunit.client.0.smithi103.stdout:0/894: dread dd/d1c/d9f/fb3 [0,4194304] 0 2024-09-17T01:07:26.498 INFO:tasks.workunit.client.0.smithi103.stdout:8/565: write d0/d6/dc/d30/f7f [881757,9780] 0 2024-09-17T01:07:26.506 INFO:tasks.workunit.client.0.smithi103.stdout:8/566: write d0/d6/dc/d30/d2d/f60 [653634,75021] 0 2024-09-17T01:07:26.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:26 smithi143 ceph-mon[35452]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:26.510 INFO:tasks.workunit.client.0.smithi103.stdout:8/567: chown d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/dac 0 1 2024-09-17T01:07:26.511 INFO:tasks.workunit.client.0.smithi103.stdout:3/949: dwrite d3/d16/d1b/d3c/d65/d83/dbf/ff0 [0,4194304] 0 2024-09-17T01:07:26.514 INFO:tasks.workunit.client.0.smithi103.stdout:3/950: chown d3/d16/d1b/d3c/d65/d75/dbe/d34/d140 482 1 2024-09-17T01:07:26.514 INFO:tasks.workunit.client.0.smithi103.stdout:0/895: dread dd/d1c/d9f/dd6/f11c [0,4194304] 0 2024-09-17T01:07:26.514 INFO:tasks.workunit.client.0.smithi103.stdout:3/951: chown d3/d16/d1b/d36/fb8 56 1 2024-09-17T01:07:26.522 INFO:tasks.workunit.client.0.smithi103.stdout:3/952: rename d3/d16/d1b/d3c/d65/d75/le1 to d3/dd7/de7/l141 0 2024-09-17T01:07:26.525 INFO:tasks.workunit.client.0.smithi103.stdout:3/953: mknod d3/d16/d1b/d3c/d65/d7e/dac/dce/c142 0 2024-09-17T01:07:26.531 INFO:tasks.workunit.client.0.smithi103.stdout:8/568: dwrite d0/d6/dc/f4b [0,4194304] 0 2024-09-17T01:07:26.534 INFO:tasks.workunit.client.0.smithi103.stdout:3/954: write d3/d16/d1b/f79 [4094954,51794] 0 2024-09-17T01:07:26.535 INFO:tasks.workunit.client.0.smithi103.stdout:3/955: truncate d3/d16/f13d 604993 0 2024-09-17T01:07:26.536 INFO:tasks.workunit.client.0.smithi103.stdout:3/956: chown d3/f66 0 1 2024-09-17T01:07:26.539 INFO:tasks.workunit.client.0.smithi103.stdout:8/569: dread d0/d6/f3b [0,4194304] 0 2024-09-17T01:07:26.539 INFO:tasks.workunit.client.0.smithi103.stdout:3/957: write d3/d16/d1b/d36/f10e [276805,49869] 0 2024-09-17T01:07:26.540 INFO:tasks.workunit.client.0.smithi103.stdout:8/570: fdatasync d0/d6/f89 0 2024-09-17T01:07:26.541 INFO:tasks.workunit.client.0.smithi103.stdout:3/958: read d3/d16/d1b/f5e [697973,75289] 0 2024-09-17T01:07:26.542 INFO:tasks.workunit.client.0.smithi103.stdout:8/571: readlink d0/d6/dc/d30/d25/d7d/d99/lb0 0 2024-09-17T01:07:26.544 INFO:tasks.workunit.client.0.smithi103.stdout:8/572: dread d0/d6/f3b [0,4194304] 0 2024-09-17T01:07:26.549 INFO:tasks.workunit.client.0.smithi103.stdout:3/959: dwrite d3/d44/d63/f13e [0,4194304] 0 2024-09-17T01:07:26.549 INFO:tasks.workunit.client.0.smithi103.stdout:8/573: symlink d0/d6/dc/d30/d25/lb5 0 2024-09-17T01:07:26.552 INFO:tasks.workunit.client.0.smithi103.stdout:3/960: creat d3/dd7/de7/f143 x:0 0 0 2024-09-17T01:07:26.555 INFO:tasks.workunit.client.0.smithi103.stdout:8/574: fsync d0/d6/dc/d30/d25/d64/f5b 0 2024-09-17T01:07:26.556 INFO:tasks.workunit.client.0.smithi103.stdout:8/575: chown d0/d6/dc/d30/d25/d64/f5b 49504 1 2024-09-17T01:07:26.559 INFO:tasks.workunit.client.0.smithi103.stdout:3/961: mkdir d3/d16/d90/d144 0 2024-09-17T01:07:26.561 INFO:tasks.workunit.client.0.smithi103.stdout:8/576: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/db6 0 2024-09-17T01:07:26.562 INFO:tasks.workunit.client.0.smithi103.stdout:3/962: creat d3/d16/d1b/d3c/d65/d7c/f145 x:0 0 0 2024-09-17T01:07:26.565 INFO:tasks.workunit.client.0.smithi103.stdout:3/963: chown d3/d16/d1b/d3c/d65/d75/d8d/cad 15 1 2024-09-17T01:07:26.568 INFO:tasks.workunit.client.0.smithi103.stdout:8/577: dwrite d0/d6/dc/d30/f7f [0,4194304] 0 2024-09-17T01:07:26.569 INFO:tasks.workunit.client.0.smithi103.stdout:3/964: creat d3/d16/d1b/d3c/d65/d7c/d10d/f146 x:0 0 0 2024-09-17T01:07:26.571 INFO:tasks.workunit.client.0.smithi103.stdout:3/965: fsync d3/d16/d1b/d3c/d65/d7e/dac/f126 0 2024-09-17T01:07:26.571 INFO:tasks.workunit.client.0.smithi103.stdout:8/578: symlink d0/d6/dc/d30/lb7 0 2024-09-17T01:07:26.572 INFO:tasks.workunit.client.0.smithi103.stdout:8/579: dread - d0/d6/f89 zero size 2024-09-17T01:07:26.573 INFO:tasks.workunit.client.0.smithi103.stdout:3/966: fsync d3/dd7/feb 0 2024-09-17T01:07:26.577 INFO:tasks.workunit.client.0.smithi103.stdout:3/967: mknod d3/d16/d1b/d86/c147 0 2024-09-17T01:07:26.577 INFO:tasks.workunit.client.0.smithi103.stdout:8/580: chown d0/d6/dc/d30/d25/d64/f75 14 1 2024-09-17T01:07:26.577 INFO:tasks.workunit.client.0.smithi103.stdout:8/581: read - d0/d6/dc/d3d/f7e zero size 2024-09-17T01:07:26.581 INFO:tasks.workunit.client.0.smithi103.stdout:3/968: dread d3/d16/d1b/d3c/d65/d75/dbe/f58 [0,4194304] 0 2024-09-17T01:07:26.584 INFO:tasks.workunit.client.0.smithi103.stdout:3/969: readlink d3/d16/l23 0 2024-09-17T01:07:26.586 INFO:tasks.workunit.client.0.smithi103.stdout:3/970: creat d3/d16/d1b/d3c/d65/d7c/f148 x:0 0 0 2024-09-17T01:07:26.589 INFO:tasks.workunit.client.0.smithi103.stdout:8/582: write d0/d6/dc/d30/d25/d7d/fa0 [1026524,55408] 0 2024-09-17T01:07:26.590 INFO:tasks.workunit.client.0.smithi103.stdout:3/971: mknod d3/d44/d129/d132/c149 0 2024-09-17T01:07:26.590 INFO:tasks.workunit.client.0.smithi103.stdout:8/583: chown d0/d6/f3b 89 1 2024-09-17T01:07:26.590 INFO:tasks.workunit.client.0.smithi103.stdout:3/972: chown d3/d16/d1b/d3c/l62 114012 1 2024-09-17T01:07:26.591 INFO:tasks.workunit.client.0.smithi103.stdout:8/584: stat d0/d6/dc/d30/d25/d7d 0 2024-09-17T01:07:26.594 INFO:tasks.workunit.client.0.smithi103.stdout:8/585: mkdir d0/d6/dc/d3d/d6d/db8 0 2024-09-17T01:07:26.595 INFO:tasks.workunit.client.0.smithi103.stdout:3/973: creat d3/d16/d1b/d3c/d65/d75/d9c/dd3/d13c/f14a x:0 0 0 2024-09-17T01:07:26.596 INFO:tasks.workunit.client.0.smithi103.stdout:3/974: fdatasync d3/d81/f133 0 2024-09-17T01:07:26.602 INFO:tasks.workunit.client.0.smithi103.stdout:3/975: truncate d3/d16/d1b/d3c/d65/d75/dbe/f58 1146606 0 2024-09-17T01:07:26.603 INFO:tasks.workunit.client.0.smithi103.stdout:8/586: truncate d0/d6/dc/d30/d2d/f60 526698 0 2024-09-17T01:07:26.604 INFO:tasks.workunit.client.0.smithi103.stdout:3/976: truncate d3/d44/fc1 844191 0 2024-09-17T01:07:26.615 INFO:tasks.workunit.client.0.smithi103.stdout:3/977: truncate d3/f59 2752509 0 2024-09-17T01:07:26.619 INFO:tasks.workunit.client.0.smithi103.stdout:3/978: mknod d3/d16/d1b/d3c/d65/d75/dd1/c14b 0 2024-09-17T01:07:26.626 INFO:tasks.workunit.client.0.smithi103.stdout:3/979: dwrite d3/d16/d1b/d3c/d65/df7/f104 [0,4194304] 0 2024-09-17T01:07:26.643 INFO:tasks.workunit.client.0.smithi103.stdout:3/980: write d3/d16/d1b/d3c/d65/d75/dbe/f58 [250454,116422] 0 2024-09-17T01:07:26.644 INFO:tasks.workunit.client.0.smithi103.stdout:3/981: write d3/d16/d1b/d3c/d65/df7/ffa [445950,17623] 0 2024-09-17T01:07:26.647 INFO:tasks.workunit.client.0.smithi103.stdout:3/982: symlink d3/d16/d1b/d86/l14c 0 2024-09-17T01:07:26.647 INFO:tasks.workunit.client.0.smithi103.stdout:3/983: truncate d3/fb0 4206193 0 2024-09-17T01:07:26.648 INFO:tasks.workunit.client.0.smithi103.stdout:3/984: fsync d3/d81/fb4 0 2024-09-17T01:07:26.651 INFO:tasks.workunit.client.0.smithi103.stdout:3/985: rename d3/d16/d1b/f74 to d3/d44/d63/f14d 0 2024-09-17T01:07:26.654 INFO:tasks.workunit.client.0.smithi103.stdout:3/986: mkdir d3/d16/d1b/d3c/d65/d75/dbe/d34/d8c/d14e 0 2024-09-17T01:07:26.657 INFO:tasks.workunit.client.0.smithi103.stdout:3/987: rename d3/d16/d90/d12b to d3/d14f 0 2024-09-17T01:07:26.657 INFO:tasks.workunit.client.0.smithi103.stdout:3/988: stat d3/d16/d1b/d3c/d65/d7e/cd2 0 2024-09-17T01:07:26.658 INFO:tasks.workunit.client.0.smithi103.stdout:3/989: chown d3/dd7/de7/f143 0 1 2024-09-17T01:07:26.661 INFO:tasks.workunit.client.0.smithi103.stdout:3/990: creat d3/d44/d129/f150 x:0 0 0 2024-09-17T01:07:26.664 INFO:tasks.workunit.client.0.smithi103.stdout:3/991: creat d3/d16/d90/d106/f151 x:0 0 0 2024-09-17T01:07:26.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:26 smithi103 ceph-mon[28156]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:26.684 INFO:tasks.workunit.client.0.smithi103.stdout:3/992: dwrite d3/d44/f4a [0,4194304] 0 2024-09-17T01:07:26.721 INFO:tasks.workunit.client.0.smithi103.stdout:7/775: sync 2024-09-17T01:07:26.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.753+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fee68107800 con 0x7fee680ffc30 2024-09-17T01:07:26.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.754+0000 7fee64ff9640 1 -- 172.21.15.103:0/51447455 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7fee5c07b160 con 0x7fee680ffc30 2024-09-17T01:07:26.753 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:07:26.753 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:07:26.753 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:07:26.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 13, 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:07:26.755 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:07:26.756 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fee5006d8e0 msgr2=0x7fee5006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fee5006d8e0 0x7fee5006fda0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fee580058c0 tx=0x7fee58005f90 comp rx=0 tx=0).stop 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680ffc30 msgr2=0x7fee68194a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680ffc30 0x7fee68194a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009850 tx=0x7fee5c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 shutdown_connections 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fee5006d8e0 0x7fee5006fda0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee680ffc30 0x7fee68194a40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 --2- 172.21.15.103:0/51447455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee680fea30 0x7fee68194500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 >> 172.21.15.103:0/51447455 conn(0x7fee680fa1c0 msgr2=0x7fee68102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:26.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 shutdown_connections 2024-09-17T01:07:26.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.756+0000 7fee6dd2c640 1 -- 172.21.15.103:0/51447455 wait complete. 2024-09-17T01:07:26.811 INFO:tasks.workunit.client.0.smithi103.stdout:3/993: read - d3/d16/d1b/d36/fa9 zero size 2024-09-17T01:07:26.815 INFO:tasks.workunit.client.0.smithi103.stdout:3/994: unlink d3/d16/d90/c9a 0 2024-09-17T01:07:26.816 INFO:tasks.workunit.client.0.smithi103.stdout:3/995: chown d3/d16/d1b/d3c/d65/d7e/fba 5634 1 2024-09-17T01:07:26.819 INFO:tasks.workunit.client.0.smithi103.stdout:7/776: dread d4/d10/f56 [0,4194304] 0 2024-09-17T01:07:26.821 INFO:tasks.workunit.client.0.smithi103.stdout:3/996: rename d3/d16/d1b/d3c/d65/d75/dd1/c131 to d3/d16/d1b/d3c/d65/d7e/da3/df5/c152 0 2024-09-17T01:07:26.824 INFO:tasks.workunit.client.0.smithi103.stdout:3/997: creat d3/d44/d129/f153 x:0 0 0 2024-09-17T01:07:26.828 INFO:tasks.workunit.client.0.smithi103.stdout:3/998: creat d3/d16/d1b/d3c/d65/d7c/d10d/f154 x:0 0 0 2024-09-17T01:07:26.832 INFO:tasks.workunit.client.0.smithi103.stdout:3/999: unlink d3/d16/d1b/l7d 0 2024-09-17T01:07:26.836 INFO:tasks.workunit.client.0.smithi103.stdout:7/777: truncate d4/d10/d43/dc8/fbf 152270 0 2024-09-17T01:07:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 -- 172.21.15.103:0/2834298948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 msgr2=0x7ff9580fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 --2- 172.21.15.103:0/2834298948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff9580fee30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009880 tx=0x7ff94c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 -- 172.21.15.103:0/2834298948 shutdown_connections 2024-09-17T01:07:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 --2- 172.21.15.103:0/2834298948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 0x7ff9581000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 --2- 172.21.15.103:0/2834298948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff9580fee30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 -- 172.21.15.103:0/2834298948 >> 172.21.15.103:0/2834298948 conn(0x7ff9580fa1c0 msgr2=0x7ff9580fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 -- 172.21.15.103:0/2834298948 shutdown_connections 2024-09-17T01:07:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.846+0000 7ff95eda1640 1 -- 172.21.15.103:0/2834298948 wait complete. 2024-09-17T01:07:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.847+0000 7ff95eda1640 1 Processor -- start 2024-09-17T01:07:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.847+0000 7ff95eda1640 1 -- start start 2024-09-17T01:07:26.848 INFO:tasks.workunit.client.0.smithi103.stdout:7/778: write d4/d10/d43/f57 [4502328,42964] 0 2024-09-17T01:07:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.847+0000 7ff95eda1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff958194510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.847+0000 7ff95eda1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 0x7ff958194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.847+0000 7ff95eda1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958195020 con 0x7ff9580fea30 2024-09-17T01:07:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff95cb3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff958194510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff95eda1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958195190 con 0x7ff9580ffc30 2024-09-17T01:07:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff957fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 0x7ff958194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff95cb3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff958194510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39122/0 (socket says 172.21.15.103:39122) 2024-09-17T01:07:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff95cb3d640 1 -- 172.21.15.103:0/1574792422 learned_addr learned my addr 172.21.15.103:0/1574792422 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff957fff640 1 -- 172.21.15.103:0/1574792422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 msgr2=0x7ff958194510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff957fff640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff958194510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff957fff640 1 -- 172.21.15.103:0/1574792422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009560 con 0x7ff9580ffc30 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.848+0000 7ff957fff640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 0x7ff958194a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff94400d6d0 tx=0x7ff94400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.849+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9440051f0 con 0x7ff9580ffc30 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.849+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff944004c60 con 0x7ff9580ffc30 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.849+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff944009d30 con 0x7ff9580ffc30 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.849+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff958067c40 con 0x7ff9580ffc30 2024-09-17T01:07:26.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.849+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff958068100 con 0x7ff9580ffc30 2024-09-17T01:07:26.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.851+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958107620 con 0x7ff9580ffc30 2024-09-17T01:07:26.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.851+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7ff9440046c0 con 0x7ff9580ffc30 2024-09-17T01:07:26.854 INFO:tasks.workunit.client.0.smithi103.stdout:7/779: mknod d4/d4a/d4b/d8a/c10e 0 2024-09-17T01:07:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.851+0000 7ff955ffb640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7ff94806d8e0 0x7ff94806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.852+0000 7ff95cb3d640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7ff94806d8e0 0x7ff94806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.852+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7ff94408d020 con 0x7ff9580ffc30 2024-09-17T01:07:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.852+0000 7ff95cb3d640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7ff94806d8e0 0x7ff94806fda0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff94c000c00 tx=0x7ff94c0314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:26.856 INFO:tasks.workunit.client.0.smithi103.stdout:7/780: read d4/d11/d3f/d63/f73 [2115987,92665] 0 2024-09-17T01:07:26.856 INFO:tasks.workunit.client.0.smithi103.stdout:7/781: rmdir d4/d10/d37/d95 39 2024-09-17T01:07:26.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:26.856+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff9440c1d10 con 0x7ff9580ffc30 2024-09-17T01:07:26.858 INFO:tasks.workunit.client.0.smithi103.stdout:7/782: creat d4/d4a/d4b/d8a/dff/db8/f10f x:0 0 0 2024-09-17T01:07:26.860 INFO:tasks.workunit.client.0.smithi103.stdout:7/783: fsync d4/d10/d6b/dc5/d8d/fbc 0 2024-09-17T01:07:26.860 INFO:tasks.workunit.client.0.smithi103.stdout:7/784: readlink d4/d10/d37/lee 0 2024-09-17T01:07:26.872 INFO:tasks.workunit.client.0.smithi103.stdout:7/785: dwrite d4/d10/d6b/dc5/d36/d3a/f6e [0,4194304] 0 2024-09-17T01:07:26.892 INFO:tasks.workunit.client.0.smithi103.stdout:7/786: mkdir d4/d4a/d4b/d8a/dff/db8/d110 0 2024-09-17T01:07:26.894 INFO:tasks.workunit.client.0.smithi103.stdout:7/787: mkdir d4/d10/d6b/dc5/d36/d3a/d51/d111 0 2024-09-17T01:07:26.895 INFO:tasks.workunit.client.0.smithi103.stdout:7/788: dread - d4/d10/d6b/d9f/fda zero size 2024-09-17T01:07:26.897 INFO:tasks.workunit.client.0.smithi103.stdout:7/789: read - d4/d10/f94 zero size 2024-09-17T01:07:26.899 INFO:tasks.workunit.client.0.smithi103.stdout:7/790: fsync d4/d11/d34/db5/f6c 0 2024-09-17T01:07:26.903 INFO:tasks.workunit.client.0.smithi103.stdout:7/791: fdatasync d4/d10/d6b/dc5/d36/d3a/f5d 0 2024-09-17T01:07:26.904 INFO:tasks.workunit.client.0.smithi103.stdout:7/792: chown d4/d11/d3f/d63/f73 1 1 2024-09-17T01:07:26.905 INFO:tasks.workunit.client.0.smithi103.stdout:7/793: chown d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/l104 169 1 2024-09-17T01:07:26.911 INFO:tasks.workunit.client.0.smithi103.stdout:7/794: dwrite d4/d4a/d4b/d9d/fb6 [0,4194304] 0 2024-09-17T01:07:26.914 INFO:tasks.workunit.client.0.smithi103.stdout:7/795: creat d4/d10/d6b/f112 x:0 0 0 2024-09-17T01:07:26.919 INFO:tasks.workunit.client.0.smithi103.stdout:7/796: fdatasync d4/d10/f35 0 2024-09-17T01:07:26.922 INFO:tasks.workunit.client.0.smithi103.stdout:7/797: rmdir d4/d10/d6b/dc5/d36/d82 39 2024-09-17T01:07:26.923 INFO:tasks.workunit.client.0.smithi103.stdout:7/798: unlink d4/d10/d66/l77 0 2024-09-17T01:07:26.941 INFO:tasks.workunit.client.0.smithi103.stdout:7/799: dread d4/d10/f25 [0,4194304] 0 2024-09-17T01:07:26.950 INFO:tasks.workunit.client.0.smithi103.stdout:7/800: write d4/d4a/d4b/fcd [323242,108891] 0 2024-09-17T01:07:26.960 INFO:tasks.workunit.client.0.smithi103.stdout:7/801: dwrite d4/d10/d6b/dc5/d36/d3a/d51/d5e/f64 [0,4194304] 0 2024-09-17T01:07:26.965 INFO:tasks.workunit.client.0.smithi103.stdout:7/802: mknod d4/c113 0 2024-09-17T01:07:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:7/803: symlink d4/d10/d6b/dc5/d8d/d92/db3/l114 0 2024-09-17T01:07:26.976 INFO:tasks.workunit.client.0.smithi103.stdout:7/804: getdents d4/d10/d6b/dc5/d36/d82 0 2024-09-17T01:07:26.980 INFO:tasks.workunit.client.0.smithi103.stdout:7/805: creat d4/f115 x:0 0 0 2024-09-17T01:07:26.996 INFO:tasks.workunit.client.0.smithi103.stdout:7/806: dread d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:26.998 INFO:tasks.workunit.client.0.smithi103.stdout:7/807: mknod d4/d10/d43/c116 0 2024-09-17T01:07:27.002 INFO:tasks.workunit.client.0.smithi103.stdout:7/808: mknod d4/d10/d37/d95/c117 0 2024-09-17T01:07:27.059 INFO:tasks.workunit.client.0.smithi103.stdout:6/806: sync 2024-09-17T01:07:27.061 INFO:tasks.workunit.client.0.smithi103.stdout:6/807: fsync d3/ff 0 2024-09-17T01:07:27.066 INFO:tasks.workunit.client.0.smithi103.stdout:6/808: rename d3/d16/d33/d3e/d58/d82/f109 to d3/d16/d21/dab/f113 0 2024-09-17T01:07:27.068 INFO:tasks.workunit.client.0.smithi103.stdout:6/809: truncate d3/d25/d74/f8e 5162988 0 2024-09-17T01:07:27.069 INFO:tasks.workunit.client.0.smithi103.stdout:6/810: fdatasync d3/dfe/dc1/f103 0 2024-09-17T01:07:27.070 INFO:tasks.workunit.client.0.smithi103.stdout:6/811: truncate d3/f36 4627709 0 2024-09-17T01:07:27.075 INFO:tasks.workunit.client.0.smithi103.stdout:6/812: dwrite d3/f11 [0,4194304] 0 2024-09-17T01:07:27.081 INFO:tasks.workunit.client.0.smithi103.stdout:6/813: creat d3/d16/d33/d57/d63/f114 x:0 0 0 2024-09-17T01:07:27.085 INFO:tasks.workunit.client.0.smithi103.stdout:6/814: creat d3/d25/d74/f115 x:0 0 0 2024-09-17T01:07:27.088 INFO:tasks.workunit.client.0.smithi103.stdout:6/815: creat d3/d16/df5/f116 x:0 0 0 2024-09-17T01:07:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.148+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff958107830 con 0x7ff9580ffc30 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.149+0000 7ff955ffb640 1 -- 172.21.15.103:0/1574792422 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7ff944017770 con 0x7ff9580ffc30 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:07:27.148 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:07:27.149 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:27.150 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:07:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:07:27.151 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:07:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:07:27.151 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:27.151 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7ff94806d8e0 msgr2=0x7ff94806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7ff94806d8e0 0x7ff94806fda0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff94c000c00 tx=0x7ff94c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 msgr2=0x7ff958194a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 0x7ff958194a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff94400d6d0 tx=0x7ff94400db90 comp rx=0 tx=0).stop 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 shutdown_connections 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7ff94806d8e0 0x7ff94806fda0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9580ffc30 0x7ff958194a50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 --2- 172.21.15.103:0/1574792422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9580fea30 0x7ff958194510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 >> 172.21.15.103:0/1574792422 conn(0x7ff9580fa1c0 msgr2=0x7ff958102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 shutdown_connections 2024-09-17T01:07:27.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.151+0000 7ff95eda1640 1 -- 172.21.15.103:0/1574792422 wait complete. 2024-09-17T01:07:27.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.271+0000 7f28e4c66640 1 -- 172.21.15.103:0/101773654 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e0106670 msgr2=0x7f28e0106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.271+0000 7f28e4c66640 1 --2- 172.21.15.103:0/101773654 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e0106670 0x7f28e0106a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009880 tx=0x7f28d002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.273+0000 7f28e4c66640 1 -- 172.21.15.103:0/101773654 shutdown_connections 2024-09-17T01:07:27.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.273+0000 7f28e4c66640 1 --2- 172.21.15.103:0/101773654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28e01073f0 0x7f28e0107870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.273+0000 7f28e4c66640 1 --2- 172.21.15.103:0/101773654 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e0106670 0x7f28e0106a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.273+0000 7f28e4c66640 1 -- 172.21.15.103:0/101773654 >> 172.21.15.103:0/101773654 conn(0x7f28e0075530 msgr2=0x7f28e0077990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:27.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.273+0000 7f28e4c66640 1 -- 172.21.15.103:0/101773654 shutdown_connections 2024-09-17T01:07:27.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.274+0000 7f28e4c66640 1 -- 172.21.15.103:0/101773654 wait complete. 2024-09-17T01:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28e4c66640 1 Processor -- start 2024-09-17T01:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28e4c66640 1 -- start start 2024-09-17T01:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28e4c66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28e0106670 0x7f28e019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28e4c66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 0x7f28e019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28e4c66640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e019c740 con 0x7f28e0106670 2024-09-17T01:07:27.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28e4c66640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e019c8b0 con 0x7f28e01073f0 2024-09-17T01:07:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28de59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28e0106670 0x7f28e019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28ddd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 0x7f28e019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28ddd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 0x7f28e019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:59142/0 (socket says 172.21.15.103:59142) 2024-09-17T01:07:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.275+0000 7f28ddd9b640 1 -- 172.21.15.103:0/1811637010 learned_addr learned my addr 172.21.15.103:0/1811637010 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.276+0000 7f28ddd9b640 1 -- 172.21.15.103:0/1811637010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28e0106670 msgr2=0x7f28e019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.276+0000 7f28ddd9b640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28e0106670 0x7f28e019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.276+0000 7f28ddd9b640 1 -- 172.21.15.103:0/1811637010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0009560 con 0x7f28e01073f0 2024-09-17T01:07:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.276+0000 7f28ddd9b640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 0x7f28e019c170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28d800ea30 tx=0x7f28d800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.276+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28d800cdb0 con 0x7f28e01073f0 2024-09-17T01:07:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.277+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f28d8011930 con 0x7f28e01073f0 2024-09-17T01:07:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.277+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e01a1340 con 0x7f28e01073f0 2024-09-17T01:07:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.277+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e01a18e0 con 0x7f28e01073f0 2024-09-17T01:07:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.277+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28d801aa30 con 0x7f28e01073f0 2024-09-17T01:07:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.278+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e0195d10 con 0x7f28e01073f0 2024-09-17T01:07:27.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.279+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f28d801ab90 con 0x7f28e01073f0 2024-09-17T01:07:27.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.280+0000 7f28cf7fe640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f28c806da00 0x7f28c806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:27.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.280+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f28d808da00 con 0x7f28e01073f0 2024-09-17T01:07:27.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.280+0000 7f28de59c640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f28c806da00 0x7f28c806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.281+0000 7f28de59c640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f28c806da00 0x7f28c806fec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f28d002aaa0 tx=0x7f28d00314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:27.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.288+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f28d8056fc0 con 0x7f28e01073f0 2024-09-17T01:07:27.403 INFO:tasks.workunit.client.0.smithi103.stdout:9/723: sync 2024-09-17T01:07:27.415 INFO:tasks.workunit.client.0.smithi103.stdout:9/724: getdents d7/db8/dbb 0 2024-09-17T01:07:27.420 INFO:tasks.workunit.client.0.smithi103.stdout:9/725: creat d7/d43/dcf/fee x:0 0 0 2024-09-17T01:07:27.424 INFO:tasks.workunit.client.0.smithi103.stdout:9/726: symlink d7/d43/d88/d11/d5c/d5e/d6c/d6e/d77/lef 0 2024-09-17T01:07:27.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:27 smithi103 ceph-mon[28156]: pgmap v24: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 201 MiB/s wr, 489 op/s 2024-09-17T01:07:27.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:27 smithi103 ceph-mon[28156]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:27 smithi103 ceph-mon[28156]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:27 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/51447455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:27 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1574792422' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:07:27.428 INFO:tasks.workunit.client.0.smithi103.stdout:9/727: truncate d7/d43/d88/d11/d20/d4f/f75 38561 0 2024-09-17T01:07:27.438 INFO:tasks.workunit.client.0.smithi103.stdout:9/728: dread d7/db8/dbb/f26 [0,4194304] 0 2024-09-17T01:07:27.442 INFO:tasks.workunit.client.0.smithi103.stdout:9/729: getdents d7/d43/d88/d11/d20/d4f/d95/d9a/dc0 0 2024-09-17T01:07:27.444 INFO:tasks.workunit.client.0.smithi103.stdout:9/730: chown d7/d43/d88/d11/d5c/d5e/d6c/f84 58784109 1 2024-09-17T01:07:27.447 INFO:tasks.workunit.client.0.smithi103.stdout:9/731: creat d7/d43/d88/d11/d20/dbc/ff0 x:0 0 0 2024-09-17T01:07:27.452 INFO:tasks.workunit.client.0.smithi103.stdout:9/732: truncate d7/d43/d88/f5a 1193406 0 2024-09-17T01:07:27.489 INFO:tasks.workunit.client.0.smithi103.stdout:9/733: creat d7/ff1 x:0 0 0 2024-09-17T01:07:27.493 INFO:tasks.workunit.client.0.smithi103.stdout:9/734: symlink d7/d43/d88/d11/d20/d4f/d95/d9a/lf2 0 2024-09-17T01:07:27.495 INFO:tasks.workunit.client.0.smithi103.stdout:9/735: truncate d7/d43/d79/f8b 533609 0 2024-09-17T01:07:27.505 INFO:tasks.workunit.client.0.smithi103.stdout:9/736: write d7/d43/d88/d11/d5c/d5e/d6c/d6e/f96 [1831563,118849] 0 2024-09-17T01:07:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:27 smithi143 ceph-mon[35452]: pgmap v24: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 201 MiB/s wr, 489 op/s 2024-09-17T01:07:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:27 smithi143 ceph-mon[35452]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:27 smithi143 ceph-mon[35452]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:27 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/51447455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:27 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1574792422' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:07:27.514 INFO:tasks.workunit.client.0.smithi103.stdout:9/737: write d7/d2d/d59/f66 [1223432,32908] 0 2024-09-17T01:07:27.515 INFO:tasks.workunit.client.0.smithi103.stdout:9/738: chown d7/d43/d88/d11/d20/d4f/l62 0 1 2024-09-17T01:07:27.526 INFO:tasks.workunit.client.0.smithi103.stdout:9/739: dwrite d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/fca [0,4194304] 0 2024-09-17T01:07:27.529 INFO:tasks.workunit.client.0.smithi103.stdout:9/740: truncate d7/db8/dbb/fa4 432691 0 2024-09-17T01:07:27.530 INFO:tasks.workunit.client.0.smithi103.stdout:9/741: chown d7/l56 27 1 2024-09-17T01:07:27.533 INFO:tasks.workunit.client.0.smithi103.stdout:9/742: symlink d7/d43/d88/d11/d5c/d5e/lf3 0 2024-09-17T01:07:27.534 INFO:tasks.workunit.client.0.smithi103.stdout:9/743: fsync d7/d43/d88/d11/d5c/d8d/fe7 0 2024-09-17T01:07:27.536 INFO:tasks.workunit.client.0.smithi103.stdout:9/744: fdatasync f0 0 2024-09-17T01:07:27.538 INFO:tasks.workunit.client.0.smithi103.stdout:9/745: write d7/d43/d88/d11/d20/d4f/f78 [1538794,54368] 0 2024-09-17T01:07:27.539 INFO:tasks.workunit.client.0.smithi103.stdout:9/746: readlink d7/d2d/l45 0 2024-09-17T01:07:27.545 INFO:tasks.workunit.client.0.smithi103.stdout:9/747: dwrite d7/d43/d88/f38 [0,4194304] 0 2024-09-17T01:07:27.547 INFO:tasks.workunit.client.0.smithi103.stdout:9/748: dread - d7/db8/fc4 zero size 2024-09-17T01:07:27.566 INFO:tasks.workunit.client.0.smithi103.stdout:9/749: dread d7/db4/fc6 [0,4194304] 0 2024-09-17T01:07:27.567 INFO:tasks.workunit.client.0.smithi103.stdout:9/750: chown d7/d43/d88/d11/d5c/d5e/d6c/ce9 3083 1 2024-09-17T01:07:27.569 INFO:tasks.workunit.client.0.smithi103.stdout:9/751: chown d7/d43/d88/f23 479258 1 2024-09-17T01:07:27.571 INFO:tasks.workunit.client.0.smithi103.stdout:9/752: creat d7/d43/d5f/d7d/d80/d93/ff4 x:0 0 0 2024-09-17T01:07:27.576 INFO:tasks.workunit.client.0.smithi103.stdout:9/753: dread - d7/d43/d88/d11/d20/dbc/fcb zero size 2024-09-17T01:07:27.582 INFO:tasks.workunit.client.0.smithi103.stdout:9/754: mkdir d7/d43/d88/d11/d5c/d8d/dac/dc2/df5 0 2024-09-17T01:07:27.584 INFO:tasks.workunit.client.0.smithi103.stdout:9/755: rmdir d7/db4 39 2024-09-17T01:07:27.587 INFO:tasks.workunit.client.0.smithi103.stdout:9/756: creat d7/d43/d88/d11/d5c/ff6 x:0 0 0 2024-09-17T01:07:27.589 INFO:tasks.workunit.client.0.smithi103.stdout:9/757: mkdir d7/d43/d88/d11/d20/d4f/df7 0 2024-09-17T01:07:27.592 INFO:tasks.workunit.client.0.smithi103.stdout:9/758: getdents d7/d43/d88/d11/d5c/d5e/d6c/d6e/d77 0 2024-09-17T01:07:27.593 INFO:tasks.workunit.client.0.smithi103.stdout:9/759: chown d7/d43/d5f 457 1 2024-09-17T01:07:27.595 INFO:tasks.workunit.client.0.smithi103.stdout:9/760: creat d7/d43/d88/ff8 x:0 0 0 2024-09-17T01:07:27.600 INFO:tasks.workunit.client.0.smithi103.stdout:9/761: creat d7/d43/d88/d11/d20/d4f/d95/ff9 x:0 0 0 2024-09-17T01:07:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.601+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28e002c4f0 con 0x7f28c806da00 2024-09-17T01:07:27.601 INFO:tasks.workunit.client.0.smithi103.stdout:9/762: rename d7/d43/d88/d11/d5c/d5e/d6c/d6e/d77/lef to d7/d43/d88/d11/d20/d8e/lfa 0 2024-09-17T01:07:27.601 INFO:tasks.workunit.client.0.smithi103.stdout:9/763: readlink d7/d43/d88/l41 0 2024-09-17T01:07:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.602+0000 7f28cf7fe640 1 -- 172.21.15.103:0/1811637010 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f28e002c4f0 con 0x7f28c806da00 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [], 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:07:27.602 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:07:27.603 INFO:tasks.workunit.client.0.smithi103.stdout:9/764: creat d7/d43/d88/d11/d5c/d8d/dac/dc2/ffb x:0 0 0 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f28c806da00 msgr2=0x7f28c806fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f28c806da00 0x7f28c806fec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f28d002aaa0 tx=0x7f28d00314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 msgr2=0x7f28e019c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 0x7f28e019c170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28d800ea30 tx=0x7f28d800eef0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 shutdown_connections 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f28c806da00 0x7f28c806fec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28e01073f0 0x7f28e019c170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 --2- 172.21.15.103:0/1811637010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28e0106670 0x7f28e019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 >> 172.21.15.103:0/1811637010 conn(0x7f28e0075530 msgr2=0x7f28e010aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 shutdown_connections 2024-09-17T01:07:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.605+0000 7f28e4c66640 1 -- 172.21.15.103:0/1811637010 wait complete. 2024-09-17T01:07:27.606 INFO:tasks.workunit.client.0.smithi103.stdout:9/765: mknod d7/d43/d88/d11/d20/d4f/d95/d9a/de5/cfc 0 2024-09-17T01:07:27.620 INFO:tasks.workunit.client.0.smithi103.stdout:9/766: write d7/d43/d88/d11/f1f [1744812,121299] 0 2024-09-17T01:07:27.624 INFO:tasks.workunit.client.0.smithi103.stdout:9/767: rename d7/db8/fc5 to d7/d43/d88/d11/d20/d4f/d95/ffd 0 2024-09-17T01:07:27.626 INFO:tasks.workunit.client.0.smithi103.stdout:9/768: mkdir d7/d43/d88/d11/d5c/d8d/dac/dfe 0 2024-09-17T01:07:27.628 INFO:tasks.workunit.client.0.smithi103.stdout:9/769: mknod d7/d43/d88/d11/d5c/d8d/dac/dc2/df5/cff 0 2024-09-17T01:07:27.629 INFO:tasks.workunit.client.0.smithi103.stdout:9/770: write d7/d2d/d59/f68 [4485549,79476] 0 2024-09-17T01:07:27.680 INFO:tasks.workunit.client.0.smithi103.stdout:9/771: truncate d7/db8/dbb/f26 2051485 0 2024-09-17T01:07:27.680 INFO:tasks.workunit.client.0.smithi103.stdout:9/772: stat d7/d43/d88/d11/d5c/fd5 0 2024-09-17T01:07:27.681 INFO:tasks.workunit.client.0.smithi103.stdout:9/773: symlink d7/d43/d5f/l100 0 2024-09-17T01:07:27.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 -- 172.21.15.103:0/1144683732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580ffc50 msgr2=0x7fe0581000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 --2- 172.21.15.103:0/1144683732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580ffc50 0x7fe0581000d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe048009880 tx=0x7fe04802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 -- 172.21.15.103:0/1144683732 shutdown_connections 2024-09-17T01:07:27.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 --2- 172.21.15.103:0/1144683732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580ffc50 0x7fe0581000d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 --2- 172.21.15.103:0/1144683732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580fea50 0x7fe0580fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 -- 172.21.15.103:0/1144683732 >> 172.21.15.103:0/1144683732 conn(0x7fe0580fa1c0 msgr2=0x7fe0580fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:27.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 -- 172.21.15.103:0/1144683732 shutdown_connections 2024-09-17T01:07:27.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.689+0000 7fe05ff64640 1 -- 172.21.15.103:0/1144683732 wait complete. 2024-09-17T01:07:27.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05ff64640 1 Processor -- start 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05ff64640 1 -- start start 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05ff64640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 0x7fe0581956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05ff64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580ffc50 0x7fe058195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05ff64640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0581961c0 con 0x7fe0580fea50 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05ff64640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe058196330 con 0x7fe0580ffc50 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05dd00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 0x7fe0581956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05dd00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 0x7fe0581956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39166/0 (socket says 172.21.15.103:39166) 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05dd00640 1 -- 172.21.15.103:0/3313046323 learned_addr learned my addr 172.21.15.103:0/3313046323 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05d4ff640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580ffc50 0x7fe058195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05dd00640 1 -- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580ffc50 msgr2=0x7fe058195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05dd00640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580ffc50 0x7fe058195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05dd00640 1 -- 172.21.15.103:0/3313046323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048009560 con 0x7fe0580fea50 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.690+0000 7fe05d4ff640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580ffc50 0x7fe058195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.691+0000 7fe05dd00640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 0x7fe0581956b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe05400d900 tx=0x7fe05400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.691+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe054009c00 con 0x7fe0580fea50 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.691+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe054009d60 con 0x7fe0580fea50 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.691+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe05400f7b0 con 0x7fe0580fea50 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.691+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05819ad30 con 0x7fe0580fea50 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.691+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05819b1b0 con 0x7fe0580fea50 2024-09-17T01:07:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.692+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe058107640 con 0x7fe0580fea50 2024-09-17T01:07:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.692+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fe054010460 con 0x7fe0580fea50 2024-09-17T01:07:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.693+0000 7fe04effd640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fe04406d890 0x7fe04406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.693+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fe05408d7e0 con 0x7fe0580fea50 2024-09-17T01:07:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.693+0000 7fe05d4ff640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fe04406d890 0x7fe04406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.694+0000 7fe05d4ff640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fe04406d890 0x7fe04406fd50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe048000c00 tx=0x7fe0480314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:27.697+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fe054056d40 con 0x7fe0580fea50 2024-09-17T01:07:27.712 INFO:tasks.workunit.client.0.smithi103.stdout:9/774: rmdir d7/dea 0 2024-09-17T01:07:27.714 INFO:tasks.workunit.client.0.smithi103.stdout:9/775: creat d7/d43/d88/d11/d5c/d5e/f101 x:0 0 0 2024-09-17T01:07:27.717 INFO:tasks.workunit.client.0.smithi103.stdout:9/776: dread d7/db8/dbb/fa4 [0,4194304] 0 2024-09-17T01:07:27.718 INFO:tasks.workunit.client.0.smithi103.stdout:9/777: dread - d7/f87 zero size 2024-09-17T01:07:27.720 INFO:tasks.workunit.client.0.smithi103.stdout:9/778: mkdir d7/d43/d88/d11/d5c/d5e/d6c/d6e/d77/d102 0 2024-09-17T01:07:27.721 INFO:tasks.workunit.client.0.smithi103.stdout:9/779: chown d7/d43/d5f/d7d/d80/d93/lab 521542939 1 2024-09-17T01:07:27.723 INFO:tasks.workunit.client.0.smithi103.stdout:9/780: mknod d7/d43/d88/d11/d5c/d8d/dac/dc2/df5/c103 0 2024-09-17T01:07:27.726 INFO:tasks.workunit.client.0.smithi103.stdout:9/781: creat d7/db4/ddc/f104 x:0 0 0 2024-09-17T01:07:27.732 INFO:tasks.workunit.client.0.smithi103.stdout:9/782: dwrite d7/d43/d88/d11/d5c/fd5 [0,4194304] 0 2024-09-17T01:07:27.737 INFO:tasks.workunit.client.0.smithi103.stdout:9/783: creat d7/d43/d88/d11/d5c/d8d/dac/dae/f105 x:0 0 0 2024-09-17T01:07:27.739 INFO:tasks.workunit.client.0.smithi103.stdout:9/784: creat d7/d43/d88/d11/d5c/d8d/dac/dae/f106 x:0 0 0 2024-09-17T01:07:27.741 INFO:tasks.workunit.client.0.smithi103.stdout:9/785: rmdir d7/db8 39 2024-09-17T01:07:27.754 INFO:tasks.workunit.client.0.smithi103.stdout:9/786: write d7/d43/d88/f5a [1610493,128467] 0 2024-09-17T01:07:27.757 INFO:tasks.workunit.client.0.smithi103.stdout:9/787: rmdir d7/d43/d88/d11/d20/d4f/d95/d9a/de5 39 2024-09-17T01:07:27.757 INFO:tasks.workunit.client.0.smithi103.stdout:9/788: fsync d7/f19 0 2024-09-17T01:07:27.761 INFO:tasks.workunit.client.0.smithi103.stdout:9/789: mkdir d7/d2d/d107 0 2024-09-17T01:07:27.773 INFO:tasks.workunit.client.0.smithi103.stdout:9/790: dread d7/d43/d88/d11/d5c/d8d/f9e [0,4194304] 0 2024-09-17T01:07:27.776 INFO:tasks.workunit.client.0.smithi103.stdout:9/791: creat d7/d43/d88/d11/d5c/d8d/dac/dfe/f108 x:0 0 0 2024-09-17T01:07:27.779 INFO:tasks.workunit.client.0.smithi103.stdout:9/792: link d7/d43/d88/d11/d5c/d8d/dac/dc2/ffb d7/d43/d88/d11/d20/d4f/f109 0 2024-09-17T01:07:27.781 INFO:tasks.workunit.client.0.smithi103.stdout:9/793: creat d7/d43/d88/d11/d20/d4f/df7/f10a x:0 0 0 2024-09-17T01:07:27.783 INFO:tasks.workunit.client.0.smithi103.stdout:9/794: rmdir d7/d43/d5f/d7d 39 2024-09-17T01:07:27.789 INFO:tasks.workunit.client.0.smithi103.stdout:9/795: rmdir d7/d43/d88/d11/d5c 39 2024-09-17T01:07:27.792 INFO:tasks.workunit.client.0.smithi103.stdout:9/796: dread d7/db8/dbb/fa4 [0,4194304] 0 2024-09-17T01:07:27.797 INFO:tasks.workunit.client.0.smithi103.stdout:9/797: dwrite d7/d43/d88/d11/d20/d4f/f78 [0,4194304] 0 2024-09-17T01:07:27.816 INFO:tasks.workunit.client.0.smithi103.stdout:9/798: dwrite d7/f87 [0,4194304] 0 2024-09-17T01:07:27.817 INFO:tasks.workunit.client.0.smithi103.stdout:9/799: write d7/f18 [1290845,100] 0 2024-09-17T01:07:27.821 INFO:tasks.workunit.client.0.smithi103.stdout:9/800: rmdir d7/d43/d5f/d7d/d80 39 2024-09-17T01:07:27.827 INFO:tasks.workunit.client.0.smithi103.stdout:9/801: dwrite d7/d43/d88/d11/d5c/f61 [0,4194304] 0 2024-09-17T01:07:27.837 INFO:tasks.workunit.client.0.smithi103.stdout:9/802: dwrite d7/d43/d88/d11/d5c/d8d/f9e [4194304,4194304] 0 2024-09-17T01:07:27.838 INFO:tasks.workunit.client.0.smithi103.stdout:9/803: write d7/d2d/d59/f66 [1785706,15380] 0 2024-09-17T01:07:27.839 INFO:tasks.workunit.client.0.smithi103.stdout:9/804: stat d7/db8/dbb 0 2024-09-17T01:07:27.844 INFO:tasks.workunit.client.0.smithi103.stdout:4/771: sync 2024-09-17T01:07:27.844 INFO:tasks.workunit.client.0.smithi103.stdout:5/579: sync 2024-09-17T01:07:27.847 INFO:tasks.workunit.client.0.smithi103.stdout:4/772: creat d9/d16/d70/dc0/fef x:0 0 0 2024-09-17T01:07:27.849 INFO:tasks.workunit.client.0.smithi103.stdout:5/580: mknod d6/d2c/d38/d4c/dd5/cd6 0 2024-09-17T01:07:27.851 INFO:tasks.workunit.client.0.smithi103.stdout:4/773: mkdir d9/d16/d23/d52/df0 0 2024-09-17T01:07:27.853 INFO:tasks.workunit.client.0.smithi103.stdout:5/581: unlink d6/d2c/d38/c46 0 2024-09-17T01:07:27.854 INFO:tasks.workunit.client.0.smithi103.stdout:5/582: fdatasync d6/d28/f96 0 2024-09-17T01:07:27.854 INFO:tasks.workunit.client.0.smithi103.stdout:4/774: symlink d9/dc/df/lf1 0 2024-09-17T01:07:27.856 INFO:tasks.workunit.client.0.smithi103.stdout:4/775: write d9/d16/d23/d2a/f5c [632676,58721] 0 2024-09-17T01:07:27.860 INFO:tasks.workunit.client.0.smithi103.stdout:9/805: dread f0 [0,4194304] 0 2024-09-17T01:07:27.866 INFO:tasks.workunit.client.0.smithi103.stdout:9/806: unlink d7/d43/d88/d11/d20/d8e/lfa 0 2024-09-17T01:07:27.877 INFO:tasks.workunit.client.0.smithi103.stdout:5/583: dwrite d6/d28/dcb/d93/fa7 [0,4194304] 0 2024-09-17T01:07:27.884 INFO:tasks.workunit.client.0.smithi103.stdout:9/807: dwrite d7/d43/d88/f7b [0,4194304] 0 2024-09-17T01:07:27.900 INFO:tasks.workunit.client.0.smithi103.stdout:5/584: fsync d6/d11/f2f 0 2024-09-17T01:07:27.903 INFO:tasks.workunit.client.0.smithi103.stdout:9/808: rename d7/d43/d5f/d7d/d80/d93 to d7/d43/d88/d11/d5c/d8d/dac/dfe/d10b 0 2024-09-17T01:07:27.904 INFO:tasks.workunit.client.0.smithi103.stdout:9/809: dread - d7/d43/d5f/fb7 zero size 2024-09-17T01:07:27.905 INFO:tasks.workunit.client.0.smithi103.stdout:5/585: dread d6/d28/dcb/d93/fa7 [0,4194304] 0 2024-09-17T01:07:27.907 INFO:tasks.workunit.client.0.smithi103.stdout:5/586: mkdir d6/d2c/dd7 0 2024-09-17T01:07:27.910 INFO:tasks.workunit.client.0.smithi103.stdout:9/810: rename d7/d43/d88/d11/d5c/d5e/d6c/d6e/f96 to d7/d43/d88/d11/f10c 0 2024-09-17T01:07:27.912 INFO:tasks.workunit.client.0.smithi103.stdout:5/587: creat d6/db/dca/fd8 x:0 0 0 2024-09-17T01:07:27.915 INFO:tasks.workunit.client.0.smithi103.stdout:9/811: creat d7/d43/d5f/d7d/d80/f10d x:0 0 0 2024-09-17T01:07:27.920 INFO:tasks.workunit.client.0.smithi103.stdout:9/812: dread d7/d2d/fa5 [0,4194304] 0 2024-09-17T01:07:27.920 INFO:tasks.workunit.client.0.smithi103.stdout:5/588: rename d6/d2c/d38/l44 to d6/db/dca/ld9 0 2024-09-17T01:07:27.921 INFO:tasks.workunit.client.0.smithi103.stdout:9/813: stat d7/d2d/c51 0 2024-09-17T01:07:27.921 INFO:tasks.workunit.client.0.smithi103.stdout:5/589: chown d6/d2c/d38/d6f/da3/fb0 6941 1 2024-09-17T01:07:27.927 INFO:tasks.workunit.client.0.smithi103.stdout:5/590: mkdir d6/dda 0 2024-09-17T01:07:27.936 INFO:tasks.workunit.client.0.smithi103.stdout:5/591: dwrite d6/d2c/d38/f6c [0,4194304] 0 2024-09-17T01:07:27.946 INFO:tasks.workunit.client.0.smithi103.stdout:5/592: rename d6/d28/dcb/d93/fa7 to d6/d2c/d38/fdb 0 2024-09-17T01:07:27.950 INFO:tasks.workunit.client.0.smithi103.stdout:9/814: write d7/d43/d88/d11/d20/d8e/fd0 [453003,18413] 0 2024-09-17T01:07:27.951 INFO:tasks.workunit.client.0.smithi103.stdout:9/815: stat d7/cf 0 2024-09-17T01:07:27.952 INFO:tasks.workunit.client.0.smithi103.stdout:9/816: dread - d7/d43/d5f/fe3 zero size 2024-09-17T01:07:27.955 INFO:tasks.workunit.client.0.smithi103.stdout:9/817: creat d7/d43/d88/d11/d5c/d8d/f10e x:0 0 0 2024-09-17T01:07:27.962 INFO:tasks.workunit.client.0.smithi103.stdout:5/593: write d6/db/d66/f67 [1621917,18094] 0 2024-09-17T01:07:27.964 INFO:tasks.workunit.client.0.smithi103.stdout:5/594: readlink d6/db/dca/ld9 0 2024-09-17T01:07:27.969 INFO:tasks.workunit.client.0.smithi103.stdout:9/818: dwrite d7/d43/d88/d11/fba [0,4194304] 0 2024-09-17T01:07:27.970 INFO:tasks.workunit.client.0.smithi103.stdout:5/595: getdents d6/d2c/d38/d4c/d54 0 2024-09-17T01:07:27.972 INFO:tasks.workunit.client.0.smithi103.stdout:9/819: symlink d7/d43/d88/d11/d20/d4f/d95/d9a/dc0/l10f 0 2024-09-17T01:07:27.974 INFO:tasks.workunit.client.0.smithi103.stdout:5/596: mkdir d6/d2c/d38/d4c/d50/ddc 0 2024-09-17T01:07:27.977 INFO:tasks.workunit.client.0.smithi103.stdout:5/597: read d6/d28/f96 [2431397,29543] 0 2024-09-17T01:07:27.977 INFO:tasks.workunit.client.0.smithi103.stdout:9/820: fdatasync d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 0 2024-09-17T01:07:27.978 INFO:tasks.workunit.client.0.smithi103.stdout:5/598: dread d6/d2c/f73 [0,4194304] 0 2024-09-17T01:07:27.981 INFO:tasks.workunit.client.0.smithi103.stdout:9/821: creat d7/d43/d88/d11/d20/d4f/df7/f110 x:0 0 0 2024-09-17T01:07:27.983 INFO:tasks.workunit.client.0.smithi103.stdout:5/599: truncate d6/d11/f1d 2647392 0 2024-09-17T01:07:27.983 INFO:tasks.workunit.client.0.smithi103.stdout:9/822: dread - d7/d43/d88/d11/d20/d4f/d95/ffd zero size 2024-09-17T01:07:27.985 INFO:tasks.workunit.client.0.smithi103.stdout:9/823: read d7/d2d/fa5 [264403,126390] 0 2024-09-17T01:07:27.985 INFO:tasks.workunit.client.0.smithi103.stdout:5/600: fsync d6/d2c/d38/d4c/d71/fbf 0 2024-09-17T01:07:27.988 INFO:tasks.workunit.client.0.smithi103.stdout:5/601: creat d6/d28/dcb/fdd x:0 0 0 2024-09-17T01:07:27.990 INFO:tasks.workunit.client.0.smithi103.stdout:9/824: dread d7/d2d/d59/f66 [0,4194304] 0 2024-09-17T01:07:27.992 INFO:tasks.workunit.client.0.smithi103.stdout:5/602: truncate d6/d28/dcb/d93/f97 123758 0 2024-09-17T01:07:27.993 INFO:tasks.workunit.client.0.smithi103.stdout:5/603: fdatasync d6/d2c/d38/f6c 0 2024-09-17T01:07:27.995 INFO:tasks.workunit.client.0.smithi103.stdout:9/825: mkdir d7/d43/d88/d11/d20/d4f/d95/d111 0 2024-09-17T01:07:27.999 INFO:tasks.workunit.client.0.smithi103.stdout:5/604: rename d6/d2c/d38/d4c/d50/f8c to d6/d2c/d38/d4c/d50/fde 0 2024-09-17T01:07:28.002 INFO:tasks.workunit.client.0.smithi103.stdout:9/826: mkdir d7/d43/d112 0 2024-09-17T01:07:28.003 INFO:tasks.workunit.client.0.smithi103.stdout:5/605: truncate d6/d28/dcb/d93/f9d 1092309 0 2024-09-17T01:07:28.006 INFO:tasks.workunit.client.0.smithi103.stdout:9/827: symlink d7/d2d/d59/l113 0 2024-09-17T01:07:28.008 INFO:tasks.workunit.client.0.smithi103.stdout:5/606: dread - d6/d2c/d38/d6f/da3/fb0 zero size 2024-09-17T01:07:28.009 INFO:tasks.workunit.client.0.smithi103.stdout:9/828: truncate d7/d2d/f71 7187919 0 2024-09-17T01:07:28.009 INFO:tasks.workunit.client.0.smithi103.stdout:5/607: chown d6/d2c/d38/d4c/d54/l95 1045841464 1 2024-09-17T01:07:28.010 INFO:tasks.workunit.client.0.smithi103.stdout:9/829: dread - d7/d43/d88/d11/d20/d4f/d95/ffd zero size 2024-09-17T01:07:28.015 INFO:tasks.workunit.client.0.smithi103.stdout:5/608: getdents d6/d2c 0 2024-09-17T01:07:28.017 INFO:tasks.workunit.client.0.smithi103.stdout:5/609: symlink d6/d11/d81/ldf 0 2024-09-17T01:07:28.023 INFO:tasks.workunit.client.0.smithi103.stdout:9/830: write d7/d43/d79/f8b [1644,52672] 0 2024-09-17T01:07:28.026 INFO:tasks.workunit.client.0.smithi103.stdout:9/831: truncate d7/d43/d88/d11/d5c/ff6 332884 0 2024-09-17T01:07:28.034 INFO:tasks.workunit.client.0.smithi103.stdout:1/769: sync 2024-09-17T01:07:28.035 INFO:tasks.workunit.client.0.smithi103.stdout:9/832: link d7/d2d/f72 d7/d43/d88/f114 0 2024-09-17T01:07:28.036 INFO:tasks.workunit.client.0.smithi103.stdout:5/610: dread d6/d2c/f3d [0,4194304] 0 2024-09-17T01:07:28.037 INFO:tasks.workunit.client.0.smithi103.stdout:9/833: mknod d7/d2d/d59/d7a/c115 0 2024-09-17T01:07:28.040 INFO:tasks.workunit.client.0.smithi103.stdout:9/834: mknod d7/d43/d88/d11/d20/d4f/d95/d9a/dc0/c116 0 2024-09-17T01:07:28.044 INFO:tasks.workunit.client.0.smithi103.stdout:5/611: link d6/d11/l49 d6/d28/dcb/d93/le0 0 2024-09-17T01:07:28.047 INFO:tasks.workunit.client.0.smithi103.stdout:5/612: mkdir d6/d2c/d32/dd1/de1 0 2024-09-17T01:07:28.051 INFO:tasks.workunit.client.0.smithi103.stdout:5/613: dread - d6/db/f78 zero size 2024-09-17T01:07:28.051 INFO:tasks.workunit.client.0.smithi103.stdout:9/835: write d7/d2d/f72 [1935211,96816] 0 2024-09-17T01:07:28.054 INFO:tasks.workunit.client.0.smithi103.stdout:5/614: mkdir d6/d2c/d38/d6f/de2 0 2024-09-17T01:07:28.054 INFO:tasks.workunit.client.0.smithi103.stdout:9/836: fdatasync d7/d43/d88/f114 0 2024-09-17T01:07:28.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.064+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe05819b450 con 0x7fe0580fea50 2024-09-17T01:07:28.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.065+0000 7fe04effd640 1 -- 172.21.15.103:0/3313046323 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe05405a400 con 0x7fe0580fea50 2024-09-17T01:07:28.064 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:07:28.066 INFO:tasks.workunit.client.0.smithi103.stdout:5/615: dwrite d6/d11/f2b [0,4194304] 0 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.068+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fe04406d890 msgr2=0x7fe04406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.068+0000 7fe05ff64640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fe04406d890 0x7fe04406fd50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe048000c00 tx=0x7fe0480314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.068+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 msgr2=0x7fe0581956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.068+0000 7fe05ff64640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 0x7fe0581956b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe05400d900 tx=0x7fe05400ddc0 comp rx=0 tx=0).stop 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 shutdown_connections 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fe04406d890 0x7fe04406fd50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0580ffc50 0x7fe058195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 --2- 172.21.15.103:0/3313046323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0580fea50 0x7fe0581956b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 >> 172.21.15.103:0/3313046323 conn(0x7fe0580fa1c0 msgr2=0x7fe0580fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 shutdown_connections 2024-09-17T01:07:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:28.069+0000 7fe05ff64640 1 -- 172.21.15.103:0/3313046323 wait complete. 2024-09-17T01:07:28.069 INFO:tasks.workunit.client.0.smithi103.stdout:5/616: write d6/d2c/d38/d4c/d50/f4f [946013,31981] 0 2024-09-17T01:07:28.073 INFO:tasks.workunit.client.0.smithi103.stdout:5/617: symlink d6/d11/le3 0 2024-09-17T01:07:28.089 INFO:tasks.workunit.client.0.smithi103.stdout:5/618: dwrite d6/d2c/d38/d4c/d50/f72 [0,4194304] 0 2024-09-17T01:07:28.091 INFO:tasks.workunit.client.0.smithi103.stdout:5/619: fdatasync d6/d2c/d38/d4c/d50/f1c 0 2024-09-17T01:07:28.099 INFO:tasks.workunit.client.0.smithi103.stdout:5/620: mkdir d6/d28/dcb/dc4/de4 0 2024-09-17T01:07:28.100 INFO:tasks.workunit.client.0.smithi103.stdout:5/621: write d6/d2c/d32/f60 [4679362,48335] 0 2024-09-17T01:07:28.103 INFO:tasks.workunit.client.0.smithi103.stdout:5/622: mkdir d6/d2c/d38/d4c/de5 0 2024-09-17T01:07:28.104 INFO:tasks.workunit.client.0.smithi103.stdout:5/623: mknod d6/d2c/ce6 0 2024-09-17T01:07:28.107 INFO:tasks.workunit.client.0.smithi103.stdout:5/624: truncate d6/d11/f1d 230849 0 2024-09-17T01:07:28.109 INFO:tasks.workunit.client.0.smithi103.stdout:5/625: mknod d6/d28/d90/ce7 0 2024-09-17T01:07:28.110 INFO:tasks.workunit.client.0.smithi103.stdout:5/626: write d6/d2c/db3/fc3 [373900,115239] 0 2024-09-17T01:07:28.112 INFO:tasks.workunit.client.0.smithi103.stdout:5/627: rmdir d6/d28 39 2024-09-17T01:07:28.120 INFO:tasks.workunit.client.0.smithi103.stdout:5/628: rename d6/d11/f2b to d6/d28/dcb/d93/fe8 0 2024-09-17T01:07:28.128 INFO:tasks.workunit.client.0.smithi103.stdout:5/629: creat d6/db/fe9 x:0 0 0 2024-09-17T01:07:28.135 INFO:tasks.workunit.client.0.smithi103.stdout:5/630: dwrite d6/d2c/d32/d55/f5d [0,4194304] 0 2024-09-17T01:07:28.140 INFO:tasks.workunit.client.0.smithi103.stdout:5/631: dread d6/d11/f1d [0,4194304] 0 2024-09-17T01:07:28.156 INFO:tasks.workunit.client.0.smithi103.stdout:5/632: dwrite d6/d11/f2f [0,4194304] 0 2024-09-17T01:07:28.177 INFO:tasks.workunit.client.0.smithi103.stdout:5/633: dread d6/d2c/d32/f60 [0,4194304] 0 2024-09-17T01:07:28.181 INFO:tasks.workunit.client.0.smithi103.stdout:5/634: write d6/d2c/d38/d4c/d71/fbf [651659,97903] 0 2024-09-17T01:07:28.184 INFO:tasks.workunit.client.0.smithi103.stdout:5/635: symlink d6/d2c/d38/d6f/lea 0 2024-09-17T01:07:28.184 INFO:tasks.workunit.client.0.smithi103.stdout:5/636: write d6/db/fe9 [68703,84388] 0 2024-09-17T01:07:28.190 INFO:tasks.workunit.client.0.smithi103.stdout:5/637: dwrite d6/d2c/d38/d6f/f9c [0,4194304] 0 2024-09-17T01:07:28.191 INFO:tasks.workunit.client.0.smithi103.stdout:8/587: sync 2024-09-17T01:07:28.191 INFO:tasks.workunit.client.0.smithi103.stdout:4/776: sync 2024-09-17T01:07:28.191 INFO:tasks.workunit.client.0.smithi103.stdout:7/809: sync 2024-09-17T01:07:28.191 INFO:tasks.workunit.client.0.smithi103.stdout:6/816: sync 2024-09-17T01:07:28.191 INFO:tasks.workunit.client.0.smithi103.stdout:0/896: sync 2024-09-17T01:07:28.191 INFO:tasks.workunit.client.0.smithi103.stdout:2/892: sync 2024-09-17T01:07:28.193 INFO:tasks.workunit.client.0.smithi103.stdout:4/777: chown d9/d16/d44/fbf 5627909 1 2024-09-17T01:07:28.197 INFO:tasks.workunit.client.0.smithi103.stdout:5/638: dread d6/d2c/f37 [0,4194304] 0 2024-09-17T01:07:28.198 INFO:tasks.workunit.client.0.smithi103.stdout:7/810: unlink d4/d4a/d4b/d9d/fb6 0 2024-09-17T01:07:28.200 INFO:tasks.workunit.client.0.smithi103.stdout:0/897: truncate dd/df/f3d 3039990 0 2024-09-17T01:07:28.202 INFO:tasks.workunit.client.0.smithi103.stdout:2/893: mkdir d6/d5f/d12f 0 2024-09-17T01:07:28.203 INFO:tasks.workunit.client.0.smithi103.stdout:8/588: dwrite d0/d6/dc/d30/d25/d7d/faf [0,4194304] 0 2024-09-17T01:07:28.205 INFO:tasks.workunit.client.0.smithi103.stdout:8/589: dread - d0/d6/f89 zero size 2024-09-17T01:07:28.208 INFO:tasks.workunit.client.0.smithi103.stdout:7/811: creat d4/d10/d6b/dc5/d8d/f118 x:0 0 0 2024-09-17T01:07:28.209 INFO:tasks.workunit.client.0.smithi103.stdout:6/817: dread d3/d16/d33/f9f [0,4194304] 0 2024-09-17T01:07:28.211 INFO:tasks.workunit.client.0.smithi103.stdout:0/898: symlink dd/df/d68/d6c/d83/l12d 0 2024-09-17T01:07:28.212 INFO:tasks.workunit.client.0.smithi103.stdout:8/590: read - d0/d6/dc/d30/d86/f9b zero size 2024-09-17T01:07:28.212 INFO:tasks.workunit.client.0.smithi103.stdout:6/818: truncate d3/d16/d33/d3e/d58/d82/fc2 4237048 0 2024-09-17T01:07:28.214 INFO:tasks.workunit.client.0.smithi103.stdout:6/819: write d3/d16/df5/f116 [60229,103025] 0 2024-09-17T01:07:28.215 INFO:tasks.workunit.client.0.smithi103.stdout:5/639: getdents d6/db/d66/dbe 0 2024-09-17T01:07:28.219 INFO:tasks.workunit.client.0.smithi103.stdout:4/778: link d9/d16/d23/d52/l80 d9/d10/d6e/lf2 0 2024-09-17T01:07:28.220 INFO:tasks.workunit.client.0.smithi103.stdout:0/899: creat dd/df/d38/d62/d84/db2/f12e x:0 0 0 2024-09-17T01:07:28.222 INFO:tasks.workunit.client.0.smithi103.stdout:6/820: fsync d3/f9 0 2024-09-17T01:07:28.222 INFO:tasks.workunit.client.0.smithi103.stdout:8/591: truncate d0/d6/dc/d30/d25/d64/f5b 991510 0 2024-09-17T01:07:28.224 INFO:tasks.workunit.client.0.smithi103.stdout:5/640: creat d6/d2c/d38/d6f/da3/feb x:0 0 0 2024-09-17T01:07:28.227 INFO:tasks.workunit.client.0.smithi103.stdout:7/812: mknod d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/df2/c119 0 2024-09-17T01:07:28.230 INFO:tasks.workunit.client.0.smithi103.stdout:5/641: dwrite d6/d2c/db3/fc3 [0,4194304] 0 2024-09-17T01:07:28.232 INFO:tasks.workunit.client.0.smithi103.stdout:5/642: write d6/d2c/d38/d4c/f8f [3647184,4501] 0 2024-09-17T01:07:28.233 INFO:tasks.workunit.client.0.smithi103.stdout:5/643: dread - d6/d2c/d38/db2/fa8 zero size 2024-09-17T01:07:28.237 INFO:tasks.workunit.client.0.smithi103.stdout:0/900: chown dd/df/d68/d6c/fd8 913438 1 2024-09-17T01:07:28.238 INFO:tasks.workunit.client.0.smithi103.stdout:0/901: chown dd/d43/dfc/ffd 13 1 2024-09-17T01:07:28.239 INFO:tasks.workunit.client.0.smithi103.stdout:0/902: readlink dd/d4f/l2b 0 2024-09-17T01:07:28.253 INFO:tasks.workunit.client.0.smithi103.stdout:2/894: rename d6/d5f/d26/d66/df/d68/d7e/d9c/db4/cc8 to d6/d5f/d26/d66/df/c130 0 2024-09-17T01:07:28.264 INFO:tasks.workunit.client.0.smithi103.stdout:5/644: rename d6/db/fe9 to d6/d28/dcb/fec 0 2024-09-17T01:07:28.265 INFO:tasks.workunit.client.0.smithi103.stdout:7/813: mkdir d4/d10/d43/d11a 0 2024-09-17T01:07:28.266 INFO:tasks.workunit.client.0.smithi103.stdout:2/895: mkdir d6/da/d5d/d8d/d60/d75/d131 0 2024-09-17T01:07:28.266 INFO:tasks.workunit.client.0.smithi103.stdout:7/814: chown d4/d4a/d4b/d8a/dff/db8/d10a/f105 22 1 2024-09-17T01:07:28.273 INFO:tasks.workunit.client.0.smithi103.stdout:7/815: dwrite d4/d4a/d4b/d8a/dff/db8/fd6 [0,4194304] 0 2024-09-17T01:07:28.273 INFO:tasks.workunit.client.0.smithi103.stdout:0/903: rename dd/df/d38/lc1 to dd/df/d68/ddc/d93/l12f 0 2024-09-17T01:07:28.274 INFO:tasks.workunit.client.0.smithi103.stdout:8/592: dwrite d0/d6/f1c [0,4194304] 0 2024-09-17T01:07:28.277 INFO:tasks.workunit.client.0.smithi103.stdout:0/904: chown dd/df/f46 10469565 1 2024-09-17T01:07:28.278 INFO:tasks.workunit.client.0.smithi103.stdout:2/896: rmdir d6/d5f/d26 39 2024-09-17T01:07:28.278 INFO:tasks.workunit.client.0.smithi103.stdout:7/816: write d4/d10/d43/fea [936443,96154] 0 2024-09-17T01:07:28.282 INFO:tasks.workunit.client.0.smithi103.stdout:5/645: dwrite d6/f8b [0,4194304] 0 2024-09-17T01:07:28.284 INFO:tasks.workunit.client.0.smithi103.stdout:5/646: write d6/db/f5c [4630974,99282] 0 2024-09-17T01:07:28.288 INFO:tasks.workunit.client.0.smithi103.stdout:8/593: rmdir d0/d6/dc 39 2024-09-17T01:07:28.294 INFO:tasks.workunit.client.0.smithi103.stdout:5/647: creat d6/d2c/fed x:0 0 0 2024-09-17T01:07:28.295 INFO:tasks.workunit.client.0.smithi103.stdout:4/779: dwrite d9/d16/d23/d52/f7e [0,4194304] 0 2024-09-17T01:07:28.297 INFO:tasks.workunit.client.0.smithi103.stdout:4/780: chown d9/d10/f1f 102 1 2024-09-17T01:07:28.298 INFO:tasks.workunit.client.0.smithi103.stdout:4/781: readlink d9/d16/d38/d3f/l4d 0 2024-09-17T01:07:28.299 INFO:tasks.workunit.client.0.smithi103.stdout:8/594: creat d0/d6/dc/d30/d86/fb9 x:0 0 0 2024-09-17T01:07:28.300 INFO:tasks.workunit.client.0.smithi103.stdout:8/595: stat d0/d6/dc/l45 0 2024-09-17T01:07:28.302 INFO:tasks.workunit.client.0.smithi103.stdout:6/821: write d3/d16/d21/d56/d9a/fc5 [951337,115964] 0 2024-09-17T01:07:28.303 INFO:tasks.workunit.client.0.smithi103.stdout:8/596: write d0/d6/dc/fb4 [3412494,110858] 0 2024-09-17T01:07:28.305 INFO:tasks.workunit.client.0.smithi103.stdout:5/648: dread d6/d2c/d38/fdb [0,4194304] 0 2024-09-17T01:07:28.307 INFO:tasks.workunit.client.0.smithi103.stdout:5/649: read d6/d28/dcb/d93/fe8 [2501820,68405] 0 2024-09-17T01:07:28.311 INFO:tasks.workunit.client.0.smithi103.stdout:4/782: dwrite d9/d16/d23/d32/d61/f87 [0,4194304] 0 2024-09-17T01:07:28.313 INFO:tasks.workunit.client.0.smithi103.stdout:5/650: creat d6/d2c/d38/d6f/de2/fee x:0 0 0 2024-09-17T01:07:28.319 INFO:tasks.workunit.client.0.smithi103.stdout:5/651: chown d6/d2c/f52 247 1 2024-09-17T01:07:28.319 INFO:tasks.workunit.client.0.smithi103.stdout:8/597: dread d0/d6/dc/d30/d25/d64/f5b [0,4194304] 0 2024-09-17T01:07:28.326 INFO:tasks.workunit.client.0.smithi103.stdout:5/652: mkdir d6/d2c/dd7/def 0 2024-09-17T01:07:28.327 INFO:tasks.workunit.client.0.smithi103.stdout:5/653: chown d6/d2c/d38/db2/dba 25593 1 2024-09-17T01:07:28.333 INFO:tasks.workunit.client.0.smithi103.stdout:5/654: symlink d6/db/lf0 0 2024-09-17T01:07:28.336 INFO:tasks.workunit.client.0.smithi103.stdout:7/817: dread d4/f7 [0,4194304] 0 2024-09-17T01:07:28.342 INFO:tasks.workunit.client.0.smithi103.stdout:2/897: dwrite d6/d5f/d26/d66/df/f8a [0,4194304] 0 2024-09-17T01:07:28.343 INFO:tasks.workunit.client.0.smithi103.stdout:5/655: chown d6/c2d 54217322 1 2024-09-17T01:07:28.343 INFO:tasks.workunit.client.0.smithi103.stdout:5/656: chown d6/d28/d90 4330 1 2024-09-17T01:07:28.343 INFO:tasks.workunit.client.0.smithi103.stdout:2/898: chown d6/d5f/d26/d66/df/d68/d7e 1229 1 2024-09-17T01:07:28.344 INFO:tasks.workunit.client.0.smithi103.stdout:7/818: symlink d4/d10/d43/dc8/l11b 0 2024-09-17T01:07:28.344 INFO:tasks.workunit.client.0.smithi103.stdout:5/657: chown d6/d28/dcb/l8d 37200862 1 2024-09-17T01:07:28.353 INFO:tasks.workunit.client.0.smithi103.stdout:7/819: fsync d4/d10/d32/faf 0 2024-09-17T01:07:28.353 INFO:tasks.workunit.client.0.smithi103.stdout:5/658: dwrite d6/d11/fc1 [0,4194304] 0 2024-09-17T01:07:28.357 INFO:tasks.workunit.client.0.smithi103.stdout:2/899: mkdir d6/da/d132 0 2024-09-17T01:07:28.357 INFO:tasks.workunit.client.0.smithi103.stdout:2/900: fdatasync f4 0 2024-09-17T01:07:28.365 INFO:tasks.workunit.client.0.smithi103.stdout:6/822: dwrite d3/f18 [0,4194304] 0 2024-09-17T01:07:28.366 INFO:tasks.workunit.client.0.smithi103.stdout:8/598: write d0/d6/dc/d30/d25/d64/d34/f9f [1353690,127642] 0 2024-09-17T01:07:28.367 INFO:tasks.workunit.client.0.smithi103.stdout:6/823: chown d3/f11 1359608 1 2024-09-17T01:07:28.370 INFO:tasks.workunit.client.0.smithi103.stdout:6/824: chown d3/d16/d21/d50/l62 19190 1 2024-09-17T01:07:28.376 INFO:tasks.workunit.client.0.smithi103.stdout:4/783: dwrite d9/d16/d23/d52/d91/fba [0,4194304] 0 2024-09-17T01:07:28.378 INFO:tasks.workunit.client.0.smithi103.stdout:5/659: link d6/db/d66/f84 d6/d2c/d38/ff1 0 2024-09-17T01:07:28.380 INFO:tasks.workunit.client.0.smithi103.stdout:4/784: fdatasync d9/d16/d38/d3f/f7c 0 2024-09-17T01:07:28.382 INFO:tasks.workunit.client.0.smithi103.stdout:7/820: write d4/d10/f94 [492707,114354] 0 2024-09-17T01:07:28.383 INFO:tasks.workunit.client.0.smithi103.stdout:5/660: read d6/d2c/d38/d4c/f8f [3672528,22187] 0 2024-09-17T01:07:28.385 INFO:tasks.workunit.client.0.smithi103.stdout:8/599: rename d0/f6c to d0/d6/dc/d3d/d88/fba 0 2024-09-17T01:07:28.387 INFO:tasks.workunit.client.0.smithi103.stdout:6/825: mknod d3/dfe/dc1/d102/c117 0 2024-09-17T01:07:28.393 INFO:tasks.workunit.client.0.smithi103.stdout:4/785: creat d9/d10/d6e/ff3 x:0 0 0 2024-09-17T01:07:28.396 INFO:tasks.workunit.client.0.smithi103.stdout:6/826: dwrite d3/d16/d33/d57/d63/d60/db5/ff2 [0,4194304] 0 2024-09-17T01:07:28.401 INFO:tasks.workunit.client.0.smithi103.stdout:5/661: unlink d6/f6d 0 2024-09-17T01:07:28.402 INFO:tasks.workunit.client.0.smithi103.stdout:2/901: dread d6/d5f/d26/d66/df/d58/f90 [0,4194304] 0 2024-09-17T01:07:28.407 INFO:tasks.workunit.client.0.smithi103.stdout:4/786: creat d9/d16/d23/d32/d64/d85/ff4 x:0 0 0 2024-09-17T01:07:28.410 INFO:tasks.workunit.client.0.smithi103.stdout:6/827: unlink d3/d16/f1b 0 2024-09-17T01:07:28.411 INFO:tasks.workunit.client.0.smithi103.stdout:5/662: mkdir d6/d2c/d38/db2/df2 0 2024-09-17T01:07:28.415 INFO:tasks.workunit.client.0.smithi103.stdout:8/600: dwrite d0/d6/dc/d30/d25/f8d [0,4194304] 0 2024-09-17T01:07:28.417 INFO:tasks.workunit.client.0.smithi103.stdout:7/821: creat d4/d10/d6b/dc5/d8d/d92/db3/dd0/f11c x:0 0 0 2024-09-17T01:07:28.418 INFO:tasks.workunit.client.0.smithi103.stdout:7/822: readlink d4/d10/d37/ld9 0 2024-09-17T01:07:28.422 INFO:tasks.workunit.client.0.smithi103.stdout:4/787: dread d9/d16/d23/f97 [0,4194304] 0 2024-09-17T01:07:28.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:28 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3313046323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:28.428 INFO:tasks.workunit.client.0.smithi103.stdout:7/823: truncate d4/d10/d6b/dc5/d36/d3a/d51/d5e/f109 982192 0 2024-09-17T01:07:28.429 INFO:tasks.workunit.client.0.smithi103.stdout:5/663: write d6/d28/f39 [3808091,117140] 0 2024-09-17T01:07:28.431 INFO:tasks.workunit.client.0.smithi103.stdout:8/601: creat d0/d6/fbb x:0 0 0 2024-09-17T01:07:28.431 INFO:tasks.workunit.client.0.smithi103.stdout:6/828: write d3/d16/d33/d57/d63/d60/da4/fc7 [9799,10191] 0 2024-09-17T01:07:28.434 INFO:tasks.workunit.client.0.smithi103.stdout:4/788: write d9/d10/f1f [1487146,52987] 0 2024-09-17T01:07:28.436 INFO:tasks.workunit.client.0.smithi103.stdout:6/829: dread d3/f11 [0,4194304] 0 2024-09-17T01:07:28.438 INFO:tasks.workunit.client.0.smithi103.stdout:5/664: mkdir d6/d28/dcb/dc4/df3 0 2024-09-17T01:07:28.442 INFO:tasks.workunit.client.0.smithi103.stdout:7/824: mkdir d4/d10/d6b/dc5/d36/d3a/d11d 0 2024-09-17T01:07:28.443 INFO:tasks.workunit.client.0.smithi103.stdout:7/825: fsync d4/d4a/f78 0 2024-09-17T01:07:28.444 INFO:tasks.workunit.client.0.smithi103.stdout:8/602: write d0/d6/dc/d3d/d88/fa5 [1017823,118529] 0 2024-09-17T01:07:28.447 INFO:tasks.workunit.client.0.smithi103.stdout:5/665: mkdir d6/d28/df4 0 2024-09-17T01:07:28.449 INFO:tasks.workunit.client.0.smithi103.stdout:8/603: fdatasync d0/d6/f3b 0 2024-09-17T01:07:28.452 INFO:tasks.workunit.client.0.smithi103.stdout:7/826: write d4/d10/d37/d95/fdc [689236,93275] 0 2024-09-17T01:07:28.455 INFO:tasks.workunit.client.0.smithi103.stdout:6/830: write d3/d16/dad/f30 [462744,124897] 0 2024-09-17T01:07:28.456 INFO:tasks.workunit.client.0.smithi103.stdout:4/789: getdents d9/d16/d23/d32 0 2024-09-17T01:07:28.458 INFO:tasks.workunit.client.0.smithi103.stdout:8/604: mknod d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/cbc 0 2024-09-17T01:07:28.462 INFO:tasks.workunit.client.0.smithi103.stdout:5/666: dwrite d6/d2c/d38/d4c/d54/f77 [0,4194304] 0 2024-09-17T01:07:28.462 INFO:tasks.workunit.client.0.smithi103.stdout:4/790: fsync d9/d16/d23/d2a/f89 0 2024-09-17T01:07:28.468 INFO:tasks.workunit.client.0.smithi103.stdout:5/667: dread d6/d2c/d38/d4c/d71/fbf [0,4194304] 0 2024-09-17T01:07:28.469 INFO:tasks.workunit.client.0.smithi103.stdout:5/668: stat d6/d2c/d38/d4c/d54 0 2024-09-17T01:07:28.469 INFO:tasks.workunit.client.0.smithi103.stdout:7/827: truncate d4/d11/d34/f41 1109121 0 2024-09-17T01:07:28.471 INFO:tasks.workunit.client.0.smithi103.stdout:8/605: write d0/d6/dc/d30/f7a [1732169,129206] 0 2024-09-17T01:07:28.472 INFO:tasks.workunit.client.0.smithi103.stdout:6/831: write d3/d16/d33/d3e/d4b/fcc [690424,21727] 0 2024-09-17T01:07:28.473 INFO:tasks.workunit.client.0.smithi103.stdout:8/606: readlink d0/d6/dc/d30/d25/l6f 0 2024-09-17T01:07:28.476 INFO:tasks.workunit.client.0.smithi103.stdout:7/828: unlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/f64 0 2024-09-17T01:07:28.478 INFO:tasks.workunit.client.0.smithi103.stdout:6/832: fdatasync d3/d16/d33/f9f 0 2024-09-17T01:07:28.480 INFO:tasks.workunit.client.0.smithi103.stdout:6/833: chown d3/d16/d33/d3e/d4b/lfa 821 1 2024-09-17T01:07:28.480 INFO:tasks.workunit.client.0.smithi103.stdout:5/669: write d6/db/f78 [1023635,83876] 0 2024-09-17T01:07:28.480 INFO:tasks.workunit.client.0.smithi103.stdout:6/834: readlink d3/d25/ldd 0 2024-09-17T01:07:28.488 INFO:tasks.workunit.client.0.smithi103.stdout:4/791: link d9/d10/de5/cea d9/d16/d23/d52/d91/dd4/cf5 0 2024-09-17T01:07:28.488 INFO:tasks.workunit.client.0.smithi103.stdout:5/670: dread d6/d28/f6b [0,4194304] 0 2024-09-17T01:07:28.490 INFO:tasks.workunit.client.0.smithi103.stdout:5/671: truncate d6/d28/f96 4976530 0 2024-09-17T01:07:28.493 INFO:tasks.workunit.client.0.smithi103.stdout:7/829: dread d4/d10/d43/f57 [0,4194304] 0 2024-09-17T01:07:28.497 INFO:tasks.workunit.client.0.smithi103.stdout:5/672: mkdir d6/d2c/d32/dd1/de1/df5 0 2024-09-17T01:07:28.502 INFO:tasks.workunit.client.0.smithi103.stdout:4/792: dread d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:28.505 INFO:tasks.workunit.client.0.smithi103.stdout:8/607: dwrite d0/d6/dc/d3d/d6d/f76 [0,4194304] 0 2024-09-17T01:07:28.505 INFO:tasks.workunit.client.0.smithi103.stdout:5/673: creat d6/d2c/db3/ff6 x:0 0 0 2024-09-17T01:07:28.505 INFO:tasks.workunit.client.0.smithi103.stdout:4/793: write d9/d16/d23/d52/d91/dd4/f39 [592822,4555] 0 2024-09-17T01:07:28.507 INFO:tasks.workunit.client.0.smithi103.stdout:7/830: fsync d4/d4a/f79 0 2024-09-17T01:07:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:28 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3313046323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:28.508 INFO:tasks.workunit.client.0.smithi103.stdout:7/831: readlink d4/d4a/l90 0 2024-09-17T01:07:28.509 INFO:tasks.workunit.client.0.smithi103.stdout:5/674: chown d6/ca 4022472 1 2024-09-17T01:07:28.513 INFO:tasks.workunit.client.0.smithi103.stdout:4/794: dwrite d9/d16/d23/d32/fe6 [0,4194304] 0 2024-09-17T01:07:28.515 INFO:tasks.workunit.client.0.smithi103.stdout:7/832: creat d4/d4a/d4b/f11e x:0 0 0 2024-09-17T01:07:28.516 INFO:tasks.workunit.client.0.smithi103.stdout:7/833: stat d4/d10/d43/dc8/cc6 0 2024-09-17T01:07:28.519 INFO:tasks.workunit.client.0.smithi103.stdout:8/608: mknod d0/d6/dc/d3d/d6d/db8/cbd 0 2024-09-17T01:07:28.519 INFO:tasks.workunit.client.0.smithi103.stdout:8/609: chown d0/d6 0 1 2024-09-17T01:07:28.521 INFO:tasks.workunit.client.0.smithi103.stdout:4/795: mknod d9/cf6 0 2024-09-17T01:07:28.521 INFO:tasks.workunit.client.0.smithi103.stdout:8/610: stat d0/d6/dc/d30/d25/d64/d34/d6e 0 2024-09-17T01:07:28.522 INFO:tasks.workunit.client.0.smithi103.stdout:8/611: chown d0/d6/dc/d30/d25/c79 1904281597 1 2024-09-17T01:07:28.526 INFO:tasks.workunit.client.0.smithi103.stdout:7/834: unlink d4/d10/d6b/dc5/d8d/fbc 0 2024-09-17T01:07:28.526 INFO:tasks.workunit.client.0.smithi103.stdout:4/796: fsync d9/d16/d45/d5e/fa5 0 2024-09-17T01:07:28.580 INFO:tasks.workunit.client.0.smithi103.stdout:4/797: mkdir d9/d16/d23/d2a/df7 0 2024-09-17T01:07:28.580 INFO:tasks.workunit.client.0.smithi103.stdout:8/612: truncate d0/d6/dc/d30/d2d/f65 52341 0 2024-09-17T01:07:28.582 INFO:tasks.workunit.client.0.smithi103.stdout:4/798: symlink d9/d10/de5/lf8 0 2024-09-17T01:07:28.584 INFO:tasks.workunit.client.0.smithi103.stdout:4/799: dread - d9/d16/d23/d2a/fad zero size 2024-09-17T01:07:28.584 INFO:tasks.workunit.client.0.smithi103.stdout:7/835: write d4/d10/d6b/dc5/d36/d3a/d51/f88 [990389,85560] 0 2024-09-17T01:07:28.589 INFO:tasks.workunit.client.0.smithi103.stdout:8/613: dwrite d0/d6/fbb [0,4194304] 0 2024-09-17T01:07:28.589 INFO:tasks.workunit.client.0.smithi103.stdout:7/836: readlink d4/d10/d6b/dc5/d36/l42 0 2024-09-17T01:07:28.590 INFO:tasks.workunit.client.0.smithi103.stdout:8/614: fdatasync d0/f4c 0 2024-09-17T01:07:28.592 INFO:tasks.workunit.client.0.smithi103.stdout:4/800: creat d9/d16/d23/d52/ff9 x:0 0 0 2024-09-17T01:07:28.599 INFO:tasks.workunit.client.0.smithi103.stdout:7/837: mknod d4/d4a/d4b/d8a/dff/db8/d10a/d8c/dfc/c11f 0 2024-09-17T01:07:28.600 INFO:tasks.workunit.client.0.smithi103.stdout:4/801: dwrite d9/d16/d23/d32/d64/fdb [0,4194304] 0 2024-09-17T01:07:28.601 INFO:tasks.workunit.client.0.smithi103.stdout:7/838: dread - d4/d10/d66/f106 zero size 2024-09-17T01:07:28.601 INFO:tasks.workunit.client.0.smithi103.stdout:4/802: dread - d9/d10/fc2 zero size 2024-09-17T01:07:28.602 INFO:tasks.workunit.client.0.smithi103.stdout:7/839: read - d4/d10/d66/dd2/de7/f10b zero size 2024-09-17T01:07:28.611 INFO:tasks.workunit.client.0.smithi103.stdout:4/803: dwrite d9/d16/d23/d2a/f5c [0,4194304] 0 2024-09-17T01:07:28.612 INFO:tasks.workunit.client.0.smithi103.stdout:8/615: dread d0/d6/dc/d3d/fad [0,4194304] 0 2024-09-17T01:07:28.613 INFO:tasks.workunit.client.0.smithi103.stdout:7/840: rename d4/d10/d6b/dc5/d36/d3a/lc0 to d4/d4a/d4b/d8a/dff/l120 0 2024-09-17T01:07:28.616 INFO:tasks.workunit.client.0.smithi103.stdout:7/841: readlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/d7b/l104 0 2024-09-17T01:07:28.622 INFO:tasks.workunit.client.0.smithi103.stdout:8/616: mknod d0/d6/dc/d3d/d6d/db8/cbe 0 2024-09-17T01:07:28.622 INFO:tasks.workunit.client.0.smithi103.stdout:7/842: creat d4/d10/d6b/de3/f121 x:0 0 0 2024-09-17T01:07:28.622 INFO:tasks.workunit.client.0.smithi103.stdout:8/617: creat d0/d6/dc/d30/d25/d7d/d99/fbf x:0 0 0 2024-09-17T01:07:28.623 INFO:tasks.workunit.client.0.smithi103.stdout:4/804: link f3 d9/d16/d36/d42/d84/de9/ffa 0 2024-09-17T01:07:28.624 INFO:tasks.workunit.client.0.smithi103.stdout:8/618: chown d0/d6/dc/d3d/d6d/f8c 535618 1 2024-09-17T01:07:28.624 INFO:tasks.workunit.client.0.smithi103.stdout:4/805: rmdir d9/d16/d23/d52/d91 39 2024-09-17T01:07:28.626 INFO:tasks.workunit.client.0.smithi103.stdout:8/619: symlink d0/d6/dc/d30/d25/d7d/lc0 0 2024-09-17T01:07:28.637 INFO:tasks.workunit.client.0.smithi103.stdout:7/843: write d4/d10/d4e/f69 [688102,89692] 0 2024-09-17T01:07:28.642 INFO:tasks.workunit.client.0.smithi103.stdout:4/806: dwrite d9/d16/d23/d32/d4c/fd2 [0,4194304] 0 2024-09-17T01:07:28.643 INFO:tasks.workunit.client.0.smithi103.stdout:7/844: mknod d4/d10/d6b/dc5/d36/d3a/d51/d111/c122 0 2024-09-17T01:07:28.646 INFO:tasks.workunit.client.0.smithi103.stdout:4/807: creat d9/d10/de5/ffb x:0 0 0 2024-09-17T01:07:28.647 INFO:tasks.workunit.client.0.smithi103.stdout:7/845: creat d4/d10/d32/f123 x:0 0 0 2024-09-17T01:07:28.649 INFO:tasks.workunit.client.0.smithi103.stdout:7/846: creat d4/d11/f124 x:0 0 0 2024-09-17T01:07:28.650 INFO:tasks.workunit.client.0.smithi103.stdout:7/847: write d4/d10/d37/fcb [2169652,33303] 0 2024-09-17T01:07:28.652 INFO:tasks.workunit.client.0.smithi103.stdout:7/848: creat d4/d10/d6b/d9f/f125 x:0 0 0 2024-09-17T01:07:28.654 INFO:tasks.workunit.client.0.smithi103.stdout:4/808: rmdir d9/d16/d23/d2a/df7 0 2024-09-17T01:07:28.654 INFO:tasks.workunit.client.0.smithi103.stdout:7/849: rmdir d4/d4a/d4b/d9d 39 2024-09-17T01:07:28.655 INFO:tasks.workunit.client.0.smithi103.stdout:7/850: chown d4/d4a/f78 25099292 1 2024-09-17T01:07:28.657 INFO:tasks.workunit.client.0.smithi103.stdout:4/809: creat d9/d16/d70/dc0/ffc x:0 0 0 2024-09-17T01:07:28.658 INFO:tasks.workunit.client.0.smithi103.stdout:4/810: write d9/d16/d45/d76/fe0 [197996,111360] 0 2024-09-17T01:07:28.661 INFO:tasks.workunit.client.0.smithi103.stdout:4/811: truncate d9/d16/d44/fc8 343674 0 2024-09-17T01:07:28.667 INFO:tasks.workunit.client.0.smithi103.stdout:7/851: dread d4/d11/f18 [0,4194304] 0 2024-09-17T01:07:28.668 INFO:tasks.workunit.client.0.smithi103.stdout:4/812: dwrite d9/d16/d45/d76/fe0 [0,4194304] 0 2024-09-17T01:07:28.671 INFO:tasks.workunit.client.0.smithi103.stdout:7/852: creat d4/f126 x:0 0 0 2024-09-17T01:07:28.672 INFO:tasks.workunit.client.0.smithi103.stdout:7/853: chown d4/d4a/d4b/ffa 12501069 1 2024-09-17T01:07:28.672 INFO:tasks.workunit.client.0.smithi103.stdout:4/813: mknod d9/d16/d23/d52/d91/dd4/d55/cfd 0 2024-09-17T01:07:28.673 INFO:tasks.workunit.client.0.smithi103.stdout:7/854: mkdir d4/d11/d3f/d63/d127 0 2024-09-17T01:07:28.675 INFO:tasks.workunit.client.0.smithi103.stdout:4/814: rmdir d9/d16/d45/d5e 39 2024-09-17T01:07:28.676 INFO:tasks.workunit.client.0.smithi103.stdout:4/815: chown d9/d16/d36/d42/led 31820358 1 2024-09-17T01:07:28.677 INFO:tasks.workunit.client.0.smithi103.stdout:7/855: mknod d4/d10/d66/dd2/de7/c128 0 2024-09-17T01:07:28.679 INFO:tasks.workunit.client.0.smithi103.stdout:4/816: symlink d9/d10/d6e/lfe 0 2024-09-17T01:07:28.679 INFO:tasks.workunit.client.0.smithi103.stdout:7/856: fsync d4/d10/d66/fd1 0 2024-09-17T01:07:28.690 INFO:tasks.workunit.client.0.smithi103.stdout:4/817: truncate d9/d10/f62 668943 0 2024-09-17T01:07:28.690 INFO:tasks.workunit.client.0.smithi103.stdout:4/818: dread - d9/d10/d6e/ff3 zero size 2024-09-17T01:07:28.692 INFO:tasks.workunit.client.0.smithi103.stdout:4/819: mknod d9/d16/d45/d76/cff 0 2024-09-17T01:07:28.694 INFO:tasks.workunit.client.0.smithi103.stdout:7/857: truncate d4/d4a/d4b/d8a/dff/db8/fd6 3587741 0 2024-09-17T01:07:28.694 INFO:tasks.workunit.client.0.smithi103.stdout:4/820: unlink d9/f3d 0 2024-09-17T01:07:28.803 INFO:tasks.workunit.client.0.smithi103.stdout:7/858: fsync d4/d11/d34/f49 0 2024-09-17T01:07:28.804 INFO:tasks.workunit.client.0.smithi103.stdout:4/821: creat d9/d16/d23/d32/d61/f100 x:0 0 0 2024-09-17T01:07:28.805 INFO:tasks.workunit.client.0.smithi103.stdout:4/822: write d9/dc/df/fc5 [5077843,36359] 0 2024-09-17T01:07:28.806 INFO:tasks.workunit.client.0.smithi103.stdout:1/770: sync 2024-09-17T01:07:28.807 INFO:tasks.workunit.client.0.smithi103.stdout:4/823: chown d9/d16/d36/d42/d84/c8c 9483420 1 2024-09-17T01:07:28.811 INFO:tasks.workunit.client.0.smithi103.stdout:7/859: creat d4/d10/d43/d11a/f129 x:0 0 0 2024-09-17T01:07:28.817 INFO:tasks.workunit.client.0.smithi103.stdout:4/824: rename d9/d16/d23/d32/d4c/f92 to d9/d16/d23/d90/dec/f101 0 2024-09-17T01:07:28.825 INFO:tasks.workunit.client.0.smithi103.stdout:4/825: rename d9/d16/d38/f99 to d9/dc/df/f102 0 2024-09-17T01:07:28.826 INFO:tasks.workunit.client.0.smithi103.stdout:7/860: symlink d4/d10/d37/l12a 0 2024-09-17T01:07:28.833 INFO:tasks.workunit.client.0.smithi103.stdout:1/771: write d2/d7/d73/d81/fa6 [2219471,126389] 0 2024-09-17T01:07:28.834 INFO:tasks.workunit.client.0.smithi103.stdout:4/826: dwrite d9/d16/d45/d5e/f71 [0,4194304] 0 2024-09-17T01:07:28.837 INFO:tasks.workunit.client.0.smithi103.stdout:4/827: rename d9/d16/d45 to d9/d16/d45/d103 22 2024-09-17T01:07:28.841 INFO:tasks.workunit.client.0.smithi103.stdout:4/828: truncate d9/d16/d44/f4f 2700395 0 2024-09-17T01:07:28.852 INFO:tasks.workunit.client.0.smithi103.stdout:4/829: write d9/d16/d23/d52/fa0 [1348156,112613] 0 2024-09-17T01:07:28.853 INFO:tasks.workunit.client.0.smithi103.stdout:7/861: dwrite d4/d10/d6b/dc5/d36/d82/f8f [0,4194304] 0 2024-09-17T01:07:28.855 INFO:tasks.workunit.client.0.smithi103.stdout:7/862: truncate d4/d4a/d4b/f11e 888385 0 2024-09-17T01:07:28.857 INFO:tasks.workunit.client.0.smithi103.stdout:4/830: symlink d9/d16/d70/l104 0 2024-09-17T01:07:28.858 INFO:tasks.workunit.client.0.smithi103.stdout:1/772: dread d2/d1c/d28/d4b/d74/fae [0,4194304] 0 2024-09-17T01:07:28.859 INFO:tasks.workunit.client.0.smithi103.stdout:1/773: readlink d2/d7/d73/l90 0 2024-09-17T01:07:28.860 INFO:tasks.workunit.client.0.smithi103.stdout:7/863: mkdir d4/d10/d43/dc8/d12b 0 2024-09-17T01:07:28.869 INFO:tasks.workunit.client.0.smithi103.stdout:7/864: truncate d4/d4a/d4b/d9d/fe6 98851 0 2024-09-17T01:07:28.870 INFO:tasks.workunit.client.0.smithi103.stdout:4/831: getdents d9/dc/df 0 2024-09-17T01:07:28.878 INFO:tasks.workunit.client.0.smithi103.stdout:1/774: getdents d2/d7 0 2024-09-17T01:07:28.881 INFO:tasks.workunit.client.0.smithi103.stdout:4/832: dread d9/d16/d23/d32/f98 [0,4194304] 0 2024-09-17T01:07:28.920 INFO:tasks.workunit.client.0.smithi103.stdout:7/865: link d4/d10/d6b/dc5/d36/d3a/d51/fca d4/d11/d34/db5/f12c 0 2024-09-17T01:07:28.921 INFO:tasks.workunit.client.0.smithi103.stdout:1/775: rmdir d2/d1c 39 2024-09-17T01:07:28.922 INFO:tasks.workunit.client.0.smithi103.stdout:4/833: rmdir d9/d16/d23/d52 39 2024-09-17T01:07:28.925 INFO:tasks.workunit.client.0.smithi103.stdout:7/866: unlink d4/d10/d6b/dc5/d36/d3a/d51/c76 0 2024-09-17T01:07:28.931 INFO:tasks.workunit.client.0.smithi103.stdout:7/867: dwrite d4/d10/d6b/d9f/fda [0,4194304] 0 2024-09-17T01:07:28.934 INFO:tasks.workunit.client.0.smithi103.stdout:1/776: symlink d2/d1c/d28/l103 0 2024-09-17T01:07:28.936 INFO:tasks.workunit.client.0.smithi103.stdout:1/777: chown d2/d7/d73/cd3 0 1 2024-09-17T01:07:28.937 INFO:tasks.workunit.client.0.smithi103.stdout:7/868: read d4/d11/d3f/d63/fa8 [921689,85634] 0 2024-09-17T01:07:28.938 INFO:tasks.workunit.client.0.smithi103.stdout:1/778: dread - d2/de/f58 zero size 2024-09-17T01:07:28.940 INFO:tasks.workunit.client.0.smithi103.stdout:7/869: mknod d4/d11/d34/c12d 0 2024-09-17T01:07:28.943 INFO:tasks.workunit.client.0.smithi103.stdout:7/870: truncate d4/d10/f56 4229923 0 2024-09-17T01:07:28.944 INFO:tasks.workunit.client.0.smithi103.stdout:7/871: write d4/d10/d43/f71 [290368,79058] 0 2024-09-17T01:07:28.961 INFO:tasks.workunit.client.0.smithi103.stdout:4/834: truncate d9/d16/d44/f68 2351560 0 2024-09-17T01:07:28.967 INFO:tasks.workunit.client.0.smithi103.stdout:7/872: write d4/d10/d66/fd1 [971345,117097] 0 2024-09-17T01:07:28.971 INFO:tasks.workunit.client.0.smithi103.stdout:1/779: dwrite d2/de/d1f/f72 [0,4194304] 0 2024-09-17T01:07:28.972 INFO:tasks.workunit.client.0.smithi103.stdout:1/780: readlink d2/d1c/lce 0 2024-09-17T01:07:28.973 INFO:tasks.workunit.client.0.smithi103.stdout:7/873: write d4/d10/d6b/dc5/d36/d3a/f4c [7367752,51953] 0 2024-09-17T01:07:28.975 INFO:tasks.workunit.client.0.smithi103.stdout:1/781: dread - d2/d1c/d28/fe8 zero size 2024-09-17T01:07:28.977 INFO:tasks.workunit.client.0.smithi103.stdout:1/782: readlink d2/d1c/d28/d4b/d67/d9e/ld6 0 2024-09-17T01:07:28.978 INFO:tasks.workunit.client.0.smithi103.stdout:4/835: dread d9/dc/f18 [0,4194304] 0 2024-09-17T01:07:28.980 INFO:tasks.workunit.client.0.smithi103.stdout:7/874: symlink d4/d10/l12e 0 2024-09-17T01:07:28.981 INFO:tasks.workunit.client.0.smithi103.stdout:1/783: fsync d2/de/d1f/fc0 0 2024-09-17T01:07:28.984 INFO:tasks.workunit.client.0.smithi103.stdout:1/784: read d2/d1c/d20/d33/f91 [44339,44944] 0 2024-09-17T01:07:28.985 INFO:tasks.workunit.client.0.smithi103.stdout:4/836: mknod d9/d16/d23/d52/c105 0 2024-09-17T01:07:28.985 INFO:tasks.workunit.client.0.smithi103.stdout:7/875: creat d4/d10/d43/f12f x:0 0 0 2024-09-17T01:07:28.986 INFO:tasks.workunit.client.0.smithi103.stdout:4/837: stat d9/d16/d23/d52/fce 0 2024-09-17T01:07:28.986 INFO:tasks.workunit.client.0.smithi103.stdout:7/876: chown d4/d10/d66/f106 15042 1 2024-09-17T01:07:28.986 INFO:tasks.workunit.client.0.smithi103.stdout:4/838: fdatasync d9/d10/d6e/fe4 0 2024-09-17T01:07:28.989 INFO:tasks.workunit.client.0.smithi103.stdout:1/785: creat d2/d7/d4e/f104 x:0 0 0 2024-09-17T01:07:28.992 INFO:tasks.workunit.client.0.smithi103.stdout:4/839: unlink d9/d16/d23/d52/l80 0 2024-09-17T01:07:28.993 INFO:tasks.workunit.client.0.smithi103.stdout:7/877: creat d4/d10/d43/dc8/d12b/f130 x:0 0 0 2024-09-17T01:07:28.994 INFO:tasks.workunit.client.0.smithi103.stdout:7/878: read d4/d11/f19 [2042791,18502] 0 2024-09-17T01:07:28.996 INFO:tasks.workunit.client.0.smithi103.stdout:1/786: link d2/lf2 d2/d7/d73/l105 0 2024-09-17T01:07:28.998 INFO:tasks.workunit.client.0.smithi103.stdout:7/879: symlink d4/d10/d37/l131 0 2024-09-17T01:07:28.999 INFO:tasks.workunit.client.0.smithi103.stdout:4/840: creat d9/d16/d23/d32/d4c/f106 x:0 0 0 2024-09-17T01:07:29.004 INFO:tasks.workunit.client.0.smithi103.stdout:4/841: dwrite d9/d16/d70/dc0/ffc [0,4194304] 0 2024-09-17T01:07:29.007 INFO:tasks.workunit.client.0.smithi103.stdout:7/880: getdents d4/d10/d6b/dc5/d36/d3a/d51 0 2024-09-17T01:07:29.022 INFO:tasks.workunit.client.0.smithi103.stdout:1/787: write d2/d1c/d28/d52/d69/f6c [1270498,39996] 0 2024-09-17T01:07:29.023 INFO:tasks.workunit.client.0.smithi103.stdout:1/788: chown d2/d70/dac/dd2 3709068 1 2024-09-17T01:07:29.026 INFO:tasks.workunit.client.0.smithi103.stdout:1/789: rmdir d2/d1c 39 2024-09-17T01:07:29.026 INFO:tasks.workunit.client.0.smithi103.stdout:7/881: write d4/d10/d6b/dc5/d36/d82/fb9 [184241,90979] 0 2024-09-17T01:07:29.029 INFO:tasks.workunit.client.0.smithi103.stdout:4/842: dwrite d9/d16/d23/d2a/f89 [0,4194304] 0 2024-09-17T01:07:29.033 INFO:tasks.workunit.client.0.smithi103.stdout:1/790: mknod d2/d16/d51/c106 0 2024-09-17T01:07:29.036 INFO:tasks.workunit.client.0.smithi103.stdout:1/791: symlink d2/d1c/d28/d4b/l107 0 2024-09-17T01:07:29.036 INFO:tasks.workunit.client.0.smithi103.stdout:1/792: stat d2/d16/dbf/ldd 0 2024-09-17T01:07:29.038 INFO:tasks.workunit.client.0.smithi103.stdout:7/882: rename d4/d4a/d4b/d8a/dff/db8/d10a/db1/cce to d4/d10/d6b/dc5/d8d/d92/db3/c132 0 2024-09-17T01:07:29.039 INFO:tasks.workunit.client.0.smithi103.stdout:1/793: symlink d2/d16/d51/d65/da7/l108 0 2024-09-17T01:07:29.040 INFO:tasks.workunit.client.0.smithi103.stdout:7/883: creat d4/d10/d6b/dc5/d36/d82/f133 x:0 0 0 2024-09-17T01:07:29.045 INFO:tasks.workunit.client.0.smithi103.stdout:4/843: write d9/d16/d44/fc8 [1215725,94683] 0 2024-09-17T01:07:29.051 INFO:tasks.workunit.client.0.smithi103.stdout:4/844: link d9/d16/d36/d42/f7b d9/d16/d36/d42/f107 0 2024-09-17T01:07:29.056 INFO:tasks.workunit.client.0.smithi103.stdout:1/794: dwrite d2/d1c/d20/d33/f91 [0,4194304] 0 2024-09-17T01:07:29.058 INFO:tasks.workunit.client.0.smithi103.stdout:4/845: dread d9/dc/df/f25 [0,4194304] 0 2024-09-17T01:07:29.060 INFO:tasks.workunit.client.0.smithi103.stdout:1/795: unlink d2/d1c/d20/c50 0 2024-09-17T01:07:29.061 INFO:tasks.workunit.client.0.smithi103.stdout:7/884: dread d4/d11/d34/db5/fb0 [0,4194304] 0 2024-09-17T01:07:29.062 INFO:tasks.workunit.client.0.smithi103.stdout:7/885: readlink d4/d10/d37/l131 0 2024-09-17T01:07:29.064 INFO:tasks.workunit.client.0.smithi103.stdout:1/796: readlink d2/d1c/d20/d6d/dcd/ld0 0 2024-09-17T01:07:29.066 INFO:tasks.workunit.client.0.smithi103.stdout:4/846: dwrite d9/fde [0,4194304] 0 2024-09-17T01:07:29.074 INFO:tasks.workunit.client.0.smithi103.stdout:1/797: read d2/d16/fb0 [568896,115349] 0 2024-09-17T01:07:29.081 INFO:tasks.workunit.client.0.smithi103.stdout:1/798: dwrite d2/d1c/d20/d33/f91 [0,4194304] 0 2024-09-17T01:07:29.087 INFO:tasks.workunit.client.0.smithi103.stdout:1/799: mkdir d2/d1c/d109 0 2024-09-17T01:07:29.089 INFO:tasks.workunit.client.0.smithi103.stdout:7/886: dread d4/d10/d6b/dc5/d36/d3a/d51/d5e/f60 [0,4194304] 0 2024-09-17T01:07:29.092 INFO:tasks.workunit.client.0.smithi103.stdout:1/800: rename d2/d1c/d20/d33/f62 to d2/d16/d51/d65/da7/f10a 0 2024-09-17T01:07:29.092 INFO:tasks.workunit.client.0.smithi103.stdout:7/887: creat d4/d10/d66/dd2/de7/f134 x:0 0 0 2024-09-17T01:07:29.094 INFO:tasks.workunit.client.0.smithi103.stdout:1/801: fdatasync d2/d1c/d28/fe8 0 2024-09-17T01:07:29.095 INFO:tasks.workunit.client.0.smithi103.stdout:7/888: creat d4/d11/d34/db5/f135 x:0 0 0 2024-09-17T01:07:29.096 INFO:tasks.workunit.client.0.smithi103.stdout:4/847: dread d9/d16/d38/d3f/f7c [0,4194304] 0 2024-09-17T01:07:29.097 INFO:tasks.workunit.client.0.smithi103.stdout:9/837: sync 2024-09-17T01:07:29.097 INFO:tasks.workunit.client.0.smithi103.stdout:1/802: truncate d2/d7/d73/db8/fee 213609 0 2024-09-17T01:07:29.099 INFO:tasks.workunit.client.0.smithi103.stdout:9/838: fsync d7/d43/d88/d11/f1f 0 2024-09-17T01:07:29.099 INFO:tasks.workunit.client.0.smithi103.stdout:1/803: write d2/d7/d73/dfd/f101 [883658,94227] 0 2024-09-17T01:07:29.101 INFO:tasks.workunit.client.0.smithi103.stdout:9/839: truncate d7/d43/d88/d11/d20/d4f/d95/ff9 928956 0 2024-09-17T01:07:29.102 INFO:tasks.workunit.client.0.smithi103.stdout:4/848: rename d9/d16/d70/lc4 to d9/d16/d36/l108 0 2024-09-17T01:07:29.103 INFO:tasks.workunit.client.0.smithi103.stdout:7/889: getdents d4/d10/d4e 0 2024-09-17T01:07:29.107 INFO:tasks.workunit.client.0.smithi103.stdout:1/804: mknod d2/d16/d51/c10b 0 2024-09-17T01:07:29.111 INFO:tasks.workunit.client.0.smithi103.stdout:1/805: creat d2/d16/dbf/df8/f10c x:0 0 0 2024-09-17T01:07:29.112 INFO:tasks.workunit.client.0.smithi103.stdout:4/849: rename d9/d10/d6e to d9/d16/d23/d52/d109 0 2024-09-17T01:07:29.114 INFO:tasks.workunit.client.0.smithi103.stdout:7/890: getdents d4/d10/d6b/dc5/d36/d3a 0 2024-09-17T01:07:29.115 INFO:tasks.workunit.client.0.smithi103.stdout:1/806: creat d2/d1c/d28/d52/d69/dbd/f10d x:0 0 0 2024-09-17T01:07:29.117 INFO:tasks.workunit.client.0.smithi103.stdout:4/850: dread d9/d16/d70/dc0/ffc [0,4194304] 0 2024-09-17T01:07:29.117 INFO:tasks.workunit.client.0.smithi103.stdout:7/891: mknod d4/d11/d3f/c136 0 2024-09-17T01:07:29.118 INFO:tasks.workunit.client.0.smithi103.stdout:7/892: write d4/d4a/f78 [4548393,88607] 0 2024-09-17T01:07:29.125 INFO:tasks.workunit.client.0.smithi103.stdout:7/893: dwrite d4/d10/d37/fcb [0,4194304] 0 2024-09-17T01:07:29.125 INFO:tasks.workunit.client.0.smithi103.stdout:9/840: rename d7/d43/d88/f7b to d7/d43/d5f/f117 0 2024-09-17T01:07:29.131 INFO:tasks.workunit.client.0.smithi103.stdout:7/894: dread d4/d10/d43/fea [0,4194304] 0 2024-09-17T01:07:29.140 INFO:tasks.workunit.client.0.smithi103.stdout:7/895: rename d4/d11/d34/c12d to d4/d11/c137 0 2024-09-17T01:07:29.142 INFO:tasks.workunit.client.0.smithi103.stdout:1/807: getdents d2 0 2024-09-17T01:07:29.144 INFO:tasks.workunit.client.0.smithi103.stdout:7/896: creat d4/d10/d6b/f138 x:0 0 0 2024-09-17T01:07:29.144 INFO:tasks.workunit.client.0.smithi103.stdout:1/808: chown d2/d7/d73/d81/fa6 4 1 2024-09-17T01:07:29.147 INFO:tasks.workunit.client.0.smithi103.stdout:1/809: creat d2/d1c/d28/d4b/d74/f10e x:0 0 0 2024-09-17T01:07:29.150 INFO:tasks.workunit.client.0.smithi103.stdout:4/851: write f3 [3227275,100796] 0 2024-09-17T01:07:29.154 INFO:tasks.workunit.client.0.smithi103.stdout:4/852: symlink d9/d16/d23/d90/l10a 0 2024-09-17T01:07:29.155 INFO:tasks.workunit.client.0.smithi103.stdout:6/835: sync 2024-09-17T01:07:29.155 INFO:tasks.workunit.client.0.smithi103.stdout:2/902: sync 2024-09-17T01:07:29.155 INFO:tasks.workunit.client.0.smithi103.stdout:5/675: sync 2024-09-17T01:07:29.155 INFO:tasks.workunit.client.0.smithi103.stdout:8/620: sync 2024-09-17T01:07:29.156 INFO:tasks.workunit.client.0.smithi103.stdout:0/905: sync 2024-09-17T01:07:29.158 INFO:tasks.workunit.client.0.smithi103.stdout:9/841: dread d7/d43/d88/d11/d5c/fd5 [0,4194304] 0 2024-09-17T01:07:29.159 INFO:tasks.workunit.client.0.smithi103.stdout:7/897: write d4/f7 [3835595,47651] 0 2024-09-17T01:07:29.162 INFO:tasks.workunit.client.0.smithi103.stdout:1/810: getdents d2/d1c/d20/d33 0 2024-09-17T01:07:29.164 INFO:tasks.workunit.client.0.smithi103.stdout:6/836: read - d3/d16/d33/d3e/fdb zero size 2024-09-17T01:07:29.166 INFO:tasks.workunit.client.0.smithi103.stdout:8/621: creat d0/d6/dc/d3d/d88/fc1 x:0 0 0 2024-09-17T01:07:29.166 INFO:tasks.workunit.client.0.smithi103.stdout:9/842: creat d7/db4/ddc/f118 x:0 0 0 2024-09-17T01:07:29.168 INFO:tasks.workunit.client.0.smithi103.stdout:0/906: symlink dd/d4f/l130 0 2024-09-17T01:07:29.171 INFO:tasks.workunit.client.0.smithi103.stdout:4/853: dread d9/d16/d70/dc0/ffc [0,4194304] 0 2024-09-17T01:07:29.173 INFO:tasks.workunit.client.0.smithi103.stdout:5/676: dwrite d6/db/f5c [4194304,4194304] 0 2024-09-17T01:07:29.173 INFO:tasks.workunit.client.0.smithi103.stdout:6/837: dread d3/d25/fca [0,4194304] 0 2024-09-17T01:07:29.174 INFO:tasks.workunit.client.0.smithi103.stdout:1/811: getdents d2/d7/d4e 0 2024-09-17T01:07:29.175 INFO:tasks.workunit.client.0.smithi103.stdout:2/903: dwrite d6/d5f/d26/f2c [0,4194304] 0 2024-09-17T01:07:29.179 INFO:tasks.workunit.client.0.smithi103.stdout:8/622: chown d0/d6/dc/d30/d25/d64/l37 20956 1 2024-09-17T01:07:29.184 INFO:tasks.workunit.client.0.smithi103.stdout:9/843: symlink d7/d43/d88/d11/d5c/d8d/dac/dc2/df5/l119 0 2024-09-17T01:07:29.188 INFO:tasks.workunit.client.0.smithi103.stdout:8/623: dread d0/d80/f9c [0,4194304] 0 2024-09-17T01:07:29.189 INFO:tasks.workunit.client.0.smithi103.stdout:1/812: dread - d2/de/fdc zero size 2024-09-17T01:07:29.191 INFO:tasks.workunit.client.0.smithi103.stdout:4/854: mkdir d9/d16/d23/d52/d109/d10b 0 2024-09-17T01:07:29.193 INFO:tasks.workunit.client.0.smithi103.stdout:5/677: write d6/d2c/f3d [2625149,22122] 0 2024-09-17T01:07:29.195 INFO:tasks.workunit.client.0.smithi103.stdout:6/838: dread d3/d16/d21/fe9 [0,4194304] 0 2024-09-17T01:07:29.196 INFO:tasks.workunit.client.0.smithi103.stdout:0/907: dwrite dd/d1c/d9f/da3/ff3 [0,4194304] 0 2024-09-17T01:07:29.197 INFO:tasks.workunit.client.0.smithi103.stdout:8/624: fsync d0/d6/dc/d30/f1f 0 2024-09-17T01:07:29.199 INFO:tasks.workunit.client.0.smithi103.stdout:9/844: mknod d7/d43/d88/d11/d20/d4f/d95/d111/c11a 0 2024-09-17T01:07:29.205 INFO:tasks.workunit.client.0.smithi103.stdout:4/855: dread d9/d16/d23/d32/d4c/fd2 [0,4194304] 0 2024-09-17T01:07:29.205 INFO:tasks.workunit.client.0.smithi103.stdout:1/813: dread d2/d16/d51/d65/da7/f10a [0,4194304] 0 2024-09-17T01:07:29.206 INFO:tasks.workunit.client.0.smithi103.stdout:2/904: write d6/d5f/d26/d66/df/d68/d7e/d9c/dbb/fd3 [1283316,79477] 0 2024-09-17T01:07:29.209 INFO:tasks.workunit.client.0.smithi103.stdout:5/678: rename d6/d2c/d38/d4c/d54/l95 to d6/d2c/d38/db2/dba/lf7 0 2024-09-17T01:07:29.211 INFO:tasks.workunit.client.0.smithi103.stdout:5/679: dread - d6/d2c/d38/d6f/da3/fb0 zero size 2024-09-17T01:07:29.212 INFO:tasks.workunit.client.0.smithi103.stdout:2/905: read d6/d5f/f5e [566628,119247] 0 2024-09-17T01:07:29.214 INFO:tasks.workunit.client.0.smithi103.stdout:0/908: mkdir dd/d43/d131 0 2024-09-17T01:07:29.266 INFO:tasks.workunit.client.0.smithi103.stdout:4/856: dread d9/fb9 [0,4194304] 0 2024-09-17T01:07:29.266 INFO:tasks.workunit.client.0.smithi103.stdout:0/909: chown dd/df/f24 1536 1 2024-09-17T01:07:29.266 INFO:tasks.workunit.client.0.smithi103.stdout:5/680: dread d6/d28/dcb/fec [0,4194304] 0 2024-09-17T01:07:29.266 INFO:tasks.workunit.client.0.smithi103.stdout:8/625: write d0/d6/dc/d30/d25/d64/d34/d6e/f7c [138985,101950] 0 2024-09-17T01:07:29.266 INFO:tasks.workunit.client.0.smithi103.stdout:5/681: chown d6/d2c/d32/d55/f5e 9 1 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:1/814: unlink d2/d1c/d28/f29 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:6/839: rename d3/dfe to d3/d16/d33/d57/d63/d60/db5/d118 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:6/840: write d3/d16/d33/d57/fcb [169480,59572] 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:4/857: creat d9/d16/d23/d2a/f10c x:0 0 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:8/626: mknod d0/d6/dc/d30/d25/d64/cc2 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/682: dread d6/d2c/d38/d4c/d71/fbf [0,4194304] 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:8/627: truncate d0/d6/dc/d3d/d88/fa5 1966589 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/683: truncate d6/db/f4e 5062407 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/684: dwrite d6/db/f78 [0,4194304] 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:1/815: dwrite d2/d1c/d28/d52/d69/fa9 [0,4194304] 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:1/816: write d2/d1c/d28/d52/d69/dbd/f10d [272368,13519] 0 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/685: rmdir d6/d2c/d38/db2 39 2024-09-17T01:07:29.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/686: fsync d6/db/f5c 0 2024-09-17T01:07:29.268 INFO:tasks.workunit.client.0.smithi103.stdout:9/845: getdents d7/d43/d88/d11/d5c/d8d 0 2024-09-17T01:07:29.268 INFO:tasks.workunit.client.0.smithi103.stdout:6/841: write d3/d16/d33/d57/d63/d60/fd4 [728364,120134] 0 2024-09-17T01:07:29.268 INFO:tasks.workunit.client.0.smithi103.stdout:1/817: truncate d2/d1c/d28/ffa 257351 0 2024-09-17T01:07:29.268 INFO:tasks.workunit.client.0.smithi103.stdout:2/906: creat d6/d5f/f133 x:0 0 0 2024-09-17T01:07:29.268 INFO:tasks.workunit.client.0.smithi103.stdout:6/842: readlink d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4/le2 0 2024-09-17T01:07:29.268 INFO:tasks.workunit.client.0.smithi103.stdout:9/846: mkdir d7/d43/d88/d11/d5c/d11b 0 2024-09-17T01:07:29.269 INFO:tasks.workunit.client.0.smithi103.stdout:5/687: rename d6/d28/dcb/dc4/de4 to d6/d11/d81/df8 0 2024-09-17T01:07:29.272 INFO:tasks.workunit.client.0.smithi103.stdout:0/910: getdents dd/df/d38/d62 0 2024-09-17T01:07:29.273 INFO:tasks.workunit.client.0.smithi103.stdout:6/843: mknod d3/d16/d33/d57/d63/d60/c119 0 2024-09-17T01:07:29.275 INFO:tasks.workunit.client.0.smithi103.stdout:4/858: dwrite d9/d16/d23/d2a/fad [0,4194304] 0 2024-09-17T01:07:29.279 INFO:tasks.workunit.client.0.smithi103.stdout:8/628: dwrite d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:29.280 INFO:tasks.workunit.client.0.smithi103.stdout:2/907: dwrite d6/da/d5d/d8d/d89/de8/f129 [0,4194304] 0 2024-09-17T01:07:29.283 INFO:tasks.workunit.client.0.smithi103.stdout:9/847: mknod d7/d2d/d59/d7a/c11c 0 2024-09-17T01:07:29.283 INFO:tasks.workunit.client.0.smithi103.stdout:4/859: symlink d9/d10/l10d 0 2024-09-17T01:07:29.284 INFO:tasks.workunit.client.0.smithi103.stdout:8/629: chown d0/d6/dc/d3d/c8a 2034563943 1 2024-09-17T01:07:29.286 INFO:tasks.workunit.client.0.smithi103.stdout:0/911: creat dd/d1c/d109/d10f/f132 x:0 0 0 2024-09-17T01:07:29.288 INFO:tasks.workunit.client.0.smithi103.stdout:5/688: dwrite d6/d2c/db3/ff6 [0,4194304] 0 2024-09-17T01:07:29.291 INFO:tasks.workunit.client.0.smithi103.stdout:6/844: creat d3/d25/d26/d10b/f11a x:0 0 0 2024-09-17T01:07:29.293 INFO:tasks.workunit.client.0.smithi103.stdout:0/912: chown dd/df/d68/c91 1 1 2024-09-17T01:07:29.299 INFO:tasks.workunit.client.0.smithi103.stdout:9/848: symlink d7/d43/d88/d11/d20/d4f/d95/d9a/de5/l11d 0 2024-09-17T01:07:29.300 INFO:tasks.workunit.client.0.smithi103.stdout:0/913: truncate dd/d4f/f32 4948606 0 2024-09-17T01:07:29.410 INFO:tasks.workunit.client.0.smithi103.stdout:4/860: link d9/d16/d23/d32/d61/d47/f73 d9/d16/d44/f10e 0 2024-09-17T01:07:29.411 INFO:tasks.workunit.client.0.smithi103.stdout:0/914: symlink dd/d4f/d64/l133 0 2024-09-17T01:07:29.411 INFO:tasks.workunit.client.0.smithi103.stdout:1/818: truncate d2/d7/f1d 6687369 0 2024-09-17T01:07:29.412 INFO:tasks.workunit.client.0.smithi103.stdout:9/849: dwrite d7/db4/ddc/f104 [0,4194304] 0 2024-09-17T01:07:29.429 INFO:tasks.workunit.client.0.smithi103.stdout:4/861: creat d9/d16/d23/d2a/f10f x:0 0 0 2024-09-17T01:07:29.430 INFO:tasks.workunit.client.0.smithi103.stdout:1/819: symlink d2/d7/d73/d81/l10f 0 2024-09-17T01:07:29.433 INFO:tasks.workunit.client.0.smithi103.stdout:0/915: mknod dd/df/d38/c134 0 2024-09-17T01:07:29.434 INFO:tasks.workunit.client.0.smithi103.stdout:9/850: creat d7/d43/d88/d11/d5c/d11b/f11e x:0 0 0 2024-09-17T01:07:29.436 INFO:tasks.workunit.client.0.smithi103.stdout:2/908: dwrite d6/d5f/d26/d66/df/fee [0,4194304] 0 2024-09-17T01:07:29.436 INFO:tasks.workunit.client.0.smithi103.stdout:8/630: dwrite d0/d6/dc/d30/d25/d64/f5b [0,4194304] 0 2024-09-17T01:07:29.440 INFO:tasks.workunit.client.0.smithi103.stdout:1/820: mknod d2/d1c/db9/c110 0 2024-09-17T01:07:29.440 INFO:tasks.workunit.client.0.smithi103.stdout:0/916: mkdir dd/df/d38/d62/d135 0 2024-09-17T01:07:29.441 INFO:tasks.workunit.client.0.smithi103.stdout:1/821: chown d2/d1c/d28/d4b/f66 2605922 1 2024-09-17T01:07:29.445 INFO:tasks.workunit.client.0.smithi103.stdout:5/689: dread d6/d2c/d38/f6c [0,4194304] 0 2024-09-17T01:07:29.451 INFO:tasks.workunit.client.0.smithi103.stdout:2/909: symlink d6/l134 0 2024-09-17T01:07:29.452 INFO:tasks.workunit.client.0.smithi103.stdout:1/822: dread d2/d1c/d28/d52/d69/f6c [0,4194304] 0 2024-09-17T01:07:29.454 INFO:tasks.workunit.client.0.smithi103.stdout:2/910: truncate d6/d5f/d26/d66/df/ffc 1029572 0 2024-09-17T01:07:29.463 INFO:tasks.workunit.client.0.smithi103.stdout:4/862: truncate d9/d16/d23/d52/d91/fba 133363 0 2024-09-17T01:07:29.466 INFO:tasks.workunit.client.0.smithi103.stdout:8/631: dwrite d0/d6/dc/d30/d25/d64/f46 [0,4194304] 0 2024-09-17T01:07:29.467 INFO:tasks.workunit.client.0.smithi103.stdout:9/851: write d7/d43/d88/d11/d20/d4f/f75 [405688,70382] 0 2024-09-17T01:07:29.467 INFO:tasks.workunit.client.0.smithi103.stdout:4/863: chown d9/d16/d23/l43 4 1 2024-09-17T01:07:29.467 INFO:tasks.workunit.client.0.smithi103.stdout:1/823: link d2/d1c/f1e d2/d16/d51/d65/da7/f111 0 2024-09-17T01:07:29.471 INFO:tasks.workunit.client.0.smithi103.stdout:4/864: dread - d9/d16/fdf zero size 2024-09-17T01:07:29.471 INFO:tasks.workunit.client.0.smithi103.stdout:0/917: dwrite dd/d1c/d9f/da3/fde [0,4194304] 0 2024-09-17T01:07:29.472 INFO:tasks.workunit.client.0.smithi103.stdout:9/852: chown d7/d43/d88/d11/d20/d4f/d95/d111 10 1 2024-09-17T01:07:29.472 INFO:tasks.workunit.client.0.smithi103.stdout:8/632: chown d0/d6/dc/d30/d2d/c8b 3 1 2024-09-17T01:07:29.476 INFO:tasks.workunit.client.0.smithi103.stdout:4/865: write d9/d16/d23/d2a/f10f [299474,27746] 0 2024-09-17T01:07:29.478 INFO:tasks.workunit.client.0.smithi103.stdout:5/690: getdents d6/d2c/d38/d4c/d50 0 2024-09-17T01:07:29.478 INFO:tasks.workunit.client.0.smithi103.stdout:1/824: rmdir d2/d1c/d20/d6d 39 2024-09-17T01:07:29.481 INFO:tasks.workunit.client.0.smithi103.stdout:9/853: write d7/d43/d88/f5a [1694903,120020] 0 2024-09-17T01:07:29.484 INFO:tasks.workunit.client.0.smithi103.stdout:2/911: dwrite d6/d5f/fac [0,4194304] 0 2024-09-17T01:07:29.486 INFO:tasks.workunit.client.0.smithi103.stdout:8/633: symlink d0/d6/dc/d30/d25/d64/d34/d6e/d72/da6/lc3 0 2024-09-17T01:07:29.488 INFO:tasks.workunit.client.0.smithi103.stdout:9/854: mknod d7/d43/d88/d11/d5c/d8d/c11f 0 2024-09-17T01:07:29.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/825: symlink d2/d1c/d20/d6d/d8d/l112 0 2024-09-17T01:07:29.489 INFO:tasks.workunit.client.0.smithi103.stdout:9/855: truncate d7/ff1 52407 0 2024-09-17T01:07:29.492 INFO:tasks.workunit.client.0.smithi103.stdout:4/866: symlink d9/d16/d23/d52/d109/l110 0 2024-09-17T01:07:29.493 INFO:tasks.workunit.client.0.smithi103.stdout:8/634: chown d0/d6/dc/d30/c48 55139 1 2024-09-17T01:07:29.495 INFO:tasks.workunit.client.0.smithi103.stdout:8/635: write d0/f4c [1708011,8045] 0 2024-09-17T01:07:29.495 INFO:tasks.workunit.client.0.smithi103.stdout:5/691: creat d6/d2c/d38/d4c/d71/db4/ff9 x:0 0 0 2024-09-17T01:07:29.495 INFO:tasks.workunit.client.0.smithi103.stdout:4/867: truncate d9/d16/d70/dc0/fe8 1047231 0 2024-09-17T01:07:29.496 INFO:tasks.workunit.client.0.smithi103.stdout:1/826: mknod d2/d16/dbf/df8/c113 0 2024-09-17T01:07:29.498 INFO:tasks.workunit.client.0.smithi103.stdout:1/827: chown d2/d16/f2a 14 1 2024-09-17T01:07:29.498 INFO:tasks.workunit.client.0.smithi103.stdout:4/868: write d9/d16/d23/d2a/f89 [4335867,26217] 0 2024-09-17T01:07:29.500 INFO:tasks.workunit.client.0.smithi103.stdout:9/856: creat d7/d43/d88/d11/d5c/d8d/dac/f120 x:0 0 0 2024-09-17T01:07:29.505 INFO:tasks.workunit.client.0.smithi103.stdout:2/912: write d6/d5f/d26/d6e/f116 [853804,79245] 0 2024-09-17T01:07:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:29 smithi143 ceph-mon[35452]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:29 smithi143 ceph-mon[35452]: pgmap v25: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 40 MiB/s rd, 101 MiB/s wr, 282 op/s 2024-09-17T01:07:29.511 INFO:tasks.workunit.client.0.smithi103.stdout:0/918: dread dd/df/d38/d62/f10c [0,4194304] 0 2024-09-17T01:07:29.513 INFO:tasks.workunit.client.0.smithi103.stdout:2/913: creat d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4/f135 x:0 0 0 2024-09-17T01:07:29.514 INFO:tasks.workunit.client.0.smithi103.stdout:5/692: write d6/d2c/d38/f83 [406346,109083] 0 2024-09-17T01:07:29.517 INFO:tasks.workunit.client.0.smithi103.stdout:1/828: rename d2/d7/f37 to d2/d1c/d28/d52/d69/f114 0 2024-09-17T01:07:29.518 INFO:tasks.workunit.client.0.smithi103.stdout:8/636: dwrite d0/d6/dc/d30/d25/d64/f75 [0,4194304] 0 2024-09-17T01:07:29.519 INFO:tasks.workunit.client.0.smithi103.stdout:9/857: write d7/d43/d88/d11/d5c/d8d/dac/dc2/fda [182135,27503] 0 2024-09-17T01:07:29.522 INFO:tasks.workunit.client.0.smithi103.stdout:2/914: creat d6/da/d5d/d8d/d60/d75/d70/f136 x:0 0 0 2024-09-17T01:07:29.523 INFO:tasks.workunit.client.0.smithi103.stdout:4/869: rename d9/dc/f8e to d9/d16/d36/d42/d84/f111 0 2024-09-17T01:07:29.524 INFO:tasks.workunit.client.0.smithi103.stdout:1/829: creat d2/d1c/d20/d6d/f115 x:0 0 0 2024-09-17T01:07:29.525 INFO:tasks.workunit.client.0.smithi103.stdout:0/919: mknod dd/df/d38/d62/db0/c136 0 2024-09-17T01:07:29.525 INFO:tasks.workunit.client.0.smithi103.stdout:9/858: dread d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 [0,4194304] 0 2024-09-17T01:07:29.526 INFO:tasks.workunit.client.0.smithi103.stdout:5/693: mknod d6/d28/df4/cfa 0 2024-09-17T01:07:29.528 INFO:tasks.workunit.client.0.smithi103.stdout:8/637: creat d0/d6/dc/d30/d86/fc4 x:0 0 0 2024-09-17T01:07:29.529 INFO:tasks.workunit.client.0.smithi103.stdout:8/638: write d0/d6/f1c [5339337,68655] 0 2024-09-17T01:07:29.532 INFO:tasks.workunit.client.0.smithi103.stdout:8/639: write d0/d6/dc/d30/d86/fc4 [69728,25848] 0 2024-09-17T01:07:29.533 INFO:tasks.workunit.client.0.smithi103.stdout:1/830: rename d2/d1c/d20/d6d/dcd to d2/de/d116 0 2024-09-17T01:07:29.533 INFO:tasks.workunit.client.0.smithi103.stdout:8/640: fsync d0/d6/dc/fb4 0 2024-09-17T01:07:29.534 INFO:tasks.workunit.client.0.smithi103.stdout:9/859: unlink d7/d43/d88/d11/d20/c29 0 2024-09-17T01:07:29.538 INFO:tasks.workunit.client.0.smithi103.stdout:0/920: fsync dd/d43/fa5 0 2024-09-17T01:07:29.540 INFO:tasks.workunit.client.0.smithi103.stdout:1/831: rmdir d2/d1c/d28/d4b/d67 39 2024-09-17T01:07:29.542 INFO:tasks.workunit.client.0.smithi103.stdout:9/860: truncate d7/db8/dbb/fa4 307500 0 2024-09-17T01:07:29.545 INFO:tasks.workunit.client.0.smithi103.stdout:5/694: dread d6/d28/f39 [0,4194304] 0 2024-09-17T01:07:29.546 INFO:tasks.workunit.client.0.smithi103.stdout:5/695: write d6/d2c/d38/f83 [490780,109785] 0 2024-09-17T01:07:29.548 INFO:tasks.workunit.client.0.smithi103.stdout:2/915: write d6/da/d5d/d8d/f71 [690141,78276] 0 2024-09-17T01:07:29.549 INFO:tasks.workunit.client.0.smithi103.stdout:1/832: mknod d2/d1c/d20/d6d/c117 0 2024-09-17T01:07:29.554 INFO:tasks.workunit.client.0.smithi103.stdout:5/696: dwrite d6/d11/f2f [4194304,4194304] 0 2024-09-17T01:07:29.554 INFO:tasks.workunit.client.0.smithi103.stdout:4/870: getdents d9/d16/d23/d32/d64/d85 0 2024-09-17T01:07:29.555 INFO:tasks.workunit.client.0.smithi103.stdout:9/861: read d7/d43/f52 [1956260,107111] 0 2024-09-17T01:07:29.560 INFO:tasks.workunit.client.0.smithi103.stdout:0/921: write dd/df/d68/d6c/d83/de4/faa [2792746,111461] 0 2024-09-17T01:07:29.561 INFO:tasks.workunit.client.0.smithi103.stdout:9/862: dread d7/db4/ddc/f104 [0,4194304] 0 2024-09-17T01:07:29.561 INFO:tasks.workunit.client.0.smithi103.stdout:0/922: chown dd/d1c/d9f/da3 3 1 2024-09-17T01:07:29.562 INFO:tasks.workunit.client.0.smithi103.stdout:9/863: readlink d7/la3 0 2024-09-17T01:07:29.563 INFO:tasks.workunit.client.0.smithi103.stdout:1/833: creat d2/d1c/d20/d6d/f118 x:0 0 0 2024-09-17T01:07:29.564 INFO:tasks.workunit.client.0.smithi103.stdout:4/871: readlink d9/d16/d23/d90/laa 0 2024-09-17T01:07:29.566 INFO:tasks.workunit.client.0.smithi103.stdout:5/697: creat d6/d28/dcb/d93/ffb x:0 0 0 2024-09-17T01:07:29.569 INFO:tasks.workunit.client.0.smithi103.stdout:2/916: creat d6/da/d28/dfe/f137 x:0 0 0 2024-09-17T01:07:29.571 INFO:tasks.workunit.client.0.smithi103.stdout:9/864: symlink d7/d43/d88/d11/d5c/d8d/dac/dfe/l121 0 2024-09-17T01:07:29.572 INFO:tasks.workunit.client.0.smithi103.stdout:9/865: fsync d7/f87 0 2024-09-17T01:07:29.572 INFO:tasks.workunit.client.0.smithi103.stdout:1/834: creat d2/d16/d51/d65/da7/f119 x:0 0 0 2024-09-17T01:07:29.574 INFO:tasks.workunit.client.0.smithi103.stdout:4/872: mkdir d9/d16/d23/d32/d64/d112 0 2024-09-17T01:07:29.577 INFO:tasks.workunit.client.0.smithi103.stdout:0/923: fdatasync dd/df/f39 0 2024-09-17T01:07:29.578 INFO:tasks.workunit.client.0.smithi103.stdout:2/917: rename d6/da/d5d/le5 to d6/da/d3f/d120/l138 0 2024-09-17T01:07:29.580 INFO:tasks.workunit.client.0.smithi103.stdout:1/835: dread - d2/de/d1f/fcc zero size 2024-09-17T01:07:29.584 INFO:tasks.workunit.client.0.smithi103.stdout:5/698: dread d6/d2c/d38/d4c/d50/fde [0,4194304] 0 2024-09-17T01:07:29.586 INFO:tasks.workunit.client.0.smithi103.stdout:2/918: creat d6/d5f/d26/d66/df/d68/f139 x:0 0 0 2024-09-17T01:07:29.591 INFO:tasks.workunit.client.0.smithi103.stdout:9/866: truncate d7/db4/ddc/f104 5211718 0 2024-09-17T01:07:29.593 INFO:tasks.workunit.client.0.smithi103.stdout:9/867: chown d7/d43/d5f/ld1 6873506 1 2024-09-17T01:07:29.593 INFO:tasks.workunit.client.0.smithi103.stdout:2/919: mkdir d6/da/d5d/d8d/d60/d75/d70/df6/d13a 0 2024-09-17T01:07:29.594 INFO:tasks.workunit.client.0.smithi103.stdout:0/924: dwrite dd/f95 [0,4194304] 0 2024-09-17T01:07:29.595 INFO:tasks.workunit.client.0.smithi103.stdout:5/699: fsync d6/fc9 0 2024-09-17T01:07:29.597 INFO:tasks.workunit.client.0.smithi103.stdout:4/873: getdents d9/d16/d36 0 2024-09-17T01:07:29.600 INFO:tasks.workunit.client.0.smithi103.stdout:2/920: creat d6/da/d5d/f13b x:0 0 0 2024-09-17T01:07:29.601 INFO:tasks.workunit.client.0.smithi103.stdout:1/836: dwrite d2/d1c/d20/d33/f3c [0,4194304] 0 2024-09-17T01:07:29.602 INFO:tasks.workunit.client.0.smithi103.stdout:9/868: symlink d7/d43/d88/l122 0 2024-09-17T01:07:29.605 INFO:tasks.workunit.client.0.smithi103.stdout:0/925: truncate dd/df/f90 991580 0 2024-09-17T01:07:29.605 INFO:tasks.workunit.client.0.smithi103.stdout:4/874: mknod d9/d16/d23/d32/c113 0 2024-09-17T01:07:29.606 INFO:tasks.workunit.client.0.smithi103.stdout:9/869: chown d7/d43/d88/d11/d5c/d8d/dac/f120 46221821 1 2024-09-17T01:07:29.606 INFO:tasks.workunit.client.0.smithi103.stdout:2/921: symlink d6/da/d5d/d8d/d89/de8/l13c 0 2024-09-17T01:07:29.608 INFO:tasks.workunit.client.0.smithi103.stdout:1/837: creat d2/de/da0/f11a x:0 0 0 2024-09-17T01:07:29.610 INFO:tasks.workunit.client.0.smithi103.stdout:9/870: mknod d7/d2d/d59/c123 0 2024-09-17T01:07:29.611 INFO:tasks.workunit.client.0.smithi103.stdout:0/926: dread dd/d43/f8f [0,4194304] 0 2024-09-17T01:07:29.612 INFO:tasks.workunit.client.0.smithi103.stdout:2/922: mknod d6/da/d5d/c13d 0 2024-09-17T01:07:29.614 INFO:tasks.workunit.client.0.smithi103.stdout:9/871: chown d7/d43/d88/d11/d5c/d8d/dac/f120 58 1 2024-09-17T01:07:29.615 INFO:tasks.workunit.client.0.smithi103.stdout:4/875: truncate d9/d16/d23/d2a/f9b 727581 0 2024-09-17T01:07:29.617 INFO:tasks.workunit.client.0.smithi103.stdout:4/876: chown d9/d16/d23/d2a/f93 3848 1 2024-09-17T01:07:29.619 INFO:tasks.workunit.client.0.smithi103.stdout:2/923: chown d6/d5f/d26/d66/df/d68/d7e/l106 1044718 1 2024-09-17T01:07:29.620 INFO:tasks.workunit.client.0.smithi103.stdout:9/872: symlink d7/d2d/d107/l124 0 2024-09-17T01:07:29.621 INFO:tasks.workunit.client.0.smithi103.stdout:0/927: dread dd/df/d38/da8/f6f [0,4194304] 0 2024-09-17T01:07:29.622 INFO:tasks.workunit.client.0.smithi103.stdout:4/877: mkdir d9/d114 0 2024-09-17T01:07:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:2/924: mkdir d6/d5f/d12f/d13e 0 2024-09-17T01:07:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:9/873: fdatasync d7/d43/d88/d11/d5c/fd5 0 2024-09-17T01:07:29.626 INFO:tasks.workunit.client.0.smithi103.stdout:0/928: rename dd/d1c/c103 to dd/df/d68/db5/d11d/c137 0 2024-09-17T01:07:29.627 INFO:tasks.workunit.client.0.smithi103.stdout:2/925: readlink d6/da/d28/ld4 0 2024-09-17T01:07:29.627 INFO:tasks.workunit.client.0.smithi103.stdout:5/700: dread d6/d2c/d32/d55/f6a [0,4194304] 0 2024-09-17T01:07:29.631 INFO:tasks.workunit.client.0.smithi103.stdout:9/874: unlink d7/d43/d88/d11/d5c/d8d/c11f 0 2024-09-17T01:07:29.632 INFO:tasks.workunit.client.0.smithi103.stdout:9/875: stat d7/d43/d88/d11/d5c/c9f 0 2024-09-17T01:07:29.633 INFO:tasks.workunit.client.0.smithi103.stdout:0/929: rename dd/d1c/d9f/dd6/de8 to dd/d138 0 2024-09-17T01:07:29.635 INFO:tasks.workunit.client.0.smithi103.stdout:2/926: readlink d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/l118 0 2024-09-17T01:07:29.637 INFO:tasks.workunit.client.0.smithi103.stdout:1/838: write d2/d7/d4e/fb4 [2788545,35441] 0 2024-09-17T01:07:29.637 INFO:tasks.workunit.client.0.smithi103.stdout:1/839: chown d2/d1c/lba 0 1 2024-09-17T01:07:29.638 INFO:tasks.workunit.client.0.smithi103.stdout:0/930: rmdir dd/d1c/d109/d10f 39 2024-09-17T01:07:29.639 INFO:tasks.workunit.client.0.smithi103.stdout:0/931: chown dd/df/d38/da8/lff 102921607 1 2024-09-17T01:07:29.644 INFO:tasks.workunit.client.0.smithi103.stdout:4/878: write d9/d16/d45/d76/fc1 [379984,12442] 0 2024-09-17T01:07:29.645 INFO:tasks.workunit.client.0.smithi103.stdout:4/879: chown d9/d16/d23/d52/d91/dd4/c94 9475841 1 2024-09-17T01:07:29.647 INFO:tasks.workunit.client.0.smithi103.stdout:5/701: link d6/d11/f1d d6/db/dca/ffc 0 2024-09-17T01:07:29.648 INFO:tasks.workunit.client.0.smithi103.stdout:0/932: truncate dd/df/d68/d6c/d8e/fdb 416580 0 2024-09-17T01:07:29.649 INFO:tasks.workunit.client.0.smithi103.stdout:2/927: mkdir d6/d5f/d26/d66/df/d13f 0 2024-09-17T01:07:29.650 INFO:tasks.workunit.client.0.smithi103.stdout:4/880: creat d9/d16/d23/d52/d91/f115 x:0 0 0 2024-09-17T01:07:29.652 INFO:tasks.workunit.client.0.smithi103.stdout:0/933: rmdir dd/df/d38/d55/dcc 39 2024-09-17T01:07:29.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:29 smithi103 ceph-mon[28156]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:29.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:29 smithi103 ceph-mon[28156]: pgmap v25: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 40 MiB/s rd, 101 MiB/s wr, 282 op/s 2024-09-17T01:07:29.703 INFO:tasks.workunit.client.0.smithi103.stdout:9/876: getdents d7/d43/d88/d11/d5c/d5e/d6c/d6e/d77 0 2024-09-17T01:07:29.703 INFO:tasks.workunit.client.0.smithi103.stdout:4/881: creat d9/d16/d70/f116 x:0 0 0 2024-09-17T01:07:29.704 INFO:tasks.workunit.client.0.smithi103.stdout:5/702: write d6/d11/f86 [54883,59289] 0 2024-09-17T01:07:29.704 INFO:tasks.workunit.client.0.smithi103.stdout:2/928: unlink d6/d5f/dad/c127 0 2024-09-17T01:07:29.707 INFO:tasks.workunit.client.0.smithi103.stdout:9/877: write d7/d43/d88/d11/d5c/fd5 [2936080,42549] 0 2024-09-17T01:07:29.708 INFO:tasks.workunit.client.0.smithi103.stdout:0/934: creat dd/df/d68/db5/f139 x:0 0 0 2024-09-17T01:07:29.710 INFO:tasks.workunit.client.0.smithi103.stdout:4/882: dread d9/d16/d38/d3f/f7c [0,4194304] 0 2024-09-17T01:07:29.711 INFO:tasks.workunit.client.0.smithi103.stdout:1/840: dread d2/d7/f1d [0,4194304] 0 2024-09-17T01:07:29.713 INFO:tasks.workunit.client.0.smithi103.stdout:9/878: creat d7/d43/d88/d11/d5c/d8d/f125 x:0 0 0 2024-09-17T01:07:29.713 INFO:tasks.workunit.client.0.smithi103.stdout:1/841: chown d2/d16/dbf/df8/c113 3369061 1 2024-09-17T01:07:29.717 INFO:tasks.workunit.client.0.smithi103.stdout:5/703: write d6/d28/d90/fa4 [16877,47443] 0 2024-09-17T01:07:29.719 INFO:tasks.workunit.client.0.smithi103.stdout:5/704: stat d6/d2c/d38/d4c/caa 0 2024-09-17T01:07:29.723 INFO:tasks.workunit.client.0.smithi103.stdout:2/929: dwrite d6/d5f/d26/d34/d80/fc5 [0,4194304] 0 2024-09-17T01:07:29.723 INFO:tasks.workunit.client.0.smithi103.stdout:9/879: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/d77/d102/f126 x:0 0 0 2024-09-17T01:07:29.724 INFO:tasks.workunit.client.0.smithi103.stdout:2/930: chown d6/d5f/d26/d66/df/ddd/d110 32296264 1 2024-09-17T01:07:29.725 INFO:tasks.workunit.client.0.smithi103.stdout:9/880: write d7/db8/dbb/f69 [5763063,22251] 0 2024-09-17T01:07:29.727 INFO:tasks.workunit.client.0.smithi103.stdout:4/883: rename d9/d16/d23/d2a/f93 to d9/d16/d45/f117 0 2024-09-17T01:07:29.729 INFO:tasks.workunit.client.0.smithi103.stdout:1/842: creat d2/d1c/f11b x:0 0 0 2024-09-17T01:07:29.730 INFO:tasks.workunit.client.0.smithi103.stdout:5/705: creat d6/d2c/dd7/ffd x:0 0 0 2024-09-17T01:07:29.731 INFO:tasks.workunit.client.0.smithi103.stdout:0/935: link dd/df/f19 dd/df/d68/d6c/d83/f13a 0 2024-09-17T01:07:29.732 INFO:tasks.workunit.client.0.smithi103.stdout:0/936: readlink dd/df/d108/l119 0 2024-09-17T01:07:29.735 INFO:tasks.workunit.client.0.smithi103.stdout:9/881: creat d7/d43/d88/d11/d5c/d5e/d6c/d6e/f127 x:0 0 0 2024-09-17T01:07:29.738 INFO:tasks.workunit.client.0.smithi103.stdout:9/882: dread d7/d43/d88/d11/d20/d4f/f75 [0,4194304] 0 2024-09-17T01:07:29.739 INFO:tasks.workunit.client.0.smithi103.stdout:1/843: creat d2/de/d76/df4/f11c x:0 0 0 2024-09-17T01:07:29.740 INFO:tasks.workunit.client.0.smithi103.stdout:9/883: dread - d7/d43/d88/d11/d5c/d11b/f11e zero size 2024-09-17T01:07:29.740 INFO:tasks.workunit.client.0.smithi103.stdout:4/884: dread d9/d16/d36/d42/d84/f111 [0,4194304] 0 2024-09-17T01:07:29.742 INFO:tasks.workunit.client.0.smithi103.stdout:5/706: write d6/d2c/d38/d4c/d50/fde [4303061,55012] 0 2024-09-17T01:07:29.742 INFO:tasks.workunit.client.0.smithi103.stdout:4/885: stat d9/d16/d44/fc8 0 2024-09-17T01:07:29.744 INFO:tasks.workunit.client.0.smithi103.stdout:5/707: write d6/d2c/d38/d6f/fbd [7804217,40009] 0 2024-09-17T01:07:29.751 INFO:tasks.workunit.client.0.smithi103.stdout:0/937: dwrite dd/d1c/d109/d10f/f116 [0,4194304] 0 2024-09-17T01:07:29.752 INFO:tasks.workunit.client.0.smithi103.stdout:4/886: unlink d9/d16/d23/d32/fe6 0 2024-09-17T01:07:29.754 INFO:tasks.workunit.client.0.smithi103.stdout:4/887: read d9/d16/d23/d32/d61/f95 [1358362,113184] 0 2024-09-17T01:07:29.755 INFO:tasks.workunit.client.0.smithi103.stdout:1/844: symlink d2/d1c/d28/d52/ddb/d102/l11d 0 2024-09-17T01:07:29.757 INFO:tasks.workunit.client.0.smithi103.stdout:9/884: write d7/d43/d88/d11/d5c/d5e/d6c/d6e/db1/fd6 [573767,124162] 0 2024-09-17T01:07:29.759 INFO:tasks.workunit.client.0.smithi103.stdout:9/885: read d7/f18 [2365202,65337] 0 2024-09-17T01:07:29.760 INFO:tasks.workunit.client.0.smithi103.stdout:0/938: read - dd/df/d38/f76 zero size 2024-09-17T01:07:29.762 INFO:tasks.workunit.client.0.smithi103.stdout:9/886: write d7/db4/ddc/f118 [305263,108272] 0 2024-09-17T01:07:29.762 INFO:tasks.workunit.client.0.smithi103.stdout:2/931: getdents d6/d5f/d26/d66/df/d68/d7e/dd9 0 2024-09-17T01:07:29.766 INFO:tasks.workunit.client.0.smithi103.stdout:5/708: dwrite d6/d2c/d32/d55/f5e [0,4194304] 0 2024-09-17T01:07:29.775 INFO:tasks.workunit.client.0.smithi103.stdout:4/888: symlink d9/d16/d23/d52/d109/d10b/l118 0 2024-09-17T01:07:29.775 INFO:tasks.workunit.client.0.smithi103.stdout:2/932: dread - d6/da/d5d/d8d/d60/d75/d70/ff1 zero size 2024-09-17T01:07:29.778 INFO:tasks.workunit.client.0.smithi103.stdout:5/709: creat d6/d2c/dd7/ffe x:0 0 0 2024-09-17T01:07:29.781 INFO:tasks.workunit.client.0.smithi103.stdout:0/939: write dd/d138/fdf [721934,66211] 0 2024-09-17T01:07:29.783 INFO:tasks.workunit.client.0.smithi103.stdout:1/845: dwrite d2/d1c/d20/d6d/d8d/d94/fbe [0,4194304] 0 2024-09-17T01:07:29.785 INFO:tasks.workunit.client.0.smithi103.stdout:9/887: write d7/d43/d88/d11/d5c/d8d/dac/dfe/d10b/faa [2005915,43] 0 2024-09-17T01:07:29.787 INFO:tasks.workunit.client.0.smithi103.stdout:2/933: mknod d6/d5f/dad/c140 0 2024-09-17T01:07:29.790 INFO:tasks.workunit.client.0.smithi103.stdout:0/940: mknod dd/d43/dfc/c13b 0 2024-09-17T01:07:29.792 INFO:tasks.workunit.client.0.smithi103.stdout:1/846: creat d2/d1c/d20/d33/f11e x:0 0 0 2024-09-17T01:07:29.793 INFO:tasks.workunit.client.0.smithi103.stdout:9/888: write d7/db4/fc6 [3584465,29689] 0 2024-09-17T01:07:29.797 INFO:tasks.workunit.client.0.smithi103.stdout:5/710: mkdir d6/d2c/d38/d4c/de5/dff 0 2024-09-17T01:07:29.799 INFO:tasks.workunit.client.0.smithi103.stdout:0/941: dwrite dd/d1c/f28 [0,4194304] 0 2024-09-17T01:07:29.799 INFO:tasks.workunit.client.0.smithi103.stdout:9/889: truncate d7/d43/d88/d11/d20/dbc/ff0 810782 0 2024-09-17T01:07:29.800 INFO:tasks.workunit.client.0.smithi103.stdout:0/942: chown dd/df/f5f 2989491 1 2024-09-17T01:07:29.802 INFO:tasks.workunit.client.0.smithi103.stdout:1/847: symlink d2/d70/l11f 0 2024-09-17T01:07:29.802 INFO:tasks.workunit.client.0.smithi103.stdout:4/889: dread d9/dc/f9a [0,4194304] 0 2024-09-17T01:07:29.805 INFO:tasks.workunit.client.0.smithi103.stdout:0/943: unlink dd/df/d68/db5/fc2 0 2024-09-17T01:07:29.806 INFO:tasks.workunit.client.0.smithi103.stdout:4/890: read d9/d16/d23/d2a/f10f [298436,42289] 0 2024-09-17T01:07:29.807 INFO:tasks.workunit.client.0.smithi103.stdout:5/711: creat d6/d2c/d32/dd1/de1/df5/f100 x:0 0 0 2024-09-17T01:07:29.809 INFO:tasks.workunit.client.0.smithi103.stdout:1/848: mknod d2/d7/c120 0 2024-09-17T01:07:29.810 INFO:tasks.workunit.client.0.smithi103.stdout:5/712: read d6/db/d66/f67 [1281075,84711] 0 2024-09-17T01:07:29.813 INFO:tasks.workunit.client.0.smithi103.stdout:4/891: mknod d9/d16/d36/d42/d84/de9/c119 0 2024-09-17T01:07:29.815 INFO:tasks.workunit.client.0.smithi103.stdout:1/849: mknod d2/d1c/d28/d52/c121 0 2024-09-17T01:07:29.819 INFO:tasks.workunit.client.0.smithi103.stdout:4/892: rename d9/d16/d23/d2a/f10f to d9/d16/d23/d32/d61/d47/f11a 0 2024-09-17T01:07:29.822 INFO:tasks.workunit.client.0.smithi103.stdout:2/934: dread f5 [0,4194304] 0 2024-09-17T01:07:29.824 INFO:tasks.workunit.client.0.smithi103.stdout:4/893: mkdir d9/dc/d11b 0 2024-09-17T01:07:29.824 INFO:tasks.workunit.client.0.smithi103.stdout:1/850: dwrite d2/d1c/d28/d52/d69/dbd/f10d [0,4194304] 0 2024-09-17T01:07:29.826 INFO:tasks.workunit.client.0.smithi103.stdout:2/935: chown d6/da/d5d/d8d/d60/d75/d70/df6/d13a 31100626 1 2024-09-17T01:07:29.827 INFO:tasks.workunit.client.0.smithi103.stdout:4/894: write d9/d16/d23/d32/d4c/f106 [620385,66314] 0 2024-09-17T01:07:29.829 INFO:tasks.workunit.client.0.smithi103.stdout:2/936: fdatasync d6/d5f/d26/d66/df/fa4 0 2024-09-17T01:07:29.834 INFO:tasks.workunit.client.0.smithi103.stdout:1/851: truncate d2/d1c/d28/d4b/d67/f6a 765565 0 2024-09-17T01:07:29.834 INFO:tasks.workunit.client.0.smithi103.stdout:2/937: mkdir d6/da/d5d/d8d/d60/d75/d141 0 2024-09-17T01:07:29.837 INFO:tasks.workunit.client.0.smithi103.stdout:2/938: fdatasync d6/f4b 0 2024-09-17T01:07:29.837 INFO:tasks.workunit.client.0.smithi103.stdout:0/944: dread dd/d1c/f1f [0,4194304] 0 2024-09-17T01:07:29.839 INFO:tasks.workunit.client.0.smithi103.stdout:5/713: dwrite d6/d2c/d38/d4c/d50/fb8 [0,4194304] 0 2024-09-17T01:07:29.839 INFO:tasks.workunit.client.0.smithi103.stdout:0/945: chown dd/f95 227533018 1 2024-09-17T01:07:29.843 INFO:tasks.workunit.client.0.smithi103.stdout:1/852: rename d2/de/d1f to d2/d16/d51/d65/dff/d122 0 2024-09-17T01:07:29.849 INFO:tasks.workunit.client.0.smithi103.stdout:2/939: rmdir d6/d5f/d26/d66/df/d68/d7e/d8b 39 2024-09-17T01:07:29.849 INFO:tasks.workunit.client.0.smithi103.stdout:5/714: dwrite d6/d2c/d38/d6f/fbd [4194304,4194304] 0 2024-09-17T01:07:29.851 INFO:tasks.workunit.client.0.smithi103.stdout:2/940: chown d6/d5f/d26/d66/df/d68/d7e/d9c/d7c 215 1 2024-09-17T01:07:29.851 INFO:tasks.workunit.client.0.smithi103.stdout:5/715: chown d6/d28/f6b 521 1 2024-09-17T01:07:29.853 INFO:tasks.workunit.client.0.smithi103.stdout:4/895: dwrite d9/fb9 [0,4194304] 0 2024-09-17T01:07:29.855 INFO:tasks.workunit.client.0.smithi103.stdout:2/941: write d6/da/d3f/f125 [12918,90942] 0 2024-09-17T01:07:29.860 INFO:tasks.workunit.client.0.smithi103.stdout:0/946: write dd/d1c/f1f [5087208,18149] 0 2024-09-17T01:07:29.861 INFO:tasks.workunit.client.0.smithi103.stdout:1/853: truncate d2/d16/d51/d65/da7/f111 9372443 0 2024-09-17T01:07:29.862 INFO:tasks.workunit.client.0.smithi103.stdout:5/716: dwrite d6/d2c/f91 [0,4194304] 0 2024-09-17T01:07:29.865 INFO:tasks.workunit.client.0.smithi103.stdout:4/896: read d9/d16/d44/f68 [1513625,58984] 0 2024-09-17T01:07:29.866 INFO:tasks.workunit.client.0.smithi103.stdout:4/897: fdatasync d9/d16/d45/d76/fc1 0 2024-09-17T01:07:29.869 INFO:tasks.workunit.client.0.smithi103.stdout:0/947: creat dd/df/d68/d6c/d83/de4/f13c x:0 0 0 2024-09-17T01:07:29.873 INFO:tasks.workunit.client.0.smithi103.stdout:2/942: write d6/da/d3f/f47 [2907117,101326] 0 2024-09-17T01:07:29.873 INFO:tasks.workunit.client.0.smithi103.stdout:1/854: dwrite d2/d1c/d28/d4b/d67/d9e/daf/fda [0,4194304] 0 2024-09-17T01:07:29.886 INFO:tasks.workunit.client.0.smithi103.stdout:4/898: creat d9/d16/f11c x:0 0 0 2024-09-17T01:07:29.887 INFO:tasks.workunit.client.0.smithi103.stdout:1/855: chown d2/d7/d73/l105 487125 1 2024-09-17T01:07:29.890 INFO:tasks.workunit.client.0.smithi103.stdout:5/717: dwrite d6/d2c/db3/fc3 [4194304,4194304] 0 2024-09-17T01:07:29.898 INFO:tasks.workunit.client.0.smithi103.stdout:0/948: dread dd/df/d68/d6c/d83/fcf [0,4194304] 0 2024-09-17T01:07:29.914 INFO:tasks.workunit.client.0.smithi103.stdout:2/943: dread d6/d5f/d26/d66/df/f8a [0,4194304] 0 2024-09-17T01:07:29.914 INFO:tasks.workunit.client.0.smithi103.stdout:1/856: read d2/d1c/d28/d52/d69/f114 [1436213,56920] 0 2024-09-17T01:07:29.927 INFO:tasks.workunit.client.0.smithi103.stdout:0/949: creat dd/df/d38/d55/dcc/f13d x:0 0 0 2024-09-17T01:07:29.928 INFO:tasks.workunit.client.0.smithi103.stdout:2/944: creat d6/d5f/df5/f142 x:0 0 0 2024-09-17T01:07:29.930 INFO:tasks.workunit.client.0.smithi103.stdout:2/945: write d6/da/d3f/f65 [2203201,55786] 0 2024-09-17T01:07:29.931 INFO:tasks.workunit.client.0.smithi103.stdout:2/946: readlink d6/d5f/l117 0 2024-09-17T01:07:29.931 INFO:tasks.workunit.client.0.smithi103.stdout:5/718: write d6/d2c/d38/d4c/f5b [1759608,53056] 0 2024-09-17T01:07:29.931 INFO:tasks.workunit.client.0.smithi103.stdout:0/950: rmdir dd/df/d68/d10b 39 2024-09-17T01:07:29.934 INFO:tasks.workunit.client.0.smithi103.stdout:4/899: write d9/d10/f62 [1582567,93072] 0 2024-09-17T01:07:29.936 INFO:tasks.workunit.client.0.smithi103.stdout:5/719: fdatasync d6/f1e 0 2024-09-17T01:07:29.938 INFO:tasks.workunit.client.0.smithi103.stdout:2/947: symlink d6/d5f/d26/d66/df/d68/d7e/d8b/l143 0 2024-09-17T01:07:29.940 INFO:tasks.workunit.client.0.smithi103.stdout:5/720: write d6/d2c/f3d [1804914,24879] 0 2024-09-17T01:07:29.940 INFO:tasks.workunit.client.0.smithi103.stdout:1/857: truncate d2/d70/ff9 672847 0 2024-09-17T01:07:29.944 INFO:tasks.workunit.client.0.smithi103.stdout:0/951: dwrite dd/d4f/d97/f121 [4194304,4194304] 0 2024-09-17T01:07:29.944 INFO:tasks.workunit.client.0.smithi103.stdout:1/858: mknod d2/d1c/d54/c123 0 2024-09-17T01:07:29.945 INFO:tasks.workunit.client.0.smithi103.stdout:4/900: dwrite d9/d16/d23/d2a/f89 [0,4194304] 0 2024-09-17T01:07:29.947 INFO:tasks.workunit.client.0.smithi103.stdout:1/859: chown d2/d1c/d28/d52/c121 0 1 2024-09-17T01:07:29.948 INFO:tasks.workunit.client.0.smithi103.stdout:5/721: mknod d6/d2c/d38/d4c/d71/db4/c101 0 2024-09-17T01:07:29.948 INFO:tasks.workunit.client.0.smithi103.stdout:2/948: truncate d6/da/d3f/fae 2359612 0 2024-09-17T01:07:29.949 INFO:tasks.workunit.client.0.smithi103.stdout:4/901: dread d9/d16/d36/d42/d84/f111 [0,4194304] 0 2024-09-17T01:07:29.953 INFO:tasks.workunit.client.0.smithi103.stdout:1/860: read d2/fb [1345897,97866] 0 2024-09-17T01:07:29.955 INFO:tasks.workunit.client.0.smithi103.stdout:4/902: rmdir d9/d16/d23/d32/d64/d85 39 2024-09-17T01:07:29.956 INFO:tasks.workunit.client.0.smithi103.stdout:1/861: chown d2/d1c/d28/d4b/d74/l75 5463786 1 2024-09-17T01:07:29.959 INFO:tasks.workunit.client.0.smithi103.stdout:2/949: truncate d6/d5f/d26/d66/df/d68/d7e/d9c/f67 453668 0 2024-09-17T01:07:29.961 INFO:tasks.workunit.client.0.smithi103.stdout:5/722: dwrite d6/d28/f96 [0,4194304] 0 2024-09-17T01:07:29.961 INFO:tasks.workunit.client.0.smithi103.stdout:4/903: write d9/d16/d23/d32/d61/f95 [3296950,62372] 0 2024-09-17T01:07:29.968 INFO:tasks.workunit.client.0.smithi103.stdout:5/723: rmdir d6/d2c 39 2024-09-17T01:07:29.970 INFO:tasks.workunit.client.0.smithi103.stdout:1/862: creat d2/d16/d51/d65/de0/f124 x:0 0 0 2024-09-17T01:07:29.971 INFO:tasks.workunit.client.0.smithi103.stdout:2/950: symlink d6/d5f/d26/d66/df/d68/d7e/d9c/db4/l144 0 2024-09-17T01:07:29.974 INFO:tasks.workunit.client.0.smithi103.stdout:1/863: truncate d2/f36 3776291 0 2024-09-17T01:07:29.975 INFO:tasks.workunit.client.0.smithi103.stdout:1/864: readlink d2/d1c/d28/d4b/d67/l9b 0 2024-09-17T01:07:29.976 INFO:tasks.workunit.client.0.smithi103.stdout:2/951: truncate d6/da/d3f/fe4 791871 0 2024-09-17T01:07:29.977 INFO:tasks.workunit.client.0.smithi103.stdout:5/724: symlink d6/d2c/d32/dd1/l102 0 2024-09-17T01:07:29.977 INFO:tasks.workunit.client.0.smithi103.stdout:1/865: write d2/d16/d51/d79/fec [79024,2927] 0 2024-09-17T01:07:29.980 INFO:tasks.workunit.client.0.smithi103.stdout:2/952: mknod d6/d5f/d26/d66/da8/c145 0 2024-09-17T01:07:29.982 INFO:tasks.workunit.client.0.smithi103.stdout:5/725: rename d6/db/f34 to d6/d2c/d38/d4c/d9a/f103 0 2024-09-17T01:07:29.989 INFO:tasks.workunit.client.0.smithi103.stdout:2/953: link d6/d5f/dad/fd6 d6/da/d5d/d8d/d60/d104/f146 0 2024-09-17T01:07:29.989 INFO:tasks.workunit.client.0.smithi103.stdout:0/952: dread dd/df/f41 [4194304,4194304] 0 2024-09-17T01:07:29.990 INFO:tasks.workunit.client.0.smithi103.stdout:5/726: dwrite d6/d2c/d38/d4c/d71/db4/ff9 [0,4194304] 0 2024-09-17T01:07:29.990 INFO:tasks.workunit.client.0.smithi103.stdout:0/953: chown dd/df/f13 35517374 1 2024-09-17T01:07:29.993 INFO:tasks.workunit.client.0.smithi103.stdout:2/954: creat d6/da/d5d/f147 x:0 0 0 2024-09-17T01:07:29.994 INFO:tasks.workunit.client.0.smithi103.stdout:2/955: chown d6/d5f/d26/d66/df 5831401 1 2024-09-17T01:07:29.996 INFO:tasks.workunit.client.0.smithi103.stdout:0/954: fdatasync dd/df/d38/f80 0 2024-09-17T01:07:29.999 INFO:tasks.workunit.client.0.smithi103.stdout:4/904: truncate d9/d16/d23/d32/d61/f87 2007987 0 2024-09-17T01:07:30.000 INFO:tasks.workunit.client.0.smithi103.stdout:5/727: symlink d6/d28/dcb/dc4/df3/l104 0 2024-09-17T01:07:30.009 INFO:tasks.workunit.client.0.smithi103.stdout:5/728: dwrite d6/d2c/d38/d6f/f9c [4194304,4194304] 0 2024-09-17T01:07:30.011 INFO:tasks.workunit.client.0.smithi103.stdout:0/955: mknod dd/df/d68/d6c/dc3/c13e 0 2024-09-17T01:07:30.013 INFO:tasks.workunit.client.0.smithi103.stdout:4/905: mkdir d9/d16/d23/d32/d11d 0 2024-09-17T01:07:30.015 INFO:tasks.workunit.client.0.smithi103.stdout:1/866: dread d2/f1a [0,4194304] 0 2024-09-17T01:07:30.015 INFO:tasks.workunit.client.0.smithi103.stdout:1/867: chown d2/d7/fc 11340851 1 2024-09-17T01:07:30.017 INFO:tasks.workunit.client.0.smithi103.stdout:1/868: chown d2/d7/d73/dfd/f101 5332 1 2024-09-17T01:07:30.018 INFO:tasks.workunit.client.0.smithi103.stdout:2/956: creat d6/d5f/d26/d66/df/ddd/d110/f148 x:0 0 0 2024-09-17T01:07:30.019 INFO:tasks.workunit.client.0.smithi103.stdout:5/729: symlink d6/d2c/d38/d4c/d71/db4/l105 0 2024-09-17T01:07:30.019 INFO:tasks.workunit.client.0.smithi103.stdout:5/730: chown d6/db/d66/dbe 130016 1 2024-09-17T01:07:30.025 INFO:tasks.workunit.client.0.smithi103.stdout:4/906: fsync d9/d16/d36/d42/f9f 0 2024-09-17T01:07:30.027 INFO:tasks.workunit.client.0.smithi103.stdout:1/869: creat d2/d70/f125 x:0 0 0 2024-09-17T01:07:30.029 INFO:tasks.workunit.client.0.smithi103.stdout:1/870: write d2/d7/d4e/f104 [695555,32998] 0 2024-09-17T01:07:30.034 INFO:tasks.workunit.client.0.smithi103.stdout:5/731: rename d6/d2c/d38/d4c/d71 to d6/d11/d81/d106 0 2024-09-17T01:07:30.034 INFO:tasks.workunit.client.0.smithi103.stdout:4/907: dwrite d9/fb9 [4194304,4194304] 0 2024-09-17T01:07:30.038 INFO:tasks.workunit.client.0.smithi103.stdout:0/956: dwrite dd/df/d38/f80 [0,4194304] 0 2024-09-17T01:07:30.041 INFO:tasks.workunit.client.0.smithi103.stdout:0/957: chown dd/df/d68/ddc/ffa 50347 1 2024-09-17T01:07:30.043 INFO:tasks.workunit.client.0.smithi103.stdout:1/871: mkdir d2/d70/dac/d126 0 2024-09-17T01:07:30.047 INFO:tasks.workunit.client.0.smithi103.stdout:5/732: creat d6/d2c/db3/f107 x:0 0 0 2024-09-17T01:07:30.048 INFO:tasks.workunit.client.0.smithi103.stdout:2/957: dread d6/d5f/d26/d66/df/f6b [0,4194304] 0 2024-09-17T01:07:30.053 INFO:tasks.workunit.client.0.smithi103.stdout:4/908: fsync d9/d16/d23/d52/d91/dd4/f4a 0 2024-09-17T01:07:30.053 INFO:tasks.workunit.client.0.smithi103.stdout:1/872: fsync d2/d16/d51/d65/dff/d122/f85 0 2024-09-17T01:07:30.057 INFO:tasks.workunit.client.0.smithi103.stdout:1/873: mknod d2/d1c/d28/d52/ddb/c127 0 2024-09-17T01:07:30.058 INFO:tasks.workunit.client.0.smithi103.stdout:1/874: write d2/d1c/d20/f83 [4326493,93059] 0 2024-09-17T01:07:30.059 INFO:tasks.workunit.client.0.smithi103.stdout:0/958: creat dd/df/d38/d62/f13f x:0 0 0 2024-09-17T01:07:30.060 INFO:tasks.workunit.client.0.smithi103.stdout:1/875: fdatasync d2/f8 0 2024-09-17T01:07:30.067 INFO:tasks.workunit.client.0.smithi103.stdout:1/876: rmdir d2/d70/dac 39 2024-09-17T01:07:30.068 INFO:tasks.workunit.client.0.smithi103.stdout:4/909: dwrite d9/d16/d23/d52/d91/dd4/d55/f60 [0,4194304] 0 2024-09-17T01:07:30.069 INFO:tasks.workunit.client.0.smithi103.stdout:5/733: dread d6/d2c/d38/fdb [0,4194304] 0 2024-09-17T01:07:30.070 INFO:tasks.workunit.client.0.smithi103.stdout:5/734: dread - d6/d28/fb1 zero size 2024-09-17T01:07:30.071 INFO:tasks.workunit.client.0.smithi103.stdout:5/735: chown d6/d2c/d38 30043730 1 2024-09-17T01:07:30.074 INFO:tasks.workunit.client.0.smithi103.stdout:4/910: unlink d9/dc/df/f20 0 2024-09-17T01:07:30.075 INFO:tasks.workunit.client.0.smithi103.stdout:4/911: stat d9/d16/d23 0 2024-09-17T01:07:30.077 INFO:tasks.workunit.client.0.smithi103.stdout:1/877: fdatasync d2/d16/d51/d65/d7f/fc4 0 2024-09-17T01:07:30.077 INFO:tasks.workunit.client.0.smithi103.stdout:0/959: dwrite dd/df/d38/f76 [0,4194304] 0 2024-09-17T01:07:30.083 INFO:tasks.workunit.client.0.smithi103.stdout:4/912: creat d9/d16/d44/f11e x:0 0 0 2024-09-17T01:07:30.084 INFO:tasks.workunit.client.0.smithi103.stdout:1/878: rmdir d2/d1c/db9 39 2024-09-17T01:07:30.085 INFO:tasks.workunit.client.0.smithi103.stdout:0/960: symlink dd/df/d38/da8/l140 0 2024-09-17T01:07:30.092 INFO:tasks.workunit.client.0.smithi103.stdout:4/913: creat d9/d16/d23/d32/d64/d112/f11f x:0 0 0 2024-09-17T01:07:30.097 INFO:tasks.workunit.client.0.smithi103.stdout:4/914: rename d9/d16/d23/l8b to d9/d16/d70/l120 0 2024-09-17T01:07:30.099 INFO:tasks.workunit.client.0.smithi103.stdout:0/961: creat dd/df/d38/f141 x:0 0 0 2024-09-17T01:07:30.103 INFO:tasks.workunit.client.0.smithi103.stdout:5/736: dwrite d6/d2c/d38/ff1 [0,4194304] 0 2024-09-17T01:07:30.104 INFO:tasks.workunit.client.0.smithi103.stdout:0/962: fsync dd/d4f/d64/f79 0 2024-09-17T01:07:30.106 INFO:tasks.workunit.client.0.smithi103.stdout:1/879: dwrite d2/d1c/d28/d4b/d67/f6b [0,4194304] 0 2024-09-17T01:07:30.109 INFO:tasks.workunit.client.0.smithi103.stdout:0/963: chown dd/df/d38/d55/dcc 0 1 2024-09-17T01:07:30.110 INFO:tasks.workunit.client.0.smithi103.stdout:5/737: symlink d6/d28/df4/l108 0 2024-09-17T01:07:30.115 INFO:tasks.workunit.client.0.smithi103.stdout:1/880: truncate d2/d16/d51/d65/de0/f124 138872 0 2024-09-17T01:07:30.117 INFO:tasks.workunit.client.0.smithi103.stdout:1/881: mknod d2/c128 0 2024-09-17T01:07:30.119 INFO:tasks.workunit.client.0.smithi103.stdout:0/964: write dd/f7a [111762,92242] 0 2024-09-17T01:07:30.122 INFO:tasks.workunit.client.0.smithi103.stdout:0/965: write dd/df/d68/d6c/d83/fcf [1285610,58813] 0 2024-09-17T01:07:30.123 INFO:tasks.workunit.client.0.smithi103.stdout:4/915: dread d9/d16/d44/f10e [0,4194304] 0 2024-09-17T01:07:30.127 INFO:tasks.workunit.client.0.smithi103.stdout:4/916: getdents d9/d16/d45/d76 0 2024-09-17T01:07:30.130 INFO:tasks.workunit.client.0.smithi103.stdout:4/917: chown d9/d16/d38/d3f/l4d 7961 1 2024-09-17T01:07:30.131 INFO:tasks.workunit.client.0.smithi103.stdout:4/918: readlink d9/d16/d23/d90/l10a 0 2024-09-17T01:07:30.133 INFO:tasks.workunit.client.0.smithi103.stdout:1/882: chown d2/d70/dac/ld1 1760669812 1 2024-09-17T01:07:30.135 INFO:tasks.workunit.client.0.smithi103.stdout:1/883: write d2/d1c/f11b [454292,24462] 0 2024-09-17T01:07:30.140 INFO:tasks.workunit.client.0.smithi103.stdout:0/966: dwrite dd/d43/f53 [0,4194304] 0 2024-09-17T01:07:30.141 INFO:tasks.workunit.client.0.smithi103.stdout:5/738: dread d6/d2c/d38/d6f/fbd [0,4194304] 0 2024-09-17T01:07:30.145 INFO:tasks.workunit.client.0.smithi103.stdout:4/919: truncate d9/d16/d36/d42/d84/de9/ffa 5917282 0 2024-09-17T01:07:30.147 INFO:tasks.workunit.client.0.smithi103.stdout:5/739: truncate d6/d2c/d38/d6f/da3/fb0 934919 0 2024-09-17T01:07:30.148 INFO:tasks.workunit.client.0.smithi103.stdout:1/884: dwrite d2/d16/d51/d65/dff/d122/f72 [0,4194304] 0 2024-09-17T01:07:30.149 INFO:tasks.workunit.client.0.smithi103.stdout:1/885: stat d2/d1c/d20/d33/f57 0 2024-09-17T01:07:30.150 INFO:tasks.workunit.client.0.smithi103.stdout:0/967: unlink dd/d1c/l89 0 2024-09-17T01:07:30.153 INFO:tasks.workunit.client.0.smithi103.stdout:4/920: creat d9/d16/d23/d32/d61/d47/f121 x:0 0 0 2024-09-17T01:07:30.155 INFO:tasks.workunit.client.0.smithi103.stdout:1/886: fdatasync d2/d7/d73/dfd/f101 0 2024-09-17T01:07:30.155 INFO:tasks.workunit.client.0.smithi103.stdout:0/968: rmdir dd/df/d38/da8 39 2024-09-17T01:07:30.156 INFO:tasks.workunit.client.0.smithi103.stdout:0/969: chown dd/df/ca2 2410624 1 2024-09-17T01:07:30.157 INFO:tasks.workunit.client.0.smithi103.stdout:5/740: mkdir d6/d2c/d38/d109 0 2024-09-17T01:07:30.158 INFO:tasks.workunit.client.0.smithi103.stdout:4/921: rmdir d9/d16/d23/d32/d4c 39 2024-09-17T01:07:30.163 INFO:tasks.workunit.client.0.smithi103.stdout:1/887: fsync d2/d7/d4e/fe1 0 2024-09-17T01:07:30.169 INFO:tasks.workunit.client.0.smithi103.stdout:5/741: rename d6/d2c/d38/d6f/f9c to d6/d28/dcb/d93/f10a 0 2024-09-17T01:07:30.174 INFO:tasks.workunit.client.0.smithi103.stdout:0/970: dwrite dd/d43/f8f [0,4194304] 0 2024-09-17T01:07:30.176 INFO:tasks.workunit.client.0.smithi103.stdout:4/922: symlink d9/d16/l122 0 2024-09-17T01:07:30.179 INFO:tasks.workunit.client.0.smithi103.stdout:5/742: symlink d6/d28/df4/l10b 0 2024-09-17T01:07:30.180 INFO:tasks.workunit.client.0.smithi103.stdout:5/743: write d6/d28/dcb/fce [93579,99801] 0 2024-09-17T01:07:30.181 INFO:tasks.workunit.client.0.smithi103.stdout:1/888: mknod d2/d16/d51/d65/c129 0 2024-09-17T01:07:30.188 INFO:tasks.workunit.client.0.smithi103.stdout:4/923: read d9/d16/d23/d52/fce [3694926,6044] 0 2024-09-17T01:07:30.188 INFO:tasks.workunit.client.0.smithi103.stdout:5/744: mknod d6/d2c/d38/d6f/da3/c10c 0 2024-09-17T01:07:30.190 INFO:tasks.workunit.client.0.smithi103.stdout:0/971: mkdir dd/d43/d142 0 2024-09-17T01:07:30.191 INFO:tasks.workunit.client.0.smithi103.stdout:1/889: read - d2/d1c/db9/fe5 zero size 2024-09-17T01:07:30.192 INFO:tasks.workunit.client.0.smithi103.stdout:0/972: chown dd/df/d108/c10d 29414 1 2024-09-17T01:07:30.194 INFO:tasks.workunit.client.0.smithi103.stdout:5/745: read d6/d28/dcb/d93/f9d [1064727,75298] 0 2024-09-17T01:07:30.195 INFO:tasks.workunit.client.0.smithi103.stdout:1/890: creat d2/d16/d51/d65/d7f/f12a x:0 0 0 2024-09-17T01:07:30.198 INFO:tasks.workunit.client.0.smithi103.stdout:0/973: mknod dd/df/d68/ddc/d93/c143 0 2024-09-17T01:07:30.199 INFO:tasks.workunit.client.0.smithi103.stdout:0/974: chown dd/d1c/d9f/da3/ff3 454 1 2024-09-17T01:07:30.199 INFO:tasks.workunit.client.0.smithi103.stdout:0/975: dread - dd/f129 zero size 2024-09-17T01:07:30.200 INFO:tasks.workunit.client.0.smithi103.stdout:0/976: stat dd/df/d68/d6c 0 2024-09-17T01:07:30.200 INFO:tasks.workunit.client.0.smithi103.stdout:5/746: mknod d6/d28/df4/c10d 0 2024-09-17T01:07:30.202 INFO:tasks.workunit.client.0.smithi103.stdout:1/891: symlink d2/d1c/d28/d52/ddb/d102/l12b 0 2024-09-17T01:07:30.203 INFO:tasks.workunit.client.0.smithi103.stdout:5/747: mkdir d6/d11/d81/d10e 0 2024-09-17T01:07:30.205 INFO:tasks.workunit.client.0.smithi103.stdout:1/892: chown d2/de/d76/df4/f11c 412898 1 2024-09-17T01:07:30.206 INFO:tasks.workunit.client.0.smithi103.stdout:1/893: chown d2/d16/dbf 58 1 2024-09-17T01:07:30.207 INFO:tasks.workunit.client.0.smithi103.stdout:1/894: dread - d2/d1c/d28/d4b/d74/f10e zero size 2024-09-17T01:07:30.208 INFO:tasks.workunit.client.0.smithi103.stdout:1/895: fsync d2/d1c/d28/d4b/d67/f6b 0 2024-09-17T01:07:30.215 INFO:tasks.workunit.client.0.smithi103.stdout:1/896: mkdir d2/d1c/d28/d4b/d12c 0 2024-09-17T01:07:30.215 INFO:tasks.workunit.client.0.smithi103.stdout:0/977: dread dd/d43/f58 [0,4194304] 0 2024-09-17T01:07:30.219 INFO:tasks.workunit.client.0.smithi103.stdout:0/978: read dd/df/f13 [1797825,65786] 0 2024-09-17T01:07:30.223 INFO:tasks.workunit.client.0.smithi103.stdout:5/748: dwrite d6/d11/d81/d106/fbf [0,4194304] 0 2024-09-17T01:07:30.228 INFO:tasks.workunit.client.0.smithi103.stdout:5/749: fsync f0 0 2024-09-17T01:07:30.234 INFO:tasks.workunit.client.0.smithi103.stdout:1/897: dwrite d2/d7/d4e/f7b [0,4194304] 0 2024-09-17T01:07:30.238 INFO:tasks.workunit.client.0.smithi103.stdout:0/979: dwrite fc [0,4194304] 0 2024-09-17T01:07:30.243 INFO:tasks.workunit.client.0.smithi103.stdout:0/980: chown dd/df/d68/c88 46731068 1 2024-09-17T01:07:30.257 INFO:tasks.workunit.client.0.smithi103.stdout:0/981: dwrite dd/df/d38/d62/f13f [0,4194304] 0 2024-09-17T01:07:30.259 INFO:tasks.workunit.client.0.smithi103.stdout:1/898: dwrite d2/d1c/db9/fd9 [0,4194304] 0 2024-09-17T01:07:30.260 INFO:tasks.workunit.client.0.smithi103.stdout:1/899: stat d2/de/f11 0 2024-09-17T01:07:30.261 INFO:tasks.workunit.client.0.smithi103.stdout:1/900: dread - d2/de/da0/f11a zero size 2024-09-17T01:07:30.271 INFO:tasks.workunit.client.0.smithi103.stdout:0/982: truncate dd/df/d38/fe0 22099 0 2024-09-17T01:07:30.279 INFO:tasks.workunit.client.0.smithi103.stdout:1/901: write d2/d1c/d28/d52/d69/f82 [5093570,45565] 0 2024-09-17T01:07:30.283 INFO:tasks.workunit.client.0.smithi103.stdout:1/902: mknod d2/de/de9/c12d 0 2024-09-17T01:07:30.286 INFO:tasks.workunit.client.0.smithi103.stdout:1/903: creat d2/d16/dbf/df8/f12e x:0 0 0 2024-09-17T01:07:30.295 INFO:tasks.workunit.client.0.smithi103.stdout:1/904: dread d2/fb [0,4194304] 0 2024-09-17T01:07:30.295 INFO:tasks.workunit.client.0.smithi103.stdout:0/983: dwrite dd/f14 [0,4194304] 0 2024-09-17T01:07:30.297 INFO:tasks.workunit.client.0.smithi103.stdout:0/984: read dd/df/d38/f117 [2794568,80012] 0 2024-09-17T01:07:30.299 INFO:tasks.workunit.client.0.smithi103.stdout:0/985: fsync dd/df/d68/d6c/d83/de4/faa 0 2024-09-17T01:07:30.306 INFO:tasks.workunit.client.0.smithi103.stdout:1/905: creat d2/d1c/d20/f12f x:0 0 0 2024-09-17T01:07:30.309 INFO:tasks.workunit.client.0.smithi103.stdout:1/906: truncate d2/de/da0/fc6 1227158 0 2024-09-17T01:07:30.310 INFO:tasks.workunit.client.0.smithi103.stdout:0/986: creat dd/df/d38/d62/d84/db2/f144 x:0 0 0 2024-09-17T01:07:30.314 INFO:tasks.workunit.client.0.smithi103.stdout:0/987: read f3 [6180129,37175] 0 2024-09-17T01:07:30.315 INFO:tasks.workunit.client.0.smithi103.stdout:0/988: chown dd/df/d68/d6c/d8e/dca/ff6 13260818 1 2024-09-17T01:07:30.317 INFO:tasks.workunit.client.0.smithi103.stdout:0/989: mknod dd/df/d38/d62/db0/c145 0 2024-09-17T01:07:30.319 INFO:tasks.workunit.client.0.smithi103.stdout:0/990: mknod dd/df/d38/d55/c146 0 2024-09-17T01:07:30.320 INFO:tasks.workunit.client.0.smithi103.stdout:0/991: write dd/d43/f53 [4623527,3966] 0 2024-09-17T01:07:30.326 INFO:tasks.workunit.client.0.smithi103.stdout:0/992: rename dd/df/d38/d62/dbf/fa6 to dd/df/d68/d6c/d8e/dca/d101/f147 0 2024-09-17T01:07:30.326 INFO:tasks.workunit.client.0.smithi103.stdout:0/993: read - dd/df/d68/d6c/f7b zero size 2024-09-17T01:07:30.338 INFO:tasks.workunit.client.0.smithi103.stdout:1/907: write d2/d1c/db9/fe5 [988727,98759] 0 2024-09-17T01:07:30.355 INFO:tasks.workunit.client.0.smithi103.stdout:1/908: creat d2/d1c/d28/d4b/f130 x:0 0 0 2024-09-17T01:07:30.363 INFO:tasks.workunit.client.0.smithi103.stdout:0/994: truncate dd/d43/f53 1464377 0 2024-09-17T01:07:30.380 INFO:tasks.workunit.client.0.smithi103.stdout:0/995: getdents dd/d1c/d109 0 2024-09-17T01:07:30.387 INFO:tasks.workunit.client.0.smithi103.stdout:1/909: dwrite d2/d16/d51/d65/dff/d122/fc0 [0,4194304] 0 2024-09-17T01:07:30.388 INFO:tasks.workunit.client.0.smithi103.stdout:7/898: sync 2024-09-17T01:07:30.388 INFO:tasks.workunit.client.0.smithi103.stdout:0/996: dread dd/d4f/d97/f12c [0,4194304] 0 2024-09-17T01:07:30.391 INFO:tasks.workunit.client.0.smithi103.stdout:1/910: chown d2/d1c/d28/d4b/d67/d9e/daf/fda 5 1 2024-09-17T01:07:30.393 INFO:tasks.workunit.client.0.smithi103.stdout:7/899: symlink d4/d10/d6b/dc5/d36/d3a/d51/l139 0 2024-09-17T01:07:30.395 INFO:tasks.workunit.client.0.smithi103.stdout:0/997: dread dd/d4f/f81 [0,4194304] 0 2024-09-17T01:07:30.395 INFO:tasks.workunit.client.0.smithi103.stdout:7/900: dread - d4/f126 zero size 2024-09-17T01:07:30.397 INFO:tasks.workunit.client.0.smithi103.stdout:1/911: dread d2/d16/f30 [0,4194304] 0 2024-09-17T01:07:30.400 INFO:tasks.workunit.client.0.smithi103.stdout:0/998: mknod dd/df/d38/d62/db0/c148 0 2024-09-17T01:07:30.400 INFO:tasks.workunit.client.0.smithi103.stdout:1/912: truncate d2/d16/d51/d65/da7/fed 279612 0 2024-09-17T01:07:30.401 INFO:tasks.workunit.client.0.smithi103.stdout:1/913: chown d2/d70/l11f 1837057 1 2024-09-17T01:07:30.408 INFO:tasks.workunit.client.0.smithi103.stdout:7/901: dread d4/d10/d43/fea [0,4194304] 0 2024-09-17T01:07:30.413 INFO:tasks.workunit.client.0.smithi103.stdout:7/902: mknod d4/d4a/d4b/c13a 0 2024-09-17T01:07:30.414 INFO:tasks.workunit.client.0.smithi103.stdout:7/903: fdatasync d4/d10/d6b/f138 0 2024-09-17T01:07:30.415 INFO:tasks.workunit.client.0.smithi103.stdout:0/999: truncate dd/d43/dfc/ffd 193791 0 2024-09-17T01:07:30.416 INFO:tasks.workunit.client.0.smithi103.stdout:7/904: readlink d4/d10/d4e/l70 0 2024-09-17T01:07:30.420 INFO:tasks.workunit.client.0.smithi103.stdout:1/914: dwrite d2/d16/d51/d65/dff/d122/f34 [4194304,4194304] 0 2024-09-17T01:07:30.421 INFO:tasks.workunit.client.0.smithi103.stdout:1/915: chown d2/d1c/d20/d6d 13453 1 2024-09-17T01:07:30.430 INFO:tasks.workunit.client.0.smithi103.stdout:1/916: dwrite d2/d16/d51/d79/fec [0,4194304] 0 2024-09-17T01:07:30.432 INFO:tasks.workunit.client.0.smithi103.stdout:7/905: write d4/d10/d6b/dc5/d8d/f107 [547240,21967] 0 2024-09-17T01:07:30.433 INFO:tasks.workunit.client.0.smithi103.stdout:1/917: mkdir d2/de/d76/df4/d131 0 2024-09-17T01:07:30.436 INFO:tasks.workunit.client.0.smithi103.stdout:7/906: rename l0 to d4/d10/d6b/dc5/d36/d3a/l13b 0 2024-09-17T01:07:30.438 INFO:tasks.workunit.client.0.smithi103.stdout:1/918: creat d2/d16/d51/d65/d7f/f132 x:0 0 0 2024-09-17T01:07:30.439 INFO:tasks.workunit.client.0.smithi103.stdout:1/919: write d2/d7/d73/dfd/f101 [603154,51612] 0 2024-09-17T01:07:30.440 INFO:tasks.workunit.client.0.smithi103.stdout:1/920: chown d2/d1c/d28/d4b/l107 483166243 1 2024-09-17T01:07:30.442 INFO:tasks.workunit.client.0.smithi103.stdout:7/907: mknod d4/d10/d43/dc8/d12b/c13c 0 2024-09-17T01:07:30.446 INFO:tasks.workunit.client.0.smithi103.stdout:1/921: symlink d2/d16/l133 0 2024-09-17T01:07:30.450 INFO:tasks.workunit.client.0.smithi103.stdout:1/922: rename d2/d16/lc7 to d2/de/d76/df4/l134 0 2024-09-17T01:07:30.451 INFO:tasks.workunit.client.0.smithi103.stdout:1/923: dread - d2/d16/dbf/df8/f12e zero size 2024-09-17T01:07:30.454 INFO:tasks.workunit.client.0.smithi103.stdout:1/924: creat d2/d1c/d28/d4b/d12c/f135 x:0 0 0 2024-09-17T01:07:30.455 INFO:tasks.workunit.client.0.smithi103.stdout:1/925: chown d2/d1c/d20/dd7/ff6 809985 1 2024-09-17T01:07:30.462 INFO:tasks.workunit.client.0.smithi103.stdout:1/926: truncate d2/d7/d73/d81/fa6 2291030 0 2024-09-17T01:07:30.463 INFO:tasks.workunit.client.0.smithi103.stdout:7/908: dwrite d4/d4a/f79 [0,4194304] 0 2024-09-17T01:07:30.465 INFO:tasks.workunit.client.0.smithi103.stdout:1/927: fsync d2/de/f58 0 2024-09-17T01:07:30.475 INFO:tasks.workunit.client.0.smithi103.stdout:7/909: rename d4/d10/d6b/dc5/d36/d3a/l13b to d4/d4a/d4b/d9d/l13d 0 2024-09-17T01:07:30.476 INFO:tasks.workunit.client.0.smithi103.stdout:1/928: write d2/d1c/d20/f2e [1730794,23340] 0 2024-09-17T01:07:30.477 INFO:tasks.workunit.client.0.smithi103.stdout:1/929: fdatasync d2/d1c/d28/d4b/f130 0 2024-09-17T01:07:30.479 INFO:tasks.workunit.client.0.smithi103.stdout:1/930: write d2/d1c/d20/d33/f3c [4392362,12000] 0 2024-09-17T01:07:30.481 INFO:tasks.workunit.client.0.smithi103.stdout:7/910: truncate d4/d4a/d4b/d8a/dff/db8/d10a/d8c/fdd 817375 0 2024-09-17T01:07:30.482 INFO:tasks.workunit.client.0.smithi103.stdout:1/931: symlink d2/d1c/d20/dd7/l136 0 2024-09-17T01:07:30.488 INFO:tasks.workunit.client.0.smithi103.stdout:7/911: mknod d4/d10/d43/c13e 0 2024-09-17T01:07:30.488 INFO:tasks.workunit.client.0.smithi103.stdout:7/912: stat d4/d10/d6b/d9f/ce5 0 2024-09-17T01:07:30.489 INFO:tasks.workunit.client.0.smithi103.stdout:7/913: readlink d4/d10/d4e/l70 0 2024-09-17T01:07:30.490 INFO:tasks.workunit.client.0.smithi103.stdout:7/914: write d4/d10/d6b/dc5/d8d/f118 [186710,111595] 0 2024-09-17T01:07:30.491 INFO:tasks.workunit.client.0.smithi103.stdout:1/932: write d2/d16/f40 [5867339,78861] 0 2024-09-17T01:07:30.495 INFO:tasks.workunit.client.0.smithi103.stdout:7/915: symlink d4/d4a/d4b/d8a/dff/db8/d10a/d100/l13f 0 2024-09-17T01:07:30.496 INFO:tasks.workunit.client.0.smithi103.stdout:7/916: fdatasync d4/d10/d32/f123 0 2024-09-17T01:07:30.499 INFO:tasks.workunit.client.0.smithi103.stdout:1/933: link d2/f6 d2/d1c/d28/d4b/d74/f137 0 2024-09-17T01:07:30.500 INFO:tasks.workunit.client.0.smithi103.stdout:7/917: creat d4/d4a/d4b/d9d/f140 x:0 0 0 2024-09-17T01:07:30.506 INFO:tasks.workunit.client.0.smithi103.stdout:7/918: fdatasync d4/d10/d6b/dc5/d8d/fd7 0 2024-09-17T01:07:30.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:30 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:30.511 INFO:tasks.workunit.client.0.smithi103.stdout:7/919: symlink d4/d10/l141 0 2024-09-17T01:07:30.513 INFO:tasks.workunit.client.0.smithi103.stdout:1/934: truncate d2/d1c/d20/d33/f3c 3915409 0 2024-09-17T01:07:30.515 INFO:tasks.workunit.client.0.smithi103.stdout:1/935: mkdir d2/d16/d51/d65/dff/d122/d138 0 2024-09-17T01:07:30.517 INFO:tasks.workunit.client.0.smithi103.stdout:7/920: creat d4/d10/d6b/dc5/f142 x:0 0 0 2024-09-17T01:07:30.517 INFO:tasks.workunit.client.0.smithi103.stdout:7/921: readlink d4/d10/d43/dc8/lb7 0 2024-09-17T01:07:30.519 INFO:tasks.workunit.client.0.smithi103.stdout:1/936: mknod d2/d1c/d28/d4b/c139 0 2024-09-17T01:07:30.520 INFO:tasks.workunit.client.0.smithi103.stdout:7/922: creat d4/d11/d3f/f143 x:0 0 0 2024-09-17T01:07:30.521 INFO:tasks.workunit.client.0.smithi103.stdout:1/937: truncate d2/d1c/d28/d4b/f66 344611 0 2024-09-17T01:07:30.523 INFO:tasks.workunit.client.0.smithi103.stdout:7/923: dread d4/d4a/d4b/f11e [0,4194304] 0 2024-09-17T01:07:30.526 INFO:tasks.workunit.client.0.smithi103.stdout:1/938: dread d2/d16/d51/d65/dff/d122/fc0 [0,4194304] 0 2024-09-17T01:07:30.526 INFO:tasks.workunit.client.0.smithi103.stdout:7/924: rmdir d4/d4a/d4b/d9d 39 2024-09-17T01:07:30.540 INFO:tasks.workunit.client.0.smithi103.stdout:7/925: write d4/d10/d6b/dc5/fae [1404775,96718] 0 2024-09-17T01:07:30.545 INFO:tasks.workunit.client.0.smithi103.stdout:7/926: dread - d4/d10/d66/dd2/fde zero size 2024-09-17T01:07:30.545 INFO:tasks.workunit.client.0.smithi103.stdout:1/939: dwrite d2/de/d116/fe3 [0,4194304] 0 2024-09-17T01:07:30.548 INFO:tasks.workunit.client.0.smithi103.stdout:7/927: mkdir d4/d10/d66/dd2/d144 0 2024-09-17T01:07:30.549 INFO:tasks.workunit.client.0.smithi103.stdout:1/940: chown d2/d1c/d54/f46 4583981 1 2024-09-17T01:07:30.549 INFO:tasks.workunit.client.0.smithi103.stdout:7/928: chown d4/d10/d66/dd2/fde 3 1 2024-09-17T01:07:30.552 INFO:tasks.workunit.client.0.smithi103.stdout:1/941: mknod d2/de/c13a 0 2024-09-17T01:07:30.554 INFO:tasks.workunit.client.0.smithi103.stdout:1/942: fsync d2/de/f11 0 2024-09-17T01:07:30.565 INFO:tasks.workunit.client.0.smithi103.stdout:7/929: dread d4/d10/d43/f57 [0,4194304] 0 2024-09-17T01:07:30.566 INFO:tasks.workunit.client.0.smithi103.stdout:7/930: chown d4/d4a/d4b/d8a/dff/db8/d10a/f105 2618230 1 2024-09-17T01:07:30.570 INFO:tasks.workunit.client.0.smithi103.stdout:6/845: sync 2024-09-17T01:07:30.571 INFO:tasks.workunit.client.0.smithi103.stdout:6/846: chown d3/d16/d33/d3e/d58/d82 45524 1 2024-09-17T01:07:30.572 INFO:tasks.workunit.client.0.smithi103.stdout:1/943: dwrite d2/de/f14 [0,4194304] 0 2024-09-17T01:07:30.574 INFO:tasks.workunit.client.0.smithi103.stdout:7/931: rename d4/d10/d6b/dc5/d36/d82 to d4/d10/d6b/dc5/d36/d145 0 2024-09-17T01:07:30.574 INFO:tasks.workunit.client.0.smithi103.stdout:1/944: symlink d2/d7/d73/db8/l13b 0 2024-09-17T01:07:30.575 INFO:tasks.workunit.client.0.smithi103.stdout:6/847: dread - d3/d16/d33/d3e/f51 zero size 2024-09-17T01:07:30.575 INFO:tasks.workunit.client.0.smithi103.stdout:1/945: stat d2/d16/dbf 0 2024-09-17T01:07:30.576 INFO:tasks.workunit.client.0.smithi103.stdout:7/932: chown d4/d10/d6b/dc5/d36/d3a/f4c 20036 1 2024-09-17T01:07:30.581 INFO:tasks.workunit.client.0.smithi103.stdout:7/933: creat d4/d10/d6b/dc5/d36/d3a/d51/f146 x:0 0 0 2024-09-17T01:07:30.591 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:30 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:30.748 INFO:tasks.workunit.client.0.smithi103.stdout:1/946: write d2/d1c/d28/d52/f5c [854995,15168] 0 2024-09-17T01:07:30.748 INFO:tasks.workunit.client.0.smithi103.stdout:7/934: chown d4/d4a/f79 139073 1 2024-09-17T01:07:30.751 INFO:tasks.workunit.client.0.smithi103.stdout:7/935: mknod d4/d10/d37/d95/c147 0 2024-09-17T01:07:30.754 INFO:tasks.workunit.client.0.smithi103.stdout:7/936: read d4/d10/d6b/dc5/d36/d145/f8f [4189588,126621] 0 2024-09-17T01:07:30.758 INFO:tasks.workunit.client.0.smithi103.stdout:6/848: dread d3/d16/fbc [0,4194304] 0 2024-09-17T01:07:30.765 INFO:tasks.workunit.client.0.smithi103.stdout:7/937: creat d4/d4a/d4b/d8a/dff/db8/f148 x:0 0 0 2024-09-17T01:07:30.771 INFO:tasks.workunit.client.0.smithi103.stdout:6/849: unlink d3/d16/d33/d57/d63/d60/db5/d118/dc1/d102/c117 0 2024-09-17T01:07:30.775 INFO:tasks.workunit.client.0.smithi103.stdout:7/938: creat d4/d10/d43/dc8/f149 x:0 0 0 2024-09-17T01:07:30.775 INFO:tasks.workunit.client.0.smithi103.stdout:1/947: write d2/d1c/f1e [6930677,68941] 0 2024-09-17T01:07:30.779 INFO:tasks.workunit.client.0.smithi103.stdout:6/850: fdatasync d3/d16/d33/d57/fbe 0 2024-09-17T01:07:30.788 INFO:tasks.workunit.client.0.smithi103.stdout:6/851: fdatasync d3/d25/d26/fc6 0 2024-09-17T01:07:30.793 INFO:tasks.workunit.client.0.smithi103.stdout:1/948: dwrite d2/d1c/d28/d52/d69/f6c [0,4194304] 0 2024-09-17T01:07:30.794 INFO:tasks.workunit.client.0.smithi103.stdout:7/939: rename d4/d4a/c99 to d4/c14a 0 2024-09-17T01:07:30.797 INFO:tasks.workunit.client.0.smithi103.stdout:6/852: write d3/d16/d33/d57/d63/d60/db5/d118/f7e [258237,553] 0 2024-09-17T01:07:30.800 INFO:tasks.workunit.client.0.smithi103.stdout:1/949: fdatasync d2/d1c/d20/fc8 0 2024-09-17T01:07:30.801 INFO:tasks.workunit.client.0.smithi103.stdout:7/940: rename d4/l22 to d4/d10/d6b/d9f/l14b 0 2024-09-17T01:07:30.892 INFO:tasks.workunit.client.0.smithi103.stdout:1/950: fdatasync d2/d1c/d20/d6d/d8d/d94/fa8 0 2024-09-17T01:07:30.892 INFO:tasks.workunit.client.0.smithi103.stdout:7/941: rename d4/d4a/d4b/d8a/dff/db8/d10a/ca2 to d4/d10/d43/dc8/d12b/c14c 0 2024-09-17T01:07:30.952 INFO:tasks.workunit.client.0.smithi103.stdout:1/951: fsync d2/de/fdc 0 2024-09-17T01:07:30.954 INFO:tasks.workunit.client.0.smithi103.stdout:1/952: read d2/d16/d51/d65/da7/f10a [36786,13055] 0 2024-09-17T01:07:30.954 INFO:tasks.workunit.client.0.smithi103.stdout:6/853: link d3/d16/d33/d3e/d58/lb3 d3/d16/d33/d3e/d4b/l11b 0 2024-09-17T01:07:30.956 INFO:tasks.workunit.client.0.smithi103.stdout:7/942: mkdir d4/d4a/d4b/d8a/dff/db8/d110/d14d 0 2024-09-17T01:07:30.959 INFO:tasks.workunit.client.0.smithi103.stdout:1/953: symlink d2/de/l13c 0 2024-09-17T01:07:30.960 INFO:tasks.workunit.client.0.smithi103.stdout:6/854: symlink d3/d16/d33/d3e/d4b/l11c 0 2024-09-17T01:07:30.964 INFO:tasks.workunit.client.0.smithi103.stdout:6/855: mknod d3/d16/c11d 0 2024-09-17T01:07:30.965 INFO:tasks.workunit.client.0.smithi103.stdout:6/856: readlink d3/d16/d33/d3e/d4b/lf7 0 2024-09-17T01:07:30.966 INFO:tasks.workunit.client.0.smithi103.stdout:7/943: rename d4/d11/d34/ff6 to d4/d10/d6b/dc5/d36/f14e 0 2024-09-17T01:07:30.973 INFO:tasks.workunit.client.0.smithi103.stdout:7/944: link d4/d10/d43/dc8/lb7 d4/d10/d6b/dc5/d8d/d92/db3/dd0/l14f 0 2024-09-17T01:07:30.973 INFO:tasks.workunit.client.0.smithi103.stdout:1/954: dread d2/d1c/d20/d6d/d8d/fd4 [0,4194304] 0 2024-09-17T01:07:30.975 INFO:tasks.workunit.client.0.smithi103.stdout:1/955: creat d2/d1c/d28/d52/ddb/f13d x:0 0 0 2024-09-17T01:07:30.976 INFO:tasks.workunit.client.0.smithi103.stdout:7/945: rmdir d4/d4a/d4b/d8a/dff/db8/d10a/d100 39 2024-09-17T01:07:30.979 INFO:tasks.workunit.client.0.smithi103.stdout:7/946: fdatasync d4/d4a/d4b/d9d/f140 0 2024-09-17T01:07:30.981 INFO:tasks.workunit.client.0.smithi103.stdout:7/947: write d4/d10/f94 [1266837,103772] 0 2024-09-17T01:07:30.983 INFO:tasks.workunit.client.0.smithi103.stdout:1/956: write d2/de/fdc [878416,31193] 0 2024-09-17T01:07:30.986 INFO:tasks.workunit.client.0.smithi103.stdout:1/957: symlink d2/d16/d51/d65/d7f/l13e 0 2024-09-17T01:07:30.989 INFO:tasks.workunit.client.0.smithi103.stdout:6/857: write d3/d16/d33/d3e/d58/fd9 [672048,67189] 0 2024-09-17T01:07:30.992 INFO:tasks.workunit.client.0.smithi103.stdout:6/858: truncate d3/d16/d33/f8d 496960 0 2024-09-17T01:07:30.994 INFO:tasks.workunit.client.0.smithi103.stdout:6/859: chown d3/d16/d33/d57/d63/d60/fd4 2246128 1 2024-09-17T01:07:30.997 INFO:tasks.workunit.client.0.smithi103.stdout:7/948: dwrite d4/d10/f25 [0,4194304] 0 2024-09-17T01:07:31.000 INFO:tasks.workunit.client.0.smithi103.stdout:7/949: rmdir d4/d10/d43/dc8 39 2024-09-17T01:07:31.005 INFO:tasks.workunit.client.0.smithi103.stdout:6/860: link d3/d16/df5/f116 d3/d16/d21/d56/d9a/f11e 0 2024-09-17T01:07:31.007 INFO:tasks.workunit.client.0.smithi103.stdout:7/950: creat d4/d4a/d4b/d8a/dff/db8/d10a/d8c/f150 x:0 0 0 2024-09-17T01:07:31.015 INFO:tasks.workunit.client.0.smithi103.stdout:6/861: creat d3/d16/f11f x:0 0 0 2024-09-17T01:07:31.022 INFO:tasks.workunit.client.0.smithi103.stdout:7/951: dwrite d4/d10/d6b/fcc [0,4194304] 0 2024-09-17T01:07:31.027 INFO:tasks.workunit.client.0.smithi103.stdout:6/862: dwrite d3/f36 [4194304,4194304] 0 2024-09-17T01:07:31.029 INFO:tasks.workunit.client.0.smithi103.stdout:7/952: write d4/d10/d37/d95/ffe [183945,45085] 0 2024-09-17T01:07:31.031 INFO:tasks.workunit.client.0.smithi103.stdout:6/863: mkdir d3/d16/d33/d57/d63/d60/da4/d120 0 2024-09-17T01:07:31.031 INFO:tasks.workunit.client.0.smithi103.stdout:6/864: dread - d3/d16/d33/d3e/fdb zero size 2024-09-17T01:07:31.033 INFO:tasks.workunit.client.0.smithi103.stdout:7/953: stat d4/d10/d43/dc8/l11b 0 2024-09-17T01:07:31.035 INFO:tasks.workunit.client.0.smithi103.stdout:6/865: symlink d3/d25/d26/d87/l121 0 2024-09-17T01:07:31.035 INFO:tasks.workunit.client.0.smithi103.stdout:7/954: chown d4/d11/d34/db5/l9c 1269153 1 2024-09-17T01:07:31.037 INFO:tasks.workunit.client.0.smithi103.stdout:6/866: symlink d3/d16/d33/d3e/l122 0 2024-09-17T01:07:31.038 INFO:tasks.workunit.client.0.smithi103.stdout:6/867: stat d3/d25/d26 0 2024-09-17T01:07:31.038 INFO:tasks.workunit.client.0.smithi103.stdout:7/955: creat d4/d4a/d4b/d8a/dff/db8/d110/f151 x:0 0 0 2024-09-17T01:07:31.042 INFO:tasks.workunit.client.0.smithi103.stdout:7/956: creat d4/d4a/d4b/d8a/f152 x:0 0 0 2024-09-17T01:07:31.044 INFO:tasks.workunit.client.0.smithi103.stdout:7/957: fsync d4/d11/f5f 0 2024-09-17T01:07:31.047 INFO:tasks.workunit.client.0.smithi103.stdout:7/958: mknod d4/d11/d34/c153 0 2024-09-17T01:07:31.051 INFO:tasks.workunit.client.0.smithi103.stdout:6/868: write d3/d16/d33/d57/d63/d60/da4/f108 [964306,40077] 0 2024-09-17T01:07:31.053 INFO:tasks.workunit.client.0.smithi103.stdout:7/959: mkdir d4/d10/d6b/dc5/d36/d3a/d51/d5e/dfd/d154 0 2024-09-17T01:07:31.053 INFO:tasks.workunit.client.0.smithi103.stdout:6/869: readlink d3/d16/d33/d3e/d4b/l11c 0 2024-09-17T01:07:31.056 INFO:tasks.workunit.client.0.smithi103.stdout:6/870: symlink d3/d16/d33/d57/d63/d60/de7/l123 0 2024-09-17T01:07:31.061 INFO:tasks.workunit.client.0.smithi103.stdout:6/871: symlink d3/d16/d33/d3e/l124 0 2024-09-17T01:07:31.062 INFO:tasks.workunit.client.0.smithi103.stdout:7/960: write d4/d10/d6b/dc5/fbb [1039474,32165] 0 2024-09-17T01:07:31.063 INFO:tasks.workunit.client.0.smithi103.stdout:6/872: chown d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4/l96 17515160 1 2024-09-17T01:07:31.064 INFO:tasks.workunit.client.0.smithi103.stdout:7/961: mknod d4/d10/d37/d95/c155 0 2024-09-17T01:07:31.076 INFO:tasks.workunit.client.0.smithi103.stdout:6/873: dwrite d3/d25/dae/fea [0,4194304] 0 2024-09-17T01:07:31.077 INFO:tasks.workunit.client.0.smithi103.stdout:7/962: dread d4/d11/d34/f49 [0,4194304] 0 2024-09-17T01:07:31.077 INFO:tasks.workunit.client.0.smithi103.stdout:6/874: chown d3/d16/d21/d56/d9a 3584 1 2024-09-17T01:07:31.082 INFO:tasks.workunit.client.0.smithi103.stdout:7/963: getdents d4/d10/d6b/dc5/d8d 0 2024-09-17T01:07:31.087 INFO:tasks.workunit.client.0.smithi103.stdout:7/964: rename d4/d10/d6b/dc5/d36/d3a/d51/d5e/c86 to d4/d4a/d4b/d8a/dff/db8/d10a/db1/c156 0 2024-09-17T01:07:31.089 INFO:tasks.workunit.client.0.smithi103.stdout:6/875: truncate d3/f11 2202466 0 2024-09-17T01:07:31.094 INFO:tasks.workunit.client.0.smithi103.stdout:7/965: getdents d4/d10/d6b/dc5/d36/d145 0 2024-09-17T01:07:31.098 INFO:tasks.workunit.client.0.smithi103.stdout:7/966: symlink d4/d11/d3f/l157 0 2024-09-17T01:07:31.100 INFO:tasks.workunit.client.0.smithi103.stdout:6/876: write d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4/f45 [1900777,42197] 0 2024-09-17T01:07:31.103 INFO:tasks.workunit.client.0.smithi103.stdout:7/967: link d4/d10/d66/fd1 d4/d10/d66/dd2/d144/f158 0 2024-09-17T01:07:31.112 INFO:tasks.workunit.client.0.smithi103.stdout:7/968: write d4/d4a/d4b/d8a/fa3 [753648,42178] 0 2024-09-17T01:07:31.116 INFO:tasks.workunit.client.0.smithi103.stdout:7/969: symlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/dfd/d154/l159 0 2024-09-17T01:07:31.116 INFO:tasks.workunit.client.0.smithi103.stdout:7/970: chown d4/d10/d37/d95/c117 1 1 2024-09-17T01:07:31.118 INFO:tasks.workunit.client.0.smithi103.stdout:7/971: write d4/d10/d66/dd2/de7/f10b [993054,62344] 0 2024-09-17T01:07:31.124 INFO:tasks.workunit.client.0.smithi103.stdout:7/972: dwrite d4/d10/d6b/dc5/fbb [0,4194304] 0 2024-09-17T01:07:31.130 INFO:tasks.workunit.client.0.smithi103.stdout:7/973: creat d4/d4a/d4b/d8a/dff/db8/d10a/f15a x:0 0 0 2024-09-17T01:07:31.136 INFO:tasks.workunit.client.0.smithi103.stdout:9/890: sync 2024-09-17T01:07:31.148 INFO:tasks.workunit.client.0.smithi103.stdout:9/891: dread d7/f55 [0,4194304] 0 2024-09-17T01:07:31.148 INFO:tasks.workunit.client.0.smithi103.stdout:7/974: dread d4/d4a/d4b/fe2 [0,4194304] 0 2024-09-17T01:07:31.149 INFO:tasks.workunit.client.0.smithi103.stdout:9/892: write d7/d43/d5f/fe3 [421328,128649] 0 2024-09-17T01:07:31.152 INFO:tasks.workunit.client.0.smithi103.stdout:7/975: mknod d4/c15b 0 2024-09-17T01:07:31.152 INFO:tasks.workunit.client.0.smithi103.stdout:9/893: dread d7/d43/d88/d11/d5c/ff6 [0,4194304] 0 2024-09-17T01:07:31.153 INFO:tasks.workunit.client.0.smithi103.stdout:9/894: dread - d7/d43/d88/d11/d5c/d8d/dac/dae/f105 zero size 2024-09-17T01:07:31.158 INFO:tasks.workunit.client.0.smithi103.stdout:9/895: truncate d7/d43/d88/d11/d20/f44 8540466 0 2024-09-17T01:07:31.158 INFO:tasks.workunit.client.0.smithi103.stdout:7/976: dwrite d4/d10/d6b/dc5/d36/d3a/f4c [4194304,4194304] 0 2024-09-17T01:07:31.161 INFO:tasks.workunit.client.0.smithi103.stdout:9/896: symlink d7/d2d/d59/l128 0 2024-09-17T01:07:31.162 INFO:tasks.workunit.client.0.smithi103.stdout:9/897: chown d7/d43/d88/d11/d20/d4f/d95/ffd 58877 1 2024-09-17T01:07:31.175 INFO:tasks.workunit.client.0.smithi103.stdout:7/977: write d4/d11/f7f [980272,60252] 0 2024-09-17T01:07:31.180 INFO:tasks.workunit.client.0.smithi103.stdout:7/978: unlink d4/c30 0 2024-09-17T01:07:31.182 INFO:tasks.workunit.client.0.smithi103.stdout:7/979: write d4/d10/d4e/f69 [2083355,2539] 0 2024-09-17T01:07:31.182 INFO:tasks.workunit.client.0.smithi103.stdout:9/898: dwrite d7/db8/dbb/f74 [0,4194304] 0 2024-09-17T01:07:31.187 INFO:tasks.workunit.client.0.smithi103.stdout:7/980: creat d4/d10/d6b/dc5/d36/d3a/d51/d111/f15c x:0 0 0 2024-09-17T01:07:31.189 INFO:tasks.workunit.client.0.smithi103.stdout:7/981: readlink d4/d4a/d4b/d8a/dff/l120 0 2024-09-17T01:07:31.190 INFO:tasks.workunit.client.0.smithi103.stdout:7/982: chown d4/d10/d43/c13e 32006 1 2024-09-17T01:07:31.192 INFO:tasks.workunit.client.0.smithi103.stdout:7/983: dread - d4/d10/d6b/dc5/d36/d3a/d51/d111/f15c zero size 2024-09-17T01:07:31.193 INFO:tasks.workunit.client.0.smithi103.stdout:7/984: write d4/d10/d6b/d9f/f125 [709801,106520] 0 2024-09-17T01:07:31.198 INFO:tasks.workunit.client.0.smithi103.stdout:9/899: write d7/f53 [6496435,40948] 0 2024-09-17T01:07:31.199 INFO:tasks.workunit.client.0.smithi103.stdout:7/985: truncate d4/d11/f18 1581570 0 2024-09-17T01:07:31.202 INFO:tasks.workunit.client.0.smithi103.stdout:7/986: mkdir d4/d4a/d4b/d8a/dff/db8/d110/d15d 0 2024-09-17T01:07:31.206 INFO:tasks.workunit.client.0.smithi103.stdout:7/987: symlink d4/d10/d6b/dc5/d36/d3a/d51/d5e/dfd/d154/l15e 0 2024-09-17T01:07:31.210 INFO:tasks.workunit.client.0.smithi103.stdout:9/900: dwrite d7/d43/f52 [4194304,4194304] 0 2024-09-17T01:07:31.213 INFO:tasks.workunit.client.0.smithi103.stdout:9/901: mknod d7/d43/d88/d11/d5c/d5e/d6c/d6e/db6/c129 0 2024-09-17T01:07:31.215 INFO:tasks.workunit.client.0.smithi103.stdout:9/902: dread - d7/d43/d88/d11/d20/d4f/fa9 zero size 2024-09-17T01:07:31.219 INFO:tasks.workunit.client.0.smithi103.stdout:7/988: dwrite d4/ff8 [0,4194304] 0 2024-09-17T01:07:31.221 INFO:tasks.workunit.client.0.smithi103.stdout:9/903: creat d7/d43/d88/d11/d5c/d5e/f12a x:0 0 0 2024-09-17T01:07:31.227 INFO:tasks.workunit.client.0.smithi103.stdout:7/989: getdents d4/d10/d66/dd2 0 2024-09-17T01:07:31.229 INFO:tasks.workunit.client.0.smithi103.stdout:7/990: chown d4/d10/d37/l12a 6 1 2024-09-17T01:07:31.230 INFO:tasks.workunit.client.0.smithi103.stdout:9/904: dwrite d7/d43/dcf/fee [0,4194304] 0 2024-09-17T01:07:31.236 INFO:tasks.workunit.client.0.smithi103.stdout:9/905: creat d7/db8/f12b x:0 0 0 2024-09-17T01:07:31.241 INFO:tasks.workunit.client.0.smithi103.stdout:9/906: truncate d7/d43/d88/d11/d20/dbc/fcb 881466 0 2024-09-17T01:07:31.243 INFO:tasks.workunit.client.0.smithi103.stdout:7/991: dwrite d4/d11/d3f/d63/f73 [0,4194304] 0 2024-09-17T01:07:31.245 INFO:tasks.workunit.client.0.smithi103.stdout:7/992: write d4/d10/d6b/dc5/d8d/f118 [413563,25016] 0 2024-09-17T01:07:31.248 INFO:tasks.workunit.client.0.smithi103.stdout:9/907: link d7/d43/d88/d11/f1f d7/d43/d88/d11/d20/d4f/d95/d9a/dc0/f12c 0 2024-09-17T01:07:31.269 INFO:tasks.workunit.client.0.smithi103.stdout:7/993: dread d4/d10/d32/faf [0,4194304] 0 2024-09-17T01:07:31.281 INFO:tasks.workunit.client.0.smithi103.stdout:7/994: dwrite d4/d10/d6b/dc5/fae [0,4194304] 0 2024-09-17T01:07:31.281 INFO:tasks.workunit.client.0.smithi103.stdout:7/995: truncate d4/d10/d43/f71 5215047 0 2024-09-17T01:07:31.287 INFO:tasks.workunit.client.0.smithi103.stdout:7/996: dwrite d4/d10/d6b/dc5/fbb [0,4194304] 0 2024-09-17T01:07:31.313 INFO:tasks.workunit.client.0.smithi103.stdout:7/997: dread d4/d4a/f67 [0,4194304] 0 2024-09-17T01:07:31.316 INFO:tasks.workunit.client.0.smithi103.stdout:7/998: truncate d4/d10/d6b/dc5/d8d/f118 519893 0 2024-09-17T01:07:31.322 INFO:tasks.workunit.client.0.smithi103.stdout:7/999: creat d4/d10/d6b/dc5/d36/d3a/d51/f15f x:0 0 0 2024-09-17T01:07:31.393 INFO:tasks.workunit.client.0.smithi103.stdout:2/958: sync 2024-09-17T01:07:31.393 INFO:tasks.workunit.client.0.smithi103.stdout:4/924: sync 2024-09-17T01:07:31.393 INFO:tasks.workunit.client.0.smithi103.stdout:5/750: sync 2024-09-17T01:07:31.393 INFO:tasks.workunit.client.0.smithi103.stdout:8/641: sync 2024-09-17T01:07:31.394 INFO:tasks.workunit.client.0.smithi103.stdout:1/958: sync 2024-09-17T01:07:31.395 INFO:tasks.workunit.client.0.smithi103.stdout:1/959: fdatasync d2/d16/dbf/df8/f10c 0 2024-09-17T01:07:31.396 INFO:tasks.workunit.client.0.smithi103.stdout:5/751: write d6/d11/f2f [7468792,28913] 0 2024-09-17T01:07:31.397 INFO:tasks.workunit.client.0.smithi103.stdout:5/752: stat d6/d28/df4/l108 0 2024-09-17T01:07:31.399 INFO:tasks.workunit.client.0.smithi103.stdout:2/959: fdatasync d6/d5f/d26/d34/d80/fb2 0 2024-09-17T01:07:31.401 INFO:tasks.workunit.client.0.smithi103.stdout:8/642: chown d0/d6/dc/d30/d25/d64/d34/fa1 13490 1 2024-09-17T01:07:31.403 INFO:tasks.workunit.client.0.smithi103.stdout:4/925: truncate d9/d16/d70/dc0/fee 206034 0 2024-09-17T01:07:31.407 INFO:tasks.workunit.client.0.smithi103.stdout:5/753: creat d6/d2c/d32/f10f x:0 0 0 2024-09-17T01:07:31.408 INFO:tasks.workunit.client.0.smithi103.stdout:8/643: unlink d0/d6/dc/d30/d2d/c8b 0 2024-09-17T01:07:31.408 INFO:tasks.workunit.client.0.smithi103.stdout:8/644: readlink d0/d6/dc/d3d/l4a 0 2024-09-17T01:07:31.409 INFO:tasks.workunit.client.0.smithi103.stdout:4/926: symlink d9/d16/d23/d32/d61/l123 0 2024-09-17T01:07:31.411 INFO:tasks.workunit.client.0.smithi103.stdout:5/754: mknod d6/d11/d81/df8/c110 0 2024-09-17T01:07:31.411 INFO:tasks.workunit.client.0.smithi103.stdout:1/960: link d2/d16/l133 d2/d7/d4e/l13f 0 2024-09-17T01:07:31.413 INFO:tasks.workunit.client.0.smithi103.stdout:8/645: mknod d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90/cc5 0 2024-09-17T01:07:31.414 INFO:tasks.workunit.client.0.smithi103.stdout:4/927: mknod d9/d16/d36/d42/d84/c124 0 2024-09-17T01:07:31.416 INFO:tasks.workunit.client.0.smithi103.stdout:8/646: creat d0/d6/dc/d3d/d88/fc6 x:0 0 0 2024-09-17T01:07:31.422 INFO:tasks.workunit.client.0.smithi103.stdout:8/647: rename d0/d6/dc/d30/d86/f9b to d0/d80/fc7 0 2024-09-17T01:07:31.428 INFO:tasks.workunit.client.0.smithi103.stdout:8/648: symlink d0/d6/dc/d30/d25/d64/d59/lc8 0 2024-09-17T01:07:31.429 INFO:tasks.workunit.client.0.smithi103.stdout:8/649: dread - d0/d6/dc/d30/d86/fb9 zero size 2024-09-17T01:07:31.432 INFO:tasks.workunit.client.0.smithi103.stdout:8/650: creat d0/d6/dc/d3d/d6d/db8/fc9 x:0 0 0 2024-09-17T01:07:31.435 INFO:tasks.workunit.client.0.smithi103.stdout:8/651: symlink d0/d6/dc/d30/d25/d64/lca 0 2024-09-17T01:07:31.437 INFO:tasks.workunit.client.0.smithi103.stdout:1/961: write d2/d70/ff9 [1697618,118931] 0 2024-09-17T01:07:31.442 INFO:tasks.workunit.client.0.smithi103.stdout:5/755: dwrite d6/d11/f1d [0,4194304] 0 2024-09-17T01:07:31.442 INFO:tasks.workunit.client.0.smithi103.stdout:1/962: read - d2/d1c/d28/d4b/d67/d9e/fa1 zero size 2024-09-17T01:07:31.444 INFO:tasks.workunit.client.0.smithi103.stdout:8/652: symlink d0/d6/dc/d30/d25/d64/d34/d6e/d72/db6/lcb 0 2024-09-17T01:07:31.446 INFO:tasks.workunit.client.0.smithi103.stdout:1/963: truncate d2/fb 4238103 0 2024-09-17T01:07:31.447 INFO:tasks.workunit.client.0.smithi103.stdout:1/964: stat d2/de/d116 0 2024-09-17T01:07:31.448 INFO:tasks.workunit.client.0.smithi103.stdout:4/928: dwrite d9/f3a [0,4194304] 0 2024-09-17T01:07:31.451 INFO:tasks.workunit.client.0.smithi103.stdout:4/929: truncate d9/d16/d70/f116 791348 0 2024-09-17T01:07:31.454 INFO:tasks.workunit.client.0.smithi103.stdout:1/965: creat d2/d16/d51/d65/dff/f140 x:0 0 0 2024-09-17T01:07:31.455 INFO:tasks.workunit.client.0.smithi103.stdout:1/966: chown d2/d16/d51/d65/da7/fed 6859 1 2024-09-17T01:07:31.459 INFO:tasks.workunit.client.0.smithi103.stdout:4/930: dread d9/d16/d70/dc0/fee [0,4194304] 0 2024-09-17T01:07:31.459 INFO:tasks.workunit.client.0.smithi103.stdout:1/967: mkdir d2/d16/d51/d65/de0/d141 0 2024-09-17T01:07:31.464 INFO:tasks.workunit.client.0.smithi103.stdout:8/653: link d0/d6/dc/d30/d2d/c56 d0/d6/dc/d30/d2d/ccc 0 2024-09-17T01:07:31.468 INFO:tasks.workunit.client.0.smithi103.stdout:8/654: dread d0/f3e [0,4194304] 0 2024-09-17T01:07:31.469 INFO:tasks.workunit.client.0.smithi103.stdout:8/655: chown d0/d6/f89 828 1 2024-09-17T01:07:31.472 INFO:tasks.workunit.client.0.smithi103.stdout:8/656: mkdir d0/d6/dc/d30/d86/dcd 0 2024-09-17T01:07:31.472 INFO:tasks.workunit.client.0.smithi103.stdout:4/931: write d9/d16/d23/d52/d91/dd4/d55/f6b [706274,56790] 0 2024-09-17T01:07:31.474 INFO:tasks.workunit.client.0.smithi103.stdout:8/657: fsync d0/d6/dc/d30/d25/d64/d34/f47 0 2024-09-17T01:07:31.479 INFO:tasks.workunit.client.0.smithi103.stdout:4/932: rename d9/dc/d11b to d9/d16/d23/d52/d109/d10b/d125 0 2024-09-17T01:07:31.486 INFO:tasks.workunit.client.0.smithi103.stdout:8/658: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/fce x:0 0 0 2024-09-17T01:07:31.486 INFO:tasks.workunit.client.0.smithi103.stdout:1/968: dread d2/d1c/d28/d4b/d67/d9e/daf/fda [0,4194304] 0 2024-09-17T01:07:31.486 INFO:tasks.workunit.client.0.smithi103.stdout:8/659: write d0/d6/dc/d30/d86/fc4 [572384,35250] 0 2024-09-17T01:07:31.486 INFO:tasks.workunit.client.0.smithi103.stdout:4/933: mkdir d9/d16/d23/d32/d61/d126 0 2024-09-17T01:07:31.486 INFO:tasks.workunit.client.0.smithi103.stdout:8/660: write d0/d6/dc/d3d/d88/fc6 [414013,53883] 0 2024-09-17T01:07:31.486 INFO:tasks.workunit.client.0.smithi103.stdout:4/934: dread - d9/dc/df/f102 zero size 2024-09-17T01:07:31.489 INFO:tasks.workunit.client.0.smithi103.stdout:1/969: unlink d2/d16/fb0 0 2024-09-17T01:07:31.492 INFO:tasks.workunit.client.0.smithi103.stdout:1/970: chown d2/d1c/d20/d33/f11e 891295011 1 2024-09-17T01:07:31.494 INFO:tasks.workunit.client.0.smithi103.stdout:8/661: dwrite d0/d6/dc/d30/d25/d64/f46 [0,4194304] 0 2024-09-17T01:07:31.495 INFO:tasks.workunit.client.0.smithi103.stdout:4/935: dwrite d9/d16/d45/d76/fc1 [0,4194304] 0 2024-09-17T01:07:31.504 INFO:tasks.workunit.client.0.smithi103.stdout:1/971: rename d2/d1c/d28/d52/d69/f6c to d2/d1c/d28/d52/d69/f142 0 2024-09-17T01:07:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:31 smithi143 ceph-mon[35452]: pgmap v26: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 40 MiB/s rd, 101 MiB/s wr, 282 op/s 2024-09-17T01:07:31.508 INFO:tasks.workunit.client.0.smithi103.stdout:4/936: rename d9/d16/d36/d42/d84/de9 to d9/d16/d70/d127 0 2024-09-17T01:07:31.508 INFO:tasks.workunit.client.0.smithi103.stdout:1/972: creat d2/d7/d73/f143 x:0 0 0 2024-09-17T01:07:31.509 INFO:tasks.workunit.client.0.smithi103.stdout:4/937: dread d9/d16/d70/f116 [0,4194304] 0 2024-09-17T01:07:31.511 INFO:tasks.workunit.client.0.smithi103.stdout:1/973: mknod d2/c144 0 2024-09-17T01:07:31.511 INFO:tasks.workunit.client.0.smithi103.stdout:4/938: fsync d9/d16/d45/fe1 0 2024-09-17T01:07:31.515 INFO:tasks.workunit.client.0.smithi103.stdout:4/939: mknod d9/d16/d23/d52/d91/dd4/d55/c128 0 2024-09-17T01:07:31.516 INFO:tasks.workunit.client.0.smithi103.stdout:4/940: unlink d9/dc/df/lf1 0 2024-09-17T01:07:31.520 INFO:tasks.workunit.client.0.smithi103.stdout:4/941: dread d9/d16/d36/d42/d84/f111 [0,4194304] 0 2024-09-17T01:07:31.521 INFO:tasks.workunit.client.0.smithi103.stdout:4/942: chown d9/d16/d23/d90/faf 391 1 2024-09-17T01:07:31.523 INFO:tasks.workunit.client.0.smithi103.stdout:4/943: write d9/d16/d23/d32/d4c/fd2 [3702584,72535] 0 2024-09-17T01:07:31.584 INFO:tasks.workunit.client.0.smithi103.stdout:6/877: sync 2024-09-17T01:07:31.584 INFO:tasks.workunit.client.0.smithi103.stdout:9/908: sync 2024-09-17T01:07:31.584 INFO:tasks.workunit.client.0.smithi103.stdout:6/878: dread - d3/d25/d74/f115 zero size 2024-09-17T01:07:31.585 INFO:tasks.workunit.client.0.smithi103.stdout:9/909: dread - d7/d43/d5f/d7d/d80/fc1 zero size 2024-09-17T01:07:31.586 INFO:tasks.workunit.client.0.smithi103.stdout:9/910: mknod d7/db8/c12d 0 2024-09-17T01:07:31.589 INFO:tasks.workunit.client.0.smithi103.stdout:9/911: truncate d7/d43/d5f/d7d/d80/f10d 406689 0 2024-09-17T01:07:31.592 INFO:tasks.workunit.client.0.smithi103.stdout:6/879: dwrite d3/d16/d21/dab/f113 [0,4194304] 0 2024-09-17T01:07:31.598 INFO:tasks.workunit.client.0.smithi103.stdout:9/912: rename d7/db8/f12b to d7/d43/d88/d11/d5c/f12e 0 2024-09-17T01:07:31.600 INFO:tasks.workunit.client.0.smithi103.stdout:6/880: symlink d3/d16/d33/d57/d63/d60/db5/l125 0 2024-09-17T01:07:31.605 INFO:tasks.workunit.client.0.smithi103.stdout:6/881: link d3/d16/d33/d57/d63/d60/db5/d118/l8b d3/d16/d21/d56/d9a/d101/l126 0 2024-09-17T01:07:31.615 INFO:tasks.workunit.client.0.smithi103.stdout:8/662: dwrite d0/d6/dc/d3d/d6d/fa3 [0,4194304] 0 2024-09-17T01:07:31.618 INFO:tasks.workunit.client.0.smithi103.stdout:8/663: mknod d0/d6/dc/d3d/ccf 0 2024-09-17T01:07:31.623 INFO:tasks.workunit.client.0.smithi103.stdout:8/664: creat d0/d6/dc/d3d/d6d/fd0 x:0 0 0 2024-09-17T01:07:31.624 INFO:tasks.workunit.client.0.smithi103.stdout:1/974: fsync d2/d1c/d20/d33/f59 0 2024-09-17T01:07:31.625 INFO:tasks.workunit.client.0.smithi103.stdout:8/665: rmdir d0/d6/dc/d30/d25/d64 39 2024-09-17T01:07:31.627 INFO:tasks.workunit.client.0.smithi103.stdout:8/666: write d0/d6/dc/d3d/d6d/f76 [942683,108604] 0 2024-09-17T01:07:31.628 INFO:tasks.workunit.client.0.smithi103.stdout:4/944: write d9/d16/d36/d42/d84/f111 [1347349,13465] 0 2024-09-17T01:07:31.632 INFO:tasks.workunit.client.0.smithi103.stdout:4/945: creat d9/d16/d70/f129 x:0 0 0 2024-09-17T01:07:31.632 INFO:tasks.workunit.client.0.smithi103.stdout:9/913: write d7/d43/d88/d11/d5c/d8d/fb2 [150138,130128] 0 2024-09-17T01:07:31.633 INFO:tasks.workunit.client.0.smithi103.stdout:8/667: creat d0/d6/dc/d30/d25/d64/d59/fd1 x:0 0 0 2024-09-17T01:07:31.635 INFO:tasks.workunit.client.0.smithi103.stdout:9/914: chown d7/d43/d88/d11/d20/d4f/d95/d111/c11a 243375583 1 2024-09-17T01:07:31.635 INFO:tasks.workunit.client.0.smithi103.stdout:6/882: write d3/d16/d21/f39 [2383895,2094] 0 2024-09-17T01:07:31.636 INFO:tasks.workunit.client.0.smithi103.stdout:8/668: read d0/d6/dc/d30/d86/fc4 [155687,81117] 0 2024-09-17T01:07:31.641 INFO:tasks.workunit.client.0.smithi103.stdout:6/883: mknod d3/d16/d33/d57/d63/d60/db5/c127 0 2024-09-17T01:07:31.642 INFO:tasks.workunit.client.0.smithi103.stdout:8/669: symlink d0/d6/dc/d3d/d6d/db8/ld2 0 2024-09-17T01:07:31.643 INFO:tasks.workunit.client.0.smithi103.stdout:6/884: read d3/f18 [4074431,109981] 0 2024-09-17T01:07:31.645 INFO:tasks.workunit.client.0.smithi103.stdout:4/946: getdents d9/d16 0 2024-09-17T01:07:31.648 INFO:tasks.workunit.client.0.smithi103.stdout:6/885: rmdir d3/d25 39 2024-09-17T01:07:31.649 INFO:tasks.workunit.client.0.smithi103.stdout:6/886: read d3/d16/d33/f9f [504270,2842] 0 2024-09-17T01:07:31.654 INFO:tasks.workunit.client.0.smithi103.stdout:9/915: getdents d7/d43/d88/d11/d20/dbc 0 2024-09-17T01:07:31.656 INFO:tasks.workunit.client.0.smithi103.stdout:4/947: mkdir d9/d16/d45/d12a 0 2024-09-17T01:07:31.657 INFO:tasks.workunit.client.0.smithi103.stdout:8/670: creat d0/d6/fd3 x:0 0 0 2024-09-17T01:07:31.658 INFO:tasks.workunit.client.0.smithi103.stdout:9/916: mkdir d7/db4/d12f 0 2024-09-17T01:07:31.659 INFO:tasks.workunit.client.0.smithi103.stdout:6/887: read d3/d25/dae/fb6 [163479,53962] 0 2024-09-17T01:07:31.661 INFO:tasks.workunit.client.0.smithi103.stdout:4/948: chown d9/d16/d23/d32/d64/d85/ff4 882 1 2024-09-17T01:07:31.666 INFO:tasks.workunit.client.0.smithi103.stdout:9/917: write d7/d43/d88/d11/d20/d4f/f109 [223212,69916] 0 2024-09-17T01:07:31.668 INFO:tasks.workunit.client.0.smithi103.stdout:8/671: rename d0/d6/dc/d30/d25/ca8 to d0/d6/dc/d30/d25/d64/d34/d6e/d72/cd4 0 2024-09-17T01:07:31.669 INFO:tasks.workunit.client.0.smithi103.stdout:4/949: mknod d9/d16/d23/d32/d61/d126/c12b 0 2024-09-17T01:07:31.672 INFO:tasks.workunit.client.0.smithi103.stdout:9/918: link d7/d43/d88/d11/d5c/d8d/dac/dae/f106 d7/d43/d88/d11/d5c/d8d/dac/dae/f130 0 2024-09-17T01:07:31.673 INFO:tasks.workunit.client.0.smithi103.stdout:9/919: chown d7/d43/d79 2116648 1 2024-09-17T01:07:31.676 INFO:tasks.workunit.client.0.smithi103.stdout:8/672: write d0/f96 [233852,111599] 0 2024-09-17T01:07:31.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:31 smithi103 ceph-mon[28156]: pgmap v26: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 40 MiB/s rd, 101 MiB/s wr, 282 op/s 2024-09-17T01:07:31.677 INFO:tasks.workunit.client.0.smithi103.stdout:9/920: symlink d7/db4/d12f/l131 0 2024-09-17T01:07:31.677 INFO:tasks.workunit.client.0.smithi103.stdout:4/950: getdents d9/d16/d23/d32/d61/d126 0 2024-09-17T01:07:31.680 INFO:tasks.workunit.client.0.smithi103.stdout:9/921: fdatasync d7/d43/d88/d11/d5c/d5e/d6c/d6e/fd2 0 2024-09-17T01:07:31.682 INFO:tasks.workunit.client.0.smithi103.stdout:4/951: rmdir d9/d16/d36 39 2024-09-17T01:07:31.682 INFO:tasks.workunit.client.0.smithi103.stdout:6/888: dwrite d3/d16/d33/d57/d63/f73 [0,4194304] 0 2024-09-17T01:07:31.684 INFO:tasks.workunit.client.0.smithi103.stdout:6/889: stat d3/d16/d33/d57/d63/d60/db5/d118/f34 0 2024-09-17T01:07:31.687 INFO:tasks.workunit.client.0.smithi103.stdout:9/922: symlink d7/d43/d88/d11/d20/d4f/d95/d9a/de5/l132 0 2024-09-17T01:07:31.687 INFO:tasks.workunit.client.0.smithi103.stdout:9/923: chown d7/f87 14058209 1 2024-09-17T01:07:31.692 INFO:tasks.workunit.client.0.smithi103.stdout:4/952: mknod d9/d16/d23/d32/d64/c12c 0 2024-09-17T01:07:31.695 INFO:tasks.workunit.client.0.smithi103.stdout:9/924: dwrite d7/d43/d88/d11/d5c/f61 [4194304,4194304] 0 2024-09-17T01:07:31.698 INFO:tasks.workunit.client.0.smithi103.stdout:4/953: symlink d9/d16/d36/l12d 0 2024-09-17T01:07:31.698 INFO:tasks.workunit.client.0.smithi103.stdout:8/673: dread d0/f4c [0,4194304] 0 2024-09-17T01:07:31.698 INFO:tasks.workunit.client.0.smithi103.stdout:4/954: stat d9/d16/d23/d52/d91/dd4/f4a 0 2024-09-17T01:07:31.699 INFO:tasks.workunit.client.0.smithi103.stdout:9/925: creat d7/db8/dbb/f133 x:0 0 0 2024-09-17T01:07:31.700 INFO:tasks.workunit.client.0.smithi103.stdout:8/674: creat d0/d6/dc/d3d/fd5 x:0 0 0 2024-09-17T01:07:31.702 INFO:tasks.workunit.client.0.smithi103.stdout:9/926: symlink d7/d43/dcf/l134 0 2024-09-17T01:07:31.703 INFO:tasks.workunit.client.0.smithi103.stdout:4/955: creat d9/d16/d70/d127/f12e x:0 0 0 2024-09-17T01:07:31.704 INFO:tasks.workunit.client.0.smithi103.stdout:8/675: mkdir d0/d6/dc/d30/d25/d7d/dd6 0 2024-09-17T01:07:31.707 INFO:tasks.workunit.client.0.smithi103.stdout:9/927: creat d7/d43/d88/d11/d20/f135 x:0 0 0 2024-09-17T01:07:31.708 INFO:tasks.workunit.client.0.smithi103.stdout:4/956: creat d9/d16/d23/d52/d109/d10b/d125/f12f x:0 0 0 2024-09-17T01:07:31.710 INFO:tasks.workunit.client.0.smithi103.stdout:9/928: creat d7/d2d/f136 x:0 0 0 2024-09-17T01:07:31.714 INFO:tasks.workunit.client.0.smithi103.stdout:9/929: creat d7/d43/d88/d11/d20/dbc/f137 x:0 0 0 2024-09-17T01:07:31.715 INFO:tasks.workunit.client.0.smithi103.stdout:9/930: truncate d7/d43/d88/d11/d20/f135 303370 0 2024-09-17T01:07:31.717 INFO:tasks.workunit.client.0.smithi103.stdout:6/890: dread d3/d16/d33/d57/d63/d60/db5/d118/f79 [4194304,4194304] 0 2024-09-17T01:07:31.719 INFO:tasks.workunit.client.0.smithi103.stdout:6/891: readlink d3/d16/d33/d57/d63/d60/db5/leb 0 2024-09-17T01:07:31.724 INFO:tasks.workunit.client.0.smithi103.stdout:4/957: dread d9/dc/f9a [0,4194304] 0 2024-09-17T01:07:31.724 INFO:tasks.workunit.client.0.smithi103.stdout:6/892: link d3/l72 d3/d16/d33/d57/d63/d60/db5/l128 0 2024-09-17T01:07:31.725 INFO:tasks.workunit.client.0.smithi103.stdout:4/958: fdatasync d9/d16/d70/d127/f12e 0 2024-09-17T01:07:31.730 INFO:tasks.workunit.client.0.smithi103.stdout:4/959: creat d9/d16/d36/f130 x:0 0 0 2024-09-17T01:07:31.731 INFO:tasks.workunit.client.0.smithi103.stdout:9/931: dread d7/d43/d88/d11/d20/d8e/fb0 [0,4194304] 0 2024-09-17T01:07:31.735 INFO:tasks.workunit.client.0.smithi103.stdout:4/960: creat d9/dc/df/f131 x:0 0 0 2024-09-17T01:07:31.738 INFO:tasks.workunit.client.0.smithi103.stdout:9/932: symlink d7/d43/d88/d11/d5c/d8d/dac/dc2/df5/l138 0 2024-09-17T01:07:31.741 INFO:tasks.workunit.client.0.smithi103.stdout:4/961: mknod d9/d16/d23/d2a/c132 0 2024-09-17T01:07:31.742 INFO:tasks.workunit.client.0.smithi103.stdout:4/962: chown d9/d16/d23/d32/d61/d47/f121 922 1 2024-09-17T01:07:31.745 INFO:tasks.workunit.client.0.smithi103.stdout:9/933: mknod d7/d43/d88/d11/c139 0 2024-09-17T01:07:31.747 INFO:tasks.workunit.client.0.smithi103.stdout:4/963: mknod d9/d16/d23/d32/d61/d47/c133 0 2024-09-17T01:07:31.748 INFO:tasks.workunit.client.0.smithi103.stdout:9/934: write d7/d43/d88/d11/d5c/d8d/dac/dc2/ffb [675062,72710] 0 2024-09-17T01:07:31.749 INFO:tasks.workunit.client.0.smithi103.stdout:9/935: chown d7/d43/d88/d11/d20/f44 253551 1 2024-09-17T01:07:31.753 INFO:tasks.workunit.client.0.smithi103.stdout:4/964: truncate d9/d16/d45/fe1 535334 0 2024-09-17T01:07:31.760 INFO:tasks.workunit.client.0.smithi103.stdout:9/936: link d7/db8/dbb/f26 d7/d43/d88/d11/d20/d4f/df7/f13a 0 2024-09-17T01:07:31.762 INFO:tasks.workunit.client.0.smithi103.stdout:9/937: fdatasync d7/d43/d88/d11/d5c/d5e/d6c/d6e/db1/fd6 0 2024-09-17T01:07:31.763 INFO:tasks.workunit.client.0.smithi103.stdout:6/893: dwrite d3/d16/d21/d56/f97 [4194304,4194304] 0 2024-09-17T01:07:31.765 INFO:tasks.workunit.client.0.smithi103.stdout:9/938: truncate d7/d43/d88/d11/d20/dbc/ff0 1649906 0 2024-09-17T01:07:31.773 INFO:tasks.workunit.client.0.smithi103.stdout:9/939: dwrite d7/d43/d88/d11/d5c/d8d/f125 [0,4194304] 0 2024-09-17T01:07:31.774 INFO:tasks.workunit.client.0.smithi103.stdout:9/940: stat d7/d43/d88/d11/d5c/d8d/dac/dfe 0 2024-09-17T01:07:31.777 INFO:tasks.workunit.client.0.smithi103.stdout:6/894: getdents d3/d16/de1/d100 0 2024-09-17T01:07:31.779 INFO:tasks.workunit.client.0.smithi103.stdout:9/941: truncate d7/f55 133386 0 2024-09-17T01:07:31.785 INFO:tasks.workunit.client.0.smithi103.stdout:9/942: symlink d7/d43/d88/d11/d5c/d8d/l13b 0 2024-09-17T01:07:31.789 INFO:tasks.workunit.client.0.smithi103.stdout:6/895: write d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4/f6b [2747177,83479] 0 2024-09-17T01:07:31.793 INFO:tasks.workunit.client.0.smithi103.stdout:6/896: mknod d3/d16/d21/c129 0 2024-09-17T01:07:31.795 INFO:tasks.workunit.client.0.smithi103.stdout:6/897: chown d3/d16/d21/d56/f97 605729 1 2024-09-17T01:07:31.796 INFO:tasks.workunit.client.0.smithi103.stdout:9/943: dwrite d7/d43/d88/d11/d5c/d5e/d6c/d6e/f86 [0,4194304] 0 2024-09-17T01:07:31.799 INFO:tasks.workunit.client.0.smithi103.stdout:6/898: fdatasync d3/d16/dad/fe0 0 2024-09-17T01:07:31.809 INFO:tasks.workunit.client.0.smithi103.stdout:9/944: write d7/d43/d88/d11/d20/d4f/d95/fe2 [691552,59328] 0 2024-09-17T01:07:31.811 INFO:tasks.workunit.client.0.smithi103.stdout:6/899: creat d3/d16/dad/d105/f12a x:0 0 0 2024-09-17T01:07:31.813 INFO:tasks.workunit.client.0.smithi103.stdout:9/945: mknod d7/d43/d88/d11/c13c 0 2024-09-17T01:07:31.819 INFO:tasks.workunit.client.0.smithi103.stdout:6/900: symlink d3/d16/d33/d57/d63/d60/da4/d10f/l12b 0 2024-09-17T01:07:31.820 INFO:tasks.workunit.client.0.smithi103.stdout:9/946: dwrite d7/d43/d88/d11/d20/f44 [4194304,4194304] 0 2024-09-17T01:07:31.823 INFO:tasks.workunit.client.0.smithi103.stdout:9/947: truncate d7/d43/d88/d11/d5c/d8d/dac/dae/f106 25960 0 2024-09-17T01:07:31.824 INFO:tasks.workunit.client.0.smithi103.stdout:6/901: rename d3/d16/d21/dab/fb4 to d3/d16/de1/f12c 0 2024-09-17T01:07:31.826 INFO:tasks.workunit.client.0.smithi103.stdout:6/902: truncate d3/d16/dad/f67 4822928 0 2024-09-17T01:07:31.828 INFO:tasks.workunit.client.0.smithi103.stdout:6/903: chown d3/d16/d33/l95 416199511 1 2024-09-17T01:07:31.829 INFO:tasks.workunit.client.0.smithi103.stdout:6/904: fsync d3/d16/d33/d57/d63/d60/fd4 0 2024-09-17T01:07:31.831 INFO:tasks.workunit.client.0.smithi103.stdout:9/948: dwrite d7/d43/f52 [4194304,4194304] 0 2024-09-17T01:07:31.832 INFO:tasks.workunit.client.0.smithi103.stdout:9/949: readlink d7/d43/d88/d11/d20/l40 0 2024-09-17T01:07:31.833 INFO:tasks.workunit.client.0.smithi103.stdout:9/950: readlink d7/d2d/d59/l113 0 2024-09-17T01:07:31.838 INFO:tasks.workunit.client.0.smithi103.stdout:9/951: mkdir d7/d43/d88/d11/d5c/d8d/dac/dae/d13d 0 2024-09-17T01:07:31.838 INFO:tasks.workunit.client.0.smithi103.stdout:9/952: chown d7/d43/d5f/fb7 44055 1 2024-09-17T01:07:31.849 INFO:tasks.workunit.client.0.smithi103.stdout:6/905: dwrite d3/d16/d33/f8d [0,4194304] 0 2024-09-17T01:07:31.852 INFO:tasks.workunit.client.0.smithi103.stdout:9/953: write d7/db4/ddc/f104 [1696978,8753] 0 2024-09-17T01:07:31.856 INFO:tasks.workunit.client.0.smithi103.stdout:9/954: read d7/d43/f52 [1073102,96152] 0 2024-09-17T01:07:31.859 INFO:tasks.workunit.client.0.smithi103.stdout:9/955: rmdir d7/d43/d88/d11/d20/d8e 39 2024-09-17T01:07:31.861 INFO:tasks.workunit.client.0.smithi103.stdout:9/956: mkdir d7/d43/d88/d11/d5c/d8d/d13e 0 2024-09-17T01:07:31.863 INFO:tasks.workunit.client.0.smithi103.stdout:9/957: creat d7/d43/d88/d11/d5c/d8d/f13f x:0 0 0 2024-09-17T01:07:31.864 INFO:tasks.workunit.client.0.smithi103.stdout:9/958: dread - d7/db8/dbb/f133 zero size 2024-09-17T01:07:31.864 INFO:tasks.workunit.client.0.smithi103.stdout:6/906: dread d3/d16/f2d [0,4194304] 0 2024-09-17T01:07:31.869 INFO:tasks.workunit.client.0.smithi103.stdout:6/907: mknod d3/d16/d33/d57/d63/d60/db5/c12d 0 2024-09-17T01:07:31.871 INFO:tasks.workunit.client.0.smithi103.stdout:9/959: rename d7/d43/d88/d11/d5c/d8d to d7/db4/ddc/d140 0 2024-09-17T01:07:31.872 INFO:tasks.workunit.client.0.smithi103.stdout:9/960: chown d7/d43/d88/d11/d20/d4f/f78 1131218 1 2024-09-17T01:07:31.877 INFO:tasks.workunit.client.0.smithi103.stdout:6/908: creat d3/d16/d33/d3e/f12e x:0 0 0 2024-09-17T01:07:31.878 INFO:tasks.workunit.client.0.smithi103.stdout:9/961: write d7/db8/fc4 [836007,125720] 0 2024-09-17T01:07:31.884 INFO:tasks.workunit.client.0.smithi103.stdout:9/962: mkdir d7/d43/d88/d11/d141 0 2024-09-17T01:07:31.891 INFO:tasks.workunit.client.0.smithi103.stdout:6/909: dwrite d3/d16/d33/d57/d63/d60/db5/d118/fa0 [0,4194304] 0 2024-09-17T01:07:31.904 INFO:tasks.workunit.client.0.smithi103.stdout:9/963: dwrite d7/d43/fc3 [0,4194304] 0 2024-09-17T01:07:31.936 INFO:tasks.workunit.client.0.smithi103.stdout:6/910: unlink d3/d16/d33/d3e/l89 0 2024-09-17T01:07:31.990 INFO:tasks.workunit.client.0.smithi103.stdout:5/756: sync 2024-09-17T01:07:31.990 INFO:tasks.workunit.client.0.smithi103.stdout:2/960: sync 2024-09-17T01:07:31.992 INFO:tasks.workunit.client.0.smithi103.stdout:2/961: unlink d6/da/f82 0 2024-09-17T01:07:31.993 INFO:tasks.workunit.client.0.smithi103.stdout:5/757: mkdir d6/d28/dcb/dc4/df3/d111 0 2024-09-17T01:07:31.994 INFO:tasks.workunit.client.0.smithi103.stdout:5/758: chown d6/d2c/d38/d4c/d50/f4f 7948779 1 2024-09-17T01:07:31.995 INFO:tasks.workunit.client.0.smithi103.stdout:2/962: symlink d6/da/d5d/d8d/d89/de8/l149 0 2024-09-17T01:07:32.014 INFO:tasks.workunit.client.0.smithi103.stdout:5/759: dwrite d6/db/d66/f67 [0,4194304] 0 2024-09-17T01:07:32.014 INFO:tasks.workunit.client.0.smithi103.stdout:2/963: dwrite d6/f44 [4194304,4194304] 0 2024-09-17T01:07:32.021 INFO:tasks.workunit.client.0.smithi103.stdout:5/760: rename d6/d2c/f5f to d6/d11/f112 0 2024-09-17T01:07:32.024 INFO:tasks.workunit.client.0.smithi103.stdout:5/761: read d6/d2c/d38/ff1 [472087,76957] 0 2024-09-17T01:07:32.025 INFO:tasks.workunit.client.0.smithi103.stdout:2/964: dwrite d6/da/d5d/f13b [0,4194304] 0 2024-09-17T01:07:32.026 INFO:tasks.workunit.client.0.smithi103.stdout:5/762: write d6/d28/dcb/fdd [657686,117468] 0 2024-09-17T01:07:32.027 INFO:tasks.workunit.client.0.smithi103.stdout:2/965: chown d6/d5f/d26/d66/c1d 507191 1 2024-09-17T01:07:32.028 INFO:tasks.workunit.client.0.smithi103.stdout:2/966: stat d6/da/d5d/d8d/d60/d75/d70/ff1 0 2024-09-17T01:07:32.031 INFO:tasks.workunit.client.0.smithi103.stdout:5/763: unlink f0 0 2024-09-17T01:07:32.037 INFO:tasks.workunit.client.0.smithi103.stdout:2/967: creat d6/da/d132/f14a x:0 0 0 2024-09-17T01:07:32.039 INFO:tasks.workunit.client.0.smithi103.stdout:5/764: dwrite d6/d28/dcb/fce [0,4194304] 0 2024-09-17T01:07:32.040 INFO:tasks.workunit.client.0.smithi103.stdout:2/968: chown d6/d5f/d26/d66/df/c130 2352483 1 2024-09-17T01:07:32.041 INFO:tasks.workunit.client.0.smithi103.stdout:5/765: chown d6/d11/d81/fac 307 1 2024-09-17T01:07:32.042 INFO:tasks.workunit.client.0.smithi103.stdout:2/969: chown d6/da/d5d/d8d/f53 0 1 2024-09-17T01:07:32.043 INFO:tasks.workunit.client.0.smithi103.stdout:5/766: chown d6/d2c/d38/d4c/l7f 15 1 2024-09-17T01:07:32.046 INFO:tasks.workunit.client.0.smithi103.stdout:5/767: creat d6/d11/d81/d10e/f113 x:0 0 0 2024-09-17T01:07:32.049 INFO:tasks.workunit.client.0.smithi103.stdout:2/970: getdents d6/da/d5d/d8d/d60/d75/d70/df6 0 2024-09-17T01:07:32.050 INFO:tasks.workunit.client.0.smithi103.stdout:2/971: fdatasync d6/fb 0 2024-09-17T01:07:32.064 INFO:tasks.workunit.client.0.smithi103.stdout:2/972: truncate d6/da/d5d/d8d/f71 145011 0 2024-09-17T01:07:32.065 INFO:tasks.workunit.client.0.smithi103.stdout:2/973: stat d6/d5f/d26/d66/df/d68/d7e/d8b 0 2024-09-17T01:07:32.069 INFO:tasks.workunit.client.0.smithi103.stdout:5/768: dread d6/d2c/f3d [0,4194304] 0 2024-09-17T01:07:32.069 INFO:tasks.workunit.client.0.smithi103.stdout:2/974: rename d6/da/d5d/d8d/d89/de8/d12a to d6/da/d5d/d8d/d89/de8/d12d/d14b 0 2024-09-17T01:07:32.070 INFO:tasks.workunit.client.0.smithi103.stdout:5/769: readlink d6/d2c/lb6 0 2024-09-17T01:07:32.071 INFO:tasks.workunit.client.0.smithi103.stdout:5/770: fsync d6/d2c/db3/f107 0 2024-09-17T01:07:32.072 INFO:tasks.workunit.client.0.smithi103.stdout:5/771: read d6/d28/f39 [7151094,113366] 0 2024-09-17T01:07:32.073 INFO:tasks.workunit.client.0.smithi103.stdout:2/975: creat d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/da1/df4/f14c x:0 0 0 2024-09-17T01:07:32.074 INFO:tasks.workunit.client.0.smithi103.stdout:5/772: read d6/d28/dcb/d93/fe8 [3068147,130031] 0 2024-09-17T01:07:32.089 INFO:tasks.workunit.client.0.smithi103.stdout:5/773: dread d6/d2c/d38/d4c/f8f [0,4194304] 0 2024-09-17T01:07:32.090 INFO:tasks.workunit.client.0.smithi103.stdout:5/774: fsync d6/d2c/fed 0 2024-09-17T01:07:32.091 INFO:tasks.workunit.client.0.smithi103.stdout:2/976: dwrite d6/d5f/d26/d66/df/f124 [0,4194304] 0 2024-09-17T01:07:32.093 INFO:tasks.workunit.client.0.smithi103.stdout:5/775: rmdir d6/d2c/d32/dd1/de1 39 2024-09-17T01:07:32.095 INFO:tasks.workunit.client.0.smithi103.stdout:2/977: truncate d6/d5f/f1e 1877150 0 2024-09-17T01:07:32.099 INFO:tasks.workunit.client.0.smithi103.stdout:2/978: unlink d6/da/d5d/d8d/d60/d75/l6c 0 2024-09-17T01:07:32.101 INFO:tasks.workunit.client.0.smithi103.stdout:5/776: truncate d6/d2c/d38/f6c 2420692 0 2024-09-17T01:07:32.101 INFO:tasks.workunit.client.0.smithi103.stdout:5/777: fsync d6/d11/f2f 0 2024-09-17T01:07:32.103 INFO:tasks.workunit.client.0.smithi103.stdout:5/778: mkdir d6/d2c/d38/d4c/d9a/d114 0 2024-09-17T01:07:32.106 INFO:tasks.workunit.client.0.smithi103.stdout:5/779: rmdir d6/d2c/d38/d4c/de5/dff 0 2024-09-17T01:07:32.117 INFO:tasks.workunit.client.0.smithi103.stdout:2/979: write d6/d5f/d26/d66/df/d68/d7e/d9c/d6f/f87 [5707538,75602] 0 2024-09-17T01:07:32.120 INFO:tasks.workunit.client.0.smithi103.stdout:5/780: write d6/d28/fb1 [981926,52946] 0 2024-09-17T01:07:32.121 INFO:tasks.workunit.client.0.smithi103.stdout:5/781: chown d6/d2c/d38/d4c/d9a 4092 1 2024-09-17T01:07:32.123 INFO:tasks.workunit.client.0.smithi103.stdout:2/980: rename d6/d5f/d26/d66/da8 to d6/da/d5d/d8d/d60/d75/d70/df6/d13a/d14d 0 2024-09-17T01:07:32.126 INFO:tasks.workunit.client.0.smithi103.stdout:2/981: mknod d6/d5f/d26/d66/df/db7/c14e 0 2024-09-17T01:07:32.128 INFO:tasks.workunit.client.0.smithi103.stdout:5/782: rename d6/d2c/d32/dd1 to d6/d2c/d38/db2/dba/d115 0 2024-09-17T01:07:32.130 INFO:tasks.workunit.client.0.smithi103.stdout:5/783: write d6/db/d66/f84 [3156646,95912] 0 2024-09-17T01:07:32.138 INFO:tasks.workunit.client.0.smithi103.stdout:5/784: dwrite d6/d2c/d38/d4c/d9a/f103 [0,4194304] 0 2024-09-17T01:07:32.144 INFO:tasks.workunit.client.0.smithi103.stdout:2/982: dwrite d6/da/d5d/d8d/f53 [0,4194304] 0 2024-09-17T01:07:32.149 INFO:tasks.workunit.client.0.smithi103.stdout:2/983: unlink d6/d5f/d26/d66/l11a 0 2024-09-17T01:07:32.165 INFO:tasks.workunit.client.0.smithi103.stdout:5/785: dread d6/d2c/db3/fbb [0,4194304] 0 2024-09-17T01:07:32.167 INFO:tasks.workunit.client.0.smithi103.stdout:5/786: fsync d6/d11/f1a 0 2024-09-17T01:07:32.172 INFO:tasks.workunit.client.0.smithi103.stdout:2/984: dwrite d6/da/d3f/fae [0,4194304] 0 2024-09-17T01:07:32.177 INFO:tasks.workunit.client.0.smithi103.stdout:5/787: getdents d6/d11/d81/da2 0 2024-09-17T01:07:32.180 INFO:tasks.workunit.client.0.smithi103.stdout:5/788: unlink d6/d11/d81/d10e/f113 0 2024-09-17T01:07:32.194 INFO:tasks.workunit.client.0.smithi103.stdout:2/985: dread d6/d5f/d26/d34/f73 [0,4194304] 0 2024-09-17T01:07:32.200 INFO:tasks.workunit.client.0.smithi103.stdout:5/789: dread d6/d2c/d32/d55/f6a [0,4194304] 0 2024-09-17T01:07:32.202 INFO:tasks.workunit.client.0.smithi103.stdout:2/986: getdents d6/d5f 0 2024-09-17T01:07:32.203 INFO:tasks.workunit.client.0.smithi103.stdout:5/790: creat d6/d2c/d38/d4c/de5/f116 x:0 0 0 2024-09-17T01:07:32.206 INFO:tasks.workunit.client.0.smithi103.stdout:5/791: symlink d6/d11/d81/df8/l117 0 2024-09-17T01:07:32.207 INFO:tasks.workunit.client.0.smithi103.stdout:5/792: fdatasync d6/d11/f1d 0 2024-09-17T01:07:32.208 INFO:tasks.workunit.client.0.smithi103.stdout:2/987: getdents d6/d5f/d26/d66 0 2024-09-17T01:07:32.209 INFO:tasks.workunit.client.0.smithi103.stdout:2/988: write d6/d5f/df5/f142 [7593,88105] 0 2024-09-17T01:07:32.214 INFO:tasks.workunit.client.0.smithi103.stdout:5/793: dwrite d6/d2c/d38/d4c/d50/fb8 [0,4194304] 0 2024-09-17T01:07:32.220 INFO:tasks.workunit.client.0.smithi103.stdout:2/989: dwrite d6/d5f/d26/d66/df/d58/f90 [0,4194304] 0 2024-09-17T01:07:32.222 INFO:tasks.workunit.client.0.smithi103.stdout:2/990: write d6/da/d28/dfe/f137 [289284,130777] 0 2024-09-17T01:07:32.226 INFO:tasks.workunit.client.0.smithi103.stdout:5/794: dwrite d6/d2c/f3d [4194304,4194304] 0 2024-09-17T01:07:32.237 INFO:tasks.workunit.client.0.smithi103.stdout:2/991: dread d6/da/d5d/ffd [0,4194304] 0 2024-09-17T01:07:32.252 INFO:tasks.workunit.client.0.smithi103.stdout:2/992: write d6/d5f/d26/d34/d80/fc6 [1483779,3686] 0 2024-09-17T01:07:32.255 INFO:tasks.workunit.client.0.smithi103.stdout:2/993: mkdir d6/d5f/d26/d66/df/ddd/d14f 0 2024-09-17T01:07:32.255 INFO:tasks.workunit.client.0.smithi103.stdout:5/795: dread d6/d11/d81/fac [0,4194304] 0 2024-09-17T01:07:32.264 INFO:tasks.workunit.client.0.smithi103.stdout:5/796: symlink d6/d28/dcb/dc4/df3/d111/l118 0 2024-09-17T01:07:32.265 INFO:tasks.workunit.client.0.smithi103.stdout:5/797: stat d6/d2c/dd7/def 0 2024-09-17T01:07:32.265 INFO:tasks.workunit.client.0.smithi103.stdout:2/994: getdents d6/da/d3f/d120 0 2024-09-17T01:07:32.266 INFO:tasks.workunit.client.0.smithi103.stdout:5/798: dread - d6/d2c/d38/d4c/de5/f116 zero size 2024-09-17T01:07:32.267 INFO:tasks.workunit.client.0.smithi103.stdout:5/799: write d6/d28/f96 [5169489,61457] 0 2024-09-17T01:07:32.268 INFO:tasks.workunit.client.0.smithi103.stdout:5/800: stat d6/d28/dcb/fdd 0 2024-09-17T01:07:32.270 INFO:tasks.workunit.client.0.smithi103.stdout:5/801: creat d6/d2c/db3/f119 x:0 0 0 2024-09-17T01:07:32.273 INFO:tasks.workunit.client.0.smithi103.stdout:5/802: mknod d6/d2c/d38/d4c/d9a/d114/c11a 0 2024-09-17T01:07:32.273 INFO:tasks.workunit.client.0.smithi103.stdout:5/803: fdatasync d6/d2c/dd7/ffd 0 2024-09-17T01:07:32.274 INFO:tasks.workunit.client.0.smithi103.stdout:5/804: stat d6/db/fd3 0 2024-09-17T01:07:32.276 INFO:tasks.workunit.client.0.smithi103.stdout:5/805: creat d6/d2c/d38/db2/f11b x:0 0 0 2024-09-17T01:07:32.278 INFO:tasks.workunit.client.0.smithi103.stdout:5/806: chown d6/d28/df4 3 1 2024-09-17T01:07:32.278 INFO:tasks.workunit.client.0.smithi103.stdout:2/995: write d6/d5f/d26/d6e/fb6 [2804433,58905] 0 2024-09-17T01:07:32.278 INFO:tasks.workunit.client.0.smithi103.stdout:2/996: fsync d6/da/d5d/d8d/d60/d75/d70/f136 0 2024-09-17T01:07:32.281 INFO:tasks.workunit.client.0.smithi103.stdout:5/807: truncate d6/d2c/d32/d55/f6a 512434 0 2024-09-17T01:07:32.282 INFO:tasks.workunit.client.0.smithi103.stdout:2/997: truncate d6/d5f/d26/d66/df/d68/d7e/faa 28781 0 2024-09-17T01:07:32.308 INFO:tasks.workunit.client.0.smithi103.stdout:2/998: dwrite d6/f52 [0,4194304] 0 2024-09-17T01:07:32.323 INFO:tasks.workunit.client.0.smithi103.stdout:2/999: getdents d6/d5f/d26/d66/df/d68/d7e/d8b 0 2024-09-17T01:07:32.364 INFO:tasks.workunit.client.0.smithi103.stdout:1/975: sync 2024-09-17T01:07:32.407 INFO:tasks.workunit.client.0.smithi103.stdout:1/976: write d2/d16/d51/d65/dff/d122/fc0 [3086471,5734] 0 2024-09-17T01:07:32.415 INFO:tasks.workunit.client.0.smithi103.stdout:1/977: dwrite d2/d70/ff9 [0,4194304] 0 2024-09-17T01:07:32.428 INFO:tasks.workunit.client.0.smithi103.stdout:1/978: dread d2/d16/d51/d65/dff/d122/f3b [0,4194304] 0 2024-09-17T01:07:32.432 INFO:tasks.workunit.client.0.smithi103.stdout:1/979: fdatasync d2/d1c/d28/d52/d69/ff1 0 2024-09-17T01:07:32.437 INFO:tasks.workunit.client.0.smithi103.stdout:1/980: readlink d2/d7/l23 0 2024-09-17T01:07:32.466 INFO:tasks.workunit.client.0.smithi103.stdout:8/676: sync 2024-09-17T01:07:32.467 INFO:tasks.workunit.client.0.smithi103.stdout:4/965: sync 2024-09-17T01:07:32.469 INFO:tasks.workunit.client.0.smithi103.stdout:4/966: chown d9/d16/d38/f75 3 1 2024-09-17T01:07:32.472 INFO:tasks.workunit.client.0.smithi103.stdout:4/967: truncate d9/d16/d36/d42/f9f 4811868 0 2024-09-17T01:07:32.476 INFO:tasks.workunit.client.0.smithi103.stdout:4/968: getdents d9/d10/de5 0 2024-09-17T01:07:32.491 INFO:tasks.workunit.client.0.smithi103.stdout:4/969: creat d9/d16/d23/f134 x:0 0 0 2024-09-17T01:07:32.493 INFO:tasks.workunit.client.0.smithi103.stdout:4/970: mknod d9/d16/d23/d52/d109/d10b/c135 0 2024-09-17T01:07:32.498 INFO:tasks.workunit.client.0.smithi103.stdout:4/971: getdents d9/d16/d36/d42 0 2024-09-17T01:07:32.498 INFO:tasks.workunit.client.0.smithi103.stdout:4/972: stat d9/d16/d23/d52/d91/dd4/d55/f60 0 2024-09-17T01:07:32.504 INFO:tasks.workunit.client.0.smithi103.stdout:1/981: symlink d2/d1c/d20/l145 0 2024-09-17T01:07:32.508 INFO:tasks.workunit.client.0.smithi103.stdout:1/982: chown d2/d7/l23 692 1 2024-09-17T01:07:32.509 INFO:tasks.workunit.client.0.smithi103.stdout:9/964: sync 2024-09-17T01:07:32.509 INFO:tasks.workunit.client.0.smithi103.stdout:6/911: sync 2024-09-17T01:07:32.509 INFO:tasks.workunit.client.0.smithi103.stdout:1/983: chown d2/d1c/d54 1436 1 2024-09-17T01:07:32.509 INFO:tasks.workunit.client.0.smithi103.stdout:6/912: dread - d3/d16/d33/d57/d63/f114 zero size 2024-09-17T01:07:32.510 INFO:tasks.workunit.client.0.smithi103.stdout:6/913: chown d3/f28 1922 1 2024-09-17T01:07:32.510 INFO:tasks.workunit.client.0.smithi103.stdout:1/984: mkdir d2/d1c/d54/d146 0 2024-09-17T01:07:32.510 INFO:tasks.workunit.client.0.smithi103.stdout:8/677: dwrite d0/d6/dc/d30/d25/d64/f4d [4194304,4194304] 0 2024-09-17T01:07:32.513 INFO:tasks.workunit.client.0.smithi103.stdout:9/965: mknod d7/db4/ddc/d140/dac/dc2/c142 0 2024-09-17T01:07:32.514 INFO:tasks.workunit.client.0.smithi103.stdout:6/914: fdatasync d3/d16/d33/d57/d63/d60/da4/f108 0 2024-09-17T01:07:32.514 INFO:tasks.workunit.client.0.smithi103.stdout:8/678: creat d0/d6/dc/d30/d25/d7d/d99/fd7 x:0 0 0 2024-09-17T01:07:32.516 INFO:tasks.workunit.client.0.smithi103.stdout:6/915: rmdir d3 39 2024-09-17T01:07:32.521 INFO:tasks.workunit.client.0.smithi103.stdout:4/973: dwrite d9/d16/f1e [0,4194304] 0 2024-09-17T01:07:32.526 INFO:tasks.workunit.client.0.smithi103.stdout:4/974: chown d9/d16/d45/d76/fe0 106779 1 2024-09-17T01:07:32.526 INFO:tasks.workunit.client.0.smithi103.stdout:8/679: mknod d0/d6/dc/d30/d86/dcd/cd8 0 2024-09-17T01:07:32.527 INFO:tasks.workunit.client.0.smithi103.stdout:9/966: truncate d7/d43/d88/d11/d20/d4f/df7/f13a 1594478 0 2024-09-17T01:07:32.529 INFO:tasks.workunit.client.0.smithi103.stdout:6/916: dwrite d3/d16/d33/d3e/fc8 [0,4194304] 0 2024-09-17T01:07:32.529 INFO:tasks.workunit.client.0.smithi103.stdout:9/967: chown d7/d43/d88/l41 64109 1 2024-09-17T01:07:32.531 INFO:tasks.workunit.client.0.smithi103.stdout:8/680: symlink d0/d6/dc/d30/d86/ld9 0 2024-09-17T01:07:32.533 INFO:tasks.workunit.client.0.smithi103.stdout:6/917: mkdir d3/d25/d9c/d12f 0 2024-09-17T01:07:32.534 INFO:tasks.workunit.client.0.smithi103.stdout:6/918: readlink d3/d16/d33/d57/d63/d60/da4/d10f/l12b 0 2024-09-17T01:07:32.536 INFO:tasks.workunit.client.0.smithi103.stdout:9/968: rename d7/d43/d88/d11/f10c to d7/d43/d88/d11/d20/d4f/d95/d111/f143 0 2024-09-17T01:07:32.537 INFO:tasks.workunit.client.0.smithi103.stdout:9/969: fdatasync d7/d43/d88/d11/d5c/d5e/f12a 0 2024-09-17T01:07:32.538 INFO:tasks.workunit.client.0.smithi103.stdout:9/970: chown d7/d43/d88/d11/d20/d4f/f75 6786 1 2024-09-17T01:07:32.540 INFO:tasks.workunit.client.0.smithi103.stdout:4/975: creat d9/d16/d38/d3f/f136 x:0 0 0 2024-09-17T01:07:32.540 INFO:tasks.workunit.client.0.smithi103.stdout:4/976: fdatasync d9/d16/d23/f134 0 2024-09-17T01:07:32.541 INFO:tasks.workunit.client.0.smithi103.stdout:4/977: readlink d9/d16/d23/d32/d64/l66 0 2024-09-17T01:07:32.542 INFO:tasks.workunit.client.0.smithi103.stdout:9/971: read d7/db4/ddc/d140/fb2 [1052530,66704] 0 2024-09-17T01:07:32.544 INFO:tasks.workunit.client.0.smithi103.stdout:8/681: fdatasync d0/d6/dc/d30/d2d/f60 0 2024-09-17T01:07:32.547 INFO:tasks.workunit.client.0.smithi103.stdout:1/985: dread d2/d16/d51/d79/fec [0,4194304] 0 2024-09-17T01:07:32.547 INFO:tasks.workunit.client.0.smithi103.stdout:9/972: mknod d7/d2d/d107/c144 0 2024-09-17T01:07:32.549 INFO:tasks.workunit.client.0.smithi103.stdout:4/978: fsync d9/d16/d23/d52/d91/fba 0 2024-09-17T01:07:32.552 INFO:tasks.workunit.client.0.smithi103.stdout:9/973: mkdir d7/db4/d145 0 2024-09-17T01:07:32.552 INFO:tasks.workunit.client.0.smithi103.stdout:6/919: getdents d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3 0 2024-09-17T01:07:32.556 INFO:tasks.workunit.client.0.smithi103.stdout:1/986: mkdir d2/de/d76/df4/d147 0 2024-09-17T01:07:32.561 INFO:tasks.workunit.client.0.smithi103.stdout:5/808: sync 2024-09-17T01:07:32.562 INFO:tasks.workunit.client.0.smithi103.stdout:6/920: getdents d3/d16/de1/d100 0 2024-09-17T01:07:32.565 INFO:tasks.workunit.client.0.smithi103.stdout:4/979: rename d9/d16/d23/d52/d91/dd4/d55/f6b to d9/d16/d23/d52/d91/dd4/f137 0 2024-09-17T01:07:32.569 INFO:tasks.workunit.client.0.smithi103.stdout:5/809: dwrite d6/db/dca/ffc [0,4194304] 0 2024-09-17T01:07:32.569 INFO:tasks.workunit.client.0.smithi103.stdout:1/987: creat d2/f148 x:0 0 0 2024-09-17T01:07:32.570 INFO:tasks.workunit.client.0.smithi103.stdout:6/921: dwrite d3/d16/d33/d3e/d58/fd9 [0,4194304] 0 2024-09-17T01:07:32.571 INFO:tasks.workunit.client.0.smithi103.stdout:8/682: write d0/d6/dc/d30/d2d/f3c [3015809,25110] 0 2024-09-17T01:07:32.582 INFO:tasks.workunit.client.0.smithi103.stdout:9/974: dwrite d7/db8/dbb/f3e [0,4194304] 0 2024-09-17T01:07:32.583 INFO:tasks.workunit.client.0.smithi103.stdout:5/810: getdents d6/d11 0 2024-09-17T01:07:32.585 INFO:tasks.workunit.client.0.smithi103.stdout:5/811: chown d6/d2c/d38/db2/dba/d115/ld4 3 1 2024-09-17T01:07:32.586 INFO:tasks.workunit.client.0.smithi103.stdout:5/812: chown d6/d2c/d38/d6f/de2 690527 1 2024-09-17T01:07:32.594 INFO:tasks.workunit.client.0.smithi103.stdout:1/988: write d2/d16/d51/d65/dff/d122/f27 [95665,123376] 0 2024-09-17T01:07:32.595 INFO:tasks.workunit.client.0.smithi103.stdout:5/813: dread d6/d2c/d38/d4c/d9a/f103 [0,4194304] 0 2024-09-17T01:07:32.596 INFO:tasks.workunit.client.0.smithi103.stdout:6/922: write d3/d16/d33/d57/f7a [1603241,61324] 0 2024-09-17T01:07:32.596 INFO:tasks.workunit.client.0.smithi103.stdout:1/989: truncate d2/d1c/f11b 621238 0 2024-09-17T01:07:32.597 INFO:tasks.workunit.client.0.smithi103.stdout:1/990: chown d2/d1c/d54/c9d 6 1 2024-09-17T01:07:32.599 INFO:tasks.workunit.client.0.smithi103.stdout:5/814: mknod d6/d2c/d38/d6f/de2/c11c 0 2024-09-17T01:07:32.601 INFO:tasks.workunit.client.0.smithi103.stdout:5/815: truncate d6/d28/dcb/fec 730742 0 2024-09-17T01:07:32.603 INFO:tasks.workunit.client.0.smithi103.stdout:9/975: write d7/db8/dbb/fe0 [4835068,17339] 0 2024-09-17T01:07:32.603 INFO:tasks.workunit.client.0.smithi103.stdout:5/816: readlink d6/d2c/d32/d55/l92 0 2024-09-17T01:07:32.607 INFO:tasks.workunit.client.0.smithi103.stdout:1/991: getdents d2/d16 0 2024-09-17T01:07:32.607 INFO:tasks.workunit.client.0.smithi103.stdout:4/980: dread d9/d16/d38/d3f/f6f [0,4194304] 0 2024-09-17T01:07:32.608 INFO:tasks.workunit.client.0.smithi103.stdout:1/992: chown d2 645 1 2024-09-17T01:07:32.608 INFO:tasks.workunit.client.0.smithi103.stdout:9/976: mknod d7/db4/c146 0 2024-09-17T01:07:32.611 INFO:tasks.workunit.client.0.smithi103.stdout:5/817: rename d6/d11/c12 to d6/db/d66/c11d 0 2024-09-17T01:07:32.613 INFO:tasks.workunit.client.0.smithi103.stdout:6/923: dread d3/d16/d33/d57/d63/d60/fd4 [0,4194304] 0 2024-09-17T01:07:32.617 INFO:tasks.workunit.client.0.smithi103.stdout:1/993: rename d2/d7/d73/db8/fee to d2/d16/d51/d65/de0/f149 0 2024-09-17T01:07:32.618 INFO:tasks.workunit.client.0.smithi103.stdout:8/683: dread d0/d6/dc/d30/d25/d64/f75 [0,4194304] 0 2024-09-17T01:07:32.620 INFO:tasks.workunit.client.0.smithi103.stdout:9/977: dwrite d7/d43/fc3 [0,4194304] 0 2024-09-17T01:07:32.620 INFO:tasks.workunit.client.0.smithi103.stdout:4/981: dwrite d9/dc/df/fc5 [0,4194304] 0 2024-09-17T01:07:32.622 INFO:tasks.workunit.client.0.smithi103.stdout:6/924: mkdir d3/d25/d9c/d130 0 2024-09-17T01:07:32.624 INFO:tasks.workunit.client.0.smithi103.stdout:6/925: chown d3/d16/d21/fe9 0 1 2024-09-17T01:07:32.626 INFO:tasks.workunit.client.0.smithi103.stdout:1/994: unlink d2/de/f8e 0 2024-09-17T01:07:32.633 INFO:tasks.workunit.client.0.smithi103.stdout:4/982: mknod d9/d16/d23/d32/d4c/c138 0 2024-09-17T01:07:32.636 INFO:tasks.workunit.client.0.smithi103.stdout:8/684: dread d0/d6/dc/d30/d25/d7d/fa0 [0,4194304] 0 2024-09-17T01:07:32.636 INFO:tasks.workunit.client.0.smithi103.stdout:1/995: creat d2/d7/f14a x:0 0 0 2024-09-17T01:07:32.639 INFO:tasks.workunit.client.0.smithi103.stdout:9/978: creat d7/db4/ddc/d140/dac/dae/d13d/f147 x:0 0 0 2024-09-17T01:07:32.646 INFO:tasks.workunit.client.0.smithi103.stdout:5/818: rename d6/d11/d81/d106 to d6/d28/df4/d11e 0 2024-09-17T01:07:32.647 INFO:tasks.workunit.client.0.smithi103.stdout:6/926: rmdir d3/d16/d33/d57/d63/d60/da4/d120 0 2024-09-17T01:07:32.647 INFO:tasks.workunit.client.0.smithi103.stdout:5/819: write d6/db/d66/f84 [2634415,117320] 0 2024-09-17T01:07:32.655 INFO:tasks.workunit.client.0.smithi103.stdout:5/820: symlink d6/d11/d81/d10e/l11f 0 2024-09-17T01:07:32.657 INFO:tasks.workunit.client.0.smithi103.stdout:1/996: link d2/d70/dac/cbb d2/d1c/d20/dd7/c14b 0 2024-09-17T01:07:32.660 INFO:tasks.workunit.client.0.smithi103.stdout:8/685: dread d0/d6/dc/d30/d25/d64/f4d [0,4194304] 0 2024-09-17T01:07:32.662 INFO:tasks.workunit.client.0.smithi103.stdout:4/983: getdents d9/d16/d70 0 2024-09-17T01:07:32.663 INFO:tasks.workunit.client.0.smithi103.stdout:5/821: truncate d6/d11/f112 1051892 0 2024-09-17T01:07:32.666 INFO:tasks.workunit.client.0.smithi103.stdout:6/927: truncate d3/d16/dad/f67 1972259 0 2024-09-17T01:07:32.667 INFO:tasks.workunit.client.0.smithi103.stdout:5/822: read - d6/d2c/d38/d6f/da3/faf zero size 2024-09-17T01:07:32.668 INFO:tasks.workunit.client.0.smithi103.stdout:5/823: chown d6/db/fd3 6237 1 2024-09-17T01:07:32.672 INFO:tasks.workunit.client.0.smithi103.stdout:8/686: creat d0/d6/dc/d30/d2d/fda x:0 0 0 2024-09-17T01:07:32.674 INFO:tasks.workunit.client.0.smithi103.stdout:5/824: chown d6/d11/fc1 0 1 2024-09-17T01:07:32.674 INFO:tasks.workunit.client.0.smithi103.stdout:1/997: dread d2/d16/d51/d65/dff/d122/f72 [0,4194304] 0 2024-09-17T01:07:32.675 INFO:tasks.workunit.client.0.smithi103.stdout:6/928: write d3/d16/dad/f2a [3787369,40276] 0 2024-09-17T01:07:32.680 INFO:tasks.workunit.client.0.smithi103.stdout:5/825: read d6/d2c/d38/f6c [695840,13706] 0 2024-09-17T01:07:32.682 INFO:tasks.workunit.client.0.smithi103.stdout:5/826: fdatasync d6/d2c/dd7/ffd 0 2024-09-17T01:07:32.684 INFO:tasks.workunit.client.0.smithi103.stdout:6/929: dwrite d3/f36 [0,4194304] 0 2024-09-17T01:07:32.684 INFO:tasks.workunit.client.0.smithi103.stdout:4/984: dread d9/d10/f14 [0,4194304] 0 2024-09-17T01:07:32.687 INFO:tasks.workunit.client.0.smithi103.stdout:4/985: fdatasync d9/d16/d23/d2a/f89 0 2024-09-17T01:07:32.687 INFO:tasks.workunit.client.0.smithi103.stdout:1/998: link d2/d1c/d28/d4b/d74/fae d2/d7/d73/db8/f14c 0 2024-09-17T01:07:32.687 INFO:tasks.workunit.client.0.smithi103.stdout:1/999: stat d2/d1c/c3e 0 2024-09-17T01:07:32.689 INFO:tasks.workunit.client.0.smithi103.stdout:5/827: rename d6/d28/d90/fc0 to d6/d2c/d38/db2/dba/f120 0 2024-09-17T01:07:32.690 INFO:tasks.workunit.client.0.smithi103.stdout:5/828: truncate d6/d2c/d32/f60 5757123 0 2024-09-17T01:07:32.691 INFO:tasks.workunit.client.0.smithi103.stdout:6/930: symlink d3/d16/d33/d57/d63/d60/db5/d118/l131 0 2024-09-17T01:07:32.692 INFO:tasks.workunit.client.0.smithi103.stdout:4/986: symlink d9/d16/l139 0 2024-09-17T01:07:32.692 INFO:tasks.workunit.client.0.smithi103.stdout:5/829: write d6/d2c/d38/db2/f11b [102522,34331] 0 2024-09-17T01:07:32.696 INFO:tasks.workunit.client.0.smithi103.stdout:6/931: creat d3/d16/d21/d50/f132 x:0 0 0 2024-09-17T01:07:32.698 INFO:tasks.workunit.client.0.smithi103.stdout:4/987: fdatasync d9/d16/d70/d127/ffa 0 2024-09-17T01:07:32.698 INFO:tasks.workunit.client.0.smithi103.stdout:8/687: dread d0/d6/dc/d30/d25/d64/f5d [0,4194304] 0 2024-09-17T01:07:32.703 INFO:tasks.workunit.client.0.smithi103.stdout:5/830: link d6/d2c/d38/lc5 d6/d2c/dd7/l121 0 2024-09-17T01:07:32.706 INFO:tasks.workunit.client.0.smithi103.stdout:5/831: mknod d6/d28/dcb/dc4/df3/c122 0 2024-09-17T01:07:32.706 INFO:tasks.workunit.client.0.smithi103.stdout:5/832: dread - d6/d2c/fed zero size 2024-09-17T01:07:32.707 INFO:tasks.workunit.client.0.smithi103.stdout:4/988: getdents d9/d16/d44 0 2024-09-17T01:07:32.708 INFO:tasks.workunit.client.0.smithi103.stdout:5/833: write d6/d28/df4/d11e/db4/ff9 [3449853,21110] 0 2024-09-17T01:07:32.713 INFO:tasks.workunit.client.0.smithi103.stdout:5/834: creat d6/d2c/d38/db2/f123 x:0 0 0 2024-09-17T01:07:32.718 INFO:tasks.workunit.client.0.smithi103.stdout:6/932: dwrite d3/d16/d33/d57/fbe [0,4194304] 0 2024-09-17T01:07:32.720 INFO:tasks.workunit.client.0.smithi103.stdout:5/835: dwrite d6/db/d66/f84 [0,4194304] 0 2024-09-17T01:07:32.721 INFO:tasks.workunit.client.0.smithi103.stdout:4/989: write d9/d16/d44/fd7 [478967,101845] 0 2024-09-17T01:07:32.723 INFO:tasks.workunit.client.0.smithi103.stdout:4/990: dread - d9/d16/d70/f129 zero size 2024-09-17T01:07:32.730 INFO:tasks.workunit.client.0.smithi103.stdout:8/688: dwrite d0/d6/dc/d3d/f7e [0,4194304] 0 2024-09-17T01:07:32.733 INFO:tasks.workunit.client.0.smithi103.stdout:5/836: dwrite d6/d28/fb1 [0,4194304] 0 2024-09-17T01:07:32.741 INFO:tasks.workunit.client.0.smithi103.stdout:8/689: dwrite d0/d6/dc/d3d/f7e [0,4194304] 0 2024-09-17T01:07:32.748 INFO:tasks.workunit.client.0.smithi103.stdout:5/837: dread d6/d2c/d38/f83 [0,4194304] 0 2024-09-17T01:07:32.750 INFO:tasks.workunit.client.0.smithi103.stdout:6/933: dwrite d3/d16/dad/f32 [4194304,4194304] 0 2024-09-17T01:07:32.755 INFO:tasks.workunit.client.0.smithi103.stdout:5/838: fsync d6/d2c/d38/f8a 0 2024-09-17T01:07:32.757 INFO:tasks.workunit.client.0.smithi103.stdout:5/839: write d6/d28/df4/d11e/db4/ff9 [4542756,74237] 0 2024-09-17T01:07:32.759 INFO:tasks.workunit.client.0.smithi103.stdout:5/840: creat d6/d2c/d38/db2/df2/f124 x:0 0 0 2024-09-17T01:07:32.762 INFO:tasks.workunit.client.0.smithi103.stdout:5/841: creat d6/d2c/d38/d6f/de2/f125 x:0 0 0 2024-09-17T01:07:32.763 INFO:tasks.workunit.client.0.smithi103.stdout:4/991: dread d9/d16/d23/d2a/f89 [0,4194304] 0 2024-09-17T01:07:32.764 INFO:tasks.workunit.client.0.smithi103.stdout:5/842: write d6/db/f5c [7824895,74753] 0 2024-09-17T01:07:32.765 INFO:tasks.workunit.client.0.smithi103.stdout:5/843: fdatasync d6/d28/df4/d11e/fbf 0 2024-09-17T01:07:32.775 INFO:tasks.workunit.client.0.smithi103.stdout:4/992: dwrite d9/d16/f11c [0,4194304] 0 2024-09-17T01:07:32.781 INFO:tasks.workunit.client.0.smithi103.stdout:5/844: dwrite d6/d2c/d32/d55/f5e [0,4194304] 0 2024-09-17T01:07:32.787 INFO:tasks.workunit.client.0.smithi103.stdout:8/690: dwrite d0/d80/fc7 [0,4194304] 0 2024-09-17T01:07:32.788 INFO:tasks.workunit.client.0.smithi103.stdout:6/934: dwrite d3/d16/d21/d56/f7c [4194304,4194304] 0 2024-09-17T01:07:32.788 INFO:tasks.workunit.client.0.smithi103.stdout:4/993: rename d9/d16/d23/d32/f98 to d9/d16/d23/d32/d61/f13a 0 2024-09-17T01:07:32.792 INFO:tasks.workunit.client.0.smithi103.stdout:5/845: write d6/d2c/d38/d4c/d50/f4f [815492,6079] 0 2024-09-17T01:07:32.793 INFO:tasks.workunit.client.0.smithi103.stdout:6/935: mknod d3/d25/dae/c133 0 2024-09-17T01:07:32.795 INFO:tasks.workunit.client.0.smithi103.stdout:6/936: chown d3/d25/fca 14258658 1 2024-09-17T01:07:32.798 INFO:tasks.workunit.client.0.smithi103.stdout:8/691: creat d0/d6/dc/d30/d25/fdb x:0 0 0 2024-09-17T01:07:32.804 INFO:tasks.workunit.client.0.smithi103.stdout:6/937: rename d3/d16/d33/d57/d63/d60/db5/l128 to d3/d16/d33/l134 0 2024-09-17T01:07:32.805 INFO:tasks.workunit.client.0.smithi103.stdout:6/938: stat d3/d16/dad/fe0 0 2024-09-17T01:07:32.806 INFO:tasks.workunit.client.0.smithi103.stdout:8/692: dwrite d0/d6/dc/d30/d25/d64/d59/f82 [0,4194304] 0 2024-09-17T01:07:32.807 INFO:tasks.workunit.client.0.smithi103.stdout:8/693: chown d0/d6/f77 21 1 2024-09-17T01:07:32.813 INFO:tasks.workunit.client.0.smithi103.stdout:6/939: dwrite d3/d16/d33/d3e/d58/fd9 [4194304,4194304] 0 2024-09-17T01:07:32.816 INFO:tasks.workunit.client.0.smithi103.stdout:8/694: link d0/d6/dc/d30/l57 d0/d6/dc/d30/d86/dcd/ldc 0 2024-09-17T01:07:32.821 INFO:tasks.workunit.client.0.smithi103.stdout:6/940: getdents d3/d16/de1/d100 0 2024-09-17T01:07:32.823 INFO:tasks.workunit.client.0.smithi103.stdout:4/994: dwrite d9/d16/d45/f82 [0,4194304] 0 2024-09-17T01:07:32.825 INFO:tasks.workunit.client.0.smithi103.stdout:6/941: symlink d3/d16/d33/d3e/d58/l135 0 2024-09-17T01:07:32.826 INFO:tasks.workunit.client.0.smithi103.stdout:8/695: creat d0/d6/dc/d30/d2d/fdd x:0 0 0 2024-09-17T01:07:32.829 INFO:tasks.workunit.client.0.smithi103.stdout:6/942: truncate d3/d16/d33/d3e/d4b/fcc 1470872 0 2024-09-17T01:07:32.829 INFO:tasks.workunit.client.0.smithi103.stdout:5/846: dread d6/d2c/db3/fc3 [4194304,4194304] 0 2024-09-17T01:07:32.831 INFO:tasks.workunit.client.0.smithi103.stdout:8/696: truncate d0/d6/f4f 2969950 0 2024-09-17T01:07:32.833 INFO:tasks.workunit.client.0.smithi103.stdout:6/943: mkdir d3/d25/d26/d87/d136 0 2024-09-17T01:07:32.834 INFO:tasks.workunit.client.0.smithi103.stdout:6/944: read d3/d16/d33/d57/d63/d60/db5/d118/fa0 [3453097,98557] 0 2024-09-17T01:07:32.839 INFO:tasks.workunit.client.0.smithi103.stdout:8/697: dwrite d0/d6/dc/d30/d25/d64/d34/f47 [4194304,4194304] 0 2024-09-17T01:07:32.840 INFO:tasks.workunit.client.0.smithi103.stdout:8/698: chown d0/d6/dc/d30/c61 13115 1 2024-09-17T01:07:32.841 INFO:tasks.workunit.client.0.smithi103.stdout:6/945: unlink d3/d16/d33/d57/d63/d60/c119 0 2024-09-17T01:07:32.847 INFO:tasks.workunit.client.0.smithi103.stdout:8/699: unlink d0/d6/dc/d30/d25/f8d 0 2024-09-17T01:07:32.847 INFO:tasks.workunit.client.0.smithi103.stdout:4/995: write d9/d10/fcc [2151281,121333] 0 2024-09-17T01:07:32.853 INFO:tasks.workunit.client.0.smithi103.stdout:8/700: dread - d0/d6/dc/d30/d25/f74 zero size 2024-09-17T01:07:32.855 INFO:tasks.workunit.client.0.smithi103.stdout:4/996: dwrite d9/d16/d23/d2a/fad [0,4194304] 0 2024-09-17T01:07:32.855 INFO:tasks.workunit.client.0.smithi103.stdout:5/847: write d6/d2c/d38/d4c/d9a/fc6 [361186,53918] 0 2024-09-17T01:07:32.860 INFO:tasks.workunit.client.0.smithi103.stdout:4/997: chown d9/dc/lb3 1613579516 1 2024-09-17T01:07:32.863 INFO:tasks.workunit.client.0.smithi103.stdout:4/998: rename d9/d16/d23/d90/l10a to d9/d16/d23/d52/d91/dd4/d55/l13b 0 2024-09-17T01:07:32.864 INFO:tasks.workunit.client.0.smithi103.stdout:5/848: getdents d6/d2c/d38/db2/dba 0 2024-09-17T01:07:32.867 INFO:tasks.workunit.client.0.smithi103.stdout:4/999: fdatasync d9/d16/d23/d90/faf 0 2024-09-17T01:07:32.869 INFO:tasks.workunit.client.0.smithi103.stdout:6/946: dwrite d3/d16/df5/f116 [0,4194304] 0 2024-09-17T01:07:32.871 INFO:tasks.workunit.client.0.smithi103.stdout:6/947: rmdir d3/d16/d33/d57 39 2024-09-17T01:07:32.872 INFO:tasks.workunit.client.0.smithi103.stdout:5/849: link d6/d2c/d32/l99 d6/d11/d81/l126 0 2024-09-17T01:07:32.874 INFO:tasks.workunit.client.0.smithi103.stdout:5/850: chown d6/db/dca/ffc 6 1 2024-09-17T01:07:32.874 INFO:tasks.workunit.client.0.smithi103.stdout:6/948: mknod d3/d25/d26/d87/c137 0 2024-09-17T01:07:32.874 INFO:tasks.workunit.client.0.smithi103.stdout:5/851: stat d6/d28/c29 0 2024-09-17T01:07:32.875 INFO:tasks.workunit.client.0.smithi103.stdout:6/949: fdatasync d3/d16/d33/d3e/f12e 0 2024-09-17T01:07:32.875 INFO:tasks.workunit.client.0.smithi103.stdout:5/852: chown d6/d2c/d38/d4c/d54/c9e 7192732 1 2024-09-17T01:07:32.878 INFO:tasks.workunit.client.0.smithi103.stdout:5/853: mkdir d6/d2c/d38/d4c/d9a/d114/d127 0 2024-09-17T01:07:32.879 INFO:tasks.workunit.client.0.smithi103.stdout:5/854: chown d6/d2c/db3/fc3 1963416 1 2024-09-17T01:07:32.880 INFO:tasks.workunit.client.0.smithi103.stdout:5/855: chown d6/d28/c3f 4477169 1 2024-09-17T01:07:32.881 INFO:tasks.workunit.client.0.smithi103.stdout:6/950: creat d3/d16/d33/d3e/f138 x:0 0 0 2024-09-17T01:07:32.883 INFO:tasks.workunit.client.0.smithi103.stdout:6/951: creat d3/d16/dad/d105/f139 x:0 0 0 2024-09-17T01:07:32.890 INFO:tasks.workunit.client.0.smithi103.stdout:5/856: write d6/d2c/d38/d6f/da3/faf [611863,1427] 0 2024-09-17T01:07:32.895 INFO:tasks.workunit.client.0.smithi103.stdout:5/857: dread d6/d2c/d38/db2/fa8 [0,4194304] 0 2024-09-17T01:07:32.897 INFO:tasks.workunit.client.0.smithi103.stdout:5/858: write d6/d2c/d38/d6f/da3/faf [854724,47493] 0 2024-09-17T01:07:32.902 INFO:tasks.workunit.client.0.smithi103.stdout:5/859: mkdir d6/d11/d81/df8/d128 0 2024-09-17T01:07:32.904 INFO:tasks.workunit.client.0.smithi103.stdout:6/952: dread d3/d16/d33/d57/d63/d60/db5/ff2 [0,4194304] 0 2024-09-17T01:07:32.905 INFO:tasks.workunit.client.0.smithi103.stdout:5/860: dread d6/d2c/f73 [0,4194304] 0 2024-09-17T01:07:32.911 INFO:tasks.workunit.client.0.smithi103.stdout:5/861: rename d6/d2c/lb6 to d6/d2c/d38/d4c/d54/l129 0 2024-09-17T01:07:32.911 INFO:tasks.workunit.client.0.smithi103.stdout:6/953: getdents d3/d25/d9c/d12f 0 2024-09-17T01:07:32.912 INFO:tasks.workunit.client.0.smithi103.stdout:6/954: mkdir d3/d16/d21/dab/d13a 0 2024-09-17T01:07:32.913 INFO:tasks.workunit.client.0.smithi103.stdout:6/955: stat d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4/l96 0 2024-09-17T01:07:32.915 INFO:tasks.workunit.client.0.smithi103.stdout:5/862: rename d6/d2c/d38/d6f/da3/feb to d6/d2c/db3/f12a 0 2024-09-17T01:07:32.920 INFO:tasks.workunit.client.0.smithi103.stdout:6/956: rename d3/d25/d26/d87/lcf to d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4/l13b 0 2024-09-17T01:07:32.922 INFO:tasks.workunit.client.0.smithi103.stdout:6/957: mknod d3/d25/d26/d87/d136/c13c 0 2024-09-17T01:07:32.926 INFO:tasks.workunit.client.0.smithi103.stdout:6/958: dread d3/d16/dad/f30 [0,4194304] 0 2024-09-17T01:07:32.930 INFO:tasks.workunit.client.0.smithi103.stdout:6/959: dread d3/d16/d21/d56/d9a/fc5 [0,4194304] 0 2024-09-17T01:07:32.937 INFO:tasks.workunit.client.0.smithi103.stdout:6/960: dwrite d3/d16/d21/d50/f132 [0,4194304] 0 2024-09-17T01:07:32.940 INFO:tasks.workunit.client.0.smithi103.stdout:6/961: creat d3/d16/d33/d57/d63/d60/db5/f13d x:0 0 0 2024-09-17T01:07:32.946 INFO:tasks.workunit.client.0.smithi103.stdout:5/863: truncate d6/d2c/d38/f83 71290 0 2024-09-17T01:07:32.950 INFO:tasks.workunit.client.0.smithi103.stdout:5/864: dwrite d6/d2c/d38/db2/fa8 [0,4194304] 0 2024-09-17T01:07:32.967 INFO:tasks.workunit.client.0.smithi103.stdout:5/865: unlink d6/d2c/d32/d55/f6a 0 2024-09-17T01:07:32.972 INFO:tasks.workunit.client.0.smithi103.stdout:6/962: write d3/d16/dad/f6f [991440,85038] 0 2024-09-17T01:07:32.976 INFO:tasks.workunit.client.0.smithi103.stdout:6/963: dread d3/d16/d33/d3e/fc8 [0,4194304] 0 2024-09-17T01:07:32.985 INFO:tasks.workunit.client.0.smithi103.stdout:6/964: truncate d3/d16/d33/d57/fcb 4158244 0 2024-09-17T01:07:32.994 INFO:tasks.workunit.client.0.smithi103.stdout:6/965: dwrite d3/f18 [0,4194304] 0 2024-09-17T01:07:32.995 INFO:tasks.workunit.client.0.smithi103.stdout:6/966: write d3/d16/d33/d57/d63/d60/fd4 [919826,41068] 0 2024-09-17T01:07:32.999 INFO:tasks.workunit.client.0.smithi103.stdout:6/967: creat d3/d25/d9c/d12f/f13e x:0 0 0 2024-09-17T01:07:33.003 INFO:tasks.workunit.client.0.smithi103.stdout:6/968: getdents d3/d16/d33/d57/d63/dd2 0 2024-09-17T01:07:33.003 INFO:tasks.workunit.client.0.smithi103.stdout:6/969: creat d3/d25/d74/f13f x:0 0 0 2024-09-17T01:07:33.004 INFO:tasks.workunit.client.0.smithi103.stdout:6/970: chown d3/d16/dad/d105/f12a 216 1 2024-09-17T01:07:33.007 INFO:tasks.workunit.client.0.smithi103.stdout:6/971: unlink d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/ldc 0 2024-09-17T01:07:33.008 INFO:tasks.workunit.client.0.smithi103.stdout:6/972: chown d3/d25/dae/fea 1 1 2024-09-17T01:07:33.009 INFO:tasks.workunit.client.0.smithi103.stdout:6/973: chown d3/d16/d33/d57/d63/d60/db5/d118/dc1/dc3/df4 98 1 2024-09-17T01:07:33.012 INFO:tasks.workunit.client.0.smithi103.stdout:6/974: getdents d3/d16/d21/d56 0 2024-09-17T01:07:33.014 INFO:tasks.workunit.client.0.smithi103.stdout:6/975: creat d3/d25/d26/d10b/f140 x:0 0 0 2024-09-17T01:07:33.017 INFO:tasks.workunit.client.0.smithi103.stdout:6/976: truncate d3/d16/d33/d3e/fb0 1141898 0 2024-09-17T01:07:33.018 INFO:tasks.workunit.client.0.smithi103.stdout:6/977: truncate d3/d25/d26/d10b/f140 862571 0 2024-09-17T01:07:33.020 INFO:tasks.workunit.client.0.smithi103.stdout:6/978: mkdir d3/d16/d33/d57/d63/d60/de7/d141 0 2024-09-17T01:07:33.025 INFO:tasks.workunit.client.0.smithi103.stdout:6/979: write d3/d16/d33/d57/d63/d60/de7/ff6 [672416,97304] 0 2024-09-17T01:07:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:33 smithi143 ceph-mon[35452]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 61 MiB/s rd, 152 MiB/s wr, 431 op/s 2024-09-17T01:07:33.525 INFO:tasks.workunit.client.0.smithi103.stdout:9/979: sync 2024-09-17T01:07:33.527 INFO:tasks.workunit.client.0.smithi103.stdout:9/980: symlink d7/d43/d88/d11/d5c/d11b/l148 0 2024-09-17T01:07:33.529 INFO:tasks.workunit.client.0.smithi103.stdout:9/981: dread - d7/db4/ddc/d140/dac/dfe/d10b/ff4 zero size 2024-09-17T01:07:33.536 INFO:tasks.workunit.client.0.smithi103.stdout:9/982: getdents d7/d43/d88/d11/d20/d4f/d95/d111 0 2024-09-17T01:07:33.557 INFO:tasks.workunit.client.0.smithi103.stdout:9/983: dwrite d7/d43/d88/d11/d20/d4f/df7/f13a [0,4194304] 0 2024-09-17T01:07:33.559 INFO:tasks.workunit.client.0.smithi103.stdout:9/984: mkdir d7/db4/ddc/d140/d149 0 2024-09-17T01:07:33.563 INFO:tasks.workunit.client.0.smithi103.stdout:9/985: creat d7/db4/ddc/d140/dac/dc2/f14a x:0 0 0 2024-09-17T01:07:33.565 INFO:tasks.workunit.client.0.smithi103.stdout:8/701: sync 2024-09-17T01:07:33.569 INFO:tasks.workunit.client.0.smithi103.stdout:8/702: dread d0/d6/dc/d3d/d88/fc6 [0,4194304] 0 2024-09-17T01:07:33.572 INFO:tasks.workunit.client.0.smithi103.stdout:8/703: unlink d0/d6/c42 0 2024-09-17T01:07:33.573 INFO:tasks.workunit.client.0.smithi103.stdout:8/704: dread - d0/d6/dc/d30/d25/d64/d59/fd1 zero size 2024-09-17T01:07:33.573 INFO:tasks.workunit.client.0.smithi103.stdout:9/986: rmdir d7 39 2024-09-17T01:07:33.575 INFO:tasks.workunit.client.0.smithi103.stdout:8/705: creat d0/d80/fde x:0 0 0 2024-09-17T01:07:33.579 INFO:tasks.workunit.client.0.smithi103.stdout:9/987: link d7/d2d/d59/d7a/c11c d7/d43/dcf/c14b 0 2024-09-17T01:07:33.583 INFO:tasks.workunit.client.0.smithi103.stdout:9/988: rename d7/db4/fc6 to d7/d43/d112/f14c 0 2024-09-17T01:07:33.590 INFO:tasks.workunit.client.0.smithi103.stdout:9/989: symlink d7/db4/ddc/d140/d13e/l14d 0 2024-09-17T01:07:33.590 INFO:tasks.workunit.client.0.smithi103.stdout:9/990: readlink d7/db8/dbb/l28 0 2024-09-17T01:07:33.591 INFO:tasks.workunit.client.0.smithi103.stdout:9/991: write d7/d2d/f72 [3392931,44710] 0 2024-09-17T01:07:33.620 INFO:tasks.workunit.client.0.smithi103.stdout:9/992: truncate d7/d43/d5f/d7d/d80/f10d 508908 0 2024-09-17T01:07:33.622 INFO:tasks.workunit.client.0.smithi103.stdout:9/993: fsync d7/d43/d88/ff8 0 2024-09-17T01:07:33.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:33 smithi103 ceph-mon[28156]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 61 MiB/s rd, 152 MiB/s wr, 431 op/s 2024-09-17T01:07:33.818 INFO:tasks.workunit.client.0.smithi103.stdout:6/980: sync 2024-09-17T01:07:33.818 INFO:tasks.workunit.client.0.smithi103.stdout:5/866: sync 2024-09-17T01:07:33.818 INFO:tasks.workunit.client.0.smithi103.stdout:6/981: chown d3/d16/d33/d57 1723 1 2024-09-17T01:07:33.819 INFO:tasks.workunit.client.0.smithi103.stdout:5/867: chown d6/d2c/d32/f10f 2 1 2024-09-17T01:07:33.820 INFO:tasks.workunit.client.0.smithi103.stdout:6/982: mknod d3/d16/d33/d57/d63/dff/c142 0 2024-09-17T01:07:33.821 INFO:tasks.workunit.client.0.smithi103.stdout:6/983: stat d3/d16/d33/d57/d63/d60/de7 0 2024-09-17T01:07:33.822 INFO:tasks.workunit.client.0.smithi103.stdout:6/984: write d3/d16/dad/f32 [8489150,98785] 0 2024-09-17T01:07:33.825 INFO:tasks.workunit.client.0.smithi103.stdout:5/868: link d6/d2c/d38/d4c/d50/f21 d6/d2c/d38/d4c/d50/ddc/f12b 0 2024-09-17T01:07:33.829 INFO:tasks.workunit.client.0.smithi103.stdout:6/985: link d3/d16/d21/d50/f132 d3/d16/d33/d3e/f143 0 2024-09-17T01:07:33.830 INFO:tasks.workunit.client.0.smithi103.stdout:6/986: write d3/d16/d33/d57/d63/d60/da4/fc7 [462216,50495] 0 2024-09-17T01:07:33.831 INFO:tasks.workunit.client.0.smithi103.stdout:5/869: symlink d6/d2c/d38/d4c/l12c 0 2024-09-17T01:07:33.841 INFO:tasks.workunit.client.0.smithi103.stdout:6/987: write d3/d16/dad/f7f [1508447,111333] 0 2024-09-17T01:07:33.841 INFO:tasks.workunit.client.0.smithi103.stdout:6/988: dread - d3/d16/d33/d3e/f51 zero size 2024-09-17T01:07:33.841 INFO:tasks.workunit.client.0.smithi103.stdout:5/870: getdents d6/d2c/d38/db2/dba/d115/de1/df5 0 2024-09-17T01:07:33.843 INFO:tasks.workunit.client.0.smithi103.stdout:6/989: symlink d3/d16/d33/d57/d63/d60/de7/d141/l144 0 2024-09-17T01:07:33.845 INFO:tasks.workunit.client.0.smithi103.stdout:5/871: creat d6/d2c/d38/d4c/d9a/d114/d127/f12d x:0 0 0 2024-09-17T01:07:33.850 INFO:tasks.workunit.client.0.smithi103.stdout:5/872: dwrite d6/d28/fb1 [0,4194304] 0 2024-09-17T01:07:33.854 INFO:tasks.workunit.client.0.smithi103.stdout:6/990: truncate d3/d16/dad/f32 7270140 0 2024-09-17T01:07:33.859 INFO:tasks.workunit.client.0.smithi103.stdout:5/873: dwrite d6/d11/f86 [0,4194304] 0 2024-09-17T01:07:33.863 INFO:tasks.workunit.client.0.smithi103.stdout:5/874: mknod d6/d28/dcb/dc4/df3/d111/c12e 0 2024-09-17T01:07:33.867 INFO:tasks.workunit.client.0.smithi103.stdout:5/875: rename d6/d2c/ce6 to d6/d28/dcb/c12f 0 2024-09-17T01:07:33.869 INFO:tasks.workunit.client.0.smithi103.stdout:5/876: mkdir d6/d28/dcb/dc4/df3/d130 0 2024-09-17T01:07:33.871 INFO:tasks.workunit.client.0.smithi103.stdout:5/877: write d6/d28/dcb/d93/fe8 [3762523,6550] 0 2024-09-17T01:07:33.873 INFO:tasks.workunit.client.0.smithi103.stdout:5/878: write d6/d2c/d38/d4c/d54/f77 [4887598,119254] 0 2024-09-17T01:07:33.876 INFO:tasks.workunit.client.0.smithi103.stdout:5/879: mknod d6/d2c/d38/d4c/d50/c131 0 2024-09-17T01:07:33.890 INFO:tasks.workunit.client.0.smithi103.stdout:5/880: dwrite d6/d2c/d32/f33 [0,4194304] 0 2024-09-17T01:07:33.893 INFO:tasks.workunit.client.0.smithi103.stdout:5/881: readlink d6/d11/l41 0 2024-09-17T01:07:33.898 INFO:tasks.workunit.client.0.smithi103.stdout:5/882: getdents d6/d2c/d38/d4c/dd5 0 2024-09-17T01:07:33.910 INFO:tasks.workunit.client.0.smithi103.stdout:5/883: write d6/d2c/d38/f8a [155155,98948] 0 2024-09-17T01:07:33.935 INFO:tasks.workunit.client.0.smithi103.stdout:5/884: getdents d6/d2c/dd7 0 2024-09-17T01:07:33.936 INFO:tasks.workunit.client.0.smithi103.stdout:5/885: truncate d6/d2c/d38/d4c/d50/f1c 1769439 0 2024-09-17T01:07:33.937 INFO:tasks.workunit.client.0.smithi103.stdout:5/886: truncate d6/d2c/d38/d4c/f8f 4607603 0 2024-09-17T01:07:33.939 INFO:tasks.workunit.client.0.smithi103.stdout:5/887: write d6/d2c/d38/d4c/d50/fde [813515,64675] 0 2024-09-17T01:07:33.942 INFO:tasks.workunit.client.0.smithi103.stdout:5/888: unlink d6/d11/d81/fac 0 2024-09-17T01:07:33.945 INFO:tasks.workunit.client.0.smithi103.stdout:5/889: rename d6/d2c/d38/d4c/d50/f72 to d6/d28/df4/d11e/f132 0 2024-09-17T01:07:33.947 INFO:tasks.workunit.client.0.smithi103.stdout:5/890: creat d6/db/dca/f133 x:0 0 0 2024-09-17T01:07:33.948 INFO:tasks.workunit.client.0.smithi103.stdout:5/891: chown d6/d2c/d38/d4c/de5/f116 706224 1 2024-09-17T01:07:33.951 INFO:tasks.workunit.client.0.smithi103.stdout:5/892: unlink d6/d2c/db3/fc3 0 2024-09-17T01:07:33.953 INFO:tasks.workunit.client.0.smithi103.stdout:5/893: mknod d6/d2c/d38/d4c/d9a/c134 0 2024-09-17T01:07:33.954 INFO:tasks.workunit.client.0.smithi103.stdout:5/894: stat d6/d2c/d38/d6f/de2/fee 0 2024-09-17T01:07:33.963 INFO:tasks.workunit.client.0.smithi103.stdout:5/895: link d6/d11/d81/ldf d6/d2c/d38/d4c/d9a/d114/d127/l135 0 2024-09-17T01:07:33.964 INFO:tasks.workunit.client.0.smithi103.stdout:5/896: readlink d6/d28/df4/d11e/db4/l105 0 2024-09-17T01:07:33.969 INFO:tasks.workunit.client.0.smithi103.stdout:5/897: dread d6/d11/f112 [0,4194304] 0 2024-09-17T01:07:33.971 INFO:tasks.workunit.client.0.smithi103.stdout:5/898: symlink d6/d2c/d38/d4c/d9a/d114/d127/l136 0 2024-09-17T01:07:33.973 INFO:tasks.workunit.client.0.smithi103.stdout:5/899: creat d6/d28/dcb/d93/f137 x:0 0 0 2024-09-17T01:07:33.975 INFO:tasks.workunit.client.0.smithi103.stdout:5/900: readlink d6/d2c/d38/db2/dba/d115/ld4 0 2024-09-17T01:07:33.975 INFO:tasks.workunit.client.0.smithi103.stdout:5/901: readlink d6/l7 0 2024-09-17T01:07:33.976 INFO:tasks.workunit.client.0.smithi103.stdout:5/902: rmdir d6/d2c/d38/db2/dba/d115 39 2024-09-17T01:07:33.978 INFO:tasks.workunit.client.0.smithi103.stdout:5/903: creat d6/d11/d81/df8/f138 x:0 0 0 2024-09-17T01:07:33.983 INFO:tasks.workunit.client.0.smithi103.stdout:5/904: getdents d6/d2c/d38/d4c/d54 0 2024-09-17T01:07:33.986 INFO:tasks.workunit.client.0.smithi103.stdout:5/905: mkdir d6/d2c/d32/d139 0 2024-09-17T01:07:33.988 INFO:tasks.workunit.client.0.smithi103.stdout:5/906: creat d6/d28/d90/f13a x:0 0 0 2024-09-17T01:07:33.989 INFO:tasks.workunit.client.0.smithi103.stdout:5/907: write d6/d2c/d38/d4c/d50/f4f [6912092,22758] 0 2024-09-17T01:07:33.989 INFO:tasks.workunit.client.0.smithi103.stdout:5/908: fdatasync d6/d2c/d38/db2/f123 0 2024-09-17T01:07:33.991 INFO:tasks.workunit.client.0.smithi103.stdout:5/909: write d6/d2c/d38/db2/fa8 [2633913,127086] 0 2024-09-17T01:07:33.994 INFO:tasks.workunit.client.0.smithi103.stdout:5/910: rename d6/d2c/d38/fdb to d6/d2c/d32/d55/f13b 0 2024-09-17T01:07:34.228 INFO:tasks.workunit.client.0.smithi103.stdout:8/706: sync 2024-09-17T01:07:34.231 INFO:tasks.workunit.client.0.smithi103.stdout:8/707: getdents d0/d6 0 2024-09-17T01:07:34.237 INFO:tasks.workunit.client.0.smithi103.stdout:8/708: dread d0/d6/dc/d30/d25/d64/f75 [0,4194304] 0 2024-09-17T01:07:34.401 INFO:tasks.workunit.client.0.smithi103.stdout:9/994: sync 2024-09-17T01:07:34.401 INFO:tasks.workunit.client.0.smithi103.stdout:9/995: creat d7/d43/d88/d11/d20/d4f/df7/f14e x:0 0 0 2024-09-17T01:07:34.401 INFO:tasks.workunit.client.0.smithi103.stdout:9/996: stat d7/d43/d88/d11/d5c/d11b 0 2024-09-17T01:07:34.407 INFO:tasks.workunit.client.0.smithi103.stdout:9/997: write d7/db4/ddc/d140/dac/dae/f130 [490625,5492] 0 2024-09-17T01:07:34.409 INFO:tasks.workunit.client.0.smithi103.stdout:9/998: unlink d7/db4/ddc/d140/dac/dae/f106 0 2024-09-17T01:07:34.413 INFO:tasks.workunit.client.0.smithi103.stdout:9/999: link d7/d2d/d59/c123 d7/d43/d5f/dc9/c14f 0 2024-09-17T01:07:34.452 INFO:tasks.workunit.client.0.smithi103.stdout:6/991: sync 2024-09-17T01:07:34.452 INFO:tasks.workunit.client.0.smithi103.stdout:8/709: sync 2024-09-17T01:07:34.452 INFO:tasks.workunit.client.0.smithi103.stdout:5/911: sync 2024-09-17T01:07:34.454 INFO:tasks.workunit.client.0.smithi103.stdout:8/710: chown d0/d6/dc/d30/d25/d64/d34/d6e/d72 213 1 2024-09-17T01:07:34.454 INFO:tasks.workunit.client.0.smithi103.stdout:6/992: write d3/d16/d21/d56/d9a/f11e [2162194,118036] 0 2024-09-17T01:07:34.455 INFO:tasks.workunit.client.0.smithi103.stdout:6/993: fsync d3/d16/f11f 0 2024-09-17T01:07:34.457 INFO:tasks.workunit.client.0.smithi103.stdout:8/711: mknod d0/d80/cdf 0 2024-09-17T01:07:34.457 INFO:tasks.workunit.client.0.smithi103.stdout:6/994: read d3/d16/d21/fe9 [199647,123445] 0 2024-09-17T01:07:34.459 INFO:tasks.workunit.client.0.smithi103.stdout:5/912: dwrite d6/db/f5c [4194304,4194304] 0 2024-09-17T01:07:34.461 INFO:tasks.workunit.client.0.smithi103.stdout:8/712: mknod d0/d6/dc/d3d/d88/ce0 0 2024-09-17T01:07:34.463 INFO:tasks.workunit.client.0.smithi103.stdout:6/995: read d3/d16/d33/d3e/d58/d82/fc2 [1606119,73928] 0 2024-09-17T01:07:34.463 INFO:tasks.workunit.client.0.smithi103.stdout:6/996: chown d3/f18 18011051 1 2024-09-17T01:07:34.467 INFO:tasks.workunit.client.0.smithi103.stdout:5/913: dread d6/fc7 [0,4194304] 0 2024-09-17T01:07:34.471 INFO:tasks.workunit.client.0.smithi103.stdout:5/914: rename d6/d2c/d38/db2/dba/d115/ld4 to d6/d11/d81/df8/d128/l13c 0 2024-09-17T01:07:34.472 INFO:tasks.workunit.client.0.smithi103.stdout:6/997: write d3/d25/fca [302885,76503] 0 2024-09-17T01:07:34.485 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:07:34.485 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-17T01:07:34.501 INFO:tasks.workunit.client.0.smithi103.stdout:5/915: write d6/d28/dcb/d93/f9d [992149,36249] 0 2024-09-17T01:07:34.503 INFO:tasks.workunit.client.0.smithi103.stdout:5/916: dread - d6/d2c/d38/d6f/de2/fee zero size 2024-09-17T01:07:34.506 INFO:tasks.workunit.client.0.smithi103.stdout:5/917: mkdir d6/d2c/d38/d4c/d54/d13d 0 2024-09-17T01:07:34.506 INFO:tasks.workunit.client.0.smithi103.stdout:6/998: dwrite d3/ff [4194304,4194304] 0 2024-09-17T01:07:34.507 INFO:tasks.workunit.client.0.smithi103.stdout:5/918: read d6/db/dca/ffc [1456760,9463] 0 2024-09-17T01:07:34.507 INFO:tasks.workunit.client.0.smithi103.stdout:6/999: read - d3/d25/d74/f13f zero size 2024-09-17T01:07:34.509 INFO:tasks.workunit.client.0.smithi103.stdout:5/919: write d6/d2c/db3/ff6 [2833320,287] 0 2024-09-17T01:07:34.510 INFO:tasks.workunit.client.0.smithi103.stdout:5/920: write d6/d28/dcb/fdd [100716,8996] 0 2024-09-17T01:07:34.512 INFO:tasks.workunit.client.0.smithi103.stdout:5/921: creat d6/d2c/d38/db2/dba/d115/de1/f13e x:0 0 0 2024-09-17T01:07:34.515 INFO:tasks.workunit.client.0.smithi103.stdout:5/922: creat d6/d2c/d38/d109/f13f x:0 0 0 2024-09-17T01:07:34.518 INFO:tasks.workunit.client.0.smithi103.stdout:5/923: getdents d6/d28/dcb/dc4/df3/d111 0 2024-09-17T01:07:34.518 INFO:tasks.workunit.client.0.smithi103.stdout:5/924: dread - d6/d2c/d38/db2/dba/d115/de1/f13e zero size 2024-09-17T01:07:34.521 INFO:tasks.workunit.client.0.smithi103.stdout:5/925: rename d6/db/l79 to d6/d28/dcb/l140 0 2024-09-17T01:07:34.524 INFO:tasks.workunit.client.0.smithi103.stdout:5/926: read d6/f1e [5767525,72469] 0 2024-09-17T01:07:34.528 INFO:tasks.workunit.client.0.smithi103.stdout:5/927: dwrite d6/d2c/d38/d6f/fbd [0,4194304] 0 2024-09-17T01:07:34.529 INFO:tasks.workunit.client.0.smithi103.stdout:5/928: chown d6/d2c/d38/d4c/dd5 2 1 2024-09-17T01:07:34.537 INFO:tasks.workunit.client.0.smithi103.stdout:5/929: truncate d6/d28/df4/d11e/db4/ff9 1006421 0 2024-09-17T01:07:34.538 INFO:tasks.workunit.client.0.smithi103.stdout:5/930: read - d6/d28/f9f zero size 2024-09-17T01:07:34.553 INFO:tasks.workunit.client.0.smithi103.stdout:5/931: dwrite d6/d2c/d32/d55/f5d [4194304,4194304] 0 2024-09-17T01:07:34.561 INFO:tasks.workunit.client.0.smithi103.stdout:5/932: truncate d6/d2c/d38/f8a 232065 0 2024-09-17T01:07:34.562 INFO:tasks.workunit.client.0.smithi103.stdout:5/933: dread d6/d11/f86 [0,4194304] 0 2024-09-17T01:07:34.567 INFO:tasks.workunit.client.0.smithi103.stdout:5/934: write d6/f8b [2611310,73977] 0 2024-09-17T01:07:34.569 INFO:tasks.workunit.client.0.smithi103.stdout:5/935: write d6/d2c/d32/d55/f5d [9422438,93306] 0 2024-09-17T01:07:34.571 INFO:tasks.workunit.client.0.smithi103.stdout:5/936: mknod d6/d2c/c141 0 2024-09-17T01:07:34.572 INFO:tasks.workunit.client.0.smithi103.stdout:5/937: dread - d6/d2c/d38/db2/dba/d115/de1/f13e zero size 2024-09-17T01:07:34.573 INFO:tasks.workunit.client.0.smithi103.stdout:5/938: read - d6/d2c/db3/f12a zero size 2024-09-17T01:07:34.576 INFO:tasks.workunit.client.0.smithi103.stdout:5/939: write d6/d2c/d38/d4c/d9a/f103 [4046150,100162] 0 2024-09-17T01:07:34.576 INFO:tasks.workunit.client.0.smithi103.stdout:5/940: stat d6/d2c/d38/d6f/da3/c10c 0 2024-09-17T01:07:34.593 INFO:tasks.workunit.client.0.smithi103.stdout:5/941: dread d6/d2c/d32/d55/f13b [0,4194304] 0 2024-09-17T01:07:34.594 INFO:tasks.workunit.client.0.smithi103.stdout:5/942: write d6/d2c/d38/d4c/d9a/f103 [4961377,7129] 0 2024-09-17T01:07:34.597 INFO:tasks.workunit.client.0.smithi103.stdout:5/943: symlink d6/d28/l142 0 2024-09-17T01:07:34.597 INFO:tasks.workunit.client.0.smithi103.stdout:5/944: stat d6/d11/d81/df8/d128 0 2024-09-17T01:07:34.600 INFO:tasks.workunit.client.0.smithi103.stdout:5/945: mkdir d6/d2c/d38/d6f/de2/d143 0 2024-09-17T01:07:34.601 INFO:tasks.workunit.client.0.smithi103.stdout:5/946: fsync d6/db/f4e 0 2024-09-17T01:07:34.945 INFO:tasks.workunit.client.0.smithi103.stdout:8/713: sync 2024-09-17T01:07:34.989 INFO:tasks.workunit.client.0.smithi103.stdout:8/714: dwrite d0/d6/dc/d3d/d88/fb3 [0,4194304] 0 2024-09-17T01:07:34.996 INFO:tasks.workunit.client.0.smithi103.stdout:8/715: dwrite d0/f4c [4194304,4194304] 0 2024-09-17T01:07:34.999 INFO:tasks.workunit.client.0.smithi103.stdout:8/716: read - d0/d6/dc/d3d/d88/fba zero size 2024-09-17T01:07:35.001 INFO:tasks.workunit.client.0.smithi103.stdout:5/947: sync 2024-09-17T01:07:35.003 INFO:tasks.workunit.client.0.smithi103.stdout:5/948: write d6/d2c/d38/d4c/f8f [3970095,3638] 0 2024-09-17T01:07:35.017 INFO:tasks.workunit.client.0.smithi103.stdout:8/717: dwrite d0/d6/f77 [0,4194304] 0 2024-09-17T01:07:35.020 INFO:tasks.workunit.client.0.smithi103.stdout:5/949: dwrite d6/d28/d90/fa4 [0,4194304] 0 2024-09-17T01:07:35.023 INFO:tasks.workunit.client.0.smithi103.stdout:8/718: mkdir d0/d6/dc/d30/d2d/de1 0 2024-09-17T01:07:35.024 INFO:tasks.workunit.client.0.smithi103.stdout:5/950: creat d6/d2c/d32/f144 x:0 0 0 2024-09-17T01:07:35.027 INFO:tasks.workunit.client.0.smithi103.stdout:8/719: chown d0/c2a 332137312 1 2024-09-17T01:07:35.030 INFO:tasks.workunit.client.0.smithi103.stdout:5/951: truncate d6/d2c/d38/f83 75254 0 2024-09-17T01:07:35.034 INFO:tasks.workunit.client.0.smithi103.stdout:5/952: rename d6/d11/d81/df8/c110 to d6/d2c/d38/db2/dba/d115/de1/df5/c145 0 2024-09-17T01:07:35.036 INFO:tasks.workunit.client.0.smithi103.stdout:8/720: getdents d0/d6/dc/d30/d25 0 2024-09-17T01:07:35.037 INFO:tasks.workunit.client.0.smithi103.stdout:8/721: fdatasync d0/d6/dc/d30/d25/d7d/d99/fd7 0 2024-09-17T01:07:35.038 INFO:tasks.workunit.client.0.smithi103.stdout:5/953: creat d6/d11/f146 x:0 0 0 2024-09-17T01:07:35.040 INFO:tasks.workunit.client.0.smithi103.stdout:8/722: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90/fe2 x:0 0 0 2024-09-17T01:07:35.041 INFO:tasks.workunit.client.0.smithi103.stdout:5/954: rmdir d6/d2c/d38/d4c/d9a/d114/d127 39 2024-09-17T01:07:35.042 INFO:tasks.workunit.client.0.smithi103.stdout:8/723: fdatasync d0/f93 0 2024-09-17T01:07:35.044 INFO:tasks.workunit.client.0.smithi103.stdout:5/955: creat d6/d2c/d38/d4c/d9a/f147 x:0 0 0 2024-09-17T01:07:35.045 INFO:tasks.workunit.client.0.smithi103.stdout:5/956: fsync d6/f8b 0 2024-09-17T01:07:35.047 INFO:tasks.workunit.client.0.smithi103.stdout:5/957: mknod d6/d2c/d32/c148 0 2024-09-17T01:07:35.051 INFO:tasks.workunit.client.0.smithi103.stdout:8/724: link d0/d80/cdf d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/dac/ce3 0 2024-09-17T01:07:35.053 INFO:tasks.workunit.client.0.smithi103.stdout:5/958: dwrite d6/d2c/d38/db2/f123 [0,4194304] 0 2024-09-17T01:07:35.061 INFO:tasks.workunit.client.0.smithi103.stdout:5/959: link d6/d2c/d38/d6f/de2/c11c d6/d28/df4/c149 0 2024-09-17T01:07:35.062 INFO:tasks.workunit.client.0.smithi103.stdout:5/960: truncate d6/d2c/dd7/ffd 691236 0 2024-09-17T01:07:35.065 INFO:tasks.workunit.client.0.smithi103.stdout:8/725: dread d0/d6/fbb [0,4194304] 0 2024-09-17T01:07:35.066 INFO:tasks.workunit.client.0.smithi103.stdout:5/961: mkdir d6/d2c/d38/d4c/d9a/d114/d14a 0 2024-09-17T01:07:35.067 INFO:tasks.workunit.client.0.smithi103.stdout:5/962: creat d6/d2c/db3/f14b x:0 0 0 2024-09-17T01:07:35.073 INFO:tasks.workunit.client.0.smithi103.stdout:5/963: getdents d6/dda 0 2024-09-17T01:07:35.074 INFO:tasks.workunit.client.0.smithi103.stdout:5/964: write d6/d2c/d38/d4c/d50/fb8 [899201,99250] 0 2024-09-17T01:07:35.079 INFO:tasks.workunit.client.0.smithi103.stdout:5/965: rename d6/d11/lbc to d6/d2c/d38/d4c/d9a/d114/d127/l14c 0 2024-09-17T01:07:35.082 INFO:tasks.workunit.client.0.smithi103.stdout:5/966: mkdir d6/d2c/d38/db2/dba/d115/de1/df5/d14d 0 2024-09-17T01:07:35.083 INFO:tasks.workunit.client.0.smithi103.stdout:8/726: dread d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:35.086 INFO:tasks.workunit.client.0.smithi103.stdout:8/727: rename d0/d6/dc/d30/f7a to d0/d6/dc/d30/d86/fe4 0 2024-09-17T01:07:35.090 INFO:tasks.workunit.client.0.smithi103.stdout:8/728: dread d0/d6/dc/d30/d2d/f60 [0,4194304] 0 2024-09-17T01:07:35.094 INFO:tasks.workunit.client.0.smithi103.stdout:5/967: dread d6/d28/df4/d11e/fbf [0,4194304] 0 2024-09-17T01:07:35.094 INFO:tasks.workunit.client.0.smithi103.stdout:8/729: unlink d0/d6/dc/d30/d25/d64/d59/lc8 0 2024-09-17T01:07:35.097 INFO:tasks.workunit.client.0.smithi103.stdout:5/968: creat d6/d2c/d38/d6f/da3/f14e x:0 0 0 2024-09-17T01:07:35.099 INFO:tasks.workunit.client.0.smithi103.stdout:5/969: rmdir d6/d2c/d38/d4c/dd5 39 2024-09-17T01:07:35.100 INFO:tasks.workunit.client.0.smithi103.stdout:5/970: symlink d6/d2c/d32/d55/l14f 0 2024-09-17T01:07:35.110 INFO:tasks.workunit.client.0.smithi103.stdout:8/730: dread d0/d6/dc/f4b [0,4194304] 0 2024-09-17T01:07:35.115 INFO:tasks.workunit.client.0.smithi103.stdout:8/731: rename d0/d80/cdf to d0/d6/dc/d3d/ce5 0 2024-09-17T01:07:35.116 INFO:tasks.workunit.client.0.smithi103.stdout:8/732: creat d0/d6/dc/d30/d25/d64/d59/fe6 x:0 0 0 2024-09-17T01:07:35.118 INFO:tasks.workunit.client.0.smithi103.stdout:8/733: creat d0/d6/dc/d30/d25/d64/d34/fe7 x:0 0 0 2024-09-17T01:07:35.120 INFO:tasks.workunit.client.0.smithi103.stdout:8/734: creat d0/d6/dc/d30/d86/dcd/fe8 x:0 0 0 2024-09-17T01:07:35.122 INFO:tasks.workunit.client.0.smithi103.stdout:8/735: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/fe9 x:0 0 0 2024-09-17T01:07:35.123 INFO:tasks.workunit.client.0.smithi103.stdout:8/736: fsync d0/d6/dc/d30/d2d/fda 0 2024-09-17T01:07:35.124 INFO:tasks.workunit.client.0.smithi103.stdout:8/737: write d0/d6/dc/d30/d25/d64/f46 [389953,116383] 0 2024-09-17T01:07:35.131 INFO:tasks.workunit.client.0.smithi103.stdout:8/738: dwrite d0/d6/dc/d30/d86/dcd/fe8 [0,4194304] 0 2024-09-17T01:07:35.134 INFO:tasks.workunit.client.0.smithi103.stdout:8/739: creat d0/d6/dc/d30/d86/fea x:0 0 0 2024-09-17T01:07:35.140 INFO:tasks.workunit.client.0.smithi103.stdout:8/740: rename d0/d6/dc/d30/d25/d64/d34/l62 to d0/d6/dc/d30/d25/d64/d34/leb 0 2024-09-17T01:07:35.144 INFO:tasks.workunit.client.0.smithi103.stdout:8/741: dread d0/f4c [4194304,4194304] 0 2024-09-17T01:07:35.146 INFO:tasks.workunit.client.0.smithi103.stdout:8/742: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/db6/fec x:0 0 0 2024-09-17T01:07:35.148 INFO:tasks.workunit.client.0.smithi103.stdout:8/743: unlink d0/d6/dc/d30/c48 0 2024-09-17T01:07:35.150 INFO:tasks.workunit.client.0.smithi103.stdout:8/744: symlink d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/led 0 2024-09-17T01:07:35.156 INFO:tasks.workunit.client.0.smithi103.stdout:8/745: write d0/d6/dc/d30/f66 [3509702,64449] 0 2024-09-17T01:07:35.157 INFO:tasks.workunit.client.0.smithi103.stdout:8/746: fdatasync d0/d80/fc7 0 2024-09-17T01:07:35.159 INFO:tasks.workunit.client.0.smithi103.stdout:8/747: mknod d0/d6/dc/d3d/d6d/cee 0 2024-09-17T01:07:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:35 smithi143 ceph-mon[35452]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 40 MiB/s rd, 96 MiB/s wr, 287 op/s 2024-09-17T01:07:35.601 INFO:tasks.workunit.client.0.smithi103.stdout:5/971: sync 2024-09-17T01:07:35.605 INFO:tasks.workunit.client.0.smithi103.stdout:5/972: rename d6/d2c/d38/d6f/de2/c11c to d6/d2c/d38/d4c/d50/c150 0 2024-09-17T01:07:35.610 INFO:tasks.workunit.client.0.smithi103.stdout:5/973: link d6/d11/f1a d6/d28/dcb/dc4/f151 0 2024-09-17T01:07:35.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:35 smithi103 ceph-mon[28156]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 40 MiB/s rd, 96 MiB/s wr, 287 op/s 2024-09-17T01:07:35.845 INFO:tasks.workunit.client.0.smithi103.stdout:8/748: sync 2024-09-17T01:07:35.845 INFO:tasks.workunit.client.0.smithi103.stdout:8/749: readlink d0/d6/dc/d30/d2d/l2f 0 2024-09-17T01:07:35.846 INFO:tasks.workunit.client.0.smithi103.stdout:8/750: fdatasync d0/d6/f10 0 2024-09-17T01:07:35.850 INFO:tasks.workunit.client.0.smithi103.stdout:8/751: stat d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/dac/ce3 0 2024-09-17T01:07:35.855 INFO:tasks.workunit.client.0.smithi103.stdout:8/752: dwrite d0/d6/dc/d3d/d88/fb3 [0,4194304] 0 2024-09-17T01:07:35.856 INFO:tasks.workunit.client.0.smithi103.stdout:8/753: dread - d0/d6/dc/d3d/d6d/fd0 zero size 2024-09-17T01:07:35.867 INFO:tasks.workunit.client.0.smithi103.stdout:5/974: sync 2024-09-17T01:07:35.867 INFO:tasks.workunit.client.0.smithi103.stdout:8/754: truncate d0/d6/dc/d3d/d6d/f76 2864247 0 2024-09-17T01:07:35.868 INFO:tasks.workunit.client.0.smithi103.stdout:5/975: mkdir d6/d28/d90/d152 0 2024-09-17T01:07:35.872 INFO:tasks.workunit.client.0.smithi103.stdout:5/976: mkdir d6/d28/dcb/dc4/df3/d130/d153 0 2024-09-17T01:07:35.872 INFO:tasks.workunit.client.0.smithi103.stdout:8/755: getdents d0/d6/dc/d30/d25/d64/d34/d6e/d72/da6 0 2024-09-17T01:07:35.874 INFO:tasks.workunit.client.0.smithi103.stdout:8/756: symlink d0/d6/lef 0 2024-09-17T01:07:35.877 INFO:tasks.workunit.client.0.smithi103.stdout:5/977: getdents d6 0 2024-09-17T01:07:35.882 INFO:tasks.workunit.client.0.smithi103.stdout:5/978: creat d6/d2c/d38/d4c/f154 x:0 0 0 2024-09-17T01:07:35.888 INFO:tasks.workunit.client.0.smithi103.stdout:5/979: mkdir d6/d2c/d38/d4c/d9a/d114/d14a/d155 0 2024-09-17T01:07:35.889 INFO:tasks.workunit.client.0.smithi103.stdout:8/757: write d0/d6/dc/f8f [638951,7349] 0 2024-09-17T01:07:35.892 INFO:tasks.workunit.client.0.smithi103.stdout:8/758: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/df0 0 2024-09-17T01:07:35.893 INFO:tasks.workunit.client.0.smithi103.stdout:8/759: write d0/d6/dc/d30/d86/fb9 [784074,92222] 0 2024-09-17T01:07:35.896 INFO:tasks.workunit.client.0.smithi103.stdout:5/980: link d6/d28/f9f d6/d2c/d38/d4c/dd5/f156 0 2024-09-17T01:07:35.898 INFO:tasks.workunit.client.0.smithi103.stdout:5/981: creat d6/d2c/d38/d109/f157 x:0 0 0 2024-09-17T01:07:35.899 INFO:tasks.workunit.client.0.smithi103.stdout:8/760: getdents d0/d80 0 2024-09-17T01:07:35.900 INFO:tasks.workunit.client.0.smithi103.stdout:5/982: unlink d6/d2c/f37 0 2024-09-17T01:07:35.902 INFO:tasks.workunit.client.0.smithi103.stdout:8/761: mkdir d0/d6/dc/df1 0 2024-09-17T01:07:35.903 INFO:tasks.workunit.client.0.smithi103.stdout:8/762: write d0/d6/dc/d30/d25/d64/d59/fe6 [885862,51158] 0 2024-09-17T01:07:35.906 INFO:tasks.workunit.client.0.smithi103.stdout:8/763: truncate d0/d6/dc/d3d/d6d/fd0 270977 0 2024-09-17T01:07:35.906 INFO:tasks.workunit.client.0.smithi103.stdout:5/983: link d6/d2c/d38/d4c/d54/l129 d6/d2c/d38/d4c/dd5/l158 0 2024-09-17T01:07:35.907 INFO:tasks.workunit.client.0.smithi103.stdout:5/984: readlink d6/d2c/d32/d55/l14f 0 2024-09-17T01:07:35.907 INFO:tasks.workunit.client.0.smithi103.stdout:5/985: chown d6/d11/f146 16528443 1 2024-09-17T01:07:35.913 INFO:tasks.workunit.client.0.smithi103.stdout:5/986: dread - d6/d2c/d38/d6f/de2/f125 zero size 2024-09-17T01:07:35.919 INFO:tasks.workunit.client.0.smithi103.stdout:8/764: dwrite d0/d6/f4f [0,4194304] 0 2024-09-17T01:07:35.963 INFO:tasks.workunit.client.0.smithi103.stdout:8/765: dread d0/d6/fbb [0,4194304] 0 2024-09-17T01:07:35.978 INFO:tasks.workunit.client.0.smithi103.stdout:8/766: dwrite d0/d6/dc/d30/d25/d64/d34/fa1 [0,4194304] 0 2024-09-17T01:07:35.981 INFO:tasks.workunit.client.0.smithi103.stdout:8/767: rmdir d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2 39 2024-09-17T01:07:35.991 INFO:tasks.workunit.client.0.smithi103.stdout:8/768: dwrite d0/d6/dc/d30/d25/d7d/d99/fd7 [0,4194304] 0 2024-09-17T01:07:36.004 INFO:tasks.workunit.client.0.smithi103.stdout:8/769: dwrite d0/f4e [0,4194304] 0 2024-09-17T01:07:36.009 INFO:tasks.workunit.client.0.smithi103.stdout:8/770: creat d0/d6/dc/ff2 x:0 0 0 2024-09-17T01:07:36.014 INFO:tasks.workunit.client.0.smithi103.stdout:8/771: rename d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/led to d0/d6/dc/d30/d2d/de1/lf3 0 2024-09-17T01:07:36.023 INFO:tasks.workunit.client.0.smithi103.stdout:8/772: write d0/d6/dc/d30/f1f [3764408,99111] 0 2024-09-17T01:07:36.026 INFO:tasks.workunit.client.0.smithi103.stdout:8/773: dread d0/d6/dc/d30/d86/f9e [0,4194304] 0 2024-09-17T01:07:36.028 INFO:tasks.workunit.client.0.smithi103.stdout:8/774: mknod d0/d6/dc/d3d/d88/cf4 0 2024-09-17T01:07:36.033 INFO:tasks.workunit.client.0.smithi103.stdout:8/775: rename d0/d6/dc/d30/d25/d64/d34/d6e/d72/fce to d0/d6/dc/d30/d25/d64/d34/d6e/d72/df0/ff5 0 2024-09-17T01:07:36.036 INFO:tasks.workunit.client.0.smithi103.stdout:8/776: creat d0/d6/dc/d30/d2d/ff6 x:0 0 0 2024-09-17T01:07:36.047 INFO:tasks.workunit.client.0.smithi103.stdout:8/777: dwrite d0/f44 [0,4194304] 0 2024-09-17T01:07:36.052 INFO:tasks.workunit.client.0.smithi103.stdout:8/778: rename d0/d80/fc7 to d0/d6/dc/d3d/d6d/d94/ff7 0 2024-09-17T01:07:36.061 INFO:tasks.workunit.client.0.smithi103.stdout:8/779: dread d0/d6/dc/d30/d25/d64/d34/f9f [0,4194304] 0 2024-09-17T01:07:36.064 INFO:tasks.workunit.client.0.smithi103.stdout:8/780: creat d0/d6/dc/d30/d25/d64/d34/d6e/ff8 x:0 0 0 2024-09-17T01:07:36.073 INFO:tasks.workunit.client.0.smithi103.stdout:8/781: dwrite d0/d6/dc/d3d/d6d/f76 [0,4194304] 0 2024-09-17T01:07:36.075 INFO:tasks.workunit.client.0.smithi103.stdout:8/782: dread - d0/d6/dc/d30/d25/d64/d59/fd1 zero size 2024-09-17T01:07:36.078 INFO:tasks.workunit.client.0.smithi103.stdout:8/783: symlink d0/d80/lf9 0 2024-09-17T01:07:36.364 INFO:tasks.workunit.client.0.smithi103.stdout:5/987: sync 2024-09-17T01:07:36.364 INFO:tasks.workunit.client.0.smithi103.stdout:8/784: sync 2024-09-17T01:07:36.375 INFO:tasks.workunit.client.0.smithi103.stdout:5/988: link d6/d2c/f35 d6/d2c/d38/db2/dba/d115/de1/df5/d14d/f159 0 2024-09-17T01:07:36.376 INFO:tasks.workunit.client.0.smithi103.stdout:8/785: creat d0/d6/dc/d30/d2d/ffa x:0 0 0 2024-09-17T01:07:36.383 INFO:tasks.workunit.client.0.smithi103.stdout:8/786: dwrite d0/d6/dc/d3d/d6d/fa3 [0,4194304] 0 2024-09-17T01:07:36.386 INFO:tasks.workunit.client.0.smithi103.stdout:8/787: write d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90/fe2 [815799,4393] 0 2024-09-17T01:07:36.392 INFO:tasks.workunit.client.0.smithi103.stdout:8/788: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/ffb x:0 0 0 2024-09-17T01:07:36.455 INFO:tasks.workunit.client.0.smithi103.stdout:5/989: write d6/d2c/dd7/ffe [928034,12320] 0 2024-09-17T01:07:36.459 INFO:tasks.workunit.client.0.smithi103.stdout:8/789: truncate d0/d6/dc/d30/d25/d64/d34/fa1 4167449 0 2024-09-17T01:07:36.461 INFO:tasks.workunit.client.0.smithi103.stdout:5/990: dwrite d6/db/f5c [0,4194304] 0 2024-09-17T01:07:36.462 INFO:tasks.workunit.client.0.smithi103.stdout:5/991: chown d6/d28/dcb/fec 107882 1 2024-09-17T01:07:36.469 INFO:tasks.workunit.client.0.smithi103.stdout:8/790: dwrite d0/d6/f10 [0,4194304] 0 2024-09-17T01:07:36.469 INFO:tasks.workunit.client.0.smithi103.stdout:5/992: dread d6/d2c/d32/d55/f13b [0,4194304] 0 2024-09-17T01:07:36.474 INFO:tasks.workunit.client.0.smithi103.stdout:8/791: rename d0/f93 to d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/ffc 0 2024-09-17T01:07:36.475 INFO:tasks.workunit.client.0.smithi103.stdout:5/993: link d6/d2c/d38/db2/dba/d115/de1/f13e d6/d2c/d38/d4c/de5/f15a 0 2024-09-17T01:07:36.476 INFO:tasks.workunit.client.0.smithi103.stdout:8/792: creat d0/d6/dc/d30/d86/dcd/ffd x:0 0 0 2024-09-17T01:07:36.476 INFO:tasks.workunit.client.0.smithi103.stdout:5/994: write d6/d2c/d38/d4c/d9a/f103 [3427474,64885] 0 2024-09-17T01:07:36.482 INFO:tasks.workunit.client.0.smithi103.stdout:8/793: read d0/d6/dc/d30/d86/fb9 [130425,80138] 0 2024-09-17T01:07:36.483 INFO:tasks.workunit.client.0.smithi103.stdout:5/995: getdents d6/d2c/d38/d4c/d9a/d114/d14a/d155 0 2024-09-17T01:07:36.483 INFO:tasks.workunit.client.0.smithi103.stdout:8/794: read - d0/d6/dc/d30/d2d/fdd zero size 2024-09-17T01:07:36.488 INFO:tasks.workunit.client.0.smithi103.stdout:5/996: unlink d6/d2c/d38/d4c/d50/c150 0 2024-09-17T01:07:36.489 INFO:tasks.workunit.client.0.smithi103.stdout:8/795: mkdir d0/d6/dc/d30/d25/d7d/dd6/dfe 0 2024-09-17T01:07:36.493 INFO:tasks.workunit.client.0.smithi103.stdout:8/796: dread d0/d6/dc/d30/d25/d64/d59/fe6 [0,4194304] 0 2024-09-17T01:07:36.495 INFO:tasks.workunit.client.0.smithi103.stdout:5/997: creat d6/d2c/d38/d4c/d9a/d114/f15b x:0 0 0 2024-09-17T01:07:36.500 INFO:tasks.workunit.client.0.smithi103.stdout:8/797: dwrite d0/d6/dc/d3d/d6d/fd0 [0,4194304] 0 2024-09-17T01:07:36.501 INFO:tasks.workunit.client.0.smithi103.stdout:8/798: chown d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90 3 1 2024-09-17T01:07:36.505 INFO:tasks.workunit.client.0.smithi103.stdout:8/799: mkdir d0/d6/dc/d30/d2d/de1/dff 0 2024-09-17T01:07:36.509 INFO:tasks.workunit.client.0.smithi103.stdout:8/800: dread d0/d6/f4f [0,4194304] 0 2024-09-17T01:07:36.518 INFO:tasks.workunit.client.0.smithi103.stdout:8/801: link d0/d6/dc/d30/d2d/fdd d0/d6/dc/d30/d25/f100 0 2024-09-17T01:07:36.523 INFO:tasks.workunit.client.0.smithi103.stdout:5/998: dwrite d6/d2c/d38/d4c/d54/fc2 [0,4194304] 0 2024-09-17T01:07:36.533 INFO:tasks.workunit.client.0.smithi103.stdout:8/802: rmdir d0/d6/dc/d30/d2d/de1/dff 0 2024-09-17T01:07:36.535 INFO:tasks.workunit.client.0.smithi103.stdout:5/999: chown d6/d11/d81/ldf 417 1 2024-09-17T01:07:36.541 INFO:tasks.workunit.client.0.smithi103.stdout:8/803: unlink d0/d6/dc/d30/d25/c5e 0 2024-09-17T01:07:36.545 INFO:tasks.workunit.client.0.smithi103.stdout:8/804: write d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90/fe2 [662142,49558] 0 2024-09-17T01:07:36.549 INFO:tasks.workunit.client.0.smithi103.stdout:8/805: write d0/d6/dc/d30/d25/fdb [1037869,72593] 0 2024-09-17T01:07:36.576 INFO:tasks.workunit.client.0.smithi103.stdout:8/806: dwrite d0/d6/dc/d30/d25/d64/d34/d6e/f7c [0,4194304] 0 2024-09-17T01:07:36.585 INFO:tasks.workunit.client.0.smithi103.stdout:8/807: rename d0/d6/dc/d3d/l84 to d0/d6/dc/d30/d25/l101 0 2024-09-17T01:07:36.586 INFO:tasks.workunit.client.0.smithi103.stdout:8/808: dread - d0/d6/dc/d30/d25/d64/d34/d6e/ff8 zero size 2024-09-17T01:07:36.593 INFO:tasks.workunit.client.0.smithi103.stdout:8/809: dwrite d0/d6/f77 [0,4194304] 0 2024-09-17T01:07:36.595 INFO:tasks.workunit.client.0.smithi103.stdout:8/810: write d0/f4c [1297153,47489] 0 2024-09-17T01:07:36.597 INFO:tasks.workunit.client.0.smithi103.stdout:8/811: readlink d0/d6/dc/d30/d25/d64/d34/d6e/l81 0 2024-09-17T01:07:36.597 INFO:tasks.workunit.client.0.smithi103.stdout:8/812: readlink d0/d6/dc/d3d/d6d/db8/ld2 0 2024-09-17T01:07:36.599 INFO:tasks.workunit.client.0.smithi103.stdout:8/813: creat d0/d80/f102 x:0 0 0 2024-09-17T01:07:36.601 INFO:tasks.workunit.client.0.smithi103.stdout:8/814: dread - d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/ffb zero size 2024-09-17T01:07:36.604 INFO:tasks.workunit.client.0.smithi103.stdout:8/815: creat d0/d6/dc/df1/f103 x:0 0 0 2024-09-17T01:07:36.608 INFO:tasks.workunit.client.0.smithi103.stdout:8/816: dread d0/d6/dc/d3d/d6d/f76 [0,4194304] 0 2024-09-17T01:07:37.152 INFO:tasks.workunit.client.0.smithi103.stdout:8/817: sync 2024-09-17T01:07:37.155 INFO:tasks.workunit.client.0.smithi103.stdout:8/818: dread d0/d6/fbb [0,4194304] 0 2024-09-17T01:07:37.157 INFO:tasks.workunit.client.0.smithi103.stdout:8/819: fdatasync d0/d6/dc/fb4 0 2024-09-17T01:07:37.159 INFO:tasks.workunit.client.0.smithi103.stdout:8/820: mkdir d0/d6/dc/d30/d2d/de1/d104 0 2024-09-17T01:07:37.161 INFO:tasks.workunit.client.0.smithi103.stdout:8/821: creat d0/d6/dc/d3d/f105 x:0 0 0 2024-09-17T01:07:37.163 INFO:tasks.workunit.client.0.smithi103.stdout:8/822: dread - d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/ffc zero size 2024-09-17T01:07:37.171 INFO:tasks.workunit.client.0.smithi103.stdout:8/823: write d0/d6/dc/d30/d25/d7d/fa0 [48144,1690] 0 2024-09-17T01:07:37.174 INFO:tasks.workunit.client.0.smithi103.stdout:8/824: creat d0/d6/dc/d30/d25/d64/d34/d6e/f106 x:0 0 0 2024-09-17T01:07:37.180 INFO:tasks.workunit.client.0.smithi103.stdout:8/825: dwrite d0/d6/dc/d30/d25/d64/d34/f47 [4194304,4194304] 0 2024-09-17T01:07:37.183 INFO:tasks.workunit.client.0.smithi103.stdout:8/826: mkdir d0/d6/dc/d30/d2d/d107 0 2024-09-17T01:07:37.184 INFO:tasks.workunit.client.0.smithi103.stdout:8/827: stat d0/d6/dc/d30/d25 0 2024-09-17T01:07:37.191 INFO:tasks.workunit.client.0.smithi103.stdout:8/828: dwrite d0/d6/dc/d30/d86/dcd/fe8 [0,4194304] 0 2024-09-17T01:07:37.193 INFO:tasks.workunit.client.0.smithi103.stdout:8/829: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d108 0 2024-09-17T01:07:37.198 INFO:tasks.workunit.client.0.smithi103.stdout:8/830: getdents d0/d6/dc/d30/d25/d7d/d99 0 2024-09-17T01:07:37.205 INFO:tasks.workunit.client.0.smithi103.stdout:8/831: dwrite d0/d6/dc/d30/d86/fea [0,4194304] 0 2024-09-17T01:07:37.207 INFO:tasks.workunit.client.0.smithi103.stdout:8/832: symlink d0/d6/dc/d30/d2d/d107/l109 0 2024-09-17T01:07:37.209 INFO:tasks.workunit.client.0.smithi103.stdout:8/833: stat d0/d6/dc/d30/d25/d64/d34/d6e/d108 0 2024-09-17T01:07:37.209 INFO:tasks.workunit.client.0.smithi103.stdout:8/834: readlink d0/d6/dc/d3d/l4a 0 2024-09-17T01:07:37.212 INFO:tasks.workunit.client.0.smithi103.stdout:8/835: symlink d0/d6/dc/d30/d86/dcd/l10a 0 2024-09-17T01:07:37.215 INFO:tasks.workunit.client.0.smithi103.stdout:8/836: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/d90/f10b x:0 0 0 2024-09-17T01:07:37.216 INFO:tasks.workunit.client.0.smithi103.stdout:8/837: chown d0/d6/dc/ff2 32196 1 2024-09-17T01:07:37.219 INFO:tasks.workunit.client.0.smithi103.stdout:8/838: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/db6/f10c x:0 0 0 2024-09-17T01:07:37.221 INFO:tasks.workunit.client.0.smithi103.stdout:8/839: unlink d0/d80/fde 0 2024-09-17T01:07:37.226 INFO:tasks.workunit.client.0.smithi103.stdout:8/840: getdents d0/d6/dc/d30/d2d 0 2024-09-17T01:07:37.227 INFO:tasks.workunit.client.0.smithi103.stdout:8/841: stat d0/l55 0 2024-09-17T01:07:37.230 INFO:tasks.workunit.client.0.smithi103.stdout:8/842: truncate d0/d6/dc/d30/d25/d64/d59/fd1 512686 0 2024-09-17T01:07:37.238 INFO:tasks.workunit.client.0.smithi103.stdout:8/843: truncate d0/d6/dc/d30/d25/d64/d59/f82 318056 0 2024-09-17T01:07:37.240 INFO:tasks.workunit.client.0.smithi103.stdout:8/844: creat d0/d6/dc/d30/d86/dcd/f10d x:0 0 0 2024-09-17T01:07:37.250 INFO:tasks.workunit.client.0.smithi103.stdout:8/845: dwrite d0/d6/dc/d3d/fd5 [0,4194304] 0 2024-09-17T01:07:37.257 INFO:tasks.workunit.client.0.smithi103.stdout:8/846: dwrite d0/d6/dc/d30/d2d/f3c [0,4194304] 0 2024-09-17T01:07:37.261 INFO:tasks.workunit.client.0.smithi103.stdout:8/847: truncate d0/d6/dc/d30/d25/f74 574118 0 2024-09-17T01:07:37.262 INFO:tasks.workunit.client.0.smithi103.stdout:8/848: readlink d0/d6/dc/d30/d25/d64/d34/d6e/la9 0 2024-09-17T01:07:37.284 INFO:tasks.workunit.client.0.smithi103.stdout:8/849: dread d0/d6/dc/d30/d25/d7d/faf [0,4194304] 0 2024-09-17T01:07:37.287 INFO:tasks.workunit.client.0.smithi103.stdout:8/850: mkdir d0/d6/dc/d30/d25/d7d/dd6/dfe/d10e 0 2024-09-17T01:07:37.289 INFO:tasks.workunit.client.0.smithi103.stdout:8/851: rmdir d0/d6/dc/d30/d25/d7d 39 2024-09-17T01:07:37.291 INFO:tasks.workunit.client.0.smithi103.stdout:8/852: mkdir d0/d6/dc/d3d/d88/d10f 0 2024-09-17T01:07:37.303 INFO:tasks.workunit.client.0.smithi103.stdout:8/853: creat d0/d6/dc/d30/d86/dcd/f110 x:0 0 0 2024-09-17T01:07:37.306 INFO:tasks.workunit.client.0.smithi103.stdout:8/854: dread d0/d6/dc/d30/d25/d64/d34/f9f [0,4194304] 0 2024-09-17T01:07:37.307 INFO:tasks.workunit.client.0.smithi103.stdout:8/855: chown d0/d6/dc/d30/d25/d64/f46 15746 1 2024-09-17T01:07:37.309 INFO:tasks.workunit.client.0.smithi103.stdout:8/856: fsync d0/d6/dc/d30/f7f 0 2024-09-17T01:07:37.312 INFO:tasks.workunit.client.0.smithi103.stdout:8/857: truncate d0/d6/dc/d30/d25/d64/d34/d6e/d72/db6/fec 66271 0 2024-09-17T01:07:37.313 INFO:tasks.workunit.client.0.smithi103.stdout:8/858: dread - d0/d6/dc/d3d/d88/fba zero size 2024-09-17T01:07:37.315 INFO:tasks.workunit.client.0.smithi103.stdout:8/859: dread d0/d6/dc/d30/d25/d64/d59/fe6 [0,4194304] 0 2024-09-17T01:07:37.316 INFO:tasks.workunit.client.0.smithi103.stdout:8/860: write d0/d6/dc/d30/d25/d64/f46 [1110117,644] 0 2024-09-17T01:07:37.320 INFO:tasks.workunit.client.0.smithi103.stdout:8/861: rmdir d0/d6/dc/d30/d25 39 2024-09-17T01:07:37.322 INFO:tasks.workunit.client.0.smithi103.stdout:8/862: symlink d0/d6/dc/d30/d2d/de1/l111 0 2024-09-17T01:07:37.323 INFO:tasks.workunit.client.0.smithi103.stdout:8/863: read d0/f3e [339496,74762] 0 2024-09-17T01:07:37.324 INFO:tasks.workunit.client.0.smithi103.stdout:8/864: chown d0/d6/dc/d30/lb7 88 1 2024-09-17T01:07:37.456 INFO:tasks.workunit.client.0.smithi103.stdout:8/865: creat d0/d6/dc/d3d/d6d/f112 x:0 0 0 2024-09-17T01:07:37.463 INFO:tasks.workunit.client.0.smithi103.stdout:8/866: mkdir d0/d6/dc/d30/d25/d64/d34/d6e/d113 0 2024-09-17T01:07:37.464 INFO:tasks.workunit.client.0.smithi103.stdout:8/867: dread - d0/d6/dc/d30/d86/dcd/f10d zero size 2024-09-17T01:07:37.469 INFO:tasks.workunit.client.0.smithi103.stdout:8/868: dread d0/d6/dc/d3d/d6d/fd0 [0,4194304] 0 2024-09-17T01:07:37.474 INFO:tasks.workunit.client.0.smithi103.stdout:8/869: creat d0/d6/dc/d30/d25/d64/d34/d6e/d72/df0/f114 x:0 0 0 2024-09-17T01:07:37.514 INFO:tasks.workunit.client.0.smithi103.stdout:8/870: rmdir d0/d6/dc 39 2024-09-17T01:07:37.519 INFO:tasks.workunit.client.0.smithi103.stdout:8/871: read d0/d6/dc/d30/d25/d64/d34/f47 [250247,128153] 0 2024-09-17T01:07:37.522 INFO:tasks.workunit.client.0.smithi103.stdout:8/872: mknod d0/d6/dc/d30/d25/d7d/d99/c115 0 2024-09-17T01:07:37.525 INFO:tasks.workunit.client.0.smithi103.stdout:8/873: creat d0/f116 x:0 0 0 2024-09-17T01:07:37.525 INFO:tasks.workunit.client.0.smithi103.stdout:8/874: read - d0/f116 zero size 2024-09-17T01:07:37.526 INFO:tasks.workunit.client.0.smithi103.stdout:8/875: chown d0/d6/dc/d30/d2d/de1 87 1 2024-09-17T01:07:37.527 INFO:tasks.workunit.client.0.smithi103.stdout:8/876: read d0/d6/dc/d30/d25/d7d/faf [3135128,87725] 0 2024-09-17T01:07:37.528 INFO:tasks.workunit.client.0.smithi103.stdout:8/877: readlink d0/d6/dc/d30/d25/d64/d34/leb 0 2024-09-17T01:07:37.533 INFO:tasks.workunit.client.0.smithi103.stdout:8/878: rename d0/d6/dc/d30/d86/dcd/l10a to d0/d6/dc/d30/d25/d64/d34/d6e/d72/d8e/da2/dac/l117 0 2024-09-17T01:07:37.535 INFO:tasks.workunit.client.0.smithi103.stdout:8/879: symlink d0/d6/dc/d30/d25/d64/d34/d6e/d72/da6/l118 0 2024-09-17T01:07:37.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:37 smithi103 ceph-mon[28156]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 54 MiB/s rd, 131 MiB/s wr, 409 op/s 2024-09-17T01:07:37.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:37 smithi143 ceph-mon[35452]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 54 MiB/s rd, 131 MiB/s wr, 409 op/s 2024-09-17T01:07:38.249 INFO:tasks.workunit.client.0.smithi103.stdout:8/880: sync 2024-09-17T01:07:38.254 INFO:tasks.workunit.client.0.smithi103.stdout:8/881: truncate d0/d6/dc/d30/d86/f9e 3856955 0 2024-09-17T01:07:38.256 INFO:tasks.workunit.client.0.smithi103.stdout:8/882: creat d0/d6/dc/d3d/d6d/d94/f119 x:0 0 0 2024-09-17T01:07:38.259 INFO:tasks.workunit.client.0.smithi103.stdout:8/883: getdents d0/d6/dc/d30/d25/d64/d34/d6e/d113 0 2024-09-17T01:07:38.260 INFO:tasks.workunit.client.0.smithi103.stdout:8/884: read - d0/d6/dc/d30/d25/d64/d34/d6e/d72/df0/ff5 zero size 2024-09-17T01:07:38.261 INFO:tasks.workunit.client.0.smithi103.stdout:8/885: dread - d0/d80/f102 zero size 2024-09-17T01:07:38.266 INFO:tasks.workunit.client.0.smithi103.stdout:8/886: link d0/d6/dc/d30/d25/d7d/d99/fd7 d0/d6/dc/d3d/d6d/d94/f11a 0 2024-09-17T01:07:38.267 INFO:tasks.workunit.client.0.smithi103.stdout:8/887: read - d0/d6/dc/df1/f103 zero size 2024-09-17T01:07:38.269 INFO:tasks.workunit.client.0.smithi103.stdout:8/888: creat d0/d6/dc/d30/d2d/f11b x:0 0 0 2024-09-17T01:07:38.272 INFO:tasks.workunit.client.0.smithi103.stdout:8/889: rename d0/d6/dc/d30/d25/d64/d34/fe7 to d0/d6/dc/d30/d25/d64/f11c 0 2024-09-17T01:07:38.276 INFO:tasks.workunit.client.0.smithi103.stdout:8/890: rename d0/d6/dc/d30/d25/d64/d34/d6e/d72 to d0/d6/dc/d30/d25/d11d 0 2024-09-17T01:07:38.282 INFO:tasks.workunit.client.0.smithi103.stdout:8/891: dwrite d0/d6/dc/d30/d25/d11d/d8e/da2/fe9 [0,4194304] 0 2024-09-17T01:07:38.287 INFO:tasks.workunit.client.0.smithi103.stdout:8/892: dread d0/d6/dc/d3d/d88/fb3 [0,4194304] 0 2024-09-17T01:07:38.288 INFO:tasks.workunit.client.0.smithi103.stdout:8/893: dread - d0/d6/fd3 zero size 2024-09-17T01:07:38.289 INFO:tasks.workunit.client.0.smithi103.stdout:8/894: read d0/d6/dc/d3d/fd5 [1924954,103251] 0 2024-09-17T01:07:38.293 INFO:tasks.workunit.client.0.smithi103.stdout:8/895: rename d0/d6/dc/d3d/d6d/l73 to d0/d6/dc/d3d/l11e 0 2024-09-17T01:07:38.295 INFO:tasks.workunit.client.0.smithi103.stdout:8/896: write d0/d6/dc/d3d/d88/fb3 [5027700,123986] 0 2024-09-17T01:07:38.298 INFO:tasks.workunit.client.0.smithi103.stdout:8/897: symlink d0/d6/dc/d3d/d6d/d94/l11f 0 2024-09-17T01:07:38.300 INFO:tasks.workunit.client.0.smithi103.stdout:8/898: creat d0/d6/dc/d30/d25/d64/f120 x:0 0 0 2024-09-17T01:07:38.301 INFO:tasks.workunit.client.0.smithi103.stdout:8/899: symlink d0/d6/dc/d30/d25/d7d/dd6/l121 0 2024-09-17T01:07:38.315 INFO:tasks.workunit.client.0.smithi103.stdout:8/900: dread d0/d6/dc/fb4 [0,4194304] 0 2024-09-17T01:07:38.318 INFO:tasks.workunit.client.0.smithi103.stdout:8/901: write d0/d6/dc/d30/d2d/f11b [124542,42845] 0 2024-09-17T01:07:38.320 INFO:tasks.workunit.client.0.smithi103.stdout:8/902: rmdir d0/d6/dc/d30/d25 39 2024-09-17T01:07:38.322 INFO:tasks.workunit.client.0.smithi103.stdout:8/903: read d0/d6/dc/d30/f7f [2882039,63300] 0 2024-09-17T01:07:38.323 INFO:tasks.workunit.client.0.smithi103.stdout:8/904: dread - d0/d6/dc/df1/f103 zero size 2024-09-17T01:07:38.342 INFO:tasks.workunit.client.0.smithi103.stdout:8/905: dwrite d0/d6/dc/d30/d25/f100 [0,4194304] 0 2024-09-17T01:07:38.345 INFO:tasks.workunit.client.0.smithi103.stdout:8/906: mknod d0/d80/c122 0 2024-09-17T01:07:38.348 INFO:tasks.workunit.client.0.smithi103.stdout:8/907: unlink d0/d80/f102 0 2024-09-17T01:07:38.352 INFO:tasks.workunit.client.0.smithi103.stdout:8/908: mknod d0/d6/dc/c123 0 2024-09-17T01:07:38.354 INFO:tasks.workunit.client.0.smithi103.stdout:8/909: truncate d0/d6/dc/d30/d25/d64/d34/f9f 1825316 0 2024-09-17T01:07:38.363 INFO:tasks.workunit.client.0.smithi103.stdout:8/910: rmdir d0/d6/dc/d30/d25/d64/d34/d6e/d108 0 2024-09-17T01:07:38.363 INFO:tasks.workunit.client.0.smithi103.stdout:8/911: fdatasync d0/d6/dc/d30/d2d/fda 0 2024-09-17T01:07:38.364 INFO:tasks.workunit.client.0.smithi103.stdout:8/912: write d0/d6/dc/d3d/d6d/d94/f119 [886495,41253] 0 2024-09-17T01:07:38.366 INFO:tasks.workunit.client.0.smithi103.stdout:8/913: chown d0/d6/dc/d30/d86/dcd/fe8 2592561 1 2024-09-17T01:07:38.372 INFO:tasks.workunit.client.0.smithi103.stdout:8/914: dwrite d0/d6/dc/d30/d86/fea [0,4194304] 0 2024-09-17T01:07:38.377 INFO:tasks.workunit.client.0.smithi103.stdout:8/915: rename d0/d6/dc/d3d/d6d/d94/l11f to d0/d6/dc/d30/d25/d64/d34/l124 0 2024-09-17T01:07:38.378 INFO:tasks.workunit.client.0.smithi103.stdout:8/916: write d0/d6/dc/d30/d25/d7d/fa0 [435026,18002] 0 2024-09-17T01:07:38.381 INFO:tasks.workunit.client.0.smithi103.stdout:8/917: creat d0/d6/dc/d30/d25/d11d/d8e/da2/f125 x:0 0 0 2024-09-17T01:07:38.383 INFO:tasks.workunit.client.0.smithi103.stdout:8/918: stat d0/d6/dc/d3d/d6d/d94/ff7 0 2024-09-17T01:07:38.387 INFO:tasks.workunit.client.0.smithi103.stdout:8/919: chown d0/d6/dc/d30/d2d/de1/lf3 310 1 2024-09-17T01:07:38.421 INFO:tasks.workunit.client.0.smithi103.stdout:8/920: rename d0/d6/dc/d30/d25/d11d/d8e/da2 to d0/d6/dc/d30/d25/d64/d126 0 2024-09-17T01:07:38.427 INFO:tasks.workunit.client.0.smithi103.stdout:8/921: creat d0/d6/dc/d30/d25/d11d/df0/f127 x:0 0 0 2024-09-17T01:07:38.433 INFO:tasks.workunit.client.0.smithi103.stdout:8/922: rename d0/d6/dc/d30/d25/d7d/dd6/dfe/d10e to d0/d6/dc/d30/d25/d11d/d128 0 2024-09-17T01:07:38.438 INFO:tasks.workunit.client.0.smithi103.stdout:8/923: dread d0/d6/dc/d30/d86/fb9 [0,4194304] 0 2024-09-17T01:07:38.445 INFO:tasks.workunit.client.0.smithi103.stdout:8/924: rename d0/d6/dc/d30/d2d/de1/lf3 to d0/d6/dc/l129 0 2024-09-17T01:07:38.461 INFO:tasks.workunit.client.0.smithi103.stdout:8/925: write d0/d6/dc/d3d/d6d/db8/fc9 [542735,44159] 0 2024-09-17T01:07:38.462 INFO:tasks.workunit.client.0.smithi103.stdout:8/926: chown d0/d6/dc/d3d/d6d/fa3 449 1 2024-09-17T01:07:38.478 INFO:tasks.workunit.client.0.smithi103.stdout:8/927: write d0/d6/dc/d3d/d6d/d94/f11a [1365461,42835] 0 2024-09-17T01:07:38.482 INFO:tasks.workunit.client.0.smithi103.stdout:8/928: creat d0/f12a x:0 0 0 2024-09-17T01:07:38.484 INFO:tasks.workunit.client.0.smithi103.stdout:8/929: creat d0/d6/dc/d30/d25/d7d/d99/f12b x:0 0 0 2024-09-17T01:07:38.485 INFO:tasks.workunit.client.0.smithi103.stdout:8/930: write d0/d6/dc/d30/d25/d7d/d99/fd7 [4919699,93706] 0 2024-09-17T01:07:38.488 INFO:tasks.workunit.client.0.smithi103.stdout:8/931: mkdir d0/d6/dc/d30/d25/d11d/df0/d12c 0 2024-09-17T01:07:38.489 INFO:tasks.workunit.client.0.smithi103.stdout:8/932: symlink d0/d6/dc/df1/l12d 0 2024-09-17T01:07:38.492 INFO:tasks.workunit.client.0.smithi103.stdout:8/933: getdents d0/d6/dc 0 2024-09-17T01:07:38.495 INFO:tasks.workunit.client.0.smithi103.stdout:8/934: write d0/d6/f1c [7127951,123745] 0 2024-09-17T01:07:38.498 INFO:tasks.workunit.client.0.smithi103.stdout:8/935: symlink d0/d6/dc/d30/d25/d11d/df0/l12e 0 2024-09-17T01:07:38.506 INFO:tasks.workunit.client.0.smithi103.stdout:8/936: dread d0/d6/dc/d30/d86/fe4 [0,4194304] 0 2024-09-17T01:07:38.507 INFO:tasks.workunit.client.0.smithi103.stdout:8/937: chown d0/d6/dc/d30/d25/d64/f4d 42 1 2024-09-17T01:07:38.510 INFO:tasks.workunit.client.0.smithi103.stdout:8/938: mknod d0/d6/dc/d30/d25/d11d/d90/c12f 0 2024-09-17T01:07:38.512 INFO:tasks.workunit.client.0.smithi103.stdout:8/939: creat d0/d6/dc/d3d/d6d/db8/f130 x:0 0 0 2024-09-17T01:07:38.514 INFO:tasks.workunit.client.0.smithi103.stdout:8/940: chown d0/d6/dc/d30/d2d/ccc 125497026 1 2024-09-17T01:07:38.526 INFO:tasks.workunit.client.0.smithi103.stdout:8/941: truncate d0/d6/dc/d30/d2d/f3c 1769375 0 2024-09-17T01:07:38.526 INFO:tasks.workunit.client.0.smithi103.stdout:8/942: chown d0/d6/dc/d30/d25/d11d/da6/lc3 1 1 2024-09-17T01:07:38.531 INFO:tasks.workunit.client.0.smithi103.stdout:8/943: link d0/d6/dc/d30/lb7 d0/d6/dc/d30/d25/d7d/dd6/dfe/l131 0 2024-09-17T01:07:38.534 INFO:tasks.workunit.client.0.smithi103.stdout:8/944: dread d0/f4e [0,4194304] 0 2024-09-17T01:07:38.537 INFO:tasks.workunit.client.0.smithi103.stdout:8/945: dread d0/d6/dc/d30/d2d/f60 [0,4194304] 0 2024-09-17T01:07:38.540 INFO:tasks.workunit.client.0.smithi103.stdout:8/946: symlink d0/d6/dc/d3d/d6d/db8/l132 0 2024-09-17T01:07:38.544 INFO:tasks.workunit.client.0.smithi103.stdout:8/947: dread d0/d6/dc/d30/d25/f100 [0,4194304] 0 2024-09-17T01:07:38.545 INFO:tasks.workunit.client.0.smithi103.stdout:8/948: fsync d0/d6/dc/d30/d25/d7d/d99/fd7 0 2024-09-17T01:07:38.548 INFO:tasks.workunit.client.0.smithi103.stdout:8/949: unlink d0/d6/dc/l129 0 2024-09-17T01:07:38.557 INFO:tasks.workunit.client.0.smithi103.stdout:8/950: read d0/d6/dc/d3d/f40 [96672,53031] 0 2024-09-17T01:07:38.561 INFO:tasks.workunit.client.0.smithi103.stdout:8/951: unlink d0/d6/dc/d30/d25/l31 0 2024-09-17T01:07:38.562 INFO:tasks.workunit.client.0.smithi103.stdout:8/952: write d0/d6/dc/d30/d25/d64/d126/fe9 [242752,38707] 0 2024-09-17T01:07:38.564 INFO:tasks.workunit.client.0.smithi103.stdout:8/953: write d0/d6/dc/d3d/d6d/fa3 [4446661,55989] 0 2024-09-17T01:07:38.568 INFO:tasks.workunit.client.0.smithi103.stdout:8/954: creat d0/d6/dc/d30/d25/d64/d34/d6e/d113/f133 x:0 0 0 2024-09-17T01:07:38.569 INFO:tasks.workunit.client.0.smithi103.stdout:8/955: chown d0/d6/dc/d30/d25/d11d/d90/cc5 5 1 2024-09-17T01:07:38.569 INFO:tasks.workunit.client.0.smithi103.stdout:8/956: stat d0/d6/dc/d3d/d88/cf4 0 2024-09-17T01:07:38.570 INFO:tasks.workunit.client.0.smithi103.stdout:8/957: dread - d0/d6/dc/d30/d25/d11d/d90/f10b zero size 2024-09-17T01:07:38.573 INFO:tasks.workunit.client.0.smithi103.stdout:8/958: mknod d0/d6/dc/d30/d25/d7d/dd6/c134 0 2024-09-17T01:07:38.574 INFO:tasks.workunit.client.0.smithi103.stdout:8/959: fdatasync d0/d6/f1c 0 2024-09-17T01:07:38.581 INFO:tasks.workunit.client.0.smithi103.stdout:8/960: write d0/d6/fd3 [695708,107990] 0 2024-09-17T01:07:38.583 INFO:tasks.workunit.client.0.smithi103.stdout:8/961: write d0/d6/dc/d30/d25/d64/d126/fe9 [3628162,130291] 0 2024-09-17T01:07:38.585 INFO:tasks.workunit.client.0.smithi103.stdout:8/962: write d0/d6/dc/d3d/d6d/fa3 [1543883,11731] 0 2024-09-17T01:07:38.588 INFO:tasks.workunit.client.0.smithi103.stdout:8/963: mkdir d0/d6/dc/d3d/d88/d10f/d135 0 2024-09-17T01:07:38.593 INFO:tasks.workunit.client.0.smithi103.stdout:8/964: getdents d0/d6/dc/d30/d25/d64/d126 0 2024-09-17T01:07:38.595 INFO:tasks.workunit.client.0.smithi103.stdout:8/965: read d0/d6/dc/d30/d25/d64/d34/f9f [734993,2309] 0 2024-09-17T01:07:38.596 INFO:tasks.workunit.client.0.smithi103.stdout:8/966: creat d0/d6/dc/d30/d25/d11d/d90/f136 x:0 0 0 2024-09-17T01:07:38.598 INFO:tasks.workunit.client.0.smithi103.stdout:8/967: symlink d0/d80/l137 0 2024-09-17T01:07:38.600 INFO:tasks.workunit.client.0.smithi103.stdout:8/968: truncate d0/d6/dc/d30/d25/d11d/db6/fec 353218 0 2024-09-17T01:07:38.605 INFO:tasks.workunit.client.0.smithi103.stdout:8/969: rename d0/d6/dc/d30/d25/d7d/lc0 to d0/d6/dc/d30/d2d/l138 0 2024-09-17T01:07:38.616 INFO:tasks.workunit.client.0.smithi103.stdout:8/970: dwrite d0/d6/dc/d3d/d6d/f8c [0,4194304] 0 2024-09-17T01:07:38.622 INFO:tasks.workunit.client.0.smithi103.stdout:8/971: mkdir d0/d6/dc/d30/d139 0 2024-09-17T01:07:38.639 INFO:tasks.workunit.client.0.smithi103.stdout:8/972: dwrite d0/d6/dc/d30/d25/d11d/d8e/ffc [0,4194304] 0 2024-09-17T01:07:38.644 INFO:tasks.workunit.client.0.smithi103.stdout:8/973: mknod d0/d6/dc/c13a 0 2024-09-17T01:07:38.649 INFO:tasks.workunit.client.0.smithi103.stdout:8/974: unlink d0/d6/dc/d30/c61 0 2024-09-17T01:07:38.656 INFO:tasks.workunit.client.0.smithi103.stdout:8/975: link d0/d6/dc/d30/d25/d64/d59/f5f d0/d6/dc/d30/d25/d11d/da6/f13b 0 2024-09-17T01:07:38.662 INFO:tasks.workunit.client.0.smithi103.stdout:8/976: dwrite d0/d6/dc/d30/d86/dcd/f10d [0,4194304] 0 2024-09-17T01:07:38.675 INFO:tasks.workunit.client.0.smithi103.stdout:8/977: write d0/d6/dc/d3d/d88/fc6 [1138792,126061] 0 2024-09-17T01:07:38.677 INFO:tasks.workunit.client.0.smithi103.stdout:8/978: chown d0/d6/dc/df1/f103 1267906133 1 2024-09-17T01:07:38.679 INFO:tasks.workunit.client.0.smithi103.stdout:8/979: write d0/d6/dc/d30/d25/d7d/fa0 [1129988,63199] 0 2024-09-17T01:07:38.685 INFO:tasks.workunit.client.0.smithi103.stdout:8/980: dwrite d0/d6/dc/d3d/d6d/fa3 [0,4194304] 0 2024-09-17T01:07:38.687 INFO:tasks.workunit.client.0.smithi103.stdout:8/981: write d0/d6/dc/d30/d25/d11d/d8e/ffc [3182174,3187] 0 2024-09-17T01:07:38.698 INFO:tasks.workunit.client.0.smithi103.stdout:8/982: write d0/d6/dc/d3d/f7e [3727431,129900] 0 2024-09-17T01:07:38.701 INFO:tasks.workunit.client.0.smithi103.stdout:8/983: mkdir d0/d6/dc/d30/d25/d64/d34/d13c 0 2024-09-17T01:07:38.703 INFO:tasks.workunit.client.0.smithi103.stdout:8/984: creat d0/d6/dc/d30/d25/d11d/df0/f13d x:0 0 0 2024-09-17T01:07:38.706 INFO:tasks.workunit.client.0.smithi103.stdout:8/985: unlink d0/d6/dc/d30/d25/d11d/da6/l118 0 2024-09-17T01:07:38.709 INFO:tasks.workunit.client.0.smithi103.stdout:8/986: creat d0/d6/dc/d30/d25/d64/d34/d6e/d113/f13e x:0 0 0 2024-09-17T01:07:38.710 INFO:tasks.workunit.client.0.smithi103.stdout:8/987: chown d0/d6/f3b 3014457 1 2024-09-17T01:07:38.711 INFO:tasks.workunit.client.0.smithi103.stdout:8/988: write d0/d6/dc/d30/d25/d11d/d8e/ffc [1206473,12924] 0 2024-09-17T01:07:38.722 INFO:tasks.workunit.client.0.smithi103.stdout:8/989: write d0/d6/dc/d30/d25/d64/d59/f5f [1526241,15414] 0 2024-09-17T01:07:38.723 INFO:tasks.workunit.client.0.smithi103.stdout:8/990: chown d0/d6/dc/d30/f66 659 1 2024-09-17T01:07:38.724 INFO:tasks.workunit.client.0.smithi103.stdout:8/991: fdatasync d0/d6/dc/d30/d25/d64/d34/d6e/d113/f13e 0 2024-09-17T01:07:38.726 INFO:tasks.workunit.client.0.smithi103.stdout:8/992: symlink d0/d6/dc/d30/d25/d11d/l13f 0 2024-09-17T01:07:38.730 INFO:tasks.workunit.client.0.smithi103.stdout:8/993: dread d0/d6/f39 [0,4194304] 0 2024-09-17T01:07:38.732 INFO:tasks.workunit.client.0.smithi103.stdout:8/994: truncate d0/d6/dc/d30/d25/d7d/d99/f12b 80592 0 2024-09-17T01:07:38.735 INFO:tasks.workunit.client.0.smithi103.stdout:8/995: unlink d0/d6/dc/d3d/d88/ce0 0 2024-09-17T01:07:38.758 INFO:tasks.workunit.client.0.smithi103.stdout:8/996: dwrite d0/d6/dc/d3d/fad [0,4194304] 0 2024-09-17T01:07:38.759 INFO:tasks.workunit.client.0.smithi103.stdout:8/997: fdatasync d0/d6/dc/d30/d25/d7d/fa0 0 2024-09-17T01:07:38.764 INFO:tasks.workunit.client.0.smithi103.stdout:8/998: creat d0/d6/dc/d30/d25/d64/d34/d6e/f140 x:0 0 0 2024-09-17T01:07:38.767 INFO:tasks.workunit.client.0.smithi103.stdout:8/999: symlink d0/d6/dc/d30/d25/d11d/da6/l141 0 2024-09-17T01:07:38.772 INFO:tasks.workunit.client.0.smithi103.stderr:+ rm -rf -- ./tmp.qbfPf0fcsU 2024-09-17T01:07:39.624 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:39 smithi103 ceph-mon[28156]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 35 MiB/s rd, 86 MiB/s wr, 272 op/s 2024-09-17T01:07:39.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:39 smithi143 ceph-mon[35452]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 35 MiB/s rd, 86 MiB/s wr, 272 op/s 2024-09-17T01:07:41.417 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:41 smithi103 ceph-mon[28156]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 35 MiB/s rd, 86 MiB/s wr, 272 op/s 2024-09-17T01:07:41.417 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:41 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:41.417 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:41 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:41.417 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:41 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:07:41.418 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:41 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:41.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:41 smithi143 ceph-mon[35452]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 35 MiB/s rd, 86 MiB/s wr, 272 op/s 2024-09-17T01:07:41.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:41 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:41.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:41 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:41.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:41 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:07:41.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:41 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:42 smithi103 ceph-mon[28156]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:07:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:42 smithi103 ceph-mon[28156]: Upgrade: Need to upgrade myself (mgr.smithi143.sxhocv) 2024-09-17T01:07:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:42 smithi103 ceph-mon[28156]: Upgrade: Need to upgrade myself (mgr.smithi143.sxhocv) 2024-09-17T01:07:42.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:42 smithi143 ceph-mon[35452]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:07:42.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:42 smithi143 ceph-mon[35452]: Upgrade: Need to upgrade myself (mgr.smithi143.sxhocv) 2024-09-17T01:07:42.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:42 smithi143 ceph-mon[35452]: Upgrade: Need to upgrade myself (mgr.smithi143.sxhocv) 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: pgmap v32: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 98 MiB/s wr, 400 op/s 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: Upgrade: Updating mgr.smithi103.efjaur 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:43 smithi103 ceph-mon[28156]: Deploying daemon mgr.smithi103.efjaur on smithi103 2024-09-17T01:07:43.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: pgmap v32: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 98 MiB/s wr, 400 op/s 2024-09-17T01:07:43.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: Upgrade: Updating mgr.smithi103.efjaur 2024-09-17T01:07:43.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:43.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:43.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:43.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:07:43.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:43.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:43 smithi143 ceph-mon[35452]: Deploying daemon mgr.smithi103.efjaur on smithi103 2024-09-17T01:07:44.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:44 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:44.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:44 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:45.657 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:45 smithi143 ceph-mon[35452]: pgmap v33: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 17 MiB/s rd, 47 MiB/s wr, 250 op/s 2024-09-17T01:07:45.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:45 smithi103 ceph-mon[28156]: pgmap v33: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 17 MiB/s rd, 47 MiB/s wr, 250 op/s 2024-09-17T01:07:47.620 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:47 smithi103 ceph-mon[28156]: pgmap v34: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 47 MiB/s wr, 398 op/s 2024-09-17T01:07:47.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:47 smithi143 ceph-mon[35452]: pgmap v34: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 47 MiB/s wr, 398 op/s 2024-09-17T01:07:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:49 smithi103 ceph-mon[28156]: pgmap v35: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 276 op/s 2024-09-17T01:07:49.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:49 smithi143 ceph-mon[35452]: pgmap v35: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 276 op/s 2024-09-17T01:07:51.359 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:51 smithi103 ceph-mon[28156]: pgmap v36: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 276 op/s 2024-09-17T01:07:51.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:51 smithi143 ceph-mon[35452]: pgmap v36: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 276 op/s 2024-09-17T01:07:52.670 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:52 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:52.670 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:52 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:52.670 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:52 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:52.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:52 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:52.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:52 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:07:52.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:52 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:53.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:53 smithi103 ceph-mon[28156]: pgmap v37: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 436 op/s 2024-09-17T01:07:53.710 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:53 smithi143 ceph-mon[35452]: pgmap v37: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 436 op/s 2024-09-17T01:07:55.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:55 smithi103 ceph-mon[28156]: pgmap v38: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 308 op/s 2024-09-17T01:07:55.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:55 smithi143 ceph-mon[35452]: pgmap v38: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 308 op/s 2024-09-17T01:07:57.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:57 smithi103 ceph-mon[28156]: pgmap v39: 65 pgs: 65 active+clean; 787 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-09-17T01:07:57.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:57 smithi143 ceph-mon[35452]: pgmap v39: 65 pgs: 65 active+clean; 787 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-09-17T01:07:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 -- 172.21.15.103:0/4287450212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 msgr2=0x7f45881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 --2- 172.21.15.103:0/4287450212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f45881029b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f457c0098b0 tx=0x7f457c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 -- 172.21.15.103:0/4287450212 shutdown_connections 2024-09-17T01:07:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 --2- 172.21.15.103:0/4287450212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 0x7f45881052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 --2- 172.21.15.103:0/4287450212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f45881029b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 -- 172.21.15.103:0/4287450212 >> 172.21.15.103:0/4287450212 conn(0x7f45880fa1c0 msgr2=0x7f45880fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 -- 172.21.15.103:0/4287450212 shutdown_connections 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.183+0000 7f458ea98640 1 -- 172.21.15.103:0/4287450212 wait complete. 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458ea98640 1 Processor -- start 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458ea98640 1 -- start start 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458ea98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f4588195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458ea98640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 0x7f4588195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458ea98640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588196190 con 0x7f45881005c0 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458ea98640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588196300 con 0x7f4588102ef0 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458c834640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f4588195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458c834640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f4588195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32844/0 (socket says 172.21.15.103:32844) 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458c834640 1 -- 172.21.15.103:0/121521670 learned_addr learned my addr 172.21.15.103:0/121521670 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f4587fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 0x7f4588195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f4587fff640 1 -- 172.21.15.103:0/121521670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 msgr2=0x7f4588195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f4587fff640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f4588195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f4587fff640 1 -- 172.21.15.103:0/121521670 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c009560 con 0x7f4588102ef0 2024-09-17T01:07:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.185+0000 7f458c834640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f4588195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:07:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.186+0000 7f4587fff640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 0x7f4588195bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f457400e940 tx=0x7f457400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.186+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4574009620 con 0x7f4588102ef0 2024-09-17T01:07:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.186+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458819ada0 con 0x7f4588102ef0 2024-09-17T01:07:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.186+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45740044f0 con 0x7f4588102ef0 2024-09-17T01:07:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.186+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458819b340 con 0x7f4588102ef0 2024-09-17T01:07:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.186+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45740049d0 con 0x7f4588102ef0 2024-09-17T01:07:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.187+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45881009a0 con 0x7f4588102ef0 2024-09-17T01:07:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.188+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 24) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f4574004c00 con 0x7f4588102ef0 2024-09-17T01:07:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.188+0000 7f4585ffb640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f457806d890 0x7f457806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.188+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f4574014070 con 0x7f4588102ef0 2024-09-17T01:07:58.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.188+0000 7f458c834640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f457806d890 0x7f457806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:58.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.189+0000 7f458c834640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f457806d890 0x7f457806fd50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f457c000c00 tx=0x7f457c0314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.193+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4574056c40 con 0x7f4588102ef0 2024-09-17T01:07:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.445+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f4574057010 con 0x7f4588102ef0 2024-09-17T01:07:58.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.447+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4588103990 con 0x7f457806d890 2024-09-17T01:07:58.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.448+0000 7f4585ffb640 1 -- 172.21.15.103:0/121521670 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f4588103990 con 0x7f457806d890 2024-09-17T01:07:58.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f457806d890 msgr2=0x7f457806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f457806d890 0x7f457806fd50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f457c000c00 tx=0x7f457c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 msgr2=0x7f4588195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 0x7f4588195bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f457400e940 tx=0x7f457400ee00 comp rx=0 tx=0).stop 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 shutdown_connections 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f457806d890 0x7f457806fd50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4588102ef0 0x7f4588195bc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 --2- 172.21.15.103:0/121521670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45881005c0 0x7f4588195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 >> 172.21.15.103:0/121521670 conn(0x7f45880fa1c0 msgr2=0x7f45880fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:58.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 shutdown_connections 2024-09-17T01:07:58.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.450+0000 7f458ea98640 1 -- 172.21.15.103:0/121521670 wait complete. 2024-09-17T01:07:58.460 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:07:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 -- 172.21.15.103:0/2774531505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 msgr2=0x7f93680fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 --2- 172.21.15.103:0/2774531505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f93680fee30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9364009880 tx=0x7f936402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 -- 172.21.15.103:0/2774531505 shutdown_connections 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 --2- 172.21.15.103:0/2774531505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 0x7f93681000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 --2- 172.21.15.103:0/2774531505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f93680fee30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 -- 172.21.15.103:0/2774531505 >> 172.21.15.103:0/2774531505 conn(0x7f93680fa1c0 msgr2=0x7f93680fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 -- 172.21.15.103:0/2774531505 shutdown_connections 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 -- 172.21.15.103:0/2774531505 wait complete. 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 Processor -- start 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.568+0000 7f936fbaa640 1 -- start start 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936fbaa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f9368068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936fbaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 0x7f936819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936fbaa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936819a920 con 0x7f93680fea30 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936fbaa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936819aa90 con 0x7f93680ffc30 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d946640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f9368068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d946640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f9368068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32870/0 (socket says 172.21.15.103:32870) 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d946640 1 -- 172.21.15.103:0/471892828 learned_addr learned my addr 172.21.15.103:0/471892828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d145640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 0x7f936819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d145640 1 -- 172.21.15.103:0/471892828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 msgr2=0x7f9368068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d145640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f9368068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d145640 1 -- 172.21.15.103:0/471892828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364009560 con 0x7f93680ffc30 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.569+0000 7f936d145640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 0x7f936819a350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f935800d6a0 tx=0x7f935800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.570+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93580051f0 con 0x7f93680ffc30 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.570+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936819ad70 con 0x7f93680ffc30 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.570+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9358009c80 con 0x7f93680ffc30 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.570+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9358004e10 con 0x7f93680ffc30 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.570+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936819b340 con 0x7f93680ffc30 2024-09-17T01:07:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.571+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9368107640 con 0x7f93680ffc30 2024-09-17T01:07:58.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.572+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f9358005350 con 0x7f93680ffc30 2024-09-17T01:07:58.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.573+0000 7f935effd640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f935406e340 0x7f9354070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:58.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.573+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f935808def0 con 0x7f93680ffc30 2024-09-17T01:07:58.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.573+0000 7f936d946640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f935406e340 0x7f9354070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:58.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.573+0000 7f936d946640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f935406e340 0x7f9354070800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9364000c00 tx=0x7f93640314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:58.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.576+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f9358057620 con 0x7f93680ffc30 2024-09-17T01:07:58.602 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:07:58.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T01:07:58.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:58 smithi103 ceph-mon[28156]: Standby manager daemon smithi103.efjaur restarted 2024-09-17T01:07:58.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:58 smithi103 ceph-mon[28156]: Standby manager daemon smithi103.efjaur started 2024-09-17T01:07:58.755 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:58 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/crt"}]: dispatch 2024-09-17T01:07:58.755 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:58 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:07:58.755 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:58 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/key"}]: dispatch 2024-09-17T01:07:58.755 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:58 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:07:58.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:58 smithi143 ceph-mon[35452]: Standby manager daemon smithi103.efjaur restarted 2024-09-17T01:07:58.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:58 smithi143 ceph-mon[35452]: Standby manager daemon smithi103.efjaur started 2024-09-17T01:07:58.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:58 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/crt"}]: dispatch 2024-09-17T01:07:58.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:58 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:07:58.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:58 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.efjaur/key"}]: dispatch 2024-09-17T01:07:58.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:58 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:07:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.933+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9368104580 con 0x7f935406e340 2024-09-17T01:07:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.935+0000 7f935effd640 1 -- 172.21.15.103:0/471892828 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f9368104580 con 0x7f935406e340 2024-09-17T01:07:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f935406e340 msgr2=0x7f9354070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f935406e340 0x7f9354070800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9364000c00 tx=0x7f93640314e0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 msgr2=0x7f936819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 0x7f936819a350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f935800d6a0 tx=0x7f935800db60 comp rx=0 tx=0).stop 2024-09-17T01:07:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 shutdown_connections 2024-09-17T01:07:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f935406e340 0x7f9354070800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93680ffc30 0x7f936819a350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 --2- 172.21.15.103:0/471892828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93680fea30 0x7f9368068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 >> 172.21.15.103:0/471892828 conn(0x7f93680fa1c0 msgr2=0x7f9368102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 shutdown_connections 2024-09-17T01:07:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:58.939+0000 7f936fbaa640 1 -- 172.21.15.103:0/471892828 wait complete. 2024-09-17T01:07:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 -- 172.21.15.103:0/3894711924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980fea30 msgr2=0x7fc1980fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 --2- 172.21.15.103:0/3894711924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980fea30 0x7fc1980fee30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc188009880 tx=0x7fc18802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 -- 172.21.15.103:0/3894711924 shutdown_connections 2024-09-17T01:07:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 --2- 172.21.15.103:0/3894711924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980ffc30 0x7fc1981000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 --2- 172.21.15.103:0/3894711924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980fea30 0x7fc1980fee30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 -- 172.21.15.103:0/3894711924 >> 172.21.15.103:0/3894711924 conn(0x7fc1980fa1c0 msgr2=0x7fc1980fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 -- 172.21.15.103:0/3894711924 shutdown_connections 2024-09-17T01:07:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.034+0000 7fc19dace640 1 -- 172.21.15.103:0/3894711924 wait complete. 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.035+0000 7fc19dace640 1 Processor -- start 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc19dace640 1 -- start start 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc19dace640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 0x7fc198194530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc19dace640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980ffc30 0x7fc198194a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc19dace640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198195040 con 0x7fc1980ffc30 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc19dace640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1981951b0 con 0x7fc1980fea30 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 0x7fc198194530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 0x7fc198194530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:57214/0 (socket says 172.21.15.103:57214) 2024-09-17T01:07:59.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc1977fe640 1 -- 172.21.15.103:0/313565235 learned_addr learned my addr 172.21.15.103:0/313565235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:59.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc196ffd640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980ffc30 0x7fc198194a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:59.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc1977fe640 1 -- 172.21.15.103:0/313565235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980ffc30 msgr2=0x7fc198194a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc1977fe640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980ffc30 0x7fc198194a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.036+0000 7fc1977fe640 1 -- 172.21.15.103:0/313565235 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009560 con 0x7fc1980fea30 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.037+0000 7fc1977fe640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 0x7fc198194530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc18802aa90 tx=0x7fc1880055c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.037+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc188004b60 con 0x7fc1980fea30 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.037+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc188004cc0 con 0x7fc1980fea30 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.037+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc198199bf0 con 0x7fc1980fea30 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.037+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc188003a50 con 0x7fc1980fea30 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.037+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19819a0e0 con 0x7fc1980fea30 2024-09-17T01:07:59.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.039+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198107640 con 0x7fc1980fea30 2024-09-17T01:07:59.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.039+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fc188003bd0 con 0x7fc1980fea30 2024-09-17T01:07:59.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.040+0000 7fc194ff9640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc18006e3f0 0x7fc1800708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:59.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.040+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fc1880af3b0 con 0x7fc1980fea30 2024-09-17T01:07:59.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.040+0000 7fc196ffd640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc18006e3f0 0x7fc1800708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:59.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.040+0000 7fc196ffd640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc18006e3f0 0x7fc1800708b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc198195a50 tx=0x7fc18c00b390 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:59.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.045+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc1880789c0 con 0x7fc1980fea30 2024-09-17T01:07:59.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.336+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc19819a330 con 0x7fc18006e3f0 2024-09-17T01:07:59.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.346+0000 7fc194ff9640 1 -- 172.21.15.103:0/313565235 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc19819a330 con 0x7fc18006e3f0 2024-09-17T01:07:59.344 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:07:59.344 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (7m) 46s ago 8m 24.7M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:07:59.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (9m) 46s ago 9m 7914k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:07:59.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (8m) 67s ago 8m 7578k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (9m) 46s ago 9m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (8m) 67s ago 8m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (7m) 46s ago 8m 87.1M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (3m) 46s ago 3m 169M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (3m) 46s ago 3m 103M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (3m) 67s ago 3m 13.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (3m) 67s ago 3m 15.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 starting - - - - 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (101s) 67s ago 7m 479M - 19.1.1-330-gc2ddf972 ebb0615149de e4a4ae03730a 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (10m) 46s ago 10m 49.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (7m) 67s ago 7m 40.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:07:59.345 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (8m) 46s ago 8m 15.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (8m) 67s ago 8m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (7m) 46s ago 7m 124M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (6m) 46s ago 6m 127M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (6m) 46s ago 6m 116M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (5m) 67s ago 5m 135M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (5m) 67s ago 5m 124M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (5m) 67s ago 5m 126M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:07:59.346 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 starting - - - - 2024-09-17T01:07:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc18006e3f0 msgr2=0x7fc1800708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc18006e3f0 0x7fc1800708b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc198195a50 tx=0x7fc18c00b390 comp rx=0 tx=0).stop 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 msgr2=0x7fc198194530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 0x7fc198194530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc18802aa90 tx=0x7fc1880055c0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 shutdown_connections 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1980ffc30 0x7fc198194a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc18006e3f0 0x7fc1800708b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 --2- 172.21.15.103:0/313565235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1980fea30 0x7fc198194530 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 >> 172.21.15.103:0/313565235 conn(0x7fc1980fa1c0 msgr2=0x7fc198102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 shutdown_connections 2024-09-17T01:07:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.349+0000 7fc19dace640 1 -- 172.21.15.103:0/313565235 wait complete. 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 -- 172.21.15.103:0/2211808306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 msgr2=0x7f99d80fe7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 --2- 172.21.15.103:0/2211808306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d80fe7b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009880 tx=0x7f99c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 -- 172.21.15.103:0/2211808306 shutdown_connections 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 --2- 172.21.15.103:0/2211808306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99d80fecf0 0x7f99d80ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 --2- 172.21.15.103:0/2211808306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d80fe7b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 -- 172.21.15.103:0/2211808306 >> 172.21.15.103:0/2211808306 conn(0x7f99d80fa1c0 msgr2=0x7f99d80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 -- 172.21.15.103:0/2211808306 shutdown_connections 2024-09-17T01:07:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.463+0000 7f99dd504640 1 -- 172.21.15.103:0/2211808306 wait complete. 2024-09-17T01:07:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.464+0000 7f99dd504640 1 Processor -- start 2024-09-17T01:07:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.464+0000 7f99dd504640 1 -- start start 2024-09-17T01:07:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99dd504640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99dd504640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99d80fecf0 0x7f99d819c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99dd504640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d819c720 con 0x7f99d80fe3b0 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99dd504640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d819c890 con 0x7f99d80fecf0 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32904/0 (socket says 172.21.15.103:32904) 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 -- 172.21.15.103:0/761714201 learned_addr learned my addr 172.21.15.103:0/761714201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d67fc640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99d80fecf0 0x7f99d819c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 -- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99d80fecf0 msgr2=0x7f99d819c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99d80fecf0 0x7f99d819c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 -- 172.21.15.103:0/761714201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8009560 con 0x7f99d80fe3b0 2024-09-17T01:07:59.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.465+0000 7f99d6ffd640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d819bc10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.466+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c8004aa0 con 0x7f99d80fe3b0 2024-09-17T01:07:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.466+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99c8005d50 con 0x7f99d80fe3b0 2024-09-17T01:07:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.466+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c8003a80 con 0x7f99d80fe3b0 2024-09-17T01:07:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.466+0000 7f99dd504640 1 -- 172.21.15.103:0/761714201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d81a12c0 con 0x7f99d80fe3b0 2024-09-17T01:07:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.466+0000 7f99dd504640 1 -- 172.21.15.103:0/761714201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d81a1770 con 0x7f99d80fe3b0 2024-09-17T01:07:59.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.467+0000 7f99dd504640 1 -- 172.21.15.103:0/761714201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d8107220 con 0x7f99d80fe3b0 2024-09-17T01:07:59.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.468+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f99c8031c90 con 0x7f99d80fe3b0 2024-09-17T01:07:59.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.468+0000 7f99bffff640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f99c006e3e0 0x7f99c00708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:59.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.469+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f99c80af260 con 0x7f99d80fe3b0 2024-09-17T01:07:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.469+0000 7f99d67fc640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f99c006e3e0 0x7f99c00708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.469+0000 7f99d67fc640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f99c006e3e0 0x7f99c00708a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009b60 tx=0x7f99cc005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.474+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f99c8078820 con 0x7f99d80fe3b0 2024-09-17T01:07:59.669 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:59 smithi103 ceph-mon[28156]: pgmap v40: 65 pgs: 65 active+clean; 787 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-09-17T01:07:59.669 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:59 smithi103 ceph-mon[28156]: mgrmap e25: smithi143.sxhocv(active, since 74s), standbys: smithi103.efjaur 2024-09-17T01:07:59.670 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:59 smithi103 ceph-mon[28156]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:59.670 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:07:59 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:59.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:59 smithi143 ceph-mon[35452]: pgmap v40: 65 pgs: 65 active+clean; 787 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-09-17T01:07:59.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:59 smithi143 ceph-mon[35452]: mgrmap e25: smithi143.sxhocv(active, since 74s), standbys: smithi103.efjaur 2024-09-17T01:07:59.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:59 smithi143 ceph-mon[35452]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:59.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:07:59 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:59.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.881+0000 7f99dd504640 1 -- 172.21.15.103:0/761714201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f99d802c480 con 0x7f99d80fe3b0 2024-09-17T01:07:59.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.883+0000 7f99bffff640 1 -- 172.21.15.103:0/761714201 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f99c807bee0 con 0x7f99d80fe3b0 2024-09-17T01:07:59.881 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:07:59.881 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:07:59.882 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:07:59.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:59.882 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:07:59.882 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:59.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:59.882 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:07:59.883 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:07:59.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:59.883 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:07:59.883 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:07:59.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:07:59.883 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:07:59.884 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 12, 2024-09-17T01:07:59.884 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:59.884 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:07:59.884 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:07:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.892+0000 7f99bdffb640 1 -- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f99c006e3e0 msgr2=0x7f99c00708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.892+0000 7f99bdffb640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f99c006e3e0 0x7f99c00708a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009b60 tx=0x7f99cc005f90 comp rx=0 tx=0).stop 2024-09-17T01:07:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.892+0000 7f99bdffb640 1 -- 172.21.15.103:0/761714201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 msgr2=0x7f99d819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.893+0000 7f99bdffb640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d819bc10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c80055a0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.896+0000 7f99bdffb640 1 -- 172.21.15.103:0/761714201 shutdown_connections 2024-09-17T01:07:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.896+0000 7f99bdffb640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f99c006e3e0 0x7f99c00708a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.896+0000 7f99bdffb640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99d80fecf0 0x7f99d819c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.896+0000 7f99bdffb640 1 --2- 172.21.15.103:0/761714201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d80fe3b0 0x7f99d819bc10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.896+0000 7f99bdffb640 1 -- 172.21.15.103:0/761714201 >> 172.21.15.103:0/761714201 conn(0x7f99d80fa1c0 msgr2=0x7f99d81043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.896+0000 7f99bdffb640 1 -- 172.21.15.103:0/761714201 shutdown_connections 2024-09-17T01:07:59.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:07:59.897+0000 7f99bdffb640 1 -- 172.21.15.103:0/761714201 wait complete. 2024-09-17T01:08:00.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/4141116650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 msgr2=0x7fc0f81007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/4141116650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f81007c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80097e0 tx=0x7fc0e802a3f0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/4141116650 shutdown_connections 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/4141116650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 0x7fc0f8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/4141116650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f81007c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/4141116650 >> 172.21.15.103:0/4141116650 conn(0x7fc0f80fa1c0 msgr2=0x7fc0f80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/4141116650 shutdown_connections 2024-09-17T01:08:00.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.036+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/4141116650 wait complete. 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.037+0000 7fc0fd6f6640 1 Processor -- start 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.037+0000 7fc0fd6f6640 1 -- start start 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.037+0000 7fc0fd6f6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.037+0000 7fc0fd6f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 0x7fc0f819c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.037+0000 7fc0fd6f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f819c740 con 0x7fc0f8100d00 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.037+0000 7fc0fd6f6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f819c8b0 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.038+0000 7fc0effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 0x7fc0f819c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.038+0000 7fc0effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 0x7fc0f819c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32920/0 (socket says 172.21.15.103:32920) 2024-09-17T01:08:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.038+0000 7fc0f6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.038+0000 7fc0effff640 1 -- 172.21.15.103:0/555786165 learned_addr learned my addr 172.21.15.103:0/555786165 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f6ffd640 1 -- 172.21.15.103:0/555786165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 msgr2=0x7fc0f819c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f6ffd640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 0x7fc0f819c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f6ffd640 1 -- 172.21.15.103:0/555786165 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009490 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f6ffd640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f819bc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802a910 tx=0x7fc0e8030c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e80037c0 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0e80044f0 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e8031da0 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f81a12e0 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.039+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f81a17d0 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.041+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d8005280 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.042+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fc0e8031400 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.043+0000 7fc0f4ff9640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc0e406e4b0 0x7fc0e4070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:00.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.043+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fc0e80afa80 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.043+0000 7fc0effff640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc0e406e4b0 0x7fc0e4070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:00.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.044+0000 7fc0effff640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc0e406e4b0 0x7fc0e4070970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00058c0 tx=0x7fc0e0009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:00.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.046+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc0e8079040 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.466+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0d8005800 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.466+0000 7fc0f4ff9640 1 -- 172.21.15.103:0/555786165 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7fc0e807c700 con 0x7fc0f80fe3b0 2024-09-17T01:08:00.464 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:08:00.465 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:08:00.466 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:00.467 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:08:00.468 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:00.468 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:00.468 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc0e406e4b0 msgr2=0x7fc0e4070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc0e406e4b0 0x7fc0e4070970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00058c0 tx=0x7fc0e0009260 comp rx=0 tx=0).stop 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 msgr2=0x7fc0f819bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f819bc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802a910 tx=0x7fc0e8030c00 comp rx=0 tx=0).stop 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 shutdown_connections 2024-09-17T01:08:00.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f8100d00 0x7fc0f819c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fc0e406e4b0 0x7fc0e4070970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.469+0000 7fc0fd6f6640 1 --2- 172.21.15.103:0/555786165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0f80fe3b0 0x7fc0f819bc30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.470+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 >> 172.21.15.103:0/555786165 conn(0x7fc0f80fa1c0 msgr2=0x7fc0f80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:00.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.470+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 shutdown_connections 2024-09-17T01:08:00.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.470+0000 7fc0fd6f6640 1 -- 172.21.15.103:0/555786165 wait complete. 2024-09-17T01:08:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.579+0000 7fd7526ec640 1 -- 172.21.15.103:0/3238613460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fecf0 msgr2=0x7fd74c0ff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.579+0000 7fd7526ec640 1 --2- 172.21.15.103:0/3238613460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fecf0 0x7fd74c0ff150 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd740009880 tx=0x7fd74002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.579+0000 7fd7526ec640 1 -- 172.21.15.103:0/3238613460 shutdown_connections 2024-09-17T01:08:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.579+0000 7fd7526ec640 1 --2- 172.21.15.103:0/3238613460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fecf0 0x7fd74c0ff150 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.579+0000 7fd7526ec640 1 --2- 172.21.15.103:0/3238613460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c0fe7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.579+0000 7fd7526ec640 1 -- 172.21.15.103:0/3238613460 >> 172.21.15.103:0/3238613460 conn(0x7fd74c0fa1c0 msgr2=0x7fd74c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.580+0000 7fd7526ec640 1 -- 172.21.15.103:0/3238613460 shutdown_connections 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.580+0000 7fd7526ec640 1 -- 172.21.15.103:0/3238613460 wait complete. 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.580+0000 7fd7526ec640 1 Processor -- start 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd7526ec640 1 -- start start 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd7526ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c1977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd7526ec640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd74c0fecf0 0x7fd74c197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd7526ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1982f0 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd7526ec640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c198460 con 0x7fd74c0fecf0 2024-09-17T01:08:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c1977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c1977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32932/0 (socket says 172.21.15.103:32932) 2024-09-17T01:08:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.581+0000 7fd74bfff640 1 -- 172.21.15.103:0/1377944459 learned_addr learned my addr 172.21.15.103:0/1377944459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd74b7fe640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd74c0fecf0 0x7fd74c197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd74bfff640 1 -- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd74c0fecf0 msgr2=0x7fd74c197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd74bfff640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd74c0fecf0 0x7fd74c197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd74bfff640 1 -- 172.21.15.103:0/1377944459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740009560 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd74bfff640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c1977e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00e9a0 tx=0x7fd73c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73c00cd50 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd73c00ceb0 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.582+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c19cf00 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.583+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73c010660 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.583+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c19d470 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.584+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c10a920 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.585+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fd73c004f40 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.586+0000 7fd7497fa640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fd73406e3b0 0x7fd734070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:00.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.586+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fd73c014070 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.586+0000 7fd74b7fe640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fd73406e3b0 0x7fd734070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:00.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.587+0000 7fd74b7fe640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fd73406e3b0 0x7fd734070870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd740031540 tx=0x7fd740000bc0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:00.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.594+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd73c057dd0 con 0x7fd74c0fe3b0 2024-09-17T01:08:00.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:00 smithi143 ceph-mon[35452]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:00.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:00 smithi143 ceph-mon[35452]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:00.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:00 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:00 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:00 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/761714201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:00.869 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:00 smithi103 ceph-mon[28156]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:00.869 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:00 smithi103 ceph-mon[28156]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:00.869 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:00 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:00.869 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:00 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:00.869 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:00 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/761714201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.977+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 --> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd74c19d6f0 con 0x7fd73406e3b0 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.978+0000 7fd7497fa640 1 -- 172.21.15.103:0/1377944459 <== mgr.24395 v2:172.21.15.143:6828/1914869103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd74c19d6f0 con 0x7fd73406e3b0 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr" 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:08:00.976 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:08:00.977 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:08:00.977 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:08:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fd73406e3b0 msgr2=0x7fd734070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fd73406e3b0 0x7fd734070870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd740031540 tx=0x7fd740000bc0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 msgr2=0x7fd74c1977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c1977e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00e9a0 tx=0x7fd73c00eda0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 shutdown_connections 2024-09-17T01:08:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7fd73406e3b0 0x7fd734070870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd74c0fecf0 0x7fd74c197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 --2- 172.21.15.103:0/1377944459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd74c0fe3b0 0x7fd74c1977e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 >> 172.21.15.103:0/1377944459 conn(0x7fd74c0fa1c0 msgr2=0x7fd74c1069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.981+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 shutdown_connections 2024-09-17T01:08:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:00.982+0000 7fd7526ec640 1 -- 172.21.15.103:0/1377944459 wait complete. 2024-09-17T01:08:01.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 -- 172.21.15.103:0/4250282211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a00ffb60 msgr2=0x7f22a00fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:01.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 --2- 172.21.15.103:0/4250282211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a00ffb60 0x7f22a00fff60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2290009880 tx=0x7f229002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 -- 172.21.15.103:0/4250282211 shutdown_connections 2024-09-17T01:08:01.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 --2- 172.21.15.103:0/4250282211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22a0100d60 0x7f22a01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 --2- 172.21.15.103:0/4250282211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a00ffb60 0x7f22a00fff60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 -- 172.21.15.103:0/4250282211 >> 172.21.15.103:0/4250282211 conn(0x7f22a00fb330 msgr2=0x7f22a00fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:01.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 -- 172.21.15.103:0/4250282211 shutdown_connections 2024-09-17T01:08:01.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.090+0000 7f22a5f23640 1 -- 172.21.15.103:0/4250282211 wait complete. 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.091+0000 7f22a5f23640 1 Processor -- start 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.091+0000 7f22a5f23640 1 -- start start 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.091+0000 7f22a5f23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22a00ffb60 0x7f22a01955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.091+0000 7f22a5f23640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 0x7f22a0195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.091+0000 7f22a5f23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a0196100 con 0x7f22a00ffb60 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.091+0000 7f22a5f23640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a0196270 con 0x7f22a0100d60 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22a00ffb60 0x7f22a01955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 0x7f22a0195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 0x7f22a0195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:57290/0 (socket says 172.21.15.103:57290) 2024-09-17T01:08:01.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 -- 172.21.15.103:0/2644785196 learned_addr learned my addr 172.21.15.103:0/2644785196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 -- 172.21.15.103:0/2644785196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22a00ffb60 msgr2=0x7f22a01955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22a00ffb60 0x7f22a01955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 -- 172.21.15.103:0/2644785196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290009560 con 0x7f22a0100d60 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229effd640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 0x7f22a0195b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f229400e970 tx=0x7f229400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.092+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229400cc90 con 0x7f22a0100d60 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.093+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f229400cdf0 con 0x7f22a0100d60 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.093+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2294018810 con 0x7f22a0100d60 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.093+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a019ad10 con 0x7f22a0100d60 2024-09-17T01:08:01.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.093+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a019b1d0 con 0x7f22a0100d60 2024-09-17T01:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.095+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 25) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f2294010c10 con 0x7f22a0100d60 2024-09-17T01:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.095+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a018f6e0 con 0x7f22a0100d60 2024-09-17T01:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.095+0000 7f229cff9640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f228806e3b0 0x7f2288070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.095+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f2294014070 con 0x7f22a0100d60 2024-09-17T01:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.095+0000 7f229f7fe640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f228806e3b0 0x7f2288070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:01.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.096+0000 7f229f7fe640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f228806e3b0 0x7f2288070870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2290009230 tx=0x7f22900314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:01.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.100+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f2294053d10 con 0x7f22a0100d60 2024-09-17T01:08:01.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.470+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f22a0108750 con 0x7f22a0100d60 2024-09-17T01:08:01.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.470+0000 7f229cff9640 1 -- 172.21.15.103:0/2644785196 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f229405b850 con 0x7f22a0100d60 2024-09-17T01:08:01.468 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:08:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f228806e3b0 msgr2=0x7f2288070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f228806e3b0 0x7f2288070870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2290009230 tx=0x7f22900314e0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 msgr2=0x7f22a0195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 0x7f22a0195b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f229400e970 tx=0x7f229400ee30 comp rx=0 tx=0).stop 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 shutdown_connections 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:6828/1914869103,v1:172.21.15.143:6829/1914869103] conn(0x7f228806e3b0 0x7f2288070870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22a0100d60 0x7f22a0195b30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 --2- 172.21.15.103:0/2644785196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22a00ffb60 0x7f22a01955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.472+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 >> 172.21.15.103:0/2644785196 conn(0x7f22a00fb330 msgr2=0x7f22a01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.473+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 shutdown_connections 2024-09-17T01:08:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:01.473+0000 7f22a5f23640 1 -- 172.21.15.103:0/2644785196 wait complete. 2024-09-17T01:08:01.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:01 smithi103 ceph-mon[28156]: pgmap v41: 65 pgs: 65 active+clean; 787 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-09-17T01:08:01.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:01 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/555786165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:01.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:01 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:01.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:01 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:01.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:01 smithi143 ceph-mon[35452]: pgmap v41: 65 pgs: 65 active+clean; 787 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-09-17T01:08:01.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:01 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/555786165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:01.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:01 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:01.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:01 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:02.701 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:02 smithi103 ceph-mon[28156]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:02.701 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:02 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2644785196' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:02.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:02 smithi143 ceph-mon[35452]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:02.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:02 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2644785196' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:03.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:03 smithi143 ceph-mon[35452]: pgmap v42: 65 pgs: 65 active+clean; 349 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 452 op/s 2024-09-17T01:08:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:03 smithi103 ceph-mon[28156]: pgmap v42: 65 pgs: 65 active+clean; 349 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 452 op/s 2024-09-17T01:08:05.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: pgmap v43: 65 pgs: 65 active+clean; 349 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr fail", "who": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr fail", "who": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:08:05.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: Activating manager daemon smithi103.efjaur 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd='[{"prefix": "mgr fail", "who": "smithi143.sxhocv"}]': finished 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: mgrmap e26: smithi103.efjaur(active, starting, since 0.00707589s) 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:08:05.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: Manager daemon smithi103.efjaur is now available 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:08:05.680 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: pgmap v43: 65 pgs: 65 active+clean; 349 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 172.21.15.143:0/1971619367' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr fail", "who": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "mgr fail", "who": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:08:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: Activating manager daemon smithi103.efjaur 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.24395 ' entity='mgr.smithi143.sxhocv' cmd='[{"prefix": "mgr fail", "who": "smithi143.sxhocv"}]': finished 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: mgrmap e26: smithi103.efjaur(active, starting, since 0.00707589s) 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:08:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: Manager daemon smithi103.efjaur is now available 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:08:05.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T01:08:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:06 smithi103 ceph-mon[28156]: mgrmap e27: smithi103.efjaur(active, since 1.00921s) 2024-09-17T01:08:06.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:06 smithi103 ceph-mon[28156]: pgmap v3: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:08:06.946 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:06 smithi143 ceph-mon[35452]: mgrmap e27: smithi103.efjaur(active, since 1.00921s) 2024-09-17T01:08:06.946 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:06 smithi143 ceph-mon[35452]: pgmap v3: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:08:07.894 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: [17/Sep/2024:01:08:06] ENGINE Bus STARTING 2024-09-17T01:08:07.894 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: [17/Sep/2024:01:08:06] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T01:08:07.894 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: [17/Sep/2024:01:08:06] ENGINE Error in HTTPServer.serve 2024-09-17T01:08:07.894 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Traceback (most recent call last): 2024-09-17T01:08:07.894 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._run(expiration_interval) 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: s = self.context.wrap_socket( 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: return self.sslsocket_class._create( 2024-09-17T01:08:07.895 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self.do_handshake() 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._sslobj.do_handshake() 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: pgmap v4: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: mgrmap e28: smithi103.efjaur(active, since 2s) 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: [17/Sep/2024:01:08:06] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:07 smithi143 ceph-mon[35452]: [17/Sep/2024:01:08:06] ENGINE Bus STARTED 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: [17/Sep/2024:01:08:06] ENGINE Bus STARTING 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: [17/Sep/2024:01:08:06] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: [17/Sep/2024:01:08:06] ENGINE Error in HTTPServer.serve 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:08:07.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: pgmap v4: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:08:07.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: mgrmap e28: smithi103.efjaur(active, since 2s) 2024-09-17T01:08:07.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: [17/Sep/2024:01:08:06] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T01:08:07.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:07 smithi103 ceph-mon[28156]: [17/Sep/2024:01:08:06] ENGINE Bus STARTED 2024-09-17T01:08:09.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:09 smithi103 ceph-mon[28156]: pgmap v5: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:08:09.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:09 smithi103 ceph-mon[28156]: mgrmap e29: smithi103.efjaur(active, since 4s) 2024-09-17T01:08:09.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:09 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:09.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:09 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:09 smithi143 ceph-mon[35452]: pgmap v5: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:08:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:09 smithi143 ceph-mon[35452]: mgrmap e29: smithi103.efjaur(active, since 4s) 2024-09-17T01:08:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:09 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:10.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:09 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:11.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:11.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:11.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:08:11.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:08:11.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:08:11.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:08:11.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:11 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:08:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:08:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:08:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:08:11.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:08:11.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:11 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1898549871' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:08:12.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:12 smithi103 ceph-mon[28156]: pgmap v6: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 263 KiB/s rd, 197 KiB/s wr, 83 op/s 2024-09-17T01:08:12.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:12 smithi103 ceph-mon[28156]: mgrmap e30: smithi103.efjaur(active, since 6s), standbys: smithi143.sxhocv 2024-09-17T01:08:12.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:12 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi143.sxhocv", "id": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:08:12.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:12 smithi143 ceph-mon[35452]: pgmap v6: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 263 KiB/s rd, 197 KiB/s wr, 83 op/s 2024-09-17T01:08:12.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:12 smithi143 ceph-mon[35452]: mgrmap e30: smithi103.efjaur(active, since 6s), standbys: smithi143.sxhocv 2024-09-17T01:08:12.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:12 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi143.sxhocv", "id": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:08:14.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:14 smithi103 ceph-mon[28156]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 913 KiB/s rd, 1018 KiB/s wr, 283 op/s 2024-09-17T01:08:14.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:14 smithi143 ceph-mon[35452]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 913 KiB/s rd, 1018 KiB/s wr, 283 op/s 2024-09-17T01:08:16.303 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:16 smithi103 ceph-mon[28156]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 710 KiB/s rd, 791 KiB/s wr, 220 op/s 2024-09-17T01:08:16.308 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:16 smithi143 ceph-mon[35452]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 710 KiB/s rd, 791 KiB/s wr, 220 op/s 2024-09-17T01:08:18.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:18 smithi103 ceph-mon[28156]: pgmap v9: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 636 op/s 2024-09-17T01:08:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:18 smithi143 ceph-mon[35452]: pgmap v9: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 636 op/s 2024-09-17T01:08:20.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:20 smithi103 ceph-mon[28156]: pgmap v10: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 582 op/s 2024-09-17T01:08:20.434 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:20 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:20.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:20 smithi143 ceph-mon[35452]: pgmap v10: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 582 op/s 2024-09-17T01:08:20.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:20 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:22.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:22 smithi103 ceph-mon[28156]: pgmap v11: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 639 op/s 2024-09-17T01:08:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:22 smithi143 ceph-mon[35452]: pgmap v11: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 639 op/s 2024-09-17T01:08:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:24 smithi103 ceph-mon[28156]: pgmap v12: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 871 op/s 2024-09-17T01:08:24.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:24 smithi143 ceph-mon[35452]: pgmap v12: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 871 op/s 2024-09-17T01:08:26.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:26 smithi103 ceph-mon[28156]: pgmap v13: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 KiB/s rd, 1.2 MiB/s wr, 741 op/s 2024-09-17T01:08:26.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:26 smithi143 ceph-mon[35452]: pgmap v13: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 KiB/s rd, 1.2 MiB/s wr, 741 op/s 2024-09-17T01:08:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:28 smithi103 ceph-mon[28156]: pgmap v14: 65 pgs: 65 active+clean; 262 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 979 op/s 2024-09-17T01:08:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:28 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:28 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:28 smithi143 ceph-mon[35452]: pgmap v14: 65 pgs: 65 active+clean; 262 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 979 op/s 2024-09-17T01:08:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:28 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:28 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:29.558 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:29 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:29.558 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:29 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:29.558 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:29 smithi103 ceph-mon[28156]: pgmap v15: 65 pgs: 65 active+clean; 262 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 562 op/s 2024-09-17T01:08:29.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:29 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:29.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:29 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:29.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:29 smithi143 ceph-mon[35452]: pgmap v15: 65 pgs: 65 active+clean; 262 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 562 op/s 2024-09-17T01:08:31.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.603+0000 7fddcecd5640 1 -- 172.21.15.103:0/3451139615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 msgr2=0x7fddc00979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:31.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.603+0000 7fddcecd5640 1 --2- 172.21.15.103:0/3451139615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00979a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009880 tx=0x7fddb802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.604+0000 7fddcecd5640 1 -- 172.21.15.103:0/3451139615 shutdown_connections 2024-09-17T01:08:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.604+0000 7fddcecd5640 1 --2- 172.21.15.103:0/3451139615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddc00987a0 0x7fddc0098c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.604+0000 7fddcecd5640 1 --2- 172.21.15.103:0/3451139615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00979a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.604+0000 7fddcecd5640 1 -- 172.21.15.103:0/3451139615 >> 172.21.15.103:0/3451139615 conn(0x7fddc0092d50 msgr2=0x7fddc0095170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.606+0000 7fddcecd5640 1 -- 172.21.15.103:0/3451139615 shutdown_connections 2024-09-17T01:08:31.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.606+0000 7fddcecd5640 1 -- 172.21.15.103:0/3451139615 wait complete. 2024-09-17T01:08:31.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.607+0000 7fddcecd5640 1 Processor -- start 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.607+0000 7fddcecd5640 1 -- start start 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.607+0000 7fddcecd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.607+0000 7fddcecd5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddc00987a0 0x7fddc00a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.607+0000 7fddcecd5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00a4a20 con 0x7fddc00975a0 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.607+0000 7fddcecd5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00a4b90 con 0x7fddc00987a0 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00a3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56932/0 (socket says 172.21.15.103:56932) 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 -- 172.21.15.103:0/19210466 learned_addr learned my addr 172.21.15.103:0/19210466 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:31.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcd4d2640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddc00987a0 0x7fddc00a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:31.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 -- 172.21.15.103:0/19210466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddc00987a0 msgr2=0x7fddc00a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:31.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddc00987a0 0x7fddc00a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 -- 172.21.15.103:0/19210466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009560 con 0x7fddc00975a0 2024-09-17T01:08:31.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.608+0000 7fddcdcd3640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00a3f10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fddb8005ab0 tx=0x7fddb80054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:31.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.611+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb8004aa0 con 0x7fddc00975a0 2024-09-17T01:08:31.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.611+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddb8004c00 con 0x7fddc00975a0 2024-09-17T01:08:31.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.611+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb8003a80 con 0x7fddc00975a0 2024-09-17T01:08:31.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.612+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc00a55e0 con 0x7fddc00975a0 2024-09-17T01:08:31.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.612+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc00a5aa0 con 0x7fddc00975a0 2024-09-17T01:08:31.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.614+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc00979a0 con 0x7fddc00975a0 2024-09-17T01:08:31.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.614+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fddb8031c70 con 0x7fddc00975a0 2024-09-17T01:08:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.615+0000 7fddbeffd640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddb406e500 0x7fddb40709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.615+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fddb80af330 con 0x7fddc00975a0 2024-09-17T01:08:31.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.617+0000 7fddcd4d2640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddb406e500 0x7fddb40709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:31.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.618+0000 7fddcd4d2640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddb406e500 0x7fddb40709c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fddc8065d00 tx=0x7fddc804f260 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:31.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.622+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fddb8078840 con 0x7fddc00975a0 2024-09-17T01:08:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.889+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddc009cdf0 con 0x7fddb406e500 2024-09-17T01:08:31.888 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:31 smithi103 ceph-mon[28156]: pgmap v16: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 611 op/s 2024-09-17T01:08:31.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.890+0000 7fddbeffd640 1 -- 172.21.15.103:0/19210466 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fddc009cdf0 con 0x7fddb406e500 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddb406e500 msgr2=0x7fddb40709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddb406e500 0x7fddb40709c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fddc8065d00 tx=0x7fddc804f260 comp rx=0 tx=0).stop 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 msgr2=0x7fddc00a3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00a3f10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fddb8005ab0 tx=0x7fddb80054f0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 shutdown_connections 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddb406e500 0x7fddb40709c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddc00987a0 0x7fddc00a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 --2- 172.21.15.103:0/19210466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc00975a0 0x7fddc00a3f10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.893+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 >> 172.21.15.103:0/19210466 conn(0x7fddc0092d50 msgr2=0x7fddc00939b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.894+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 shutdown_connections 2024-09-17T01:08:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.894+0000 7fddcecd5640 1 -- 172.21.15.103:0/19210466 wait complete. 2024-09-17T01:08:31.901 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:08:31.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 -- 172.21.15.103:0/840095752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 msgr2=0x7ffb800fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 --2- 172.21.15.103:0/840095752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb800fee30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009880 tx=0x7ffb7c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 -- 172.21.15.103:0/840095752 shutdown_connections 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 --2- 172.21.15.103:0/840095752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb800ffc30 0x7ffb801000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 --2- 172.21.15.103:0/840095752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb800fee30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 -- 172.21.15.103:0/840095752 >> 172.21.15.103:0/840095752 conn(0x7ffb800fa1c0 msgr2=0x7ffb800fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 -- 172.21.15.103:0/840095752 shutdown_connections 2024-09-17T01:08:31.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.997+0000 7ffb87e39640 1 -- 172.21.15.103:0/840095752 wait complete. 2024-09-17T01:08:31.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb87e39640 1 Processor -- start 2024-09-17T01:08:31.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb87e39640 1 -- start start 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb87e39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb80197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb87e39640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb800ffc30 0x7ffb80197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb87e39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80198350 con 0x7ffb800fea30 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb87e39640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb801984c0 con 0x7ffb800ffc30 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb85bd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb80197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb85bd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb80197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56942/0 (socket says 172.21.15.103:56942) 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb85bd5640 1 -- 172.21.15.103:0/3310924885 learned_addr learned my addr 172.21.15.103:0/3310924885 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.998+0000 7ffb853d4640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb800ffc30 0x7ffb80197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb85bd5640 1 -- 172.21.15.103:0/3310924885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb800ffc30 msgr2=0x7ffb80197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb85bd5640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb800ffc30 0x7ffb80197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb85bd5640 1 -- 172.21.15.103:0/3310924885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009560 con 0x7ffb800fea30 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb85bd5640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb80197840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0054f0 tx=0x7ffb7c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:31.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c004aa0 con 0x7ffb800fea30 2024-09-17T01:08:32.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8019cf00 con 0x7ffb800fea30 2024-09-17T01:08:32.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8019d3f0 con 0x7ffb800fea30 2024-09-17T01:08:32.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb7c004c00 con 0x7ffb800fea30 2024-09-17T01:08:32.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:31.999+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c003ac0 con 0x7ffb800fea30 2024-09-17T01:08:32.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.001+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb64005250 con 0x7ffb800fea30 2024-09-17T01:08:32.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.001+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7ffb7c003d30 con 0x7ffb800fea30 2024-09-17T01:08:32.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.002+0000 7ffb76ffd640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffb6c06e3b0 0x7ffb6c070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.002+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ffb7c0af420 con 0x7ffb800fea30 2024-09-17T01:08:32.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.002+0000 7ffb853d4640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffb6c06e3b0 0x7ffb6c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.002+0000 7ffb853d4640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffb6c06e3b0 0x7ffb6c070870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb80198d60 tx=0x7ffb7000b390 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:32.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.007+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ffb7c078950 con 0x7ffb800fea30 2024-09-17T01:08:32.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:31 smithi143 ceph-mon[35452]: pgmap v16: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 611 op/s 2024-09-17T01:08:32.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.233+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb64000bc0 con 0x7ffb6c06e3b0 2024-09-17T01:08:32.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.235+0000 7ffb76ffd640 1 -- 172.21.15.103:0/3310924885 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ffb64000bc0 con 0x7ffb6c06e3b0 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffb6c06e3b0 msgr2=0x7ffb6c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffb6c06e3b0 0x7ffb6c070870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb80198d60 tx=0x7ffb7000b390 comp rx=0 tx=0).stop 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 msgr2=0x7ffb80197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb80197840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0054f0 tx=0x7ffb7c005520 comp rx=0 tx=0).stop 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 shutdown_connections 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffb6c06e3b0 0x7ffb6c070870 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb800ffc30 0x7ffb80197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 --2- 172.21.15.103:0/3310924885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb800fea30 0x7ffb80197840 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 >> 172.21.15.103:0/3310924885 conn(0x7ffb800fa1c0 msgr2=0x7ffb800fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 shutdown_connections 2024-09-17T01:08:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.238+0000 7ffb87e39640 1 -- 172.21.15.103:0/3310924885 wait complete. 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 -- 172.21.15.103:0/4016470138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780fea30 msgr2=0x7fea780fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 --2- 172.21.15.103:0/4016470138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780fea30 0x7fea780fee30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fea74009880 tx=0x7fea7402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 -- 172.21.15.103:0/4016470138 shutdown_connections 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 --2- 172.21.15.103:0/4016470138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea780ffc30 0x7fea781000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 --2- 172.21.15.103:0/4016470138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780fea30 0x7fea780fee30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 -- 172.21.15.103:0/4016470138 >> 172.21.15.103:0/4016470138 conn(0x7fea780fa1c0 msgr2=0x7fea780fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 -- 172.21.15.103:0/4016470138 shutdown_connections 2024-09-17T01:08:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 -- 172.21.15.103:0/4016470138 wait complete. 2024-09-17T01:08:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.344+0000 7fea7f455640 1 Processor -- start 2024-09-17T01:08:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7f455640 1 -- start start 2024-09-17T01:08:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7f455640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea780fea30 0x7fea78195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7f455640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 0x7fea78195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7f455640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78196110 con 0x7fea780ffc30 2024-09-17T01:08:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7f455640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78196280 con 0x7fea780fea30 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 0x7fea78195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 0x7fea78195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35158/0 (socket says 172.21.15.103:35158) 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 -- 172.21.15.103:0/3480071155 learned_addr learned my addr 172.21.15.103:0/3480071155 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7d1f1640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea780fea30 0x7fea78195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 -- 172.21.15.103:0/3480071155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea780fea30 msgr2=0x7fea78195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea780fea30 0x7fea78195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 -- 172.21.15.103:0/3480071155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea74009560 con 0x7fea780ffc30 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.345+0000 7fea7c9f0640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 0x7fea78195b40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fea6800e9a0 tx=0x7fea6800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.346+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6800cc90 con 0x7fea780ffc30 2024-09-17T01:08:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.346+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7819ad20 con 0x7fea780ffc30 2024-09-17T01:08:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.346+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea6800cdf0 con 0x7fea780ffc30 2024-09-17T01:08:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.346+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea680187f0 con 0x7fea780ffc30 2024-09-17T01:08:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.346+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7819b2f0 con 0x7fea780ffc30 2024-09-17T01:08:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.347+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea78107620 con 0x7fea780ffc30 2024-09-17T01:08:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.348+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fea68010c10 con 0x7fea780ffc30 2024-09-17T01:08:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.348+0000 7fea6e7fc640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fea6406e3b0 0x7fea64070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.348+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fea68014070 con 0x7fea780ffc30 2024-09-17T01:08:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.349+0000 7fea7d1f1640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fea6406e3b0 0x7fea64070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.349+0000 7fea7d1f1640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fea6406e3b0 0x7fea64070870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea74009230 tx=0x7fea740314e0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:32.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.354+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fea68053d10 con 0x7fea780ffc30 2024-09-17T01:08:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.627+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea7819b590 con 0x7fea6406e3b0 2024-09-17T01:08:32.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.647+0000 7fea6e7fc640 1 -- 172.21.15.103:0/3480071155 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fea7819b590 con 0x7fea6406e3b0 2024-09-17T01:08:32.646 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:08:32.646 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (8m) 4s ago 9m 24.7M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:08:32.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (9m) 4s ago 9m 8044k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:08:32.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (8m) 23s ago 8m 7688k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (9m) 4s ago 9m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (8m) 23s ago 8m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (7m) 4s ago 9m 84.9M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (4m) 4s ago 4m 217M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (4m) 4s ago 4m 143M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (4m) 23s ago 4m 13.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (4m) 23s ago 4m 15.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (41s) 4s ago 10m 475M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (2m) 23s ago 8m 96.9M - 19.1.1-330-gc2ddf972 ebb0615149de e4a4ae03730a 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (10m) 4s ago 10m 53.2M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (8m) 23s ago 8m 42.8M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:08:32.647 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (9m) 4s ago 9m 15.9M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (8m) 23s ago 8m 17.1M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (7m) 4s ago 7m 202M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (7m) 4s ago 7m 206M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (6m) 4s ago 6m 186M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (6m) 23s ago 6m 238M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (6m) 23s ago 6m 237M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (5m) 23s ago 5m 198M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:08:32.648 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (52s) 4s ago 8m 46.6M - 2.43.0 a07b618ecd1d b12914ae8e9a 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fea6406e3b0 msgr2=0x7fea64070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fea6406e3b0 0x7fea64070870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea74009230 tx=0x7fea740314e0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 msgr2=0x7fea78195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 0x7fea78195b40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fea6800e9a0 tx=0x7fea6800ee60 comp rx=0 tx=0).stop 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 shutdown_connections 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fea6406e3b0 0x7fea64070870 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea780ffc30 0x7fea78195b40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 --2- 172.21.15.103:0/3480071155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea780fea30 0x7fea78195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 >> 172.21.15.103:0/3480071155 conn(0x7fea780fa1c0 msgr2=0x7fea780fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:32.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 shutdown_connections 2024-09-17T01:08:32.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.649+0000 7fea7f455640 1 -- 172.21.15.103:0/3480071155 wait complete. 2024-09-17T01:08:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 -- 172.21.15.103:0/2796956723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ffc30 msgr2=0x7fabec1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/2796956723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ffc30 0x7fabec1000b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009880 tx=0x7fabe002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 -- 172.21.15.103:0/2796956723 shutdown_connections 2024-09-17T01:08:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/2796956723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ffc30 0x7fabec1000b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/2796956723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0fea30 0x7fabec0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 -- 172.21.15.103:0/2796956723 >> 172.21.15.103:0/2796956723 conn(0x7fabec0fa1c0 msgr2=0x7fabec0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 -- 172.21.15.103:0/2796956723 shutdown_connections 2024-09-17T01:08:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.742+0000 7fabf1f7f640 1 -- 172.21.15.103:0/2796956723 wait complete. 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.743+0000 7fabf1f7f640 1 Processor -- start 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.743+0000 7fabf1f7f640 1 -- start start 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.743+0000 7fabf1f7f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0fea30 0x7fabec19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabf1f7f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 0x7fabec19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabf1f7f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec19c850 con 0x7fabec0ffc30 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabf1f7f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec19c9c0 con 0x7fabec0fea30 2024-09-17T01:08:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabeaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 0x7fabec19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabeaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 0x7fabec19c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35168/0 (socket says 172.21.15.103:35168) 2024-09-17T01:08:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabeaffd640 1 -- 172.21.15.103:0/3251074360 learned_addr learned my addr 172.21.15.103:0/3251074360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.744+0000 7fabeb7fe640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0fea30 0x7fabec19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.745+0000 7fabeaffd640 1 -- 172.21.15.103:0/3251074360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0fea30 msgr2=0x7fabec19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.745+0000 7fabeaffd640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0fea30 0x7fabec19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:32.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.745+0000 7fabeaffd640 1 -- 172.21.15.103:0/3251074360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009560 con 0x7fabec0ffc30 2024-09-17T01:08:32.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.746+0000 7fabeaffd640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 0x7fabec19c280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005610 tx=0x7fabe0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:32.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.747+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe0004b20 con 0x7fabec0ffc30 2024-09-17T01:08:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.747+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec1a13f0 con 0x7fabec0ffc30 2024-09-17T01:08:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.747+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec1a1960 con 0x7fabec0ffc30 2024-09-17T01:08:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.747+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabe0004c80 con 0x7fabec0ffc30 2024-09-17T01:08:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.747+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe0003a50 con 0x7fabec0ffc30 2024-09-17T01:08:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.748+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8005280 con 0x7fabec0ffc30 2024-09-17T01:08:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.751+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fabe0003cc0 con 0x7fabec0ffc30 2024-09-17T01:08:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.752+0000 7fabe8ff9640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fabd406e430 0x7fabd40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.752+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fabe00afb30 con 0x7fabec0ffc30 2024-09-17T01:08:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.752+0000 7fabeb7fe640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fabd406e430 0x7fabd40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:32.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.753+0000 7fabeb7fe640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fabd406e430 0x7fabd40708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fabec19d220 tx=0x7fabdc009110 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:32.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:32.756+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fabe0078f90 con 0x7fabec0ffc30 2024-09-17T01:08:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:32 smithi103 ceph-mon[28156]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:32 smithi103 ceph-mon[28156]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:33.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:32 smithi143 ceph-mon[35452]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:33.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:32 smithi143 ceph-mon[35452]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:33.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.106+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fabd8005800 con 0x7fabec0ffc30 2024-09-17T01:08:33.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.107+0000 7fabe8ff9640 1 -- 172.21.15.103:0/3251074360 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fabe007c650 con 0x7fabec0ffc30 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:08:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 12, 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:08:33.107 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fabd406e430 msgr2=0x7fabd40708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fabd406e430 0x7fabd40708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fabec19d220 tx=0x7fabdc009110 comp rx=0 tx=0).stop 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 msgr2=0x7fabec19c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 0x7fabec19c280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005610 tx=0x7fabe0005640 comp rx=0 tx=0).stop 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 shutdown_connections 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fabd406e430 0x7fabd40708f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabec0ffc30 0x7fabec19c280 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 --2- 172.21.15.103:0/3251074360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0fea30 0x7fabec19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 >> 172.21.15.103:0/3251074360 conn(0x7fabec0fa1c0 msgr2=0x7fabec102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:33.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 shutdown_connections 2024-09-17T01:08:33.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.109+0000 7fabf1f7f640 1 -- 172.21.15.103:0/3251074360 wait complete. 2024-09-17T01:08:33.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.214+0000 7fdde4309640 1 -- 172.21.15.103:0/1999816612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0fea30 msgr2=0x7fdddc0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.214+0000 7fdde4309640 1 --2- 172.21.15.103:0/1999816612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0fea30 0x7fdddc0fee30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097e0 tx=0x7fddd802a3f0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.214+0000 7fdde4309640 1 -- 172.21.15.103:0/1999816612 shutdown_connections 2024-09-17T01:08:33.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.214+0000 7fdde4309640 1 --2- 172.21.15.103:0/1999816612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0ffc30 0x7fdddc1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.214+0000 7fdde4309640 1 --2- 172.21.15.103:0/1999816612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0fea30 0x7fdddc0fee30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.214+0000 7fdde4309640 1 -- 172.21.15.103:0/1999816612 >> 172.21.15.103:0/1999816612 conn(0x7fdddc0fa1c0 msgr2=0x7fdddc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.215+0000 7fdde4309640 1 -- 172.21.15.103:0/1999816612 shutdown_connections 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.215+0000 7fdde4309640 1 -- 172.21.15.103:0/1999816612 wait complete. 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde4309640 1 Processor -- start 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde4309640 1 -- start start 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde4309640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 0x7fdddc197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde4309640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 0x7fdddc197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde4309640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc198320 con 0x7fdddc0fea30 2024-09-17T01:08:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde4309640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc198490 con 0x7fdddc0ffc30 2024-09-17T01:08:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde20a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 0x7fdddc197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde18a4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 0x7fdddc197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde20a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 0x7fdddc197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35190/0 (socket says 172.21.15.103:35190) 2024-09-17T01:08:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde18a4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 0x7fdddc197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:35516/0 (socket says 172.21.15.103:35516) 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde20a5640 1 -- 172.21.15.103:0/3523310772 learned_addr learned my addr 172.21.15.103:0/3523310772 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde20a5640 1 -- 172.21.15.103:0/3523310772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 msgr2=0x7fdddc197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde20a5640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 0x7fdddc197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.216+0000 7fdde20a5640 1 -- 172.21.15.103:0/3523310772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009560 con 0x7fdddc0fea30 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fdde20a5640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 0x7fdddc197810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fddd8030c30 tx=0x7fddd8030c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fdde18a4640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 0x7fdddc197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddd80039d0 con 0x7fdddc0fea30 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddd80044f0 con 0x7fdddc0fea30 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd8009490 con 0x7fdddc0fea30 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddd8045460 con 0x7fdddc0fea30 2024-09-17T01:08:33.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.217+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc19d1d0 con 0x7fdddc0fea30 2024-09-17T01:08:33.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.218+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc0fee30 con 0x7fdddc0fea30 2024-09-17T01:08:33.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.219+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fddd8031690 con 0x7fdddc0fea30 2024-09-17T01:08:33.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.220+0000 7fddd37fe640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddc806e3b0 0x7fddc8070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:33.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.220+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fddd80af9f0 con 0x7fdddc0fea30 2024-09-17T01:08:33.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.220+0000 7fdde18a4640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddc806e3b0 0x7fddc8070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:33.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.220+0000 7fdde18a4640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddc806e3b0 0x7fddc8070870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdddc198d30 tx=0x7fddcc009260 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:33.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.227+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fddd80b1e60 con 0x7fdddc0fea30 2024-09-17T01:08:33.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.516+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdddc1078a0 con 0x7fdddc0fea30 2024-09-17T01:08:33.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.516+0000 7fddd37fe640 1 -- 172.21.15.103:0/3523310772 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7fddd8078e70 con 0x7fdddc0fea30 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:08:33.516 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:08:33.517 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:08:33.518 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:08:33.519 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:33.519 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:33.519 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:08:33.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddc806e3b0 msgr2=0x7fddc8070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddc806e3b0 0x7fddc8070870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdddc198d30 tx=0x7fddcc009260 comp rx=0 tx=0).stop 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 msgr2=0x7fdddc197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 0x7fdddc197810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fddd8030c30 tx=0x7fddd8030c60 comp rx=0 tx=0).stop 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 shutdown_connections 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fddc806e3b0 0x7fddc8070870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdddc0ffc30 0x7fdddc197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 --2- 172.21.15.103:0/3523310772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdddc0fea30 0x7fdddc197810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 >> 172.21.15.103:0/3523310772 conn(0x7fdddc0fa1c0 msgr2=0x7fdddc0fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 shutdown_connections 2024-09-17T01:08:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.519+0000 7fdde4309640 1 -- 172.21.15.103:0/3523310772 wait complete. 2024-09-17T01:08:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 -- 172.21.15.103:0/3510316705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b8101280 msgr2=0x7f05b8101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 --2- 172.21.15.103:0/3510316705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b8101280 0x7f05b8101680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009880 tx=0x7f05a802a4b0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 -- 172.21.15.103:0/3510316705 shutdown_connections 2024-09-17T01:08:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 --2- 172.21.15.103:0/3510316705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b80ff7c0 0x7f05b80ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 --2- 172.21.15.103:0/3510316705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b8101280 0x7f05b8101680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 -- 172.21.15.103:0/3510316705 >> 172.21.15.103:0/3510316705 conn(0x7f05b80fb330 msgr2=0x7f05b80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 -- 172.21.15.103:0/3510316705 shutdown_connections 2024-09-17T01:08:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.648+0000 7f05bd52d640 1 -- 172.21.15.103:0/3510316705 wait complete. 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.649+0000 7f05bd52d640 1 Processor -- start 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.649+0000 7f05bd52d640 1 -- start start 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.649+0000 7f05bd52d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b80ff7c0 0x7f05b819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.649+0000 7f05bd52d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 0x7f05b819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.649+0000 7f05bd52d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b819c820 con 0x7f05b80ff7c0 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.649+0000 7f05bd52d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b819c990 con 0x7f05b8101280 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b80ff7c0 0x7f05b819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b67fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 0x7f05b819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b67fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 0x7f05b819c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:35532/0 (socket says 172.21.15.103:35532) 2024-09-17T01:08:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b67fc640 1 -- 172.21.15.103:0/1189818846 learned_addr learned my addr 172.21.15.103:0/1189818846 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b67fc640 1 -- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b80ff7c0 msgr2=0x7f05b819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b67fc640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b80ff7c0 0x7f05b819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.650+0000 7f05b67fc640 1 -- 172.21.15.103:0/1189818846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8009560 con 0x7f05b8101280 2024-09-17T01:08:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.651+0000 7f05b67fc640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 0x7f05b819c250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00e970 tx=0x7f05ac00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.651+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05ac00cc90 con 0x7f05b8101280 2024-09-17T01:08:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.651+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b81a1420 con 0x7f05b8101280 2024-09-17T01:08:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.651+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b81a19c0 con 0x7f05b8101280 2024-09-17T01:08:33.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.652+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05ac00cdf0 con 0x7f05b8101280 2024-09-17T01:08:33.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.652+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05ac018810 con 0x7f05b8101280 2024-09-17T01:08:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.655+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a4005280 con 0x7f05b8101280 2024-09-17T01:08:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.655+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f05ac010430 con 0x7f05b8101280 2024-09-17T01:08:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.656+0000 7f059ffff640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f05a006e3f0 0x7f05a00708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.656+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f05ac014070 con 0x7f05b8101280 2024-09-17T01:08:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.656+0000 7f05b6ffd640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f05a006e3f0 0x7f05a00708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.657+0000 7f05b6ffd640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f05a006e3f0 0x7f05a00708b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05a802aaa0 tx=0x7f05a80314e0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.664+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f05ac053d10 con 0x7f05b8101280 2024-09-17T01:08:33.926 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:33 smithi103 ceph-mon[28156]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:33.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:33 smithi103 ceph-mon[28156]: pgmap v17: 65 pgs: 65 active+clean; 253 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 693 op/s 2024-09-17T01:08:33.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:33 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3251074360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:33 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3523310772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:33.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.944+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05a4000bf0 con 0x7f05a006e3f0 2024-09-17T01:08:33.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.945+0000 7f059ffff640 1 -- 172.21.15.103:0/1189818846 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f05a4000bf0 con 0x7f05a006e3f0 2024-09-17T01:08:33.944 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr" 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:08:33.945 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:08:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f05a006e3f0 msgr2=0x7f05a00708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f05a006e3f0 0x7f05a00708b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05a802aaa0 tx=0x7f05a80314e0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 msgr2=0x7f05b819c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 0x7f05b819c250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00e970 tx=0x7f05ac00ee30 comp rx=0 tx=0).stop 2024-09-17T01:08:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 shutdown_connections 2024-09-17T01:08:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f05a006e3f0 0x7f05a00708b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05b8101280 0x7f05b819c250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 --2- 172.21.15.103:0/1189818846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b80ff7c0 0x7f05b819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 >> 172.21.15.103:0/1189818846 conn(0x7f05b80fb330 msgr2=0x7f05b8104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 shutdown_connections 2024-09-17T01:08:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:33.948+0000 7f05bd52d640 1 -- 172.21.15.103:0/1189818846 wait complete. 2024-09-17T01:08:34.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:33 smithi143 ceph-mon[35452]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:34.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:33 smithi143 ceph-mon[35452]: pgmap v17: 65 pgs: 65 active+clean; 253 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 693 op/s 2024-09-17T01:08:34.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:33 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3251074360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:34.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:33 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3523310772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 -- 172.21.15.103:0/304063802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 msgr2=0x7fba701052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 --2- 172.21.15.103:0/304063802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 0x7fba701052e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fba600098b0 tx=0x7fba6002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 -- 172.21.15.103:0/304063802 shutdown_connections 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 --2- 172.21.15.103:0/304063802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 0x7fba701052e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 --2- 172.21.15.103:0/304063802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 -- 172.21.15.103:0/304063802 >> 172.21.15.103:0/304063802 conn(0x7fba700fa1c0 msgr2=0x7fba700fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:34.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 -- 172.21.15.103:0/304063802 shutdown_connections 2024-09-17T01:08:34.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.053+0000 7fba78313640 1 -- 172.21.15.103:0/304063802 wait complete. 2024-09-17T01:08:34.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.054+0000 7fba78313640 1 Processor -- start 2024-09-17T01:08:34.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.054+0000 7fba78313640 1 -- start start 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.054+0000 7fba78313640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.054+0000 7fba78313640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 0x7fba70197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.054+0000 7fba78313640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba701983c0 con 0x7fba70102ef0 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.054+0000 7fba78313640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba70198530 con 0x7fba701005c0 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:35556/0 (socket says 172.21.15.103:35556) 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 -- 172.21.15.103:0/1120994138 learned_addr learned my addr 172.21.15.103:0/1120994138 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:08:34.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba758ae640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 0x7fba70197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:34.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 -- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 msgr2=0x7fba70197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:34.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 0x7fba70197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 -- 172.21.15.103:0/1120994138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60009560 con 0x7fba701005c0 2024-09-17T01:08:34.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.055+0000 7fba760af640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701978b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00e970 tx=0x7fba6c00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:34.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.056+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba6c00cc90 con 0x7fba701005c0 2024-09-17T01:08:34.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.056+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba6c00cdf0 con 0x7fba701005c0 2024-09-17T01:08:34.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.056+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7019cfd0 con 0x7fba701005c0 2024-09-17T01:08:34.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.056+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba6c010430 con 0x7fba701005c0 2024-09-17T01:08:34.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.056+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7019d510 con 0x7fba701005c0 2024-09-17T01:08:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.057+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba701009a0 con 0x7fba701005c0 2024-09-17T01:08:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.057+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 30) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fba6c0106f0 con 0x7fba701005c0 2024-09-17T01:08:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.058+0000 7fba677fe640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fba5c06e3a0 0x7fba5c070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.058+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fba6c014070 con 0x7fba701005c0 2024-09-17T01:08:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.058+0000 7fba758ae640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fba5c06e3a0 0x7fba5c070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.058+0000 7fba758ae640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fba5c06e3a0 0x7fba5c070860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba60009880 tx=0x7fba600314e0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.062+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fba6c057d40 con 0x7fba701005c0 2024-09-17T01:08:34.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.407+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fba70108740 con 0x7fba701005c0 2024-09-17T01:08:34.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.407+0000 7fba677fe640 1 -- 172.21.15.103:0/1120994138 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fba6c05b400 con 0x7fba701005c0 2024-09-17T01:08:34.406 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:08:34.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fba5c06e3a0 msgr2=0x7fba5c070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fba5c06e3a0 0x7fba5c070860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba60009880 tx=0x7fba600314e0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 msgr2=0x7fba701978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701978b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00e970 tx=0x7fba6c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 shutdown_connections 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fba5c06e3a0 0x7fba5c070860 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba70102ef0 0x7fba70197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 --2- 172.21.15.103:0/1120994138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba701005c0 0x7fba701978b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.410+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 >> 172.21.15.103:0/1120994138 conn(0x7fba700fa1c0 msgr2=0x7fba700ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.411+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 shutdown_connections 2024-09-17T01:08:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:08:34.411+0000 7fba78313640 1 -- 172.21.15.103:0/1120994138 wait complete. 2024-09-17T01:08:34.983 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:34 smithi103 ceph-mon[28156]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:34.984 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:34 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/1120994138' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:35.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:34 smithi143 ceph-mon[35452]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:34 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/1120994138' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:36.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:35 smithi143 ceph-mon[35452]: pgmap v18: 65 pgs: 65 active+clean; 253 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 425 op/s 2024-09-17T01:08:36.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:35 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:36.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:35 smithi103 ceph-mon[28156]: pgmap v18: 65 pgs: 65 active+clean; 253 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 425 op/s 2024-09-17T01:08:36.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:35 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:37.883 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-17T01:08:37.884 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-17T01:08:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:37 smithi143 ceph-mon[35452]: pgmap v19: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 603 op/s 2024-09-17T01:08:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:37 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:37 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:37 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:38.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:37 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:37 smithi103 ceph-mon[28156]: pgmap v19: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 603 op/s 2024-09-17T01:08:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:37 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:37 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:37 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:38.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:37 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:38.197 DEBUG:teuthology.parallel:result is None 2024-09-17T01:08:39.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:38 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.160 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:39.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:38 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:39 smithi143 ceph-mon[35452]: Reconfiguring prometheus.smithi103 (dependencies changed)... 2024-09-17T01:08:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:39 smithi143 ceph-mon[35452]: pgmap v20: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-09-17T01:08:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:39 smithi143 ceph-mon[35452]: Reconfiguring daemon prometheus.smithi103 on smithi103 2024-09-17T01:08:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:39 smithi103 ceph-mon[28156]: Reconfiguring prometheus.smithi103 (dependencies changed)... 2024-09-17T01:08:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:39 smithi103 ceph-mon[28156]: pgmap v20: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-09-17T01:08:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:39 smithi103 ceph-mon[28156]: Reconfiguring daemon prometheus.smithi103 on smithi103 2024-09-17T01:08:42.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:41 smithi103 ceph-mon[28156]: pgmap v21: 65 pgs: 65 active+clean; 244 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-09-17T01:08:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:41 smithi143 ceph-mon[35452]: pgmap v21: 65 pgs: 65 active+clean; 244 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-09-17T01:08:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:43 smithi103 ceph-mon[28156]: pgmap v22: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 499 op/s 2024-09-17T01:08:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:43 smithi143 ceph-mon[35452]: pgmap v22: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 499 op/s 2024-09-17T01:08:46.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:45 smithi103 ceph-mon[28156]: pgmap v23: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 360 op/s 2024-09-17T01:08:46.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:45 smithi143 ceph-mon[35452]: pgmap v23: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 360 op/s 2024-09-17T01:08:48.059 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:47 smithi143 ceph-mon[35452]: pgmap v24: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 493 op/s 2024-09-17T01:08:48.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:47 smithi103 ceph-mon[28156]: pgmap v24: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 493 op/s 2024-09-17T01:08:50.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:49 smithi143 ceph-mon[35452]: pgmap v25: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1010 KiB/s rd, 1019 KiB/s wr, 315 op/s 2024-09-17T01:08:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:49 smithi103 ceph-mon[28156]: pgmap v25: 65 pgs: 65 active+clean; 236 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1010 KiB/s rd, 1019 KiB/s wr, 315 op/s 2024-09-17T01:08:50.926 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:50 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:50 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:51.788 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T01:08:51.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T01:08:51.971 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:51 smithi103 ceph-mon[28156]: pgmap v26: 65 pgs: 65 active+clean; 225 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1011 KiB/s rd, 1019 KiB/s wr, 333 op/s 2024-09-17T01:08:52.174 DEBUG:teuthology.parallel:result is None 2024-09-17T01:08:52.174 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:08:52.209 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:08:52.210 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:08:52.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:51 smithi143 ceph-mon[35452]: pgmap v26: 65 pgs: 65 active+clean; 225 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1011 KiB/s rd, 1019 KiB/s wr, 333 op/s 2024-09-17T01:08:52.241 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:08:52.241 DEBUG:teuthology.parallel:result is None 2024-09-17T01:08:53.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:53 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:53.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:53 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:53.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:53 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:08:53.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:53 smithi143 ceph-mon[35452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:08:53.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:53 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:53 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:53 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:53 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:08:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:53 smithi103 ceph-mon[28156]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:08:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:53 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.331 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:54 smithi143 ceph-mon[35452]: pgmap v27: 65 pgs: 65 active+clean; 222 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 407 op/s 2024-09-17T01:08:54.331 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:54 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:08:54.331 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:54 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:08:54.331 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:54 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:54 smithi103 ceph-mon[28156]: pgmap v27: 65 pgs: 65 active+clean; 222 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 407 op/s 2024-09-17T01:08:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:54 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:08:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:54 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:08:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:54 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.381 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:55 smithi143 ceph-mon[35452]: Upgrade: Updating mgr.smithi143.sxhocv 2024-09-17T01:08:55.381 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:55 smithi143 ceph-mon[35452]: Deploying daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:08:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:55 smithi103 ceph-mon[28156]: Upgrade: Updating mgr.smithi143.sxhocv 2024-09-17T01:08:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:55 smithi103 ceph-mon[28156]: Deploying daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:08:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:56 smithi143 ceph-mon[35452]: pgmap v28: 65 pgs: 65 active+clean; 222 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 832 KiB/s rd, 875 KiB/s wr, 260 op/s 2024-09-17T01:08:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:56 smithi103 ceph-mon[28156]: pgmap v28: 65 pgs: 65 active+clean; 222 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 832 KiB/s rd, 875 KiB/s wr, 260 op/s 2024-09-17T01:08:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:58 smithi103 ceph-mon[28156]: pgmap v29: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 351 op/s 2024-09-17T01:08:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:58 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:58 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:58 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:58 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:08:58 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.433 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:58 smithi143 ceph-mon[35452]: pgmap v29: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 351 op/s 2024-09-17T01:08:58.434 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:58 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.434 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:58 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.434 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:58 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.434 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:58 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:08:58.434 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:08:58 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:00 smithi143 ceph-mon[35452]: pgmap v30: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 597 KiB/s rd, 616 KiB/s wr, 218 op/s 2024-09-17T01:09:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:00 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:00 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:00.533 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:00 smithi103 ceph-mon[28156]: pgmap v30: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 597 KiB/s rd, 616 KiB/s wr, 218 op/s 2024-09-17T01:09:00.533 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:00 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:00.533 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:00 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:01.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:01 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:01.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:01 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:01.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:01 smithi143 ceph-mon[35452]: pgmap v31: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 598 KiB/s rd, 616 KiB/s wr, 218 op/s 2024-09-17T01:09:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:01 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:01 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:01.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:01 smithi103 ceph-mon[28156]: pgmap v31: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 598 KiB/s rd, 616 KiB/s wr, 218 op/s 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: Standby manager daemon smithi143.sxhocv restarted 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:09:02.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:02.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:02 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:03.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv restarted 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/1411473199' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:03.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:02 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:03 smithi103 ceph-mon[28156]: mgrmap e31: smithi103.efjaur(active, since 57s), standbys: smithi143.sxhocv 2024-09-17T01:09:03.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:03 smithi103 ceph-mon[28156]: pgmap v32: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 624 KiB/s rd, 643 KiB/s wr, 201 op/s 2024-09-17T01:09:04.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:03 smithi143 ceph-mon[35452]: mgrmap e31: smithi103.efjaur(active, since 57s), standbys: smithi143.sxhocv 2024-09-17T01:09:04.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:03 smithi143 ceph-mon[35452]: pgmap v32: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 624 KiB/s rd, 643 KiB/s wr, 201 op/s 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- 172.21.15.103:0/4017280047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 msgr2=0x7fd1201011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 --2- 172.21.15.103:0/4017280047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd1201011d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd108009880 tx=0x7fd10802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- 172.21.15.103:0/4017280047 shutdown_connections 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 --2- 172.21.15.103:0/4017280047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd1201011d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 --2- 172.21.15.103:0/4017280047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 0x7fd1200fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- 172.21.15.103:0/4017280047 >> 172.21.15.103:0/4017280047 conn(0x7fd1200fb2c0 msgr2=0x7fd1200fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- 172.21.15.103:0/4017280047 shutdown_connections 2024-09-17T01:09:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- 172.21.15.103:0/4017280047 wait complete. 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 Processor -- start 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- start start 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 0x7fd120195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd120195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201960c0 con 0x7fd120100d50 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.506+0000 7fd12635a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120196230 con 0x7fd1200ffb50 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd120195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd120195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54556/0 (socket says 172.21.15.103:54556) 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 -- 172.21.15.103:0/2038938418 learned_addr learned my addr 172.21.15.103:0/2038938418 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd11ffff640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 0x7fd120195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 -- 172.21.15.103:0/2038938418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 msgr2=0x7fd120195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 0x7fd120195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 -- 172.21.15.103:0/2038938418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009560 con 0x7fd120100d50 2024-09-17T01:09:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd11ffff640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 0x7fd120195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:09:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd117fff640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd120195b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd108005610 tx=0x7fd108005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd108004ba0 con 0x7fd120100d50 2024-09-17T01:09:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd108004d00 con 0x7fd120100d50 2024-09-17T01:09:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12019ac60 con 0x7fd120100d50 2024-09-17T01:09:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd108003bd0 con 0x7fd120100d50 2024-09-17T01:09:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.507+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12019b180 con 0x7fd120100d50 2024-09-17T01:09:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.508+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12018f6d0 con 0x7fd120100d50 2024-09-17T01:09:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.512+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fd108031640 con 0x7fd120100d50 2024-09-17T01:09:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.512+0000 7fd11dffb640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd10c06e3b0 0x7fd10c070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.513+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd1080af9c0 con 0x7fd120100d50 2024-09-17T01:09:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.513+0000 7fd11ffff640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd10c06e3b0 0x7fd10c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.513+0000 7fd11ffff640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd10c06e3b0 0x7fd10c070870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd120100bb0 tx=0x7fd110005db0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:04.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.516+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd108078ee0 con 0x7fd120100d50 2024-09-17T01:09:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.706+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd12002c590 con 0x7fd10c06e3b0 2024-09-17T01:09:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.707+0000 7fd11dffb640 1 -- 172.21.15.103:0/2038938418 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd12002c590 con 0x7fd10c06e3b0 2024-09-17T01:09:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd10c06e3b0 msgr2=0x7fd10c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd10c06e3b0 0x7fd10c070870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd120100bb0 tx=0x7fd110005db0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 msgr2=0x7fd120195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd120195b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd108005610 tx=0x7fd108005640 comp rx=0 tx=0).stop 2024-09-17T01:09:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 shutdown_connections 2024-09-17T01:09:04.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd10c06e3b0 0x7fd10c070870 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd120100d50 0x7fd120195b80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 --2- 172.21.15.103:0/2038938418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1200ffb50 0x7fd120195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 >> 172.21.15.103:0/2038938418 conn(0x7fd1200fb2c0 msgr2=0x7fd120104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:04.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 shutdown_connections 2024-09-17T01:09:04.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.709+0000 7fd12635a640 1 -- 172.21.15.103:0/2038938418 wait complete. 2024-09-17T01:09:04.716 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:09:04.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.798+0000 7ffa2fc78640 1 -- 172.21.15.103:0/2161306408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28100610 msgr2=0x7ffa28102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:04.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.798+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/2161306408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28100610 0x7ffa28102a00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffa240098b0 tx=0x7ffa2402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 -- 172.21.15.103:0/2161306408 shutdown_connections 2024-09-17T01:09:04.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/2161306408 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28102f40 0x7ffa28105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/2161306408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28100610 0x7ffa28102a00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 -- 172.21.15.103:0/2161306408 >> 172.21.15.103:0/2161306408 conn(0x7ffa280fa210 msgr2=0x7ffa280fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 -- 172.21.15.103:0/2161306408 shutdown_connections 2024-09-17T01:09:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 -- 172.21.15.103:0/2161306408 wait complete. 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.799+0000 7ffa2fc78640 1 Processor -- start 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2fc78640 1 -- start start 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2fc78640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28100610 0x7ffa28195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2fc78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 0x7ffa28195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2fc78640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28196190 con 0x7ffa28102f40 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2fc78640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28196300 con 0x7ffa28100610 2024-09-17T01:09:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2d213640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 0x7ffa28195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2d213640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 0x7ffa28195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54588/0 (socket says 172.21.15.103:54588) 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2d213640 1 -- 172.21.15.103:0/3247454792 learned_addr learned my addr 172.21.15.103:0/3247454792 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2da14640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28100610 0x7ffa28195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2d213640 1 -- 172.21.15.103:0/3247454792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28100610 msgr2=0x7ffa28195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2d213640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28100610 0x7ffa28195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2d213640 1 -- 172.21.15.103:0/3247454792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24009560 con 0x7ffa28102f40 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.800+0000 7ffa2da14640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28100610 0x7ffa28195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.801+0000 7ffa2d213640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 0x7ffa28195bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800e9a0 tx=0x7ffa1800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.801+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1800cc90 con 0x7ffa28102f40 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.801+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2819ada0 con 0x7ffa28102f40 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.801+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa1800cdf0 con 0x7ffa28102f40 2024-09-17T01:09:04.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.801+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa18010430 con 0x7ffa28102f40 2024-09-17T01:09:04.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.801+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2819b340 con 0x7ffa28102f40 2024-09-17T01:09:04.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.802+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa281009f0 con 0x7ffa28102f40 2024-09-17T01:09:04.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.803+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7ffa180106e0 con 0x7ffa28102f40 2024-09-17T01:09:04.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.803+0000 7ffa1effd640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffa1406e400 0x7ffa140708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:04.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.803+0000 7ffa2da14640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffa1406e400 0x7ffa140708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:04.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.803+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ffa18014070 con 0x7ffa28102f40 2024-09-17T01:09:04.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.804+0000 7ffa2da14640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffa1406e400 0x7ffa140708c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa24006010 tx=0x7ffa240314e0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:04.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:04.808+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ffa18057dd0 con 0x7ffa28102f40 2024-09-17T01:09:05.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.011+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa281039a0 con 0x7ffa1406e400 2024-09-17T01:09:05.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.012+0000 7ffa1effd640 1 -- 172.21.15.103:0/3247454792 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ffa281039a0 con 0x7ffa1406e400 2024-09-17T01:09:05.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffa1406e400 msgr2=0x7ffa140708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffa1406e400 0x7ffa140708c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa24006010 tx=0x7ffa240314e0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 msgr2=0x7ffa28195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 0x7ffa28195bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800e9a0 tx=0x7ffa1800ee60 comp rx=0 tx=0).stop 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 shutdown_connections 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7ffa1406e400 0x7ffa140708c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa28102f40 0x7ffa28195bc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 --2- 172.21.15.103:0/3247454792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa28100610 0x7ffa28195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.014+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 >> 172.21.15.103:0/3247454792 conn(0x7ffa280fa210 msgr2=0x7ffa280fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.015+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 shutdown_connections 2024-09-17T01:09:05.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.015+0000 7ffa2fc78640 1 -- 172.21.15.103:0/3247454792 wait complete. 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 -- 172.21.15.103:0/592664590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0fea30 msgr2=0x7fae5c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 --2- 172.21.15.103:0/592664590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0fea30 0x7fae5c0fee30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009880 tx=0x7fae4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 -- 172.21.15.103:0/592664590 shutdown_connections 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 --2- 172.21.15.103:0/592664590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae5c0ffc30 0x7fae5c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 --2- 172.21.15.103:0/592664590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0fea30 0x7fae5c0fee30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 -- 172.21.15.103:0/592664590 >> 172.21.15.103:0/592664590 conn(0x7fae5c0fa1c0 msgr2=0x7fae5c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 -- 172.21.15.103:0/592664590 shutdown_connections 2024-09-17T01:09:05.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.099+0000 7fae60b46640 1 -- 172.21.15.103:0/592664590 wait complete. 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae60b46640 1 Processor -- start 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae60b46640 1 -- start start 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae60b46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae5c0fea30 0x7fae5c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae60b46640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 0x7fae5c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae60b46640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c19a940 con 0x7fae5c0ffc30 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae60b46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c19aa80 con 0x7fae5c0fea30 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae59d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 0x7fae5c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae59d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 0x7fae5c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54592/0 (socket says 172.21.15.103:54592) 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae59d9b640 1 -- 172.21.15.103:0/4292054372 learned_addr learned my addr 172.21.15.103:0/4292054372 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae5a59c640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae5c0fea30 0x7fae5c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae59d9b640 1 -- 172.21.15.103:0/4292054372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae5c0fea30 msgr2=0x7fae5c068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.100+0000 7fae59d9b640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae5c0fea30 0x7fae5c068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae59d9b640 1 -- 172.21.15.103:0/4292054372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009560 con 0x7fae5c0ffc30 2024-09-17T01:09:05.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae59d9b640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 0x7fae5c19a370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fae4400e970 tx=0x7fae4400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:05.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae4400cc90 con 0x7fae5c0ffc30 2024-09-17T01:09:05.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae4400cdf0 con 0x7fae5c0ffc30 2024-09-17T01:09:05.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c19ad30 con 0x7fae5c0ffc30 2024-09-17T01:09:05.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae44018810 con 0x7fae5c0ffc30 2024-09-17T01:09:05.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.101+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c19b300 con 0x7fae5c0ffc30 2024-09-17T01:09:05.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.102+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c107620 con 0x7fae5c0ffc30 2024-09-17T01:09:05.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.103+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fae44010c10 con 0x7fae5c0ffc30 2024-09-17T01:09:05.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.103+0000 7fae537fe640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fae4806e3b0 0x7fae48070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.103+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fae44014070 con 0x7fae5c0ffc30 2024-09-17T01:09:05.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.103+0000 7fae5a59c640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fae4806e3b0 0x7fae48070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.104+0000 7fae5a59c640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fae4806e3b0 0x7fae48070870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009230 tx=0x7fae4c0314e0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:05.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.107+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fae44053d10 con 0x7fae5c0ffc30 2024-09-17T01:09:05.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.286+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae5c19b4f0 con 0x7fae4806e3b0 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.296+0000 7fae537fe640 1 -- 172.21.15.103:0/4292054372 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fae5c19b4f0 con 0x7fae4806e3b0 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (8m) 2s ago 9m 24.7M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (10m) 2s ago 10m 8124k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (9m) 5s ago 9m 7755k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (10m) 2s ago 10m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:09:05.294 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (9m) 5s ago 9m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (8m) 2s ago 9m 84.6M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (4m) 2s ago 4m 156M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (4m) 2s ago 4m 94.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (4m) 5s ago 4m 14.4M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (4m) 5s ago 4m 16.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (74s) 2s ago 11m 491M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (8s) 5s ago 9m 66.7M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (11m) 2s ago 11m 55.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 afe8f135ac91 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (8m) 5s ago 8m 44.8M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 a7eceba58ad3 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (10m) 2s ago 10m 15.9M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (9m) 5s ago 9m 16.4M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (8m) 2s ago 8m 228M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:09:05.295 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (7m) 2s ago 7m 238M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:09:05.296 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (7m) 2s ago 7m 208M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:09:05.296 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (7m) 5s ago 7m 283M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:09:05.296 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (6m) 5s ago 6m 267M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:09:05.296 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (6m) 5s ago 6m 230M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:09:05.296 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (13s) 2s ago 9m 44.4M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fae4806e3b0 msgr2=0x7fae48070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fae4806e3b0 0x7fae48070870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009230 tx=0x7fae4c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 msgr2=0x7fae5c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 0x7fae5c19a370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fae4400e970 tx=0x7fae4400ee30 comp rx=0 tx=0).stop 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 shutdown_connections 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fae4806e3b0 0x7fae48070870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae5c0ffc30 0x7fae5c19a370 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 --2- 172.21.15.103:0/4292054372 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae5c0fea30 0x7fae5c068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 >> 172.21.15.103:0/4292054372 conn(0x7fae5c0fa1c0 msgr2=0x7fae5c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 shutdown_connections 2024-09-17T01:09:05.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.298+0000 7fae60b46640 1 -- 172.21.15.103:0/4292054372 wait complete. 2024-09-17T01:09:05.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 -- 172.21.15.103:0/1703134982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80ffc30 msgr2=0x7f8ae81000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 --2- 172.21.15.103:0/1703134982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80ffc30 0x7f8ae81000b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009880 tx=0x7f8ad802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 -- 172.21.15.103:0/1703134982 shutdown_connections 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 --2- 172.21.15.103:0/1703134982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80ffc30 0x7f8ae81000b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 --2- 172.21.15.103:0/1703134982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae80fea30 0x7f8ae80fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 -- 172.21.15.103:0/1703134982 >> 172.21.15.103:0/1703134982 conn(0x7f8ae80fa1c0 msgr2=0x7f8ae80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 -- 172.21.15.103:0/1703134982 shutdown_connections 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 -- 172.21.15.103:0/1703134982 wait complete. 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 Processor -- start 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.382+0000 7f8aef692640 1 -- start start 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aef692640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 0x7f8ae81957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aef692640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae80ffc30 0x7f8ae8195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aef692640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae81962c0 con 0x7f8ae80fea30 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aef692640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8196430 con 0x7f8ae80ffc30 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 0x7f8ae81957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 0x7f8ae81957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54614/0 (socket says 172.21.15.103:54614) 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 -- 172.21.15.103:0/2705161310 learned_addr learned my addr 172.21.15.103:0/2705161310 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aecc2d640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae80ffc30 0x7f8ae8195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 -- 172.21.15.103:0/2705161310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae80ffc30 msgr2=0x7f8ae8195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae80ffc30 0x7f8ae8195cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 -- 172.21.15.103:0/2705161310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8009560 con 0x7f8ae80fea30 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aed42e640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 0x7f8ae81957b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400b400 tx=0x7f8ae400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae4011800 con 0x7f8ae80fea30 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.383+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae819ae60 con 0x7f8ae80fea30 2024-09-17T01:09:05.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.384+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ae4011e20 con 0x7f8ae80fea30 2024-09-17T01:09:05.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.384+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae400f2e0 con 0x7f8ae80fea30 2024-09-17T01:09:05.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.384+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae819b3a0 con 0x7f8ae80fea30 2024-09-17T01:09:05.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: Upgrade: Setting container_image for all mgr 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.efjaur"}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.efjaur"}]': finished 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi143.sxhocv"}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi143.sxhocv"}]': finished 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: pgmap v33: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 270 KiB/s rd, 183 KiB/s wr, 91 op/s 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:05.385 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:05 smithi103 ceph-mon[28156]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:05.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.385+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae80feeb0 con 0x7f8ae80fea30 2024-09-17T01:09:05.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.385+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f8ae4010380 con 0x7f8ae80fea30 2024-09-17T01:09:05.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.386+0000 7f8ade7fc640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f8ad406e3b0 0x7f8ad4070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.386+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8ae408dfd0 con 0x7f8ae80fea30 2024-09-17T01:09:05.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.386+0000 7f8aecc2d640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f8ad406e3b0 0x7f8ad4070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.386+0000 7f8aecc2d640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f8ad406e3b0 0x7f8ad4070870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8000c00 tx=0x7f8ad80314e0 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:05.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.390+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f8ae40574e0 con 0x7f8ae80fea30 2024-09-17T01:09:05.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.633+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ae81076c0 con 0x7f8ae80fea30 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.634+0000 7f8ade7fc640 1 -- 172.21.15.103:0/2705161310 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f8ae405aba0 con 0x7f8ae80fea30 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 12, 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:09:05.633 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:09:05.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f8ad406e3b0 msgr2=0x7f8ad4070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f8ad406e3b0 0x7f8ad4070870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8000c00 tx=0x7f8ad80314e0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 msgr2=0x7f8ae81957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 0x7f8ae81957b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400b400 tx=0x7f8ae400b8c0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 shutdown_connections 2024-09-17T01:09:05.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f8ad406e3b0 0x7f8ad4070870 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae80ffc30 0x7f8ae8195cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 --2- 172.21.15.103:0/2705161310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ae80fea30 0x7f8ae81957b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 >> 172.21.15.103:0/2705161310 conn(0x7f8ae80fa1c0 msgr2=0x7f8ae8067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 shutdown_connections 2024-09-17T01:09:05.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.636+0000 7f8aef692640 1 -- 172.21.15.103:0/2705161310 wait complete. 2024-09-17T01:09:05.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 -- 172.21.15.103:0/1572941882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240fea30 msgr2=0x7f78240fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 --2- 172.21.15.103:0/1572941882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240fea30 0x7f78240fee30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f781c009c20 tx=0x7f781c02a970 comp rx=0 tx=0).stop 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 -- 172.21.15.103:0/1572941882 shutdown_connections 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 --2- 172.21.15.103:0/1572941882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78240ffc30 0x7f78241000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 --2- 172.21.15.103:0/1572941882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240fea30 0x7f78240fee30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 -- 172.21.15.103:0/1572941882 >> 172.21.15.103:0/1572941882 conn(0x7f78240fa1c0 msgr2=0x7f78240fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 -- 172.21.15.103:0/1572941882 shutdown_connections 2024-09-17T01:09:05.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.718+0000 7f782b5b1640 1 -- 172.21.15.103:0/1572941882 wait complete. 2024-09-17T01:09:05.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782b5b1640 1 Processor -- start 2024-09-17T01:09:05.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782b5b1640 1 -- start start 2024-09-17T01:09:05.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782b5b1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78240fea30 0x7f7824194530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782b5b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 0x7f7824194a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782b5b1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7824195040 con 0x7f78240ffc30 2024-09-17T01:09:05.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782b5b1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78241951b0 con 0x7f78240fea30 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f7828b4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 0x7f7824194a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f7828b4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 0x7f7824194a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54640/0 (socket says 172.21.15.103:54640) 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f7828b4c640 1 -- 172.21.15.103:0/2643581133 learned_addr learned my addr 172.21.15.103:0/2643581133 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.719+0000 7f782934d640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78240fea30 0x7f7824194530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f7828b4c640 1 -- 172.21.15.103:0/2643581133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78240fea30 msgr2=0x7f7824194530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f7828b4c640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78240fea30 0x7f7824194530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f7828b4c640 1 -- 172.21.15.103:0/2643581133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009900 con 0x7f78240ffc30 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f7828b4c640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 0x7f7824194a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f781800d720 tx=0x7f781800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78180051f0 con 0x7f78240ffc30 2024-09-17T01:09:05.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7818009ce0 con 0x7f78240ffc30 2024-09-17T01:09:05.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7824199c50 con 0x7f78240ffc30 2024-09-17T01:09:05.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7818010460 con 0x7f78240ffc30 2024-09-17T01:09:05.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.720+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782419a220 con 0x7f78240ffc30 2024-09-17T01:09:05.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.721+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7824107640 con 0x7f78240ffc30 2024-09-17T01:09:05.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.722+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f7818005350 con 0x7f78240ffc30 2024-09-17T01:09:05.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.722+0000 7f78227fc640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f780c06e3b0 0x7f780c070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:05.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.722+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f781808df70 con 0x7f78240ffc30 2024-09-17T01:09:05.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.722+0000 7f782934d640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f780c06e3b0 0x7f780c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:05.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.723+0000 7f782934d640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f780c06e3b0 0x7f780c070870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f781c000f80 tx=0x7f781c009360 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:05.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.726+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f78180c2d10 con 0x7f78240ffc30 2024-09-17T01:09:05.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: Upgrade: Setting container_image for all mgr 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:05.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.efjaur"}]: dispatch 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.efjaur"}]': finished 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi143.sxhocv"}]: dispatch 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi143.sxhocv"}]': finished 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: pgmap v33: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 270 KiB/s rd, 183 KiB/s wr, 91 op/s 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:05.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:05 smithi143 ceph-mon[35452]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.930+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f782419a410 con 0x7f78240ffc30 2024-09-17T01:09:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.930+0000 7f78227fc640 1 -- 172.21.15.103:0/2643581133 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1878 (secure 0 0 0) 0x7f7818017770 con 0x7f78240ffc30 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:09:05.929 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:09:05.930 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:09:05.931 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:05.932 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:05.933 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:09:05.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f780c06e3b0 msgr2=0x7f780c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f780c06e3b0 0x7f780c070870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f781c000f80 tx=0x7f781c009360 comp rx=0 tx=0).stop 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 msgr2=0x7f7824194a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 0x7f7824194a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f781800d720 tx=0x7f781800dbe0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 shutdown_connections 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f780c06e3b0 0x7f780c070870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78240ffc30 0x7f7824194a70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 --2- 172.21.15.103:0/2643581133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78240fea30 0x7f7824194530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 >> 172.21.15.103:0/2643581133 conn(0x7f78240fa1c0 msgr2=0x7f7824102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 shutdown_connections 2024-09-17T01:09:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:05.932+0000 7f782b5b1640 1 -- 172.21.15.103:0/2643581133 wait complete. 2024-09-17T01:09:06.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.015+0000 7fd596198640 1 -- 172.21.15.103:0/2031424045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900feaa0 msgr2=0x7fd5900feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.015+0000 7fd596198640 1 --2- 172.21.15.103:0/2031424045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900feaa0 0x7fd5900feea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd580009880 tx=0x7fd58002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.015+0000 7fd596198640 1 -- 172.21.15.103:0/2031424045 shutdown_connections 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.015+0000 7fd596198640 1 --2- 172.21.15.103:0/2031424045 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5900ffca0 0x7fd590100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.015+0000 7fd596198640 1 --2- 172.21.15.103:0/2031424045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900feaa0 0x7fd5900feea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.015+0000 7fd596198640 1 -- 172.21.15.103:0/2031424045 >> 172.21.15.103:0/2031424045 conn(0x7fd5900fa230 msgr2=0x7fd5900fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.016+0000 7fd596198640 1 -- 172.21.15.103:0/2031424045 shutdown_connections 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.016+0000 7fd596198640 1 -- 172.21.15.103:0/2031424045 wait complete. 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.016+0000 7fd596198640 1 Processor -- start 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.016+0000 7fd596198640 1 -- start start 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd596198640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5900feaa0 0x7fd590068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd596198640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 0x7fd59019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:06.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd596198640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59019aa40 con 0x7fd5900ffca0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd596198640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59019abb0 con 0x7fd5900feaa0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 0x7fd59019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 0x7fd59019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54664/0 (socket says 172.21.15.103:54664) 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 -- 172.21.15.103:0/1129043898 learned_addr learned my addr 172.21.15.103:0/1129043898 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58f7fe640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5900feaa0 0x7fd590068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 -- 172.21.15.103:0/1129043898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5900feaa0 msgr2=0x7fd590068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5900feaa0 0x7fd590068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 -- 172.21.15.103:0/1129043898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009560 con 0x7fd5900ffca0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58effd640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 0x7fd59019a500 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd58400b420 tx=0x7fd58400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd584011800 con 0x7fd5900ffca0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd584011e20 con 0x7fd5900ffca0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59019ae90 con 0x7fd5900ffca0 2024-09-17T01:09:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd58400f2e0 con 0x7fd5900ffca0 2024-09-17T01:09:06.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.017+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59019b430 con 0x7fd5900ffca0 2024-09-17T01:09:06.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.018+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900fef20 con 0x7fd5900ffca0 2024-09-17T01:09:06.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.019+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7fd584010380 con 0x7fd5900ffca0 2024-09-17T01:09:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.019+0000 7fd58cff9640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd57806e3b0 0x7fd578070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.019+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd58408dc10 con 0x7fd5900ffca0 2024-09-17T01:09:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.019+0000 7fd58f7fe640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd57806e3b0 0x7fd578070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.020+0000 7fd58f7fe640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd57806e3b0 0x7fd578070870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd580009230 tx=0x7fd580005b50 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.024+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd584057110 con 0x7fd5900ffca0 2024-09-17T01:09:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.224+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 --> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd59002c540 con 0x7fd57806e3b0 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.225+0000 7fd58cff9640 1 -- 172.21.15.103:0/1129043898 <== mgr.14714 v2:172.21.15.103:6800/3853554040 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd59002c540 con 0x7fd57806e3b0 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:09:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr" 2024-09-17T01:09:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:09:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:09:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:09:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:09:06.224 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:09:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd57806e3b0 msgr2=0x7fd578070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd57806e3b0 0x7fd578070870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd580009230 tx=0x7fd580005b50 comp rx=0 tx=0).stop 2024-09-17T01:09:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 msgr2=0x7fd59019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 0x7fd59019a500 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd58400b420 tx=0x7fd58400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 shutdown_connections 2024-09-17T01:09:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7fd57806e3b0 0x7fd578070870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5900ffca0 0x7fd59019a500 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 --2- 172.21.15.103:0/1129043898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5900feaa0 0x7fd590068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 >> 172.21.15.103:0/1129043898 conn(0x7fd5900fa230 msgr2=0x7fd5901033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 shutdown_connections 2024-09-17T01:09:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.227+0000 7fd596198640 1 -- 172.21.15.103:0/1129043898 wait complete. 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3128564987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 msgr2=0x7f3c781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3128564987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c781029b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3c680098b0 tx=0x7f3c6802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3128564987 shutdown_connections 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3128564987 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 0x7f3c781052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3128564987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c781029b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3128564987 >> 172.21.15.103:0/3128564987 conn(0x7f3c780fa1c0 msgr2=0x7f3c780fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3128564987 shutdown_connections 2024-09-17T01:09:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.311+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3128564987 wait complete. 2024-09-17T01:09:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c7d5e9640 1 Processor -- start 2024-09-17T01:09:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c7d5e9640 1 -- start start 2024-09-17T01:09:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c7d5e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c78195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c7d5e9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 0x7f3c78195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c7d5e9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78196170 con 0x7f3c781005c0 2024-09-17T01:09:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c7d5e9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c781962e0 con 0x7f3c78102ef0 2024-09-17T01:09:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c78195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c78195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54694/0 (socket says 172.21.15.103:54694) 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.312+0000 7f3c76ffd640 1 -- 172.21.15.103:0/3647665036 learned_addr learned my addr 172.21.15.103:0/3647665036 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c767fc640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 0x7f3c78195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c76ffd640 1 -- 172.21.15.103:0/3647665036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 msgr2=0x7f3c78195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c76ffd640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 0x7f3c78195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c76ffd640 1 -- 172.21.15.103:0/3647665036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68009560 con 0x7f3c781005c0 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c767fc640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 0x7f3c78195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c76ffd640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c78195660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3c680054f0 tx=0x7f3c68005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c68004aa0 con 0x7f3c781005c0 2024-09-17T01:09:06.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c68004c00 con 0x7f3c781005c0 2024-09-17T01:09:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c68003b10 con 0x7f3c781005c0 2024-09-17T01:09:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7819ad20 con 0x7f3c781005c0 2024-09-17T01:09:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.313+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7819b240 con 0x7f3c781005c0 2024-09-17T01:09:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.314+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c78108750 con 0x7f3c781005c0 2024-09-17T01:09:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.315+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 31) v1 ==== 92516+0+0 (secure 0 0 0) 0x7f3c68031640 con 0x7f3c781005c0 2024-09-17T01:09:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.315+0000 7f3c5ffff640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f3c6006e3b0 0x7f3c60070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.315+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f3c680af5c0 con 0x7f3c781005c0 2024-09-17T01:09:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.315+0000 7f3c767fc640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f3c6006e3b0 0x7f3c60070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.316+0000 7f3c767fc640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f3c6006e3b0 0x7f3c60070870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c78196b80 tx=0x7f3c6c005e50 comp rx=0 tx=0).ready entity=mgr.14714 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:06.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.320+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f3c680789c0 con 0x7f3c781005c0 2024-09-17T01:09:06.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.560+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3c78108900 con 0x7f3c781005c0 2024-09-17T01:09:06.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.560+0000 7f3c5ffff640 1 -- 172.21.15.103:0/3647665036 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3c6807c080 con 0x7f3c781005c0 2024-09-17T01:09:06.559 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.562+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f3c6006e3b0 msgr2=0x7f3c60070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.562+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f3c6006e3b0 0x7f3c60070870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c78196b80 tx=0x7f3c6c005e50 comp rx=0 tx=0).stop 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 msgr2=0x7f3c78195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c78195660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3c680054f0 tx=0x7f3c68005520 comp rx=0 tx=0).stop 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 shutdown_connections 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:6800/3853554040,v1:172.21.15.103:6801/3853554040] conn(0x7f3c6006e3b0 0x7f3c60070870 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c78102ef0 0x7f3c78195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 --2- 172.21.15.103:0/3647665036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c781005c0 0x7f3c78195660 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:06.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 >> 172.21.15.103:0/3647665036 conn(0x7f3c780fa1c0 msgr2=0x7f3c780fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:06.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 shutdown_connections 2024-09-17T01:09:06.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:06.563+0000 7f3c7d5e9640 1 -- 172.21.15.103:0/3647665036 wait complete. 2024-09-17T01:09:06.796 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:06.796 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2705161310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/2643581133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: Upgrade: Updating mon.smithi103 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: Deploying daemon mon.smithi103 on smithi103 2024-09-17T01:09:06.797 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:06 smithi103 ceph-mon[28156]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2705161310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/2643581133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: Upgrade: Updating mon.smithi103 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: Deploying daemon mon.smithi103 on smithi103 2024-09-17T01:09:07.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:06 smithi143 ceph-mon[35452]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.818 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:07 smithi103 ceph-mon[28156]: from='client.? 172.21.15.103:0/3647665036' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:07.819 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:07 smithi103 ceph-mon[28156]: pgmap v34: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 270 KiB/s rd, 183 KiB/s wr, 92 op/s 2024-09-17T01:09:08.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:07 smithi143 ceph-mon[35452]: from='client.? 172.21.15.103:0/3647665036' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:08.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:07 smithi143 ceph-mon[35452]: pgmap v34: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 270 KiB/s rd, 183 KiB/s wr, 92 op/s 2024-09-17T01:09:08.383 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:08 smithi103 systemd[1]: Stopping Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:09:08.635 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[28152]: 2024-09-17T01:09:08.384+0000 7ff193d91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi103 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:09:08.635 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[28152]: 2024-09-17T01:09:08.384+0000 7ff193d91640 -1 mon.smithi103@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T01:09:08.635 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:08 smithi103 podman[92563]: 2024-09-17 01:09:08.415351231 +0000 UTC m=+0.139840977 container died afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:09:08.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:08 smithi103 podman[92563]: 2024-09-17 01:09:08.817626007 +0000 UTC m=+0.542115785 container cleanup afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T01:09:08.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:08 smithi103 bash[92563]: ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103 2024-09-17T01:09:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 podman[92577]: 2024-09-17 01:09:09.077979463 +0000 UTC m=+0.663951970 container remove afe8f135ac91001287e7d4596f03100cb0baf192881b910061228fb207d2b63e (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T01:09:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service: Deactivated successfully. 2024-09-17T01:09:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 systemd[1]: Stopped Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:09:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service: Consumed 11.004s CPU time. 2024-09-17T01:09:09.795 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 systemd[1]: Starting Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:09:09.795 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 podman[92714]: 2024-09-17 01:09:09.567823815 +0000 UTC m=+0.016823737 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:09:09.795 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 podman[92714]: 2024-09-17 01:09:09.687602234 +0000 UTC m=+0.136602142 container create 76837adde89025e7f17d0e7a62f2f536801a9f72cf9d91dae1206d682a0ba8f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97) 2024-09-17T01:09:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 podman[92714]: 2024-09-17 01:09:09.907016034 +0000 UTC m=+0.356015949 container init 76837adde89025e7f17d0e7a62f2f536801a9f72cf9d91dae1206d682a0ba8f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T01:09:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 podman[92714]: 2024-09-17 01:09:09.910558984 +0000 UTC m=+0.359558904 container start 76837adde89025e7f17d0e7a62f2f536801a9f72cf9d91dae1206d682a0ba8f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: pidfile_write: ignore empty --pid-file 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: load: jerasure load: lrc 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Git sha 0 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: DB SUMMARY 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: DB Session ID: HBPHBHP70MVUAC7008ZU 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:09:10.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1259 Bytes 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi103/store.db dir, Total Num: 1, files: 000029.sst 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi103/store.db: 000027.log size: 2850426 ; 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.env: 0x55c4ded58940 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.info_log: 0x55c4dfaa18c0 2024-09-17T01:09:10.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:09:10.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.statistics: (nil) 2024-09-17T01:09:10.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.use_fsync: 0 2024-09-17T01:09:10.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:09:10.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.db_log_dir: 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.wal_dir: 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:09:10.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.write_buffer_manager: 0x55c4dfab0dc0 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:09:10.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.unordered_write: 0 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.row_cache: None 2024-09-17T01:09:10.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.wal_filter: None 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.wal_compression: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:09:10.184 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:09:10.185 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_open_files: -1 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Compression algorithms supported: 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kZSTD supported: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:09:10.186 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi103/store.db/MANIFEST-000015 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.merge_operator: 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_filter: None 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:09:10.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4dfaa1520) 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_type: 0 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_block_index_type: 0 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_shortening: 1 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:09:10.188 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: checksum: 4 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: no_block_cache: 0 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache: 0x55c4dfa951f0 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_options: 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: capacity : 536870912 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: num_shard_bits : 4 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: strict_capacity_limit : 0 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_compressed: (nil) 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: persistent_cache: (nil) 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_size: 4096 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_size_deviation: 10 2024-09-17T01:09:10.189 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_restart_interval: 16 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_block_restart_interval: 1 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: metadata_block_size: 4096 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: partition_filters: 0 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: use_delta_encoding: 1 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: filter_policy: bloomfilter 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: whole_key_filtering: 1 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: verify_compression: 0 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: format_version: 5 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: enable_index_compression: 1 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_align: 0 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_auto_readahead_size: 262144 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: prepopulate_block_cache: 0 2024-09-17T01:09:10.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression: NoCompression 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.num_levels: 7 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:09:10.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:09:10.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:09:10.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:09:10.194 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:09:10.194 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:09:10.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:09:10.196 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.ttl: 2592000 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:09:10.197 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi103/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 31, last_sequence is 10211, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 27 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 27 2024-09-17T01:09:10.198 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1f3af57d-92f6-4dd2-9c4d-5193c8d1668a 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535349937787, "job": 1, "event": "recovery_started", "wal_files": [27]} 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #27 mode 2 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535349945862, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 2605551, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10212, "largest_seqno": 11483, "table_properties": {"data_size": 2598750, "index_size": 4284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 12970, "raw_average_key_size": 22, "raw_value_size": 2586196, "raw_average_value_size": 4569, "num_data_blocks": 196, "num_entries": 566, "num_filter_entries": 566, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535349, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1f3af57d-92f6-4dd2-9c4d-5193c8d1668a", "db_session_id": "HBPHBHP70MVUAC7008ZU", "orig_file_number": 32, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535349945981, "job": 1, "event": "recovery_finished"} 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/version_set.cc:5047] Creating manifest 34 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi103/store.db/000027.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c4dfac2e00 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: DB pointer 0x55c4dfbbe000 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** DB Stats ** 2024-09-17T01:09:10.199 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:09:10.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: L0 1/0 2.48 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 610.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: L6 1/0 5.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Sum 2/0 7.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 610.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 610.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 610.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-17T01:09:10.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative compaction: 0.00 GB write, 203.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval compaction: 0.00 GB write, 203.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Block cache BinnedLRUCache@0x55c4dfa951f0#2 capacity: 512.00 MB usage: 6.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: starting mon.smithi103 rank 0 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi103 fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???) e2 preinit fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:10.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).mds e16 new map 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).mds e16 print_map 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: e16 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: legacy client fscid: 1 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: fs_name cephfs 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: epoch 16 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:09:10.203 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: tableserver 0 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: root 0 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: session_timeout 60 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: session_autoclose 300 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_file_size 1099511627776 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_xattr_size 65536 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: required_client_features {} 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: last_failure 0 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: last_failure_osd_epoch 0 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_mds 1 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: in 0 2024-09-17T01:09:10.204 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: up {0=14468} 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: failed 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: damaged 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: stopped 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_pools [3] 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: metadata_pool 2 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: inline_data disabled 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: balancer 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: bal_rank_mask -1 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: standby_count_wanted 1 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: qdb_cluster leader: 0 members: 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:10.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Standby daemons: 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:09 smithi103 ceph-mon[92733]: mon.smithi103@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:10 smithi103 bash[92714]: 76837adde89025e7f17d0e7a62f2f536801a9f72cf9d91dae1206d682a0ba8f2 2024-09-17T01:09:10.206 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:10 smithi103 systemd[1]: Started Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:09:13.330 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:09:13.330 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:09:13.330 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: pgmap v35: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 27 KiB/s wr, 1 op/s 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: pgmap v36: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 27 KiB/s wr, 2 op/s 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: mon.smithi103 calling monitor election 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: mon.smithi103 is new leader, mons smithi103,smithi143 in quorum (ranks 0,1) 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: monmap epoch 2 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: last_changed 2024-09-17T01:00:07.438962+0000 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: created 2024-09-17T00:57:34.622316+0000 2024-09-17T01:09:13.331 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: min_mon_release 18 (reef) 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: election_strategy: 1 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: 1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.smithi143 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: mgrmap e31: smithi103.efjaur(active, since 68s), standbys: smithi143.sxhocv 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: overall HEALTH_OK 2024-09-17T01:09:13.332 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: from='mgr.14714 ' entity='' 2024-09-17T01:09:13.333 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:13 smithi103 ceph-mon[92733]: mgrmap e32: smithi103.efjaur(active, since 68s), standbys: smithi143.sxhocv 2024-09-17T01:09:13.333 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:09:13.333 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: from='mgr.14714 172.21.15.103:0/3563161482' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:09:13.333 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: pgmap v35: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 27 KiB/s wr, 1 op/s 2024-09-17T01:09:13.333 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: pgmap v36: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 27 KiB/s wr, 2 op/s 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: mon.smithi103 calling monitor election 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: mon.smithi103 is new leader, mons smithi103,smithi143 in quorum (ranks 0,1) 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: monmap epoch 2 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: last_changed 2024-09-17T01:00:07.438962+0000 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: created 2024-09-17T00:57:34.622316+0000 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: min_mon_release 18 (reef) 2024-09-17T01:09:13.334 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: election_strategy: 1 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: 1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.smithi143 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: mgrmap e31: smithi103.efjaur(active, since 68s), standbys: smithi143.sxhocv 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: overall HEALTH_OK 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: from='mgr.14714 ' entity='' 2024-09-17T01:09:13.335 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:13 smithi143 ceph-mon[35452]: mgrmap e32: smithi103.efjaur(active, since 68s), standbys: smithi143.sxhocv 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv restarted 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: Active manager daemon smithi103.efjaur restarted 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: Activating manager daemon smithi103.efjaur 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: mgrmap e33: smithi103.efjaur(active, starting, since 0.00578159s), standbys: smithi143.sxhocv 2024-09-17T01:09:18.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi143.sxhocv", "id": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:09:18.027 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:17 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:09:18.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: Standby manager daemon smithi143.sxhocv restarted 2024-09-17T01:09:18.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: Standby manager daemon smithi143.sxhocv started 2024-09-17T01:09:18.052 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/crt"}]: dispatch 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi143.sxhocv/key"}]: dispatch 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.? 172.21.15.143:0/3869553989' entity='mgr.smithi143.sxhocv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: Active manager daemon smithi103.efjaur restarted 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: Activating manager daemon smithi103.efjaur 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: mgrmap e33: smithi103.efjaur(active, starting, since 0.00578159s), standbys: smithi143.sxhocv 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:09:18.053 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:09:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:09:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:09:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:09:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi103.efjaur", "id": "smithi103.efjaur"}]: dispatch 2024-09-17T01:09:18.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr metadata", "who": "smithi143.sxhocv", "id": "smithi143.sxhocv"}]: dispatch 2024-09-17T01:09:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:09:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:09:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:09:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:09:18.057 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:09:19.070 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: Manager daemon smithi103.efjaur is now available 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:09:19.071 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:18 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T01:09:19.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:09:19.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:09:19.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:09:19.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: Manager daemon smithi103.efjaur is now available 2024-09-17T01:09:19.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:19.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:19.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:09:19.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.efjaur/trash_purge_schedule"}]: dispatch 2024-09-17T01:09:19.850 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:19 smithi143 ceph-mon[35452]: mgrmap e34: smithi103.efjaur(active, since 1.02491s), standbys: smithi143.sxhocv 2024-09-17T01:09:19.850 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:19 smithi143 ceph-mon[35452]: [17/Sep/2024:01:09:19] ENGINE Bus STARTING 2024-09-17T01:09:19.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:19 smithi103 ceph-mon[92733]: mgrmap e34: smithi103.efjaur(active, since 1.02491s), standbys: smithi143.sxhocv 2024-09-17T01:09:19.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:19 smithi103 ceph-mon[92733]: [17/Sep/2024:01:09:19] ENGINE Bus STARTING 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:20 smithi103 ceph-mon[92733]: [17/Sep/2024:01:09:19] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:20 smithi103 ceph-mon[92733]: [17/Sep/2024:01:09:19] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:20 smithi103 ceph-mon[92733]: [17/Sep/2024:01:09:19] ENGINE Bus STARTED 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:20 smithi103 ceph-mon[92733]: [17/Sep/2024:01:09:19] ENGINE Error in HTTPServer.serve 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:09:21.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-17T01:09:21.097 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:09:21.098 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-17T01:09:21.098 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:09:21.098 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:20 smithi103 ceph-mon[92733]: pgmap v4: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:21.098 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:20 smithi103 ceph-mon[92733]: mgrmap e35: smithi103.efjaur(active, since 2s), standbys: smithi143.sxhocv 2024-09-17T01:09:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:20 smithi143 ceph-mon[35452]: [17/Sep/2024:01:09:19] ENGINE Serving on http://172.21.15.103:8765 2024-09-17T01:09:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:20 smithi143 ceph-mon[35452]: [17/Sep/2024:01:09:19] ENGINE Serving on https://172.21.15.103:7150 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:20 smithi143 ceph-mon[35452]: [17/Sep/2024:01:09:19] ENGINE Bus STARTED 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:20 smithi143 ceph-mon[35452]: [17/Sep/2024:01:09:19] ENGINE Error in HTTPServer.serve 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Traceback (most recent call last): 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._run(expiration_interval) 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:09:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: s = self.context.wrap_socket( 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: return self.sslsocket_class._create( 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self.do_handshake() 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: self._sslobj.do_handshake() 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:20 smithi143 ceph-mon[35452]: pgmap v4: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:21.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:20 smithi143 ceph-mon[35452]: mgrmap e35: smithi103.efjaur(active, since 2s), standbys: smithi143.sxhocv 2024-09-17T01:09:22.343 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:22 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.343 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:22 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.343 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:22 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.344 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:22 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:22.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:23.098 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:23 smithi143 ceph-mon[35452]: pgmap v5: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:23.098 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:23 smithi143 ceph-mon[35452]: mgrmap e36: smithi103.efjaur(active, since 4s), standbys: smithi143.sxhocv 2024-09-17T01:09:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:23 smithi103 ceph-mon[92733]: pgmap v5: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:23 smithi103 ceph-mon[92733]: mgrmap e36: smithi103.efjaur(active, since 4s), standbys: smithi143.sxhocv 2024-09-17T01:09:24.422 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:24 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.422 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:24 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.422 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:24 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.422 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:24 smithi143 ceph-mon[35452]: pgmap v6: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:24.422 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:24 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:24 smithi103 ceph-mon[92733]: pgmap v6: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.204 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:26.205 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:25 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:27.156 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: pgmap v7: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.157 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:26 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: Updating smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: Updating smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: pgmap v7: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:09:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: Upgrade: Updating mon.smithi143 2024-09-17T01:09:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: Deploying daemon mon.smithi143 on smithi143 2024-09-17T01:09:28.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 ceph-mon[35452]: pgmap v8: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: Upgrade: Updating mon.smithi143 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: Deploying daemon mon.smithi143 on smithi143 2024-09-17T01:09:28.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:28 smithi103 ceph-mon[92733]: pgmap v8: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:09:29.110 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:28 smithi143 systemd[1]: Stopping Ceph mon.smithi143 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:09:29.367 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143[35446]: 2024-09-17T01:09:29.110+0000 7f3ba9422640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi143 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:09:29.367 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143[35446]: 2024-09-17T01:09:29.110+0000 7f3ba9422640 -1 mon.smithi143@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T01:09:29.367 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 podman[80525]: 2024-09-17 01:09:29.172821283 +0000 UTC m=+0.164645063 container died a7eceba58ad37033c83d5e1373509ec8e78f0439458f73aa9e9af663dab2b160 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:09:29.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 podman[80525]: 2024-09-17 01:09:29.544418453 +0000 UTC m=+0.536242232 container cleanup a7eceba58ad37033c83d5e1373509ec8e78f0439458f73aa9e9af663dab2b160 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T01:09:29.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 bash[80525]: ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143 2024-09-17T01:09:30.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 podman[80537]: 2024-09-17 01:09:29.79542447 +0000 UTC m=+0.622977873 container remove a7eceba58ad37033c83d5e1373509ec8e78f0439458f73aa9e9af663dab2b160 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T01:09:30.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi143.service: Deactivated successfully. 2024-09-17T01:09:30.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 systemd[1]: Stopped Ceph mon.smithi143 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:09:30.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:29 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi143.service: Consumed 6.156s CPU time. 2024-09-17T01:09:30.505 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 systemd[1]: Starting Ceph mon.smithi143 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:09:30.505 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 podman[80666]: 2024-09-17 01:09:30.282732709 +0000 UTC m=+0.015706651 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:09:30.505 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 podman[80666]: 2024-09-17 01:09:30.396660395 +0000 UTC m=+0.129634383 container create 03d2b861ad7f539b685594f973b4ecfc3257534bfa81675edc7d21f3505f32d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T01:09:30.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 podman[80666]: 2024-09-17 01:09:30.632025862 +0000 UTC m=+0.364999813 container init 03d2b861ad7f539b685594f973b4ecfc3257534bfa81675edc7d21f3505f32d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97) 2024-09-17T01:09:30.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 podman[80666]: 2024-09-17 01:09:30.635305566 +0000 UTC m=+0.368279509 container start 03d2b861ad7f539b685594f973b4ecfc3257534bfa81675edc7d21f3505f32d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T01:09:30.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:09:30.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:09:30.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: pidfile_write: ignore empty --pid-file 2024-09-17T01:09:30.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: load: jerasure load: lrc 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Git sha 0 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: DB SUMMARY 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: DB Session ID: NJ93CNVNWIW2G08CREV4 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1391 Bytes 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi143/store.db dir, Total Num: 1, files: 000027.sst 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi143/store.db: 000025.log size: 167924 ; 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:09:30.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.env: 0x55de30dc1940 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.info_log: 0x55de3199d8c0 2024-09-17T01:09:30.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.statistics: (nil) 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.use_fsync: 0 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:09:30.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.db_log_dir: 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.wal_dir: 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:09:30.762 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.write_buffer_manager: 0x55de319acdc0 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:09:30.763 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.unordered_write: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.row_cache: None 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.wal_filter: None 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.wal_compression: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:09:30.764 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:09:30.765 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_open_files: -1 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:09:30.766 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Compression algorithms supported: 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kZSTD supported: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:09:30.767 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi143/store.db/MANIFEST-000010 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.merge_operator: 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_filter: None 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:09:30.768 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55de3199d520) 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: index_type: 0 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: data_block_index_type: 0 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: index_shortening: 1 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: checksum: 4 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: no_block_cache: 0 2024-09-17T01:09:30.769 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache: 0x55de319911f0 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache_options: 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: capacity : 536870912 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: num_shard_bits : 4 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: strict_capacity_limit : 0 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_cache_compressed: (nil) 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: persistent_cache: (nil) 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_size: 4096 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_size_deviation: 10 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_restart_interval: 16 2024-09-17T01:09:30.770 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: index_block_restart_interval: 1 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: metadata_block_size: 4096 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: partition_filters: 0 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: use_delta_encoding: 1 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: filter_policy: bloomfilter 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: whole_key_filtering: 1 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: verify_compression: 0 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: format_version: 5 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: enable_index_compression: 1 2024-09-17T01:09:30.771 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: block_align: 0 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: max_auto_readahead_size: 262144 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: prepopulate_block_cache: 0 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression: NoCompression 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.num_levels: 7 2024-09-17T01:09:30.772 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:09:30.773 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:09:30.774 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:09:30.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:09:30.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:09:30.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:09:30.775 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:09:30.776 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:09:30.777 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.ttl: 2592000 2024-09-17T01:09:30.778 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:09:30.779 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi143/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12167, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e4fe47bc-3065-42f6-9d6f-3b68a27d3040 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535370661688, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535370662719, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 112227, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12172, "largest_seqno": 12267, "table_properties": {"data_size": 110662, "index_size": 335, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1622, "raw_average_key_size": 27, "raw_value_size": 109248, "raw_average_value_size": 1820, "num_data_blocks": 14, "num_entries": 60, "num_filter_entries": 60, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535370, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e4fe47bc-3065-42f6-9d6f-3b68a27d3040", "db_session_id": "NJ93CNVNWIW2G08CREV4", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535370662831, "job": 1, "event": "recovery_finished"} 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi143/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55de319bee00 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: DB pointer 0x55de31aba000 2024-09-17T01:09:30.780 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** DB Stats ** 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** Compaction Stats [default] ** 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:09:30.781 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: L0 1/0 109.60 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: L6 1/0 7.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Sum 2/0 8.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** Compaction Stats [default] ** 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 163.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:09:30.782 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Cumulative compaction: 0.00 GB write, 30.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Interval compaction: 0.00 GB write, 30.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Block cache BinnedLRUCache@0x55de319911f0#2 capacity: 512.00 MB usage: 0.66 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.23 KB,4.47035e-05%) IndexBlock(1,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: starting mon.smithi143 rank 1 at public addrs [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] at bind addrs [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi143 fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???) e2 preinit fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).mds e16 new map 2024-09-17T01:09:30.783 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).mds e16 print_map 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: e16 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: legacy client fscid: 1 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: fs_name cephfs 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: epoch 16 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:09:30.784 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: tableserver 0 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: root 0 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: session_timeout 60 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: session_autoclose 300 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: max_file_size 1099511627776 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: max_xattr_size 65536 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: required_client_features {} 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: last_failure 0 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: last_failure_osd_epoch 0 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: max_mds 1 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: in 0 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: up {0=14468} 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: failed 2024-09-17T01:09:30.785 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: damaged 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: stopped 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: data_pools [3] 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: metadata_pool 2 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: inline_data disabled 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: balancer 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: bal_rank_mask -1 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: standby_count_wanted 1 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: qdb_cluster leader: 0 members: 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: [mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: [mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: Standby daemons: 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: 2024-09-17T01:09:30.786 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: [mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout: [mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 ceph-mon[80685]: mon.smithi143@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 bash[80666]: 03d2b861ad7f539b685594f973b4ecfc3257534bfa81675edc7d21f3505f32d5 2024-09-17T01:09:30.787 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:30 smithi143 systemd[1]: Started Ceph mon.smithi143 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:09:32.622 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:09:32.622 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: mgrmap e36: smithi103.efjaur(active, since 13s), standbys: smithi143.sxhocv 2024-09-17T01:09:32.622 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: overall HEALTH_OK 2024-09-17T01:09:32.622 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: mon.smithi103 calling monitor election 2024-09-17T01:09:32.622 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: mon.smithi143 calling monitor election 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: mon.smithi103 is new leader, mons smithi103,smithi143 in quorum (ranks 0,1) 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: monmap epoch 3 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: last_changed 2024-09-17T01:09:31.286151+0000 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: created 2024-09-17T00:57:34.622316+0000 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: min_mon_release 19 (squid) 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: election_strategy: 1 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: 1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.smithi143 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:09:32.623 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: mgrmap e36: smithi103.efjaur(active, since 13s), standbys: smithi143.sxhocv 2024-09-17T01:09:32.624 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: overall HEALTH_OK 2024-09-17T01:09:32.624 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:32.624 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:32.624 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:32.624 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:32 smithi143 ceph-mon[80685]: pgmap v10: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: mgrmap e36: smithi103.efjaur(active, since 13s), standbys: smithi143.sxhocv 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: overall HEALTH_OK 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: mon.smithi103 calling monitor election 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: mon.smithi143 calling monitor election 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-17T01:09:32.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mon metadata", "id": "smithi143"}]: dispatch 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: mon.smithi103 is new leader, mons smithi103,smithi143 in quorum (ranks 0,1) 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: monmap epoch 3 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: fsid b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: last_changed 2024-09-17T01:09:31.286151+0000 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: created 2024-09-17T00:57:34.622316+0000 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: min_mon_release 19 (squid) 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: election_strategy: 1 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: 1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.smithi143 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: mgrmap e36: smithi103.efjaur(active, since 13s), standbys: smithi143.sxhocv 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: overall HEALTH_OK 2024-09-17T01:09:32.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:32.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:32.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:32.679 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:32 smithi103 ceph-mon[92733]: pgmap v10: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:09:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:33.604 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:35.351 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:35 smithi143 ceph-mon[80685]: pgmap v11: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:09:35.351 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.351 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.351 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.351 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:35 smithi103 ceph-mon[92733]: pgmap v11: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:09:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 -- 172.21.15.103:0/3033219439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe0101280 msgr2=0x7effe0101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 --2- 172.21.15.103:0/3033219439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe0101280 0x7effe0101680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7effdc009880 tx=0x7effdc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 -- 172.21.15.103:0/3033219439 shutdown_connections 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 --2- 172.21.15.103:0/3033219439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effe00ff7c0 0x7effe00ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 --2- 172.21.15.103:0/3033219439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe0101280 0x7effe0101680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 -- 172.21.15.103:0/3033219439 >> 172.21.15.103:0/3033219439 conn(0x7effe00fb330 msgr2=0x7effe00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 -- 172.21.15.103:0/3033219439 shutdown_connections 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 -- 172.21.15.103:0/3033219439 wait complete. 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.657+0000 7effe8261640 1 Processor -- start 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe8261640 1 -- start start 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe8261640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 0x7effe0074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe8261640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effe0101280 0x7effe00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe8261640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0072de0 con 0x7effe00ff7c0 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe8261640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0072f50 con 0x7effe0101280 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 0x7effe0074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 0x7effe0074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37496/0 (socket says 172.21.15.103:37496) 2024-09-17T01:09:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 -- 172.21.15.103:0/343067178 learned_addr learned my addr 172.21.15.103:0/343067178 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe57fc640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effe0101280 0x7effe00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 -- 172.21.15.103:0/343067178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effe0101280 msgr2=0x7effe00728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effe0101280 0x7effe00728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 -- 172.21.15.103:0/343067178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009560 con 0x7effe00ff7c0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.658+0000 7effe5ffd640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 0x7effe0074250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effdc02a9c0 tx=0x7effdc0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.659+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effdc004aa0 con 0x7effe00ff7c0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.659+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effdc004c00 con 0x7effe00ff7c0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.659+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00731d0 con 0x7effe00ff7c0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.659+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effdc003a80 con 0x7effe00ff7c0 2024-09-17T01:09:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.659+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe019d770 con 0x7effe00ff7c0 2024-09-17T01:09:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.660+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0109200 con 0x7effe00ff7c0 2024-09-17T01:09:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.660+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7effdc003d40 con 0x7effe00ff7c0 2024-09-17T01:09:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.661+0000 7effd6ffd640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7effcc06e730 0x7effcc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.661+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7effdc0afa40 con 0x7effe00ff7c0 2024-09-17T01:09:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.661+0000 7effe57fc640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7effcc06e730 0x7effcc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.662+0000 7effe57fc640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7effcc06e730 0x7effcc070bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7effe0073fd0 tx=0x7effd000b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:36.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.666+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7effdc078a20 con 0x7effe00ff7c0 2024-09-17T01:09:36.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.870+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effe0108af0 con 0x7effcc06e730 2024-09-17T01:09:36.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.871+0000 7effd6ffd640 1 -- 172.21.15.103:0/343067178 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7effe0108af0 con 0x7effcc06e730 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7effcc06e730 msgr2=0x7effcc070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7effcc06e730 0x7effcc070bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7effe0073fd0 tx=0x7effd000b390 comp rx=0 tx=0).stop 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 msgr2=0x7effe0074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 0x7effe0074250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effdc02a9c0 tx=0x7effdc0054f0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 shutdown_connections 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7effcc06e730 0x7effcc070bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effe0101280 0x7effe00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 --2- 172.21.15.103:0/343067178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe00ff7c0 0x7effe0074250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 >> 172.21.15.103:0/343067178 conn(0x7effe00fb330 msgr2=0x7effe0104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:36.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 shutdown_connections 2024-09-17T01:09:36.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.874+0000 7effe8261640 1 -- 172.21.15.103:0/343067178 wait complete. 2024-09-17T01:09:36.881 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:09:36.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:36 smithi103 ceph-mon[92733]: pgmap v12: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.955+0000 7f426ff9d640 1 -- 172.21.15.103:0/3942823746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4268101280 msgr2=0x7f4268101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.955+0000 7f426ff9d640 1 --2- 172.21.15.103:0/3942823746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4268101280 0x7f4268101680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4264009880 tx=0x7f426402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.955+0000 7f426ff9d640 1 -- 172.21.15.103:0/3942823746 shutdown_connections 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.955+0000 7f426ff9d640 1 --2- 172.21.15.103:0/3942823746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42680ff7c0 0x7f42680ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.955+0000 7f426ff9d640 1 --2- 172.21.15.103:0/3942823746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4268101280 0x7f4268101680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.955+0000 7f426ff9d640 1 -- 172.21.15.103:0/3942823746 >> 172.21.15.103:0/3942823746 conn(0x7f42680fb330 msgr2=0x7f42680fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 -- 172.21.15.103:0/3942823746 shutdown_connections 2024-09-17T01:09:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 -- 172.21.15.103:0/3942823746 wait complete. 2024-09-17T01:09:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 Processor -- start 2024-09-17T01:09:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 -- start start 2024-09-17T01:09:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 0x7f4268074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4268101280 0x7f42680728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4268072de0 con 0x7f42680ff7c0 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426ff9d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4268072f50 con 0x7f4268101280 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426dd39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 0x7f4268074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426dd39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 0x7f4268074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37522/0 (socket says 172.21.15.103:37522) 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426dd39640 1 -- 172.21.15.103:0/1490323414 learned_addr learned my addr 172.21.15.103:0/1490323414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.956+0000 7f426d538640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4268101280 0x7f42680728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f426dd39640 1 -- 172.21.15.103:0/1490323414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4268101280 msgr2=0x7f42680728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f426dd39640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4268101280 0x7f42680728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f426dd39640 1 -- 172.21.15.103:0/1490323414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009560 con 0x7f42680ff7c0 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f426dd39640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 0x7f4268074250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f426402a9c0 tx=0x7f42640054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4264004aa0 con 0x7f42680ff7c0 2024-09-17T01:09:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4264004c00 con 0x7f42680ff7c0 2024-09-17T01:09:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42680731d0 con 0x7f42680ff7c0 2024-09-17T01:09:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4264003a80 con 0x7f42680ff7c0 2024-09-17T01:09:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.957+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426819d740 con 0x7f42680ff7c0 2024-09-17T01:09:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.958+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42681091e0 con 0x7f42680ff7c0 2024-09-17T01:09:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.959+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f4264003d40 con 0x7f42680ff7c0 2024-09-17T01:09:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.959+0000 7f425effd640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f425406e720 0x7f4254070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.959+0000 7f426d538640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f425406e720 0x7f4254070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.959+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f42640afab0 con 0x7f42680ff7c0 2024-09-17T01:09:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.960+0000 7f426d538640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f425406e720 0x7f4254070be0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4268073fd0 tx=0x7f425800b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:36.964+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4264078a90 con 0x7f42680ff7c0 2024-09-17T01:09:37.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:36 smithi143 ceph-mon[80685]: pgmap v12: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T01:09:37.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.145+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4268105550 con 0x7f425406e720 2024-09-17T01:09:37.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.146+0000 7f425effd640 1 -- 172.21.15.103:0/1490323414 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4268105550 con 0x7f425406e720 2024-09-17T01:09:37.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f425406e720 msgr2=0x7f4254070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f425406e720 0x7f4254070be0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4268073fd0 tx=0x7f425800b390 comp rx=0 tx=0).stop 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 msgr2=0x7f4268074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 0x7f4268074250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f426402a9c0 tx=0x7f42640054f0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 shutdown_connections 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f425406e720 0x7f4254070be0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4268101280 0x7f42680728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 --2- 172.21.15.103:0/1490323414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42680ff7c0 0x7f4268074250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 >> 172.21.15.103:0/1490323414 conn(0x7f42680fb330 msgr2=0x7f42680fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 shutdown_connections 2024-09-17T01:09:37.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.148+0000 7f426ff9d640 1 -- 172.21.15.103:0/1490323414 wait complete. 2024-09-17T01:09:37.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.228+0000 7ff40a14e640 1 -- 172.21.15.103:0/1678681872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 msgr2=0x7ff404101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.228+0000 7ff40a14e640 1 --2- 172.21.15.103:0/1678681872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404101680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009880 tx=0x7ff3f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.228+0000 7ff40a14e640 1 -- 172.21.15.103:0/1678681872 shutdown_connections 2024-09-17T01:09:37.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.228+0000 7ff40a14e640 1 --2- 172.21.15.103:0/1678681872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff4040ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.228+0000 7ff40a14e640 1 --2- 172.21.15.103:0/1678681872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404101680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.228+0000 7ff40a14e640 1 -- 172.21.15.103:0/1678681872 >> 172.21.15.103:0/1678681872 conn(0x7ff4040fb330 msgr2=0x7ff4040fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.229+0000 7ff40a14e640 1 -- 172.21.15.103:0/1678681872 shutdown_connections 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.229+0000 7ff40a14e640 1 -- 172.21.15.103:0/1678681872 wait complete. 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.229+0000 7ff40a14e640 1 Processor -- start 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff40a14e640 1 -- start start 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff40a14e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff404195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff40a14e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff40a14e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404196220 con 0x7ff404101280 2024-09-17T01:09:37.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff40a14e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404196390 con 0x7ff4040ff7c0 2024-09-17T01:09:37.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff402ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff404195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff402ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37528/0 (socket says 172.21.15.103:37528) 2024-09-17T01:09:37.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff404195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:39102/0 (socket says 172.21.15.103:39102) 2024-09-17T01:09:37.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff402ffd640 1 -- 172.21.15.103:0/3148821506 learned_addr learned my addr 172.21.15.103:0/3148821506 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:37.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff402ffd640 1 -- 172.21.15.103:0/3148821506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 msgr2=0x7ff404195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff402ffd640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff404195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff402ffd640 1 -- 172.21.15.103:0/3148821506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009560 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.230+0000 7ff4037fe640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff404195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.231+0000 7ff402ffd640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404195c50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800e9a0 tx=0x7ff3f800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.231+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f800cd50 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.231+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3f800ceb0 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.231+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40419ae30 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.231+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f8010660 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.231+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40419b3d0 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.232+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4040ffc40 con 0x7ff404101280 2024-09-17T01:09:37.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.232+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff3f80048a0 con 0x7ff404101280 2024-09-17T01:09:37.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.233+0000 7ff400ff9640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff3ec06e730 0x7ff3ec070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.233+0000 7ff4037fe640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff3ec06e730 0x7ff3ec070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.233+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff3f8014070 con 0x7ff404101280 2024-09-17T01:09:37.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.234+0000 7ff4037fe640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff3ec06e730 0x7ff3ec070bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009230 tx=0x7ff3f40314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:37.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.237+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff3f8057d30 con 0x7ff404101280 2024-09-17T01:09:37.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.412+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff40402c4a0 con 0x7ff3ec06e730 2024-09-17T01:09:37.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.422+0000 7ff400ff9640 1 -- 172.21.15.103:0/3148821506 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff40402c4a0 con 0x7ff3ec06e730 2024-09-17T01:09:37.421 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:09:37.421 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (9m) 14s ago 10m 24.7M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (10m) 14s ago 10m 8150k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (9m) 3s ago 9m 7801k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (10m) 14s ago 10m 6903k - 18.2.4-855-g19e2a2be 980a0bfcd684 8ae77296a8fd 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (9m) 3s ago 9m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (8m) 14s ago 10m 84.6M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (5m) 14s ago 5m 151M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (5m) 14s ago 5m 91.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (5m) 3s ago 5m 14.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (5m) 3s ago 5m 16.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (106s) 14s ago 11m 472M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (40s) 3s ago 9m 438M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (27s) 14s ago 12m 29.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:09:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (7s) 3s ago 9m 19.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (10m) 14s ago 10m 16.2M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (9m) 3s ago 9m 16.2M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (8m) 14s ago 8m 229M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (8m) 14s ago 8m 236M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (7m) 14s ago 7m 209M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (7m) 3s ago 7m 284M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (7m) 3s ago 7m 268M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (6m) 3s ago 6m 230M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:09:37.423 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (45s) 14s ago 10m 46.2M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff3ec06e730 msgr2=0x7ff3ec070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff3ec06e730 0x7ff3ec070bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009230 tx=0x7ff3f40314e0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 msgr2=0x7ff404195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404195c50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800e9a0 tx=0x7ff3f800eda0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 shutdown_connections 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff3ec06e730 0x7ff3ec070bf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff404101280 0x7ff404195c50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 --2- 172.21.15.103:0/3148821506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4040ff7c0 0x7ff404195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.424+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 >> 172.21.15.103:0/3148821506 conn(0x7ff4040fb330 msgr2=0x7ff404104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:37.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.425+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 shutdown_connections 2024-09-17T01:09:37.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.425+0000 7ff40a14e640 1 -- 172.21.15.103:0/3148821506 wait complete. 2024-09-17T01:09:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 -- 172.21.15.103:0/863761445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0ffca0 msgr2=0x7fd20c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 --2- 172.21.15.103:0/863761445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0ffca0 0x7fd20c100120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009880 tx=0x7fd1f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 -- 172.21.15.103:0/863761445 shutdown_connections 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 --2- 172.21.15.103:0/863761445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0ffca0 0x7fd20c100120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 --2- 172.21.15.103:0/863761445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd20c0feaa0 0x7fd20c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 -- 172.21.15.103:0/863761445 >> 172.21.15.103:0/863761445 conn(0x7fd20c0fa230 msgr2=0x7fd20c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 -- 172.21.15.103:0/863761445 shutdown_connections 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 -- 172.21.15.103:0/863761445 wait complete. 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.504+0000 7fd210a2f640 1 Processor -- start 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd210a2f640 1 -- start start 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd210a2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 0x7fd20c102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd210a2f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd20c0ffca0 0x7fd20c101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd210a2f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c101ad0 con 0x7fd20c0feaa0 2024-09-17T01:09:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd210a2f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c101c40 con 0x7fd20c0ffca0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 0x7fd20c102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 0x7fd20c102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37546/0 (socket says 172.21.15.103:37546) 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 -- 172.21.15.103:0/2991056569 learned_addr learned my addr 172.21.15.103:0/2991056569 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd209d9b640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd20c0ffca0 0x7fd20c101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 -- 172.21.15.103:0/2991056569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd20c0ffca0 msgr2=0x7fd20c101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd20c0ffca0 0x7fd20c101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 -- 172.21.15.103:0/2991056569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009560 con 0x7fd20c0feaa0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.505+0000 7fd20a59c640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 0x7fd20c102ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd204009fd0 tx=0x7fd20400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.506+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd20400ce10 con 0x7fd20c0feaa0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.506+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd204011930 con 0x7fd20c0feaa0 2024-09-17T01:09:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.506+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c101f20 con 0x7fd20c0feaa0 2024-09-17T01:09:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.506+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd20401ab30 con 0x7fd20c0feaa0 2024-09-17T01:09:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.506+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c19d6c0 con 0x7fd20c0feaa0 2024-09-17T01:09:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.507+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c107ff0 con 0x7fd20c0feaa0 2024-09-17T01:09:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.507+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd20401ac90 con 0x7fd20c0feaa0 2024-09-17T01:09:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.508+0000 7fd2037fe640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd1f806e730 0x7fd1f8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.508+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd20408f030 con 0x7fd20c0feaa0 2024-09-17T01:09:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.508+0000 7fd209d9b640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd1f806e730 0x7fd1f8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.508+0000 7fd209d9b640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd1f806e730 0x7fd1f8070bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4000c00 tx=0x7fd1f40314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:37.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.512+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd204057f60 con 0x7fd20c0feaa0 2024-09-17T01:09:37.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.742+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd20c107710 con 0x7fd20c0feaa0 2024-09-17T01:09:37.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.742+0000 7fd2037fe640 1 -- 172.21.15.103:0/2991056569 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fd20405b620 con 0x7fd20c0feaa0 2024-09-17T01:09:37.741 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:09:37.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:09:37.743 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:09:37.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 10, 2024-09-17T01:09:37.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:09:37.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:09:37.743 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.744+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd1f806e730 msgr2=0x7fd1f8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.744+0000 7fd210a2f640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd1f806e730 0x7fd1f8070bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4000c00 tx=0x7fd1f40314e0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.744+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 msgr2=0x7fd20c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.744+0000 7fd210a2f640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 0x7fd20c102ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd204009fd0 tx=0x7fd20400ef40 comp rx=0 tx=0).stop 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 shutdown_connections 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd1f806e730 0x7fd1f8070bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd20c0ffca0 0x7fd20c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 --2- 172.21.15.103:0/2991056569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd20c0feaa0 0x7fd20c102ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 >> 172.21.15.103:0/2991056569 conn(0x7fd20c0fa230 msgr2=0x7fd20c0fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 shutdown_connections 2024-09-17T01:09:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.745+0000 7fd210a2f640 1 -- 172.21.15.103:0/2991056569 wait complete. 2024-09-17T01:09:37.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.826+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3038427196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280feaa0 msgr2=0x7fc2280feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.826+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3038427196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280feaa0 0x7fc2280feea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc218009880 tx=0x7fc21802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3038427196 shutdown_connections 2024-09-17T01:09:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3038427196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2280ffca0 0x7fc228100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3038427196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280feaa0 0x7fc2280feea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3038427196 >> 172.21.15.103:0/3038427196 conn(0x7fc2280fa230 msgr2=0x7fc2280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:37.826 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:37 smithi103 ceph-mon[92733]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3038427196 shutdown_connections 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3038427196 wait complete. 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 Processor -- start 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.827+0000 7fc22d9ee640 1 -- start start 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc22d9ee640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2280feaa0 0x7fc228068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc22d9ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 0x7fc22819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc22d9ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22819a970 con 0x7fc2280ffca0 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc22d9ee640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22819aab0 con 0x7fc2280feaa0 2024-09-17T01:09:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 0x7fc22819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 0x7fc22819a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37564/0 (socket says 172.21.15.103:37564) 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 -- 172.21.15.103:0/3071941021 learned_addr learned my addr 172.21.15.103:0/3071941021 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc226ffd640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2280feaa0 0x7fc228068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 -- 172.21.15.103:0/3071941021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2280feaa0 msgr2=0x7fc228068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2280feaa0 0x7fc228068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 -- 172.21.15.103:0/3071941021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218009560 con 0x7fc2280ffca0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc2267fc640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 0x7fc22819a3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00e970 tx=0x7fc21c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.828+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21c00cc90 con 0x7fc2280ffca0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.829+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc21c00cdf0 con 0x7fc2280ffca0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.829+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22819ad60 con 0x7fc2280ffca0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.829+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21c010430 con 0x7fc2280ffca0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.829+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22819b330 con 0x7fc2280ffca0 2024-09-17T01:09:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.830+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22818e640 con 0x7fc2280ffca0 2024-09-17T01:09:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.830+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc21c0046c0 con 0x7fc2280ffca0 2024-09-17T01:09:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.831+0000 7fc22c9ec640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc21006e730 0x7fc210070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.831+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc21c014070 con 0x7fc2280ffca0 2024-09-17T01:09:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.831+0000 7fc226ffd640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc21006e730 0x7fc210070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.831+0000 7fc226ffd640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc21006e730 0x7fc210070bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc218009230 tx=0x7fc218005d50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:37.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:37.835+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc21c093070 con 0x7fc2280ffca0 2024-09-17T01:09:37.969 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:37 smithi143 ceph-mon[80685]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:38.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.050+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2281078d0 con 0x7fc2280ffca0 2024-09-17T01:09:38.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.050+0000 7fc22c9ec640 1 -- 172.21.15.103:0/3071941021 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7fc21c057e10 con 0x7fc2280ffca0 2024-09-17T01:09:38.049 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:09:38.050 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:09:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:38.052 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc21006e730 msgr2=0x7fc210070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc21006e730 0x7fc210070bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc218009230 tx=0x7fc218005d50 comp rx=0 tx=0).stop 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 msgr2=0x7fc22819a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 0x7fc22819a3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00e970 tx=0x7fc21c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 shutdown_connections 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc21006e730 0x7fc210070bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2280ffca0 0x7fc22819a3a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 --2- 172.21.15.103:0/3071941021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2280feaa0 0x7fc228068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 >> 172.21.15.103:0/3071941021 conn(0x7fc2280fa230 msgr2=0x7fc228103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 shutdown_connections 2024-09-17T01:09:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.054+0000 7fc22d9ee640 1 -- 172.21.15.103:0/3071941021 wait complete. 2024-09-17T01:09:38.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 -- 172.21.15.103:0/720075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740fea30 msgr2=0x7fa1740fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 --2- 172.21.15.103:0/720075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740fea30 0x7fa1740fee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa170009880 tx=0x7fa17002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 -- 172.21.15.103:0/720075553 shutdown_connections 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 --2- 172.21.15.103:0/720075553 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1740ffc30 0x7fa1741000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 --2- 172.21.15.103:0/720075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740fea30 0x7fa1740fee30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 -- 172.21.15.103:0/720075553 >> 172.21.15.103:0/720075553 conn(0x7fa1740fa1c0 msgr2=0x7fa1740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 -- 172.21.15.103:0/720075553 shutdown_connections 2024-09-17T01:09:38.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.139+0000 7fa17bb73640 1 -- 172.21.15.103:0/720075553 wait complete. 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.140+0000 7fa17bb73640 1 Processor -- start 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.140+0000 7fa17bb73640 1 -- start start 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.140+0000 7fa17bb73640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1740fea30 0x7fa174195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.140+0000 7fa17bb73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 0x7fa174195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.140+0000 7fa17bb73640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174196080 con 0x7fa1740ffc30 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.140+0000 7fa17bb73640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741961f0 con 0x7fa1740fea30 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 0x7fa174195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:38.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 0x7fa174195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37590/0 (socket says 172.21.15.103:37590) 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 -- 172.21.15.103:0/4214470501 learned_addr learned my addr 172.21.15.103:0/4214470501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17990f640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1740fea30 0x7fa174195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 -- 172.21.15.103:0/4214470501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1740fea30 msgr2=0x7fa174195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1740fea30 0x7fa174195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 -- 172.21.15.103:0/4214470501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170009560 con 0x7fa1740ffc30 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.141+0000 7fa17910e640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 0x7fa174195b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c960 tx=0x7fa16400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.142+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa164007c40 con 0x7fa1740ffc30 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.142+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa164007da0 con 0x7fa1740ffc30 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.142+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa164019b20 con 0x7fa1740ffc30 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.142+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa174100eb0 con 0x7fa1740ffc30 2024-09-17T01:09:38.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.142+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174101430 con 0x7fa1740ffc30 2024-09-17T01:09:38.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.143+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa174107620 con 0x7fa1740ffc30 2024-09-17T01:09:38.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.143+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa164011750 con 0x7fa1740ffc30 2024-09-17T01:09:38.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.144+0000 7fa16affd640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16006e760 0x7fa160070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:38.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.144+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa164092740 con 0x7fa1740ffc30 2024-09-17T01:09:38.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.144+0000 7fa17990f640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16006e760 0x7fa160070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:38.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.145+0000 7fa17990f640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16006e760 0x7fa160070c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa170006010 tx=0x7fa1700314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:38.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.149+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa16405b950 con 0x7fa1740ffc30 2024-09-17T01:09:38.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.346+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1740fc3d0 con 0x7fa16006e760 2024-09-17T01:09:38.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.347+0000 7fa16affd640 1 -- 172.21.15.103:0/4214470501 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa1740fc3d0 con 0x7fa16006e760 2024-09-17T01:09:38.346 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:09:38.346 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "4/23 daemons upgraded", 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:09:38.347 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.349+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16006e760 msgr2=0x7fa160070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16006e760 0x7fa160070c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa170006010 tx=0x7fa1700314e0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 msgr2=0x7fa174195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 0x7fa174195b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c960 tx=0x7fa16400ce20 comp rx=0 tx=0).stop 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 shutdown_connections 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16006e760 0x7fa160070c20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1740ffc30 0x7fa174195b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 --2- 172.21.15.103:0/4214470501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1740fea30 0x7fa174195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 >> 172.21.15.103:0/4214470501 conn(0x7fa1740fa1c0 msgr2=0x7fa1740fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:38.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 shutdown_connections 2024-09-17T01:09:38.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.350+0000 7fa17bb73640 1 -- 172.21.15.103:0/4214470501 wait complete. 2024-09-17T01:09:38.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 -- 172.21.15.103:0/1840128232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 msgr2=0x7fd3100fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 --2- 172.21.15.103:0/1840128232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd3100fee80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd308009880 tx=0x7fd30802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 -- 172.21.15.103:0/1840128232 shutdown_connections 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 --2- 172.21.15.103:0/1840128232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3100ffc80 0x7fd310100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 --2- 172.21.15.103:0/1840128232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd3100fee80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 -- 172.21.15.103:0/1840128232 >> 172.21.15.103:0/1840128232 conn(0x7fd3100fa230 msgr2=0x7fd3100fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 -- 172.21.15.103:0/1840128232 shutdown_connections 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 -- 172.21.15.103:0/1840128232 wait complete. 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.439+0000 7fd315331640 1 Processor -- start 2024-09-17T01:09:38.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd315331640 1 -- start start 2024-09-17T01:09:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd315331640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd310195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd315331640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3100ffc80 0x7fd310195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd315331640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd310196210 con 0x7fd3100fea80 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd315331640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd310196380 con 0x7fd3100ffc80 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd310195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd310195700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37610/0 (socket says 172.21.15.103:37610) 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 -- 172.21.15.103:0/2382259892 learned_addr learned my addr 172.21.15.103:0/2382259892 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30e7fc640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3100ffc80 0x7fd310195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 -- 172.21.15.103:0/2382259892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3100ffc80 msgr2=0x7fd310195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3100ffc80 0x7fd310195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 -- 172.21.15.103:0/2382259892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009560 con 0x7fd3100fea80 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.440+0000 7fd30effd640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd310195700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd308005610 tx=0x7fd308005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.441+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd308004ba0 con 0x7fd3100fea80 2024-09-17T01:09:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.441+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd308004d00 con 0x7fd3100fea80 2024-09-17T01:09:38.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.441+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31019adc0 con 0x7fd3100fea80 2024-09-17T01:09:38.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.441+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd308003b50 con 0x7fd3100fea80 2024-09-17T01:09:38.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.441+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31019b2d0 con 0x7fd3100fea80 2024-09-17T01:09:38.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.442+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3101076f0 con 0x7fd3100fea80 2024-09-17T01:09:38.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.442+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd308003d90 con 0x7fd3100fea80 2024-09-17T01:09:38.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.443+0000 7fd307fff640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2fc06e730 0x7fd2fc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:38.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.443+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd3080afba0 con 0x7fd3100fea80 2024-09-17T01:09:38.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.443+0000 7fd30e7fc640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2fc06e730 0x7fd2fc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:38.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.443+0000 7fd30e7fc640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2fc06e730 0x7fd2fc070bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd310196c20 tx=0x7fd2f8009110 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:38.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.447+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd308078ad0 con 0x7fd3100fea80 2024-09-17T01:09:38.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.685+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd310107880 con 0x7fd3100fea80 2024-09-17T01:09:38.715 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:38.715 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:38.715 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2991056569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:38.715 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: pgmap v13: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3071941021' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:38.716 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.719+0000 7fd307fff640 1 -- 172.21.15.103:0/2382259892 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd30807c190 con 0x7fd3100fea80 2024-09-17T01:09:38.718 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:09:38.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2fc06e730 msgr2=0x7fd2fc070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2fc06e730 0x7fd2fc070bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd310196c20 tx=0x7fd2f8009110 comp rx=0 tx=0).stop 2024-09-17T01:09:38.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 msgr2=0x7fd310195700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:38.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd310195700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd308005610 tx=0x7fd308005640 comp rx=0 tx=0).stop 2024-09-17T01:09:38.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 shutdown_connections 2024-09-17T01:09:38.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2fc06e730 0x7fd2fc070bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3100ffc80 0x7fd310195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 --2- 172.21.15.103:0/2382259892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3100fea80 0x7fd310195700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:38.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 >> 172.21.15.103:0/2382259892 conn(0x7fd3100fa230 msgr2=0x7fd3100fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:38.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 shutdown_connections 2024-09-17T01:09:38.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:09:38.721+0000 7fd315331640 1 -- 172.21.15.103:0/2382259892 wait complete. 2024-09-17T01:09:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2991056569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:39.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: pgmap v13: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:39.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:39.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:39.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:39.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:39.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:39.010 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3071941021' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:09:39.010 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:39.010 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:39.010 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:39.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:39 smithi103 ceph-mon[92733]: Reconfiguring mon.smithi103 (monmap changed)... 2024-09-17T01:09:39.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:39 smithi103 ceph-mon[92733]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-17T01:09:39.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:39 smithi103 ceph-mon[92733]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:39.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:39 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2382259892' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:39 smithi143 ceph-mon[80685]: Reconfiguring mon.smithi103 (monmap changed)... 2024-09-17T01:09:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:39 smithi143 ceph-mon[80685]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-17T01:09:40.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:39 smithi143 ceph-mon[80685]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:39 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2382259892' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:41.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:41.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:41.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: Reconfiguring mgr.smithi103.efjaur (monmap changed)... 2024-09-17T01:09:41.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:09:41.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:09:41.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:41.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: Reconfiguring daemon mgr.smithi103.efjaur on smithi103 2024-09-17T01:09:41.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:40 smithi143 ceph-mon[80685]: pgmap v14: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:41.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:41.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:41.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: Reconfiguring mgr.smithi103.efjaur (monmap changed)... 2024-09-17T01:09:41.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.efjaur", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:09:41.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:09:41.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:41.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: Reconfiguring daemon mgr.smithi103.efjaur on smithi103 2024-09-17T01:09:41.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:40 smithi103 ceph-mon[92733]: pgmap v14: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: Reconfiguring ceph-exporter.smithi103 (monmap changed)... 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: Unable to update caps for client.ceph-exporter.smithi103 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi103"}]: dispatch 2024-09-17T01:09:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:42.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: Reconfiguring daemon ceph-exporter.smithi103 on smithi103 2024-09-17T01:09:42.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:42 smithi103 ceph-mon[92733]: pgmap v15: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:42.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: Reconfiguring ceph-exporter.smithi103 (monmap changed)... 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: Unable to update caps for client.ceph-exporter.smithi103 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi103"}]: dispatch 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: Reconfiguring daemon ceph-exporter.smithi103 on smithi103 2024-09-17T01:09:42.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:42 smithi143 ceph-mon[80685]: pgmap v15: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:43.904 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:43 smithi103 ceph-mon[92733]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:43 smithi103 ceph-mon[92733]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-17T01:09:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:43 smithi143 ceph-mon[80685]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-17T01:09:44.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:09:44.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:44.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:43 smithi143 ceph-mon[80685]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-17T01:09:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: pgmap v16: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:09:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:09:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:44 smithi143 ceph-mon[80685]: Reconfiguring daemon osd.0 on smithi103 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: pgmap v16: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:44 smithi103 ceph-mon[92733]: Reconfiguring daemon osd.0 on smithi103 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: Reconfiguring daemon osd.1 on smithi103 2024-09-17T01:09:46.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:46 smithi103 ceph-mon[92733]: pgmap v17: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:46.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:46.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:46.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:09:46.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:46.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: Reconfiguring daemon osd.1 on smithi103 2024-09-17T01:09:46.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:46 smithi143 ceph-mon[80685]: pgmap v17: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:47 smithi103 ceph-mon[92733]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:09:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:09:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:47 smithi103 ceph-mon[92733]: Reconfiguring daemon osd.2 on smithi103 2024-09-17T01:09:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:47 smithi143 ceph-mon[80685]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:09:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:09:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:47 smithi143 ceph-mon[80685]: Reconfiguring daemon osd.2 on smithi103 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:48 smithi103 ceph-mon[92733]: pgmap v18: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:48 smithi143 ceph-mon[80685]: pgmap v18: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:09:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:49 smithi143 ceph-mon[80685]: Reconfiguring mds.cephfs.smithi103.gmmiqj (monmap changed)... 2024-09-17T01:09:50.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:49 smithi143 ceph-mon[80685]: Reconfiguring daemon mds.cephfs.smithi103.gmmiqj on smithi103 2024-09-17T01:09:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:49 smithi103 ceph-mon[92733]: Reconfiguring mds.cephfs.smithi103.gmmiqj (monmap changed)... 2024-09-17T01:09:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:49 smithi103 ceph-mon[92733]: Reconfiguring daemon mds.cephfs.smithi103.gmmiqj on smithi103 2024-09-17T01:09:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: pgmap v19: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: Reconfiguring mds.cephfs.smithi103.rnhmlw (monmap changed)... 2024-09-17T01:09:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:09:51.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:50 smithi103 ceph-mon[92733]: Reconfiguring daemon mds.cephfs.smithi103.rnhmlw on smithi103 2024-09-17T01:09:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: pgmap v19: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: Reconfiguring mds.cephfs.smithi103.rnhmlw (monmap changed)... 2024-09-17T01:09:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:09:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:50 smithi143 ceph-mon[80685]: Reconfiguring daemon mds.cephfs.smithi103.rnhmlw on smithi103 2024-09-17T01:09:52.666 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:52.666 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:52.666 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: Reconfiguring ceph-exporter.smithi143 (monmap changed)... 2024-09-17T01:09:52.666 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: Unable to update caps for client.ceph-exporter.smithi143 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi143"}]: dispatch 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: Reconfiguring daemon ceph-exporter.smithi143 on smithi143 2024-09-17T01:09:52.667 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:52 smithi143 ceph-mon[80685]: pgmap v20: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: Reconfiguring ceph-exporter.smithi143 (monmap changed)... 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:09:52.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: Unable to update caps for client.ceph-exporter.smithi143 2024-09-17T01:09:52.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi143"}]: dispatch 2024-09-17T01:09:52.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: Reconfiguring daemon ceph-exporter.smithi143 on smithi143 2024-09-17T01:09:52.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:52 smithi103 ceph-mon[92733]: pgmap v20: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:53 smithi143 ceph-mon[80685]: Reconfiguring crash.smithi143 (monmap changed)... 2024-09-17T01:09:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:09:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:53 smithi143 ceph-mon[80685]: Reconfiguring daemon crash.smithi143 on smithi143 2024-09-17T01:09:54.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:54.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:54.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:53 smithi103 ceph-mon[92733]: Reconfiguring crash.smithi143 (monmap changed)... 2024-09-17T01:09:54.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:09:54.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:53 smithi103 ceph-mon[92733]: Reconfiguring daemon crash.smithi143 on smithi143 2024-09-17T01:09:54.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:54 smithi143 ceph-mon[80685]: pgmap v21: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:54.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:54.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:54.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:09:54.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:09:54.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:54 smithi103 ceph-mon[92733]: pgmap v21: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi143.sxhocv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:09:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:09:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: Reconfiguring mgr.smithi143.sxhocv (monmap changed)... 2024-09-17T01:09:55.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: Reconfiguring daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:09:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:55.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: Reconfiguring mgr.smithi143.sxhocv (monmap changed)... 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: Reconfiguring daemon mgr.smithi143.sxhocv on smithi143 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:09:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:56.943 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:56 smithi143 ceph-mon[80685]: Reconfiguring mon.smithi143 (monmap changed)... 2024-09-17T01:09:56.943 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:56 smithi143 ceph-mon[80685]: Reconfiguring daemon mon.smithi143 on smithi143 2024-09-17T01:09:56.943 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:56 smithi143 ceph-mon[80685]: pgmap v22: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:57.046 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:56 smithi103 ceph-mon[92733]: Reconfiguring mon.smithi143 (monmap changed)... 2024-09-17T01:09:57.046 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:56 smithi103 ceph-mon[92733]: Reconfiguring daemon mon.smithi143 on smithi143 2024-09-17T01:09:57.046 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:56 smithi103 ceph-mon[92733]: pgmap v22: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:09:58.000 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:58 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:58.001 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:58 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:58.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:58 smithi143 ceph-mon[80685]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:09:58.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:58 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:09:58.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:58 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:58.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:58 smithi143 ceph-mon[80685]: Reconfiguring daemon osd.3 on smithi143 2024-09-17T01:09:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:58 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:58 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:58 smithi103 ceph-mon[92733]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:09:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:58 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:09:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:58 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:58 smithi103 ceph-mon[92733]: Reconfiguring daemon osd.3 on smithi143 2024-09-17T01:09:59.102 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:59 smithi143 ceph-mon[80685]: pgmap v23: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:59.102 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:59 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:59.102 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:59 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:59.102 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:59 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:09:59.102 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:09:59 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:59 smithi103 ceph-mon[92733]: pgmap v23: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:09:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:59 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:59 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:09:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:59 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:09:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:09:59 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:00.236 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:10:00.236 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: Reconfiguring daemon osd.4 on smithi143 2024-09-17T01:10:00.236 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:00.236 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:00.236 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:10:00.236 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:00.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:00 smithi143 ceph-mon[80685]: overall HEALTH_OK 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: Reconfiguring daemon osd.4 on smithi143 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:00 smithi103 ceph-mon[92733]: overall HEALTH_OK 2024-09-17T01:10:01.220 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:01 smithi143 ceph-mon[80685]: pgmap v24: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:01.220 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:01 smithi143 ceph-mon[80685]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:10:01.220 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:01 smithi143 ceph-mon[80685]: Reconfiguring daemon osd.5 on smithi143 2024-09-17T01:10:01.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:01 smithi103 ceph-mon[92733]: pgmap v24: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:01.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:01 smithi103 ceph-mon[92733]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:10:01.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:01 smithi103 ceph-mon[92733]: Reconfiguring daemon osd.5 on smithi143 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: Reconfiguring mds.cephfs.smithi143.zkrwqj (monmap changed)... 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: Reconfiguring daemon mds.cephfs.smithi143.zkrwqj on smithi143 2024-09-17T01:10:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:02 smithi103 ceph-mon[92733]: pgmap v25: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: Reconfiguring mds.cephfs.smithi143.zkrwqj (monmap changed)... 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: Reconfiguring daemon mds.cephfs.smithi143.zkrwqj on smithi143 2024-09-17T01:10:02.724 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:02 smithi143 ceph-mon[80685]: pgmap v25: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:04.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: Reconfiguring mds.cephfs.smithi143.uraktq (monmap changed)... 2024-09-17T01:10:04.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:04.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:04.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: Reconfiguring daemon mds.cephfs.smithi143.uraktq on smithi143 2024-09-17T01:10:04.127 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:04.141 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.141 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.141 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: Reconfiguring mds.cephfs.smithi143.uraktq (monmap changed)... 2024-09-17T01:10:04.141 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:04.141 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:04.141 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: Reconfiguring daemon mds.cephfs.smithi143.uraktq on smithi143 2024-09-17T01:10:04.142 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: pgmap v26: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:04.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]: dispatch 2024-09-17T01:10:04.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]': finished 2024-09-17T01:10:04.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi143"}]: dispatch 2024-09-17T01:10:04.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi143"}]': finished 2024-09-17T01:10:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: pgmap v26: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]: dispatch 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]': finished 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi143"}]: dispatch 2024-09-17T01:10:05.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi143"}]': finished 2024-09-17T01:10:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:05 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all mon 2024-09-17T01:10:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:10:05.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:06.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:05 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all mon 2024-09-17T01:10:06.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:06.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:10:06.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:07.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:06 smithi103 ceph-mon[92733]: Upgrade: Updating crash.smithi103 (1/2) 2024-09-17T01:10:07.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:06 smithi103 ceph-mon[92733]: Deploying daemon crash.smithi103 on smithi103 2024-09-17T01:10:07.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:06 smithi103 ceph-mon[92733]: pgmap v27: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:06 smithi143 ceph-mon[80685]: Upgrade: Updating crash.smithi103 (1/2) 2024-09-17T01:10:07.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:06 smithi143 ceph-mon[80685]: Deploying daemon crash.smithi103 on smithi103 2024-09-17T01:10:07.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:06 smithi143 ceph-mon[80685]: pgmap v27: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:08.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.813+0000 7f531ae7e640 1 -- 172.21.15.103:0/559009443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 msgr2=0x7f53140fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:08.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 --2- 172.21.15.103:0/559009443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f53140fee30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5308009880 tx=0x7f530802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:08.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 -- 172.21.15.103:0/559009443 shutdown_connections 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 --2- 172.21.15.103:0/559009443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 0x7f53141000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 --2- 172.21.15.103:0/559009443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f53140fee30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 -- 172.21.15.103:0/559009443 >> 172.21.15.103:0/559009443 conn(0x7f53140fa1c0 msgr2=0x7f53140fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 -- 172.21.15.103:0/559009443 shutdown_connections 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 -- 172.21.15.103:0/559009443 wait complete. 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 Processor -- start 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 -- start start 2024-09-17T01:10:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.814+0000 7f531ae7e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f5314195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f531ae7e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 0x7f5314195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f531ae7e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314196130 con 0x7f53140fea30 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f531ae7e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53141962a0 con 0x7f53140ffc30 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f5314195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f5314195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51786/0 (socket says 172.21.15.103:51786) 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 -- 172.21.15.103:0/3671352114 learned_addr learned my addr 172.21.15.103:0/3671352114 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5313fff640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 0x7f5314195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 -- 172.21.15.103:0/3671352114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 msgr2=0x7f5314195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 0x7f5314195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 -- 172.21.15.103:0/3671352114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308009560 con 0x7f53140fea30 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5313fff640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 0x7f5314195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5318c1a640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f5314195620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53080054f0 tx=0x7f5308005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5308004aa0 con 0x7f53140fea30 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531419ace0 con 0x7f53140fea30 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5308004c00 con 0x7f53140fea30 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.815+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5308003ac0 con 0x7f53140fea30 2024-09-17T01:10:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.816+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531419b200 con 0x7f53140fea30 2024-09-17T01:10:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.817+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314107640 con 0x7f53140fea30 2024-09-17T01:10:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.817+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f5308003d80 con 0x7f53140fea30 2024-09-17T01:10:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.818+0000 7f5311ffb640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f530406e730 0x7f5304070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.818+0000 7f5313fff640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f530406e730 0x7f5304070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.818+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f53080afb50 con 0x7f53140fea30 2024-09-17T01:10:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.818+0000 7f5313fff640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f530406e730 0x7f5304070bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5314196b40 tx=0x7f5300005e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:08.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:08.822+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5308078a80 con 0x7f53140fea30 2024-09-17T01:10:09.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.021+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53140fc3d0 con 0x7f530406e730 2024-09-17T01:10:09.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.022+0000 7f5311ffb640 1 -- 172.21.15.103:0/3671352114 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f53140fc3d0 con 0x7f530406e730 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f530406e730 msgr2=0x7f5304070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f530406e730 0x7f5304070bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5314196b40 tx=0x7f5300005e50 comp rx=0 tx=0).stop 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 msgr2=0x7f5314195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f5314195620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53080054f0 tx=0x7f5308005520 comp rx=0 tx=0).stop 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 shutdown_connections 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f530406e730 0x7f5304070bf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53140ffc30 0x7f5314195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 --2- 172.21.15.103:0/3671352114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140fea30 0x7f5314195620 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 >> 172.21.15.103:0/3671352114 conn(0x7f53140fa1c0 msgr2=0x7f53140fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 shutdown_connections 2024-09-17T01:10:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.025+0000 7f531ae7e640 1 -- 172.21.15.103:0/3671352114 wait complete. 2024-09-17T01:10:09.033 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 -- 172.21.15.103:0/308352590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0ffc30 msgr2=0x7fb2bc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 --2- 172.21.15.103:0/308352590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0ffc30 0x7fb2bc1000b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009880 tx=0x7fb2b002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 -- 172.21.15.103:0/308352590 shutdown_connections 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 --2- 172.21.15.103:0/308352590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0ffc30 0x7fb2bc1000b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 --2- 172.21.15.103:0/308352590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 -- 172.21.15.103:0/308352590 >> 172.21.15.103:0/308352590 conn(0x7fb2bc0fa1c0 msgr2=0x7fb2bc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.109+0000 7fb2c2419640 1 -- 172.21.15.103:0/308352590 shutdown_connections 2024-09-17T01:10:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 -- 172.21.15.103:0/308352590 wait complete. 2024-09-17T01:10:09.110 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:08 smithi103 ceph-mon[92733]: pgmap v28: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 Processor -- start 2024-09-17T01:10:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 -- start start 2024-09-17T01:10:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2bc0ffc30 0x7fb2bc197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc198350 con 0x7fb2bc0fea30 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.110+0000 7fb2c2419640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc1984c0 con 0x7fb2bc0ffc30 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51806/0 (socket says 172.21.15.103:51806) 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 -- 172.21.15.103:0/775279520 learned_addr learned my addr 172.21.15.103:0/775279520 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bb7fe640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2bc0ffc30 0x7fb2bc197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 -- 172.21.15.103:0/775279520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2bc0ffc30 msgr2=0x7fb2bc197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2bc0ffc30 0x7fb2bc197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 -- 172.21.15.103:0/775279520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0009560 con 0x7fb2bc0fea30 2024-09-17T01:10:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2bbfff640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc197840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00d900 tx=0x7fb2ac00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ac009c00 con 0x7fb2bc0fea30 2024-09-17T01:10:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2ac009d60 con 0x7fb2bc0fea30 2024-09-17T01:10:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ac00f660 con 0x7fb2bc0fea30 2024-09-17T01:10:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc19cf60 con 0x7fb2bc0fea30 2024-09-17T01:10:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.111+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc19d4a0 con 0x7fb2bc0fea30 2024-09-17T01:10:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.112+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc0fee30 con 0x7fb2bc0fea30 2024-09-17T01:10:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.113+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb2ac010460 con 0x7fb2bc0fea30 2024-09-17T01:10:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.114+0000 7fb2b97fa640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb2a406e720 0x7fb2a4070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.114+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb2ac08e6d0 con 0x7fb2bc0fea30 2024-09-17T01:10:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.114+0000 7fb2bb7fe640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb2a406e720 0x7fb2a4070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.114+0000 7fb2bb7fe640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb2a406e720 0x7fb2a4070be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0000c00 tx=0x7fb2b0005d90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:09.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.118+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb2ac057680 con 0x7fb2bc0fea30 2024-09-17T01:10:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:08 smithi143 ceph-mon[80685]: pgmap v28: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:09.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.307+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2bc0fc3b0 con 0x7fb2a406e720 2024-09-17T01:10:09.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.309+0000 7fb2b97fa640 1 -- 172.21.15.103:0/775279520 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb2bc0fc3b0 con 0x7fb2a406e720 2024-09-17T01:10:09.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb2a406e720 msgr2=0x7fb2a4070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb2a406e720 0x7fb2a4070be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0000c00 tx=0x7fb2b0005d90 comp rx=0 tx=0).stop 2024-09-17T01:10:09.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 msgr2=0x7fb2bc197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc197840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00d900 tx=0x7fb2ac00ddc0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 shutdown_connections 2024-09-17T01:10:09.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb2a406e720 0x7fb2a4070be0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2bc0ffc30 0x7fb2bc197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 --2- 172.21.15.103:0/775279520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2bc0fea30 0x7fb2bc197840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 >> 172.21.15.103:0/775279520 conn(0x7fb2bc0fa1c0 msgr2=0x7fb2bc0fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 shutdown_connections 2024-09-17T01:10:09.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.311+0000 7fb2c2419640 1 -- 172.21.15.103:0/775279520 wait complete. 2024-09-17T01:10:09.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.393+0000 7fb79faa5640 1 -- 172.21.15.103:0/4285575788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980ffc30 msgr2=0x7fb7981000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.393+0000 7fb79faa5640 1 --2- 172.21.15.103:0/4285575788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980ffc30 0x7fb7981000b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009880 tx=0x7fb78c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.393+0000 7fb79faa5640 1 -- 172.21.15.103:0/4285575788 shutdown_connections 2024-09-17T01:10:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.393+0000 7fb79faa5640 1 --2- 172.21.15.103:0/4285575788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980ffc30 0x7fb7981000b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.393+0000 7fb79faa5640 1 --2- 172.21.15.103:0/4285575788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7980fea30 0x7fb7980fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.393+0000 7fb79faa5640 1 -- 172.21.15.103:0/4285575788 >> 172.21.15.103:0/4285575788 conn(0x7fb7980fa1c0 msgr2=0x7fb7980fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.394+0000 7fb79faa5640 1 -- 172.21.15.103:0/4285575788 shutdown_connections 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.394+0000 7fb79faa5640 1 -- 172.21.15.103:0/4285575788 wait complete. 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.394+0000 7fb79faa5640 1 Processor -- start 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79faa5640 1 -- start start 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79faa5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 0x7fb798068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79faa5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7980ffc30 0x7fb79819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79faa5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819a970 con 0x7fb7980fea30 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79faa5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819aab0 con 0x7fb7980ffc30 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 0x7fb798068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 0x7fb798068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51826/0 (socket says 172.21.15.103:51826) 2024-09-17T01:10:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 -- 172.21.15.103:0/130034705 learned_addr learned my addr 172.21.15.103:0/130034705 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d040640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7980ffc30 0x7fb79819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 -- 172.21.15.103:0/130034705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7980ffc30 msgr2=0x7fb79819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7980ffc30 0x7fb79819a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 -- 172.21.15.103:0/130034705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c009560 con 0x7fb7980fea30 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb79d841640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 0x7fb798068740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb788009fd0 tx=0x7fb78800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.395+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb78800ce10 con 0x7fb7980fea30 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.396+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79819ad60 con 0x7fb7980fea30 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.396+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79819b2b0 con 0x7fb7980fea30 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.396+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb788011930 con 0x7fb7980fea30 2024-09-17T01:10:09.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.396+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb78801ab30 con 0x7fb7980fea30 2024-09-17T01:10:09.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.397+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79818e5b0 con 0x7fb7980fea30 2024-09-17T01:10:09.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.397+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb78801ac90 con 0x7fb7980fea30 2024-09-17T01:10:09.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.397+0000 7fb796ffd640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb78006e730 0x7fb780070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.398+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb78808ef50 con 0x7fb7980fea30 2024-09-17T01:10:09.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.398+0000 7fb79d040640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb78006e730 0x7fb780070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.398+0000 7fb79d040640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb78006e730 0x7fb780070bf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006010 tx=0x7fb78c000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:09.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.403+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb7880c41b0 con 0x7fb7980fea30 2024-09-17T01:10:09.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.589+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb79802c550 con 0x7fb78006e730 2024-09-17T01:10:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.598+0000 7fb796ffd640 1 -- 172.21.15.103:0/130034705 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fb79802c550 con 0x7fb78006e730 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (9m) 46s ago 10m 24.7M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (11m) 46s ago 11m 8150k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (10m) 35s ago 10m 7801k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 starting - - - - 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (10m) 35s ago 10m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 818c6d9bec70 2024-09-17T01:10:09.598 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (9m) 46s ago 10m 84.6M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (5m) 46s ago 5m 151M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (5m) 46s ago 5m 91.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (5m) 35s ago 5m 14.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (5m) 35s ago 5m 16.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (2m) 46s ago 12m 472M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (72s) 35s ago 10m 438M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (60s) 46s ago 12m 29.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (39s) 35s ago 10m 19.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (11m) 46s ago 11m 16.2M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (10m) 35s ago 10m 16.2M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (9m) 46s ago 9m 229M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 35f89cd57291 2024-09-17T01:10:09.599 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (8m) 46s ago 8m 236M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:10:09.600 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (8m) 46s ago 8m 209M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:10:09.600 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (8m) 35s ago 8m 284M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:10:09.600 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (7m) 35s ago 7m 268M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:10:09.600 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (7m) 35s ago 7m 230M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:10:09.600 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (78s) 46s ago 10m 46.2M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.600+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb78006e730 msgr2=0x7fb780070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.600+0000 7fb79faa5640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb78006e730 0x7fb780070bf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006010 tx=0x7fb78c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 msgr2=0x7fb798068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 0x7fb798068740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb788009fd0 tx=0x7fb78800ef40 comp rx=0 tx=0).stop 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 shutdown_connections 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb78006e730 0x7fb780070bf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7980ffc30 0x7fb79819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 --2- 172.21.15.103:0/130034705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7980fea30 0x7fb798068740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 >> 172.21.15.103:0/130034705 conn(0x7fb7980fa1c0 msgr2=0x7fb798103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 shutdown_connections 2024-09-17T01:10:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.601+0000 7fb79faa5640 1 -- 172.21.15.103:0/130034705 wait complete. 2024-09-17T01:10:09.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 -- 172.21.15.103:0/3319234820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880ffc80 msgr2=0x7fba88100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/3319234820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880ffc80 0x7fba88100100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba78009c20 tx=0x7fba7802a970 comp rx=0 tx=0).stop 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 -- 172.21.15.103:0/3319234820 shutdown_connections 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/3319234820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880ffc80 0x7fba88100100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/3319234820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba880fea80 0x7fba880fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 -- 172.21.15.103:0/3319234820 >> 172.21.15.103:0/3319234820 conn(0x7fba880fa230 msgr2=0x7fba880fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 -- 172.21.15.103:0/3319234820 shutdown_connections 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 -- 172.21.15.103:0/3319234820 wait complete. 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.680+0000 7fba8ef6c640 1 Processor -- start 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8ef6c640 1 -- start start 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8ef6c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 0x7fba88068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8ef6c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba880ffc80 0x7fba8819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8ef6c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8819a8a0 con 0x7fba880fea80 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8ef6c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8819aa10 con 0x7fba880ffc80 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 0x7fba88068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 0x7fba88068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51866/0 (socket says 172.21.15.103:51866) 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 -- 172.21.15.103:0/2830030977 learned_addr learned my addr 172.21.15.103:0/2830030977 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba87fff640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba880ffc80 0x7fba8819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 -- 172.21.15.103:0/2830030977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba880ffc80 msgr2=0x7fba8819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba880ffc80 0x7fba8819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 -- 172.21.15.103:0/2830030977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009900 con 0x7fba880fea80 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8cd08640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 0x7fba88068f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba8000d8d0 tx=0x7fba8000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8000bea0 con 0x7fba880fea80 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8819acf0 con 0x7fba880fea80 2024-09-17T01:10:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba80009c00 con 0x7fba880fea80 2024-09-17T01:10:09.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.681+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8000f790 con 0x7fba880fea80 2024-09-17T01:10:09.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.682+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8819b1e0 con 0x7fba880fea80 2024-09-17T01:10:09.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.683+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8818e600 con 0x7fba880fea80 2024-09-17T01:10:09.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.683+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fba8000fa50 con 0x7fba880fea80 2024-09-17T01:10:09.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.683+0000 7fba85ffb640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fba7406e730 0x7fba74070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:09.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.683+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fba8008e9a0 con 0x7fba880fea80 2024-09-17T01:10:09.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.684+0000 7fba87fff640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fba7406e730 0x7fba74070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:09.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.684+0000 7fba87fff640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fba7406e730 0x7fba74070bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba88068c90 tx=0x7fba7803d040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:09.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.688+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fba80057840 con 0x7fba880fea80 2024-09-17T01:10:09.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.924+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba8802c520 con 0x7fba880fea80 2024-09-17T01:10:09.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.924+0000 7fba85ffb640 1 -- 172.21.15.103:0/2830030977 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fba8005af00 con 0x7fba880fea80 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T01:10:09.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 10, 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:10:09.925 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.926+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fba7406e730 msgr2=0x7fba74070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.926+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fba7406e730 0x7fba74070bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba88068c90 tx=0x7fba7803d040 comp rx=0 tx=0).stop 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.926+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 msgr2=0x7fba88068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.926+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 0x7fba88068f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba8000d8d0 tx=0x7fba8000dd90 comp rx=0 tx=0).stop 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 shutdown_connections 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fba7406e730 0x7fba74070bf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba880ffc80 0x7fba8819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 --2- 172.21.15.103:0/2830030977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba880fea80 0x7fba88068f10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:09.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 >> 172.21.15.103:0/2830030977 conn(0x7fba880fa230 msgr2=0x7fba88103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:09.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 shutdown_connections 2024-09-17T01:10:09.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:09.927+0000 7fba8ef6c640 1 -- 172.21.15.103:0/2830030977 wait complete. 2024-09-17T01:10:10.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.008+0000 7fa181c25640 1 -- 172.21.15.103:0/1337049817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0feaa0 msgr2=0x7fa17c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.008+0000 7fa181c25640 1 --2- 172.21.15.103:0/1337049817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0feaa0 0x7fa17c0feea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009880 tx=0x7fa16c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.008+0000 7fa181c25640 1 -- 172.21.15.103:0/1337049817 shutdown_connections 2024-09-17T01:10:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.008+0000 7fa181c25640 1 --2- 172.21.15.103:0/1337049817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa17c0ffca0 0x7fa17c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.008+0000 7fa181c25640 1 --2- 172.21.15.103:0/1337049817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0feaa0 0x7fa17c0feea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.008+0000 7fa181c25640 1 -- 172.21.15.103:0/1337049817 >> 172.21.15.103:0/1337049817 conn(0x7fa17c0fa230 msgr2=0x7fa17c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:10.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:09 smithi103 ceph-mon[92733]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:10.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:09 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:10.008 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:09 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.009+0000 7fa181c25640 1 -- 172.21.15.103:0/1337049817 shutdown_connections 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.009+0000 7fa181c25640 1 -- 172.21.15.103:0/1337049817 wait complete. 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.009+0000 7fa181c25640 1 Processor -- start 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa181c25640 1 -- start start 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa181c25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa17c0feaa0 0x7fa17c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa181c25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 0x7fa17c19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa181c25640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19a920 con 0x7fa17c0ffca0 2024-09-17T01:10:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa181c25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19aa60 con 0x7fa17c0feaa0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 0x7fa17c19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 0x7fa17c19a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51876/0 (socket says 172.21.15.103:51876) 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 -- 172.21.15.103:0/4204481004 learned_addr learned my addr 172.21.15.103:0/4204481004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17b7fe640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa17c0feaa0 0x7fa17c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 -- 172.21.15.103:0/4204481004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa17c0feaa0 msgr2=0x7fa17c068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa17c0feaa0 0x7fa17c068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 -- 172.21.15.103:0/4204481004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c009560 con 0x7fa17c0ffca0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.010+0000 7fa17affd640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 0x7fa17c19a350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e970 tx=0x7fa17000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.011+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa17000cc90 con 0x7fa17c0ffca0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.011+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa17000cdf0 con 0x7fa17c0ffca0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.011+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c19ad10 con 0x7fa17c0ffca0 2024-09-17T01:10:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.011+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa170018810 con 0x7fa17c0ffca0 2024-09-17T01:10:10.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.011+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c19b2e0 con 0x7fa17c0ffca0 2024-09-17T01:10:10.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.012+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c107690 con 0x7fa17c0ffca0 2024-09-17T01:10:10.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.012+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa170010c10 con 0x7fa17c0ffca0 2024-09-17T01:10:10.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.013+0000 7fa178ff9640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16406e730 0x7fa164070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.013+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa170014070 con 0x7fa17c0ffca0 2024-09-17T01:10:10.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.013+0000 7fa17b7fe640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16406e730 0x7fa164070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.013+0000 7fa17b7fe640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16406e730 0x7fa164070bf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009230 tx=0x7fa16c0314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:10.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.017+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa1700541b0 con 0x7fa17c0ffca0 2024-09-17T01:10:10.177 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:09 smithi143 ceph-mon[80685]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:10.177 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:09 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:10.177 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:09 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.217+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa17c19b520 con 0x7fa17c0ffca0 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.218+0000 7fa178ff9640 1 -- 172.21.15.103:0/4204481004 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7fa17005b8c0 con 0x7fa17c0ffca0 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:10:10.217 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:10:10.218 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:10:10.219 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:10.220 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:10.221 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:10:10.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16406e730 msgr2=0x7fa164070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16406e730 0x7fa164070bf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009230 tx=0x7fa16c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 msgr2=0x7fa17c19a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 0x7fa17c19a350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e970 tx=0x7fa17000ee30 comp rx=0 tx=0).stop 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 shutdown_connections 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa16406e730 0x7fa164070bf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa17c0ffca0 0x7fa17c19a350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 --2- 172.21.15.103:0/4204481004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa17c0feaa0 0x7fa17c068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 >> 172.21.15.103:0/4204481004 conn(0x7fa17c0fa230 msgr2=0x7fa17c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 shutdown_connections 2024-09-17T01:10:10.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.221+0000 7fa181c25640 1 -- 172.21.15.103:0/4204481004 wait complete. 2024-09-17T01:10:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 -- 172.21.15.103:0/2871998640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 msgr2=0x7fb4d8101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 --2- 172.21.15.103:0/2871998640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 0x7fb4d8101680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009880 tx=0x7fb4d402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 -- 172.21.15.103:0/2871998640 shutdown_connections 2024-09-17T01:10:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 --2- 172.21.15.103:0/2871998640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d80ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 --2- 172.21.15.103:0/2871998640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 0x7fb4d8101680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 -- 172.21.15.103:0/2871998640 >> 172.21.15.103:0/2871998640 conn(0x7fb4d80fb330 msgr2=0x7fb4d80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 -- 172.21.15.103:0/2871998640 shutdown_connections 2024-09-17T01:10:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.302+0000 7fb4def6c640 1 -- 172.21.15.103:0/2871998640 wait complete. 2024-09-17T01:10:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.303+0000 7fb4def6c640 1 Processor -- start 2024-09-17T01:10:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.303+0000 7fb4def6c640 1 -- start start 2024-09-17T01:10:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.303+0000 7fb4def6c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d8195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.303+0000 7fb4def6c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 0x7fb4d8195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.303+0000 7fb4def6c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8196240 con 0x7fb4d8101280 2024-09-17T01:10:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.303+0000 7fb4def6c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d81963b0 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d8195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d8195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:35994/0 (socket says 172.21.15.103:35994) 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 -- 172.21.15.103:0/1403667002 learned_addr learned my addr 172.21.15.103:0/1403667002 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4cffff640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 0x7fb4d8195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 -- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 msgr2=0x7fb4d8195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 0x7fb4d8195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 -- 172.21.15.103:0/1403667002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009560 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4dcd08640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d8195730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4d402a9c0 tx=0x7fb4d4005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4d4004b20 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d819adf0 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4d4004c80 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.304+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4d4003b80 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.305+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d819b2e0 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.306+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d80ffc40 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.306+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb4d4031640 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.307+0000 7fb4cdffb640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4c006e730 0x7fb4c0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.307+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb4d40afbc0 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.307+0000 7fb4cffff640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4c006e730 0x7fb4c0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.307+0000 7fb4cffff640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4c006e730 0x7fb4c0070bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8196c50 tx=0x7fb4c800a250 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.312+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4d4078ba0 con 0x7fb4d80ff7c0 2024-09-17T01:10:10.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.493+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4d81056f0 con 0x7fb4c006e730 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.494+0000 7fb4cdffb640 1 -- 172.21.15.103:0/1403667002 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb4d81056f0 con 0x7fb4c006e730 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:10:10.493 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:10:10.494 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:10:10.494 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:10:10.494 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "4/23 daemons upgraded", 2024-09-17T01:10:10.494 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading crash daemons", 2024-09-17T01:10:10.494 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:10:10.494 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:10:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4c006e730 msgr2=0x7fb4c0070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4c006e730 0x7fb4c0070bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8196c50 tx=0x7fb4c800a250 comp rx=0 tx=0).stop 2024-09-17T01:10:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 msgr2=0x7fb4d8195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d8195730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4d402a9c0 tx=0x7fb4d4005610 comp rx=0 tx=0).stop 2024-09-17T01:10:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 shutdown_connections 2024-09-17T01:10:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4c006e730 0x7fb4c0070bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4d8101280 0x7fb4d8195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 --2- 172.21.15.103:0/1403667002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4d80ff7c0 0x7fb4d8195730 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 >> 172.21.15.103:0/1403667002 conn(0x7fb4d80fb330 msgr2=0x7fb4d8103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 shutdown_connections 2024-09-17T01:10:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.496+0000 7fb4def6c640 1 -- 172.21.15.103:0/1403667002 wait complete. 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.578+0000 7fa19fa6a640 1 -- 172.21.15.103:0/2125599739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980fea80 msgr2=0x7fa1980fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.578+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/2125599739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980fea80 0x7fa1980fee80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa194009880 tx=0x7fa19402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.578+0000 7fa19fa6a640 1 -- 172.21.15.103:0/2125599739 shutdown_connections 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.578+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/2125599739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980ffc80 0x7fa198100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.578+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/2125599739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980fea80 0x7fa1980fee80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.578+0000 7fa19fa6a640 1 -- 172.21.15.103:0/2125599739 >> 172.21.15.103:0/2125599739 conn(0x7fa1980fa230 msgr2=0x7fa1980fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.579+0000 7fa19fa6a640 1 -- 172.21.15.103:0/2125599739 shutdown_connections 2024-09-17T01:10:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.579+0000 7fa19fa6a640 1 -- 172.21.15.103:0/2125599739 wait complete. 2024-09-17T01:10:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.579+0000 7fa19fa6a640 1 Processor -- start 2024-09-17T01:10:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.579+0000 7fa19fa6a640 1 -- start start 2024-09-17T01:10:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19fa6a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 0x7fa198068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19fa6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 0x7fa19819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19fa6a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19819a920 con 0x7fa1980ffc80 2024-09-17T01:10:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19fa6a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19819aa60 con 0x7fa1980fea80 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d005640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 0x7fa19819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d806640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 0x7fa198068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d806640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 0x7fa198068f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:36018/0 (socket says 172.21.15.103:36018) 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d005640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 0x7fa19819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51934/0 (socket says 172.21.15.103:51934) 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d806640 1 -- 172.21.15.103:0/238674774 learned_addr learned my addr 172.21.15.103:0/238674774 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d005640 1 -- 172.21.15.103:0/238674774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 msgr2=0x7fa198068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d005640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 0x7fa198068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d005640 1 -- 172.21.15.103:0/238674774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009560 con 0x7fa1980ffc80 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d806640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 0x7fa198068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.580+0000 7fa19d005640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 0x7fa19819a350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa18800e970 tx=0x7fa18800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.581+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa188009620 con 0x7fa1980ffc80 2024-09-17T01:10:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.581+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1880044f0 con 0x7fa1980ffc80 2024-09-17T01:10:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.581+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1880049d0 con 0x7fa1980ffc80 2024-09-17T01:10:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.581+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19819ad10 con 0x7fa1980ffc80 2024-09-17T01:10:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.581+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19819b290 con 0x7fa1980ffc80 2024-09-17T01:10:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.582+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa198107690 con 0x7fa1980ffc80 2024-09-17T01:10:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.582+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa18800cc90 con 0x7fa1980ffc80 2024-09-17T01:10:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.583+0000 7fa18effd640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa18406e730 0x7fa184070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.583+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa188014070 con 0x7fa1980ffc80 2024-09-17T01:10:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.583+0000 7fa19d806640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa18406e730 0x7fa184070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.583+0000 7fa19d806640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa18406e730 0x7fa184070bf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa194000c00 tx=0x7fa1940314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.588+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa188057b90 con 0x7fa1980ffc80 2024-09-17T01:10:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.817+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa198107820 con 0x7fa1980ffc80 2024-09-17T01:10:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.817+0000 7fa18effd640 1 -- 172.21.15.103:0/238674774 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa18805b250 con 0x7fa1980ffc80 2024-09-17T01:10:10.817 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:10:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.819+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa18406e730 msgr2=0x7fa184070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.819+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa18406e730 0x7fa184070bf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa194000c00 tx=0x7fa1940314e0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.819+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 msgr2=0x7fa19819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.819+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 0x7fa19819a350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa18800e970 tx=0x7fa18800ee30 comp rx=0 tx=0).stop 2024-09-17T01:10:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 shutdown_connections 2024-09-17T01:10:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa18406e730 0x7fa184070bf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1980ffc80 0x7fa19819a350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 --2- 172.21.15.103:0/238674774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1980fea80 0x7fa198068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 >> 172.21.15.103:0/238674774 conn(0x7fa1980fa230 msgr2=0x7fa1980fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 shutdown_connections 2024-09-17T01:10:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:10.820+0000 7fa19fa6a640 1 -- 172.21.15.103:0/238674774 wait complete. 2024-09-17T01:10:11.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:10 smithi143 ceph-mon[80685]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:10 smithi143 ceph-mon[80685]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:10 smithi143 ceph-mon[80685]: pgmap v29: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:11.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:10 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2830030977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:11.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:10 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/4204481004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:11.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:10 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/238674774' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:10 smithi103 ceph-mon[92733]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:10 smithi103 ceph-mon[92733]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:10 smithi103 ceph-mon[92733]: pgmap v29: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:10 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2830030977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:10 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/4204481004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:10 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/238674774' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:11 smithi103 ceph-mon[92733]: from='client.44139 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:11 smithi103 ceph-mon[92733]: Upgrade: Updating crash.smithi143 (2/2) 2024-09-17T01:10:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:11 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:11 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:10:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:11 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:11 smithi103 ceph-mon[92733]: Deploying daemon crash.smithi143 on smithi143 2024-09-17T01:10:12.186 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:11 smithi143 ceph-mon[80685]: from='client.44139 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.186 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:11 smithi143 ceph-mon[80685]: Upgrade: Updating crash.smithi143 (2/2) 2024-09-17T01:10:12.187 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:11 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:12.187 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:11 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi143", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:10:12.187 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:11 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:12.187 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:11 smithi143 ceph-mon[80685]: Deploying daemon crash.smithi143 on smithi143 2024-09-17T01:10:12.993 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:12 smithi143 ceph-mon[80685]: pgmap v30: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:13.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:12 smithi103 ceph-mon[92733]: pgmap v30: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:14 smithi103 ceph-mon[92733]: pgmap v31: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:14 smithi143 ceph-mon[80685]: pgmap v31: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:15.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:16.980 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:16 smithi143 ceph-mon[80685]: pgmap v32: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:16 smithi103 ceph-mon[92733]: pgmap v32: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:18.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:18 smithi143 ceph-mon[80685]: pgmap v33: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:18.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:18.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.860 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.860 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.860 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:18 smithi103 ceph-mon[92733]: pgmap v33: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:18.860 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:18.860 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:18.861 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:20 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:20 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:20 smithi143 ceph-mon[80685]: pgmap v34: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:20.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:20 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:20 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.799 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:20 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.800 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:20 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.800 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:20 smithi103 ceph-mon[92733]: pgmap v34: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:20.800 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:20 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:20.800 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:20 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:22.491 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:22.491 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:22.491 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:22 smithi103 ceph-mon[92733]: pgmap v35: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:22 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:22 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:22.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:22 smithi143 ceph-mon[80685]: pgmap v35: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all crash 2024-09-17T01:10:24.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]: dispatch 2024-09-17T01:10:24.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]': finished 2024-09-17T01:10:24.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi143"}]: dispatch 2024-09-17T01:10:24.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi143"}]': finished 2024-09-17T01:10:24.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:10:24.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:10:24.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: Upgrade: osd.0 is safe to restart 2024-09-17T01:10:24.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:24 smithi103 ceph-mon[92733]: pgmap v36: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:24.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all crash 2024-09-17T01:10:24.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:24.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]: dispatch 2024-09-17T01:10:24.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]': finished 2024-09-17T01:10:24.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi143"}]: dispatch 2024-09-17T01:10:24.760 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi143"}]': finished 2024-09-17T01:10:24.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:10:24.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:10:24.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: Upgrade: osd.0 is safe to restart 2024-09-17T01:10:24.761 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:24 smithi143 ceph-mon[80685]: pgmap v36: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:26.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:25 smithi103 ceph-mon[92733]: Upgrade: Updating osd.0 2024-09-17T01:10:26.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:26.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:10:26.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:25 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.174 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:25 smithi103 ceph-mon[92733]: Deploying daemon osd.0 on smithi103 2024-09-17T01:10:26.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:25 smithi143 ceph-mon[80685]: Upgrade: Updating osd.0 2024-09-17T01:10:26.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:25 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:26.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:25 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:10:26.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:25 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:25 smithi143 ceph-mon[80685]: Deploying daemon osd.0 on smithi103 2024-09-17T01:10:27.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:26 smithi103 ceph-mon[92733]: pgmap v37: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:27.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:26 smithi143 ceph-mon[80685]: pgmap v37: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:27.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:27 smithi103 systemd[1]: Stopping Ceph osd.0 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:10:28.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:27 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[47102]: 2024-09-17T01:10:27.932+0000 7f7b5e10e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:10:28.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:27 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[47102]: 2024-09-17T01:10:27.932+0000 7f7b5e10e640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-17T01:10:28.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:27 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[47102]: 2024-09-17T01:10:27.932+0000 7f7b5e10e640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:10:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:28 smithi103 ceph-mon[92733]: pgmap v38: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:28 smithi103 ceph-mon[92733]: osd.0 marked itself down and dead 2024-09-17T01:10:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:28 smithi143 ceph-mon[80685]: pgmap v38: 65 pgs: 65 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:10:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:28 smithi143 ceph-mon[80685]: osd.0 marked itself down and dead 2024-09-17T01:10:29.707 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:29 smithi103 podman[100538]: 2024-09-17 01:10:29.447230893 +0000 UTC m=+1.653038301 container died 35f89cd57291e6a4ac821fad87910e8cafe89a1dffc95b2e3f389fa87fc11eb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T01:10:30.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:29 smithi103 ceph-mon[92733]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:30.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:29 smithi103 ceph-mon[92733]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:10:30.133 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:29 smithi103 podman[100538]: 2024-09-17 01:10:29.807887535 +0000 UTC m=+2.013694944 container cleanup 35f89cd57291e6a4ac821fad87910e8cafe89a1dffc95b2e3f389fa87fc11eb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:10:30.133 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:29 smithi103 bash[100538]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:10:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:29 smithi143 ceph-mon[80685]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:29 smithi143 ceph-mon[80685]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:10:30.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100556]: 2024-09-17 01:10:30.134719273 +0000 UTC m=+0.682505284 container remove 35f89cd57291e6a4ac821fad87910e8cafe89a1dffc95b2e3f389fa87fc11eb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:10:30.777 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100643]: 2024-09-17 01:10:30.366729935 +0000 UTC m=+0.016366526 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:10:30.777 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100643]: 2024-09-17 01:10:30.468871259 +0000 UTC m=+0.118507843 container create f195cd703e470f9979aa0ad4519e093eb5ed48342d46a07fb9ddec6612c4ca2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T01:10:30.777 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100643]: 2024-09-17 01:10:30.704816535 +0000 UTC m=+0.354453135 container init f195cd703e470f9979aa0ad4519e093eb5ed48342d46a07fb9ddec6612c4ca2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:10:30.778 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100643]: 2024-09-17 01:10:30.708242165 +0000 UTC m=+0.357878750 container start f195cd703e470f9979aa0ad4519e093eb5ed48342d46a07fb9ddec6612c4ca2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T01:10:30.778 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100643]: 2024-09-17 01:10:30.779590779 +0000 UTC m=+0.429227379 container attach f195cd703e470f9979aa0ad4519e093eb5ed48342d46a07fb9ddec6612c4ca2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:10:31.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:30 smithi103 ceph-mon[92733]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:10:31.173 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:30 smithi103 ceph-mon[92733]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:10:31.173 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:30 smithi103 podman[100643]: 2024-09-17 01:10:30.899370233 +0000 UTC m=+0.549006820 container died f195cd703e470f9979aa0ad4519e093eb5ed48342d46a07fb9ddec6612c4ca2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:10:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:30 smithi143 ceph-mon[80685]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:10:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:30 smithi143 ceph-mon[80685]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:10:31.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 podman[100666]: 2024-09-17 01:10:31.50060207 +0000 UTC m=+0.592129832 container remove f195cd703e470f9979aa0ad4519e093eb5ed48342d46a07fb9ddec6612c4ca2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:31.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:10:31.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 systemd[1]: Stopped Ceph osd.0 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:10:31.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.0.service: Consumed 1min 653ms CPU time. 2024-09-17T01:10:31.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 systemd[1]: Starting Ceph osd.0 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:10:32.211 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 podman[100764]: 2024-09-17 01:10:31.836532263 +0000 UTC m=+0.016453288 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:10:32.211 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:31 smithi103 podman[100764]: 2024-09-17 01:10:31.959958254 +0000 UTC m=+0.139879261 container create 95ff9882483d00b278a08d111acc523f465d441b0fddcda04b88dfea8f95d1da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T01:10:32.552 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 podman[100764]: 2024-09-17 01:10:32.213289635 +0000 UTC m=+0.393210652 container init 95ff9882483d00b278a08d111acc523f465d441b0fddcda04b88dfea8f95d1da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:32.552 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 podman[100764]: 2024-09-17 01:10:32.218245657 +0000 UTC m=+0.398166668 container start 95ff9882483d00b278a08d111acc523f465d441b0fddcda04b88dfea8f95d1da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:10:32.552 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 podman[100764]: 2024-09-17 01:10:32.321309149 +0000 UTC m=+0.501230168 container attach 95ff9882483d00b278a08d111acc523f465d441b0fddcda04b88dfea8f95d1da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T01:10:32.553 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:32.553 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 bash[100764]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:32.553 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:32.553 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:32 smithi103 bash[100764]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:32 smithi103 ceph-mon[92733]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:33.177 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:10:33.177 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:10:33.177 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:10:33.178 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:10:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:32 smithi143 ceph-mon[80685]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:10:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:33.677 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:10:33.677 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:10:33.677 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:10:33.678 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:10:33.678 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:10:33.678 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:10:33.678 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:10:33.678 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:10:33.678 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate[100779]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:10:33.679 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 bash[100764]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:10:33.679 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:33 smithi103 podman[100764]: 2024-09-17 01:10:33.424919133 +0000 UTC m=+1.604840148 container died 95ff9882483d00b278a08d111acc523f465d441b0fddcda04b88dfea8f95d1da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-17T01:10:34.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 podman[100925]: 2024-09-17 01:10:34.059007547 +0000 UTC m=+0.623698568 container remove 95ff9882483d00b278a08d111acc523f465d441b0fddcda04b88dfea8f95d1da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97) 2024-09-17T01:10:34.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 podman[100984]: 2024-09-17 01:10:34.169149247 +0000 UTC m=+0.016254190 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:10:34.427 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 podman[100984]: 2024-09-17 01:10:34.301678402 +0000 UTC m=+0.148783376 container create 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T01:10:34.893 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 podman[100984]: 2024-09-17 01:10:34.587686032 +0000 UTC m=+0.434790970 container init 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:10:34.893 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 podman[100984]: 2024-09-17 01:10:34.591281584 +0000 UTC m=+0.438386516 container start 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T01:10:34.893 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 ceph-osd[101002]: -- 172.21.15.103:0/3935332707 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639651bc1e0 con 0x563964369c00 2024-09-17T01:10:34.894 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 bash[100984]: 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 2024-09-17T01:10:34.894 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:34 smithi103 systemd[1]: Started Ceph osd.0 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:10:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:34 smithi103 ceph-mon[92733]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-17T01:10:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:34 smithi143 ceph-mon[80685]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-17T01:10:35.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:35.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:35 smithi103 ceph-mon[92733]: Health check failed: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:35 smithi143 ceph-mon[80685]: Health check failed: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:36.533 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:36 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[100998]: 2024-09-17T01:10:36.221+0000 7f04550dd640 -1 Falling back to public interface 2024-09-17T01:10:37.253 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:36 smithi103 ceph-mon[92733]: pgmap v44: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:37.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:36 smithi143 ceph-mon[80685]: pgmap v44: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:39.205 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:38 smithi103 ceph-mon[92733]: pgmap v45: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 458 B/s rd, 0 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:38 smithi143 ceph-mon[80685]: pgmap v45: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 458 B/s rd, 0 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.910+0000 7fcc0cd51640 1 -- 172.21.15.103:0/1529146630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080fea30 msgr2=0x7fcc080fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.910+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/1529146630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080fea30 0x7fcc080fee30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009c20 tx=0x7fcc0002a970 comp rx=0 tx=0).stop 2024-09-17T01:10:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 -- 172.21.15.103:0/1529146630 shutdown_connections 2024-09-17T01:10:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/1529146630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080ffc30 0x7fcc081000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:40.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/1529146630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080fea30 0x7fcc080fee30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:40.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 -- 172.21.15.103:0/1529146630 >> 172.21.15.103:0/1529146630 conn(0x7fcc080fa1c0 msgr2=0x7fcc080fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:40.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 -- 172.21.15.103:0/1529146630 shutdown_connections 2024-09-17T01:10:40.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 -- 172.21.15.103:0/1529146630 wait complete. 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 Processor -- start 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.911+0000 7fcc0cd51640 1 -- start start 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0cd51640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080fea30 0x7fcc08195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0cd51640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 0x7fcc08195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0cd51640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08196210 con 0x7fcc080ffc30 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0cd51640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08196380 con 0x7fcc080fea30 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 0x7fcc08195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:40.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 0x7fcc08195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49730/0 (socket says 172.21.15.103:49730) 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 -- 172.21.15.103:0/476161712 learned_addr learned my addr 172.21.15.103:0/476161712 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0659c640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080fea30 0x7fcc08195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 -- 172.21.15.103:0/476161712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080fea30 msgr2=0x7fcc08195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080fea30 0x7fcc08195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 -- 172.21.15.103:0/476161712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00009900 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0659c640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080fea30 0x7fcc08195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc05d9b640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 0x7fcc08195c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00b450 tx=0x7fcbfc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbfc011860 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbfc011e80 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.912+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0819ae20 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.913+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbfc00f570 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.913+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0819b3c0 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.914+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc080feeb0 con 0x7fcc080ffc30 2024-09-17T01:10:40.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.914+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fcbfc0103e0 con 0x7fcc080ffc30 2024-09-17T01:10:40.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.914+0000 7fcbf77fe640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcbf006e720 0x7fcbf0070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:40.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.915+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcbfc08e720 con 0x7fcc080ffc30 2024-09-17T01:10:40.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.915+0000 7fcc0659c640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcbf006e720 0x7fcbf0070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:40.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.915+0000 7fcc0659c640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcbf006e720 0x7fcbf0070be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098d0 tx=0x7fcc00009360 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:40.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:40.919+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcbfc057760 con 0x7fcc080ffc30 2024-09-17T01:10:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.122+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc080682f0 con 0x7fcbf006e720 2024-09-17T01:10:41.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:40 smithi103 ceph-mon[92733]: pgmap v46: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:41.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.121 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.121 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:40 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.123+0000 7fcbf77fe640 1 -- 172.21.15.103:0/476161712 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcc080682f0 con 0x7fcbf006e720 2024-09-17T01:10:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcbf006e720 msgr2=0x7fcbf0070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcbf006e720 0x7fcbf0070be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098d0 tx=0x7fcc00009360 comp rx=0 tx=0).stop 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 msgr2=0x7fcc08195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 0x7fcc08195c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00b450 tx=0x7fcbfc00b910 comp rx=0 tx=0).stop 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 shutdown_connections 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcbf006e720 0x7fcbf0070be0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc080ffc30 0x7fcc08195c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.125+0000 7fcc0cd51640 1 --2- 172.21.15.103:0/476161712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc080fea30 0x7fcc08195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.126+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 >> 172.21.15.103:0/476161712 conn(0x7fcc080fa1c0 msgr2=0x7fcc08067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.126+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 shutdown_connections 2024-09-17T01:10:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.126+0000 7fcc0cd51640 1 -- 172.21.15.103:0/476161712 wait complete. 2024-09-17T01:10:41.134 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:10:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 -- 172.21.15.103:0/1672527520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 msgr2=0x7fde380fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/1672527520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde380fee30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde28009880 tx=0x7fde2802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 -- 172.21.15.103:0/1672527520 shutdown_connections 2024-09-17T01:10:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/1672527520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde380ffc30 0x7fde381000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/1672527520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde380fee30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 -- 172.21.15.103:0/1672527520 >> 172.21.15.103:0/1672527520 conn(0x7fde380fa1c0 msgr2=0x7fde380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 -- 172.21.15.103:0/1672527520 shutdown_connections 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 -- 172.21.15.103:0/1672527520 wait complete. 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 Processor -- start 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.213+0000 7fde3dd6e640 1 -- start start 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde3dd6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde38195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde3dd6e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde380ffc30 0x7fde38195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde3dd6e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde38196220 con 0x7fde380fea30 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde3dd6e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde38196390 con 0x7fde380ffc30 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde38195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde38195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49758/0 (socket says 172.21.15.103:49758) 2024-09-17T01:10:41.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 -- 172.21.15.103:0/731052034 learned_addr learned my addr 172.21.15.103:0/731052034 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:41.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde36ffd640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde380ffc30 0x7fde38195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 -- 172.21.15.103:0/731052034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde380ffc30 msgr2=0x7fde38195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde380ffc30 0x7fde38195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 -- 172.21.15.103:0/731052034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009560 con 0x7fde380fea30 2024-09-17T01:10:41.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.214+0000 7fde377fe640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde38195710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde28005610 tx=0x7fde28005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:41.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.215+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde28004ba0 con 0x7fde380fea30 2024-09-17T01:10:41.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.215+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde28004d00 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.215+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde28003bf0 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.215+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3819add0 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.215+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3819b290 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.216+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fde28031640 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.216+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde381076a0 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.217+0000 7fde34ff9640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fde2006e720 0x7fde20070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.217+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fde280afd50 con 0x7fde380fea30 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.217+0000 7fde36ffd640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fde2006e720 0x7fde20070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.217+0000 7fde36ffd640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fde2006e720 0x7fde20070be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fde38196c30 tx=0x7fde2c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.221+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fde28078c20 con 0x7fde380fea30 2024-09-17T01:10:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:40 smithi143 ceph-mon[80685]: pgmap v46: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:40 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:41.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.420+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde3819b500 con 0x7fde2006e720 2024-09-17T01:10:41.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.422+0000 7fde34ff9640 1 -- 172.21.15.103:0/731052034 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fde3819b500 con 0x7fde2006e720 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.423+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fde2006e720 msgr2=0x7fde20070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.423+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fde2006e720 0x7fde20070be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fde38196c30 tx=0x7fde2c008040 comp rx=0 tx=0).stop 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.423+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 msgr2=0x7fde38195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.423+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde38195710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde28005610 tx=0x7fde28005640 comp rx=0 tx=0).stop 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 shutdown_connections 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fde2006e720 0x7fde20070be0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde380ffc30 0x7fde38195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 --2- 172.21.15.103:0/731052034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde380fea30 0x7fde38195710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 >> 172.21.15.103:0/731052034 conn(0x7fde380fa1c0 msgr2=0x7fde380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 shutdown_connections 2024-09-17T01:10:41.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.424+0000 7fde3dd6e640 1 -- 172.21.15.103:0/731052034 wait complete. 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 -- 172.21.15.103:0/3704484438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 msgr2=0x7efea40ffc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 --2- 172.21.15.103:0/3704484438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea40ffc40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe90009880 tx=0x7efe9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 -- 172.21.15.103:0/3704484438 shutdown_connections 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 --2- 172.21.15.103:0/3704484438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea40ffc40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 --2- 172.21.15.103:0/3704484438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efea4101280 0x7efea4101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 -- 172.21.15.103:0/3704484438 >> 172.21.15.103:0/3704484438 conn(0x7efea40fb330 msgr2=0x7efea40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:41.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.505+0000 7efeaae3e640 1 -- 172.21.15.103:0/3704484438 shutdown_connections 2024-09-17T01:10:41.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.506+0000 7efeaae3e640 1 -- 172.21.15.103:0/3704484438 wait complete. 2024-09-17T01:10:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.506+0000 7efeaae3e640 1 Processor -- start 2024-09-17T01:10:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.506+0000 7efeaae3e640 1 -- start start 2024-09-17T01:10:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efeaae3e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efeaae3e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efea4101280 0x7efea40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efeaae3e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4072de0 con 0x7efea40ff7c0 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efeaae3e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4072f50 con 0x7efea4101280 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea4074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49766/0 (socket says 172.21.15.103:49766) 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 -- 172.21.15.103:0/2315253036 learned_addr learned my addr 172.21.15.103:0/2315253036 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea3fff640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efea4101280 0x7efea40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 -- 172.21.15.103:0/2315253036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efea4101280 msgr2=0x7efea40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efea4101280 0x7efea40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 -- 172.21.15.103:0/2315253036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009560 con 0x7efea40ff7c0 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.507+0000 7efea8bda640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea4074250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c8f0 tx=0x7efe9800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.508+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe980041f0 con 0x7efea40ff7c0 2024-09-17T01:10:41.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.508+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea4073230 con 0x7efea40ff7c0 2024-09-17T01:10:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.508+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe98007e70 con 0x7efea40ff7c0 2024-09-17T01:10:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.508+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe980049d0 con 0x7efea40ff7c0 2024-09-17T01:10:41.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.508+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea419d7c0 con 0x7efea40ff7c0 2024-09-17T01:10:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.509+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea4109200 con 0x7efea40ff7c0 2024-09-17T01:10:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.509+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7efe98004b30 con 0x7efea40ff7c0 2024-09-17T01:10:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.510+0000 7efea1ffb640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9406e780 0x7efe94070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.510+0000 7efea3fff640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9406e780 0x7efe94070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.510+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efe9808e650 con 0x7efea40ff7c0 2024-09-17T01:10:41.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.511+0000 7efea3fff640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9406e780 0x7efe94070c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe90000c00 tx=0x7efe900314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:41.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.515+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe98057610 con 0x7efea40ff7c0 2024-09-17T01:10:41.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.731+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efea40608f0 con 0x7efe9406e780 2024-09-17T01:10:41.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.740+0000 7efea1ffb640 1 -- 172.21.15.103:0/2315253036 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7efea40608f0 con 0x7efe9406e780 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (10m) 1s ago 11m 24.5M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (11m) 1s ago 11m 8254k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (10m) 24s ago 10m 7856k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (32s) 1s ago 11m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (27s) 24s ago 10m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (10m) 1s ago 11m 86.1M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (6m) 1s ago 6m 149M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (6m) 1s ago 6m 91.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (6m) 24s ago 6m 15.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (6m) 24s ago 6m 16.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:10:41.739 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (2m) 1s ago 12m 495M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (104s) 24s ago 10m 438M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (92s) 1s ago 13m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (71s) 24s ago 10m 34.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (11m) 1s ago 11m 15.9M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (10m) 24s ago 10m 16.2M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (7s) 1s ago 9m 12.1M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (9m) 1s ago 9m 237M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 6fcce5e20263 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (8m) 1s ago 8m 209M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:10:41.740 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (8m) 24s ago 8m 285M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:10:41.741 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (8m) 24s ago 8m 269M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:10:41.741 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (7m) 24s ago 7m 231M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:10:41.741 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (110s) 1s ago 11m 58.6M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9406e780 msgr2=0x7efe94070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9406e780 0x7efe94070c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe90000c00 tx=0x7efe900314e0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 msgr2=0x7efea4074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea4074250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c8f0 tx=0x7efe9800cdb0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 shutdown_connections 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9406e780 0x7efe94070c40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efea4101280 0x7efea40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 --2- 172.21.15.103:0/2315253036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efea40ff7c0 0x7efea4074250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 >> 172.21.15.103:0/2315253036 conn(0x7efea40fb330 msgr2=0x7efea4104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 shutdown_connections 2024-09-17T01:10:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.743+0000 7efeaae3e640 1 -- 172.21.15.103:0/2315253036 wait complete. 2024-09-17T01:10:41.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 -- 172.21.15.103:0/1704244753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e4102ef0 msgr2=0x7fd4e41052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/1704244753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e4102ef0 0x7fd4e41052e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80098b0 tx=0x7fd4d802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 -- 172.21.15.103:0/1704244753 shutdown_connections 2024-09-17T01:10:41.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/1704244753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e4102ef0 0x7fd4e41052e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/1704244753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e41005c0 0x7fd4e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 -- 172.21.15.103:0/1704244753 >> 172.21.15.103:0/1704244753 conn(0x7fd4e40fa1c0 msgr2=0x7fd4e40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:41.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 -- 172.21.15.103:0/1704244753 shutdown_connections 2024-09-17T01:10:41.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.826+0000 7fd4e8b31640 1 -- 172.21.15.103:0/1704244753 wait complete. 2024-09-17T01:10:41.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.827+0000 7fd4e8b31640 1 Processor -- start 2024-09-17T01:10:41.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.827+0000 7fd4e8b31640 1 -- start start 2024-09-17T01:10:41.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.827+0000 7fd4e8b31640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 0x7fd4e40fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.827+0000 7fd4e8b31640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e4102ef0 0x7fd4e40fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.827+0000 7fd4e8b31640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40feab0 con 0x7fd4e41005c0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.827+0000 7fd4e8b31640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40fec20 con 0x7fd4e4102ef0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 0x7fd4e40fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 0x7fd4e40fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49786/0 (socket says 172.21.15.103:49786) 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 -- 172.21.15.103:0/383431444 learned_addr learned my addr 172.21.15.103:0/383431444 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e1d9b640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e4102ef0 0x7fd4e40fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 -- 172.21.15.103:0/383431444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e4102ef0 msgr2=0x7fd4e40fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e4102ef0 0x7fd4e40fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 -- 172.21.15.103:0/383431444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d8009560 con 0x7fd4e41005c0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e259c640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 0x7fd4e40fff20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400c810 tx=0x7fd4d400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d40041f0 con 0x7fd4e41005c0 2024-09-17T01:10:41.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e40fef00 con 0x7fd4e41005c0 2024-09-17T01:10:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4d4007e70 con 0x7fd4e41005c0 2024-09-17T01:10:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d40049d0 con 0x7fd4e41005c0 2024-09-17T01:10:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.828+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e419d6a0 con 0x7fd4e41005c0 2024-09-17T01:10:41.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.830+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e41009a0 con 0x7fd4e41005c0 2024-09-17T01:10:41.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.830+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd4d4004b30 con 0x7fd4e41005c0 2024-09-17T01:10:41.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.831+0000 7fd4d37fe640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd4cc06e730 0x7fd4cc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:41.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.831+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd4d408e780 con 0x7fd4e41005c0 2024-09-17T01:10:41.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.831+0000 7fd4e1d9b640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd4cc06e730 0x7fd4cc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:41.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.832+0000 7fd4e1d9b640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd4cc06e730 0x7fd4cc070bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009230 tx=0x7fd4d8031e10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:41.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:41.836+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd4d4057720 con 0x7fd4e41005c0 2024-09-17T01:10:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.108+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd4e419da40 con 0x7fd4e41005c0 2024-09-17T01:10:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.108+0000 7fd4d37fe640 1 -- 172.21.15.103:0/383431444 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fd4d405ade0 con 0x7fd4e41005c0 2024-09-17T01:10:42.106 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 5 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:10:42.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:10:42.108 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:10:42.108 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 9, 2024-09-17T01:10:42.108 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:10:42.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:10:42.108 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:10:42.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd4cc06e730 msgr2=0x7fd4cc070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd4cc06e730 0x7fd4cc070bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009230 tx=0x7fd4d8031e10 comp rx=0 tx=0).stop 2024-09-17T01:10:42.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 msgr2=0x7fd4e40fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 0x7fd4e40fff20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400c810 tx=0x7fd4d400ccd0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 shutdown_connections 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd4cc06e730 0x7fd4cc070bf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4e4102ef0 0x7fd4e40fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 --2- 172.21.15.103:0/383431444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e41005c0 0x7fd4e40fff20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 >> 172.21.15.103:0/383431444 conn(0x7fd4e40fa1c0 msgr2=0x7fd4e40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 shutdown_connections 2024-09-17T01:10:42.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.111+0000 7fd4e8b31640 1 -- 172.21.15.103:0/383431444 wait complete. 2024-09-17T01:10:42.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 -- 172.21.15.103:0/1305961102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 msgr2=0x7f6738105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 --2- 172.21.15.103:0/1305961102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738105380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6728009880 tx=0x7f672802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 -- 172.21.15.103:0/1305961102 shutdown_connections 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 --2- 172.21.15.103:0/1305961102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738105380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 --2- 172.21.15.103:0/1305961102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6738100660 0x7f6738102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 -- 172.21.15.103:0/1305961102 >> 172.21.15.103:0/1305961102 conn(0x7f67380fa1c0 msgr2=0x7f67380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 -- 172.21.15.103:0/1305961102 shutdown_connections 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 -- 172.21.15.103:0/1305961102 wait complete. 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 Processor -- start 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.198+0000 7f673f6c6640 1 -- start start 2024-09-17T01:10:42.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673f6c6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6738100660 0x7f67381955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673f6c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673f6c6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6738196070 con 0x7f6738102f90 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673f6c6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67381961e0 con 0x7f6738100660 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49806/0 (socket says 172.21.15.103:49806) 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 -- 172.21.15.103:0/967318450 learned_addr learned my addr 172.21.15.103:0/967318450 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 -- 172.21.15.103:0/967318450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6738100660 msgr2=0x7f67381955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6738100660 0x7f67381955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 -- 172.21.15.103:0/967318450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009560 con 0x7f6738102f90 2024-09-17T01:10:42.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673cc61640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738195b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f672802a9c0 tx=0x7f6728005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6728004b20 con 0x7f6738102f90 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6728004c80 con 0x7f6738102f90 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.199+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673819ac60 con 0x7f6738102f90 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.200+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6728003bc0 con 0x7f6738102f90 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.200+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673819b180 con 0x7f6738102f90 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.201+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738108710 con 0x7f6738102f90 2024-09-17T01:10:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.201+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f6728031640 con 0x7f6738102f90 2024-09-17T01:10:42.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.202+0000 7f672e7fc640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f672406e720 0x7f6724070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.202+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f67280b01f0 con 0x7f6738102f90 2024-09-17T01:10:42.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.202+0000 7f673d462640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f672406e720 0x7f6724070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.203+0000 7f673d462640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f672406e720 0x7f6724070be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f673400a990 tx=0x7f6734005c70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:42.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.209+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f67280791a0 con 0x7f6738102f90 2024-09-17T01:10:42.347 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[100998]: 2024-09-17T01:10:42.243+0000 7f04550dd640 -1 osd.0 48 log_to_monitors true 2024-09-17T01:10:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.422+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f673819b480 con 0x7f6738102f90 2024-09-17T01:10:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.423+0000 7f672e7fc640 1 -- 172.21.15.103:0/967318450 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7f67280407b0 con 0x7f6738102f90 2024-09-17T01:10:42.421 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:10:42.421 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:10:42.421 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:10:42.421 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:10:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:42.425 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:42.425 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:42.425 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:10:42.425 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:10:42.425 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:42.425 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f672406e720 msgr2=0x7f6724070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f672406e720 0x7f6724070be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f673400a990 tx=0x7f6734005c70 comp rx=0 tx=0).stop 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 msgr2=0x7f6738195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738195b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f672802a9c0 tx=0x7f6728005610 comp rx=0 tx=0).stop 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 shutdown_connections 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f672406e720 0x7f6724070be0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6738102f90 0x7f6738195b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 --2- 172.21.15.103:0/967318450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6738100660 0x7f67381955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 >> 172.21.15.103:0/967318450 conn(0x7f67380fa1c0 msgr2=0x7f67380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:42.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.425+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 shutdown_connections 2024-09-17T01:10:42.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.426+0000 7f673f6c6640 1 -- 172.21.15.103:0/967318450 wait complete. 2024-09-17T01:10:42.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 -- 172.21.15.103:0/682723532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940fea30 msgr2=0x7f13940fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 --2- 172.21.15.103:0/682723532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940fea30 0x7f13940fee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1388009880 tx=0x7f138802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 -- 172.21.15.103:0/682723532 shutdown_connections 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 --2- 172.21.15.103:0/682723532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13940ffc30 0x7f13941000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 --2- 172.21.15.103:0/682723532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940fea30 0x7f13940fee30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 -- 172.21.15.103:0/682723532 >> 172.21.15.103:0/682723532 conn(0x7f13940fa1c0 msgr2=0x7f13940fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 -- 172.21.15.103:0/682723532 shutdown_connections 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 -- 172.21.15.103:0/682723532 wait complete. 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.509+0000 7f139ab30640 1 Processor -- start 2024-09-17T01:10:42.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f139ab30640 1 -- start start 2024-09-17T01:10:42.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f139ab30640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13940fea30 0x7f1394102970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f139ab30640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 0x7f1394101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f139ab30640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394101550 con 0x7f13940ffc30 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f139ab30640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13941016c0 con 0x7f13940fea30 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 0x7f1394101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 0x7f1394101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42896/0 (socket says 172.21.15.103:42896) 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 -- 172.21.15.103:0/3315976510 learned_addr learned my addr 172.21.15.103:0/3315976510 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f13988cc640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13940fea30 0x7f1394102970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 -- 172.21.15.103:0/3315976510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13940fea30 msgr2=0x7f1394102970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13940fea30 0x7f1394102970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 -- 172.21.15.103:0/3315976510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009560 con 0x7f13940ffc30 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.510+0000 7f1393fff640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 0x7f1394101010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f138000d8d0 tx=0x7f138000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.511+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138000bea0 con 0x7f13940ffc30 2024-09-17T01:10:42.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.511+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1380009c00 con 0x7f13940ffc30 2024-09-17T01:10:42.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.511+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13941019a0 con 0x7f13940ffc30 2024-09-17T01:10:42.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.511+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138000f710 con 0x7f13940ffc30 2024-09-17T01:10:42.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.511+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139419d6f0 con 0x7f13940ffc30 2024-09-17T01:10:42.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.512+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13940fee30 con 0x7f13940ffc30 2024-09-17T01:10:42.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.512+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f138000f990 con 0x7f13940ffc30 2024-09-17T01:10:42.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.513+0000 7f1391ffb640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f138406e730 0x7f1384070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.513+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f138008e620 con 0x7f13940ffc30 2024-09-17T01:10:42.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.513+0000 7f13988cc640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f138406e730 0x7f1384070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.514+0000 7f13988cc640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f138406e730 0x7f1384070bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1388009230 tx=0x7f13880314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:42.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.517+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1380057600 con 0x7f13940ffc30 2024-09-17T01:10:42.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.709+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13940fc3c0 con 0x7f138406e730 2024-09-17T01:10:42.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.710+0000 7f1391ffb640 1 -- 172.21.15.103:0/3315976510 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f13940fc3c0 con 0x7f138406e730 2024-09-17T01:10:42.708 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "7/23 daemons upgraded", 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:10:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:10:42.710 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f138406e730 msgr2=0x7f1384070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f138406e730 0x7f1384070bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1388009230 tx=0x7f13880314e0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 msgr2=0x7f1394101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 0x7f1394101010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f138000d8d0 tx=0x7f138000dd90 comp rx=0 tx=0).stop 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 shutdown_connections 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f138406e730 0x7f1384070bf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13940ffc30 0x7f1394101010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 --2- 172.21.15.103:0/3315976510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13940fea30 0x7f1394102970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 >> 172.21.15.103:0/3315976510 conn(0x7f13940fa1c0 msgr2=0x7f13940fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:42.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 shutdown_connections 2024-09-17T01:10:42.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.714+0000 7f139ab30640 1 -- 172.21.15.103:0/3315976510 wait complete. 2024-09-17T01:10:42.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 -- 172.21.15.103:0/546403057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 msgr2=0x7fd858101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 --2- 172.21.15.103:0/546403057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858101210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd848009880 tx=0x7fd84802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 -- 172.21.15.103:0/546403057 shutdown_connections 2024-09-17T01:10:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 --2- 172.21.15.103:0/546403057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858101210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 --2- 172.21.15.103:0/546403057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 0x7fd8580fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 -- 172.21.15.103:0/546403057 >> 172.21.15.103:0/546403057 conn(0x7fd8580fb320 msgr2=0x7fd8580fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 -- 172.21.15.103:0/546403057 shutdown_connections 2024-09-17T01:10:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.799+0000 7fd860126640 1 -- 172.21.15.103:0/546403057 wait complete. 2024-09-17T01:10:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd860126640 1 Processor -- start 2024-09-17T01:10:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd860126640 1 -- start start 2024-09-17T01:10:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd860126640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 0x7fd858195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd860126640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd860126640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858196120 con 0x7fd858100d90 2024-09-17T01:10:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd860126640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858196290 con 0x7fd8580ffb90 2024-09-17T01:10:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85d6c1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85d6c1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42912/0 (socket says 172.21.15.103:42912) 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85d6c1640 1 -- 172.21.15.103:0/3529601664 learned_addr learned my addr 172.21.15.103:0/3529601664 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85dec2640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 0x7fd858195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85d6c1640 1 -- 172.21.15.103:0/3529601664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 msgr2=0x7fd858195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85d6c1640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 0x7fd858195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85d6c1640 1 -- 172.21.15.103:0/3529601664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848009560 con 0x7fd858100d90 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.800+0000 7fd85dec2640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 0x7fd858195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:10:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.801+0000 7fd85d6c1640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858195b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8480055a0 tx=0x7fd8480055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.801+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd848004aa0 con 0x7fd858100d90 2024-09-17T01:10:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.801+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd848004c00 con 0x7fd858100d90 2024-09-17T01:10:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.801+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85819acd0 con 0x7fd858100d90 2024-09-17T01:10:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.801+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd848003b10 con 0x7fd858100d90 2024-09-17T01:10:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.801+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85819b240 con 0x7fd858100d90 2024-09-17T01:10:42.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.802+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85818f730 con 0x7fd858100d90 2024-09-17T01:10:42.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.803+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 36) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd848031d20 con 0x7fd858100d90 2024-09-17T01:10:42.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.803+0000 7fd84effd640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd84406e730 0x7fd844070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:42.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.803+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd8480afa50 con 0x7fd858100d90 2024-09-17T01:10:42.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.804+0000 7fd85dec2640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd84406e730 0x7fd844070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:42.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.804+0000 7fd85dec2640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd84406e730 0x7fd844070bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd858100bf0 tx=0x7fd854005f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:42.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:42.809+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd848078a40 con 0x7fd858100d90 2024-09-17T01:10:43.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.081+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd8581087a0 con 0x7fd858100d90 2024-09-17T01:10:43.080 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[100998]: 2024-09-17T01:10:42.892+0000 7f044ce77640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: pgmap v47: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 771 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/383431444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: from='osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:10:43.080 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:42 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/967318450' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.082+0000 7fd84effd640 1 -- 172.21.15.103:0/3529601664 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1271 (secure 0 0 0) 0x7fd84807c100 con 0x7fd858100d90 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: osd.0 (root=default,host=smithi103) is down 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-17T01:10:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-17T01:10:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-17T01:10:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-17T01:10:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-17T01:10:43.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd84406e730 msgr2=0x7fd844070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:43.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd84406e730 0x7fd844070bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd858100bf0 tx=0x7fd854005f90 comp rx=0 tx=0).stop 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 msgr2=0x7fd858195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858195b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8480055a0 tx=0x7fd8480055d0 comp rx=0 tx=0).stop 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 shutdown_connections 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd84406e730 0x7fd844070bf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd858100d90 0x7fd858195b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 --2- 172.21.15.103:0/3529601664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8580ffb90 0x7fd858195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 >> 172.21.15.103:0/3529601664 conn(0x7fd8580fb320 msgr2=0x7fd858104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 shutdown_connections 2024-09-17T01:10:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:10:43.084+0000 7fd860126640 1 -- 172.21.15.103:0/3529601664 wait complete. 2024-09-17T01:10:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: pgmap v47: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 771 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/383431444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: from='osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:10:43.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:42 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/967318450' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:43 smithi103 ceph-mon[92733]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:43 smithi103 ceph-mon[92733]: from='osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:10:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:43 smithi103 ceph-mon[92733]: osdmap e51: 6 total, 5 up, 6 in 2024-09-17T01:10:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:43 smithi103 ceph-mon[92733]: from='osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:10:44.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:43 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3529601664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:43 smithi143 ceph-mon[80685]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:43 smithi143 ceph-mon[80685]: from='osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:10:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:43 smithi143 ceph-mon[80685]: osdmap e51: 6 total, 5 up, 6 in 2024-09-17T01:10:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:43 smithi143 ceph-mon[80685]: from='osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:10:44.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:43 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3529601664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: pgmap v49: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:10:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718] boot 2024-09-17T01:10:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:10:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:10:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: pgmap v49: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: osd.0 [v2:172.21.15.103:6802/175809718,v1:172.21.15.103:6803/175809718] boot 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:45.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:10:46.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:45 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:10:46.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:45 smithi143 ceph-mon[80685]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:10:46.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:45 smithi143 ceph-mon[80685]: osdmap e53: 6 total, 6 up, 6 in 2024-09-17T01:10:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:45 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:10:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:45 smithi103 ceph-mon[92733]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:10:46.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:45 smithi103 ceph-mon[92733]: osdmap e53: 6 total, 6 up, 6 in 2024-09-17T01:10:47.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:46 smithi103 ceph-mon[92733]: pgmap v52: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:46 smithi143 ceph-mon[80685]: pgmap v52: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:48 smithi103 ceph-mon[92733]: pgmap v53: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:48 smithi143 ceph-mon[80685]: pgmap v53: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 40/225 objects degraded (17.778%) 2024-09-17T01:10:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:49 smithi103 ceph-mon[92733]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded) 2024-09-17T01:10:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:49 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:10:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:49 smithi103 ceph-mon[92733]: mgrmap e37: smithi103.efjaur(active, since 92s), standbys: smithi143.sxhocv 2024-09-17T01:10:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:49 smithi143 ceph-mon[80685]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded) 2024-09-17T01:10:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:49 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:10:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:49 smithi143 ceph-mon[80685]: mgrmap e37: smithi103.efjaur(active, since 92s), standbys: smithi143.sxhocv 2024-09-17T01:10:51.232 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:50 smithi143 ceph-mon[80685]: pgmap v54: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 441 B/s wr, 3 op/s 2024-09-17T01:10:51.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:50 smithi103 ceph-mon[92733]: pgmap v54: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 441 B/s wr, 3 op/s 2024-09-17T01:10:53.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:52 smithi143 ceph-mon[80685]: pgmap v55: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-17T01:10:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:52 smithi103 ceph-mon[92733]: pgmap v55: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-17T01:10:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:54 smithi143 ceph-mon[80685]: pgmap v56: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 515 B/s rd, 309 B/s wr, 1 op/s 2024-09-17T01:10:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:54 smithi103 ceph-mon[92733]: pgmap v56: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 515 B/s rd, 309 B/s wr, 1 op/s 2024-09-17T01:10:57.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:56 smithi143 ceph-mon[80685]: pgmap v57: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 935 B/s rd, 280 B/s wr, 1 op/s 2024-09-17T01:10:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:56 smithi103 ceph-mon[92733]: pgmap v57: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 935 B/s rd, 280 B/s wr, 1 op/s 2024-09-17T01:10:59.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:58 smithi103 ceph-mon[92733]: pgmap v58: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T01:10:59.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:58 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:10:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:58 smithi143 ceph-mon[80685]: pgmap v58: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T01:10:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:58 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:00.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:10:59 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:11:00.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:10:59 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:11:01.169 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:00 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:11:01.169 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:00 smithi103 ceph-mon[92733]: Upgrade: osd.1 is safe to restart 2024-09-17T01:11:01.169 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:00 smithi103 ceph-mon[92733]: pgmap v59: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T01:11:01.170 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:01.170 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:11:01.170 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:01.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:00 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:11:01.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:00 smithi143 ceph-mon[80685]: Upgrade: osd.1 is safe to restart 2024-09-17T01:11:01.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:00 smithi143 ceph-mon[80685]: pgmap v59: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-17T01:11:01.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:01.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:11:01.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:02.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:01 smithi103 ceph-mon[92733]: Upgrade: Updating osd.1 2024-09-17T01:11:02.167 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:01 smithi103 ceph-mon[92733]: Deploying daemon osd.1 on smithi103 2024-09-17T01:11:02.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:01 smithi143 ceph-mon[80685]: Upgrade: Updating osd.1 2024-09-17T01:11:02.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:01 smithi143 ceph-mon[80685]: Deploying daemon osd.1 on smithi103 2024-09-17T01:11:03.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:02 smithi103 ceph-mon[92733]: pgmap v60: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:11:03.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:03.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:02 smithi143 ceph-mon[80685]: pgmap v60: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:11:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:03.628 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:03 smithi103 systemd[1]: Stopping Ceph osd.1 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:11:03.891 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:03 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[54648]: 2024-09-17T01:11:03.628+0000 7f8715d61640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:11:03.891 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:03 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[54648]: 2024-09-17T01:11:03.628+0000 7f8715d61640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-17T01:11:03.892 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:03 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[54648]: 2024-09-17T01:11:03.628+0000 7f8715d61640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:11:04.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:03 smithi103 ceph-mon[92733]: osd.1 marked itself down and dead 2024-09-17T01:11:04.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:03 smithi143 ceph-mon[80685]: osd.1 marked itself down and dead 2024-09-17T01:11:04.511 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:04 smithi103 podman[106215]: 2024-09-17 01:11:04.239023626 +0000 UTC m=+0.704522367 container died 6fcce5e20263e62d925266e9c0af11696aea80a10cff6649ec2f883dd1264d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=reef-19e2a2b) 2024-09-17T01:11:04.886 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:04 smithi103 podman[106215]: 2024-09-17 01:11:04.620823545 +0000 UTC m=+1.086322286 container cleanup 6fcce5e20263e62d925266e9c0af11696aea80a10cff6649ec2f883dd1264d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=reef-19e2a2b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T01:11:04.887 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:04 smithi103 bash[106215]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:11:05.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:04 smithi103 ceph-mon[92733]: pgmap v61: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:11:05.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:04 smithi103 ceph-mon[92733]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:05.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:04 smithi103 ceph-mon[92733]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:11:05.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:04 smithi103 podman[106243]: 2024-09-17 01:11:04.889075983 +0000 UTC m=+0.650775385 container remove 6fcce5e20263e62d925266e9c0af11696aea80a10cff6649ec2f883dd1264d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-17T01:11:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:04 smithi143 ceph-mon[80685]: pgmap v61: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:11:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:04 smithi143 ceph-mon[80685]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:04 smithi143 ceph-mon[80685]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:11:05.524 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:05 smithi103 podman[106329]: 2024-09-17 01:11:05.1246388 +0000 UTC m=+0.016218201 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:11:05.524 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:05 smithi103 podman[106329]: 2024-09-17 01:11:05.231714393 +0000 UTC m=+0.123293774 container create 600c4481343b532e10abbc3dcce64973cb51925fbe1c244727041ca34befdb21 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:11:05.524 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:05 smithi103 podman[106329]: 2024-09-17 01:11:05.442926537 +0000 UTC m=+0.334505936 container init 600c4481343b532e10abbc3dcce64973cb51925fbe1c244727041ca34befdb21 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:11:05.524 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:05 smithi103 podman[106329]: 2024-09-17 01:11:05.446230813 +0000 UTC m=+0.337810204 container start 600c4481343b532e10abbc3dcce64973cb51925fbe1c244727041ca34befdb21 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:11:05.524 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:05 smithi103 podman[106329]: 2024-09-17 01:11:05.525991233 +0000 UTC m=+0.417570615 container attach 600c4481343b532e10abbc3dcce64973cb51925fbe1c244727041ca34befdb21 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:11:05.903 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:05 smithi103 podman[106329]: 2024-09-17 01:11:05.633667472 +0000 UTC m=+0.525246861 container died 600c4481343b532e10abbc3dcce64973cb51925fbe1c244727041ca34befdb21 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-17T01:11:06.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:05 smithi103 ceph-mon[92733]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:11:06.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:05 smithi143 ceph-mon[80685]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:11:06.650 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 podman[106352]: 2024-09-17 01:11:06.213123396 +0000 UTC m=+0.572736377 container remove 600c4481343b532e10abbc3dcce64973cb51925fbe1c244727041ca34befdb21 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:11:06.651 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T01:11:06.651 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 systemd[1]: Stopped Ceph osd.1 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:11:06.651 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 5.006s CPU time. 2024-09-17T01:11:06.651 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 systemd[1]: Starting Ceph osd.1 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:11:06.905 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 podman[106452]: 2024-09-17 01:11:06.555527899 +0000 UTC m=+0.016567882 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:11:06.905 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 podman[106452]: 2024-09-17 01:11:06.714664137 +0000 UTC m=+0.175704112 container create f587c5a415ad8daf1143c1d1ad86026f14983ae729a69eb3cce47a00eb414396 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:11:07.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:06 smithi103 ceph-mon[92733]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 podman[106452]: 2024-09-17 01:11:06.927740128 +0000 UTC m=+0.388780109 container init f587c5a415ad8daf1143c1d1ad86026f14983ae729a69eb3cce47a00eb414396 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:06 smithi103 podman[106452]: 2024-09-17 01:11:06.931045306 +0000 UTC m=+0.392085283 container start f587c5a415ad8daf1143c1d1ad86026f14983ae729a69eb3cce47a00eb414396 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 podman[106452]: 2024-09-17 01:11:07.002718115 +0000 UTC m=+0.463758113 container attach f587c5a415ad8daf1143c1d1ad86026f14983ae729a69eb3cce47a00eb414396 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 bash[106452]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:07.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 bash[106452]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:06 smithi143 ceph-mon[80685]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:11:08.083 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:11:08.083 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 bash[106452]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:11:08.083 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:11:08.083 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:07 smithi103 bash[106452]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:11:08.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:11:08.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 bash[106452]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:11:08.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:11:08.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 bash[106452]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 bash[106452]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 bash[106452]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate[106467]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 bash[106452]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:11:08.428 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 podman[106452]: 2024-09-17 01:11:08.113207619 +0000 UTC m=+1.574247592 container died f587c5a415ad8daf1143c1d1ad86026f14983ae729a69eb3cce47a00eb414396 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:11:09.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:08 smithi103 ceph-mon[92733]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-17T01:11:09.028 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 podman[106612]: 2024-09-17 01:11:08.715055791 +0000 UTC m=+0.590659768 container remove f587c5a415ad8daf1143c1d1ad86026f14983ae729a69eb3cce47a00eb414396 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:11:09.028 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 podman[106672]: 2024-09-17 01:11:08.824344099 +0000 UTC m=+0.016112011 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:11:09.028 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:08 smithi103 podman[106672]: 2024-09-17 01:11:08.93287383 +0000 UTC m=+0.124641725 container create 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:11:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:08 smithi143 ceph-mon[80685]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-17T01:11:09.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:09 smithi103 podman[106672]: 2024-09-17 01:11:09.127171535 +0000 UTC m=+0.318939431 container init 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T01:11:09.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:09 smithi103 podman[106672]: 2024-09-17 01:11:09.130305849 +0000 UTC m=+0.322073742 container start 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T01:11:09.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:09 smithi103 ceph-osd[106691]: -- 172.21.15.103:0/1571650640 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d0491c1e0 con 0x555d03b31c00 2024-09-17T01:11:09.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:09 smithi103 bash[106672]: 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf 2024-09-17T01:11:09.427 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:09 smithi103 systemd[1]: Started Ceph osd.1 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:11:10.665 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:10.666 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:10.666 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:10.666 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:10 smithi103 ceph-mon[92733]: pgmap v66: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:10.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:10.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:10.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:10.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:10 smithi143 ceph-mon[80685]: pgmap v66: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:10.927 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:10 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[106687]: 2024-09-17T01:11:10.759+0000 7f946eac4640 -1 Falling back to public interface 2024-09-17T01:11:11.591 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:11 smithi103 ceph-mon[92733]: Health check failed: Degraded data redundancy: 28/225 objects degraded (12.444%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:11.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:11 smithi143 ceph-mon[80685]: Health check failed: Degraded data redundancy: 28/225 objects degraded (12.444%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:12.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:12 smithi103 ceph-mon[92733]: pgmap v67: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:12.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:12 smithi143 ceph-mon[80685]: pgmap v67: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 -- 172.21.15.103:0/2806275667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040ffc30 msgr2=0x7f01041000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 --2- 172.21.15.103:0/2806275667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040ffc30 0x7f01041000b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009880 tx=0x7f00f802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 -- 172.21.15.103:0/2806275667 shutdown_connections 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 --2- 172.21.15.103:0/2806275667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040ffc30 0x7f01041000b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 --2- 172.21.15.103:0/2806275667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01040fea30 0x7f01040fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 -- 172.21.15.103:0/2806275667 >> 172.21.15.103:0/2806275667 conn(0x7f01040fa1c0 msgr2=0x7f01040fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 -- 172.21.15.103:0/2806275667 shutdown_connections 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.175+0000 7f010a455640 1 -- 172.21.15.103:0/2806275667 wait complete. 2024-09-17T01:11:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f010a455640 1 Processor -- start 2024-09-17T01:11:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f010a455640 1 -- start start 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f010a455640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 0x7f0104068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f010a455640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01040ffc30 0x7f010419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f010a455640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010419a970 con 0x7f01040fea30 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f010a455640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010419aab0 con 0x7f01040ffc30 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f0103fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 0x7f0104068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.176+0000 7f0103fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 0x7f0104068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33492/0 (socket says 172.21.15.103:33492) 2024-09-17T01:11:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f0103fff640 1 -- 172.21.15.103:0/2619840359 learned_addr learned my addr 172.21.15.103:0/2619840359 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f01037fe640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01040ffc30 0x7f010419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f0103fff640 1 -- 172.21.15.103:0/2619840359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01040ffc30 msgr2=0x7f010419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f0103fff640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01040ffc30 0x7f010419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f0103fff640 1 -- 172.21.15.103:0/2619840359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8009560 con 0x7f01040fea30 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f0103fff640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 0x7f0104068740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00f400d6f0 tx=0x7f00f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f4009a30 con 0x7f01040fea30 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00f4009b90 con 0x7f01040fea30 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010419ad60 con 0x7f01040fea30 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f4003e70 con 0x7f01040fea30 2024-09-17T01:11:13.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.177+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010419b300 con 0x7f01040fea30 2024-09-17T01:11:13.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.179+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01040fee30 con 0x7f01040fea30 2024-09-17T01:11:13.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.179+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f00f4009d00 con 0x7f01040fea30 2024-09-17T01:11:13.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.179+0000 7f01017fa640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f00ec06e590 0x7f00ec070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.180+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f00f408e120 con 0x7f01040fea30 2024-09-17T01:11:13.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.180+0000 7f01037fe640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f00ec06e590 0x7f00ec070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.180+0000 7f01037fe640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f00ec06e590 0x7f00ec070a50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00f8000c00 tx=0x7f00f80314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:13.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.184+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f00f4057320 con 0x7f01040fea30 2024-09-17T01:11:13.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.368+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f010402c540 con 0x7f00ec06e590 2024-09-17T01:11:13.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.369+0000 7f01017fa640 1 -- 172.21.15.103:0/2619840359 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f010402c540 con 0x7f00ec06e590 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f00ec06e590 msgr2=0x7f00ec070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f00ec06e590 0x7f00ec070a50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00f8000c00 tx=0x7f00f80314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 msgr2=0x7f0104068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 0x7f0104068740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00f400d6f0 tx=0x7f00f400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 shutdown_connections 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f00ec06e590 0x7f00ec070a50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01040ffc30 0x7f010419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 --2- 172.21.15.103:0/2619840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01040fea30 0x7f0104068740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 >> 172.21.15.103:0/2619840359 conn(0x7f01040fa1c0 msgr2=0x7f0104103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:13.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 shutdown_connections 2024-09-17T01:11:13.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.372+0000 7f010a455640 1 -- 172.21.15.103:0/2619840359 wait complete. 2024-09-17T01:11:13.380 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:11:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 -- 172.21.15.103:0/3663993450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 msgr2=0x7f25d80fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 --2- 172.21.15.103:0/3663993450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d80fff60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009c20 tx=0x7f25d002a970 comp rx=0 tx=0).stop 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 -- 172.21.15.103:0/3663993450 shutdown_connections 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 --2- 172.21.15.103:0/3663993450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25d8100d60 0x7f25d81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 --2- 172.21.15.103:0/3663993450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d80fff60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 -- 172.21.15.103:0/3663993450 >> 172.21.15.103:0/3663993450 conn(0x7f25d80fb2f0 msgr2=0x7f25d80fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 -- 172.21.15.103:0/3663993450 shutdown_connections 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.474+0000 7f25dcd22640 1 -- 172.21.15.103:0/3663993450 wait complete. 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25dcd22640 1 Processor -- start 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25dcd22640 1 -- start start 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25dcd22640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d8195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25dcd22640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25d8100d60 0x7f25d8195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25dcd22640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81961a0 con 0x7f25d80ffb60 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25dcd22640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8196310 con 0x7f25d8100d60 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d8195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d8195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33520/0 (socket says 172.21.15.103:33520) 2024-09-17T01:11:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.475+0000 7f25d659c640 1 -- 172.21.15.103:0/2187220939 learned_addr learned my addr 172.21.15.103:0/2187220939 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.476+0000 7f25d5d9b640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25d8100d60 0x7f25d8195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.476+0000 7f25d659c640 1 -- 172.21.15.103:0/2187220939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25d8100d60 msgr2=0x7f25d8195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.476+0000 7f25d659c640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25d8100d60 0x7f25d8195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.476+0000 7f25d659c640 1 -- 172.21.15.103:0/2187220939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0009900 con 0x7f25d80ffb60 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.476+0000 7f25d659c640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d8195690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f25d002f5f0 tx=0x7f25d002f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.477+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d0030670 con 0x7f25d80ffb60 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.477+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d819ace0 con 0x7f25d80ffb60 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.477+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d819b200 con 0x7f25d80ffb60 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.477+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25d0030c90 con 0x7f25d80ffb60 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.477+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d003a660 con 0x7f25d80ffb60 2024-09-17T01:11:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.478+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b8005280 con 0x7f25d80ffb60 2024-09-17T01:11:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.478+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f25d000a040 con 0x7f25d80ffb60 2024-09-17T01:11:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.479+0000 7f25c77fe640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f25c006e640 0x7f25c0070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.479+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f25d002c040 con 0x7f25d80ffb60 2024-09-17T01:11:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.479+0000 7f25d5d9b640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f25c006e640 0x7f25c0070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.481+0000 7f25d5d9b640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f25c006e640 0x7f25c0070b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25d8196b40 tx=0x7f25cc005f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:13.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.485+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f25d007c5c0 con 0x7f25d80ffb60 2024-09-17T01:11:13.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.673+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25b8000bf0 con 0x7f25c006e640 2024-09-17T01:11:13.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.675+0000 7f25c77fe640 1 -- 172.21.15.103:0/2187220939 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f25b8000bf0 con 0x7f25c006e640 2024-09-17T01:11:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f25c006e640 msgr2=0x7f25c0070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f25c006e640 0x7f25c0070b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25d8196b40 tx=0x7f25cc005f90 comp rx=0 tx=0).stop 2024-09-17T01:11:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 msgr2=0x7f25d8195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d8195690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f25d002f5f0 tx=0x7f25d002f620 comp rx=0 tx=0).stop 2024-09-17T01:11:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 shutdown_connections 2024-09-17T01:11:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f25c006e640 0x7f25c0070b00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25d8100d60 0x7f25d8195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 --2- 172.21.15.103:0/2187220939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25d80ffb60 0x7f25d8195690 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 >> 172.21.15.103:0/2187220939 conn(0x7f25d80fb2f0 msgr2=0x7f25d8103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 shutdown_connections 2024-09-17T01:11:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.677+0000 7f25dcd22640 1 -- 172.21.15.103:0/2187220939 wait complete. 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 -- 172.21.15.103:0/345105944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c100e20 msgr2=0x7fcf0c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/345105944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c100e20 0x7fcf0c1012a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009880 tx=0x7fcef402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 -- 172.21.15.103:0/345105944 shutdown_connections 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/345105944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c100e20 0x7fcf0c1012a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/345105944 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c0fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 -- 172.21.15.103:0/345105944 >> 172.21.15.103:0/345105944 conn(0x7fcf0c0f99b0 msgr2=0x7fcf0c0fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 -- 172.21.15.103:0/345105944 shutdown_connections 2024-09-17T01:11:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.769+0000 7fcf10e9b640 1 -- 172.21.15.103:0/345105944 wait complete. 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf10e9b640 1 Processor -- start 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf10e9b640 1 -- start start 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf10e9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf10e9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf0c100e20 0x7fcf0c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf10e9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c196090 con 0x7fcf0c0fde40 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf10e9b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c196200 con 0x7fcf0c100e20 2024-09-17T01:11:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf0a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf0a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c195580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33540/0 (socket says 172.21.15.103:33540) 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf0a59c640 1 -- 172.21.15.103:0/3117046476 learned_addr learned my addr 172.21.15.103:0/3117046476 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.770+0000 7fcf03fff640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf0c100e20 0x7fcf0c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf0a59c640 1 -- 172.21.15.103:0/3117046476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf0c100e20 msgr2=0x7fcf0c195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf0a59c640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf0c100e20 0x7fcf0c195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf0a59c640 1 -- 172.21.15.103:0/3117046476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4009560 con 0x7fcf0c0fde40 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf0a59c640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c195580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00d900 tx=0x7fcefc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcefc009c00 con 0x7fcf0c0fde40 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcefc009d60 con 0x7fcf0c0fde40 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c19aca0 con 0x7fcf0c0fde40 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcefc00f7b0 con 0x7fcf0c0fde40 2024-09-17T01:11:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.771+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c19b1c0 con 0x7fcf0c0fde40 2024-09-17T01:11:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.773+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c0fe240 con 0x7fcf0c0fde40 2024-09-17T01:11:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.773+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcefc010460 con 0x7fcf0c0fde40 2024-09-17T01:11:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.773+0000 7fcf037fe640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcef806e5f0 0x7fcef8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.773+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcefc08ea00 con 0x7fcf0c0fde40 2024-09-17T01:11:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.773+0000 7fcf03fff640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcef806e5f0 0x7fcef8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.774+0000 7fcf03fff640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcef806e5f0 0x7fcef8070ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000c00 tx=0x7fcef40314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.778+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcefc057b50 con 0x7fcf0c0fde40 2024-09-17T01:11:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.964+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf0c105770 con 0x7fcef806e5f0 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.974+0000 7fcf037fe640 1 -- 172.21.15.103:0/3117046476 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fcf0c105770 con 0x7fcef806e5f0 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (10m) 34s ago 12m 24.5M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (12m) 34s ago 12m 8254k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (11m) 56s ago 11m 7856k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (64s) 34s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:11:13.973 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (60s) 56s ago 11m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (10m) 34s ago 11m 86.1M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (6m) 34s ago 6m 149M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (6m) 34s ago 6m 91.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (6m) 56s ago 6m 15.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (6m) 56s ago 6m 16.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (3m) 34s ago 13m 495M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (2m) 56s ago 11m 438M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (2m) 34s ago 13m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (103s) 56s ago 11m 34.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (12m) 34s ago 12m 15.9M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (11m) 56s ago 11m 16.2M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (39s) 34s ago 10m 12.1M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:11:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 starting - - - 1216M 2024-09-17T01:11:13.975 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (9m) 34s ago 9m 209M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1ecaa3bdb0a4 2024-09-17T01:11:13.975 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (9m) 56s ago 9m 285M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:11:13.975 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (8m) 56s ago 8m 269M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:11:13.975 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (8m) 56s ago 8m 231M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:11:13.975 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (2m) 34s ago 11m 58.6M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcef806e5f0 msgr2=0x7fcef8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcef806e5f0 0x7fcef8070ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000c00 tx=0x7fcef40314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 msgr2=0x7fcf0c195580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c195580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00d900 tx=0x7fcefc00ddc0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 shutdown_connections 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcef806e5f0 0x7fcef8070ab0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf0c100e20 0x7fcf0c195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 --2- 172.21.15.103:0/3117046476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0c0fde40 0x7fcf0c195580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 >> 172.21.15.103:0/3117046476 conn(0x7fcf0c0f99b0 msgr2=0x7fcf0c104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 shutdown_connections 2024-09-17T01:11:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:13.976+0000 7fcf10e9b640 1 -- 172.21.15.103:0/3117046476 wait complete. 2024-09-17T01:11:14.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/4032308158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 msgr2=0x7fa2c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/4032308158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c41029b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00098b0 tx=0x7fa2c002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/4032308158 shutdown_connections 2024-09-17T01:11:14.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/4032308158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 0x7fa2c41052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/4032308158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c41029b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/4032308158 >> 172.21.15.103:0/4032308158 conn(0x7fa2c40fa1c0 msgr2=0x7fa2c40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/4032308158 shutdown_connections 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.059+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/4032308158 wait complete. 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2cc2f7640 1 Processor -- start 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2cc2f7640 1 -- start start 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2cc2f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c40fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2cc2f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 0x7fa2c40fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2cc2f7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c40feab0 con 0x7fa2c41005c0 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2cc2f7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c40fec20 con 0x7fa2c4102ef0 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2ca093640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c40fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2ca093640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c40fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33556/0 (socket says 172.21.15.103:33556) 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2ca093640 1 -- 172.21.15.103:0/3539987175 learned_addr learned my addr 172.21.15.103:0/3539987175 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.060+0000 7fa2c9892640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 0x7fa2c40fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2ca093640 1 -- 172.21.15.103:0/3539987175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 msgr2=0x7fa2c40fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2ca093640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 0x7fa2c40fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2ca093640 1 -- 172.21.15.103:0/3539987175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009560 con 0x7fa2c41005c0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2c9892640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 0x7fa2c40fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2ca093640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c40fff20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006010 tx=0x7fa2c0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c0004b20 con 0x7fa2c41005c0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2c0004c80 con 0x7fa2c41005c0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c0003bf0 con 0x7fa2c41005c0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c40feea0 con 0x7fa2c41005c0 2024-09-17T01:11:14.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.061+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c40ff3c0 con 0x7fa2c41005c0 2024-09-17T01:11:14.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.062+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c41087c0 con 0x7fa2c41005c0 2024-09-17T01:11:14.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.063+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa2c0031640 con 0x7fa2c41005c0 2024-09-17T01:11:14.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.063+0000 7fa2bb7fe640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa2b006e5f0 0x7fa2b0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.063+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa2c00af960 con 0x7fa2c41005c0 2024-09-17T01:11:14.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.063+0000 7fa2c9892640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa2b006e5f0 0x7fa2b0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.064+0000 7fa2c9892640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa2b006e5f0 0x7fa2b0070ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ffca0 tx=0x7fa2b4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.067+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa2c0078ab0 con 0x7fa2c41005c0 2024-09-17T01:11:14.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.323+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa2c419da40 con 0x7fa2c41005c0 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.324+0000 7fa2bb7fe640 1 -- 172.21.15.103:0/3539987175 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fa2c007c170 con 0x7fa2c41005c0 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:11:14.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4, 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 8, 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:11:14.324 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:11:14.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa2b006e5f0 msgr2=0x7fa2b0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa2b006e5f0 0x7fa2b0070ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ffca0 tx=0x7fa2b4008040 comp rx=0 tx=0).stop 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 msgr2=0x7fa2c40fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c40fff20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006010 tx=0x7fa2c0005610 comp rx=0 tx=0).stop 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 shutdown_connections 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa2b006e5f0 0x7fa2b0070ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2c4102ef0 0x7fa2c40fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 --2- 172.21.15.103:0/3539987175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c41005c0 0x7fa2c40fff20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.326+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 >> 172.21.15.103:0/3539987175 conn(0x7fa2c40fa1c0 msgr2=0x7fa2c40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.327+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 shutdown_connections 2024-09-17T01:11:14.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.327+0000 7fa2cc2f7640 1 -- 172.21.15.103:0/3539987175 wait complete. 2024-09-17T01:11:14.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 -- 172.21.15.103:0/3787966508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb080100ee0 msgr2=0x7fb080101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 --2- 172.21.15.103:0/3787966508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb080100ee0 0x7fb080101360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb074009880 tx=0x7fb07402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 -- 172.21.15.103:0/3787966508 shutdown_connections 2024-09-17T01:11:14.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 --2- 172.21.15.103:0/3787966508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb080100ee0 0x7fb080101360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 --2- 172.21.15.103:0/3787966508 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0800fde60 0x7fb0800fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 -- 172.21.15.103:0/3787966508 >> 172.21.15.103:0/3787966508 conn(0x7fb0800f99b0 msgr2=0x7fb0800fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 -- 172.21.15.103:0/3787966508 shutdown_connections 2024-09-17T01:11:14.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.422+0000 7fb084b58640 1 -- 172.21.15.103:0/3787966508 wait complete. 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb084b58640 1 Processor -- start 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb084b58640 1 -- start start 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb084b58640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 0x7fb080100840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb084b58640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb080100ee0 0x7fb0800fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb084b58640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800ff3d0 con 0x7fb0800fde60 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb084b58640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800ff540 con 0x7fb080100ee0 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb07e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 0x7fb080100840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.423+0000 7fb07e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 0x7fb080100840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33562/0 (socket says 172.21.15.103:33562) 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07e59c640 1 -- 172.21.15.103:0/874573629 learned_addr learned my addr 172.21.15.103:0/874573629 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07dd9b640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb080100ee0 0x7fb0800fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07e59c640 1 -- 172.21.15.103:0/874573629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb080100ee0 msgr2=0x7fb0800fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07e59c640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb080100ee0 0x7fb0800fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07e59c640 1 -- 172.21.15.103:0/874573629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009560 con 0x7fb0800fde60 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07dd9b640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb080100ee0 0x7fb0800fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:11:14.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.424+0000 7fb07e59c640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 0x7fb080100840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb07000eaf0 tx=0x7fb07000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.426+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb070003970 con 0x7fb0800fde60 2024-09-17T01:11:14.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.426+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800ff820 con 0x7fb0800fde60 2024-09-17T01:11:14.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.426+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08019d610 con 0x7fb0800fde60 2024-09-17T01:11:14.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.426+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb070004020 con 0x7fb0800fde60 2024-09-17T01:11:14.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.426+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb070010660 con 0x7fb0800fde60 2024-09-17T01:11:14.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.428+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb060005280 con 0x7fb0800fde60 2024-09-17T01:11:14.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.429+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb070004600 con 0x7fb0800fde60 2024-09-17T01:11:14.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.429+0000 7fb06f7fe640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb06806e5f0 0x7fb068070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.430+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb070014070 con 0x7fb0800fde60 2024-09-17T01:11:14.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.430+0000 7fb07dd9b640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb06806e5f0 0x7fb068070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.430+0000 7fb07dd9b640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb06806e5f0 0x7fb068070ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb074000c00 tx=0x7fb0740314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.437+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb070058480 con 0x7fb0800fde60 2024-09-17T01:11:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.652+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb060005800 con 0x7fb0800fde60 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.653+0000 7fb06f7fe640 1 -- 172.21.15.103:0/874573629 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7fb07005bb40 con 0x7fb0800fde60 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:11:14.652 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:11:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:11:14.654 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:14.655 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:14.656 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:14.656 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:14.656 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:11:14.656 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:14.656 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:14.656 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb06806e5f0 msgr2=0x7fb068070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb06806e5f0 0x7fb068070ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb074000c00 tx=0x7fb0740314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 msgr2=0x7fb080100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 0x7fb080100840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb07000eaf0 tx=0x7fb07000c2d0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 shutdown_connections 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb06806e5f0 0x7fb068070ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb080100ee0 0x7fb0800fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 --2- 172.21.15.103:0/874573629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0800fde60 0x7fb080100840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.655+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 >> 172.21.15.103:0/874573629 conn(0x7fb0800f99b0 msgr2=0x7fb0800fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.656+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 shutdown_connections 2024-09-17T01:11:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.656+0000 7fb084b58640 1 -- 172.21.15.103:0/874573629 wait complete. 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 -- 172.21.15.103:0/3807270549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874102f50 msgr2=0x7ff874105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3807270549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874102f50 0x7ff874105340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009880 tx=0x7ff85c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 -- 172.21.15.103:0/3807270549 shutdown_connections 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3807270549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874102f50 0x7ff874105340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3807270549 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff874100620 0x7ff874102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 -- 172.21.15.103:0/3807270549 >> 172.21.15.103:0/3807270549 conn(0x7ff8740fa1c0 msgr2=0x7ff8740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 -- 172.21.15.103:0/3807270549 shutdown_connections 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.760+0000 7ff8792a2640 1 -- 172.21.15.103:0/3807270549 wait complete. 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.761+0000 7ff8792a2640 1 Processor -- start 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.761+0000 7ff8792a2640 1 -- start start 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.761+0000 7ff8792a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 0x7ff8740fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.761+0000 7ff8792a2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff874102f50 0x7ff8740fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.761+0000 7ff8792a2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740feb10 con 0x7ff874100620 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.761+0000 7ff8792a2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740fec80 con 0x7ff874102f50 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 0x7ff8740fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 0x7ff8740fff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33582/0 (socket says 172.21.15.103:33582) 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 -- 172.21.15.103:0/3851602499 learned_addr learned my addr 172.21.15.103:0/3851602499 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff8727fc640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff874102f50 0x7ff8740fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 -- 172.21.15.103:0/3851602499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff874102f50 msgr2=0x7ff8740fe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff874102f50 0x7ff8740fe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 -- 172.21.15.103:0/3851602499 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c009560 con 0x7ff874100620 2024-09-17T01:11:14.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff872ffd640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 0x7ff8740fff80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff86400e970 tx=0x7ff86400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86400cc90 con 0x7ff874100620 2024-09-17T01:11:14.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8740fef60 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff86400cdf0 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff864010430 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.762+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87419d650 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.763+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8741086d0 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.764+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff8640046c0 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.765+0000 7ff86bfff640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff86006e5f0 0x7ff860070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.765+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff864014070 con 0x7ff874100620 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.765+0000 7ff8727fc640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff86006e5f0 0x7ff860070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.765+0000 7ff8727fc640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff86006e5f0 0x7ff860070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff85c006010 tx=0x7ff85c0314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.769+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff864057cf0 con 0x7ff874100620 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: pgmap v68: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3539987175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:14.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:14 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/874573629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:11:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.961+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff874103a10 con 0x7ff86006e5f0 2024-09-17T01:11:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.963+0000 7ff86bfff640 1 -- 172.21.15.103:0/3851602499 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff874103a10 con 0x7ff86006e5f0 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:11:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:11:14.963 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff86006e5f0 msgr2=0x7ff860070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff86006e5f0 0x7ff860070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff85c006010 tx=0x7ff85c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 msgr2=0x7ff8740fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 0x7ff8740fff80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff86400e970 tx=0x7ff86400ed70 comp rx=0 tx=0).stop 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 shutdown_connections 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff86006e5f0 0x7ff860070ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff874102f50 0x7ff8740fe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 --2- 172.21.15.103:0/3851602499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874100620 0x7ff8740fff80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 >> 172.21.15.103:0/3851602499 conn(0x7ff8740fa1c0 msgr2=0x7ff8740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 shutdown_connections 2024-09-17T01:11:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:14.965+0000 7ff8792a2640 1 -- 172.21.15.103:0/3851602499 wait complete. 2024-09-17T01:11:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.047+0000 7f5b644bd640 1 -- 172.21.15.103:0/641307252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 msgr2=0x7f5b5c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.047+0000 7f5b644bd640 1 --2- 172.21.15.103:0/641307252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c1011e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009880 tx=0x7f5b5802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.047+0000 7f5b644bd640 1 -- 172.21.15.103:0/641307252 shutdown_connections 2024-09-17T01:11:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.047+0000 7f5b644bd640 1 --2- 172.21.15.103:0/641307252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c1011e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.047+0000 7f5b644bd640 1 --2- 172.21.15.103:0/641307252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b5c0ffb60 0x7f5b5c0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.047+0000 7f5b644bd640 1 -- 172.21.15.103:0/641307252 >> 172.21.15.103:0/641307252 conn(0x7f5b5c0fb2f0 msgr2=0x7f5b5c0fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 -- 172.21.15.103:0/641307252 shutdown_connections 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 -- 172.21.15.103:0/641307252 wait complete. 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 Processor -- start 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 -- start start 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b5c0ffb60 0x7f5b5c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c072de0 con 0x7f5b5c100d60 2024-09-17T01:11:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b644bd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c072f50 con 0x7f5b5c0ffb60 2024-09-17T01:11:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b61a58640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b61a58640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33598/0 (socket says 172.21.15.103:33598) 2024-09-17T01:11:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.048+0000 7f5b61a58640 1 -- 172.21.15.103:0/418752570 learned_addr learned my addr 172.21.15.103:0/418752570 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b62259640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b5c0ffb60 0x7f5b5c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b61a58640 1 -- 172.21.15.103:0/418752570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b5c0ffb60 msgr2=0x7f5b5c074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b61a58640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b5c0ffb60 0x7f5b5c074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b61a58640 1 -- 172.21.15.103:0/418752570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009560 con 0x7f5b5c100d60 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b61a58640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c0728a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b580054f0 tx=0x7f5b58005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b58004aa0 con 0x7f5b5c100d60 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b58004c00 con 0x7f5b5c100d60 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c0731d0 con 0x7f5b5c100d60 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b58003ac0 con 0x7f5b5c100d60 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.049+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c19d660 con 0x7f5b5c100d60 2024-09-17T01:11:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.050+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c0fff60 con 0x7f5b5c100d60 2024-09-17T01:11:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.051+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5b58031c70 con 0x7f5b5c100d60 2024-09-17T01:11:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.051+0000 7f5b537fe640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f5b4806e5f0 0x7f5b48070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.051+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5b580af800 con 0x7f5b5c100d60 2024-09-17T01:11:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.052+0000 7f5b62259640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f5b4806e5f0 0x7f5b48070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.052+0000 7f5b62259640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f5b4806e5f0 0x7f5b48070ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c005fd0 tx=0x7f5b4c00b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:15.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.056+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5b58078a00 con 0x7f5b5c100d60 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: pgmap v68: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3539987175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:14 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/874573629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:11:15.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.317+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b5c18f700 con 0x7f5b5c100d60 2024-09-17T01:11:15.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.317+0000 7f5b537fe640 1 -- 172.21.15.103:0/418752570 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+936 (secure 0 0 0) 0x7f5b5807c0c0 con 0x7f5b5c100d60 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 28/225 objects degraded (12.444%), 12 pgs degraded 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: osd.1 (root=default,host=smithi103) is down 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/225 objects degraded (12.444%), 12 pgs degraded 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-17T01:11:15.318 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-17T01:11:15.319 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-17T01:11:15.319 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-17T01:11:15.319 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.320+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f5b4806e5f0 msgr2=0x7f5b48070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.320+0000 7f5b644bd640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f5b4806e5f0 0x7f5b48070ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c005fd0 tx=0x7f5b4c00b390 comp rx=0 tx=0).stop 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.320+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 msgr2=0x7f5b5c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.320+0000 7f5b644bd640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c0728a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b580054f0 tx=0x7f5b58005520 comp rx=0 tx=0).stop 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.320+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 shutdown_connections 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.321+0000 7f5b644bd640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f5b4806e5f0 0x7f5b48070ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.321+0000 7f5b644bd640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5c100d60 0x7f5b5c0728a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.321+0000 7f5b644bd640 1 --2- 172.21.15.103:0/418752570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b5c0ffb60 0x7f5b5c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.321+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 >> 172.21.15.103:0/418752570 conn(0x7f5b5c0fb2f0 msgr2=0x7f5b5c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.321+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 shutdown_connections 2024-09-17T01:11:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:15.321+0000 7f5b644bd640 1 -- 172.21.15.103:0/418752570 wait complete. 2024-09-17T01:11:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:15 smithi103 ceph-mon[92733]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:15 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:15 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:15 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/418752570' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:15 smithi143 ceph-mon[80685]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:15 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:15 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:15 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/418752570' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:16.817 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:16 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[106687]: 2024-09-17T01:11:16.531+0000 7f946eac4640 -1 osd.1 53 log_to_monitors true 2024-09-17T01:11:17.078 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:16 smithi103 ceph-mon[92733]: pgmap v69: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:17.078 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:16 smithi103 ceph-mon[92733]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:11:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:16 smithi143 ceph-mon[80685]: pgmap v69: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:16 smithi143 ceph-mon[80685]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:11:18.342 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[106687]: 2024-09-17T01:11:18.115+0000 7f9462856640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:11:18.342 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:11:18.342 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: osdmap e56: 6 total, 5 up, 6 in 2024-09-17T01:11:18.343 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:11:18.343 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: pgmap v71: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:18.343 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:18.343 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:18.343 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:18 smithi103 ceph-mon[92733]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' 2024-09-17T01:11:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:11:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: osdmap e56: 6 total, 5 up, 6 in 2024-09-17T01:11:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:11:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: pgmap v71: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/225 objects degraded (12.444%) 2024-09-17T01:11:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:18.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:18 smithi143 ceph-mon[80685]: from='osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086]' entity='osd.1' 2024-09-17T01:11:20.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:20.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:11:20.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:20.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086] boot 2024-09-17T01:11:20.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:11:20.009 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:11:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: osd.1 [v2:172.21.15.103:6810/3659354086,v1:172.21.15.103:6811/3659354086] boot 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:11:20.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:11:21.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:20 smithi143 ceph-mon[80685]: pgmap v73: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 28/225 objects degraded (12.444%) 2024-09-17T01:11:21.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:20 smithi143 ceph-mon[80685]: osdmap e58: 6 total, 6 up, 6 in 2024-09-17T01:11:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:20 smithi103 ceph-mon[92733]: pgmap v73: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 28/225 objects degraded (12.444%) 2024-09-17T01:11:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:20 smithi103 ceph-mon[92733]: osdmap e58: 6 total, 6 up, 6 in 2024-09-17T01:11:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:22 smithi103 ceph-mon[92733]: pgmap v75: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/225 objects degraded (12.444%) 2024-09-17T01:11:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:22 smithi143 ceph-mon[80685]: pgmap v75: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/225 objects degraded (12.444%) 2024-09-17T01:11:24.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:23 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 13/225 objects degraded (5.778%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:23 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 13/225 objects degraded (5.778%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:25.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:24 smithi143 ceph-mon[80685]: pgmap v76: 65 pgs: 14 active+undersized, 6 active+undersized+degraded, 45 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 13/225 objects degraded (5.778%) 2024-09-17T01:11:25.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:24 smithi103 ceph-mon[92733]: pgmap v76: 65 pgs: 14 active+undersized, 6 active+undersized+degraded, 45 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 13/225 objects degraded (5.778%) 2024-09-17T01:11:26.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:25 smithi143 ceph-mon[80685]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/225 objects degraded (5.778%), 6 pgs degraded) 2024-09-17T01:11:26.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:25 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:11:26.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:25 smithi103 ceph-mon[92733]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/225 objects degraded (5.778%), 6 pgs degraded) 2024-09-17T01:11:26.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:25 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:11:27.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:27 smithi143 ceph-mon[80685]: pgmap v77: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-17T01:11:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:27 smithi103 ceph-mon[92733]: pgmap v77: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-17T01:11:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:29 smithi143 ceph-mon[80685]: pgmap v78: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:11:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:29 smithi103 ceph-mon[92733]: pgmap v78: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:11:31.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:31 smithi143 ceph-mon[80685]: pgmap v79: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:11:31.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:31 smithi103 ceph-mon[92733]: pgmap v79: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:11:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:33 smithi143 ceph-mon[80685]: pgmap v80: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 873 B/s rd, 0 op/s 2024-09-17T01:11:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:33 smithi103 ceph-mon[92733]: pgmap v80: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 873 B/s rd, 0 op/s 2024-09-17T01:11:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:34.125 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:35 smithi103 ceph-mon[92733]: pgmap v81: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:35 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:35 smithi103 ceph-mon[92733]: Upgrade: osd.2 is safe to restart 2024-09-17T01:11:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:35 smithi143 ceph-mon[80685]: pgmap v81: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:35 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:11:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:35 smithi143 ceph-mon[80685]: Upgrade: osd.2 is safe to restart 2024-09-17T01:11:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:36 smithi103 ceph-mon[92733]: Upgrade: Updating osd.2 2024-09-17T01:11:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:11:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:36 smithi103 ceph-mon[92733]: Deploying daemon osd.2 on smithi103 2024-09-17T01:11:36.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:36 smithi103 ceph-mon[92733]: pgmap v82: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:11:36.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:36 smithi143 ceph-mon[80685]: Upgrade: Updating osd.2 2024-09-17T01:11:36.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:36.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:11:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:36 smithi143 ceph-mon[80685]: Deploying daemon osd.2 on smithi103 2024-09-17T01:11:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:36 smithi143 ceph-mon[80685]: pgmap v82: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:11:38.763 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:38 smithi103 systemd[1]: Stopping Ceph osd.2 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:11:39.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:38 smithi103 ceph-mon[92733]: pgmap v83: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:11:39.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:38 smithi103 ceph-mon[92733]: osd.2 marked itself down and dead 2024-09-17T01:11:39.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:38 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[61974]: 2024-09-17T01:11:38.764+0000 7f9105198640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:11:39.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:38 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[61974]: 2024-09-17T01:11:38.764+0000 7f9105198640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-17T01:11:39.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:38 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[61974]: 2024-09-17T01:11:38.764+0000 7f9105198640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:11:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:38 smithi143 ceph-mon[80685]: pgmap v83: 65 pgs: 65 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:11:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:38 smithi143 ceph-mon[80685]: osd.2 marked itself down and dead 2024-09-17T01:11:39.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:39 smithi103 podman[112063]: 2024-09-17 01:11:39.407274955 +0000 UTC m=+0.747316795 container died 1ecaa3bdb0a4806ed67dddfc4387266283c21555644c8716ef3178f8402dce91 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:11:40.048 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:39 smithi103 ceph-mon[92733]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:40.048 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:39 smithi103 ceph-mon[92733]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:11:40.048 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:39 smithi103 podman[112063]: 2024-09-17 01:11:39.781461999 +0000 UTC m=+1.121503839 container cleanup 1ecaa3bdb0a4806ed67dddfc4387266283c21555644c8716ef3178f8402dce91 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:11:40.048 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:39 smithi103 bash[112063]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:11:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:39 smithi143 ceph-mon[80685]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:39 smithi143 ceph-mon[80685]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:11:40.395 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112079]: 2024-09-17 01:11:40.050173573 +0000 UTC m=+0.638656868 container remove 1ecaa3bdb0a4806ed67dddfc4387266283c21555644c8716ef3178f8402dce91 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T01:11:40.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112166]: 2024-09-17 01:11:40.30026999 +0000 UTC m=+0.015729172 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:11:40.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112166]: 2024-09-17 01:11:40.417941258 +0000 UTC m=+0.133400478 container create 514da0727855d5b84d9fbaaaf3709aae2d95ef65c1a3f416e88d8ec551eb2ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-17T01:11:40.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112166]: 2024-09-17 01:11:40.628726971 +0000 UTC m=+0.344186159 container init 514da0727855d5b84d9fbaaaf3709aae2d95ef65c1a3f416e88d8ec551eb2ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:11:40.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112166]: 2024-09-17 01:11:40.632119785 +0000 UTC m=+0.347578965 container start 514da0727855d5b84d9fbaaaf3709aae2d95ef65c1a3f416e88d8ec551eb2ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:11:41.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:40 smithi103 ceph-mon[92733]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:11:41.096 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:40 smithi103 ceph-mon[92733]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:11:41.097 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112166]: 2024-09-17 01:11:40.703606176 +0000 UTC m=+0.419065350 container attach 514da0727855d5b84d9fbaaaf3709aae2d95ef65c1a3f416e88d8ec551eb2ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-17T01:11:41.097 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:40 smithi103 podman[112166]: 2024-09-17 01:11:40.81914362 +0000 UTC m=+0.534602803 container died 514da0727855d5b84d9fbaaaf3709aae2d95ef65c1a3f416e88d8ec551eb2ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T01:11:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:40 smithi143 ceph-mon[80685]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:11:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:40 smithi143 ceph-mon[80685]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:11:41.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 podman[112189]: 2024-09-17 01:11:41.424791965 +0000 UTC m=+0.600021559 container remove 514da0727855d5b84d9fbaaaf3709aae2d95ef65c1a3f416e88d8ec551eb2ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:11:41.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T01:11:41.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 systemd[1]: Stopped Ceph osd.2 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:11:41.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.2.service: Consumed 56.772s CPU time. 2024-09-17T01:11:41.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 systemd[1]: Starting Ceph osd.2 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:11:42.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 podman[112287]: 2024-09-17 01:11:41.76484521 +0000 UTC m=+0.016125962 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:11:42.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:41 smithi103 podman[112287]: 2024-09-17 01:11:41.876053983 +0000 UTC m=+0.127334736 container create a79ca80af9b7ebe3c59b7143ac5e4bd95667de595c25f2d873f04cf1f9a4cd57 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-17T01:11:42.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 podman[112287]: 2024-09-17 01:11:42.145375325 +0000 UTC m=+0.396656084 container init a79ca80af9b7ebe3c59b7143ac5e4bd95667de595c25f2d873f04cf1f9a4cd57 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:11:42.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 podman[112287]: 2024-09-17 01:11:42.148983022 +0000 UTC m=+0.400263774 container start a79ca80af9b7ebe3c59b7143ac5e4bd95667de595c25f2d873f04cf1f9a4cd57 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T01:11:42.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 podman[112287]: 2024-09-17 01:11:42.245545242 +0000 UTC m=+0.496826007 container attach a79ca80af9b7ebe3c59b7143ac5e4bd95667de595c25f2d873f04cf1f9a4cd57 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:11:42.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:42.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 bash[112287]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:42.428 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:42.428 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:42 smithi103 bash[112287]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:42 smithi103 ceph-mon[92733]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:43.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:11:43.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:11:43.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:11:43.177 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:11:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:42 smithi143 ceph-mon[80685]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:43.630 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:11:43.630 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate[112302]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 bash[112287]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:11:43.631 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 podman[112287]: 2024-09-17 01:11:43.334359561 +0000 UTC m=+1.585640314 container died a79ca80af9b7ebe3c59b7143ac5e4bd95667de595c25f2d873f04cf1f9a4cd57 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:11:44.190 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:43 smithi103 ceph-mon[92733]: Health check failed: Degraded data redundancy: 19/225 objects degraded (8.444%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:44.191 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:43 smithi103 podman[112439]: 2024-09-17 01:11:43.933342809 +0000 UTC m=+0.593049538 container remove a79ca80af9b7ebe3c59b7143ac5e4bd95667de595c25f2d873f04cf1f9a4cd57 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:11:44.191 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 podman[112497]: 2024-09-17 01:11:44.059416156 +0000 UTC m=+0.019256593 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:11:44.191 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 podman[112497]: 2024-09-17 01:11:44.193078161 +0000 UTC m=+0.152918581 container create 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:11:44.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:43 smithi143 ceph-mon[80685]: Health check failed: Degraded data redundancy: 19/225 objects degraded (8.444%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:44.443 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 podman[112497]: 2024-09-17 01:11:44.421649311 +0000 UTC m=+0.381489735 container init 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97) 2024-09-17T01:11:44.443 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 podman[112497]: 2024-09-17 01:11:44.424887535 +0000 UTC m=+0.384727956 container start 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:11:44.927 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 ceph-osd[112517]: -- 172.21.15.103:0/3141970026 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564cc81f81e0 con 0x564cc73a5c00 2024-09-17T01:11:44.927 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 bash[112497]: 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad 2024-09-17T01:11:44.927 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:44 smithi103 systemd[1]: Started Ceph osd.2 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:11:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:44 smithi143 ceph-mon[80685]: pgmap v88: 65 pgs: 8 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 48 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 19/225 objects degraded (8.444%) 2024-09-17T01:11:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:44 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:45.302 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:44 smithi103 ceph-mon[92733]: pgmap v88: 65 pgs: 8 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 48 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 19/225 objects degraded (8.444%) 2024-09-17T01:11:45.302 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:45.303 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:45.303 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:44 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 -- 172.21.15.103:0/2290697407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101280 msgr2=0x7fa8dc101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 --2- 172.21.15.103:0/2290697407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101280 0x7fa8dc101680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009880 tx=0x7fa8d802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 -- 172.21.15.103:0/2290697407 shutdown_connections 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 --2- 172.21.15.103:0/2290697407 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc0ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 --2- 172.21.15.103:0/2290697407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101280 0x7fa8dc101680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 -- 172.21.15.103:0/2290697407 >> 172.21.15.103:0/2290697407 conn(0x7fa8dc0fb330 msgr2=0x7fa8dc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 -- 172.21.15.103:0/2290697407 shutdown_connections 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 -- 172.21.15.103:0/2290697407 wait complete. 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 Processor -- start 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 -- start start 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.408+0000 7fa8e3596640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e3596640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8dc101280 0x7fa8dc197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e3596640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc198430 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e3596640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1985a0 con 0x7fa8dc101280 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51982/0 (socket says 172.21.15.103:51982) 2024-09-17T01:11:45.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 -- 172.21.15.103:0/1624252526 learned_addr learned my addr 172.21.15.103:0/1624252526 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e0b31640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8dc101280 0x7fa8dc197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 -- 172.21.15.103:0/1624252526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8dc101280 msgr2=0x7fa8dc197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8dc101280 0x7fa8dc197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 -- 172.21.15.103:0/1624252526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8009560 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e1332640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc197920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005610 tx=0x7fa8d8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d8004ba0 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc19cfe0 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8d8004d00 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d8003bd0 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.409+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc19d4d0 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.410+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc0ffc40 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.411+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa8d8031640 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.411+0000 7fa8d27fc640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa8c806e5f0 0x7fa8c8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.412+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa8d80af960 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.412+0000 7fa8e0b31640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa8c806e5f0 0x7fa8c8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.412+0000 7fa8e0b31640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa8c806e5f0 0x7fa8c8070ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc198e40 tx=0x7fa8cc00a250 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:45.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.416+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8d8078b60 con 0x7fa8dc0ff7c0 2024-09-17T01:11:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.604+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8dc02c4a0 con 0x7fa8c806e5f0 2024-09-17T01:11:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.605+0000 7fa8d27fc640 1 -- 172.21.15.103:0/1624252526 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa8dc02c4a0 con 0x7fa8c806e5f0 2024-09-17T01:11:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa8c806e5f0 msgr2=0x7fa8c8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa8c806e5f0 0x7fa8c8070ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc198e40 tx=0x7fa8cc00a250 comp rx=0 tx=0).stop 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 msgr2=0x7fa8dc197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc197920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005610 tx=0x7fa8d8005640 comp rx=0 tx=0).stop 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 shutdown_connections 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa8c806e5f0 0x7fa8c8070ab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8dc101280 0x7fa8dc197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 --2- 172.21.15.103:0/1624252526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0ff7c0 0x7fa8dc197920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 >> 172.21.15.103:0/1624252526 conn(0x7fa8dc0fb330 msgr2=0x7fa8dc102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 shutdown_connections 2024-09-17T01:11:45.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.607+0000 7fa8e3596640 1 -- 172.21.15.103:0/1624252526 wait complete. 2024-09-17T01:11:45.614 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:11:45.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 -- 172.21.15.103:0/3213332822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c102f90 msgr2=0x7fdf1c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3213332822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c102f90 0x7fdf1c105380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009880 tx=0x7fdf1002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 -- 172.21.15.103:0/3213332822 shutdown_connections 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3213332822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c102f90 0x7fdf1c105380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3213332822 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf1c100660 0x7fdf1c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 -- 172.21.15.103:0/3213332822 >> 172.21.15.103:0/3213332822 conn(0x7fdf1c0fa1c0 msgr2=0x7fdf1c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 -- 172.21.15.103:0/3213332822 shutdown_connections 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.708+0000 7fdf226ba640 1 -- 172.21.15.103:0/3213332822 wait complete. 2024-09-17T01:11:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf226ba640 1 Processor -- start 2024-09-17T01:11:45.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf226ba640 1 -- start start 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf226ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 0x7fdf1c0fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf226ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf1c102f90 0x7fdf1c0fe610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf226ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0feb50 con 0x7fdf1c100660 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf226ba640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0fecc0 con 0x7fdf1c102f90 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf1bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 0x7fdf1c0fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf1bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 0x7fdf1c0fffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52012/0 (socket says 172.21.15.103:52012) 2024-09-17T01:11:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf1bfff640 1 -- 172.21.15.103:0/3813876659 learned_addr learned my addr 172.21.15.103:0/3813876659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.709+0000 7fdf1b7fe640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf1c102f90 0x7fdf1c0fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf1bfff640 1 -- 172.21.15.103:0/3813876659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf1c102f90 msgr2=0x7fdf1c0fe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf1bfff640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf1c102f90 0x7fdf1c0fe610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf1bfff640 1 -- 172.21.15.103:0/3813876659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009560 con 0x7fdf1c100660 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf1bfff640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 0x7fdf1c0fffc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00e970 tx=0x7fdf0c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c00cc90 con 0x7fdf1c100660 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf0c00cdf0 con 0x7fdf1c100660 2024-09-17T01:11:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c0fefa0 con 0x7fdf1c100660 2024-09-17T01:11:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c010430 con 0x7fdf1c100660 2024-09-17T01:11:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.710+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c19d670 con 0x7fdf1c100660 2024-09-17T01:11:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.711+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c100a40 con 0x7fdf1c100660 2024-09-17T01:11:45.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.712+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdf0c0046c0 con 0x7fdf1c100660 2024-09-17T01:11:45.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.712+0000 7fdf197fa640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdf0406e5f0 0x7fdf04070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.712+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdf0c014070 con 0x7fdf1c100660 2024-09-17T01:11:45.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.712+0000 7fdf1b7fe640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdf0406e5f0 0x7fdf04070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.713+0000 7fdf1b7fe640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdf0406e5f0 0x7fdf04070ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009230 tx=0x7fdf100314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.717+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdf0c057ce0 con 0x7fdf1c100660 2024-09-17T01:11:45.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.909+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1c103a10 con 0x7fdf0406e5f0 2024-09-17T01:11:45.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.910+0000 7fdf197fa640 1 -- 172.21.15.103:0/3813876659 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdf1c103a10 con 0x7fdf0406e5f0 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdf0406e5f0 msgr2=0x7fdf04070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdf0406e5f0 0x7fdf04070ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009230 tx=0x7fdf100314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 msgr2=0x7fdf1c0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 0x7fdf1c0fffc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00e970 tx=0x7fdf0c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 shutdown_connections 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdf0406e5f0 0x7fdf04070ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf1c102f90 0x7fdf1c0fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 --2- 172.21.15.103:0/3813876659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf1c100660 0x7fdf1c0fffc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 >> 172.21.15.103:0/3813876659 conn(0x7fdf1c0fa1c0 msgr2=0x7fdf1c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:45.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 shutdown_connections 2024-09-17T01:11:45.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.913+0000 7fdf226ba640 1 -- 172.21.15.103:0/3813876659 wait complete. 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 -- 172.21.15.103:0/1851148169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 msgr2=0x7fee1c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 --2- 172.21.15.103:0/1851148169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c0fee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009880 tx=0x7fee0c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 -- 172.21.15.103:0/1851148169 shutdown_connections 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 --2- 172.21.15.103:0/1851148169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee1c0ffc30 0x7fee1c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 --2- 172.21.15.103:0/1851148169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c0fee30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 -- 172.21.15.103:0/1851148169 >> 172.21.15.103:0/1851148169 conn(0x7fee1c0fa1c0 msgr2=0x7fee1c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 -- 172.21.15.103:0/1851148169 shutdown_connections 2024-09-17T01:11:45.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 -- 172.21.15.103:0/1851148169 wait complete. 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.997+0000 7fee21ad7640 1 Processor -- start 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee21ad7640 1 -- start start 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee21ad7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee21ad7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee1c0ffc30 0x7fee1c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee21ad7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c198370 con 0x7fee1c0fea30 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee21ad7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c1984e0 con 0x7fee1c0ffc30 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52028/0 (socket says 172.21.15.103:52028) 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1b7fe640 1 -- 172.21.15.103:0/945802567 learned_addr learned my addr 172.21.15.103:0/945802567 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1affd640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee1c0ffc30 0x7fee1c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1b7fe640 1 -- 172.21.15.103:0/945802567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee1c0ffc30 msgr2=0x7fee1c197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1b7fe640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee1c0ffc30 0x7fee1c197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:45.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.998+0000 7fee1b7fe640 1 -- 172.21.15.103:0/945802567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c009560 con 0x7fee1c0fea30 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.999+0000 7fee1b7fe640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c197860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee0c005610 tx=0x7fee0c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.999+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c004ba0 con 0x7fee1c0fea30 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.999+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee0c004d00 con 0x7fee1c0fea30 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.999+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c19cf20 con 0x7fee1c0fea30 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.999+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c003bd0 con 0x7fee1c0fea30 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:45.999+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c19d410 con 0x7fee1c0fea30 2024-09-17T01:11:46.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.000+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c106510 con 0x7fee1c0fea30 2024-09-17T01:11:46.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.001+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fee0c031640 con 0x7fee1c0fea30 2024-09-17T01:11:46.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.001+0000 7fee18ff9640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fee0406e5f0 0x7fee04070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.001+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fee0c0afa10 con 0x7fee1c0fea30 2024-09-17T01:11:46.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.001+0000 7fee1affd640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fee0406e5f0 0x7fee04070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.002+0000 7fee1affd640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fee0406e5f0 0x7fee04070ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee1c198d80 tx=0x7fee10005c60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.006+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fee0c078b60 con 0x7fee1c0fea30 2024-09-17T01:11:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.190+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee1c104580 con 0x7fee0406e5f0 2024-09-17T01:11:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.199+0000 7fee18ff9640 1 -- 172.21.15.103:0/945802567 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fee1c104580 con 0x7fee0406e5f0 2024-09-17T01:11:46.197 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:11:46.197 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (11m) 31s ago 12m 24.5M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:11:46.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (12m) 31s ago 12m 8833k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:11:46.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (11m) 88s ago 11m 7856k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:11:46.197 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (97s) 31s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (92s) 88s ago 11m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (11m) 31s ago 12m 86.5M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (7m) 31s ago 7m 148M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (7m) 31s ago 7m 91.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (7m) 88s ago 7m 15.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (7m) 88s ago 7m 16.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (3m) 31s ago 14m 499M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (2m) 88s ago 11m 438M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (2m) 31s ago 14m 46.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (2m) 88s ago 11m 34.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:11:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (12m) 31s ago 12m 15.7M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (11m) 88s ago 11m 16.2M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (72s) 31s ago 10m 90.8M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (37s) 31s ago 10m 12.1M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 starting - - - 1216M 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (9m) 88s ago 9m 285M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (9m) 88s ago 9m 269M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (8m) 88s ago 8m 231M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:11:46.199 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (2m) 31s ago 12m 65.1M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fee0406e5f0 msgr2=0x7fee04070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fee0406e5f0 0x7fee04070ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee1c198d80 tx=0x7fee10005c60 comp rx=0 tx=0).stop 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 msgr2=0x7fee1c197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c197860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee0c005610 tx=0x7fee0c005640 comp rx=0 tx=0).stop 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 shutdown_connections 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fee0406e5f0 0x7fee04070ab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee1c0ffc30 0x7fee1c197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 --2- 172.21.15.103:0/945802567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee1c0fea30 0x7fee1c197860 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 >> 172.21.15.103:0/945802567 conn(0x7fee1c0fa1c0 msgr2=0x7fee1c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 shutdown_connections 2024-09-17T01:11:46.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.202+0000 7fee21ad7640 1 -- 172.21.15.103:0/945802567 wait complete. 2024-09-17T01:11:46.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 -- 172.21.15.103:0/1164291465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c01006b0 msgr2=0x7fe7c0102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 --2- 172.21.15.103:0/1164291465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c01006b0 0x7fe7c0102aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009880 tx=0x7fe7b002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 -- 172.21.15.103:0/1164291465 shutdown_connections 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 --2- 172.21.15.103:0/1164291465 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c0102fe0 0x7fe7c01053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 --2- 172.21.15.103:0/1164291465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c01006b0 0x7fe7c0102aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 -- 172.21.15.103:0/1164291465 >> 172.21.15.103:0/1164291465 conn(0x7fe7c00fa230 msgr2=0x7fe7c00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 -- 172.21.15.103:0/1164291465 shutdown_connections 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.283+0000 7fe7c6902640 1 -- 172.21.15.103:0/1164291465 wait complete. 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7c6902640 1 Processor -- start 2024-09-17T01:11:46.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7c6902640 1 -- start start 2024-09-17T01:11:46.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7c6902640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c01006b0 0x7fe7c0195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7c6902640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 0x7fe7c0195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7c6902640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0196140 con 0x7fe7c0102fe0 2024-09-17T01:11:46.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7c6902640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01962b0 con 0x7fe7c01006b0 2024-09-17T01:11:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7bf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 0x7fe7c0195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7bf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 0x7fe7c0195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52036/0 (socket says 172.21.15.103:52036) 2024-09-17T01:11:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7bf7fe640 1 -- 172.21.15.103:0/2161700688 learned_addr learned my addr 172.21.15.103:0/2161700688 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.284+0000 7fe7bffff640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c01006b0 0x7fe7c0195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bf7fe640 1 -- 172.21.15.103:0/2161700688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c01006b0 msgr2=0x7fe7c0195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bf7fe640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c01006b0 0x7fe7c0195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bf7fe640 1 -- 172.21.15.103:0/2161700688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0009560 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bffff640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c01006b0 0x7fe7c0195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bf7fe640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 0x7fe7c0195b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400d6f0 tx=0x7fe7b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7b40051f0 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c019ad50 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7b4009ce0 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7b4004e80 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.285+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c019b320 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.286+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c01087b0 con 0x7fe7c0102fe0 2024-09-17T01:11:46.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.286+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe7b40046c0 con 0x7fe7c0102fe0 2024-09-17T01:11:46.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.287+0000 7fe7bd7fa640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe7a806e590 0x7fe7a8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.287+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe7b408e110 con 0x7fe7c0102fe0 2024-09-17T01:11:46.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.287+0000 7fe7bffff640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe7a806e590 0x7fe7a8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.287+0000 7fe7bffff640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe7a806e590 0x7fe7a8070a50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0000c00 tx=0x7fe7b00314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.291+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe7b4057260 con 0x7fe7c0102fe0 2024-09-17T01:11:46.532 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:46 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[112513]: 2024-09-17T01:11:46.312+0000 7f618fcdd640 -1 Falling back to public interface 2024-09-17T01:11:46.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.534+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7c019b560 con 0x7fe7c0102fe0 2024-09-17T01:11:46.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.534+0000 7fe7bd7fa640 1 -- 172.21.15.103:0/2161700688 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fe7b405a920 con 0x7fe7c0102fe0 2024-09-17T01:11:46.533 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3, 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:11:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 7, 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.537+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe7a806e590 msgr2=0x7fe7a8070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.537+0000 7fe7c6902640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe7a806e590 0x7fe7a8070a50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0000c00 tx=0x7fe7b00314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.537+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 msgr2=0x7fe7c0195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.537+0000 7fe7c6902640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 0x7fe7c0195b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400d6f0 tx=0x7fe7b400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 shutdown_connections 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe7a806e590 0x7fe7a8070a50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c0102fe0 0x7fe7c0195b70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 --2- 172.21.15.103:0/2161700688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c01006b0 0x7fe7c0195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 >> 172.21.15.103:0/2161700688 conn(0x7fe7c00fa230 msgr2=0x7fe7c00fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:46.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 shutdown_connections 2024-09-17T01:11:46.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.538+0000 7fe7c6902640 1 -- 172.21.15.103:0/2161700688 wait complete. 2024-09-17T01:11:46.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2164191553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 msgr2=0x7f6b300fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2164191553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b300fee50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009880 tx=0x7f6b2c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2164191553 shutdown_connections 2024-09-17T01:11:46.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2164191553 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b300ffc50 0x7f6b301000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2164191553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b300fee50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2164191553 >> 172.21.15.103:0/2164191553 conn(0x7f6b300fa1e0 msgr2=0x7f6b300fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2164191553 shutdown_connections 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.621+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2164191553 wait complete. 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b36c2b640 1 Processor -- start 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b36c2b640 1 -- start start 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b36c2b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b30195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b36c2b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b300ffc50 0x7f6b30195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b36c2b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30196120 con 0x7f6b300fea50 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b36c2b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30196290 con 0x7f6b300ffc50 2024-09-17T01:11:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b30195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b30195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52064/0 (socket says 172.21.15.103:52064) 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 -- 172.21.15.103:0/2973568608 learned_addr learned my addr 172.21.15.103:0/2973568608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 -- 172.21.15.103:0/2973568608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b300ffc50 msgr2=0x7f6b30195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b300ffc50 0x7f6b30195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 -- 172.21.15.103:0/2973568608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c009560 con 0x7f6b300fea50 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.622+0000 7f6b349c7640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b30195610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0054f0 tx=0x7f6b2c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.623+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2c004aa0 con 0x7f6b300fea50 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.623+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b2c004c00 con 0x7f6b300fea50 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.623+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3019acd0 con 0x7f6b300fea50 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.623+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2c003ac0 con 0x7f6b300fea50 2024-09-17T01:11:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.623+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3019b240 con 0x7f6b300fea50 2024-09-17T01:11:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.624+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30107640 con 0x7f6b300fea50 2024-09-17T01:11:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.624+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6b2c003d80 con 0x7f6b300fea50 2024-09-17T01:11:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.625+0000 7f6b25ffb640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6b1806e5f0 0x7f6b18070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.625+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6b2c0af8f0 con 0x7f6b300fea50 2024-09-17T01:11:46.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.625+0000 7f6b27fff640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6b1806e5f0 0x7f6b18070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.625+0000 7f6b27fff640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6b1806e5f0 0x7f6b18070ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b20005fd0 tx=0x7f6b20005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.629+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6b2c078a40 con 0x7f6b300fea50 2024-09-17T01:11:46.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.832+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6b3019b430 con 0x7f6b300fea50 2024-09-17T01:11:46.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.833+0000 7f6b25ffb640 1 -- 172.21.15.103:0/2973568608 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7f6b2c07c100 con 0x7f6b300fea50 2024-09-17T01:11:46.831 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:11:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:11:46.833 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:11:46.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:11:46.835 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:46.835 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:11:46.835 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:11:46.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6b1806e5f0 msgr2=0x7f6b18070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6b1806e5f0 0x7f6b18070ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b20005fd0 tx=0x7f6b20005850 comp rx=0 tx=0).stop 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 msgr2=0x7f6b30195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b30195610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0054f0 tx=0x7f6b2c005520 comp rx=0 tx=0).stop 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 shutdown_connections 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6b1806e5f0 0x7f6b18070ab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b300ffc50 0x7f6b30195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 --2- 172.21.15.103:0/2973568608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b300fea50 0x7f6b30195610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.835+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 >> 172.21.15.103:0/2973568608 conn(0x7f6b300fa1e0 msgr2=0x7f6b30068400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.836+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 shutdown_connections 2024-09-17T01:11:46.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.836+0000 7f6b36c2b640 1 -- 172.21.15.103:0/2973568608 wait complete. 2024-09-17T01:11:46.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.920+0000 7fa5b80a1640 1 -- 172.21.15.103:0/2967680733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00ffc30 msgr2=0x7fa5b01000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.920+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/2967680733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00ffc30 0x7fa5b01000b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009880 tx=0x7fa5a402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.920+0000 7fa5b80a1640 1 -- 172.21.15.103:0/2967680733 shutdown_connections 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.920+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/2967680733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00ffc30 0x7fa5b01000b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.920+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/2967680733 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5b00fea30 0x7fa5b00fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.920+0000 7fa5b80a1640 1 -- 172.21.15.103:0/2967680733 >> 172.21.15.103:0/2967680733 conn(0x7fa5b00fa1c0 msgr2=0x7fa5b00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 -- 172.21.15.103:0/2967680733 shutdown_connections 2024-09-17T01:11:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 -- 172.21.15.103:0/2967680733 wait complete. 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 Processor -- start 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 -- start start 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 0x7fa5b0195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5b00ffc30 0x7fa5b0195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0196240 con 0x7fa5b00fea30 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b80a1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01963b0 con 0x7fa5b00ffc30 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b5e3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 0x7fa5b0195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b5e3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 0x7fa5b0195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52080/0 (socket says 172.21.15.103:52080) 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.921+0000 7fa5b5e3d640 1 -- 172.21.15.103:0/4121550976 learned_addr learned my addr 172.21.15.103:0/4121550976 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b563c640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5b00ffc30 0x7fa5b0195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b5e3d640 1 -- 172.21.15.103:0/4121550976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5b00ffc30 msgr2=0x7fa5b0195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b5e3d640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5b00ffc30 0x7fa5b0195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b5e3d640 1 -- 172.21.15.103:0/4121550976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009560 con 0x7fa5b00fea30 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b5e3d640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 0x7fa5b0195730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b9f0 tx=0x7fa5a800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a800cb20 con 0x7fa5b00fea30 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5a800cc80 con 0x7fa5b00fea30 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a8012710 con 0x7fa5b00fea30 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b019ae50 con 0x7fa5b00fea30 2024-09-17T01:11:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.922+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b019b390 con 0x7fa5b00fea30 2024-09-17T01:11:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.923+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b00feeb0 con 0x7fa5b00fea30 2024-09-17T01:11:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.924+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa5a8014b90 con 0x7fa5b00fea30 2024-09-17T01:11:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.924+0000 7fa5aeffd640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa59806e5f0 0x7fa598070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.924+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa5a808df30 con 0x7fa5b00fea30 2024-09-17T01:11:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.924+0000 7fa5b563c640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa59806e5f0 0x7fa598070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.925+0000 7fa5b563c640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa59806e5f0 0x7fa598070ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000c00 tx=0x7fa5a40314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:46.929+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa5a80c31b0 con 0x7fa5b00fea30 2024-09-17T01:11:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.116+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5b0104580 con 0x7fa59806e5f0 2024-09-17T01:11:47.115 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:46 smithi103 ceph-mon[92733]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:47.115 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:46 smithi103 ceph-mon[92733]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:47.115 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:46 smithi103 ceph-mon[92733]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:47.115 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:46 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2161700688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:47.115 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:46 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2973568608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:11:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.117+0000 7fa5aeffd640 1 -- 172.21.15.103:0/4121550976 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa5b0104580 con 0x7fa59806e5f0 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:11:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:11:47.117 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:11:47.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa59806e5f0 msgr2=0x7fa598070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:47.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa59806e5f0 0x7fa598070ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000c00 tx=0x7fa5a40314e0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 msgr2=0x7fa5b0195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 0x7fa5b0195730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b9f0 tx=0x7fa5a800beb0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 shutdown_connections 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa59806e5f0 0x7fa598070ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5b00ffc30 0x7fa5b0195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 --2- 172.21.15.103:0/4121550976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b00fea30 0x7fa5b0195730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 >> 172.21.15.103:0/4121550976 conn(0x7fa5b00fa1c0 msgr2=0x7fa5b0102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 shutdown_connections 2024-09-17T01:11:47.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.119+0000 7fa5b80a1640 1 -- 172.21.15.103:0/4121550976 wait complete. 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 -- 172.21.15.103:0/65256085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd80ffb40 msgr2=0x7f2dd80fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/65256085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd80ffb40 0x7f2dd80fff40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009880 tx=0x7f2dc802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 -- 172.21.15.103:0/65256085 shutdown_connections 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/65256085 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd8100d40 0x7f2dd81011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/65256085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd80ffb40 0x7f2dd80fff40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 -- 172.21.15.103:0/65256085 >> 172.21.15.103:0/65256085 conn(0x7f2dd80fb2f0 msgr2=0x7f2dd80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 -- 172.21.15.103:0/65256085 shutdown_connections 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.202+0000 7f2ddcadb640 1 -- 172.21.15.103:0/65256085 wait complete. 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2ddcadb640 1 Processor -- start 2024-09-17T01:11:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2ddcadb640 1 -- start start 2024-09-17T01:11:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2ddcadb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd80ffb40 0x7f2dd8195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2ddcadb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 0x7f2dd8195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2ddcadb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8196270 con 0x7f2dd8100d40 2024-09-17T01:11:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2ddcadb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd81963e0 con 0x7f2dd80ffb40 2024-09-17T01:11:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2dd5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 0x7f2dd8195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2dd5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 0x7f2dd8195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52098/0 (socket says 172.21.15.103:52098) 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.203+0000 7f2dd5d9b640 1 -- 172.21.15.103:0/3588536181 learned_addr learned my addr 172.21.15.103:0/3588536181 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dd5d9b640 1 -- 172.21.15.103:0/3588536181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd80ffb40 msgr2=0x7f2dd8195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dd659c640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd80ffb40 0x7f2dd8195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dd5d9b640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd80ffb40 0x7f2dd8195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dd5d9b640 1 -- 172.21.15.103:0/3588536181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc8009560 con 0x7f2dd8100d40 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dd659c640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd80ffb40 0x7f2dd8195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dd5d9b640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 0x7f2dd8195ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00b450 tx=0x7f2dcc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dcc011860 con 0x7f2dd8100d40 2024-09-17T01:11:47.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2dcc011e80 con 0x7f2dd8100d40 2024-09-17T01:11:47.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd819ae30 con 0x7f2dd8100d40 2024-09-17T01:11:47.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dcc00f570 con 0x7f2dd8100d40 2024-09-17T01:11:47.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.204+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd819b3d0 con 0x7f2dd8100d40 2024-09-17T01:11:47.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.205+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd80fffc0 con 0x7f2dd8100d40 2024-09-17T01:11:47.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.206+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2dcc0103e0 con 0x7f2dd8100d40 2024-09-17T01:11:47.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.206+0000 7f2dc77fe640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2dc006e5f0 0x7f2dc0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.206+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2dcc08e5b0 con 0x7f2dd8100d40 2024-09-17T01:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.206+0000 7f2dd659c640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2dc006e5f0 0x7f2dc0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.207+0000 7f2dd659c640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2dc006e5f0 0x7f2dc0070ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8031540 tx=0x7f2dc8005de0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.210+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2dcc057700 con 0x7f2dd8100d40 2024-09-17T01:11:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:46 smithi143 ceph-mon[80685]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:46 smithi143 ceph-mon[80685]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:46 smithi143 ceph-mon[80685]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:46 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2161700688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:47.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:46 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2973568608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:11:47.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.459+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2dd81087b0 con 0x7f2dd8100d40 2024-09-17T01:11:47.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.459+0000 7f2dc77fe640 1 -- 172.21.15.103:0/3588536181 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+940 (secure 0 0 0) 0x7f2dcc05adc0 con 0x7f2dd8100d40 2024-09-17T01:11:47.457 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 29/225 objects degraded (12.889%), 12 pgs degraded 2024-09-17T01:11:47.457 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:11:47.457 INFO:teuthology.orchestra.run.smithi103.stdout: osd.2 (root=default,host=smithi103) is down 2024-09-17T01:11:47.457 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/225 objects degraded (12.889%), 12 pgs degraded 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-17T01:11:47.458 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-17T01:11:47.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2dc006e5f0 msgr2=0x7f2dc0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:47.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2dc006e5f0 0x7f2dc0070ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8031540 tx=0x7f2dc8005de0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 msgr2=0x7f2dd8195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 0x7f2dd8195ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00b450 tx=0x7f2dcc00b910 comp rx=0 tx=0).stop 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 shutdown_connections 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2dc006e5f0 0x7f2dc0070ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dd8100d40 0x7f2dd8195ca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 --2- 172.21.15.103:0/3588536181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd80ffb40 0x7f2dd8195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 >> 172.21.15.103:0/3588536181 conn(0x7f2dd80fb2f0 msgr2=0x7f2dd8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 shutdown_connections 2024-09-17T01:11:47.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:11:47.461+0000 7f2ddcadb640 1 -- 172.21.15.103:0/3588536181 wait complete. 2024-09-17T01:11:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:47 smithi103 ceph-mon[92733]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:47 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3588536181' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:47 smithi143 ceph-mon[80685]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:47 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3588536181' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:48 smithi143 ceph-mon[80685]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:48 smithi143 ceph-mon[80685]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:49.276 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:48 smithi103 ceph-mon[92733]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.277 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:48 smithi103 ceph-mon[92733]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:50.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:50.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:50.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:50 smithi103 ceph-mon[92733]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:50.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:50 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 29/225 objects degraded (12.889%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:50.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:50.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:51.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:51.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:51.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:50 smithi143 ceph-mon[80685]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:51.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:50 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 29/225 objects degraded (12.889%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:51.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:51.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:52.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:52 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[112513]: 2024-09-17T01:11:52.277+0000 7f618fcdd640 -1 osd.2 58 log_to_monitors true 2024-09-17T01:11:53.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:52 smithi103 ceph-mon[92733]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:53.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:52 smithi103 ceph-mon[92733]: from='osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:11:53.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:11:52 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[112513]: 2024-09-17T01:11:52.927+0000 7f6187a77640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:11:53.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:52 smithi143 ceph-mon[80685]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:53.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:52 smithi143 ceph-mon[80685]: from='osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: osdmap e61: 6 total, 5 up, 6 in 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:53.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:53.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:53.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:53.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:53.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:53.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:53.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:11:54.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:11:54.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: osdmap e61: 6 total, 5 up, 6 in 2024-09-17T01:11:54.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-17T01:11:54.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:54.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:54.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:54.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:54.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:11:54.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:54.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:54.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:54.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:54.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290] boot 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:11:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:11:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:11:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:11:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: osd.2 [v2:172.21.15.103:6818/1049662290,v1:172.21.15.103:6819/1049662290] boot 2024-09-17T01:11:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:11:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:11:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:55 smithi103 ceph-mon[92733]: osdmap e63: 6 total, 6 up, 6 in 2024-09-17T01:11:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:55 smithi143 ceph-mon[80685]: osdmap e63: 6 total, 6 up, 6 in 2024-09-17T01:11:57.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:56 smithi103 ceph-mon[92733]: pgmap v97: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:57.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:56 smithi143 ceph-mon[80685]: pgmap v97: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 29/225 objects degraded (12.889%) 2024-09-17T01:11:58.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:57 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:58.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:57 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:11:58 smithi143 ceph-mon[80685]: pgmap v98: 65 pgs: 13 active+undersized, 11 active+undersized+degraded, 41 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 26/225 objects degraded (11.556%) 2024-09-17T01:11:59.292 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:11:58 smithi103 ceph-mon[92733]: pgmap v98: 65 pgs: 13 active+undersized, 11 active+undersized+degraded, 41 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 26/225 objects degraded (11.556%) 2024-09-17T01:12:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:00 smithi103 ceph-mon[92733]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded) 2024-09-17T01:12:00.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:00 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:12:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:00 smithi143 ceph-mon[80685]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded) 2024-09-17T01:12:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:00 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:12:01.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:01 smithi103 ceph-mon[92733]: pgmap v99: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-17T01:12:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:01 smithi143 ceph-mon[80685]: pgmap v99: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-17T01:12:03.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:03 smithi103 ceph-mon[92733]: pgmap v100: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:03.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:03.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:03 smithi143 ceph-mon[80685]: pgmap v100: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:03.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:05 smithi103 ceph-mon[92733]: pgmap v101: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-17T01:12:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:05 smithi143 ceph-mon[80685]: pgmap v101: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-17T01:12:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:07 smithi103 ceph-mon[92733]: pgmap v102: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 936 B/s rd, 1 op/s 2024-09-17T01:12:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:07 smithi143 ceph-mon[80685]: pgmap v102: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 936 B/s rd, 1 op/s 2024-09-17T01:12:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:08 smithi103 ceph-mon[92733]: pgmap v103: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:12:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:08 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:09.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:08 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:12:09.220 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:08 smithi143 ceph-mon[80685]: pgmap v103: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:12:09.220 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:08 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:09.220 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:08 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:12:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:09 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:12:10.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:09 smithi103 ceph-mon[92733]: Upgrade: osd.3 is safe to restart 2024-09-17T01:12:10.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:09 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:12:10.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:09 smithi143 ceph-mon[80685]: Upgrade: osd.3 is safe to restart 2024-09-17T01:12:10.914 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:10 smithi143 ceph-mon[80685]: pgmap v104: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:12:10.914 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:10.915 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:12:10.915 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:10 smithi103 ceph-mon[92733]: pgmap v104: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:12:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:12:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:12.104 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:11 smithi143 ceph-mon[80685]: Upgrade: Updating osd.3 2024-09-17T01:12:12.104 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:11 smithi143 ceph-mon[80685]: Deploying daemon osd.3 on smithi143 2024-09-17T01:12:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:11 smithi103 ceph-mon[92733]: Upgrade: Updating osd.3 2024-09-17T01:12:12.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:11 smithi103 ceph-mon[92733]: Deploying daemon osd.3 on smithi143 2024-09-17T01:12:13.175 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:12 smithi143 ceph-mon[80685]: pgmap v105: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:12:13.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:12 smithi103 ceph-mon[92733]: pgmap v105: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:12:13.473 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:13 smithi143 systemd[1]: Stopping Ceph osd.3 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:12:13.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:13 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[41416]: 2024-09-17T01:12:13.474+0000 7f67a684c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:12:13.758 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:13 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[41416]: 2024-09-17T01:12:13.474+0000 7f67a684c640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-17T01:12:13.758 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:13 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[41416]: 2024-09-17T01:12:13.474+0000 7f67a684c640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:12:14.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:13 smithi143 ceph-mon[80685]: osd.3 marked itself down and dead 2024-09-17T01:12:14.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:13 smithi103 ceph-mon[92733]: osd.3 marked itself down and dead 2024-09-17T01:12:14.606 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:14 smithi143 podman[89950]: 2024-09-17 01:12:14.313079965 +0000 UTC m=+0.987793824 container died 673568079f10cbf13175076e992966c8bc710011a4769ecbc509176471c9bb4a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, ceph=True) 2024-09-17T01:12:14.935 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:14 smithi143 podman[89950]: 2024-09-17 01:12:14.706872875 +0000 UTC m=+1.381586722 container cleanup 673568079f10cbf13175076e992966c8bc710011a4769ecbc509176471c9bb4a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=reef-19e2a2b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:12:14.936 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:14 smithi143 bash[89950]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:12:15.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:14 smithi143 ceph-mon[80685]: pgmap v106: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:12:15.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:14 smithi143 ceph-mon[80685]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:15.256 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:14 smithi143 ceph-mon[80685]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:12:15.256 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:14 smithi143 podman[89966]: 2024-09-17 01:12:14.941552576 +0000 UTC m=+0.631103605 container remove 673568079f10cbf13175076e992966c8bc710011a4769ecbc509176471c9bb4a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:12:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:14 smithi103 ceph-mon[92733]: pgmap v106: 65 pgs: 65 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:12:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:14 smithi103 ceph-mon[92733]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:14 smithi103 ceph-mon[92733]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:12:15.507 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:15 smithi143 podman[90056]: 2024-09-17 01:12:15.258611267 +0000 UTC m=+0.099570171 container create 0632b613fed8d14093bc76cd17760b193e0a817139c813cea6ea816860b3593c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T01:12:15.508 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:15 smithi143 podman[90056]: 2024-09-17 01:12:15.175288785 +0000 UTC m=+0.016247689 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:12:15.939 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:15 smithi143 podman[90056]: 2024-09-17 01:12:15.513101082 +0000 UTC m=+0.354059991 container init 0632b613fed8d14093bc76cd17760b193e0a817139c813cea6ea816860b3593c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:12:15.939 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:15 smithi143 podman[90056]: 2024-09-17 01:12:15.516360802 +0000 UTC m=+0.357319707 container start 0632b613fed8d14093bc76cd17760b193e0a817139c813cea6ea816860b3593c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T01:12:15.939 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:15 smithi143 podman[90056]: 2024-09-17 01:12:15.596198691 +0000 UTC m=+0.437157601 container attach 0632b613fed8d14093bc76cd17760b193e0a817139c813cea6ea816860b3593c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:15.940 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:15 smithi143 podman[90056]: 2024-09-17 01:12:15.703296852 +0000 UTC m=+0.544255763 container died 0632b613fed8d14093bc76cd17760b193e0a817139c813cea6ea816860b3593c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:12:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:15 smithi143 ceph-mon[80685]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:12:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:15 smithi103 ceph-mon[92733]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:12:16.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 podman[90079]: 2024-09-17 01:12:16.349477185 +0000 UTC m=+0.639442609 container remove 0632b613fed8d14093bc76cd17760b193e0a817139c813cea6ea816860b3593c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T01:12:16.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T01:12:16.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 systemd[1]: Stopped Ceph osd.3 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:12:16.758 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 17.104s CPU time. 2024-09-17T01:12:16.758 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 systemd[1]: Starting Ceph osd.3 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:12:17.100 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:16 smithi143 ceph-mon[80685]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:17.100 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 podman[90178]: 2024-09-17 01:12:16.682119504 +0000 UTC m=+0.015994660 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:12:17.101 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:16 smithi143 podman[90178]: 2024-09-17 01:12:16.783738779 +0000 UTC m=+0.117613931 container create 914de7739fa6c889763b4a7485c266108d3f65ec6b35a76431695531bdb3adaf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:12:17.101 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 podman[90178]: 2024-09-17 01:12:17.020217375 +0000 UTC m=+0.354092537 container init 914de7739fa6c889763b4a7485c266108d3f65ec6b35a76431695531bdb3adaf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-17T01:12:17.101 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 podman[90178]: 2024-09-17 01:12:17.023929886 +0000 UTC m=+0.357805041 container start 914de7739fa6c889763b4a7485c266108d3f65ec6b35a76431695531bdb3adaf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-17T01:12:17.101 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 podman[90178]: 2024-09-17 01:12:17.10301943 +0000 UTC m=+0.436894599 container attach 914de7739fa6c889763b4a7485c266108d3f65ec6b35a76431695531bdb3adaf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:12:17.395 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:17.395 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 bash[90178]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:17.395 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:17.395 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 bash[90178]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:16 smithi103 ceph-mon[92733]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 -- 172.21.15.103:0/2304395241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 msgr2=0x7fe2900fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2304395241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe2900fee30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009880 tx=0x7fe28c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 -- 172.21.15.103:0/2304395241 shutdown_connections 2024-09-17T01:12:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2304395241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2900ffc30 0x7fe2901000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2304395241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe2900fee30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 -- 172.21.15.103:0/2304395241 >> 172.21.15.103:0/2304395241 conn(0x7fe2900fa1c0 msgr2=0x7fe2900fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 -- 172.21.15.103:0/2304395241 shutdown_connections 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.555+0000 7fe297a0a640 1 -- 172.21.15.103:0/2304395241 wait complete. 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe297a0a640 1 Processor -- start 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe297a0a640 1 -- start start 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe297a0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe290195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe297a0a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2900ffc30 0x7fe290195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe297a0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290196130 con 0x7fe2900fea30 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe297a0a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2901962a0 con 0x7fe2900ffc30 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe2957a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe290195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe2957a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe290195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57556/0 (socket says 172.21.15.103:57556) 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe2957a6640 1 -- 172.21.15.103:0/2735229046 learned_addr learned my addr 172.21.15.103:0/2735229046 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe294fa5640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2900ffc30 0x7fe290195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe2957a6640 1 -- 172.21.15.103:0/2735229046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2900ffc30 msgr2=0x7fe290195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe2957a6640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2900ffc30 0x7fe290195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.556+0000 7fe2957a6640 1 -- 172.21.15.103:0/2735229046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c009560 con 0x7fe2900fea30 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.557+0000 7fe2957a6640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe290195620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe28c004650 tx=0x7fe28c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.557+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe28c004aa0 con 0x7fe2900fea30 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.557+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29019ace0 con 0x7fe2900fea30 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.557+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe28c005d50 con 0x7fe2900fea30 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.557+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe28c0039e0 con 0x7fe2900fea30 2024-09-17T01:12:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.557+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29019b200 con 0x7fe2900fea30 2024-09-17T01:12:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.558+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe290107640 con 0x7fe2900fea30 2024-09-17T01:12:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.558+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe28c031c00 con 0x7fe2900fea30 2024-09-17T01:12:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.559+0000 7fe2867fc640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe27c06e5f0 0x7fe27c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.559+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe28c0af6f0 con 0x7fe2900fea30 2024-09-17T01:12:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.559+0000 7fe294fa5640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe27c06e5f0 0x7fe27c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.560+0000 7fe294fa5640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe27c06e5f0 0x7fe27c070ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe290196b40 tx=0x7fe280005f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:17.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.564+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe28c0788f0 con 0x7fe2900fea30 2024-09-17T01:12:17.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.745+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2900fc3d0 con 0x7fe27c06e5f0 2024-09-17T01:12:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.746+0000 7fe2867fc640 1 -- 172.21.15.103:0/2735229046 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe2900fc3d0 con 0x7fe27c06e5f0 2024-09-17T01:12:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe27c06e5f0 msgr2=0x7fe27c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe27c06e5f0 0x7fe27c070ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe290196b40 tx=0x7fe280005f90 comp rx=0 tx=0).stop 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 msgr2=0x7fe290195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe290195620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe28c004650 tx=0x7fe28c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 shutdown_connections 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe27c06e5f0 0x7fe27c070ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2900ffc30 0x7fe290195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 --2- 172.21.15.103:0/2735229046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2900fea30 0x7fe290195620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 >> 172.21.15.103:0/2735229046 conn(0x7fe2900fa1c0 msgr2=0x7fe2900fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 shutdown_connections 2024-09-17T01:12:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.748+0000 7fe297a0a640 1 -- 172.21.15.103:0/2735229046 wait complete. 2024-09-17T01:12:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:12:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 -- 172.21.15.103:0/3056127882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 msgr2=0x7f51481000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 --2- 172.21.15.103:0/3056127882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f51481000b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f513c009880 tx=0x7f513c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 -- 172.21.15.103:0/3056127882 shutdown_connections 2024-09-17T01:12:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 --2- 172.21.15.103:0/3056127882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f51481000b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 --2- 172.21.15.103:0/3056127882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 0x7f51480fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 -- 172.21.15.103:0/3056127882 >> 172.21.15.103:0/3056127882 conn(0x7f51480fa1c0 msgr2=0x7f51480fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 -- 172.21.15.103:0/3056127882 shutdown_connections 2024-09-17T01:12:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.830+0000 7f514cc41640 1 -- 172.21.15.103:0/3056127882 wait complete. 2024-09-17T01:12:17.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f514cc41640 1 Processor -- start 2024-09-17T01:12:17.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f514cc41640 1 -- start start 2024-09-17T01:12:17.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f514cc41640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 0x7f5148068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f514cc41640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f514819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f514cc41640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514819a930 con 0x7f51480ffc30 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f514cc41640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514819aa70 con 0x7f51480fea30 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f5145d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f514819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f5145d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f514819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57584/0 (socket says 172.21.15.103:57584) 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.831+0000 7f5145d9b640 1 -- 172.21.15.103:0/4038494667 learned_addr learned my addr 172.21.15.103:0/4038494667 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f514659c640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 0x7f5148068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f5145d9b640 1 -- 172.21.15.103:0/4038494667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 msgr2=0x7f5148068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f5145d9b640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 0x7f5148068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f5145d9b640 1 -- 172.21.15.103:0/4038494667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009560 con 0x7f51480ffc30 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f514659c640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 0x7f5148068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:12:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f5145d9b640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f514819a360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f513c006010 tx=0x7f513c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513c004aa0 con 0x7f51480ffc30 2024-09-17T01:12:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f513c004c00 con 0x7f51480ffc30 2024-09-17T01:12:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514819acc0 con 0x7f51480ffc30 2024-09-17T01:12:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513c003ac0 con 0x7f51480ffc30 2024-09-17T01:12:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.832+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514819b230 con 0x7f51480ffc30 2024-09-17T01:12:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.833+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5148107640 con 0x7f51480ffc30 2024-09-17T01:12:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.834+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f513c031640 con 0x7f51480ffc30 2024-09-17T01:12:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.834+0000 7f51377fe640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f513006e5f0 0x7f5130070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.834+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f513c0af910 con 0x7f51480ffc30 2024-09-17T01:12:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.835+0000 7f514659c640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f513006e5f0 0x7f5130070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.835+0000 7f514659c640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f513006e5f0 0x7f5130070ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51380058c0 tx=0x7f5138005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:17.840+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f513c078a60 con 0x7f51480ffc30 2024-09-17T01:12:18.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.043+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f514819b3c0 con 0x7f513006e5f0 2024-09-17T01:12:18.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.045+0000 7f51377fe640 1 -- 172.21.15.103:0/4038494667 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f514819b3c0 con 0x7f513006e5f0 2024-09-17T01:12:18.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.046+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f513006e5f0 msgr2=0x7f5130070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.046+0000 7f514cc41640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f513006e5f0 0x7f5130070ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51380058c0 tx=0x7f5138005850 comp rx=0 tx=0).stop 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 msgr2=0x7f514819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f514819a360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f513c006010 tx=0x7f513c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 shutdown_connections 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f513006e5f0 0x7f5130070ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51480ffc30 0x7f514819a360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 --2- 172.21.15.103:0/4038494667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51480fea30 0x7f5148068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 >> 172.21.15.103:0/4038494667 conn(0x7f51480fa1c0 msgr2=0x7f5148102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 shutdown_connections 2024-09-17T01:12:18.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.047+0000 7f514cc41640 1 -- 172.21.15.103:0/4038494667 wait complete. 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 -- 172.21.15.103:0/3025129183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0fea30 msgr2=0x7fe8ec0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/3025129183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec0fee30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009880 tx=0x7fe8dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 -- 172.21.15.103:0/3025129183 shutdown_connections 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/3025129183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/3025129183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec0fee30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 -- 172.21.15.103:0/3025129183 >> 172.21.15.103:0/3025129183 conn(0x7fe8ec0fa1c0 msgr2=0x7fe8ec0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 -- 172.21.15.103:0/3025129183 shutdown_connections 2024-09-17T01:12:18.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 -- 172.21.15.103:0/3025129183 wait complete. 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 3]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 2]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 5]}]: dispatch 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:18.129 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:18.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 Processor -- start 2024-09-17T01:12:18.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.129+0000 7fe8f29eb640 1 -- start start 2024-09-17T01:12:18.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8f29eb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8f29eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8f29eb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec196110 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8f29eb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec196280 con 0x7fe8ec0fea30 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57590/0 (socket says 172.21.15.103:57590) 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 -- 172.21.15.103:0/1531317724 learned_addr learned my addr 172.21.15.103:0/1531317724 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8ebfff640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 -- 172.21.15.103:0/1531317724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0fea30 msgr2=0x7fe8ec195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 -- 172.21.15.103:0/1531317724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009560 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8ebfff640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.130+0000 7fe8eb7fe640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec195b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400e9a0 tx=0x7fe8d400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.131+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d400cc90 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.131+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8d400cdf0 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.131+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec19ad20 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.131+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d40187f0 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.131+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec19b2f0 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.132+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec107620 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.132+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe8d4010c10 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.133+0000 7fe8e97fa640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe8d806e5f0 0x7fe8d8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.133+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe8d4014070 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.133+0000 7fe8ebfff640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe8d806e5f0 0x7fe8d8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.133+0000 7fe8ebfff640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe8d806e5f0 0x7fe8d8070ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009230 tx=0x7fe8dc0314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.137+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe8d40541b0 con 0x7fe8ec0ffc30 2024-09-17T01:12:18.165 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:12:18.165 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 bash[90178]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:12:18.165 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:12:18.165 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:17 smithi143 bash[90178]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:12:18.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-09-17T01:12:18.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]: dispatch 2024-09-17T01:12:18.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 3]}]: dispatch 2024-09-17T01:12:18.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]: dispatch 2024-09-17T01:12:18.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]: dispatch 2024-09-17T01:12:18.166 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 2]}]: dispatch 2024-09-17T01:12:18.168 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 5]}]: dispatch 2024-09-17T01:12:18.168 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:18.168 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.311+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8ec19b540 con 0x7fe8d806e5f0 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.321+0000 7fe8e97fa640 1 -- 172.21.15.103:0/1531317724 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe8ec19b540 con 0x7fe8d806e5f0 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (11m) 28s ago 13m 24.5M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (13m) 28s ago 13m 8887k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (12m) 2m ago 12m 7856k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (2m) 28s ago 13m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:12:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (2m) 2m ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (11m) 28s ago 12m 86.5M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (7m) 28s ago 7m 148M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (7m) 28s ago 7m 90.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (7m) 2m ago 7m 15.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (7m) 2m ago 7m 16.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (4m) 28s ago 14m 500M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (3m) 2m ago 12m 438M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (3m) 28s ago 14m 48.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (2m) 2m ago 12m 34.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (13m) 28s ago 13m 16.0M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (12m) 2m ago 12m 16.2M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (104s) 28s ago 11m 92.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:12:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (69s) 28s ago 11m 100M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:12:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (34s) 28s ago 10m 14.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:12:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (10m) 2m ago 10m 285M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 673568079f10 2024-09-17T01:12:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (9m) 2m ago 9m 269M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:12:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (9m) 2m ago 9m 231M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:12:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (3m) 28s ago 12m 65.1M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe8d806e5f0 msgr2=0x7fe8d8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe8d806e5f0 0x7fe8d8070ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009230 tx=0x7fe8dc0314e0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 msgr2=0x7fe8ec195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec195b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400e9a0 tx=0x7fe8d400ee60 comp rx=0 tx=0).stop 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 shutdown_connections 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe8d806e5f0 0x7fe8d8070ab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0ffc30 0x7fe8ec195b40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 --2- 172.21.15.103:0/1531317724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe8ec0fea30 0x7fe8ec195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 >> 172.21.15.103:0/1531317724 conn(0x7fe8ec0fa1c0 msgr2=0x7fe8ec0fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 shutdown_connections 2024-09-17T01:12:18.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.323+0000 7fe8f29eb640 1 -- 172.21.15.103:0/1531317724 wait complete. 2024-09-17T01:12:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.403+0000 7fc73f9e5640 1 -- 172.21.15.103:0/2641165670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380ffc80 msgr2=0x7fc738100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.403+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/2641165670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380ffc80 0x7fc738100100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc728009880 tx=0x7fc72802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.403+0000 7fc73f9e5640 1 -- 172.21.15.103:0/2641165670 shutdown_connections 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.403+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/2641165670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380ffc80 0x7fc738100100 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.403+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/2641165670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7380fea80 0x7fc7380fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.403+0000 7fc73f9e5640 1 -- 172.21.15.103:0/2641165670 >> 172.21.15.103:0/2641165670 conn(0x7fc7380fa230 msgr2=0x7fc7380fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 -- 172.21.15.103:0/2641165670 shutdown_connections 2024-09-17T01:12:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 -- 172.21.15.103:0/2641165670 wait complete. 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 Processor -- start 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 -- start start 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 0x7fc738102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7380ffc80 0x7fc738101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7381015a0 con 0x7fc7380fea80 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.404+0000 7fc73f9e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738101710 con 0x7fc7380ffc80 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 0x7fc738102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 0x7fc738102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57612/0 (socket says 172.21.15.103:57612) 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 -- 172.21.15.103:0/3782950400 learned_addr learned my addr 172.21.15.103:0/3782950400 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73cf80640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7380ffc80 0x7fc738101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 -- 172.21.15.103:0/3782950400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7380ffc80 msgr2=0x7fc738101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7380ffc80 0x7fc738101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 -- 172.21.15.103:0/3782950400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009560 con 0x7fc7380fea80 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73d781640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 0x7fc738102a10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc73400d8d0 tx=0x7fc73400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73400bea0 con 0x7fc7380fea80 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7381019f0 con 0x7fc7380fea80 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc734009c00 con 0x7fc7380fea80 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73400f790 con 0x7fc7380fea80 2024-09-17T01:12:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.405+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73819d650 con 0x7fc7380fea80 2024-09-17T01:12:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.406+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7380fee80 con 0x7fc7380fea80 2024-09-17T01:12:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.407+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc73400fa50 con 0x7fc7380fea80 2024-09-17T01:12:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.407+0000 7fc72e7fc640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc72406e5f0 0x7fc724070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.408+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc73408ea30 con 0x7fc7380fea80 2024-09-17T01:12:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.408+0000 7fc73cf80640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc72406e5f0 0x7fc724070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.408+0000 7fc73cf80640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc72406e5f0 0x7fc724070ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc728000c00 tx=0x7fc7280314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.412+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc734057ab0 con 0x7fc7380fea80 2024-09-17T01:12:18.495 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:12:18.495 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 bash[90178]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:12:18.495 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:12:18.495 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 bash[90178]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 bash[90178]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 bash[90178]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate[90193]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 bash[90178]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:12:18.496 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 podman[90178]: 2024-09-17 01:12:18.195611425 +0000 UTC m=+1.529486578 container died 914de7739fa6c889763b4a7485c266108d3f65ec6b35a76431695531bdb3adaf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:12:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.642+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc738107670 con 0x7fc7380fea80 2024-09-17T01:12:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.642+0000 7fc72e7fc640 1 -- 172.21.15.103:0/3782950400 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fc73405b170 con 0x7fc7380fea80 2024-09-17T01:12:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2, 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:18.642 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6, 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:12:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc72406e5f0 msgr2=0x7fc724070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc72406e5f0 0x7fc724070ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc728000c00 tx=0x7fc7280314e0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 msgr2=0x7fc738102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 0x7fc738102a10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc73400d8d0 tx=0x7fc73400dd90 comp rx=0 tx=0).stop 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 shutdown_connections 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc72406e5f0 0x7fc724070ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7380ffc80 0x7fc738101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 --2- 172.21.15.103:0/3782950400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7380fea80 0x7fc738102a10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 >> 172.21.15.103:0/3782950400 conn(0x7fc7380fa230 msgr2=0x7fc738068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 shutdown_connections 2024-09-17T01:12:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.644+0000 7fc73f9e5640 1 -- 172.21.15.103:0/3782950400 wait complete. 2024-09-17T01:12:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 -- 172.21.15.103:0/1252358589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980fea30 msgr2=0x7f19980fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 --2- 172.21.15.103:0/1252358589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980fea30 0x7f19980fee30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1980009880 tx=0x7f198002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 -- 172.21.15.103:0/1252358589 shutdown_connections 2024-09-17T01:12:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 --2- 172.21.15.103:0/1252358589 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19980ffc30 0x7f19981000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 --2- 172.21.15.103:0/1252358589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980fea30 0x7f19980fee30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 -- 172.21.15.103:0/1252358589 >> 172.21.15.103:0/1252358589 conn(0x7f19980fa1c0 msgr2=0x7f19980fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 -- 172.21.15.103:0/1252358589 shutdown_connections 2024-09-17T01:12:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.726+0000 7f199eb86640 1 -- 172.21.15.103:0/1252358589 wait complete. 2024-09-17T01:12:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199eb86640 1 Processor -- start 2024-09-17T01:12:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199eb86640 1 -- start start 2024-09-17T01:12:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199eb86640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19980fea30 0x7f1998195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199eb86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 0x7f1998195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199eb86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19981961a0 con 0x7f19980ffc30 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199eb86640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1998196310 con 0x7f19980fea30 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 0x7f1998195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 0x7f1998195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57620/0 (socket says 172.21.15.103:57620) 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 -- 172.21.15.103:0/3460520143 learned_addr learned my addr 172.21.15.103:0/3460520143 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f199c922640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19980fea30 0x7f1998195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 -- 172.21.15.103:0/3460520143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19980fea30 msgr2=0x7f1998195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19980fea30 0x7f1998195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 -- 172.21.15.103:0/3460520143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009560 con 0x7f19980ffc30 2024-09-17T01:12:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1997fff640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 0x7f1998195bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f198800c920 tx=0x7f198800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.727+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1988007b80 con 0x7f19980ffc30 2024-09-17T01:12:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.728+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199819ad40 con 0x7f19980ffc30 2024-09-17T01:12:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.728+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19880054e0 con 0x7f19980ffc30 2024-09-17T01:12:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.728+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198800f450 con 0x7f19980ffc30 2024-09-17T01:12:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.728+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199819b310 con 0x7f19980ffc30 2024-09-17T01:12:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.729+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1998107640 con 0x7f19980ffc30 2024-09-17T01:12:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.729+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1988004f60 con 0x7f19980ffc30 2024-09-17T01:12:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.730+0000 7f1995ffb640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f198406e5f0 0x7f1984070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.730+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f198808e5c0 con 0x7f19980ffc30 2024-09-17T01:12:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.730+0000 7f199c922640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f198406e5f0 0x7f1984070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.730+0000 7f199c922640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f198406e5f0 0x7f1984070ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1980006010 tx=0x7f1980031500 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.734+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1988057640 con 0x7f19980ffc30 2024-09-17T01:12:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.936+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f199819b560 con 0x7f19980ffc30 2024-09-17T01:12:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.936+0000 7f1995ffb640 1 -- 172.21.15.103:0/3460520143 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7f199819b560 con 0x7f19980ffc30 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:12:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:12:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:12:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f198406e5f0 msgr2=0x7f1984070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f198406e5f0 0x7f1984070ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1980006010 tx=0x7f1980031500 comp rx=0 tx=0).stop 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 msgr2=0x7f1998195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 0x7f1998195bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f198800c920 tx=0x7f198800cde0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 shutdown_connections 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f198406e5f0 0x7f1984070ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980ffc30 0x7f1998195bd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 --2- 172.21.15.103:0/3460520143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19980fea30 0x7f1998195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:18.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.938+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 >> 172.21.15.103:0/3460520143 conn(0x7f19980fa1c0 msgr2=0x7f1998067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:18.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.939+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 shutdown_connections 2024-09-17T01:12:18.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:18.939+0000 7f199eb86640 1 -- 172.21.15.103:0/3460520143 wait complete. 2024-09-17T01:12:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 -- 172.21.15.103:0/392872457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 msgr2=0x7fc8341011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 --2- 172.21.15.103:0/392872457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc8341011b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc828009880 tx=0x7fc82802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 -- 172.21.15.103:0/392872457 shutdown_connections 2024-09-17T01:12:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 --2- 172.21.15.103:0/392872457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc8341011b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 --2- 172.21.15.103:0/392872457 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8340ffb30 0x7fc8340fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 -- 172.21.15.103:0/392872457 >> 172.21.15.103:0/392872457 conn(0x7fc8340fb2c0 msgr2=0x7fc8340fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 -- 172.21.15.103:0/392872457 shutdown_connections 2024-09-17T01:12:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 -- 172.21.15.103:0/392872457 wait complete. 2024-09-17T01:12:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: pgmap v110: 65 pgs: 4 active+undersized, 14 stale+active+clean, 5 active+undersized+degraded, 42 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 14/225 objects degraded (6.222%) 2024-09-17T01:12:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: Health check failed: Degraded data redundancy: 14/225 objects degraded (6.222%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 3]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 2]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 5]}]': finished 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: osdmap e66: 6 total, 5 up, 6 in 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3782950400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:18 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3460520143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:12:19.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.024+0000 7fc83c057640 1 Processor -- start 2024-09-17T01:12:19.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc83c057640 1 -- start start 2024-09-17T01:12:19.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc83c057640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8340ffb30 0x7fc834195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:19.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc83c057640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc834195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:19.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc83c057640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834196220 con 0x7fc834100d30 2024-09-17T01:12:19.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc83c057640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834196390 con 0x7fc8340ffb30 2024-09-17T01:12:19.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc834195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:19.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc834195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57640/0 (socket says 172.21.15.103:57640) 2024-09-17T01:12:19.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 -- 172.21.15.103:0/4025597326 learned_addr learned my addr 172.21.15.103:0/4025597326 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:19.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc839df3640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8340ffb30 0x7fc834195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:19.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 -- 172.21.15.103:0/4025597326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8340ffb30 msgr2=0x7fc834195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8340ffb30 0x7fc834195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 -- 172.21.15.103:0/4025597326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009560 con 0x7fc834100d30 2024-09-17T01:12:19.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.025+0000 7fc8395f2640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc834195c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc828005640 tx=0x7fc828005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:19.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.026+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc828004ba0 con 0x7fc834100d30 2024-09-17T01:12:19.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.026+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83419add0 con 0x7fc834100d30 2024-09-17T01:12:19.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.026+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc828004d00 con 0x7fc834100d30 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.026+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc828003b70 con 0x7fc834100d30 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.026+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83419b340 con 0x7fc834100d30 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.027+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8341087c0 con 0x7fc834100d30 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.027+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc828031640 con 0x7fc834100d30 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.028+0000 7fc832ffd640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc81c06e5f0 0x7fc81c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.028+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6832+0+0 (secure 0 0 0) 0x7fc8280afa50 con 0x7fc834100d30 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.028+0000 7fc839df3640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc81c06e5f0 0x7fc81c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.028+0000 7fc839df3640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc81c06e5f0 0x7fc81c070ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc834100b90 tx=0x7fc82c009110 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:19.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.032+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc828078a00 con 0x7fc834100d30 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: pgmap v110: 65 pgs: 4 active+undersized, 14 stale+active+clean, 5 active+undersized+degraded, 42 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 14/225 objects degraded (6.222%) 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: Health check failed: Degraded data redundancy: 14/225 objects degraded (6.222%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]': finished 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 3]}]': finished 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]': finished 2024-09-17T01:12:19.172 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [4, 0]}]': finished 2024-09-17T01:12:19.173 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 2]}]': finished 2024-09-17T01:12:19.173 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 5]}]': finished 2024-09-17T01:12:19.173 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: osdmap e66: 6 total, 5 up, 6 in 2024-09-17T01:12:19.173 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:19.173 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3782950400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:19.173 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:18 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3460520143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:12:19.173 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:18 smithi143 podman[90323]: 2024-09-17 01:12:18.835692651 +0000 UTC m=+0.629233241 container remove 914de7739fa6c889763b4a7485c266108d3f65ec6b35a76431695531bdb3adaf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:12:19.173 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 podman[90383]: 2024-09-17 01:12:18.943844211 +0000 UTC m=+0.015921141 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:12:19.174 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 podman[90383]: 2024-09-17 01:12:19.049491248 +0000 UTC m=+0.121568164 container create 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T01:12:19.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.217+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc834105680 con 0x7fc81c06e5f0 2024-09-17T01:12:19.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.219+0000 7fc832ffd640 1 -- 172.21.15.103:0/4025597326 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc834105680 con 0x7fc81c06e5f0 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:12:19.218 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:12:19.219 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "9/23 daemons upgraded", 2024-09-17T01:12:19.219 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:12:19.219 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:12:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc81c06e5f0 msgr2=0x7fc81c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc81c06e5f0 0x7fc81c070ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc834100b90 tx=0x7fc82c009110 comp rx=0 tx=0).stop 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 msgr2=0x7fc834195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc834195c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc828005640 tx=0x7fc828005670 comp rx=0 tx=0).stop 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 shutdown_connections 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc81c06e5f0 0x7fc81c070ab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc834100d30 0x7fc834195c50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 --2- 172.21.15.103:0/4025597326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8340ffb30 0x7fc834195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 >> 172.21.15.103:0/4025597326 conn(0x7fc8340fb2c0 msgr2=0x7fc834103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 shutdown_connections 2024-09-17T01:12:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.221+0000 7fc83c057640 1 -- 172.21.15.103:0/4025597326 wait complete. 2024-09-17T01:12:19.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 -- 172.21.15.103:0/821901736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40ffc30 msgr2=0x7fefe41000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 --2- 172.21.15.103:0/821901736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40ffc30 0x7fefe41000b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009880 tx=0x7fefe002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 -- 172.21.15.103:0/821901736 shutdown_connections 2024-09-17T01:12:19.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 --2- 172.21.15.103:0/821901736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40ffc30 0x7fefe41000b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 --2- 172.21.15.103:0/821901736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefe40fea30 0x7fefe40fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 -- 172.21.15.103:0/821901736 >> 172.21.15.103:0/821901736 conn(0x7fefe40fa1c0 msgr2=0x7fefe40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:19.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 -- 172.21.15.103:0/821901736 shutdown_connections 2024-09-17T01:12:19.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.302+0000 7fefec6cd640 1 -- 172.21.15.103:0/821901736 wait complete. 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefec6cd640 1 Processor -- start 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefec6cd640 1 -- start start 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefec6cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 0x7fefe4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefec6cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefe40ffc30 0x7fefe419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefec6cd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe419a930 con 0x7fefe40fea30 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefec6cd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe419aa70 con 0x7fefe40ffc30 2024-09-17T01:12:19.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefea469640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 0x7fefe4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefea469640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 0x7fefe4068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57658/0 (socket says 172.21.15.103:57658) 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefea469640 1 -- 172.21.15.103:0/997425916 learned_addr learned my addr 172.21.15.103:0/997425916 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefe9c68640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefe40ffc30 0x7fefe419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefea469640 1 -- 172.21.15.103:0/997425916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefe40ffc30 msgr2=0x7fefe419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefea469640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefe40ffc30 0x7fefe419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.303+0000 7fefea469640 1 -- 172.21.15.103:0/997425916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0009560 con 0x7fefe40fea30 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.304+0000 7fefea469640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 0x7fefe4068740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fefd800e940 tx=0x7fefd800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.304+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd80096e0 con 0x7fefe40fea30 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.304+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe419ad20 con 0x7fefe40fea30 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.304+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefd80044f0 con 0x7fefe40fea30 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.304+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd8010430 con 0x7fefe40fea30 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.304+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe419b2c0 con 0x7fefe40fea30 2024-09-17T01:12:19.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.305+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe4107640 con 0x7fefe40fea30 2024-09-17T01:12:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.306+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fefd800cc90 con 0x7fefe40fea30 2024-09-17T01:12:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.306+0000 7fefd77fe640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fefd006e5f0 0x7fefd0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.306+0000 7fefe9c68640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fefd006e5f0 0x7fefd0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.306+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6832+0+0 (secure 0 0 0) 0x7fefd8014070 con 0x7fefe40fea30 2024-09-17T01:12:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.307+0000 7fefe9c68640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fefd006e5f0 0x7fefd0070ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefe0000c00 tx=0x7fefe00314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:19.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.311+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fefd8057c80 con 0x7fefe40fea30 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.545+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fefe4107860 con 0x7fefe40fea30 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.546+0000 7fefd77fe640 1 -- 172.21.15.103:0/997425916 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+546 (secure 0 0 0) 0x7fefd805b340 con 0x7fefe40fea30 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 14/225 objects degraded (6.222%), 5 pgs degraded 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: osd.3 (root=default,host=smithi143) is down 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 14/225 objects degraded (6.222%), 5 pgs degraded 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-17T01:12:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-17T01:12:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-17T01:12:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fefd006e5f0 msgr2=0x7fefd0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fefd006e5f0 0x7fefd0070ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefe0000c00 tx=0x7fefe00314e0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 msgr2=0x7fefe4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 0x7fefe4068740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fefd800e940 tx=0x7fefd800ee00 comp rx=0 tx=0).stop 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 shutdown_connections 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fefd006e5f0 0x7fefd0070ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefe40ffc30 0x7fefe419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 --2- 172.21.15.103:0/997425916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe40fea30 0x7fefe4068740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:19.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 >> 172.21.15.103:0/997425916 conn(0x7fefe40fa1c0 msgr2=0x7fefe4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:19.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 shutdown_connections 2024-09-17T01:12:19.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:19.548+0000 7fefec6cd640 1 -- 172.21.15.103:0/997425916 wait complete. 2024-09-17T01:12:19.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 podman[90383]: 2024-09-17 01:12:19.277502851 +0000 UTC m=+0.349579773 container init 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:12:19.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 podman[90383]: 2024-09-17 01:12:19.280580988 +0000 UTC m=+0.352657909 container start 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-17T01:12:19.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-osd[90402]: -- 172.21.15.143:0/2624604372 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d26ee41e0 con 0x562d26091c00 2024-09-17T01:12:19.758 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 bash[90383]: 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 2024-09-17T01:12:19.758 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:19 smithi143 systemd[1]: Started Ceph osd.3 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:12:20.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-mon[80685]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:20.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-mon[80685]: osdmap e67: 6 total, 5 up, 6 in 2024-09-17T01:12:20.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:20.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:20.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:20.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:19 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/997425916' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:20.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:19 smithi103 ceph-mon[92733]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:20.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:19 smithi103 ceph-mon[92733]: osdmap e67: 6 total, 5 up, 6 in 2024-09-17T01:12:20.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:20.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:20.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:20.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:19 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/997425916' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:21.217 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:21 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[90398]: 2024-09-17T01:12:21.161+0000 7f4186493640 -1 Falling back to public interface 2024-09-17T01:12:21.218 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:20 smithi143 ceph-mon[80685]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.218 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:20 smithi143 ceph-mon[80685]: pgmap v113: 65 pgs: 18 active+undersized, 2 stale+active+clean, 18 active+undersized+degraded, 27 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/225 objects degraded (24.000%) 2024-09-17T01:12:21.218 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:20 smithi143 ceph-mon[80685]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:12:21.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:20 smithi103 ceph-mon[92733]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:20 smithi103 ceph-mon[92733]: pgmap v113: 65 pgs: 18 active+undersized, 2 stale+active+clean, 18 active+undersized+degraded, 27 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/225 objects degraded (24.000%) 2024-09-17T01:12:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:20 smithi103 ceph-mon[92733]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:12:22.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:21 smithi143 ceph-mon[80685]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:12:22.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:21 smithi103 ceph-mon[92733]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:12:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:22 smithi143 ceph-mon[80685]: pgmap v116: 65 pgs: 18 active+undersized, 2 stale+active+clean, 18 active+undersized+degraded, 27 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/225 objects degraded (24.000%) 2024-09-17T01:12:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:22 smithi143 ceph-mon[80685]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:12:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:22 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:23.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:22 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:22 smithi103 ceph-mon[92733]: pgmap v116: 65 pgs: 18 active+undersized, 2 stale+active+clean, 18 active+undersized+degraded, 27 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/225 objects degraded (24.000%) 2024-09-17T01:12:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:22 smithi103 ceph-mon[92733]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:12:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:22 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:24.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:23 smithi143 ceph-mon[80685]: osdmap e71: 6 total, 5 up, 6 in 2024-09-17T01:12:24.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:24.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:24.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:23 smithi143 ceph-mon[80685]: osdmap e72: 6 total, 5 up, 6 in 2024-09-17T01:12:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:23 smithi103 ceph-mon[92733]: osdmap e71: 6 total, 5 up, 6 in 2024-09-17T01:12:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:24.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:23 smithi103 ceph-mon[92733]: osdmap e72: 6 total, 5 up, 6 in 2024-09-17T01:12:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:24 smithi103 ceph-mon[92733]: pgmap v119: 65 pgs: 2 remapped+peering, 4 active+clean+remapped, 17 active+undersized, 1 stale+active+clean, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 2.0 MiB/s, 368 objects/s recovering 2024-09-17T01:12:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:24 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 52/225 objects degraded (23.111%), 17 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:25.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:24 smithi143 ceph-mon[80685]: pgmap v119: 65 pgs: 2 remapped+peering, 4 active+clean+remapped, 17 active+undersized, 1 stale+active+clean, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 2.0 MiB/s, 368 objects/s recovering 2024-09-17T01:12:25.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:24 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 52/225 objects degraded (23.111%), 17 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:27.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: pgmap v121: 65 pgs: 2 remapped+peering, 4 active+clean+remapped, 17 active+undersized, 1 stale+active+clean, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 418 B/s rd, 0 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 1.6 MiB/s, 301 objects/s recovering 2024-09-17T01:12:27.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:27.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: pgmap v121: 65 pgs: 2 remapped+peering, 4 active+clean+remapped, 17 active+undersized, 1 stale+active+clean, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 418 B/s rd, 0 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 1.6 MiB/s, 301 objects/s recovering 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:27.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:27.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:27.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:27.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:27.757 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:27 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[90398]: 2024-09-17T01:12:27.317+0000 7f4186493640 -1 osd.3 63 log_to_monitors true 2024-09-17T01:12:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:27 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:27 smithi143 ceph-mon[80685]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-17T01:12:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:27 smithi143 ceph-mon[80685]: from='osd.3 [v2:172.21.15.143:6800/3400539552,v1:172.21.15.143:6801/3400539552]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:12:28.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:27 smithi143 ceph-mon[80685]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:12:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:27 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:27 smithi103 ceph-mon[92733]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-17T01:12:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:27 smithi103 ceph-mon[92733]: from='osd.3 [v2:172.21.15.143:6800/3400539552,v1:172.21.15.143:6801/3400539552]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:12:28.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:27 smithi103 ceph-mon[92733]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:12:29.257 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[90398]: 2024-09-17T01:12:28.777+0000 7f417a225640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:12:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-mon[80685]: pgmap v122: 65 pgs: 2 remapped+peering, 4 active+clean+remapped, 17 active+undersized, 1 stale+active+clean, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 1.3 MiB/s, 245 objects/s recovering 2024-09-17T01:12:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-mon[80685]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:12:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-mon[80685]: from='osd.3 [v2:172.21.15.143:6800/3400539552,v1:172.21.15.143:6801/3400539552]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:12:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-mon[80685]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T01:12:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-mon[80685]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:12:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:28 smithi143 ceph-mon[80685]: from='osd.3 ' entity='osd.3' 2024-09-17T01:12:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:28 smithi103 ceph-mon[92733]: pgmap v122: 65 pgs: 2 remapped+peering, 4 active+clean+remapped, 17 active+undersized, 1 stale+active+clean, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 1.3 MiB/s, 245 objects/s recovering 2024-09-17T01:12:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:28 smithi103 ceph-mon[92733]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:12:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:28 smithi103 ceph-mon[92733]: from='osd.3 [v2:172.21.15.143:6800/3400539552,v1:172.21.15.143:6801/3400539552]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:12:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:28 smithi103 ceph-mon[92733]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T01:12:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:28 smithi103 ceph-mon[92733]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:12:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:28 smithi103 ceph-mon[92733]: from='osd.3 ' entity='osd.3' 2024-09-17T01:12:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:29 smithi103 ceph-mon[92733]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:29 smithi103 ceph-mon[92733]: osd.3 [v2:172.21.15.143:6800/3400539552,v1:172.21.15.143:6801/3400539552] boot 2024-09-17T01:12:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:29 smithi103 ceph-mon[92733]: osdmap e74: 6 total, 6 up, 6 in 2024-09-17T01:12:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:12:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:29 smithi103 ceph-mon[92733]: osdmap e75: 6 total, 6 up, 6 in 2024-09-17T01:12:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:29 smithi143 ceph-mon[80685]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:29 smithi143 ceph-mon[80685]: osd.3 [v2:172.21.15.143:6800/3400539552,v1:172.21.15.143:6801/3400539552] boot 2024-09-17T01:12:30.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:29 smithi143 ceph-mon[80685]: osdmap e74: 6 total, 6 up, 6 in 2024-09-17T01:12:30.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:12:30.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:29 smithi143 ceph-mon[80685]: osdmap e75: 6 total, 6 up, 6 in 2024-09-17T01:12:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:31 smithi143 ceph-mon[80685]: pgmap v125: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 0 B/s, 113 objects/s recovering 2024-09-17T01:12:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:31 smithi143 ceph-mon[80685]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T01:12:31.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:31 smithi103 ceph-mon[92733]: pgmap v125: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 0 B/s, 113 objects/s recovering 2024-09-17T01:12:31.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:31 smithi103 ceph-mon[92733]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T01:12:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:33 smithi103 ceph-mon[92733]: pgmap v128: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 0 B/s, 169 objects/s recovering 2024-09-17T01:12:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:33 smithi103 ceph-mon[92733]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:12:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:33 smithi143 ceph-mon[80685]: pgmap v128: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 52/225 objects degraded (23.111%); 5/225 objects misplaced (2.222%); 0 B/s, 169 objects/s recovering 2024-09-17T01:12:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:33 smithi143 ceph-mon[80685]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:12:33.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:33.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:34 smithi103 ceph-mon[92733]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:34 smithi103 ceph-mon[92733]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:12:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:34 smithi143 ceph-mon[80685]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:12:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:34 smithi143 ceph-mon[80685]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:12:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:35 smithi103 ceph-mon[92733]: pgmap v131: 65 pgs: 2 peering, 63 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 1024 KiB/s, 185 objects/s recovering 2024-09-17T01:12:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:35 smithi103 ceph-mon[92733]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/225 objects degraded (23.111%), 17 pgs degraded) 2024-09-17T01:12:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:35 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:12:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:35 smithi143 ceph-mon[80685]: pgmap v131: 65 pgs: 2 peering, 63 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 1024 KiB/s, 185 objects/s recovering 2024-09-17T01:12:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:35 smithi143 ceph-mon[80685]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/225 objects degraded (23.111%), 17 pgs degraded) 2024-09-17T01:12:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:35 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:12:37.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:37 smithi103 ceph-mon[92733]: pgmap v133: 65 pgs: 2 peering, 63 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 631 B/s rd, 1 op/s; 842 KiB/s, 152 objects/s recovering 2024-09-17T01:12:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:37 smithi143 ceph-mon[80685]: pgmap v133: 65 pgs: 2 peering, 63 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 631 B/s rd, 1 op/s; 842 KiB/s, 152 objects/s recovering 2024-09-17T01:12:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:39 smithi103 ceph-mon[92733]: pgmap v134: 65 pgs: 1 peering, 64 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 683 KiB/s, 123 objects/s recovering 2024-09-17T01:12:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:39 smithi143 ceph-mon[80685]: pgmap v134: 65 pgs: 1 peering, 64 active+clean; 204 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 683 KiB/s, 123 objects/s recovering 2024-09-17T01:12:41.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:41 smithi103 ceph-mon[92733]: pgmap v135: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 522 KiB/s, 94 objects/s recovering 2024-09-17T01:12:41.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:41 smithi143 ceph-mon[80685]: pgmap v135: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 522 KiB/s, 94 objects/s recovering 2024-09-17T01:12:42.151 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:42 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:42.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:42 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:43.308 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:43 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:43.309 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:43 smithi143 ceph-mon[80685]: Upgrade: osd.4 is safe to restart 2024-09-17T01:12:43.309 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:43 smithi143 ceph-mon[80685]: pgmap v136: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 925 B/s rd, 1 op/s 2024-09-17T01:12:43.309 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:43.309 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:12:43.309 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:43 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:43 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:12:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:43 smithi103 ceph-mon[92733]: Upgrade: osd.4 is safe to restart 2024-09-17T01:12:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:43 smithi103 ceph-mon[92733]: pgmap v136: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 925 B/s rd, 1 op/s 2024-09-17T01:12:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:12:43.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:43 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.290 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:44 smithi143 ceph-mon[80685]: Upgrade: Updating osd.4 2024-09-17T01:12:44.290 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:44 smithi143 ceph-mon[80685]: Deploying daemon osd.4 on smithi143 2024-09-17T01:12:44.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:44 smithi103 ceph-mon[92733]: Upgrade: Updating osd.4 2024-09-17T01:12:44.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:44 smithi103 ceph-mon[92733]: Deploying daemon osd.4 on smithi143 2024-09-17T01:12:45.248 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:45 smithi143 ceph-mon[80685]: pgmap v137: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-17T01:12:45.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:45 smithi103 ceph-mon[92733]: pgmap v137: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-17T01:12:46.139 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:45 smithi143 systemd[1]: Stopping Ceph osd.4 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:12:46.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:46 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[48272]: 2024-09-17T01:12:46.163+0000 7fd577776640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:12:46.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:46 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[48272]: 2024-09-17T01:12:46.163+0000 7fd577776640 -1 osd.4 79 *** Got signal Terminated *** 2024-09-17T01:12:46.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:46 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[48272]: 2024-09-17T01:12:46.163+0000 7fd577776640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:12:47.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:47 smithi103 ceph-mon[92733]: pgmap v138: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 777 B/s rd, 1 op/s 2024-09-17T01:12:47.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:47 smithi103 ceph-mon[92733]: osd.4 marked itself down and dead 2024-09-17T01:12:47.475 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:47 smithi143 ceph-mon[80685]: pgmap v138: 65 pgs: 65 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 777 B/s rd, 1 op/s 2024-09-17T01:12:47.476 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:47 smithi143 ceph-mon[80685]: osd.4 marked itself down and dead 2024-09-17T01:12:47.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:47 smithi143 podman[95273]: 2024-09-17 01:12:47.477703086 +0000 UTC m=+1.430834803 container died e4eeac2d4f1edbceb73a8080ba844940d81a4fbbe6446f62a44867585fb205e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:48.056 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:47 smithi143 podman[95273]: 2024-09-17 01:12:47.897940406 +0000 UTC m=+1.851072122 container cleanup e4eeac2d4f1edbceb73a8080ba844940d81a4fbbe6446f62a44867585fb205e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T01:12:48.057 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:47 smithi143 bash[95273]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:12:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:48 smithi103 ceph-mon[92733]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:48 smithi103 ceph-mon[92733]: osdmap e80: 6 total, 5 up, 6 in 2024-09-17T01:12:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:48 smithi103 ceph-mon[92733]: osdmap e81: 6 total, 5 up, 6 in 2024-09-17T01:12:48.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:48 smithi143 podman[95298]: 2024-09-17 01:12:48.124528311 +0000 UTC m=+0.647006729 container remove e4eeac2d4f1edbceb73a8080ba844940d81a4fbbe6446f62a44867585fb205e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b) 2024-09-17T01:12:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:48 smithi143 ceph-mon[80685]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:48.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:48 smithi143 ceph-mon[80685]: osdmap e80: 6 total, 5 up, 6 in 2024-09-17T01:12:48.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:48.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:48.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:48.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:48 smithi143 ceph-mon[80685]: osdmap e81: 6 total, 5 up, 6 in 2024-09-17T01:12:48.817 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:48 smithi143 podman[95389]: 2024-09-17 01:12:48.452884956 +0000 UTC m=+0.015902080 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:12:48.817 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:48 smithi143 podman[95389]: 2024-09-17 01:12:48.583890282 +0000 UTC m=+0.146907404 container create b1b4c13157c84a36a37f4785c88f73233ff2987abfd749eda90b92cd5c1799c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97) 2024-09-17T01:12:48.818 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:48 smithi143 podman[95389]: 2024-09-17 01:12:48.820158234 +0000 UTC m=+0.383175362 container init b1b4c13157c84a36a37f4785c88f73233ff2987abfd749eda90b92cd5c1799c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T01:12:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:49 smithi143 ceph-mon[80685]: pgmap v140: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-17T01:12:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:49 smithi143 ceph-mon[80685]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:12:49.258 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:48 smithi143 podman[95389]: 2024-09-17 01:12:48.823498352 +0000 UTC m=+0.386515484 container start b1b4c13157c84a36a37f4785c88f73233ff2987abfd749eda90b92cd5c1799c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-17T01:12:49.258 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:48 smithi143 podman[95389]: 2024-09-17 01:12:48.928557908 +0000 UTC m=+0.491575039 container attach b1b4c13157c84a36a37f4785c88f73233ff2987abfd749eda90b92cd5c1799c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:12:49.258 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:49 smithi143 podman[95389]: 2024-09-17 01:12:49.019818173 +0000 UTC m=+0.582835295 container died b1b4c13157c84a36a37f4785c88f73233ff2987abfd749eda90b92cd5c1799c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97) 2024-09-17T01:12:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:49 smithi103 ceph-mon[92733]: pgmap v140: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-17T01:12:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:49 smithi103 ceph-mon[92733]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:12:49.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.643+0000 7f357a34c640 1 -- 172.21.15.103:0/2617224065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574102f70 msgr2=0x7f3574105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.643+0000 7f357a34c640 1 --2- 172.21.15.103:0/2617224065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574102f70 0x7f3574105360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3568009880 tx=0x7f356802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.643+0000 7f357a34c640 1 -- 172.21.15.103:0/2617224065 shutdown_connections 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.643+0000 7f357a34c640 1 --2- 172.21.15.103:0/2617224065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574102f70 0x7f3574105360 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.643+0000 7f357a34c640 1 --2- 172.21.15.103:0/2617224065 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3574100640 0x7f3574102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.643+0000 7f357a34c640 1 -- 172.21.15.103:0/2617224065 >> 172.21.15.103:0/2617224065 conn(0x7f35740fa1c0 msgr2=0x7f35740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.644+0000 7f357a34c640 1 -- 172.21.15.103:0/2617224065 shutdown_connections 2024-09-17T01:12:49.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.644+0000 7f357a34c640 1 -- 172.21.15.103:0/2617224065 wait complete. 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.644+0000 7f357a34c640 1 Processor -- start 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.644+0000 7f357a34c640 1 -- start start 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f357a34c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 0x7f3574195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f357a34c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3574102f70 0x7f3574195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f357a34c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574196140 con 0x7f3574100640 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f357a34c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741962b0 con 0x7f3574102f70 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 0x7f3574195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 0x7f3574195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57806/0 (socket says 172.21.15.103:57806) 2024-09-17T01:12:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 -- 172.21.15.103:0/1340252322 learned_addr learned my addr 172.21.15.103:0/1340252322 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f35737fe640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3574102f70 0x7f3574195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 -- 172.21.15.103:0/1340252322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3574102f70 msgr2=0x7f3574195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3574102f70 0x7f3574195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 -- 172.21.15.103:0/1340252322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568009560 con 0x7f3574100640 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f3573fff640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 0x7f3574195630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f356400e9a0 tx=0x7f356400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.645+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356400cc90 con 0x7f3574100640 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.646+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f356400cdf0 con 0x7f3574100640 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.646+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357419ad00 con 0x7f3574100640 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.646+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35640187f0 con 0x7f3574100640 2024-09-17T01:12:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.646+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357419b240 con 0x7f3574100640 2024-09-17T01:12:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.647+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3574108710 con 0x7f3574100640 2024-09-17T01:12:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.647+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3564010c10 con 0x7f3574100640 2024-09-17T01:12:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.648+0000 7f35717fa640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f355c06e5f0 0x7f355c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.648+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f3564014070 con 0x7f3574100640 2024-09-17T01:12:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.648+0000 7f35737fe640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f355c06e5f0 0x7f355c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.648+0000 7f35737fe640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f355c06e5f0 0x7f355c070ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3568009230 tx=0x7f35680314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:49.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.652+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f35640541b0 con 0x7f3574100640 2024-09-17T01:12:49.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.836+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f357419b4c0 con 0x7f355c06e5f0 2024-09-17T01:12:49.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.838+0000 7f35717fa640 1 -- 172.21.15.103:0/1340252322 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f357419b4c0 con 0x7f355c06e5f0 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f355c06e5f0 msgr2=0x7f355c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f355c06e5f0 0x7f355c070ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3568009230 tx=0x7f35680314e0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 msgr2=0x7f3574195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 0x7f3574195630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f356400e9a0 tx=0x7f356400ee60 comp rx=0 tx=0).stop 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 shutdown_connections 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f355c06e5f0 0x7f355c070ab0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3574102f70 0x7f3574195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 --2- 172.21.15.103:0/1340252322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3574100640 0x7f3574195630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 >> 172.21.15.103:0/1340252322 conn(0x7f35740fa1c0 msgr2=0x7f35740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:49.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 shutdown_connections 2024-09-17T01:12:49.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.840+0000 7f357a34c640 1 -- 172.21.15.103:0/1340252322 wait complete. 2024-09-17T01:12:49.847 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.922+0000 7fe0e4766640 1 -- 172.21.15.103:0/4060227544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 msgr2=0x7fe0dc0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.922+0000 7fe0e4766640 1 --2- 172.21.15.103:0/4060227544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc0feea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009880 tx=0x7fe0d802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- 172.21.15.103:0/4060227544 shutdown_connections 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 --2- 172.21.15.103:0/4060227544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0dc0ffca0 0x7fe0dc100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 --2- 172.21.15.103:0/4060227544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc0feea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- 172.21.15.103:0/4060227544 >> 172.21.15.103:0/4060227544 conn(0x7fe0dc0fa230 msgr2=0x7fe0dc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- 172.21.15.103:0/4060227544 shutdown_connections 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- 172.21.15.103:0/4060227544 wait complete. 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 Processor -- start 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- start start 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0dc0ffca0 0x7fe0dc197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc198310 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e4766640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc198480 con 0x7fe0dc0ffca0 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e2502640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.923+0000 7fe0e2502640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57830/0 (socket says 172.21.15.103:57830) 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e2502640 1 -- 172.21.15.103:0/3273679636 learned_addr learned my addr 172.21.15.103:0/3273679636 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e1d01640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0dc0ffca0 0x7fe0dc197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e2502640 1 -- 172.21.15.103:0/3273679636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0dc0ffca0 msgr2=0x7fe0dc197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e2502640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0dc0ffca0 0x7fe0dc197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e2502640 1 -- 172.21.15.103:0/3273679636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009560 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e2502640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc197800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80054f0 tx=0x7fe0d8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d8004aa0 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0d8004c00 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d8003ac0 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc19cec0 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.924+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc19d3b0 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.926+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc106150 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.926+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe0d8003d30 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.926+0000 7fe0d37fe640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0c806e5f0 0x7fe0c8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:49.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.926+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe0d80af830 con 0x7fe0dc0feaa0 2024-09-17T01:12:49.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.927+0000 7fe0e1d01640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0c806e5f0 0x7fe0c8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:49.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.927+0000 7fe0e1d01640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0c806e5f0 0x7fe0c8070ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc198d20 tx=0x7fe0cc00b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:49.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:49.931+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe0d80789e0 con 0x7fe0dc0feaa0 2024-09-17T01:12:50.007 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:49 smithi143 podman[95412]: 2024-09-17 01:12:49.615588641 +0000 UTC m=+0.585370387 container remove b1b4c13157c84a36a37f4785c88f73233ff2987abfd749eda90b92cd5c1799c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T01:12:50.007 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:49 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T01:12:50.008 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:49 smithi143 systemd[1]: Stopped Ceph osd.4 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:12:50.008 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:49 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 6.546s CPU time. 2024-09-17T01:12:50.008 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:49 smithi143 systemd[1]: Starting Ceph osd.4 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:12:50.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.115+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0dc02c4f0 con 0x7fe0c806e5f0 2024-09-17T01:12:50.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.116+0000 7fe0d37fe640 1 -- 172.21.15.103:0/3273679636 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe0dc02c4f0 con 0x7fe0c806e5f0 2024-09-17T01:12:50.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0c806e5f0 msgr2=0x7fe0c8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0c806e5f0 0x7fe0c8070ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc198d20 tx=0x7fe0cc00b390 comp rx=0 tx=0).stop 2024-09-17T01:12:50.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 msgr2=0x7fe0dc197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc197800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80054f0 tx=0x7fe0d8005520 comp rx=0 tx=0).stop 2024-09-17T01:12:50.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 shutdown_connections 2024-09-17T01:12:50.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0c806e5f0 0x7fe0c8070ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0dc0ffca0 0x7fe0dc197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 --2- 172.21.15.103:0/3273679636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0dc0feaa0 0x7fe0dc197800 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 >> 172.21.15.103:0/3273679636 conn(0x7fe0dc0fa230 msgr2=0x7fe0dc103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 shutdown_connections 2024-09-17T01:12:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.118+0000 7fe0e4766640 1 -- 172.21.15.103:0/3273679636 wait complete. 2024-09-17T01:12:50.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:50 smithi103 ceph-mon[92733]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:50 smithi103 ceph-mon[92733]: pgmap v142: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 7/225 objects degraded (3.111%) 2024-09-17T01:12:50.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:50 smithi103 ceph-mon[92733]: Health check failed: Degraded data redundancy: 7/225 objects degraded (3.111%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 -- 172.21.15.103:0/1502864262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 msgr2=0x7f02380fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 --2- 172.21.15.103:0/1502864262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f02380fee80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0228009880 tx=0x7f022802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 -- 172.21.15.103:0/1502864262 shutdown_connections 2024-09-17T01:12:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 --2- 172.21.15.103:0/1502864262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02380ffc80 0x7f0238100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 --2- 172.21.15.103:0/1502864262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f02380fee80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 -- 172.21.15.103:0/1502864262 >> 172.21.15.103:0/1502864262 conn(0x7f02380fa230 msgr2=0x7f02380fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 -- 172.21.15.103:0/1502864262 shutdown_connections 2024-09-17T01:12:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 -- 172.21.15.103:0/1502864262 wait complete. 2024-09-17T01:12:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.200+0000 7f023e1e5640 1 Processor -- start 2024-09-17T01:12:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f023e1e5640 1 -- start start 2024-09-17T01:12:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f023e1e5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f0238068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f023e1e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02380ffc80 0x7f023819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f023e1e5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023819a8b0 con 0x7f02380fea80 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f023e1e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023819aa20 con 0x7f02380ffc80 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f0238068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f0238068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57846/0 (socket says 172.21.15.103:57846) 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 -- 172.21.15.103:0/2369668611 learned_addr learned my addr 172.21.15.103:0/2369668611 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f0236ffd640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02380ffc80 0x7f023819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 -- 172.21.15.103:0/2369668611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02380ffc80 msgr2=0x7f023819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02380ffc80 0x7f023819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 -- 172.21.15.103:0/2369668611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009560 con 0x7f02380fea80 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.201+0000 7f02377fe640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f0238068f10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f022802a9c0 tx=0x7f02280054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.202+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0228004aa0 con 0x7f02380fea80 2024-09-17T01:12:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.202+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0228004c00 con 0x7f02380fea80 2024-09-17T01:12:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.202+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023819aca0 con 0x7f02380fea80 2024-09-17T01:12:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.202+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0228003a80 con 0x7f02380fea80 2024-09-17T01:12:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.202+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023819b190 con 0x7f02380fea80 2024-09-17T01:12:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.203+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023818e600 con 0x7f02380fea80 2024-09-17T01:12:50.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.203+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0228003cf0 con 0x7f02380fea80 2024-09-17T01:12:50.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.204+0000 7f0234ff9640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f022006e5f0 0x7f0220070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.204+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f02280af840 con 0x7f02380fea80 2024-09-17T01:12:50.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.204+0000 7f0236ffd640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f022006e5f0 0x7f0220070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.204+0000 7f0236ffd640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f022006e5f0 0x7f0220070ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0238068c90 tx=0x7f022c00b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.208+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0228078960 con 0x7f02380fea80 2024-09-17T01:12:50.325 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:50 smithi143 ceph-mon[80685]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:50.326 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:50 smithi143 ceph-mon[80685]: pgmap v142: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 7/225 objects degraded (3.111%) 2024-09-17T01:12:50.326 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:50 smithi143 ceph-mon[80685]: Health check failed: Degraded data redundancy: 7/225 objects degraded (3.111%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:50.326 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 podman[95512]: 2024-09-17 01:12:49.962789933 +0000 UTC m=+0.015689925 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:12:50.326 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 podman[95512]: 2024-09-17 01:12:50.092367089 +0000 UTC m=+0.145267067 container create 30dde63ccb26ba8c22dba5bf5b9959274409940ed53b9bc0a949ec833655d576 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:12:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.411+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f023802c590 con 0x7f022006e5f0 2024-09-17T01:12:50.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.421+0000 7f0234ff9640 1 -- 172.21.15.103:0/2369668611 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f023802c590 con 0x7f022006e5f0 2024-09-17T01:12:50.419 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:12:50.420 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (12m) 60s ago 13m 24.5M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:12:50.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (13m) 60s ago 13m 8887k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:12:50.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (13m) 27s ago 13m 8019k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:12:50.420 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (2m) 60s ago 13m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:12:50.420 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (2m) 27s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:12:50.420 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (12m) 60s ago 13m 86.5M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:12:50.421 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (8m) 60s ago 8m 148M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:12:50.421 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (8m) 60s ago 8m 90.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:12:50.421 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (8m) 27s ago 8m 16.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:12:50.421 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (8m) 27s ago 8m 17.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:12:50.422 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (4m) 60s ago 15m 500M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:12:50.422 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (3m) 27s ago 12m 440M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:12:50.422 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (3m) 60s ago 15m 48.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:12:50.422 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (3m) 27s ago 12m 38.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:12:50.422 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (13m) 60s ago 13m 16.0M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:12:50.422 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (12m) 27s ago 12m 16.0M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (2m) 60s ago 12m 92.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (101s) 60s ago 11m 100M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (66s) 60s ago 11m 14.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (31s) 27s ago 10m 11.5M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (10m) 27s ago 10m 269M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 e4eeac2d4f1e 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (9m) 27s ago 9m 233M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:12:50.423 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (3m) 60s ago 13m 65.1M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:12:50.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f022006e5f0 msgr2=0x7f0220070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f022006e5f0 0x7f0220070ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0238068c90 tx=0x7f022c00b410 comp rx=0 tx=0).stop 2024-09-17T01:12:50.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 msgr2=0x7f0238068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f0238068f10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f022802a9c0 tx=0x7f02280054f0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 shutdown_connections 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f022006e5f0 0x7f0220070ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02380ffc80 0x7f023819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 --2- 172.21.15.103:0/2369668611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02380fea80 0x7f0238068f10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 >> 172.21.15.103:0/2369668611 conn(0x7f02380fa230 msgr2=0x7f0238103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 shutdown_connections 2024-09-17T01:12:50.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.423+0000 7f023e1e5640 1 -- 172.21.15.103:0/2369668611 wait complete. 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.503+0000 7fcf47de0640 1 -- 172.21.15.103:0/1303271860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400ffc30 msgr2=0x7fcf401000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.503+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1303271860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400ffc30 0x7fcf401000b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009880 tx=0x7fcf3402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- 172.21.15.103:0/1303271860 shutdown_connections 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1303271860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400ffc30 0x7fcf401000b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1303271860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf400fea30 0x7fcf400fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- 172.21.15.103:0/1303271860 >> 172.21.15.103:0/1303271860 conn(0x7fcf400fa1c0 msgr2=0x7fcf400fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- 172.21.15.103:0/1303271860 shutdown_connections 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- 172.21.15.103:0/1303271860 wait complete. 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 Processor -- start 2024-09-17T01:12:50.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- start start 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 0x7fcf40195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf400ffc30 0x7fcf40195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40196160 con 0x7fcf400fea30 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.504+0000 7fcf47de0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401962d0 con 0x7fcf400ffc30 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 0x7fcf40195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 0x7fcf40195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57878/0 (socket says 172.21.15.103:57878) 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 -- 172.21.15.103:0/1895309667 learned_addr learned my addr 172.21.15.103:0/1895309667 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf4537b640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf400ffc30 0x7fcf40195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 -- 172.21.15.103:0/1895309667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf400ffc30 msgr2=0x7fcf40195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf400ffc30 0x7fcf40195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 -- 172.21.15.103:0/1895309667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009560 con 0x7fcf400fea30 2024-09-17T01:12:50.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf45b7c640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 0x7fcf40195650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000d900 tx=0x7fcf3000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf30009c00 con 0x7fcf400fea30 2024-09-17T01:12:50.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf30009d60 con 0x7fcf400fea30 2024-09-17T01:12:50.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4019ad70 con 0x7fcf400fea30 2024-09-17T01:12:50.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3000f7b0 con 0x7fcf400fea30 2024-09-17T01:12:50.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.505+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4019b230 con 0x7fcf400fea30 2024-09-17T01:12:50.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.506+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf40107620 con 0x7fcf400fea30 2024-09-17T01:12:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.507+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcf30010460 con 0x7fcf400fea30 2024-09-17T01:12:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.508+0000 7fcf3effd640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcf2806e5f0 0x7fcf28070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.508+0000 7fcf4537b640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcf2806e5f0 0x7fcf28070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.508+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fcf3008e990 con 0x7fcf400fea30 2024-09-17T01:12:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.508+0000 7fcf4537b640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcf2806e5f0 0x7fcf28070ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf34000c00 tx=0x7fcf340314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.513+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf30057a90 con 0x7fcf400fea30 2024-09-17T01:12:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.744+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf4019b8d0 con 0x7fcf400fea30 2024-09-17T01:12:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.744+0000 7fcf3effd640 1 -- 172.21.15.103:0/1895309667 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fcf3005b150 con 0x7fcf400fea30 2024-09-17T01:12:50.742 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:12:50.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:12:50.744 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:12:50.744 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 5, 2024-09-17T01:12:50.744 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:12:50.744 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:12:50.744 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcf2806e5f0 msgr2=0x7fcf28070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcf2806e5f0 0x7fcf28070ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf34000c00 tx=0x7fcf340314e0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 msgr2=0x7fcf40195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 0x7fcf40195650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000d900 tx=0x7fcf3000ddc0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 shutdown_connections 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fcf2806e5f0 0x7fcf28070ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf400ffc30 0x7fcf40195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 --2- 172.21.15.103:0/1895309667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf400fea30 0x7fcf40195650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.746+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 >> 172.21.15.103:0/1895309667 conn(0x7fcf400fa1c0 msgr2=0x7fcf400fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.747+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 shutdown_connections 2024-09-17T01:12:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.747+0000 7fcf47de0640 1 -- 172.21.15.103:0/1895309667 wait complete. 2024-09-17T01:12:50.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 podman[95512]: 2024-09-17 01:12:50.328301102 +0000 UTC m=+0.381201084 container init 30dde63ccb26ba8c22dba5bf5b9959274409940ed53b9bc0a949ec833655d576 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:12:50.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 podman[95512]: 2024-09-17 01:12:50.33158978 +0000 UTC m=+0.384489755 container start 30dde63ccb26ba8c22dba5bf5b9959274409940ed53b9bc0a949ec833655d576 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97) 2024-09-17T01:12:50.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 podman[95512]: 2024-09-17 01:12:50.436831101 +0000 UTC m=+0.489731079 container attach 30dde63ccb26ba8c22dba5bf5b9959274409940ed53b9bc0a949ec833655d576 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:12:50.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:50.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 bash[95512]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:50.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:50.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:50 smithi143 bash[95512]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.827+0000 7f4f9a663640 1 -- 172.21.15.103:0/330310416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940feaa0 msgr2=0x7f4f940feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.827+0000 7f4f9a663640 1 --2- 172.21.15.103:0/330310416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940feaa0 0x7f4f940feea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009880 tx=0x7f4f8402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.827+0000 7f4f9a663640 1 -- 172.21.15.103:0/330310416 shutdown_connections 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.827+0000 7f4f9a663640 1 --2- 172.21.15.103:0/330310416 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940ffca0 0x7f4f94100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.827+0000 7f4f9a663640 1 --2- 172.21.15.103:0/330310416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940feaa0 0x7f4f940feea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.828+0000 7f4f9a663640 1 -- 172.21.15.103:0/330310416 >> 172.21.15.103:0/330310416 conn(0x7f4f940fa230 msgr2=0x7f4f940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.828+0000 7f4f9a663640 1 -- 172.21.15.103:0/330310416 shutdown_connections 2024-09-17T01:12:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.828+0000 7f4f9a663640 1 -- 172.21.15.103:0/330310416 wait complete. 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f9a663640 1 Processor -- start 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f9a663640 1 -- start start 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f9a663640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940feaa0 0x7f4f941956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f9a663640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 0x7f4f94195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f9a663640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941961f0 con 0x7f4f940ffca0 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f9a663640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94196360 con 0x7f4f940feaa0 2024-09-17T01:12:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 0x7f4f94195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 0x7f4f94195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57908/0 (socket says 172.21.15.103:57908) 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f937fe640 1 -- 172.21.15.103:0/1706916243 learned_addr learned my addr 172.21.15.103:0/1706916243 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f93fff640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940feaa0 0x7f4f941956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f937fe640 1 -- 172.21.15.103:0/1706916243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940feaa0 msgr2=0x7f4f941956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f937fe640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940feaa0 0x7f4f941956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f937fe640 1 -- 172.21.15.103:0/1706916243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f84009560 con 0x7f4f940ffca0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.829+0000 7f4f93fff640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940feaa0 0x7f4f941956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.830+0000 7f4f937fe640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 0x7f4f94195c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800e9a0 tx=0x7f4f8800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.830+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8800cd50 con 0x7f4f940ffca0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.830+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f8800ceb0 con 0x7f4f940ffca0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.830+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9419adb0 con 0x7f4f940ffca0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.830+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f88010660 con 0x7f4f940ffca0 2024-09-17T01:12:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.830+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9419b350 con 0x7f4f940ffca0 2024-09-17T01:12:50.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.831+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940feea0 con 0x7f4f940ffca0 2024-09-17T01:12:50.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.832+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4f880048a0 con 0x7f4f940ffca0 2024-09-17T01:12:50.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.832+0000 7f4f917fa640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f7c06e5f0 0x7f4f7c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.832+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4f88014070 con 0x7f4f940ffca0 2024-09-17T01:12:50.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.832+0000 7f4f93fff640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f7c06e5f0 0x7f4f7c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.833+0000 7f4f93fff640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f7c06e5f0 0x7f4f7c070ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f84031540 tx=0x7f4f84005de0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:50.836+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f88095080 con 0x7f4f940ffca0 2024-09-17T01:12:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.038+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f941076b0 con 0x7f4f940ffca0 2024-09-17T01:12:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.038+0000 7f4f917fa640 1 -- 172.21.15.103:0/1706916243 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7f4f8805b920 con 0x7f4f940ffca0 2024-09-17T01:12:51.036 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:12:51.036 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:12:51.037 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:12:51.038 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:51.039 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:51.040 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:51.040 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:12:51.040 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:12:51.040 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:51.040 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f7c06e5f0 msgr2=0x7f4f7c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f7c06e5f0 0x7f4f7c070ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f84031540 tx=0x7f4f84005de0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 msgr2=0x7f4f94195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 0x7f4f94195c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800e9a0 tx=0x7f4f8800eda0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 shutdown_connections 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f7c06e5f0 0x7f4f7c070ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f940ffca0 0x7f4f94195c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 --2- 172.21.15.103:0/1706916243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f940feaa0 0x7f4f941956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 >> 172.21.15.103:0/1706916243 conn(0x7f4f940fa230 msgr2=0x7f4f940684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:51.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 shutdown_connections 2024-09-17T01:12:51.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.040+0000 7f4f9a663640 1 -- 172.21.15.103:0/1706916243 wait complete. 2024-09-17T01:12:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 -- 172.21.15.103:0/1681714831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40ffc80 msgr2=0x7fb4e4100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/1681714831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40ffc80 0x7fb4e4100100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009880 tx=0x7fb4d402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 -- 172.21.15.103:0/1681714831 shutdown_connections 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/1681714831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40ffc80 0x7fb4e4100100 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/1681714831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40fea80 0x7fb4e40fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 -- 172.21.15.103:0/1681714831 >> 172.21.15.103:0/1681714831 conn(0x7fb4e40fa230 msgr2=0x7fb4e40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 -- 172.21.15.103:0/1681714831 shutdown_connections 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.122+0000 7fb4eb52b640 1 -- 172.21.15.103:0/1681714831 wait complete. 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4eb52b640 1 Processor -- start 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4eb52b640 1 -- start start 2024-09-17T01:12:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4eb52b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 0x7fb4e4102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4eb52b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40ffc80 0x7fb4e4101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4eb52b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41015a0 con 0x7fb4e40fea80 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4eb52b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4101710 con 0x7fb4e40ffc80 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4e92c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 0x7fb4e4102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4e92c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 0x7fb4e4102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57932/0 (socket says 172.21.15.103:57932) 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4e92c7640 1 -- 172.21.15.103:0/2446942401 learned_addr learned my addr 172.21.15.103:0/2446942401 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.123+0000 7fb4e8ac6640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40ffc80 0x7fb4e4101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4e92c7640 1 -- 172.21.15.103:0/2446942401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40ffc80 msgr2=0x7fb4e4101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4e92c7640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40ffc80 0x7fb4e4101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4e92c7640 1 -- 172.21.15.103:0/2446942401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009560 con 0x7fb4e40fea80 2024-09-17T01:12:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4e92c7640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 0x7fb4e4102a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e940 tx=0x7fb4e000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e00096e0 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4e00044f0 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.124+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e41019f0 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.125+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e0010430 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.125+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e419d720 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.126+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e40fee80 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.126+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb4e000cc90 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.126+0000 7fb4da7fc640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.126+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fb4e0014070 con 0x7fb4e40fea80 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.126+0000 7fb4e8ac6640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.127+0000 7fb4e8ac6640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009230 tx=0x7fb4d40058d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.130+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4e0057c10 con 0x7fb4e40fea80 2024-09-17T01:12:51.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.314+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4e4068ba0 con 0x7fb4d006e5f0 2024-09-17T01:12:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.315+0000 7fb4da7fc640 1 -- 172.21.15.103:0/2446942401 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb4e4068ba0 con 0x7fb4d006e5f0 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:12:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:12:51.316 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:12:51.316 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:12:51.316 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "10/23 daemons upgraded", 2024-09-17T01:12:51.316 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:12:51.316 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:12:51.316 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:12:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.317+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4d006e5f0 msgr2=0x7fb4d0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.317+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009230 tx=0x7fb4d40058d0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.317+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 msgr2=0x7fb4e4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.317+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 0x7fb4e4102a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e940 tx=0x7fb4e000ee00 comp rx=0 tx=0).stop 2024-09-17T01:12:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 shutdown_connections 2024-09-17T01:12:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4d006e5f0 0x7fb4d0070ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4e40ffc80 0x7fb4e4101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 --2- 172.21.15.103:0/2446942401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4e40fea80 0x7fb4e4102a10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 >> 172.21.15.103:0/2446942401 conn(0x7fb4e40fa230 msgr2=0x7fb4e4068490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 shutdown_connections 2024-09-17T01:12:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.318+0000 7fb4eb52b640 1 -- 172.21.15.103:0/2446942401 wait complete. 2024-09-17T01:12:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 -- 172.21.15.103:0/2446974833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 msgr2=0x7ff8e80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 --2- 172.21.15.103:0/2446974833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e80fee80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009880 tx=0x7ff8dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 -- 172.21.15.103:0/2446974833 shutdown_connections 2024-09-17T01:12:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 --2- 172.21.15.103:0/2446974833 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8e80ffc80 0x7ff8e8100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 --2- 172.21.15.103:0/2446974833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e80fee80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 -- 172.21.15.103:0/2446974833 >> 172.21.15.103:0/2446974833 conn(0x7ff8e80fa230 msgr2=0x7ff8e80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 -- 172.21.15.103:0/2446974833 shutdown_connections 2024-09-17T01:12:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 -- 172.21.15.103:0/2446974833 wait complete. 2024-09-17T01:12:51.397 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:51 smithi103 ceph-mon[92733]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:51.397 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:51 smithi103 ceph-mon[92733]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:51.397 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:51 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1895309667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:51.397 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:51 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1706916243' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:12:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.398+0000 7ff8ed433640 1 Processor -- start 2024-09-17T01:12:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8ed433640 1 -- start start 2024-09-17T01:12:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8ed433640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8ed433640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8e80ffc80 0x7ff8e819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8ed433640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e81961c0 con 0x7ff8e80fea80 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8ed433640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e819cc90 con 0x7ff8e80ffc80 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e8068f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57948/0 (socket says 172.21.15.103:57948) 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e6ffd640 1 -- 172.21.15.103:0/1772289616 learned_addr learned my addr 172.21.15.103:0/1772289616 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e67fc640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8e80ffc80 0x7ff8e819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e6ffd640 1 -- 172.21.15.103:0/1772289616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8e80ffc80 msgr2=0x7ff8e819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e6ffd640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8e80ffc80 0x7ff8e819c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.399+0000 7ff8e6ffd640 1 -- 172.21.15.103:0/1772289616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc009560 con 0x7ff8e80fea80 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.400+0000 7ff8e6ffd640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e8068f60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc02a9c0 tx=0x7ff8dc0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.400+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8dc004aa0 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.400+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e819cec0 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.400+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8dc004c00 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.400+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8dc003b10 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.400+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e819d3a0 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.401+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e8107690 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.401+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff8dc003d40 con 0x7ff8e80fea80 2024-09-17T01:12:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.402+0000 7ff8cffff640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.402+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff8dc0af8b0 con 0x7ff8e80fea80 2024-09-17T01:12:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.402+0000 7ff8e67fc640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.402+0000 7ff8e67fc640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80694e0 tx=0x7ff8d800b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.408+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff8dc078ad0 con 0x7ff8e80fea80 2024-09-17T01:12:51.483 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-mon[80685]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:51.483 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-mon[80685]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:51.483 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1895309667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:51.483 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1706916243' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:12:51.483 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:12:51.483 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:12:51.483 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:51.483 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:51.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.637+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff8e8107870 con 0x7ff8e80fea80 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.638+0000 7ff8cffff640 1 -- 172.21.15.103:0/1772289616 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+873 (secure 0 0 0) 0x7ff8dc07c190 con 0x7ff8e80fea80 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 5 pgs peering; Degraded data redundancy: 7/225 objects degraded (3.111%), 2 pgs degraded 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: osd.4 (root=default,host=smithi143) is down 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 5 pgs peering 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.f is stuck peering for 4m, current state peering, last acting [0,5] 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.11 is stuck peering for 4m, current state peering, last acting [3,1] 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: pg 3.3 is stuck peering for 3m, current state peering, last acting [0,3] 2024-09-17T01:12:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: pg 3.9 is stuck peering for 3m, current state peering, last acting [2,5] 2024-09-17T01:12:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: pg 3.1a is stuck peering for 3m, current state peering, last acting [1,2] 2024-09-17T01:12:51.637 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 7/225 objects degraded (3.111%), 2 pgs degraded 2024-09-17T01:12:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-17T01:12:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff8d006e5f0 msgr2=0x7ff8d0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80694e0 tx=0x7ff8d800b390 comp rx=0 tx=0).stop 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 msgr2=0x7ff8e8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e8068f60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc02a9c0 tx=0x7ff8dc0054f0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 shutdown_connections 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8e80ffc80 0x7ff8e819c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 --2- 172.21.15.103:0/1772289616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e80fea80 0x7ff8e8068f60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 >> 172.21.15.103:0/1772289616 conn(0x7ff8e80fa230 msgr2=0x7ff8e80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:51.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 shutdown_connections 2024-09-17T01:12:51.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:12:51.640+0000 7ff8ed433640 1 -- 172.21.15.103:0/1772289616 wait complete. 2024-09-17T01:12:51.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate[95527]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 bash[95512]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:12:51.758 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:51 smithi143 podman[95512]: 2024-09-17 01:12:51.514624167 +0000 UTC m=+1.567524150 container died 30dde63ccb26ba8c22dba5bf5b9959274409940ed53b9bc0a949ec833655d576 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:12:52.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:52 smithi103 ceph-mon[92733]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:52.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:52 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1772289616' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:52.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:52 smithi103 ceph-mon[92733]: pgmap v143: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 7/225 objects degraded (3.111%) 2024-09-17T01:12:52.445 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:52 smithi143 ceph-mon[80685]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:52.445 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:52 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1772289616' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:52.445 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:52 smithi143 ceph-mon[80685]: pgmap v143: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 7/225 objects degraded (3.111%) 2024-09-17T01:12:52.446 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 podman[95658]: 2024-09-17 01:12:52.132527599 +0000 UTC m=+0.610986271 container remove 30dde63ccb26ba8c22dba5bf5b9959274409940ed53b9bc0a949ec833655d576 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-c2ddf97) 2024-09-17T01:12:52.446 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 podman[95718]: 2024-09-17 01:12:52.241054454 +0000 UTC m=+0.015858824 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:12:52.446 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 podman[95718]: 2024-09-17 01:12:52.341683284 +0000 UTC m=+0.116487686 container create 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T01:12:52.856 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 podman[95718]: 2024-09-17 01:12:52.552683585 +0000 UTC m=+0.327487952 container init 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T01:12:52.856 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 podman[95718]: 2024-09-17 01:12:52.555814793 +0000 UTC m=+0.330619160 container start 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:12:52.856 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 ceph-osd[95737]: -- 172.21.15.143:0/3296476775 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c1b2301e0 con 0x555c1a61e000 2024-09-17T01:12:52.856 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 bash[95718]: 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c 2024-09-17T01:12:52.857 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:52 smithi143 systemd[1]: Started Ceph osd.4 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:12:54.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:54.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:54.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:53 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:54.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:54.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:54.126 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:53 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:54.709 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:12:54 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:12:54.427+0000 7fee74409640 -1 Falling back to public interface 2024-09-17T01:12:55.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:54 smithi143 ceph-mon[80685]: pgmap v144: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:12:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:54 smithi103 ceph-mon[92733]: pgmap v144: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:12:56.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:55 smithi143 ceph-mon[80685]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-17T01:12:56.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:56.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:55 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:55 smithi103 ceph-mon[92733]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-17T01:12:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:55 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:56.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:56 smithi143 ceph-mon[80685]: pgmap v145: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 928 B/s rd, 2 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:12:56.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:56.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:57.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:56 smithi103 ceph-mon[92733]: pgmap v145: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 928 B/s rd, 2 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:12:57.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:57.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:12:59.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:12:58 smithi103 ceph-mon[92733]: pgmap v146: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:12:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:12:58 smithi143 ceph-mon[80685]: pgmap v146: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:00.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:00.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-17T01:13:00.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: pgmap v147: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 866 B/s rd, 1 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:13:00.678 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:00 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 39/225 objects degraded (17.333%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:00.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:13:00.479+0000 7fee74409640 -1 osd.4 79 log_to_monitors true 2024-09-17T01:13:00.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: pgmap v147: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 866 B/s rd, 1 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:13:00.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:00 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 39/225 objects degraded (17.333%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:01.580 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:01 smithi143 ceph-mon[80685]: from='osd.4 [v2:172.21.15.143:6808/2754050207,v1:172.21.15.143:6809/2754050207]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:13:01.580 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:01 smithi143 ceph-mon[80685]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:13:01.580 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:13:01 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:13:01.345+0000 7fee6c1a3640 -1 osd.4 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:13:01.580 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:01 smithi103 ceph-mon[92733]: from='osd.4 [v2:172.21.15.143:6808/2754050207,v1:172.21.15.143:6809/2754050207]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:13:01.581 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:01 smithi103 ceph-mon[92733]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:13:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:02 smithi103 ceph-mon[92733]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:13:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:02 smithi103 ceph-mon[92733]: osdmap e82: 6 total, 5 up, 6 in 2024-09-17T01:13:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:02 smithi103 ceph-mon[92733]: from='osd.4 [v2:172.21.15.143:6808/2754050207,v1:172.21.15.143:6809/2754050207]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:02 smithi103 ceph-mon[92733]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:02.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:02 smithi103 ceph-mon[92733]: pgmap v149: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:13:02.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:02 smithi143 ceph-mon[80685]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:13:02.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:02 smithi143 ceph-mon[80685]: osdmap e82: 6 total, 5 up, 6 in 2024-09-17T01:13:02.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:02 smithi143 ceph-mon[80685]: from='osd.4 [v2:172.21.15.143:6808/2754050207,v1:172.21.15.143:6809/2754050207]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:02.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:02 smithi143 ceph-mon[80685]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:02.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:02 smithi143 ceph-mon[80685]: pgmap v149: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 39/225 objects degraded (17.333%) 2024-09-17T01:13:03.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:03 smithi103 ceph-mon[92733]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:03.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:03 smithi103 ceph-mon[92733]: osd.4 [v2:172.21.15.143:6808/2754050207,v1:172.21.15.143:6809/2754050207] boot 2024-09-17T01:13:03.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:03 smithi103 ceph-mon[92733]: osdmap e83: 6 total, 6 up, 6 in 2024-09-17T01:13:03.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:13:03.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:03.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:03.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:03 smithi143 ceph-mon[80685]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:03.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:03 smithi143 ceph-mon[80685]: osd.4 [v2:172.21.15.143:6808/2754050207,v1:172.21.15.143:6809/2754050207] boot 2024-09-17T01:13:03.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:03 smithi143 ceph-mon[80685]: osdmap e83: 6 total, 6 up, 6 in 2024-09-17T01:13:03.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:13:03.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:03.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:04.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:04 smithi103 ceph-mon[92733]: osdmap e84: 6 total, 6 up, 6 in 2024-09-17T01:13:04.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:04 smithi103 ceph-mon[92733]: pgmap v152: 65 pgs: 16 peering, 6 active+undersized, 6 active+undersized+degraded, 37 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 10/225 objects degraded (4.444%) 2024-09-17T01:13:04.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:04 smithi143 ceph-mon[80685]: osdmap e84: 6 total, 6 up, 6 in 2024-09-17T01:13:04.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:04 smithi143 ceph-mon[80685]: pgmap v152: 65 pgs: 16 peering, 6 active+undersized, 6 active+undersized+degraded, 37 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 10/225 objects degraded (4.444%) 2024-09-17T01:13:05.623 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:05 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 10/225 objects degraded (4.444%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:05.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:05 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 10/225 objects degraded (4.444%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:06.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:06 smithi103 ceph-mon[92733]: pgmap v153: 65 pgs: 16 peering, 6 active+undersized, 6 active+undersized+degraded, 37 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 10/225 objects degraded (4.444%) 2024-09-17T01:13:06.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:06 smithi143 ceph-mon[80685]: pgmap v153: 65 pgs: 16 peering, 6 active+undersized, 6 active+undersized+degraded, 37 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 10/225 objects degraded (4.444%) 2024-09-17T01:13:08.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:07 smithi143 ceph-mon[80685]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/225 objects degraded (4.444%), 6 pgs degraded) 2024-09-17T01:13:08.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:07 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:13:08.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:07 smithi103 ceph-mon[92733]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/225 objects degraded (4.444%), 6 pgs degraded) 2024-09-17T01:13:08.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:07 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:13:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:08 smithi143 ceph-mon[80685]: pgmap v154: 65 pgs: 16 peering, 49 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 626 B/s rd, 1 op/s 2024-09-17T01:13:09.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:08 smithi103 ceph-mon[92733]: pgmap v154: 65 pgs: 16 peering, 49 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 626 B/s rd, 1 op/s 2024-09-17T01:13:11.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:10 smithi103 ceph-mon[92733]: pgmap v155: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T01:13:11.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:10 smithi143 ceph-mon[80685]: pgmap v155: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T01:13:13.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:12 smithi143 ceph-mon[80685]: pgmap v156: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 1 op/s 2024-09-17T01:13:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:12 smithi103 ceph-mon[92733]: pgmap v156: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 1 op/s 2024-09-17T01:13:15.081 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:14 smithi143 ceph-mon[80685]: pgmap v157: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2024-09-17T01:13:15.081 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:14 smithi103 ceph-mon[92733]: pgmap v157: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2024-09-17T01:13:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:15 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:15 smithi103 ceph-mon[92733]: Upgrade: osd.5 is safe to restart 2024-09-17T01:13:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:15 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:15 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:13:16.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:15 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:15 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:13:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:15 smithi143 ceph-mon[80685]: Upgrade: osd.5 is safe to restart 2024-09-17T01:13:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:15 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:15 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:13:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:15 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:16 smithi143 ceph-mon[80685]: Upgrade: Updating osd.5 2024-09-17T01:13:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:16 smithi143 ceph-mon[80685]: Deploying daemon osd.5 on smithi143 2024-09-17T01:13:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:16 smithi143 ceph-mon[80685]: pgmap v158: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:13:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:16 smithi103 ceph-mon[92733]: Upgrade: Updating osd.5 2024-09-17T01:13:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:16 smithi103 ceph-mon[92733]: Deploying daemon osd.5 on smithi143 2024-09-17T01:13:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:16 smithi103 ceph-mon[92733]: pgmap v158: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:13:18.757 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:18 smithi143 systemd[1]: Stopping Ceph osd.5 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:13:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:18 smithi103 ceph-mon[92733]: pgmap v159: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:13:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:19.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-mon[80685]: pgmap v159: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:13:19.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:19.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:19.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:19.258 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[54746]: 2024-09-17T01:13:18.880+0000 7f405bdfc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:13:19.258 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[54746]: 2024-09-17T01:13:18.880+0000 7f405bdfc640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-17T01:13:19.258 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:18 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[54746]: 2024-09-17T01:13:18.880+0000 7f405bdfc640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:13:20.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:19 smithi103 ceph-mon[92733]: osd.5 marked itself down and dead 2024-09-17T01:13:20.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:19 smithi143 ceph-mon[80685]: osd.5 marked itself down and dead 2024-09-17T01:13:20.614 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:20 smithi143 podman[100599]: 2024-09-17 01:13:20.318158276 +0000 UTC m=+1.558147547 container died 6e90e7147b4b9641a5aed1e178f4ebdcbc2d3dad0d95f0ba7fbdd2c5b095b118 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:13:20.890 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:20 smithi143 podman[100599]: 2024-09-17 01:13:20.715206588 +0000 UTC m=+1.955195856 container cleanup 6e90e7147b4b9641a5aed1e178f4ebdcbc2d3dad0d95f0ba7fbdd2c5b095b118 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:13:20.890 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:20 smithi143 bash[100599]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:13:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:20 smithi103 ceph-mon[92733]: pgmap v160: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:13:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:20 smithi103 ceph-mon[92733]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:20 smithi103 ceph-mon[92733]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:13:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:20 smithi103 ceph-mon[92733]: osdmap e85: 6 total, 5 up, 6 in 2024-09-17T01:13:21.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:20 smithi143 podman[100628]: 2024-09-17 01:13:20.94219013 +0000 UTC m=+0.616411917 container remove 6e90e7147b4b9641a5aed1e178f4ebdcbc2d3dad0d95f0ba7fbdd2c5b095b118 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:13:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:20 smithi143 ceph-mon[80685]: pgmap v160: 65 pgs: 65 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:13:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:20 smithi143 ceph-mon[80685]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:20 smithi143 ceph-mon[80685]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:13:21.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:20 smithi143 ceph-mon[80685]: osdmap e85: 6 total, 5 up, 6 in 2024-09-17T01:13:21.513 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:21 smithi143 podman[100716]: 2024-09-17 01:13:21.285913554 +0000 UTC m=+0.015536934 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:13:21.513 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:21 smithi143 podman[100716]: 2024-09-17 01:13:21.409779145 +0000 UTC m=+0.139402511 container create 80ba309fcef9c4863cda03ff3dc605f6feada2f4fd3cacdfb3751f311c3c77e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-17T01:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.727+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3614513483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f40ffb70 msgr2=0x7fc2f40fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.727+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3614513483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f40ffb70 0x7fc2f40fff70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009c20 tx=0x7fc2e402a970 comp rx=0 tx=0).stop 2024-09-17T01:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3614513483 shutdown_connections 2024-09-17T01:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3614513483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f4100d70 0x7fc2f41011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3614513483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f40ffb70 0x7fc2f40fff70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3614513483 >> 172.21.15.103:0/3614513483 conn(0x7fc2f40fb2e0 msgr2=0x7fc2f40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3614513483 shutdown_connections 2024-09-17T01:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3614513483 wait complete. 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.728+0000 7fc2f98c5640 1 Processor -- start 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f98c5640 1 -- start start 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f98c5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f40ffb70 0x7fc2f4195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f98c5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 0x7fc2f4195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f98c5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4196180 con 0x7fc2f4100d70 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f98c5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41962f0 con 0x7fc2f40ffb70 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 0x7fc2f4195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 0x7fc2f4195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49078/0 (socket says 172.21.15.103:49078) 2024-09-17T01:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 -- 172.21.15.103:0/3153980625 learned_addr learned my addr 172.21.15.103:0/3153980625 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f2ffd640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f40ffb70 0x7fc2f4195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 -- 172.21.15.103:0/3153980625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f40ffb70 msgr2=0x7fc2f4195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f40ffb70 0x7fc2f4195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 -- 172.21.15.103:0/3153980625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009900 con 0x7fc2f4100d70 2024-09-17T01:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.729+0000 7fc2f27fc640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 0x7fc2f4195bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e9a0 tx=0x7fc2dc00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.730+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc00cd50 con 0x7fc2f4100d70 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.730+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2dc00ceb0 con 0x7fc2f4100d70 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.730+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f419ad90 con 0x7fc2f4100d70 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.730+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc010660 con 0x7fc2f4100d70 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.730+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f419b330 con 0x7fc2f4100d70 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.731+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f40fff70 con 0x7fc2f4100d70 2024-09-17T01:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.731+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc2dc0048a0 con 0x7fc2f4100d70 2024-09-17T01:13:21.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.732+0000 7fc2f88c3640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc2e006e5f0 0x7fc2e0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:21.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.732+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc2dc014070 con 0x7fc2f4100d70 2024-09-17T01:13:21.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.732+0000 7fc2f2ffd640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc2e006e5f0 0x7fc2e0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:21.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.732+0000 7fc2f2ffd640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc2e006e5f0 0x7fc2e0070ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006010 tx=0x7fc2e403d040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:21.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.737+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc2dc05b860 con 0x7fc2f4100d70 2024-09-17T01:13:21.809 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:21 smithi143 podman[100716]: 2024-09-17 01:13:21.620735202 +0000 UTC m=+0.350358572 container init 80ba309fcef9c4863cda03ff3dc605f6feada2f4fd3cacdfb3751f311c3c77e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:13:21.809 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:21 smithi143 podman[100716]: 2024-09-17 01:13:21.624051414 +0000 UTC m=+0.353674780 container start 80ba309fcef9c4863cda03ff3dc605f6feada2f4fd3cacdfb3751f311c3c77e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-17T01:13:21.809 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:21 smithi143 podman[100716]: 2024-09-17 01:13:21.704036728 +0000 UTC m=+0.433660107 container attach 80ba309fcef9c4863cda03ff3dc605f6feada2f4fd3cacdfb3751f311c3c77e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T01:13:21.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.922+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2f402c540 con 0x7fc2e006e5f0 2024-09-17T01:13:21.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.923+0000 7fc2f88c3640 1 -- 172.21.15.103:0/3153980625 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc2f402c540 con 0x7fc2e006e5f0 2024-09-17T01:13:21.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.925+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc2e006e5f0 msgr2=0x7fc2e0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.925+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc2e006e5f0 0x7fc2e0070ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006010 tx=0x7fc2e403d040 comp rx=0 tx=0).stop 2024-09-17T01:13:21.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.925+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 msgr2=0x7fc2f4195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.925+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 0x7fc2f4195bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e9a0 tx=0x7fc2dc00eda0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.925+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 shutdown_connections 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.926+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc2e006e5f0 0x7fc2e0070ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.926+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f4100d70 0x7fc2f4195bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.926+0000 7fc2f98c5640 1 --2- 172.21.15.103:0/3153980625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f40ffb70 0x7fc2f4195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.926+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 >> 172.21.15.103:0/3153980625 conn(0x7fc2f40fb2e0 msgr2=0x7fc2f41044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.926+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 shutdown_connections 2024-09-17T01:13:21.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:21.926+0000 7fc2f98c5640 1 -- 172.21.15.103:0/3153980625 wait complete. 2024-09-17T01:13:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:13:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 -- 172.21.15.103:0/338519760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180102f60 msgr2=0x7f8180105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 --2- 172.21.15.103:0/338519760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180102f60 0x7f8180105350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81740098b0 tx=0x7f817402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 -- 172.21.15.103:0/338519760 shutdown_connections 2024-09-17T01:13:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 --2- 172.21.15.103:0/338519760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180102f60 0x7f8180105350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 --2- 172.21.15.103:0/338519760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8180100630 0x7f8180102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 -- 172.21.15.103:0/338519760 >> 172.21.15.103:0/338519760 conn(0x7f81800fa230 msgr2=0x7f81800fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:21 smithi103 ceph-mon[92733]: osdmap e86: 6 total, 5 up, 6 in 2024-09-17T01:13:22.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 -- 172.21.15.103:0/338519760 shutdown_connections 2024-09-17T01:13:22.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.008+0000 7f818606e640 1 -- 172.21.15.103:0/338519760 wait complete. 2024-09-17T01:13:22.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f818606e640 1 Processor -- start 2024-09-17T01:13:22.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f818606e640 1 -- start start 2024-09-17T01:13:22.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f818606e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 0x7f81800fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f818606e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8180102f60 0x7f81800fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f818606e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81800feb20 con 0x7f8180100630 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f818606e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81800fec90 con 0x7f8180102f60 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f817f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 0x7f81800fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f817f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 0x7f81800fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49102/0 (socket says 172.21.15.103:49102) 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f817f7fe640 1 -- 172.21.15.103:0/1697700479 learned_addr learned my addr 172.21.15.103:0/1697700479 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.009+0000 7f817effd640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8180102f60 0x7f81800fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817f7fe640 1 -- 172.21.15.103:0/1697700479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8180102f60 msgr2=0x7f81800fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817f7fe640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8180102f60 0x7f81800fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817f7fe640 1 -- 172.21.15.103:0/1697700479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174009560 con 0x7f8180100630 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817f7fe640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 0x7f81800fff90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f817000d6f0 tx=0x7f817000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8170009a30 con 0x7f8180100630 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81800fef70 con 0x7f8180100630 2024-09-17T01:13:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81700054e0 con 0x7f8180100630 2024-09-17T01:13:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8170010460 con 0x7f8180100630 2024-09-17T01:13:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.010+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818019d6c0 con 0x7f8180100630 2024-09-17T01:13:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.011+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81801087b0 con 0x7f8180100630 2024-09-17T01:13:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.012+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8170009b90 con 0x7f8180100630 2024-09-17T01:13:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.013+0000 7f817cff9640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f816806e5f0 0x7f8168070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.013+0000 7f817effd640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f816806e5f0 0x7f8168070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.013+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f817008e280 con 0x7f8180100630 2024-09-17T01:13:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.013+0000 7f817effd640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f816806e5f0 0x7f8168070ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8174009880 tx=0x7f81740314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.017+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f81700573b0 con 0x7f8180100630 2024-09-17T01:13:22.087 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:21 smithi143 ceph-mon[80685]: osdmap e86: 6 total, 5 up, 6 in 2024-09-17T01:13:22.088 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:21 smithi143 podman[100716]: 2024-09-17 01:13:21.81178884 +0000 UTC m=+0.541412215 container died 80ba309fcef9c4863cda03ff3dc605f6feada2f4fd3cacdfb3751f311c3c77e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97) 2024-09-17T01:13:22.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.199+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8180103960 con 0x7f816806e5f0 2024-09-17T01:13:22.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.200+0000 7f817cff9640 1 -- 172.21.15.103:0/1697700479 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8180103960 con 0x7f816806e5f0 2024-09-17T01:13:22.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f816806e5f0 msgr2=0x7f8168070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f816806e5f0 0x7f8168070ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8174009880 tx=0x7f81740314e0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 msgr2=0x7f81800fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 0x7f81800fff90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f817000d6f0 tx=0x7f817000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 shutdown_connections 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f816806e5f0 0x7f8168070ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8180102f60 0x7f81800fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 --2- 172.21.15.103:0/1697700479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8180100630 0x7f81800fff90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.202+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 >> 172.21.15.103:0/1697700479 conn(0x7f81800fa230 msgr2=0x7f81800fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.203+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 shutdown_connections 2024-09-17T01:13:22.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.203+0000 7f818606e640 1 -- 172.21.15.103:0/1697700479 wait complete. 2024-09-17T01:13:22.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.292+0000 7f9d3a953640 1 -- 172.21.15.103:0/4140305368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d34101280 msgr2=0x7f9d34101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.292+0000 7f9d3a953640 1 --2- 172.21.15.103:0/4140305368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d34101280 0x7f9d34101680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009880 tx=0x7f9d2402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.292+0000 7f9d3a953640 1 -- 172.21.15.103:0/4140305368 shutdown_connections 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.292+0000 7f9d3a953640 1 --2- 172.21.15.103:0/4140305368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d340ff7c0 0x7f9d340ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.292+0000 7f9d3a953640 1 --2- 172.21.15.103:0/4140305368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d34101280 0x7f9d34101680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.292+0000 7f9d3a953640 1 -- 172.21.15.103:0/4140305368 >> 172.21.15.103:0/4140305368 conn(0x7f9d340fb330 msgr2=0x7f9d340fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.293+0000 7f9d3a953640 1 -- 172.21.15.103:0/4140305368 shutdown_connections 2024-09-17T01:13:22.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.293+0000 7f9d3a953640 1 -- 172.21.15.103:0/4140305368 wait complete. 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.293+0000 7f9d3a953640 1 Processor -- start 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.293+0000 7f9d3a953640 1 -- start start 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d3a953640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 0x7f9d34195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d3a953640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d34101280 0x7f9d34195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d3a953640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d341962a0 con 0x7f9d340ff7c0 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d3a953640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34196410 con 0x7f9d34101280 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 0x7f9d34195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 0x7f9d34195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44668/0 (socket says 172.21.15.103:44668) 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 -- 172.21.15.103:0/3186394285 learned_addr learned my addr 172.21.15.103:0/3186394285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d337fe640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d34101280 0x7f9d34195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 -- 172.21.15.103:0/3186394285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d34101280 msgr2=0x7f9d34195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d34101280 0x7f9d34195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 -- 172.21.15.103:0/3186394285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24009560 con 0x7f9d340ff7c0 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d33fff640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 0x7f9d34195790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d2402a9c0 tx=0x7f9d240055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d24004aa0 con 0x7f9d340ff7c0 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3419ae50 con 0x7f9d340ff7c0 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.294+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d24004c00 con 0x7f9d340ff7c0 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.295+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3419b2c0 con 0x7f9d340ff7c0 2024-09-17T01:13:22.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.295+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d24003a50 con 0x7f9d340ff7c0 2024-09-17T01:13:22.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.296+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20005280 con 0x7f9d340ff7c0 2024-09-17T01:13:22.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.296+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9d24031c90 con 0x7f9d340ff7c0 2024-09-17T01:13:22.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.296+0000 7f9d317fa640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d1c06e600 0x7f9d1c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.297+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f9d240af840 con 0x7f9d340ff7c0 2024-09-17T01:13:22.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.297+0000 7f9d337fe640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d1c06e600 0x7f9d1c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.297+0000 7f9d337fe640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d1c06e600 0x7f9d1c070ac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d28005d00 tx=0x7f9d28005c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.301+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9d240788c0 con 0x7f9d340ff7c0 2024-09-17T01:13:22.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.475+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d20000bf0 con 0x7f9d1c06e600 2024-09-17T01:13:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.484+0000 7f9d317fa640 1 -- 172.21.15.103:0/3186394285 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f9d20000bf0 con 0x7f9d1c06e600 2024-09-17T01:13:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:13:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (12m) 92s ago 14m 24.5M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:13:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (14m) 92s ago 14m 8887k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:13:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (13m) 27s ago 13m 8321k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:13:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (3m) 92s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (3m) 27s ago 13m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (12m) 92s ago 14m 86.5M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (9m) 92s ago 9m 148M - 18.2.4-855-g19e2a2be 980a0bfcd684 4120f0ae2131 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (8m) 92s ago 8m 90.8M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (8m) 27s ago 8m 16.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (8m) 27s ago 8m 18.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (5m) 92s ago 15m 500M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (4m) 27s ago 13m 440M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:13:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (4m) 92s ago 15m 48.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (3m) 27s ago 13m 39.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (14m) 92s ago 14m 16.0M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (13m) 27s ago 13m 16.0M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (2m) 92s ago 12m 92.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (2m) 92s ago 12m 100M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (98s) 92s ago 11m 14.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (63s) 27s ago 11m 139M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (30s) 27s ago 10m 12.3M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (10m) 27s ago 10m 235M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 6e90e7147b4b 2024-09-17T01:13:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (4m) 92s ago 13m 65.1M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.486+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d1c06e600 msgr2=0x7f9d1c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.486+0000 7f9d3a953640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d1c06e600 0x7f9d1c070ac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d28005d00 tx=0x7f9d28005c50 comp rx=0 tx=0).stop 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.486+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 msgr2=0x7f9d34195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.486+0000 7f9d3a953640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 0x7f9d34195790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d2402a9c0 tx=0x7f9d240055a0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 shutdown_connections 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d1c06e600 0x7f9d1c070ac0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d34101280 0x7f9d34195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 --2- 172.21.15.103:0/3186394285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d340ff7c0 0x7f9d34195790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 >> 172.21.15.103:0/3186394285 conn(0x7f9d340fb330 msgr2=0x7f9d34104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 shutdown_connections 2024-09-17T01:13:22.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.487+0000 7f9d3a953640 1 -- 172.21.15.103:0/3186394285 wait complete. 2024-09-17T01:13:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 -- 172.21.15.103:0/534435765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 msgr2=0x7f2b781000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/534435765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b781000b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009880 tx=0x7f2b6002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 -- 172.21.15.103:0/534435765 shutdown_connections 2024-09-17T01:13:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/534435765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b781000b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/534435765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b780fea30 0x7f2b780fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 -- 172.21.15.103:0/534435765 >> 172.21.15.103:0/534435765 conn(0x7f2b780fa1c0 msgr2=0x7f2b780fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 -- 172.21.15.103:0/534435765 shutdown_connections 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.567+0000 7f2b7e10c640 1 -- 172.21.15.103:0/534435765 wait complete. 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b7e10c640 1 Processor -- start 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b7e10c640 1 -- start start 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b7e10c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b780fea30 0x7f2b78068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b7e10c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b7819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b7e10c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7819a930 con 0x7f2b780ffc30 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b7e10c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7819aa70 con 0x7f2b780fea30 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b7819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b7819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44688/0 (socket says 172.21.15.103:44688) 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 -- 172.21.15.103:0/3542851398 learned_addr learned my addr 172.21.15.103:0/3542851398 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b777fe640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b780fea30 0x7f2b78068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 -- 172.21.15.103:0/3542851398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b780fea30 msgr2=0x7f2b78068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b780fea30 0x7f2b78068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 -- 172.21.15.103:0/3542851398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60009560 con 0x7f2b780ffc30 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.568+0000 7f2b6ffff640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b7819a360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b600054f0 tx=0x7f2b60005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.569+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b60004aa0 con 0x7f2b780ffc30 2024-09-17T01:13:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.569+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7819acc0 con 0x7f2b780ffc30 2024-09-17T01:13:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.569+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b60004c00 con 0x7f2b780ffc30 2024-09-17T01:13:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.569+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b60003ac0 con 0x7f2b780ffc30 2024-09-17T01:13:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.569+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7819b230 con 0x7f2b780ffc30 2024-09-17T01:13:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.570+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b78107640 con 0x7f2b780ffc30 2024-09-17T01:13:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.571+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2b60031c70 con 0x7f2b780ffc30 2024-09-17T01:13:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.571+0000 7f2b757fa640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2b6406e5f0 0x7f2b64070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.571+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f2b600afa30 con 0x7f2b780ffc30 2024-09-17T01:13:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.571+0000 7f2b777fe640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2b6406e5f0 0x7f2b64070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.572+0000 7f2b777fe640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2b6406e5f0 0x7f2b64070ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005fd0 tx=0x7f2b68005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.575+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2b60078ab0 con 0x7f2b780ffc30 2024-09-17T01:13:22.757 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 podman[100739]: 2024-09-17 01:13:22.349712683 +0000 UTC m=+0.532119110 container remove 80ba309fcef9c4863cda03ff3dc605f6feada2f4fd3cacdfb3751f311c3c77e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD) 2024-09-17T01:13:22.758 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T01:13:22.758 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 systemd[1]: Stopped Ceph osd.5 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:13:22.758 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 systemd[1]: ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 5.463s CPU time. 2024-09-17T01:13:22.758 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 systemd[1]: Starting Ceph osd.5 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:13:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.806+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2b7819b420 con 0x7f2b780ffc30 2024-09-17T01:13:22.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.807+0000 7f2b757fa640 1 -- 172.21.15.103:0/3542851398 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f2b6007c170 con 0x7f2b780ffc30 2024-09-17T01:13:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:13:22.805 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:13:22.805 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:13:22.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:22.806 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:13:22.807 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4, 2024-09-17T01:13:22.808 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9 2024-09-17T01:13:22.808 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:13:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2b6406e5f0 msgr2=0x7f2b64070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2b6406e5f0 0x7f2b64070ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005fd0 tx=0x7f2b68005850 comp rx=0 tx=0).stop 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 msgr2=0x7f2b7819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b7819a360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b600054f0 tx=0x7f2b60005520 comp rx=0 tx=0).stop 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 shutdown_connections 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2b6406e5f0 0x7f2b64070ab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b780ffc30 0x7f2b7819a360 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 --2- 172.21.15.103:0/3542851398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b780fea30 0x7f2b78068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 >> 172.21.15.103:0/3542851398 conn(0x7f2b780fa1c0 msgr2=0x7f2b78102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 shutdown_connections 2024-09-17T01:13:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.809+0000 7f2b7e10c640 1 -- 172.21.15.103:0/3542851398 wait complete. 2024-09-17T01:13:22.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 -- 172.21.15.103:0/2509543156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 msgr2=0x7f8be80fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 --2- 172.21.15.103:0/2509543156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be80fff20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009880 tx=0x7f8bd802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 -- 172.21.15.103:0/2509543156 shutdown_connections 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 --2- 172.21.15.103:0/2509543156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be80fff20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 --2- 172.21.15.103:0/2509543156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8be80fe8a0 0x7f8be80feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 -- 172.21.15.103:0/2509543156 >> 172.21.15.103:0/2509543156 conn(0x7f8be80fa030 msgr2=0x7f8be80fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 -- 172.21.15.103:0/2509543156 shutdown_connections 2024-09-17T01:13:22.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.890+0000 7f8bee59f640 1 -- 172.21.15.103:0/2509543156 wait complete. 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.891+0000 7f8bee59f640 1 Processor -- start 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.891+0000 7f8bee59f640 1 -- start start 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.891+0000 7f8bee59f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8be80fe8a0 0x7f8be8195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.891+0000 7f8bee59f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be81959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.891+0000 7f8bee59f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8195fa0 con 0x7f8be80ffaa0 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.891+0000 7f8bee59f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8196110 con 0x7f8be80fe8a0 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be81959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8bed59d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8be80fe8a0 0x7f8be8195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be81959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44714/0 (socket says 172.21.15.103:44714) 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 -- 172.21.15.103:0/1374522656 learned_addr learned my addr 172.21.15.103:0/1374522656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 -- 172.21.15.103:0/1374522656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8be80fe8a0 msgr2=0x7f8be8195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8be80fe8a0 0x7f8be8195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 -- 172.21.15.103:0/1374522656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8009560 con 0x7f8be80ffaa0 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8becd9c640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be81959d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8005520 tx=0x7f8bd8005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8004aa0 con 0x7f8be80ffaa0 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bd8004c00 con 0x7f8be80ffaa0 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be819ab50 con 0x7f8be80ffaa0 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8003b10 con 0x7f8be80ffaa0 2024-09-17T01:13:22.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.892+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be819b0c0 con 0x7f8be80ffaa0 2024-09-17T01:13:22.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.894+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be81074b0 con 0x7f8be80ffaa0 2024-09-17T01:13:22.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.894+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8bd8003c70 con 0x7f8be80ffaa0 2024-09-17T01:13:22.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.894+0000 7f8bde7fc640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8bd406e5f0 0x7f8bd4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:22.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.895+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f8bd80af790 con 0x7f8be80ffaa0 2024-09-17T01:13:22.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.895+0000 7f8bed59d640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8bd406e5f0 0x7f8bd4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:22.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.895+0000 7f8bed59d640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8bd406e5f0 0x7f8bd4070ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8be4005fd0 tx=0x7f8be400b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:22.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:22.899+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8bd8078940 con 0x7f8be80ffaa0 2024-09-17T01:13:23.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:22 smithi143 ceph-mon[80685]: pgmap v163: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 9/225 objects degraded (4.000%) 2024-09-17T01:13:23.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:22 smithi143 ceph-mon[80685]: Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:23.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:22 smithi143 ceph-mon[80685]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:23.026 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:22 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3542851398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.026 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 podman[100838]: 2024-09-17 01:13:22.776071836 +0000 UTC m=+0.104904662 container create ea32bc444146146eec26993865f8ffd172ff0ef1a255fd00c8655b7b1db6fbd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T01:13:23.027 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:22 smithi143 podman[100838]: 2024-09-17 01:13:22.686913743 +0000 UTC m=+0.015746578 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:13:23.027 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 podman[100838]: 2024-09-17 01:13:23.028854236 +0000 UTC m=+0.357687072 container init ea32bc444146146eec26993865f8ffd172ff0ef1a255fd00c8655b7b1db6fbd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.102+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8be819b5b0 con 0x7f8be80ffaa0 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.103+0000 7f8bde7fc640 1 -- 172.21.15.103:0/1374522656 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1948 (secure 0 0 0) 0x7f8bd807c000 con 0x7f8be80ffaa0 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:e16 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:13:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:04:34.945692+0000 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:13:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=14468} 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:13:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:14468} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.103:6826/305377133,v1:172.21.15.103:6827/305377133] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.103:6828/1908466108,v1:172.21.15.103:6829/1908466108] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:24271} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8bd406e5f0 msgr2=0x7f8bd4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8bd406e5f0 0x7f8bd4070ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8be4005fd0 tx=0x7f8be400b390 comp rx=0 tx=0).stop 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 msgr2=0x7f8be81959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be81959d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8005520 tx=0x7f8bd8005550 comp rx=0 tx=0).stop 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 shutdown_connections 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8bd406e5f0 0x7f8bd4070ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be80ffaa0 0x7f8be81959d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 --2- 172.21.15.103:0/1374522656 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8be80fe8a0 0x7f8be8195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 >> 172.21.15.103:0/1374522656 conn(0x7f8be80fa030 msgr2=0x7f8be80684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 shutdown_connections 2024-09-17T01:13:23.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.106+0000 7f8bee59f640 1 -- 172.21.15.103:0/1374522656 wait complete. 2024-09-17T01:13:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:22 smithi103 ceph-mon[92733]: pgmap v163: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 204 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 9/225 objects degraded (4.000%) 2024-09-17T01:13:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:22 smithi103 ceph-mon[92733]: Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:22 smithi103 ceph-mon[92733]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:22 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3542851398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.186+0000 7f35b3f6b640 1 -- 172.21.15.103:0/3591084230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0fea80 msgr2=0x7f35ac0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.186+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/3591084230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0fea80 0x7f35ac0fee80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009c20 tx=0x7f35a802a970 comp rx=0 tx=0).stop 2024-09-17T01:13:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- 172.21.15.103:0/3591084230 shutdown_connections 2024-09-17T01:13:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/3591084230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35ac0ffc80 0x7f35ac100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/3591084230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0fea80 0x7f35ac0fee80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- 172.21.15.103:0/3591084230 >> 172.21.15.103:0/3591084230 conn(0x7f35ac0fa210 msgr2=0x7f35ac0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- 172.21.15.103:0/3591084230 shutdown_connections 2024-09-17T01:13:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- 172.21.15.103:0/3591084230 wait complete. 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 Processor -- start 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- start start 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35ac0fea80 0x7f35ac068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 0x7f35ac19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac19a950 con 0x7f35ac0ffc80 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.187+0000 7f35b3f6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac19aa90 con 0x7f35ac0fea80 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 0x7f35ac19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1d07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35ac0fea80 0x7f35ac068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 0x7f35ac19a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44744/0 (socket says 172.21.15.103:44744) 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 -- 172.21.15.103:0/2849698493 learned_addr learned my addr 172.21.15.103:0/2849698493 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:23.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 -- 172.21.15.103:0/2849698493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35ac0fea80 msgr2=0x7f35ac068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35ac0fea80 0x7f35ac068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 -- 172.21.15.103:0/2849698493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8009900 con 0x7f35ac0ffc80 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b1506640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 0x7f35ac19a380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f359c00d8d0 tx=0x7f359c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359c00bea0 con 0x7f35ac0ffc80 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f359c009c00 con 0x7f35ac0ffc80 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac19ad40 con 0x7f35ac0ffc80 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359c00f710 con 0x7f35ac0ffc80 2024-09-17T01:13:23.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.188+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac19b310 con 0x7f35ac0ffc80 2024-09-17T01:13:23.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.189+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac107670 con 0x7f35ac0ffc80 2024-09-17T01:13:23.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.190+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f359c00f990 con 0x7f35ac0ffc80 2024-09-17T01:13:23.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.190+0000 7f35a2ffd640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f359806e5f0 0x7f3598070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.190+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f359c08e4b0 con 0x7f35ac0ffc80 2024-09-17T01:13:23.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.190+0000 7f35b1d07640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f359806e5f0 0x7f3598070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.191+0000 7f35b1d07640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f359806e5f0 0x7f3598070ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f35a8000f80 tx=0x7f35a803d040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:23.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.195+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f359c0575e0 con 0x7f35ac0ffc80 2024-09-17T01:13:23.316 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 podman[100838]: 2024-09-17 01:13:23.032149292 +0000 UTC m=+0.360982123 container start ea32bc444146146eec26993865f8ffd172ff0ef1a255fd00c8655b7b1db6fbd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True) 2024-09-17T01:13:23.317 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 podman[100838]: 2024-09-17 01:13:23.112105143 +0000 UTC m=+0.440937983 container attach ea32bc444146146eec26993865f8ffd172ff0ef1a255fd00c8655b7b1db6fbd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:13:23.317 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:23.317 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 bash[100838]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:23.317 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:23.317 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 bash[100838]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:23.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.378+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35ac19b500 con 0x7f359806e5f0 2024-09-17T01:13:23.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.379+0000 7f35a2ffd640 1 -- 172.21.15.103:0/2849698493 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f35ac19b500 con 0x7f359806e5f0 2024-09-17T01:13:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:13:23.377 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:13:23.377 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:13:23.377 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:13:23.377 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "11/23 daemons upgraded", 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:13:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:13:23.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f359806e5f0 msgr2=0x7f3598070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f359806e5f0 0x7f3598070ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f35a8000f80 tx=0x7f35a803d040 comp rx=0 tx=0).stop 2024-09-17T01:13:23.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 msgr2=0x7f35ac19a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 0x7f35ac19a380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f359c00d8d0 tx=0x7f359c00dd90 comp rx=0 tx=0).stop 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 shutdown_connections 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f359806e5f0 0x7f3598070ab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ac0ffc80 0x7f35ac19a380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 --2- 172.21.15.103:0/2849698493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35ac0fea80 0x7f35ac068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 >> 172.21.15.103:0/2849698493 conn(0x7f35ac0fa210 msgr2=0x7f35ac102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 shutdown_connections 2024-09-17T01:13:23.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.381+0000 7f35b3f6b640 1 -- 172.21.15.103:0/2849698493 wait complete. 2024-09-17T01:13:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 -- 172.21.15.103:0/787218965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 msgr2=0x7fe9801000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 --2- 172.21.15.103:0/787218965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe9801000b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe974009880 tx=0x7fe97402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 -- 172.21.15.103:0/787218965 shutdown_connections 2024-09-17T01:13:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 --2- 172.21.15.103:0/787218965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe9801000b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 --2- 172.21.15.103:0/787218965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9800fea30 0x7fe9800fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 -- 172.21.15.103:0/787218965 >> 172.21.15.103:0/787218965 conn(0x7fe9800fa1c0 msgr2=0x7fe9800fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 -- 172.21.15.103:0/787218965 shutdown_connections 2024-09-17T01:13:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 -- 172.21.15.103:0/787218965 wait complete. 2024-09-17T01:13:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.462+0000 7fe985d94640 1 Processor -- start 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe985d94640 1 -- start start 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe985d94640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9800fea30 0x7fe9801029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe985d94640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe980101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe985d94640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe980101550 con 0x7fe9800ffc30 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe985d94640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801016c0 con 0x7fe9800fea30 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe980101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe980101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44766/0 (socket says 172.21.15.103:44766) 2024-09-17T01:13:23.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 -- 172.21.15.103:0/634673867 learned_addr learned my addr 172.21.15.103:0/634673867 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97f7fe640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9800fea30 0x7fe9801029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 -- 172.21.15.103:0/634673867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9800fea30 msgr2=0x7fe9801029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9800fea30 0x7fe9801029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 -- 172.21.15.103:0/634673867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974009560 con 0x7fe9800ffc30 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.463+0000 7fe97effd640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe980101010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9740054f0 tx=0x7fe974005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.464+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe974004aa0 con 0x7fe9800ffc30 2024-09-17T01:13:23.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.464+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe974004c00 con 0x7fe9800ffc30 2024-09-17T01:13:23.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.464+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe980101940 con 0x7fe9800ffc30 2024-09-17T01:13:23.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.464+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98019d6b0 con 0x7fe9800ffc30 2024-09-17T01:13:23.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.464+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe974003ac0 con 0x7fe9800ffc30 2024-09-17T01:13:23.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.465+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe980107640 con 0x7fe9800ffc30 2024-09-17T01:13:23.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.466+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe974031c70 con 0x7fe9800ffc30 2024-09-17T01:13:23.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.466+0000 7fe97cff9640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe96806e5f0 0x7fe968070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.466+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe9740af980 con 0x7fe9800ffc30 2024-09-17T01:13:23.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.466+0000 7fe97f7fe640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe96806e5f0 0x7fe968070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.467+0000 7fe97f7fe640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe96806e5f0 0x7fe968070ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe970005fd0 tx=0x7fe970005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:23.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.471+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe974078a00 con 0x7fe9800ffc30 2024-09-17T01:13:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.704+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe9801077d0 con 0x7fe9800ffc30 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.705+0000 7fe97cff9640 1 -- 172.21.15.103:0/634673867 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+672 (secure 0 0 0) 0x7fe97407c0c0 con 0x7fe9800ffc30 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 9/225 objects degraded (4.000%), 3 pgs degraded 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout: osd.5 (root=default,host=smithi143) is down 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 9/225 objects degraded (4.000%), 3 pgs degraded 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-17T01:13:23.703 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-17T01:13:23.704 INFO:teuthology.orchestra.run.smithi103.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe96806e5f0 msgr2=0x7fe968070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe96806e5f0 0x7fe968070ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe970005fd0 tx=0x7fe970005850 comp rx=0 tx=0).stop 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 msgr2=0x7fe980101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe980101010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9740054f0 tx=0x7fe974005520 comp rx=0 tx=0).stop 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 shutdown_connections 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe96806e5f0 0x7fe968070ab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9800ffc30 0x7fe980101010 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 --2- 172.21.15.103:0/634673867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9800fea30 0x7fe9801029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 >> 172.21.15.103:0/634673867 conn(0x7fe9800fa1c0 msgr2=0x7fe9800fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 shutdown_connections 2024-09-17T01:13:23.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:23.707+0000 7fe985d94640 1 -- 172.21.15.103:0/634673867 wait complete. 2024-09-17T01:13:24.175 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-mon[80685]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:24.176 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-mon[80685]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:24.176 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1374522656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:13:24.176 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/634673867' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:24.176 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:13:24.176 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 bash[100838]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:13:24.176 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:24.176 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:23 smithi143 bash[100838]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:23 smithi103 ceph-mon[92733]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:23 smithi103 ceph-mon[92733]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:23 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1374522656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:13:24.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:23 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/634673867' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:24.507 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 bash[100838]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 bash[100838]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 bash[100838]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 bash[100838]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate[100852]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:13:24.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 bash[100838]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:13:24.509 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 podman[100838]: 2024-09-17 01:13:24.208714743 +0000 UTC m=+1.537547573 container died ea32bc444146146eec26993865f8ffd172ff0ef1a255fd00c8655b7b1db6fbd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:13:25.124 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-mon[80685]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.124 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:24 smithi143 ceph-mon[80685]: pgmap v164: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:25.124 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 podman[100995]: 2024-09-17 01:13:24.76623983 +0000 UTC m=+0.546863284 container remove ea32bc444146146eec26993865f8ffd172ff0ef1a255fd00c8655b7b1db6fbd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T01:13:25.124 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 podman[101054]: 2024-09-17 01:13:24.876289966 +0000 UTC m=+0.016138361 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:13:25.125 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:24 smithi143 podman[101054]: 2024-09-17 01:13:24.975748316 +0000 UTC m=+0.115596734 container create 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-17T01:13:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:24 smithi103 ceph-mon[92733]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:24 smithi103 ceph-mon[92733]: pgmap v164: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:25.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:25 smithi143 podman[101054]: 2024-09-17 01:13:25.245120187 +0000 UTC m=+0.384968570 container init 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T01:13:25.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:25 smithi143 podman[101054]: 2024-09-17 01:13:25.24854052 +0000 UTC m=+0.388388896 container start 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:13:25.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:25 smithi143 ceph-osd[101072]: -- 172.21.15.143:0/3961101286 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a30ea301e0 con 0x55a30e9c6000 2024-09-17T01:13:25.508 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:25 smithi143 bash[101054]: 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 2024-09-17T01:13:25.509 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:25 smithi143 systemd[1]: Started Ceph osd.5 for b107b510-748f-11ef-bceb-c7b262605968. 2024-09-17T01:13:26.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:26.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:26.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:26 smithi103 ceph-mon[92733]: pgmap v165: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:26.716 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:26.716 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.716 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:26 smithi143 ceph-mon[80685]: pgmap v165: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:27.410 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:27 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:13:27.126+0000 7fcbcb646640 -1 Falling back to public interface 2024-09-17T01:13:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:28 smithi103 ceph-mon[92733]: pgmap v166: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:28 smithi143 ceph-mon[80685]: pgmap v166: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:31.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:30 smithi143 ceph-mon[80685]: pgmap v167: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 922 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:31.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:30 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 35/225 objects degraded (15.556%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:30 smithi103 ceph-mon[92733]: pgmap v167: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 922 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:31.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:30 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 35/225 objects degraded (15.556%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: pgmap v168: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 839 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:13:33.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:13:33.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:13:33.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:33.457 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:13:33.080+0000 7fcbcb646640 -1 osd.5 84 log_to_monitors true 2024-09-17T01:13:33.457 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:13:33.276+0000 7fcbc33e0640 -1 osd.5 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: pgmap v168: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 839 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.458 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:13:33.459 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:13:33.460 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:13:33.460 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:13:33.460 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:13:33.460 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:13:33.460 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:33.460 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all osd 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='osd.5 [v2:172.21.15.143:6816/3076848366,v1:172.21.15.143:6817/3076848366]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='osd.5 [v2:172.21.15.143:6816/3076848366,v1:172.21.15.143:6817/3076848366]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: osdmap e87: 6 total, 5 up, 6 in 2024-09-17T01:13:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:34.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:34.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T01:13:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all osd 2024-09-17T01:13:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='osd.5 [v2:172.21.15.143:6816/3076848366,v1:172.21.15.143:6817/3076848366]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='osd.5 [v2:172.21.15.143:6816/3076848366,v1:172.21.15.143:6817/3076848366]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: osdmap e87: 6 total, 5 up, 6 in 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:34.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T01:13:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:13:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: pgmap v170: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: osdmap e88: 6 total, 5 up, 6 in 2024-09-17T01:13:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:13:35.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 2 up:standby 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:35 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.gmmiqj"]}]: dispatch 2024-09-17T01:13:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: pgmap v170: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: osdmap e88: 6 total, 5 up, 6 in 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 2 up:standby 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:35.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:35 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.gmmiqj"]}]: dispatch 2024-09-17T01:13:36.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: Upgrade: It appears safe to stop mds.cephfs.smithi103.gmmiqj 2024-09-17T01:13:36.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:36.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: osd.5 [v2:172.21.15.143:6816/3076848366,v1:172.21.15.143:6817/3076848366] boot 2024-09-17T01:13:36.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: osdmap e89: 6 total, 6 up, 6 in 2024-09-17T01:13:36.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:13:36.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.103:6828/2039397078,v1:172.21.15.103:6829/2039397078] up:boot 2024-09-17T01:13:36.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 3 up:standby 2024-09-17T01:13:36.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:13:36.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:36.350 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:13:36.350 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:36.350 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:36 smithi103 ceph-mon[92733]: osdmap e90: 6 total, 6 up, 6 in 2024-09-17T01:13:36.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: Upgrade: It appears safe to stop mds.cephfs.smithi103.gmmiqj 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: osd.5 [v2:172.21.15.143:6816/3076848366,v1:172.21.15.143:6817/3076848366] boot 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: osdmap e89: 6 total, 6 up, 6 in 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.103:6828/2039397078,v1:172.21.15.103:6829/2039397078] up:boot 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 3 up:standby 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.gmmiqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:36.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:36 smithi143 ceph-mon[80685]: osdmap e90: 6 total, 6 up, 6 in 2024-09-17T01:13:37.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:37 smithi103 ceph-mon[92733]: Upgrade: Updating mds.cephfs.smithi103.gmmiqj 2024-09-17T01:13:37.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:37 smithi103 ceph-mon[92733]: Deploying daemon mds.cephfs.smithi103.gmmiqj on smithi103 2024-09-17T01:13:37.195 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:37 smithi103 ceph-mon[92733]: pgmap v173: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:37 smithi143 ceph-mon[80685]: Upgrade: Updating mds.cephfs.smithi103.gmmiqj 2024-09-17T01:13:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:37 smithi143 ceph-mon[80685]: Deploying daemon mds.cephfs.smithi103.gmmiqj on smithi103 2024-09-17T01:13:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:37 smithi143 ceph-mon[80685]: pgmap v173: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/225 objects degraded (15.556%) 2024-09-17T01:13:37.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:37 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[92729]: 2024-09-17T01:13:37.752+0000 7faaa80fe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:13:38.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:13:38.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:13:38.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: osdmap e91: 6 total, 6 up, 6 in 2024-09-17T01:13:38.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: Standby daemon mds.cephfs.smithi143.zkrwqj assigned to filesystem cephfs as rank 0 2024-09-17T01:13:38.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:13:38.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:13:38.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:38 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi143.zkrwqj=up:replay} 2 up:standby 2024-09-17T01:13:38.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:13:38.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:13:38.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: osdmap e91: 6 total, 6 up, 6 in 2024-09-17T01:13:38.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: Standby daemon mds.cephfs.smithi143.zkrwqj assigned to filesystem cephfs as rank 0 2024-09-17T01:13:38.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:13:38.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:13:38.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:38 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi143.zkrwqj=up:replay} 2 up:standby 2024-09-17T01:13:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:39 smithi103 ceph-mon[92733]: pgmap v176: 65 pgs: 14 active+undersized, 10 active+undersized+degraded, 41 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 31/225 objects degraded (13.778%) 2024-09-17T01:13:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:39 smithi103 ceph-mon[92733]: Health check update: Degraded data redundancy: 31/225 objects degraded (13.778%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:39 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:13:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:39 smithi143 ceph-mon[80685]: pgmap v176: 65 pgs: 14 active+undersized, 10 active+undersized+degraded, 41 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 31/225 objects degraded (13.778%) 2024-09-17T01:13:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:39 smithi143 ceph-mon[80685]: Health check update: Degraded data redundancy: 31/225 objects degraded (13.778%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:39 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:13:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:40 smithi103 ceph-mon[92733]: pgmap v177: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 3 op/s 2024-09-17T01:13:40.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:40 smithi103 ceph-mon[92733]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/225 objects degraded (13.778%), 10 pgs degraded) 2024-09-17T01:13:40.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:40 smithi143 ceph-mon[80685]: pgmap v177: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 3 op/s 2024-09-17T01:13:40.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:40 smithi143 ceph-mon[80685]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/225 objects degraded (13.778%), 10 pgs degraded) 2024-09-17T01:13:43.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:42 smithi103 ceph-mon[92733]: pgmap v178: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 3 op/s 2024-09-17T01:13:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:42 smithi143 ceph-mon[80685]: pgmap v178: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 3 op/s 2024-09-17T01:13:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:44 smithi143 ceph-mon[80685]: pgmap v179: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-17T01:13:45.274 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:44 smithi103 ceph-mon[92733]: pgmap v179: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-17T01:13:46.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:46.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:46.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:46.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: pgmap v180: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-17T01:13:46.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:reconnect 2024-09-17T01:13:46.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:boot 2024-09-17T01:13:46.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi143.zkrwqj=up:reconnect} 3 up:standby 2024-09-17T01:13:46.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:13:47.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:47.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:47.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: pgmap v180: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-17T01:13:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:reconnect 2024-09-17T01:13:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:boot 2024-09-17T01:13:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi143.zkrwqj=up:reconnect} 3 up:standby 2024-09-17T01:13:47.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:13:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:47 smithi103 ceph-mon[92733]: reconnect by client.24309 192.168.0.1:0/2120554610 after 0.000999974 2024-09-17T01:13:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:47 smithi103 ceph-mon[92733]: reconnect by client.14520 192.168.0.1:0/2898688174 after 0.000999974 2024-09-17T01:13:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:47 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:rejoin 2024-09-17T01:13:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:47 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi143.zkrwqj=up:rejoin} 3 up:standby 2024-09-17T01:13:47.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:47 smithi103 ceph-mon[92733]: daemon mds.cephfs.smithi143.zkrwqj is now active in filesystem cephfs as rank 0 2024-09-17T01:13:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:47 smithi143 ceph-mon[80685]: reconnect by client.24309 192.168.0.1:0/2120554610 after 0.000999974 2024-09-17T01:13:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:47 smithi143 ceph-mon[80685]: reconnect by client.14520 192.168.0.1:0/2898688174 after 0.000999974 2024-09-17T01:13:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:47 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:rejoin 2024-09-17T01:13:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:47 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi143.zkrwqj=up:rejoin} 3 up:standby 2024-09-17T01:13:48.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:47 smithi143 ceph-mon[80685]: daemon mds.cephfs.smithi143.zkrwqj is now active in filesystem cephfs as rank 0 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: pgmap v181: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 101 B/s wr, 6 op/s 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:active 2024-09-17T01:13:49.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:48 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi143.zkrwqj=up:active} 3 up:standby 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: pgmap v181: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 101 B/s wr, 6 op/s 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] up:active 2024-09-17T01:13:49.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:48 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi143.zkrwqj=up:active} 3 up:standby 2024-09-17T01:13:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:50 smithi103 ceph-mon[92733]: pgmap v182: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T01:13:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:50 smithi143 ceph-mon[80685]: pgmap v182: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T01:13:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:52.477 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:52.478 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:52.478 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:52 smithi143 ceph-mon[80685]: pgmap v183: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T01:13:52.650 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:52.650 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:52.651 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:52 smithi103 ceph-mon[92733]: pgmap v183: 65 pgs: 65 active+clean; 204 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T01:13:53.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 -- 172.21.15.103:0/3736832919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36000ff9a0 msgr2=0x7f36000ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:53.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3736832919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36000ff9a0 0x7f36000ffda0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009880 tx=0x7f35f002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 -- 172.21.15.103:0/3736832919 shutdown_connections 2024-09-17T01:13:53.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3736832919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3600100ba0 0x7f3600101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3736832919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36000ff9a0 0x7f36000ffda0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 -- 172.21.15.103:0/3736832919 >> 172.21.15.103:0/3736832919 conn(0x7f36000fb150 msgr2=0x7f36000fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:53.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 -- 172.21.15.103:0/3736832919 shutdown_connections 2024-09-17T01:13:53.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.794+0000 7f35ff59e640 1 -- 172.21.15.103:0/3736832919 wait complete. 2024-09-17T01:13:53.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35ff59e640 1 Processor -- start 2024-09-17T01:13:53.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35ff59e640 1 -- start start 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35ff59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36000ff9a0 0x7f3600195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35ff59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 0x7f36001959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35ff59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3600195f80 con 0x7f3600100ba0 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35ff59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36001960f0 con 0x7f36000ff9a0 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35fdd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 0x7f36001959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35fdd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 0x7f36001959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35016/0 (socket says 172.21.15.103:35016) 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.795+0000 7f35fdd9b640 1 -- 172.21.15.103:0/3136967333 learned_addr learned my addr 172.21.15.103:0/3136967333 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35fe59c640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36000ff9a0 0x7f3600195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35fdd9b640 1 -- 172.21.15.103:0/3136967333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36000ff9a0 msgr2=0x7f3600195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35fdd9b640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36000ff9a0 0x7f3600195470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35fdd9b640 1 -- 172.21.15.103:0/3136967333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009560 con 0x7f3600100ba0 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35fdd9b640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 0x7f36001959b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35f400e9a0 tx=0x7f35f400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f400cd50 con 0x7f3600100ba0 2024-09-17T01:13:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35f400ceb0 con 0x7f3600100ba0 2024-09-17T01:13:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f4010660 con 0x7f3600100ba0 2024-09-17T01:13:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360019ab90 con 0x7f3600100ba0 2024-09-17T01:13:53.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.796+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360019b160 con 0x7f3600100ba0 2024-09-17T01:13:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.797+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36001085b0 con 0x7f3600100ba0 2024-09-17T01:13:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.798+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f35f40048a0 con 0x7f3600100ba0 2024-09-17T01:13:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.798+0000 7f35ef7fe640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f35e806e5f0 0x7f35e8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.799+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f35f4014070 con 0x7f3600100ba0 2024-09-17T01:13:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.799+0000 7f35fe59c640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f35e806e5f0 0x7f35e8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:53.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.799+0000 7f35fe59c640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f35e806e5f0 0x7f35e8070ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009230 tx=0x7f35f00314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:53.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.805+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f35f4057cd0 con 0x7f3600100ba0 2024-09-17T01:13:53.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.993+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36001054f0 con 0x7f35e806e5f0 2024-09-17T01:13:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.994+0000 7f35ef7fe640 1 -- 172.21.15.103:0/3136967333 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f36001054f0 con 0x7f35e806e5f0 2024-09-17T01:13:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f35e806e5f0 msgr2=0x7f35e8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f35e806e5f0 0x7f35e8070ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009230 tx=0x7f35f00314e0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 msgr2=0x7f36001959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 0x7f36001959b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35f400e9a0 tx=0x7f35f400eda0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 shutdown_connections 2024-09-17T01:13:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f35e806e5f0 0x7f35e8070ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600100ba0 0x7f36001959b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 --2- 172.21.15.103:0/3136967333 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36000ff9a0 0x7f3600195470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 >> 172.21.15.103:0/3136967333 conn(0x7f36000fb150 msgr2=0x7f3600103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 shutdown_connections 2024-09-17T01:13:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:53.996+0000 7f35ff59e640 1 -- 172.21.15.103:0/3136967333 wait complete. 2024-09-17T01:13:54.004 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:13:54.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.079+0000 7f50427bd640 1 -- 172.21.15.103:0/1799167839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0ffc30 msgr2=0x7f503c1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.079+0000 7f50427bd640 1 --2- 172.21.15.103:0/1799167839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0ffc30 0x7f503c1000b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5030009880 tx=0x7f503002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.079+0000 7f50427bd640 1 -- 172.21.15.103:0/1799167839 shutdown_connections 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.079+0000 7f50427bd640 1 --2- 172.21.15.103:0/1799167839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0ffc30 0x7f503c1000b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.079+0000 7f50427bd640 1 --2- 172.21.15.103:0/1799167839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503c0fea30 0x7f503c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.079+0000 7f50427bd640 1 -- 172.21.15.103:0/1799167839 >> 172.21.15.103:0/1799167839 conn(0x7f503c0fa1c0 msgr2=0x7f503c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.080+0000 7f50427bd640 1 -- 172.21.15.103:0/1799167839 shutdown_connections 2024-09-17T01:13:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.080+0000 7f50427bd640 1 -- 172.21.15.103:0/1799167839 wait complete. 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.080+0000 7f50427bd640 1 Processor -- start 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.080+0000 7f50427bd640 1 -- start start 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f50427bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 0x7f503c195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f50427bd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503c0ffc30 0x7f503c195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f50427bd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c196160 con 0x7f503c0fea30 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f50427bd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c1962d0 con 0x7f503c0ffc30 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 0x7f503c195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 0x7f503c195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35026/0 (socket says 172.21.15.103:35026) 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 -- 172.21.15.103:0/1345507468 learned_addr learned my addr 172.21.15.103:0/1345507468 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503b7fe640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503c0ffc30 0x7f503c195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 -- 172.21.15.103:0/1345507468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503c0ffc30 msgr2=0x7f503c195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503c0ffc30 0x7f503c195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 -- 172.21.15.103:0/1345507468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030009560 con 0x7f503c0fea30 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f503bfff640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 0x7f503c195650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f502c00d900 tx=0x7f502c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.081+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502c009c00 con 0x7f503c0fea30 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.082+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c19ad70 con 0x7f503c0fea30 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.082+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f502c009d60 con 0x7f503c0fea30 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.082+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502c00f660 con 0x7f503c0fea30 2024-09-17T01:13:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.082+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c19b2b0 con 0x7f503c0fea30 2024-09-17T01:13:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.083+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c107640 con 0x7f503c0fea30 2024-09-17T01:13:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.083+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f502c00f8d0 con 0x7f503c0fea30 2024-09-17T01:13:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.084+0000 7f50397fa640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f502406e5f0 0x7f5024070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.084+0000 7f503b7fe640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f502406e5f0 0x7f5024070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.084+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f502c08e5e0 con 0x7f503c0fea30 2024-09-17T01:13:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.084+0000 7f503b7fe640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f502406e5f0 0x7f5024070ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5030000c00 tx=0x7f50300314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.088+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f502c0576c0 con 0x7f503c0fea30 2024-09-17T01:13:54.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.275+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f503c19b4a0 con 0x7f502406e5f0 2024-09-17T01:13:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.276+0000 7f50397fa640 1 -- 172.21.15.103:0/1345507468 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f503c19b4a0 con 0x7f502406e5f0 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.278+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f502406e5f0 msgr2=0x7f5024070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.278+0000 7f50427bd640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f502406e5f0 0x7f5024070ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5030000c00 tx=0x7f50300314e0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.278+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 msgr2=0x7f503c195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.278+0000 7f50427bd640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 0x7f503c195650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f502c00d900 tx=0x7f502c00ddc0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 shutdown_connections 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f502406e5f0 0x7f5024070ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503c0ffc30 0x7f503c195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 --2- 172.21.15.103:0/1345507468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f503c0fea30 0x7f503c195650 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 >> 172.21.15.103:0/1345507468 conn(0x7f503c0fa1c0 msgr2=0x7f503c067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 shutdown_connections 2024-09-17T01:13:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.279+0000 7f50427bd640 1 -- 172.21.15.103:0/1345507468 wait complete. 2024-09-17T01:13:54.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.360+0000 7fa53ec0a640 1 -- 172.21.15.103:0/925320446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 msgr2=0x7fa5380fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.360+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/925320446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa5380fee30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009880 tx=0x7fa52c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.360+0000 7fa53ec0a640 1 -- 172.21.15.103:0/925320446 shutdown_connections 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.360+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/925320446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5380ffc30 0x7fa5381000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.360+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/925320446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa5380fee30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.360+0000 7fa53ec0a640 1 -- 172.21.15.103:0/925320446 >> 172.21.15.103:0/925320446 conn(0x7fa5380fa1c0 msgr2=0x7fa5380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 -- 172.21.15.103:0/925320446 shutdown_connections 2024-09-17T01:13:54.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 -- 172.21.15.103:0/925320446 wait complete. 2024-09-17T01:13:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 Processor -- start 2024-09-17T01:13:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 -- start start 2024-09-17T01:13:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa538102970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5380ffc30 0x7fa538101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa538102eb0 con 0x7fa5380fea30 2024-09-17T01:13:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53ec0a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa538101550 con 0x7fa5380ffc30 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.361+0000 7fa53c9a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa538102970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53c9a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa538102970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35040/0 (socket says 172.21.15.103:35040) 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53c9a6640 1 -- 172.21.15.103:0/2624807426 learned_addr learned my addr 172.21.15.103:0/2624807426 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa537fff640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5380ffc30 0x7fa538101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53c9a6640 1 -- 172.21.15.103:0/2624807426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5380ffc30 msgr2=0x7fa538101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53c9a6640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5380ffc30 0x7fa538101010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53c9a6640 1 -- 172.21.15.103:0/2624807426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c009560 con 0x7fa5380fea30 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53c9a6640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa538102970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa52c02a9c0 tx=0x7fa52c005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52c004b20 con 0x7fa5380fea30 2024-09-17T01:13:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa52c004c80 con 0x7fa5380fea30 2024-09-17T01:13:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52c003b10 con 0x7fa5380fea30 2024-09-17T01:13:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.362+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5381017d0 con 0x7fa5380fea30 2024-09-17T01:13:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.363+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa538101d40 con 0x7fa5380fea30 2024-09-17T01:13:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.363+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa538107620 con 0x7fa5380fea30 2024-09-17T01:13:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.364+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa52c031d20 con 0x7fa5380fea30 2024-09-17T01:13:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.364+0000 7fa535ffb640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa52806e5f0 0x7fa528070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.364+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fa52c0af9a0 con 0x7fa5380fea30 2024-09-17T01:13:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.364+0000 7fa537fff640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa52806e5f0 0x7fa528070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.365+0000 7fa537fff640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa52806e5f0 0x7fa528070ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa5381026f0 tx=0x7fa52400a2d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.369+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa52c0789d0 con 0x7fa5380fea30 2024-09-17T01:13:54.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.549+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5380fc3c0 con 0x7fa52806e5f0 2024-09-17T01:13:54.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.559+0000 7fa535ffb640 1 -- 172.21.15.103:0/2624807426 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa5380fc3c0 con 0x7fa52806e5f0 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (13m) 3s ago 14m 24.8M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (15m) 3s ago 15m 9256k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (14m) 26s ago 14m 8530k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (3m) 3s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (3m) 26s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (13m) 3s ago 14m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (9s) 3s ago 9m 11.7M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (9m) 3s ago 9m 11.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 1ac5551b023c 2024-09-17T01:13:54.559 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (9m) 26s ago 9m 16.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (9m) 26s ago 9m 18.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (6m) 3s ago 16m 505M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (4m) 26s ago 13m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (4m) 3s ago 16m 50.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (4m) 26s ago 13m 40.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (14m) 3s ago 14m 16.4M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (13m) 26s ago 13m 16.3M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (3m) 3s ago 13m 107M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (2m) 3s ago 12m 148M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (2m) 3s ago 12m 175M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (95s) 26s ago 11m 140M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (62s) 26s ago 11m 97.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:13:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (29s) 26s ago 11m 14.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:13:54.561 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (5m) 3s ago 14m 69.3M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:13:54.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa52806e5f0 msgr2=0x7fa528070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa52806e5f0 0x7fa528070ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa5381026f0 tx=0x7fa52400a2d0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 msgr2=0x7fa538102970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa538102970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa52c02a9c0 tx=0x7fa52c005610 comp rx=0 tx=0).stop 2024-09-17T01:13:54.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 shutdown_connections 2024-09-17T01:13:54.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa52806e5f0 0x7fa528070ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5380ffc30 0x7fa538101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 --2- 172.21.15.103:0/2624807426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5380fea30 0x7fa538102970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 >> 172.21.15.103:0/2624807426 conn(0x7fa5380fa1c0 msgr2=0x7fa5380fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 shutdown_connections 2024-09-17T01:13:54.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.562+0000 7fa53ec0a640 1 -- 172.21.15.103:0/2624807426 wait complete. 2024-09-17T01:13:54.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 -- 172.21.15.103:0/4025078736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940fea30 msgr2=0x7f3e940fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 --2- 172.21.15.103:0/4025078736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940fea30 0x7f3e940fee30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009880 tx=0x7f3e9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 -- 172.21.15.103:0/4025078736 shutdown_connections 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 --2- 172.21.15.103:0/4025078736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940ffc30 0x7f3e941000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 --2- 172.21.15.103:0/4025078736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940fea30 0x7f3e940fee30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 -- 172.21.15.103:0/4025078736 >> 172.21.15.103:0/4025078736 conn(0x7f3e940fa1c0 msgr2=0x7f3e940fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 -- 172.21.15.103:0/4025078736 shutdown_connections 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.644+0000 7f3e9b494640 1 -- 172.21.15.103:0/4025078736 wait complete. 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e9b494640 1 Processor -- start 2024-09-17T01:13:54.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e9b494640 1 -- start start 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e9b494640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940fea30 0x7f3e94068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e9b494640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 0x7f3e9419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e9b494640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419aa40 con 0x7f3e940ffc30 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e9b494640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419ab80 con 0x7f3e940fea30 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e98a2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 0x7f3e9419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e98a2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 0x7f3e9419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35062/0 (socket says 172.21.15.103:35062) 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e98a2f640 1 -- 172.21.15.103:0/2428405682 learned_addr learned my addr 172.21.15.103:0/2428405682 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.645+0000 7f3e99230640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940fea30 0x7f3e94068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e98a2f640 1 -- 172.21.15.103:0/2428405682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940fea30 msgr2=0x7f3e94068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e98a2f640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940fea30 0x7f3e94068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e98a2f640 1 -- 172.21.15.103:0/2428405682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009560 con 0x7f3e940ffc30 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e99230640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940fea30 0x7f3e94068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e98a2f640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 0x7f3e9419a470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400b420 tx=0x7f3e8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e84011800 con 0x7f3e940ffc30 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e84011e20 con 0x7f3e940ffc30 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9419ae30 con 0x7f3e940ffc30 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8400f2e0 con 0x7f3e940ffc30 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.646+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9419b3d0 con 0x7f3e940ffc30 2024-09-17T01:13:54.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.647+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e940feeb0 con 0x7f3e940ffc30 2024-09-17T01:13:54.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.648+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3e84010380 con 0x7f3e940ffc30 2024-09-17T01:13:54.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.649+0000 7f3e8a7fc640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3e8006e5f0 0x7f3e80070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.649+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f3e8408e090 con 0x7f3e940ffc30 2024-09-17T01:13:54.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.649+0000 7f3e99230640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3e8006e5f0 0x7f3e80070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.650+0000 7f3e99230640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3e8006e5f0 0x7f3e80070ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e90031540 tx=0x7f3e90005de0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.653+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3e84057140 con 0x7f3e940ffc30 2024-09-17T01:13:54.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.898+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e941076a0 con 0x7f3e940ffc30 2024-09-17T01:13:54.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.898+0000 7f3e8a7fc640 1 -- 172.21.15.103:0/2428405682 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f3e8405a800 con 0x7f3e940ffc30 2024-09-17T01:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3, 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3, 2024-09-17T01:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11 2024-09-17T01:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3e8006e5f0 msgr2=0x7f3e80070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3e8006e5f0 0x7f3e80070ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e90031540 tx=0x7f3e90005de0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 msgr2=0x7f3e9419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 0x7f3e9419a470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400b420 tx=0x7f3e8400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 shutdown_connections 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3e8006e5f0 0x7f3e80070ab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e940ffc30 0x7f3e9419a470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 --2- 172.21.15.103:0/2428405682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e940fea30 0x7f3e94068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 >> 172.21.15.103:0/2428405682 conn(0x7f3e940fa1c0 msgr2=0x7f3e94102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 shutdown_connections 2024-09-17T01:13:54.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.901+0000 7f3e9b494640 1 -- 172.21.15.103:0/2428405682 wait complete. 2024-09-17T01:13:54.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1672371856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8100670 msgr2=0x7f47f8102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1672371856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8100670 0x7f47f8102a60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009880 tx=0x7f47e802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1672371856 shutdown_connections 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1672371856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8102fa0 0x7f47f8105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1672371856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8100670 0x7f47f8102a60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1672371856 >> 172.21.15.103:0/1672371856 conn(0x7f47f80fa230 msgr2=0x7f47f80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1672371856 shutdown_connections 2024-09-17T01:13:54.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.989+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1672371856 wait complete. 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47fcf4e640 1 Processor -- start 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47fcf4e640 1 -- start start 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47fcf4e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8100670 0x7f47f81956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47fcf4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 0x7f47f8195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47fcf4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f81961c0 con 0x7f47f8102fa0 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47fcf4e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8196330 con 0x7f47f8100670 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.990+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 0x7f47f8195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 0x7f47f8195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35084/0 (socket says 172.21.15.103:35084) 2024-09-17T01:13:54.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f5d9b640 1 -- 172.21.15.103:0/1322714808 learned_addr learned my addr 172.21.15.103:0/1322714808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f659c640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8100670 0x7f47f81956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f5d9b640 1 -- 172.21.15.103:0/1322714808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8100670 msgr2=0x7f47f81956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f5d9b640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8100670 0x7f47f81956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f5d9b640 1 -- 172.21.15.103:0/1322714808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8009560 con 0x7f47f8102fa0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47f5d9b640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 0x7f47f8195bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00b400 tx=0x7f47ec00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47ec011800 con 0x7f47f8102fa0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47ec011e20 con 0x7f47f8102fa0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f819add0 con 0x7f47f8102fa0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47ec00f2e0 con 0x7f47f8102fa0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.991+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f819b370 con 0x7f47f8102fa0 2024-09-17T01:13:54.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.992+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f8100ad0 con 0x7f47f8102fa0 2024-09-17T01:13:54.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.993+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f47ec010380 con 0x7f47f8102fa0 2024-09-17T01:13:54.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.993+0000 7f47e77fe640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f47e006e5f0 0x7f47e0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:54.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.993+0000 7f47f659c640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f47e006e5f0 0x7f47e0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:54.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.993+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f47ec08e310 con 0x7f47f8102fa0 2024-09-17T01:13:54.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.994+0000 7f47f659c640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f47e006e5f0 0x7f47e0070ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000c00 tx=0x7f47e80314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:54.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:54.998+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47ec0573c0 con 0x7f47f8102fa0 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: pgmap v184: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:55.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.rnhmlw"]}]: dispatch 2024-09-17T01:13:55.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:54 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2428405682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.206+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f47f819b640 con 0x7f47f8102fa0 2024-09-17T01:13:55.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.206+0000 7f47e77fe640 1 -- 172.21.15.103:0/1322714808 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1936 (secure 0 0 0) 0x7f47ec05aa80 con 0x7f47f8102fa0 2024-09-17T01:13:55.205 INFO:teuthology.orchestra.run.smithi103.stdout:e23 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-17T01:13:48:006625+0000 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 23 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:13:48.006623+0000 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:13:55.206 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 91 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=24271} 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:13:55.207 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 24271 members: 24271 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{0:24271} state up:active seq 144 join_fscid=1 addr [v2:172.21.15.143:6824/1830708841,v1:172.21.15.143:6825/1830708841] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{-1:34376} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6828/2039397078,v1:172.21.15.103:6829/2039397078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:13:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:13:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 23 2024-09-17T01:13:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f47e006e5f0 msgr2=0x7f47e0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f47e006e5f0 0x7f47e0070ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000c00 tx=0x7f47e80314e0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 msgr2=0x7f47f8195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 0x7f47f8195bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00b400 tx=0x7f47ec00b8c0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 shutdown_connections 2024-09-17T01:13:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f47e006e5f0 0x7f47e0070ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f8102fa0 0x7f47f8195bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 --2- 172.21.15.103:0/1322714808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8100670 0x7f47f81956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 >> 172.21.15.103:0/1322714808 conn(0x7f47f80fa230 msgr2=0x7f47f80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.208+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 shutdown_connections 2024-09-17T01:13:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.209+0000 7f47fcf4e640 1 -- 172.21.15.103:0/1322714808 wait complete. 2024-09-17T01:13:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: pgmap v184: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.rnhmlw"]}]: dispatch 2024-09-17T01:13:55.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:54 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2428405682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 -- 172.21.15.103:0/211801798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 msgr2=0x7fa7a4101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 --2- 172.21.15.103:0/211801798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a4101680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009880 tx=0x7fa7a002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 -- 172.21.15.103:0/211801798 shutdown_connections 2024-09-17T01:13:55.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 --2- 172.21.15.103:0/211801798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ff7c0 0x7fa7a40ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 --2- 172.21.15.103:0/211801798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a4101680 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 -- 172.21.15.103:0/211801798 >> 172.21.15.103:0/211801798 conn(0x7fa7a40fb330 msgr2=0x7fa7a40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 -- 172.21.15.103:0/211801798 shutdown_connections 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 -- 172.21.15.103:0/211801798 wait complete. 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.293+0000 7fa7abf53640 1 Processor -- start 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7abf53640 1 -- start start 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7abf53640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ff7c0 0x7fa7a4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7abf53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7abf53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4072de0 con 0x7fa7a4101280 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7abf53640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4072f50 con 0x7fa7a40ff7c0 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a40728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35100/0 (socket says 172.21.15.103:35100) 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 -- 172.21.15.103:0/572568690 learned_addr learned my addr 172.21.15.103:0/572568690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a9cef640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ff7c0 0x7fa7a4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 -- 172.21.15.103:0/572568690 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ff7c0 msgr2=0x7fa7a4074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ff7c0 0x7fa7a4074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 -- 172.21.15.103:0/572568690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009560 con 0x7fa7a4101280 2024-09-17T01:13:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.294+0000 7fa7a94ee640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a40728a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa79400b420 tx=0x7fa79400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.295+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa794011800 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.295+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa794011e20 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.295+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79400f2e0 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.295+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4073230 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.295+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a419d850 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.296+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a40ffcc0 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.296+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa794010380 con 0x7fa7a4101280 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.297+0000 7fa79affd640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa79006e5f0 0x7fa790070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:55.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.297+0000 7fa7a9cef640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa79006e5f0 0x7fa790070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.297+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fa79408e140 con 0x7fa7a4101280 2024-09-17T01:13:55.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.297+0000 7fa7a9cef640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa79006e5f0 0x7fa790070ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0031540 tx=0x7fa7a0000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:55.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.301+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa794057170 con 0x7fa7a4101280 2024-09-17T01:13:55.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.491+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a41056f0 con 0x7fa79006e5f0 2024-09-17T01:13:55.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.493+0000 7fa79affd640 1 -- 172.21.15.103:0/572568690 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa7a41056f0 con 0x7fa79006e5f0 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "osd", 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "13/23 daemons upgraded", 2024-09-17T01:13:55.492 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:13:55.493 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:13:55.493 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:13:55.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa79006e5f0 msgr2=0x7fa790070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa79006e5f0 0x7fa790070ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0031540 tx=0x7fa7a0000bc0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 msgr2=0x7fa7a40728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a40728a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa79400b420 tx=0x7fa79400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 shutdown_connections 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa79006e5f0 0x7fa790070ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7a4101280 0x7fa7a40728a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 --2- 172.21.15.103:0/572568690 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7a40ff7c0 0x7fa7a4074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 >> 172.21.15.103:0/572568690 conn(0x7fa7a40fb330 msgr2=0x7fa7a4103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 shutdown_connections 2024-09-17T01:13:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.495+0000 7fa7abf53640 1 -- 172.21.15.103:0/572568690 wait complete. 2024-09-17T01:13:55.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.576+0000 7f642b9ef640 1 -- 172.21.15.103:0/1375135836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 msgr2=0x7f64240fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.576+0000 7f642b9ef640 1 --2- 172.21.15.103:0/1375135836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64240fe830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f641c009880 tx=0x7f641c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.576+0000 7f642b9ef640 1 -- 172.21.15.103:0/1375135836 shutdown_connections 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.576+0000 7f642b9ef640 1 --2- 172.21.15.103:0/1375135836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64240fed70 0x7f64240ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.576+0000 7f642b9ef640 1 --2- 172.21.15.103:0/1375135836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64240fe830 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.576+0000 7f642b9ef640 1 -- 172.21.15.103:0/1375135836 >> 172.21.15.103:0/1375135836 conn(0x7f64240fa1c0 msgr2=0x7f64240fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 -- 172.21.15.103:0/1375135836 shutdown_connections 2024-09-17T01:13:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 -- 172.21.15.103:0/1375135836 wait complete. 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 Processor -- start 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 -- start start 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64241978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64240fed70 0x7f6424197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64241983f0 con 0x7f64240fe430 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642b9ef640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424198560 con 0x7f64240fed70 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642978b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64241978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642978b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64241978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35104/0 (socket says 172.21.15.103:35104) 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.577+0000 7f642978b640 1 -- 172.21.15.103:0/2482277232 learned_addr learned my addr 172.21.15.103:0/2482277232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f6428f8a640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64240fed70 0x7f6424197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f642978b640 1 -- 172.21.15.103:0/2482277232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64240fed70 msgr2=0x7f6424197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f642978b640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64240fed70 0x7f6424197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f642978b640 1 -- 172.21.15.103:0/2482277232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c009560 con 0x7f64240fe430 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f642978b640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64241978e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f641c005640 tx=0x7f641c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f641c004ba0 con 0x7f64240fe430 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f641c004d00 con 0x7f64240fe430 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642419cfa0 con 0x7f64240fe430 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f641c003b70 con 0x7f64240fe430 2024-09-17T01:13:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.578+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642419d490 con 0x7f64240fe430 2024-09-17T01:13:55.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.579+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642410a990 con 0x7f64240fe430 2024-09-17T01:13:55.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.580+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f641c031640 con 0x7f64240fe430 2024-09-17T01:13:55.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.580+0000 7f641a7fc640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f641006e5f0 0x7f6410070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:55.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.580+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f641c0af9b0 con 0x7f64240fe430 2024-09-17T01:13:55.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.580+0000 7f6428f8a640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f641006e5f0 0x7f6410070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:55.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.581+0000 7f6428f8a640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f641006e5f0 0x7f6410070ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6424198e00 tx=0x7f6414009110 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:55.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.584+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f641c0789e0 con 0x7f64240fe430 2024-09-17T01:13:55.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.824+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f642410ab20 con 0x7f64240fe430 2024-09-17T01:13:55.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.824+0000 7f641a7fc640 1 -- 172.21.15.103:0/2482277232 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f641c07c0a0 con 0x7f64240fe430 2024-09-17T01:13:55.824 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:13:55.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f641006e5f0 msgr2=0x7f6410070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f641006e5f0 0x7f6410070ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6424198e00 tx=0x7f6414009110 comp rx=0 tx=0).stop 2024-09-17T01:13:55.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 msgr2=0x7f64241978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64241978e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f641c005640 tx=0x7f641c005670 comp rx=0 tx=0).stop 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 shutdown_connections 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f641006e5f0 0x7f6410070ab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64240fed70 0x7f6424197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 --2- 172.21.15.103:0/2482277232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64240fe430 0x7f64241978e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 >> 172.21.15.103:0/2482277232 conn(0x7f64240fa1c0 msgr2=0x7f6424106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 shutdown_connections 2024-09-17T01:13:55.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:13:55.827+0000 7f642b9ef640 1 -- 172.21.15.103:0/2482277232 wait complete. 2024-09-17T01:13:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:55 smithi103 ceph-mon[92733]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:55 smithi103 ceph-mon[92733]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:55 smithi103 ceph-mon[92733]: Upgrade: It appears safe to stop mds.cephfs.smithi103.rnhmlw 2024-09-17T01:13:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:55 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1322714808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:13:56.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:55 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2482277232' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:55 smithi143 ceph-mon[80685]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:55 smithi143 ceph-mon[80685]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:55 smithi143 ceph-mon[80685]: Upgrade: It appears safe to stop mds.cephfs.smithi103.rnhmlw 2024-09-17T01:13:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:55 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1322714808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:13:56.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:55 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2482277232' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: pgmap v185: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 744 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: Upgrade: Updating mds.cephfs.smithi103.rnhmlw 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:57 smithi103 ceph-mon[92733]: Deploying daemon mds.cephfs.smithi103.rnhmlw on smithi103 2024-09-17T01:13:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: pgmap v185: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 744 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:13:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: Upgrade: Updating mds.cephfs.smithi103.rnhmlw 2024-09-17T01:13:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:13:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.rnhmlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:13:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:57 smithi143 ceph-mon[80685]: Deploying daemon mds.cephfs.smithi103.rnhmlw on smithi103 2024-09-17T01:13:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:59 smithi143 ceph-mon[80685]: pgmap v186: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 744 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:13:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:59 smithi143 ceph-mon[80685]: osdmap e92: 6 total, 6 up, 6 in 2024-09-17T01:13:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:13:59 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi143.zkrwqj=up:active} 2 up:standby 2024-09-17T01:13:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:59 smithi103 ceph-mon[92733]: pgmap v186: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 744 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:13:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:59 smithi103 ceph-mon[92733]: osdmap e92: 6 total, 6 up, 6 in 2024-09-17T01:13:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:13:59 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi143.zkrwqj=up:active} 2 up:standby 2024-09-17T01:14:01.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:01 smithi103 ceph-mon[92733]: pgmap v188: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-17T01:14:01.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:01 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:14:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:01 smithi143 ceph-mon[80685]: pgmap v188: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-17T01:14:01.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:01 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:14:03.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:03 smithi103 ceph-mon[92733]: pgmap v189: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-17T01:14:03.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:03.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:03 smithi143 ceph-mon[80685]: pgmap v189: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-17T01:14:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: pgmap v190: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] up:boot 2024-09-17T01:14:04.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi143.zkrwqj=up:active} 3 up:standby 2024-09-17T01:14:04.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:04 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:14:05.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:05.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:05.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:05.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: pgmap v190: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:05.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] up:boot 2024-09-17T01:14:05.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi143.zkrwqj=up:active} 3 up:standby 2024-09-17T01:14:05.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:04 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:14:07.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:06 smithi103 ceph-mon[92733]: pgmap v191: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:06 smithi143 ceph-mon[80685]: pgmap v191: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:08 smithi143 ceph-mon[80685]: pgmap v192: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:08 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:08 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:09.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:08 smithi103 ceph-mon[92733]: pgmap v192: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:08 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:08 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:10.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:10.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:10.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:10 smithi143 ceph-mon[80685]: pgmap v193: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:10.602 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:10.602 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:10.603 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:10 smithi103 ceph-mon[92733]: pgmap v193: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: pgmap v194: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.237 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.238 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi143.zkrwqj"]}]: dispatch 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: pgmap v194: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi143.zkrwqj"]}]: dispatch 2024-09-17T01:14:14.135 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:13 smithi143 ceph-mon[80685]: Upgrade: It appears safe to stop mds.cephfs.smithi143.zkrwqj 2024-09-17T01:14:14.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:13 smithi103 ceph-mon[92733]: Upgrade: It appears safe to stop mds.cephfs.smithi143.zkrwqj 2024-09-17T01:14:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:14 smithi143 ceph-mon[80685]: pgmap v195: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:14:15.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:14 smithi103 ceph-mon[92733]: pgmap v195: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.zkrwqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:14:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:15 smithi143 ceph-mon[80685]: Upgrade: Updating mds.cephfs.smithi143.zkrwqj 2024-09-17T01:14:16.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:15 smithi143 ceph-mon[80685]: Deploying daemon mds.cephfs.smithi143.zkrwqj on smithi143 2024-09-17T01:14:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:15 smithi103 ceph-mon[92733]: Upgrade: Updating mds.cephfs.smithi143.zkrwqj 2024-09-17T01:14:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:15 smithi103 ceph-mon[92733]: Deploying daemon mds.cephfs.smithi143.zkrwqj on smithi143 2024-09-17T01:14:16.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[92729]: 2024-09-17T01:14:16.092+0000 7faaa80fe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: pgmap v196: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: osdmap e93: 6 total, 6 up, 6 in 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: Standby daemon mds.cephfs.smithi143.uraktq assigned to filesystem cephfs as rank 0 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:14:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:16 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi143.uraktq=up:replay} 2 up:standby 2024-09-17T01:14:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: pgmap v196: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:14:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:14:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: osdmap e93: 6 total, 6 up, 6 in 2024-09-17T01:14:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: Standby daemon mds.cephfs.smithi143.uraktq assigned to filesystem cephfs as rank 0 2024-09-17T01:14:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:14:17.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:14:17.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:16 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi143.uraktq=up:replay} 2 up:standby 2024-09-17T01:14:19.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:18 smithi103 ceph-mon[92733]: pgmap v198: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-17T01:14:19.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:19.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:19.181 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:14:19.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:18 smithi143 ceph-mon[80685]: pgmap v198: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-17T01:14:19.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:19.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:19.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:14:21.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:20 smithi103 ceph-mon[92733]: pgmap v199: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-09-17T01:14:21.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:20 smithi143 ceph-mon[80685]: pgmap v199: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-09-17T01:14:23.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:22 smithi143 ceph-mon[80685]: pgmap v200: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-09-17T01:14:23.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:22 smithi103 ceph-mon[92733]: pgmap v200: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-09-17T01:14:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:24 smithi103 ceph-mon[92733]: pgmap v201: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-17T01:14:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:24 smithi103 ceph-mon[92733]: reconnect by client.24309 192.168.0.1:0/2120554610 after 0.000999973 2024-09-17T01:14:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:24 smithi103 ceph-mon[92733]: reconnect by client.14520 192.168.0.1:0/2898688174 after 0.000999973 2024-09-17T01:14:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:24 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:reconnect 2024-09-17T01:14:25.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:24 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi143.uraktq=up:reconnect} 2 up:standby 2024-09-17T01:14:25.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:24 smithi143 ceph-mon[80685]: pgmap v201: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-17T01:14:25.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:24 smithi143 ceph-mon[80685]: reconnect by client.24309 192.168.0.1:0/2120554610 after 0.000999973 2024-09-17T01:14:25.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:24 smithi143 ceph-mon[80685]: reconnect by client.14520 192.168.0.1:0/2898688174 after 0.000999973 2024-09-17T01:14:25.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:24 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:reconnect 2024-09-17T01:14:25.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:24 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi143.uraktq=up:reconnect} 2 up:standby 2024-09-17T01:14:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 -- 172.21.15.103:0/2270183000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 msgr2=0x7efeb00fe220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 --2- 172.21.15.103:0/2270183000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb00fe220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efea4009880 tx=0x7efea402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 -- 172.21.15.103:0/2270183000 shutdown_connections 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 --2- 172.21.15.103:0/2270183000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 0x7efeb00fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 --2- 172.21.15.103:0/2270183000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb00fe220 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 -- 172.21.15.103:0/2270183000 >> 172.21.15.103:0/2270183000 conn(0x7efeb00f99b0 msgr2=0x7efeb00fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 -- 172.21.15.103:0/2270183000 shutdown_connections 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.924+0000 7efeb755c640 1 -- 172.21.15.103:0/2270183000 wait complete. 2024-09-17T01:14:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb755c640 1 Processor -- start 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb755c640 1 -- start start 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb755c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb01032c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb755c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 0x7efeb0101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb755c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0101e50 con 0x7efeb0067b70 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb755c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0101fc0 con 0x7efeb0068000 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb52f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb01032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb52f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb01032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57830/0 (socket says 172.21.15.103:57830) 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.925+0000 7efeb4af7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 0x7efeb0101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb52f8640 1 -- 172.21.15.103:0/2339518622 learned_addr learned my addr 172.21.15.103:0/2339518622 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb52f8640 1 -- 172.21.15.103:0/2339518622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 msgr2=0x7efeb0101910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb52f8640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 0x7efeb0101910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb52f8640 1 -- 172.21.15.103:0/2339518622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009560 con 0x7efeb0067b70 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb4af7640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 0x7efeb0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb52f8640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb01032c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efea402a9c0 tx=0x7efea40054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea4004aa0 con 0x7efeb0067b70 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efea4004c00 con 0x7efeb0067b70 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea4003a80 con 0x7efeb0067b70 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0102240 con 0x7efeb0067b70 2024-09-17T01:14:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.926+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0102730 con 0x7efeb0067b70 2024-09-17T01:14:25.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.927+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb00fe220 con 0x7efeb0067b70 2024-09-17T01:14:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.928+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efea4003d40 con 0x7efeb0067b70 2024-09-17T01:14:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.929+0000 7efea27fc640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9c06e5f0 0x7efe9c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.929+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7efea40af940 con 0x7efeb0067b70 2024-09-17T01:14:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.929+0000 7efeb4af7640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9c06e5f0 0x7efe9c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.929+0000 7efeb4af7640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9c06e5f0 0x7efe9c070ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efeb0103040 tx=0x7efeac00b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:25.933+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efea40789c0 con 0x7efeb0067b70 2024-09-17T01:14:26.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.122+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efeb0100dc0 con 0x7efe9c06e5f0 2024-09-17T01:14:26.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.123+0000 7efea27fc640 1 -- 172.21.15.103:0/2339518622 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efeb0100dc0 con 0x7efe9c06e5f0 2024-09-17T01:14:26.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9c06e5f0 msgr2=0x7efe9c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9c06e5f0 0x7efe9c070ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efeb0103040 tx=0x7efeac00b390 comp rx=0 tx=0).stop 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 msgr2=0x7efeb01032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb01032c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efea402a9c0 tx=0x7efea40054f0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 shutdown_connections 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe9c06e5f0 0x7efe9c070ab0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb0068000 0x7efeb0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 --2- 172.21.15.103:0/2339518622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb0067b70 0x7efeb01032c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.125+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 >> 172.21.15.103:0/2339518622 conn(0x7efeb00f99b0 msgr2=0x7efeb01006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.126+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 shutdown_connections 2024-09-17T01:14:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.126+0000 7efeb755c640 1 -- 172.21.15.103:0/2339518622 wait complete. 2024-09-17T01:14:26.132 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:14:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:25 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:rejoin 2024-09-17T01:14:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:25 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi143.uraktq=up:rejoin} 2 up:standby 2024-09-17T01:14:26.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:25 smithi103 ceph-mon[92733]: daemon mds.cephfs.smithi143.uraktq is now active in filesystem cephfs as rank 0 2024-09-17T01:14:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.208+0000 7f917bf3f640 1 -- 172.21.15.103:0/4043718738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91741005c0 msgr2=0x7f91741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.208+0000 7f917bf3f640 1 --2- 172.21.15.103:0/4043718738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91741005c0 0x7f91741029b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91640098b0 tx=0x7f916402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- 172.21.15.103:0/4043718738 shutdown_connections 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 --2- 172.21.15.103:0/4043718738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9174102ef0 0x7f91741052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 --2- 172.21.15.103:0/4043718738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91741005c0 0x7f91741029b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- 172.21.15.103:0/4043718738 >> 172.21.15.103:0/4043718738 conn(0x7f91740fa1c0 msgr2=0x7f91740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- 172.21.15.103:0/4043718738 shutdown_connections 2024-09-17T01:14:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- 172.21.15.103:0/4043718738 wait complete. 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 Processor -- start 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- start start 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91741005c0 0x7f9174195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 0x7f9174195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174196190 con 0x7f9174102ef0 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.209+0000 7f917bf3f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174196300 con 0x7f91741005c0 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 0x7f9174195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 0x7f9174195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57852/0 (socket says 172.21.15.103:57852) 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 -- 172.21.15.103:0/3919843331 learned_addr learned my addr 172.21.15.103:0/3919843331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:26.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f9179cdb640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91741005c0 0x7f9174195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 -- 172.21.15.103:0/3919843331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91741005c0 msgr2=0x7f9174195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91741005c0 0x7f9174195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 -- 172.21.15.103:0/3919843331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164009560 con 0x7f9174102ef0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f91794da640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 0x7f9174195bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f917000d6f0 tx=0x7f917000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91700051f0 con 0x7f9174102ef0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9170009ce0 con 0x7f9174102ef0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9170004e80 con 0x7f9174102ef0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917419ada0 con 0x7f9174102ef0 2024-09-17T01:14:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.210+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917419b340 con 0x7f9174102ef0 2024-09-17T01:14:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.211+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91741009a0 con 0x7f9174102ef0 2024-09-17T01:14:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.212+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f91700046c0 con 0x7f9174102ef0 2024-09-17T01:14:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.212+0000 7f916affd640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f916006e5a0 0x7f9160070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.212+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f917008e2c0 con 0x7f9174102ef0 2024-09-17T01:14:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.212+0000 7f9179cdb640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f916006e5a0 0x7f9160070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.213+0000 7f9179cdb640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f916006e5a0 0x7f9160070a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9164006010 tx=0x7f9164005d50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:26.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.217+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9170057290 con 0x7f9174102ef0 2024-09-17T01:14:26.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:25 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:rejoin 2024-09-17T01:14:26.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:25 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi143.uraktq=up:rejoin} 2 up:standby 2024-09-17T01:14:26.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:25 smithi143 ceph-mon[80685]: daemon mds.cephfs.smithi143.uraktq is now active in filesystem cephfs as rank 0 2024-09-17T01:14:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.399+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9174103990 con 0x7f916006e5a0 2024-09-17T01:14:26.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.401+0000 7f916affd640 1 -- 172.21.15.103:0/3919843331 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9174103990 con 0x7f916006e5a0 2024-09-17T01:14:26.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f916006e5a0 msgr2=0x7f9160070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f916006e5a0 0x7f9160070a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9164006010 tx=0x7f9164005d50 comp rx=0 tx=0).stop 2024-09-17T01:14:26.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 msgr2=0x7f9174195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 0x7f9174195bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f917000d6f0 tx=0x7f917000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 shutdown_connections 2024-09-17T01:14:26.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f916006e5a0 0x7f9160070a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9174102ef0 0x7f9174195bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 --2- 172.21.15.103:0/3919843331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91741005c0 0x7f9174195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 >> 172.21.15.103:0/3919843331 conn(0x7f91740fa1c0 msgr2=0x7f91740fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:26.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 shutdown_connections 2024-09-17T01:14:26.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.403+0000 7f917bf3f640 1 -- 172.21.15.103:0/3919843331 wait complete. 2024-09-17T01:14:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 -- 172.21.15.103:0/1274447536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 msgr2=0x7f3240100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 --2- 172.21.15.103:0/1274447536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f3240100810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3234009880 tx=0x7f323402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 -- 172.21.15.103:0/1274447536 shutdown_connections 2024-09-17T01:14:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 --2- 172.21.15.103:0/1274447536 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3240100d50 0x7f32401031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 --2- 172.21.15.103:0/1274447536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f3240100810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 -- 172.21.15.103:0/1274447536 >> 172.21.15.103:0/1274447536 conn(0x7f32400fa230 msgr2=0x7f32400fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 -- 172.21.15.103:0/1274447536 shutdown_connections 2024-09-17T01:14:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.484+0000 7f324722c640 1 -- 172.21.15.103:0/1274447536 wait complete. 2024-09-17T01:14:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f324722c640 1 Processor -- start 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f324722c640 1 -- start start 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f324722c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f324019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f324722c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3240100d50 0x7f324019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f324722c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324019c6c0 con 0x7f32400fe400 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f324722c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324019c830 con 0x7f3240100d50 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f3244fc8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f324019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f3244fc8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f324019bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57870/0 (socket says 172.21.15.103:57870) 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.485+0000 7f3244fc8640 1 -- 172.21.15.103:0/3229585601 learned_addr learned my addr 172.21.15.103:0/3229585601 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f323ffff640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3240100d50 0x7f324019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f3244fc8640 1 -- 172.21.15.103:0/3229585601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3240100d50 msgr2=0x7f324019c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f3244fc8640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3240100d50 0x7f324019c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f3244fc8640 1 -- 172.21.15.103:0/3229585601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234009560 con 0x7f32400fe400 2024-09-17T01:14:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f3244fc8640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f324019bbb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3234005640 tx=0x7f3234005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3234004ba0 con 0x7f32400fe400 2024-09-17T01:14:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3234004d00 con 0x7f32400fe400 2024-09-17T01:14:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32401a1270 con 0x7f32400fe400 2024-09-17T01:14:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3234003c30 con 0x7f32400fe400 2024-09-17T01:14:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.486+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32401a17e0 con 0x7f32400fe400 2024-09-17T01:14:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.487+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324010ed50 con 0x7f32400fe400 2024-09-17T01:14:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.488+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3234031640 con 0x7f32400fe400 2024-09-17T01:14:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.489+0000 7f323dffb640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f323006e5f0 0x7f3230070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.489+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f32340afa50 con 0x7f32400fe400 2024-09-17T01:14:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.489+0000 7f323ffff640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f323006e5f0 0x7f3230070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.489+0000 7f323ffff640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f323006e5f0 0x7f3230070ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f324019d0d0 tx=0x7f322c00a4c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:26.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.493+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3234078aa0 con 0x7f32400fe400 2024-09-17T01:14:26.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.670+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3240101710 con 0x7f323006e5f0 2024-09-17T01:14:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.679+0000 7f323dffb640 1 -- 172.21.15.103:0/3229585601 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f3240101710 con 0x7f323006e5f0 2024-09-17T01:14:26.677 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:14:26.677 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (13m) 18s ago 15m 24.9M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:14:26.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (15m) 18s ago 15m 9281k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:14:26.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (14m) 58s ago 14m 8530k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (4m) 18s ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (4m) 58s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (13m) 18s ago 15m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (41s) 18s ago 10m 13.9M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (23s) 18s ago 9m 14.0M - 19.1.1-330-gc2ddf972 ebb0615149de b2b1fe41a30f 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (9m) 58s ago 9m 16.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 97e1e0f9b572 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (10m) 58s ago 10m 18.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 42aed80d3ef9 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (6m) 18s ago 16m 505M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (5m) 58s ago 14m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (5m) 18s ago 16m 51.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (4m) 58s ago 14m 40.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (15m) 18s ago 15m 16.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:14:26.678 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (14m) 58s ago 14m 16.3M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (3m) 18s ago 13m 108M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (3m) 18s ago 13m 149M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (2m) 18s ago 12m 174M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (2m) 58s ago 12m 140M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (94s) 58s ago 11m 97.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (61s) 58s ago 11m 14.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:14:26.679 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (5m) 18s ago 14m 69.3M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f323006e5f0 msgr2=0x7f3230070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f323006e5f0 0x7f3230070ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f324019d0d0 tx=0x7f322c00a4c0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 msgr2=0x7f324019bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f324019bbb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3234005640 tx=0x7f3234005670 comp rx=0 tx=0).stop 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 shutdown_connections 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f323006e5f0 0x7f3230070ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3240100d50 0x7f324019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 --2- 172.21.15.103:0/3229585601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32400fe400 0x7f324019bbb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 >> 172.21.15.103:0/3229585601 conn(0x7f32400fa230 msgr2=0x7f32400fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 shutdown_connections 2024-09-17T01:14:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.682+0000 7f324722c640 1 -- 172.21.15.103:0/3229585601 wait complete. 2024-09-17T01:14:26.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 -- 172.21.15.103:0/1853346065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3538100060 msgr2=0x7f3538100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 --2- 172.21.15.103:0/1853346065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3538100060 0x7f3538100460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3528009880 tx=0x7f352802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 -- 172.21.15.103:0/1853346065 shutdown_connections 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 --2- 172.21.15.103:0/1853346065 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35380fed10 0x7f35380ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 --2- 172.21.15.103:0/1853346065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3538100060 0x7f3538100460 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 -- 172.21.15.103:0/1853346065 >> 172.21.15.103:0/1853346065 conn(0x7f35380f99b0 msgr2=0x7f35380fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 -- 172.21.15.103:0/1853346065 shutdown_connections 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.761+0000 7f353daa7640 1 -- 172.21.15.103:0/1853346065 wait complete. 2024-09-17T01:14:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.762+0000 7f353daa7640 1 Processor -- start 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.762+0000 7f353daa7640 1 -- start start 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.762+0000 7f353daa7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 0x7f35380fe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.762+0000 7f353daa7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3538100060 0x7f353819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.762+0000 7f353daa7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819a930 con 0x7f35380fed10 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.762+0000 7f353daa7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819aa70 con 0x7f3538100060 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 0x7f35380fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 0x7f35380fe760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57878/0 (socket says 172.21.15.103:57878) 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 -- 172.21.15.103:0/2778811069 learned_addr learned my addr 172.21.15.103:0/2778811069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f3536ffd640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3538100060 0x7f353819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 -- 172.21.15.103:0/2778811069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3538100060 msgr2=0x7f353819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3538100060 0x7f353819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 -- 172.21.15.103:0/2778811069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009560 con 0x7f35380fed10 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f35377fe640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 0x7f35380fe760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f352802a9c0 tx=0x7f35280054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3528004aa0 con 0x7f35380fed10 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3528004c00 con 0x7f35380fed10 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353819acc0 con 0x7f35380fed10 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3528003a80 con 0x7f35380fed10 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.763+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353819b230 con 0x7f35380fed10 2024-09-17T01:14:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.764+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3538107680 con 0x7f35380fed10 2024-09-17T01:14:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.765+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3528003cf0 con 0x7f35380fed10 2024-09-17T01:14:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.765+0000 7f3534ff9640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f352006e5f0 0x7f3520070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.766+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f35280af880 con 0x7f35380fed10 2024-09-17T01:14:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.766+0000 7f3536ffd640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f352006e5f0 0x7f3520070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.766+0000 7f3536ffd640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f352006e5f0 0x7f3520070ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35380fece0 tx=0x7f352c00b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:26.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:26.770+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3528078980 con 0x7f35380fed10 2024-09-17T01:14:27.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.012+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f353819b470 con 0x7f35380fed10 2024-09-17T01:14:27.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:26 smithi103 ceph-mon[92733]: pgmap v202: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-17T01:14:27.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:26 smithi103 ceph-mon[92733]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:14:27.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:26 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:14:27.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:26 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:active 2024-09-17T01:14:27.011 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:26 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi143.uraktq=up:active} 2 up:standby 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.013+0000 7f3534ff9640 1 -- 172.21.15.103:0/2778811069 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f352807c040 con 0x7f35380fed10 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:14:27.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:14:27.013 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.015+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f352006e5f0 msgr2=0x7f3520070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.015+0000 7f353daa7640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f352006e5f0 0x7f3520070ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35380fece0 tx=0x7f352c00b390 comp rx=0 tx=0).stop 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.015+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 msgr2=0x7f35380fe760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 0x7f35380fe760 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f352802a9c0 tx=0x7f35280054f0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 shutdown_connections 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f352006e5f0 0x7f3520070ab0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3538100060 0x7f353819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 --2- 172.21.15.103:0/2778811069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35380fed10 0x7f35380fe760 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 >> 172.21.15.103:0/2778811069 conn(0x7f35380f99b0 msgr2=0x7f3538102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 shutdown_connections 2024-09-17T01:14:27.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.016+0000 7f353daa7640 1 -- 172.21.15.103:0/2778811069 wait complete. 2024-09-17T01:14:27.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 -- 172.21.15.103:0/2584718925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 msgr2=0x7f02c81000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 --2- 172.21.15.103:0/2584718925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c81000b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009880 tx=0x7f02bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 -- 172.21.15.103:0/2584718925 shutdown_connections 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 --2- 172.21.15.103:0/2584718925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c81000b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 --2- 172.21.15.103:0/2584718925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02c80fea30 0x7f02c80fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 -- 172.21.15.103:0/2584718925 >> 172.21.15.103:0/2584718925 conn(0x7f02c80fa1c0 msgr2=0x7f02c80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 -- 172.21.15.103:0/2584718925 shutdown_connections 2024-09-17T01:14:27.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.097+0000 7f02cd082640 1 -- 172.21.15.103:0/2584718925 wait complete. 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.098+0000 7f02cd082640 1 Processor -- start 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.098+0000 7f02cd082640 1 -- start start 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02cd082640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02c80fea30 0x7f02c8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02cd082640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02cd082640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c819a930 con 0x7f02c80ffc30 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02cd082640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c819aa70 con 0x7f02c80fea30 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57890/0 (socket says 172.21.15.103:57890) 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 -- 172.21.15.103:0/2556191714 learned_addr learned my addr 172.21.15.103:0/2556191714 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c6d9d640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02c80fea30 0x7f02c8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 -- 172.21.15.103:0/2556191714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02c80fea30 msgr2=0x7f02c8068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02c80fea30 0x7f02c8068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 -- 172.21.15.103:0/2556191714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc009560 con 0x7f02c80ffc30 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.099+0000 7f02c659c640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c819a360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0054f0 tx=0x7f02bc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.100+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02bc004aa0 con 0x7f02c80ffc30 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.100+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02bc004c00 con 0x7f02c80ffc30 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.100+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c819acc0 con 0x7f02c80ffc30 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.100+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02bc003ac0 con 0x7f02c80ffc30 2024-09-17T01:14:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.100+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c819b230 con 0x7f02c80ffc30 2024-09-17T01:14:27.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.101+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c8107640 con 0x7f02c80ffc30 2024-09-17T01:14:27.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.101+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f02bc003d30 con 0x7f02c80ffc30 2024-09-17T01:14:27.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.102+0000 7f02affff640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f02b006e5f0 0x7f02b0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.102+0000 7f02c6d9d640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f02b006e5f0 0x7f02b0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.102+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f02bc0af910 con 0x7f02c80ffc30 2024-09-17T01:14:27.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.103+0000 7f02c6d9d640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f02b006e5f0 0x7f02b0070ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f02b8005fd0 tx=0x7f02b800b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:27.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.106+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f02bc078a10 con 0x7f02c80ffc30 2024-09-17T01:14:27.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:26 smithi143 ceph-mon[80685]: pgmap v202: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-17T01:14:27.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:26 smithi143 ceph-mon[80685]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:14:27.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:26 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:14:27.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:26 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] up:active 2024-09-17T01:14:27.159 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:26 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi143.uraktq=up:active} 2 up:standby 2024-09-17T01:14:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.334+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02c819b3c0 con 0x7f02c80ffc30 2024-09-17T01:14:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.334+0000 7f02affff640 1 -- 172.21.15.103:0/2556191714 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1759 (secure 0 0 0) 0x7f02bc07c0d0 con 0x7f02c80ffc30 2024-09-17T01:14:27.332 INFO:teuthology.orchestra.run.smithi103.stdout:e30 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-17T01:14:25:901793+0000 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 30 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:14:25.901790+0000 2024-09-17T01:14:27.333 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 93 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:14:27.334 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=24287} 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 24287 members: 24287 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{0:24287} state up:active seq 151 join_fscid=1 addr [v2:172.21.15.143:6826/2518601459,v1:172.21.15.143:6827/2518601459] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:27.335 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:14:27.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:27.336 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:14:27.336 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:14:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 30 2024-09-17T01:14:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f02b006e5f0 msgr2=0x7f02b0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f02b006e5f0 0x7f02b0070ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f02b8005fd0 tx=0x7f02b800b390 comp rx=0 tx=0).stop 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 msgr2=0x7f02c819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c819a360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0054f0 tx=0x7f02bc005520 comp rx=0 tx=0).stop 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 shutdown_connections 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f02b006e5f0 0x7f02b0070ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c80ffc30 0x7f02c819a360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 --2- 172.21.15.103:0/2556191714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02c80fea30 0x7f02c8068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 >> 172.21.15.103:0/2556191714 conn(0x7f02c80fa1c0 msgr2=0x7f02c8102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 shutdown_connections 2024-09-17T01:14:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.337+0000 7f02cd082640 1 -- 172.21.15.103:0/2556191714 wait complete. 2024-09-17T01:14:27.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/1244009511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40ffc80 msgr2=0x7fe0e4100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/1244009511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40ffc80 0x7fe0e4100100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009880 tx=0x7fe0d402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/1244009511 shutdown_connections 2024-09-17T01:14:27.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/1244009511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40ffc80 0x7fe0e4100100 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/1244009511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0e40fea80 0x7fe0e40fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/1244009511 >> 172.21.15.103:0/1244009511 conn(0x7fe0e40fa230 msgr2=0x7fe0e40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/1244009511 shutdown_connections 2024-09-17T01:14:27.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.420+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/1244009511 wait complete. 2024-09-17T01:14:27.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e8fd6640 1 Processor -- start 2024-09-17T01:14:27.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e8fd6640 1 -- start start 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e8fd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 0x7fe0e4102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e8fd6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0e40ffc80 0x7fe0e4101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e8fd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41015a0 con 0x7fe0e40fea80 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e8fd6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4101710 con 0x7fe0e40ffc80 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 0x7fe0e4102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 0x7fe0e4102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57918/0 (socket says 172.21.15.103:57918) 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e259c640 1 -- 172.21.15.103:0/3424837255 learned_addr learned my addr 172.21.15.103:0/3424837255 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.421+0000 7fe0e1d9b640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0e40ffc80 0x7fe0e4101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0e259c640 1 -- 172.21.15.103:0/3424837255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0e40ffc80 msgr2=0x7fe0e4101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0e259c640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0e40ffc80 0x7fe0e4101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0e259c640 1 -- 172.21.15.103:0/3424837255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4009560 con 0x7fe0e40fea80 2024-09-17T01:14:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0e259c640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 0x7fe0e4102a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00d8d0 tx=0x7fe0cc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:27.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0cc00bea0 con 0x7fe0e40fea80 2024-09-17T01:14:27.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e41019f0 con 0x7fe0e40fea80 2024-09-17T01:14:27.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0cc009c00 con 0x7fe0e40fea80 2024-09-17T01:14:27.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0cc00f790 con 0x7fe0e40fea80 2024-09-17T01:14:27.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.422+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e419d650 con 0x7fe0e40fea80 2024-09-17T01:14:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.423+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e4107fd0 con 0x7fe0e40fea80 2024-09-17T01:14:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.423+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe0cc00fa50 con 0x7fe0e40fea80 2024-09-17T01:14:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.424+0000 7fe0db7fe640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0d006e5f0 0x7fe0d0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.424+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fe0cc08e890 con 0x7fe0e40fea80 2024-09-17T01:14:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.424+0000 7fe0e1d9b640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0d006e5f0 0x7fe0d0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.424+0000 7fe0e1d9b640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0d006e5f0 0x7fe0d0070ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d40314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.428+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe0cc057860 con 0x7fe0e40fea80 2024-09-17T01:14:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.608+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e4068be0 con 0x7fe0d006e5f0 2024-09-17T01:14:27.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.610+0000 7fe0db7fe640 1 -- 172.21.15.103:0/3424837255 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe0e4068be0 con 0x7fe0d006e5f0 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "osd", 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "14/23 daemons upgraded", 2024-09-17T01:14:27.608 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:14:27.609 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:14:27.609 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0d006e5f0 msgr2=0x7fe0d0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0d006e5f0 0x7fe0d0070ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d40314e0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 msgr2=0x7fe0e4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 0x7fe0e4102a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00d8d0 tx=0x7fe0cc00dd90 comp rx=0 tx=0).stop 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 shutdown_connections 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe0d006e5f0 0x7fe0d0070ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0e40ffc80 0x7fe0e4101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 --2- 172.21.15.103:0/3424837255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e40fea80 0x7fe0e4102a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 >> 172.21.15.103:0/3424837255 conn(0x7fe0e40fa230 msgr2=0x7fe0e40684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 shutdown_connections 2024-09-17T01:14:27.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.612+0000 7fe0e8fd6640 1 -- 172.21.15.103:0/3424837255 wait complete. 2024-09-17T01:14:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 -- 172.21.15.103:0/3140408264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101280 msgr2=0x7feee4101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 --2- 172.21.15.103:0/3140408264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101280 0x7feee4101680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feed4009880 tx=0x7feed402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 -- 172.21.15.103:0/3140408264 shutdown_connections 2024-09-17T01:14:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 --2- 172.21.15.103:0/3140408264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feee40ff7c0 0x7feee40ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 --2- 172.21.15.103:0/3140408264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101280 0x7feee4101680 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 -- 172.21.15.103:0/3140408264 >> 172.21.15.103:0/3140408264 conn(0x7feee40fb330 msgr2=0x7feee40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 -- 172.21.15.103:0/3140408264 shutdown_connections 2024-09-17T01:14:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 -- 172.21.15.103:0/3140408264 wait complete. 2024-09-17T01:14:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 Processor -- start 2024-09-17T01:14:27.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.693+0000 7feeea711640 1 -- start start 2024-09-17T01:14:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feeea711640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 0x7feee4195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feeea711640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feee4101280 0x7feee4195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feeea711640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4196220 con 0x7feee40ff7c0 2024-09-17T01:14:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feeea711640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4196390 con 0x7feee4101280 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 0x7feee4195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 0x7feee4195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57934/0 (socket says 172.21.15.103:57934) 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 -- 172.21.15.103:0/3067155406 learned_addr learned my addr 172.21.15.103:0/3067155406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 -- 172.21.15.103:0/3067155406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feee4101280 msgr2=0x7feee4195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feee4101280 0x7feee4195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 -- 172.21.15.103:0/3067155406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4009560 con 0x7feee40ff7c0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee3fff640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 0x7feee4195710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feed40054f0 tx=0x7feed4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed4004aa0 con 0x7feee40ff7c0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feed4004c00 con 0x7feee40ff7c0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed4003ac0 con 0x7feee40ff7c0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.694+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee419add0 con 0x7feee40ff7c0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.695+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee419b340 con 0x7feee40ff7c0 2024-09-17T01:14:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.696+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40ffc40 con 0x7feee40ff7c0 2024-09-17T01:14:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.696+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7feed4003d30 con 0x7feee40ff7c0 2024-09-17T01:14:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.697+0000 7feee17fa640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7feed006e5f0 0x7feed0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.697+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6789+0+0 (secure 0 0 0) 0x7feed40af990 con 0x7feee40ff7c0 2024-09-17T01:14:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.697+0000 7feee37fe640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7feed006e5f0 0x7feed0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.697+0000 7feee37fe640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7feed006e5f0 0x7feed0070ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feecc005fd0 tx=0x7feecc005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:27.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.701+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feed40789e0 con 0x7feee40ff7c0 2024-09-17T01:14:27.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.934+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feee418f830 con 0x7feee40ff7c0 2024-09-17T01:14:27.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.935+0000 7feee17fa640 1 -- 172.21.15.103:0/3067155406 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7feed407c0a0 con 0x7feee40ff7c0 2024-09-17T01:14:27.933 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:14:27.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7feed006e5f0 msgr2=0x7feed0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7feed006e5f0 0x7feed0070ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feecc005fd0 tx=0x7feecc005850 comp rx=0 tx=0).stop 2024-09-17T01:14:27.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 msgr2=0x7feee4195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:27.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 0x7feee4195710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feed40054f0 tx=0x7feed4005520 comp rx=0 tx=0).stop 2024-09-17T01:14:27.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 shutdown_connections 2024-09-17T01:14:27.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7feed006e5f0 0x7feed0070ab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feee4101280 0x7feee4195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 --2- 172.21.15.103:0/3067155406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40ff7c0 0x7feee4195710 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:27.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 >> 172.21.15.103:0/3067155406 conn(0x7feee40fb330 msgr2=0x7feee4104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:27.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 shutdown_connections 2024-09-17T01:14:27.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:27.937+0000 7feeea711640 1 -- 172.21.15.103:0/3067155406 wait complete. 2024-09-17T01:14:28.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:27 smithi143 ceph-mon[80685]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:28.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:27 smithi143 ceph-mon[80685]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:28.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:27 smithi143 ceph-mon[80685]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:28.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:27 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2778811069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:28.171 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:27 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2556191714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:14:28.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:27 smithi103 ceph-mon[92733]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:28.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:27 smithi103 ceph-mon[92733]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:28.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:27 smithi103 ceph-mon[92733]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:28.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:27 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2778811069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:28.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:27 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2556191714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:14:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:28 smithi103 ceph-mon[92733]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:28 smithi103 ceph-mon[92733]: pgmap v203: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-17T01:14:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:28 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6824/1792149992,v1:172.21.15.143:6825/1792149992] up:boot 2024-09-17T01:14:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:28 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi143.uraktq=up:active} 3 up:standby 2024-09-17T01:14:29.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:14:29.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:28 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3067155406' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:14:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:28 smithi143 ceph-mon[80685]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:28 smithi143 ceph-mon[80685]: pgmap v203: 65 pgs: 65 active+clean; 204 MiB data, 897 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-17T01:14:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:28 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6824/1792149992,v1:172.21.15.143:6825/1792149992] up:boot 2024-09-17T01:14:29.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:28 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi143.uraktq=up:active} 3 up:standby 2024-09-17T01:14:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:14:29.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:28 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3067155406' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:14:30.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:30.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:30.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:30.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:30.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:30.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:31.319 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:31 smithi143 ceph-mon[80685]: pgmap v204: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-17T01:14:31.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:31 smithi103 ceph-mon[92733]: pgmap v204: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-17T01:14:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:32 smithi103 ceph-mon[92733]: pgmap v205: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-17T01:14:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:32.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:33.107 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:33.107 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:33.107 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:32 smithi143 ceph-mon[80685]: pgmap v205: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-17T01:14:33.108 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:33.108 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:34.117 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:34.117 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:34.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:35.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:34 smithi103 ceph-mon[92733]: pgmap v206: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-17T01:14:35.193 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:34 smithi143 ceph-mon[80685]: pgmap v206: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-17T01:14:36.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi143.uraktq"]}]: dispatch 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: Upgrade: It appears safe to stop mds.cephfs.smithi143.uraktq 2024-09-17T01:14:36.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:36 smithi143 ceph-mon[80685]: pgmap v207: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:14:36.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:36.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:36.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:36.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:36.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:36.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:36.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.928 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:36.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi143.uraktq"]}]: dispatch 2024-09-17T01:14:36.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: Upgrade: It appears safe to stop mds.cephfs.smithi143.uraktq 2024-09-17T01:14:36.929 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:36 smithi103 ceph-mon[92733]: pgmap v207: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:14:38.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:38 smithi103 ceph-mon[92733]: Upgrade: Updating mds.cephfs.smithi143.uraktq 2024-09-17T01:14:38.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:38.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:14:38.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:38 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:38.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:38 smithi103 ceph-mon[92733]: Deploying daemon mds.cephfs.smithi143.uraktq on smithi143 2024-09-17T01:14:38.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:38 smithi103 ceph-mon[92733]: pgmap v208: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:14:38.470 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:38 smithi143 ceph-mon[80685]: Upgrade: Updating mds.cephfs.smithi143.uraktq 2024-09-17T01:14:38.470 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:38.470 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi143.uraktq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:14:38.470 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:38 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:38.470 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:38 smithi143 ceph-mon[80685]: Deploying daemon mds.cephfs.smithi143.uraktq on smithi143 2024-09-17T01:14:38.470 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:38 smithi143 ceph-mon[80685]: pgmap v208: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[92729]: 2024-09-17T01:14:39.010+0000 7faaa80fe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: osdmap e94: 6 total, 6 up, 6 in 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: Standby daemon mds.cephfs.smithi103.gmmiqj assigned to filesystem cephfs as rank 0 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:14:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:39 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi103.gmmiqj=up:replay} 2 up:standby 2024-09-17T01:14:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:14:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:14:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: osdmap e94: 6 total, 6 up, 6 in 2024-09-17T01:14:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: Standby daemon mds.cephfs.smithi103.gmmiqj assigned to filesystem cephfs as rank 0 2024-09-17T01:14:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:14:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:14:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:39 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi103.gmmiqj=up:replay} 2 up:standby 2024-09-17T01:14:40.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:40 smithi103 ceph-mon[92733]: pgmap v210: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:40.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:40 smithi143 ceph-mon[80685]: pgmap v210: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:14:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:42 smithi143 ceph-mon[80685]: pgmap v211: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-17T01:14:43.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:42 smithi103 ceph-mon[92733]: pgmap v211: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-17T01:14:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:44 smithi143 ceph-mon[80685]: pgmap v212: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-17T01:14:45.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:44 smithi103 ceph-mon[92733]: pgmap v212: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-17T01:14:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:46 smithi143 ceph-mon[80685]: pgmap v213: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-17T01:14:47.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:46 smithi103 ceph-mon[92733]: pgmap v213: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-17T01:14:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: reconnect by client.14520 192.168.0.1:0/2898688174 after 0.000999982 2024-09-17T01:14:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: reconnect by client.24309 192.168.0.1:0/2120554610 after 0.000999982 2024-09-17T01:14:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:reconnect 2024-09-17T01:14:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi103.gmmiqj=up:reconnect} 2 up:standby 2024-09-17T01:14:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: reconnect by client.14520 192.168.0.1:0/2898688174 after 0.000999982 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: reconnect by client.24309 192.168.0.1:0/2120554610 after 0.000999982 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:reconnect 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi103.gmmiqj=up:reconnect} 2 up:standby 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:48.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:48 smithi143 ceph-mon[80685]: pgmap v214: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-17T01:14:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:48 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:rejoin 2024-09-17T01:14:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:48 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.143:6826/2562780354,v1:172.21.15.143:6827/2562780354] up:boot 2024-09-17T01:14:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:48 smithi143 ceph-mon[80685]: fsmap cephfs:1/1 {0=cephfs.smithi103.gmmiqj=up:rejoin} 3 up:standby 2024-09-17T01:14:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:14:49.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:48 smithi143 ceph-mon[80685]: daemon mds.cephfs.smithi103.gmmiqj is now active in filesystem cephfs as rank 0 2024-09-17T01:14:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:48 smithi103 ceph-mon[92733]: pgmap v214: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-17T01:14:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:48 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:rejoin 2024-09-17T01:14:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:48 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.143:6826/2562780354,v1:172.21.15.143:6827/2562780354] up:boot 2024-09-17T01:14:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:48 smithi103 ceph-mon[92733]: fsmap cephfs:1/1 {0=cephfs.smithi103.gmmiqj=up:rejoin} 3 up:standby 2024-09-17T01:14:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:14:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:48 smithi103 ceph-mon[92733]: daemon mds.cephfs.smithi103.gmmiqj is now active in filesystem cephfs as rank 0 2024-09-17T01:14:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:49 smithi143 ceph-mon[80685]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:14:50.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:49 smithi143 ceph-mon[80685]: Cluster is now healthy 2024-09-17T01:14:50.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:49 smithi143 ceph-mon[80685]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:active 2024-09-17T01:14:50.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:49 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 3 up:standby 2024-09-17T01:14:50.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:49 smithi103 ceph-mon[92733]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:14:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:49 smithi103 ceph-mon[92733]: Cluster is now healthy 2024-09-17T01:14:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:49 smithi103 ceph-mon[92733]: mds.? [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] up:active 2024-09-17T01:14:50.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:49 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 3 up:standby 2024-09-17T01:14:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:50 smithi143 ceph-mon[80685]: pgmap v215: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 94 B/s wr, 5 op/s 2024-09-17T01:14:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:51.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:51.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:50 smithi103 ceph-mon[92733]: pgmap v215: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 94 B/s wr, 5 op/s 2024-09-17T01:14:51.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:51.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:52 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:52.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:52 smithi143 ceph-mon[80685]: pgmap v216: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-17T01:14:52.580 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:52.580 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:52 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:52.580 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:52 smithi103 ceph-mon[92733]: pgmap v216: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: pgmap v217: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:55.260 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.gmmiqj"}]': finished 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.rnhmlw"}]': finished 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.uraktq"}]': finished 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:14:55.261 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.zkrwqj"}]': finished 2024-09-17T01:14:55.262 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:54 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: pgmap v217: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.gmmiqj"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.gmmiqj"}]': finished 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.rnhmlw"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.rnhmlw"}]': finished 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.uraktq"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.uraktq"}]': finished 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.zkrwqj"}]: dispatch 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi143.zkrwqj"}]': finished 2024-09-17T01:14:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:54 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all mds 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all rgw 2024-09-17T01:14:56.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:56.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:56.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:14:56.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:56.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:56 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:56.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all mds 2024-09-17T01:14:56.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T01:14:56.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T01:14:56.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: fsmap cephfs:1 {0=cephfs.smithi103.gmmiqj=up:active} 1 up:standby-replay 2 up:standby 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all rgw 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:56.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:56 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:57.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:57 smithi103 ceph-mon[92733]: pgmap v218: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-17T01:14:57.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:57.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:14:57.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:57 smithi143 ceph-mon[80685]: pgmap v218: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-17T01:14:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:14:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi103", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:14:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.022+0000 7fe4213a0640 1 -- 172.21.15.103:0/1103418396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c102f50 msgr2=0x7fe41c105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.022+0000 7fe4213a0640 1 --2- 172.21.15.103:0/1103418396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c102f50 0x7fe41c105340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe404009880 tx=0x7fe40402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.022+0000 7fe4213a0640 1 -- 172.21.15.103:0/1103418396 shutdown_connections 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.022+0000 7fe4213a0640 1 --2- 172.21.15.103:0/1103418396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c102f50 0x7fe41c105340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.022+0000 7fe4213a0640 1 --2- 172.21.15.103:0/1103418396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c100620 0x7fe41c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.022+0000 7fe4213a0640 1 -- 172.21.15.103:0/1103418396 >> 172.21.15.103:0/1103418396 conn(0x7fe41c0fa1c0 msgr2=0x7fe41c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 -- 172.21.15.103:0/1103418396 shutdown_connections 2024-09-17T01:14:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 -- 172.21.15.103:0/1103418396 wait complete. 2024-09-17T01:14:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 Processor -- start 2024-09-17T01:14:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 -- start start 2024-09-17T01:14:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 0x7fe41c1955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c102f50 0x7fe41c195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1960b0 con 0x7fe41c100620 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe4213a0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c196220 con 0x7fe41c102f50 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.023+0000 7fe41affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 0x7fe41c1955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe41affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 0x7fe41c1955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44288/0 (socket says 172.21.15.103:44288) 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe41affd640 1 -- 172.21.15.103:0/4015582780 learned_addr learned my addr 172.21.15.103:0/4015582780 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe413fff640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c102f50 0x7fe41c195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe41affd640 1 -- 172.21.15.103:0/4015582780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c102f50 msgr2=0x7fe41c195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe41affd640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c102f50 0x7fe41c195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe41affd640 1 -- 172.21.15.103:0/4015582780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe404009560 con 0x7fe41c100620 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe413fff640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c102f50 0x7fe41c195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe41affd640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 0x7fe41c1955a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00c840 tx=0x7fe40c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe40c0041f0 con 0x7fe41c100620 2024-09-17T01:14:58.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe40c007e70 con 0x7fe41c100620 2024-09-17T01:14:58.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe40c0049d0 con 0x7fe41c100620 2024-09-17T01:14:58.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c19acc0 con 0x7fe41c100620 2024-09-17T01:14:58.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.024+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c19b210 con 0x7fe41c100620 2024-09-17T01:14:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.026+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c100a00 con 0x7fe41c100620 2024-09-17T01:14:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.026+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe40c0079b0 con 0x7fe41c100620 2024-09-17T01:14:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.027+0000 7fe418ff9640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe40806e5f0 0x7fe408070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.027+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fe40c08e610 con 0x7fe41c100620 2024-09-17T01:14:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.027+0000 7fe413fff640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe40806e5f0 0x7fe408070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.027+0000 7fe413fff640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe40806e5f0 0x7fe408070ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe404009230 tx=0x7fe4040314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:58.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.031+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe40c057610 con 0x7fe41c100620 2024-09-17T01:14:58.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.270+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe41c103990 con 0x7fe40806e5f0 2024-09-17T01:14:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.271+0000 7fe418ff9640 1 -- 172.21.15.103:0/4015582780 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fe41c103990 con 0x7fe40806e5f0 2024-09-17T01:14:58.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe40806e5f0 msgr2=0x7fe408070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe40806e5f0 0x7fe408070ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe404009230 tx=0x7fe4040314e0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 msgr2=0x7fe41c1955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 0x7fe41c1955a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00c840 tx=0x7fe40c00cd00 comp rx=0 tx=0).stop 2024-09-17T01:14:58.274 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:58 smithi103 ceph-mon[92733]: Upgrade: Updating ceph-exporter.smithi103 (1/2) 2024-09-17T01:14:58.274 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:58 smithi103 ceph-mon[92733]: Deploying daemon ceph-exporter.smithi103 on smithi103 2024-09-17T01:14:58.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 shutdown_connections 2024-09-17T01:14:58.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fe40806e5f0 0x7fe408070ab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe41c102f50 0x7fe41c195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 --2- 172.21.15.103:0/4015582780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe41c100620 0x7fe41c1955a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.274+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 >> 172.21.15.103:0/4015582780 conn(0x7fe41c0fa1c0 msgr2=0x7fe41c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.275+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 shutdown_connections 2024-09-17T01:14:58.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.275+0000 7fe4213a0640 1 -- 172.21.15.103:0/4015582780 wait complete. 2024-09-17T01:14:58.289 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:14:58.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 -- 172.21.15.103:0/2804046860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 msgr2=0x7f87601000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 --2- 172.21.15.103:0/2804046860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f87601000b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f874c009880 tx=0x7f874c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 -- 172.21.15.103:0/2804046860 shutdown_connections 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 --2- 172.21.15.103:0/2804046860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f87601000b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 --2- 172.21.15.103:0/2804046860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87600fea30 0x7f87600fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 -- 172.21.15.103:0/2804046860 >> 172.21.15.103:0/2804046860 conn(0x7f87600fa1c0 msgr2=0x7f87600fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 -- 172.21.15.103:0/2804046860 shutdown_connections 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.390+0000 7f8766b65640 1 -- 172.21.15.103:0/2804046860 wait complete. 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8766b65640 1 Processor -- start 2024-09-17T01:14:58.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8766b65640 1 -- start start 2024-09-17T01:14:58.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8766b65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87600fea30 0x7f8760195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8766b65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f8760195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8766b65640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760196160 con 0x7f87600ffc30 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8766b65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87601962d0 con 0x7f87600fea30 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f875ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f8760195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f875ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f8760195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44292/0 (socket says 172.21.15.103:44292) 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f875ffff640 1 -- 172.21.15.103:0/3937315196 learned_addr learned my addr 172.21.15.103:0/3937315196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.391+0000 7f8764901640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87600fea30 0x7f8760195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875ffff640 1 -- 172.21.15.103:0/3937315196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87600fea30 msgr2=0x7f8760195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875ffff640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87600fea30 0x7f8760195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875ffff640 1 -- 172.21.15.103:0/3937315196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c009560 con 0x7f87600ffc30 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875ffff640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f8760195b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f874c0055a0 tx=0x7f874c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:58.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874c004b20 con 0x7f87600ffc30 2024-09-17T01:14:58.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876019aca0 con 0x7f87600ffc30 2024-09-17T01:14:58.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f874c004c80 con 0x7f87600ffc30 2024-09-17T01:14:58.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874c003bc0 con 0x7f87600ffc30 2024-09-17T01:14:58.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.392+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8760100e50 con 0x7f87600ffc30 2024-09-17T01:14:58.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.394+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8760107620 con 0x7f87600ffc30 2024-09-17T01:14:58.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.395+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f874c003d20 con 0x7f87600ffc30 2024-09-17T01:14:58.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.395+0000 7f875dffb640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8750072a00 0x7f8750074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.395+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f874c0af9b0 con 0x7f87600ffc30 2024-09-17T01:14:58.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.396+0000 7f8764901640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8750072a00 0x7f8750074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.396+0000 7f8764901640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8750072a00 0x7f8750074ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8754005fd0 tx=0x7f875400b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:58.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.404+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f874c078a60 con 0x7f87600ffc30 2024-09-17T01:14:58.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:58 smithi143 ceph-mon[80685]: Upgrade: Updating ceph-exporter.smithi103 (1/2) 2024-09-17T01:14:58.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:58 smithi143 ceph-mon[80685]: Deploying daemon ceph-exporter.smithi103 on smithi103 2024-09-17T01:14:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.602+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87600fc3e0 con 0x7f8750072a00 2024-09-17T01:14:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.604+0000 7f875dffb640 1 -- 172.21.15.103:0/3937315196 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f87600fc3e0 con 0x7f8750072a00 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8750072a00 msgr2=0x7f8750074ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8750072a00 0x7f8750074ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8754005fd0 tx=0x7f875400b410 comp rx=0 tx=0).stop 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 msgr2=0x7f8760195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f8760195b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f874c0055a0 tx=0x7f874c0055d0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 shutdown_connections 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8750072a00 0x7f8750074ec0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87600ffc30 0x7f8760195b90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 --2- 172.21.15.103:0/3937315196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87600fea30 0x7f8760195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 >> 172.21.15.103:0/3937315196 conn(0x7f87600fa1c0 msgr2=0x7f87600fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 shutdown_connections 2024-09-17T01:14:58.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.606+0000 7f8766b65640 1 -- 172.21.15.103:0/3937315196 wait complete. 2024-09-17T01:14:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 -- 172.21.15.103:0/4083300237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 msgr2=0x7f3100102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 --2- 172.21.15.103:0/4083300237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f3100102a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30f000dcc0 tx=0x7f30f002e4d0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 -- 172.21.15.103:0/4083300237 shutdown_connections 2024-09-17T01:14:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 --2- 172.21.15.103:0/4083300237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3100102f40 0x7f3100105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 --2- 172.21.15.103:0/4083300237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f3100102a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 -- 172.21.15.103:0/4083300237 >> 172.21.15.103:0/4083300237 conn(0x7f31000fa210 msgr2=0x7f31000fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 -- 172.21.15.103:0/4083300237 shutdown_connections 2024-09-17T01:14:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.699+0000 7f31061e6640 1 -- 172.21.15.103:0/4083300237 wait complete. 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.700+0000 7f31061e6640 1 Processor -- start 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.700+0000 7f31061e6640 1 -- start start 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f31061e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f310019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f31061e6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3100102f40 0x7f310019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f31061e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310019c760 con 0x7f3100100610 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f31061e6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310019c8d0 con 0x7f3100102f40 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f310019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f310019bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44314/0 (socket says 172.21.15.103:44314) 2024-09-17T01:14:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30ff7fe640 1 -- 172.21.15.103:0/4049686006 learned_addr learned my addr 172.21.15.103:0/4049686006 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30feffd640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3100102f40 0x7f310019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30ff7fe640 1 -- 172.21.15.103:0/4049686006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3100102f40 msgr2=0x7f310019c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30ff7fe640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3100102f40 0x7f310019c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.701+0000 7f30ff7fe640 1 -- 172.21.15.103:0/4049686006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f000d970 con 0x7f3100100610 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.702+0000 7f30ff7fe640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f310019bc50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.702+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f0004250 con 0x7f3100100610 2024-09-17T01:14:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.702+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30f00043b0 con 0x7f3100100610 2024-09-17T01:14:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.702+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f00035f0 con 0x7f3100100610 2024-09-17T01:14:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.702+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31001a1300 con 0x7f3100100610 2024-09-17T01:14:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.702+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31001a1820 con 0x7f3100100610 2024-09-17T01:14:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.703+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310010ed50 con 0x7f3100100610 2024-09-17T01:14:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.704+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f30f0004f60 con 0x7f3100100610 2024-09-17T01:14:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.705+0000 7f30fcff9640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f30e806e5f0 0x7f30e8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.705+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f30f00af9e0 con 0x7f3100100610 2024-09-17T01:14:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.705+0000 7f30feffd640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f30e806e5f0 0x7f30e8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.705+0000 7f30feffd640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f30e806e5f0 0x7f30e8070ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30f4005fd0 tx=0x7f30f4005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.709+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f30f00788c0 con 0x7f3100100610 2024-09-17T01:14:58.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.898+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f31001a1a90 con 0x7f30e806e5f0 2024-09-17T01:14:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.908+0000 7f30fcff9640 1 -- 172.21.15.103:0/4049686006 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f31001a1a90 con 0x7f30e806e5f0 2024-09-17T01:14:58.907 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (14m) 50s ago 15m 24.9M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (16m) 50s ago 16m 9281k - 18.2.4-855-g19e2a2be 980a0bfcd684 5c515b990a93 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (15m) 8s ago 15m 9143k - 18.2.4-855-g19e2a2be 980a0bfcd684 c187e320e1ff 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (4m) 50s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (4m) 8s ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (14m) 50s ago 15m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (73s) 50s ago 10m 13.9M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (55s) 50s ago 10m 14.0M - 19.1.1-330-gc2ddf972 ebb0615149de b2b1fe41a30f 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (11s) 8s ago 10m 14.4M - 19.1.1-330-gc2ddf972 ebb0615149de 22146925e364 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (34s) 8s ago 10m 13.9M - 19.1.1-330-gc2ddf972 ebb0615149de 031fc3939184 2024-09-17T01:14:58.908 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (7m) 50s ago 17m 505M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (6m) 8s ago 14m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (5m) 50s ago 17m 51.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (5m) 8s ago 14m 38.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (15m) 50s ago 15m 16.8M - 1.5.0 0da6a335fe13 afa46c05740b 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (15m) 8s ago 15m 16.6M - 1.5.0 0da6a335fe13 8fd5e0dd6e43 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (4m) 50s ago 14m 108M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (3m) 50s ago 13m 149M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (3m) 50s ago 13m 174M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (2m) 8s ago 12m 144M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (2m) 8s ago 12m 101M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (94s) 8s ago 12m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:14:58.909 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (6m) 50s ago 15m 69.3M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:14:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f30e806e5f0 msgr2=0x7f30e8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f30e806e5f0 0x7f30e8070ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30f4005fd0 tx=0x7f30f4005850 comp rx=0 tx=0).stop 2024-09-17T01:14:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 msgr2=0x7f310019bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f310019bc50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0004c60 comp rx=0 tx=0).stop 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 shutdown_connections 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f30e806e5f0 0x7f30e8070ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3100102f40 0x7f310019c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 --2- 172.21.15.103:0/4049686006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3100100610 0x7f310019bc50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.910+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 >> 172.21.15.103:0/4049686006 conn(0x7f31000fa210 msgr2=0x7f31000fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.911+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 shutdown_connections 2024-09-17T01:14:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.911+0000 7f31061e6640 1 -- 172.21.15.103:0/4049686006 wait complete. 2024-09-17T01:14:58.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 -- 172.21.15.103:0/1107064666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d900ffb70 msgr2=0x7f7d900fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 --2- 172.21.15.103:0/1107064666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d900ffb70 0x7f7d900fff70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009880 tx=0x7f7d8c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 -- 172.21.15.103:0/1107064666 shutdown_connections 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 --2- 172.21.15.103:0/1107064666 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d90100d70 0x7f7d901011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 --2- 172.21.15.103:0/1107064666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d900ffb70 0x7f7d900fff70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 -- 172.21.15.103:0/1107064666 >> 172.21.15.103:0/1107064666 conn(0x7f7d900fb2e0 msgr2=0x7f7d900fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 -- 172.21.15.103:0/1107064666 shutdown_connections 2024-09-17T01:14:58.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.997+0000 7f7d97b16640 1 -- 172.21.15.103:0/1107064666 wait complete. 2024-09-17T01:14:58.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d97b16640 1 Processor -- start 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d97b16640 1 -- start start 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d97b16640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d900ffb70 0x7f7d90195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d97b16640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 0x7f7d90195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d97b16640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d90196130 con 0x7f7d90100d70 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d97b16640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d901962a0 con 0x7f7d900ffb70 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d950b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 0x7f7d90195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d950b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 0x7f7d90195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44320/0 (socket says 172.21.15.103:44320) 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.998+0000 7f7d950b1640 1 -- 172.21.15.103:0/2383781838 learned_addr learned my addr 172.21.15.103:0/2383781838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d958b2640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d900ffb70 0x7f7d90195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d950b1640 1 -- 172.21.15.103:0/2383781838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d900ffb70 msgr2=0x7f7d90195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d950b1640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d900ffb70 0x7f7d90195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d950b1640 1 -- 172.21.15.103:0/2383781838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c009560 con 0x7f7d90100d70 2024-09-17T01:14:58.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d950b1640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 0x7f7d90195b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000d900 tx=0x7f7d8000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d80009c00 con 0x7f7d90100d70 2024-09-17T01:14:59.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d8000b660 con 0x7f7d90100d70 2024-09-17T01:14:59.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9019ad40 con 0x7f7d90100d70 2024-09-17T01:14:59.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d8000f680 con 0x7f7d90100d70 2024-09-17T01:14:59.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:58.999+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9019b310 con 0x7f7d90100d70 2024-09-17T01:14:59.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.000+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d90108760 con 0x7f7d90100d70 2024-09-17T01:14:59.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.001+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7d80010ab0 con 0x7f7d90100d70 2024-09-17T01:14:59.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.002+0000 7f7d86ffd640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7d7c06e5f0 0x7f7d7c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.002+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f7d8008e680 con 0x7f7d90100d70 2024-09-17T01:14:59.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.002+0000 7f7d958b2640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7d7c06e5f0 0x7f7d7c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.003+0000 7f7d958b2640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7d7c06e5f0 0x7f7d7c070ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009230 tx=0x7f7d8c005d50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.010+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7d80057600 con 0x7f7d90100d70 2024-09-17T01:14:59.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:14:59 smithi103 ceph-mon[92733]: pgmap v219: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-17T01:14:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.276+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d90108940 con 0x7f7d90100d70 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.276+0000 7f7d86ffd640 1 -- 172.21.15.103:0/2383781838 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f7d8005acc0 con 0x7f7d90100d70 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:14:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:14:59.277 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:14:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7d7c06e5f0 msgr2=0x7f7d7c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7d7c06e5f0 0x7f7d7c070ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009230 tx=0x7f7d8c005d50 comp rx=0 tx=0).stop 2024-09-17T01:14:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 msgr2=0x7f7d90195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 0x7f7d90195b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000d900 tx=0x7f7d8000ddc0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 shutdown_connections 2024-09-17T01:14:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7d7c06e5f0 0x7f7d7c070ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d90100d70 0x7f7d90195b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 --2- 172.21.15.103:0/2383781838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d900ffb70 0x7f7d90195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 >> 172.21.15.103:0/2383781838 conn(0x7f7d900fb2e0 msgr2=0x7f7d90103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 shutdown_connections 2024-09-17T01:14:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.279+0000 7f7d97b16640 1 -- 172.21.15.103:0/2383781838 wait complete. 2024-09-17T01:14:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 -- 172.21.15.103:0/1555878941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 msgr2=0x7f98ac102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 --2- 172.21.15.103:0/1555878941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac102a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f989c009880 tx=0x7f989c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 -- 172.21.15.103:0/1555878941 shutdown_connections 2024-09-17T01:14:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 --2- 172.21.15.103:0/1555878941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac102fb0 0x7f98ac1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 --2- 172.21.15.103:0/1555878941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac102a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 -- 172.21.15.103:0/1555878941 >> 172.21.15.103:0/1555878941 conn(0x7f98ac0fa1c0 msgr2=0x7f98ac0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 -- 172.21.15.103:0/1555878941 shutdown_connections 2024-09-17T01:14:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.362+0000 7f98b236c640 1 -- 172.21.15.103:0/1555878941 wait complete. 2024-09-17T01:14:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98b236c640 1 Processor -- start 2024-09-17T01:14:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98b236c640 1 -- start start 2024-09-17T01:14:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98b236c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98b236c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac102fb0 0x7f98ac195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98b236c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac196120 con 0x7f98ac100680 2024-09-17T01:14:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98b236c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac196290 con 0x7f98ac102fb0 2024-09-17T01:14:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98abfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98abfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44326/0 (socket says 172.21.15.103:44326) 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.363+0000 7f98abfff640 1 -- 172.21.15.103:0/379443744 learned_addr learned my addr 172.21.15.103:0/379443744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98ab7fe640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac102fb0 0x7f98ac195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98abfff640 1 -- 172.21.15.103:0/379443744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac102fb0 msgr2=0x7f98ac195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98abfff640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac102fb0 0x7f98ac195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98abfff640 1 -- 172.21.15.103:0/379443744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009560 con 0x7f98ac100680 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98abfff640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac195610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f989c031500 tx=0x7f989c032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989c0037c0 con 0x7f98ac100680 2024-09-17T01:14:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac19acd0 con 0x7f98ac100680 2024-09-17T01:14:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f989c003de0 con 0x7f98ac100680 2024-09-17T01:14:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989c03a3c0 con 0x7f98ac100680 2024-09-17T01:14:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.364+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac19b1c0 con 0x7f98ac100680 2024-09-17T01:14:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.365+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac108750 con 0x7f98ac100680 2024-09-17T01:14:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.366+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f989c03b7f0 con 0x7f98ac100680 2024-09-17T01:14:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.367+0000 7f98a97fa640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f989406e5f0 0x7f9894070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.367+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f989c0af730 con 0x7f98ac100680 2024-09-17T01:14:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.367+0000 7f98ab7fe640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f989406e5f0 0x7f9894070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.367+0000 7f98ab7fe640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f989406e5f0 0x7f9894070ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98a0005fd0 tx=0x7f98a0005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.375+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f989c078730 con 0x7f98ac100680 2024-09-17T01:14:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:14:59 smithi143 ceph-mon[80685]: pgmap v219: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-17T01:14:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.589+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98ac19b430 con 0x7f98ac100680 2024-09-17T01:14:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.589+0000 7f98a97fa640 1 -- 172.21.15.103:0/379443744 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+2009 (secure 0 0 0) 0x7f989c07bdf0 con 0x7f98ac100680 2024-09-17T01:14:59.588 INFO:teuthology.orchestra.run.smithi103.stdout:e37 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-17T01:14:55:014839+0000 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 37 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:14:55.014828+0000 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:14:59.589 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 94 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=34380} 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:14:59.590 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 34380 members: 34380 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:34380} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:34412} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:14:59.591 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6824/1792149992,v1:172.21.15.143:6825/1792149992] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:14:59.592 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2562780354,v1:172.21.15.143:6827/2562780354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:14:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 37 2024-09-17T01:14:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f989406e5f0 msgr2=0x7f9894070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f989406e5f0 0x7f9894070ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98a0005fd0 tx=0x7f98a0005850 comp rx=0 tx=0).stop 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 msgr2=0x7f98ac195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac195610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f989c031500 tx=0x7f989c032bb0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 shutdown_connections 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f989406e5f0 0x7f9894070ab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac102fb0 0x7f98ac195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 --2- 172.21.15.103:0/379443744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98ac100680 0x7f98ac195610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 >> 172.21.15.103:0/379443744 conn(0x7f98ac0fa1c0 msgr2=0x7f98ac0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 shutdown_connections 2024-09-17T01:14:59.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.592+0000 7f98b236c640 1 -- 172.21.15.103:0/379443744 wait complete. 2024-09-17T01:14:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 -- 172.21.15.103:0/64370206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c102ef0 msgr2=0x7f777c1052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 --2- 172.21.15.103:0/64370206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c102ef0 0x7f777c1052e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77700098b0 tx=0x7f777002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 -- 172.21.15.103:0/64370206 shutdown_connections 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 --2- 172.21.15.103:0/64370206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c102ef0 0x7f777c1052e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 --2- 172.21.15.103:0/64370206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c1005c0 0x7f777c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 -- 172.21.15.103:0/64370206 >> 172.21.15.103:0/64370206 conn(0x7f777c0fa1c0 msgr2=0x7f777c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 -- 172.21.15.103:0/64370206 shutdown_connections 2024-09-17T01:14:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.675+0000 7f7782308640 1 -- 172.21.15.103:0/64370206 wait complete. 2024-09-17T01:14:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.676+0000 7f7782308640 1 Processor -- start 2024-09-17T01:14:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.676+0000 7f7782308640 1 -- start start 2024-09-17T01:14:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f7782308640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 0x7f777c195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f7782308640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c102ef0 0x7f777c195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f7782308640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c1960c0 con 0x7f777c1005c0 2024-09-17T01:14:59.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f7782308640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c196230 con 0x7f777c102ef0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 0x7f777c195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 0x7f777c195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44350/0 (socket says 172.21.15.103:44350) 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 -- 172.21.15.103:0/3100843475 learned_addr learned my addr 172.21.15.103:0/3100843475 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777b7fe640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c102ef0 0x7f777c195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 -- 172.21.15.103:0/3100843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c102ef0 msgr2=0x7f777c195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c102ef0 0x7f777c195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 -- 172.21.15.103:0/3100843475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770009560 con 0x7f777c1005c0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777b7fe640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c102ef0 0x7f777c195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.677+0000 7f777bfff640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 0x7f777c195640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c8a0 tx=0x7f776c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.678+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776c007b80 con 0x7f777c1005c0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.678+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f776c007ce0 con 0x7f777c1005c0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.678+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c19ad10 con 0x7f777c1005c0 2024-09-17T01:14:59.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.678+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776c018810 con 0x7f777c1005c0 2024-09-17T01:14:59.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.678+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c19b210 con 0x7f777c1005c0 2024-09-17T01:14:59.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.679+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c1009a0 con 0x7f777c1005c0 2024-09-17T01:14:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.679+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f776c018970 con 0x7f777c1005c0 2024-09-17T01:14:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.680+0000 7f77797fa640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f776406e5f0 0x7f7764070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.680+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f776c08ea10 con 0x7f777c1005c0 2024-09-17T01:14:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.680+0000 7f777b7fe640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f776406e5f0 0x7f7764070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.681+0000 7f777b7fe640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f776406e5f0 0x7f7764070ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7770009880 tx=0x7f77700314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.688+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f776c057a10 con 0x7f777c1005c0 2024-09-17T01:14:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.891+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f777c103910 con 0x7f776406e5f0 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.892+0000 7f77797fa640 1 -- 172.21.15.103:0/3100843475 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f777c103910 con 0x7f776406e5f0 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:14:59.891 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "mds", 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "osd", 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "16/23 daemons upgraded", 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:14:59.892 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:14:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f776406e5f0 msgr2=0x7f7764070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f776406e5f0 0x7f7764070ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7770009880 tx=0x7f77700314e0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 msgr2=0x7f777c195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 0x7f777c195640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c8a0 tx=0x7f776c00cd60 comp rx=0 tx=0).stop 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 shutdown_connections 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f776406e5f0 0x7f7764070ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f777c102ef0 0x7f777c195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 --2- 172.21.15.103:0/3100843475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f777c1005c0 0x7f777c195640 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 >> 172.21.15.103:0/3100843475 conn(0x7f777c0fa1c0 msgr2=0x7f777c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 shutdown_connections 2024-09-17T01:14:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.894+0000 7f7782308640 1 -- 172.21.15.103:0/3100843475 wait complete. 2024-09-17T01:14:59.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 -- 172.21.15.103:0/3442152669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc102f60 msgr2=0x7f59bc105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3442152669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc102f60 0x7f59bc105350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f59b00098b0 tx=0x7f59b002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 -- 172.21.15.103:0/3442152669 shutdown_connections 2024-09-17T01:14:59.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3442152669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc102f60 0x7f59bc105350 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3442152669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc100630 0x7f59bc102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 -- 172.21.15.103:0/3442152669 >> 172.21.15.103:0/3442152669 conn(0x7f59bc0fa230 msgr2=0x7f59bc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:14:59.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 -- 172.21.15.103:0/3442152669 shutdown_connections 2024-09-17T01:14:59.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.979+0000 7f59c10a3640 1 -- 172.21.15.103:0/3442152669 wait complete. 2024-09-17T01:14:59.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59c10a3640 1 Processor -- start 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59c10a3640 1 -- start start 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59c10a3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc100630 0x7f59bc195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59c10a3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc102f60 0x7f59bc195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59c10a3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1961a0 con 0x7f59bc100630 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59c10a3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc196310 con 0x7f59bc102f60 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59ba59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc102f60 0x7f59bc195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59bad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc100630 0x7f59bc195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59ba59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc102f60 0x7f59bc195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:44586/0 (socket says 172.21.15.103:44586) 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.980+0000 7f59ba59c640 1 -- 172.21.15.103:0/3037730324 learned_addr learned my addr 172.21.15.103:0/3037730324 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59bad9d640 1 -- 172.21.15.103:0/3037730324 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc102f60 msgr2=0x7f59bc195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:14:59.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59bad9d640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc102f60 0x7f59bc195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59bad9d640 1 -- 172.21.15.103:0/3037730324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009560 con 0x7f59bc100630 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59bad9d640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc100630 0x7f59bc195690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c920 tx=0x7f59ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59ac007b80 con 0x7f59bc100630 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc19adb0 con 0x7f59bc100630 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59ac0054e0 con 0x7f59bc100630 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59ac004e80 con 0x7f59bc100630 2024-09-17T01:14:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.981+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc19b300 con 0x7f59bc100630 2024-09-17T01:14:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.982+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc1087b0 con 0x7f59bc100630 2024-09-17T01:14:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.984+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f59ac005000 con 0x7f59bc100630 2024-09-17T01:14:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.984+0000 7f59a3fff640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f59a406e600 0x7f59a4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:14:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.984+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f59ac08e910 con 0x7f59bc100630 2024-09-17T01:14:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.984+0000 7f59ba59c640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f59a406e600 0x7f59a4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:14:59.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.985+0000 7f59ba59c640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f59a406e600 0x7f59a4070ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f59bc196bb0 tx=0x7f59b00314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:14:59.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:14:59.988+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f59ac057a60 con 0x7f59bc100630 2024-09-17T01:15:00.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:00 smithi103 ceph-mon[92733]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:00.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:00 smithi103 ceph-mon[92733]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:00.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:00 smithi103 ceph-mon[92733]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:00.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:00 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2383781838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:00.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:00 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/379443744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:15:00.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.231+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f59bc108990 con 0x7f59bc100630 2024-09-17T01:15:00.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.232+0000 7f59a3fff640 1 -- 172.21.15.103:0/3037730324 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f59ac01d020 con 0x7f59bc100630 2024-09-17T01:15:00.231 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f59a406e600 msgr2=0x7f59a4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f59a406e600 0x7f59a4070ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f59bc196bb0 tx=0x7f59b00314e0 comp rx=0 tx=0).stop 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc100630 msgr2=0x7f59bc195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc100630 0x7f59bc195690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c920 tx=0x7f59ac00cde0 comp rx=0 tx=0).stop 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 shutdown_connections 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f59a406e600 0x7f59a4070ac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59bc102f60 0x7f59bc195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 --2- 172.21.15.103:0/3037730324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc100630 0x7f59bc195690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 >> 172.21.15.103:0/3037730324 conn(0x7f59bc0fa230 msgr2=0x7f59bc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 shutdown_connections 2024-09-17T01:15:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:00.235+0000 7f59c10a3640 1 -- 172.21.15.103:0/3037730324 wait complete. 2024-09-17T01:15:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:00 smithi143 ceph-mon[80685]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:00 smithi143 ceph-mon[80685]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:00 smithi143 ceph-mon[80685]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:00 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2383781838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:00.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:00 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/379443744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:15:01.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:01 smithi103 ceph-mon[92733]: pgmap v220: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-17T01:15:01.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:01 smithi103 ceph-mon[92733]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:01.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:01 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3037730324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:01 smithi143 ceph-mon[80685]: pgmap v220: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-17T01:15:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:01 smithi143 ceph-mon[80685]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:01 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3037730324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:03 smithi103 ceph-mon[92733]: pgmap v221: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-17T01:15:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:03 smithi143 ceph-mon[80685]: pgmap v221: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-17T01:15:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:05.328 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:05 smithi143 ceph-mon[80685]: pgmap v222: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-17T01:15:05.328 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:05.328 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:05 smithi103 ceph-mon[92733]: pgmap v222: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-17T01:15:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:05.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:07 smithi143 ceph-mon[80685]: pgmap v223: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-09-17T01:15:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:07 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:07 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:15:07.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:07 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:07 smithi103 ceph-mon[92733]: pgmap v223: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-09-17T01:15:07.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:07 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:07.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:07 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi143", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:15:07.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:07 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:08.127 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:08 smithi143 ceph-mon[80685]: Upgrade: Updating ceph-exporter.smithi143 (2/2) 2024-09-17T01:15:08.127 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:08 smithi143 ceph-mon[80685]: Deploying daemon ceph-exporter.smithi143 on smithi143 2024-09-17T01:15:08.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:08 smithi103 ceph-mon[92733]: Upgrade: Updating ceph-exporter.smithi143 (2/2) 2024-09-17T01:15:08.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:08 smithi103 ceph-mon[92733]: Deploying daemon ceph-exporter.smithi143 on smithi143 2024-09-17T01:15:09.357 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:09 smithi143 ceph-mon[80685]: pgmap v224: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-17T01:15:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:09 smithi103 ceph-mon[92733]: pgmap v224: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-17T01:15:11.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:11.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:11.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:10 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:11.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:10 smithi143 ceph-mon[80685]: pgmap v225: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:15:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:10 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:11.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:10 smithi103 ceph-mon[92733]: pgmap v225: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:15:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:12 smithi103 ceph-mon[92733]: pgmap v226: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-09-17T01:15:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:12.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:12 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:13.069 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:13.069 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:13.069 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:12 smithi143 ceph-mon[80685]: pgmap v226: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-09-17T01:15:13.069 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:13.069 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:12 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:14 smithi143 ceph-mon[80685]: pgmap v227: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-09-17T01:15:15.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.008 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:14 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:14 smithi103 ceph-mon[92733]: pgmap v227: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-09-17T01:15:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:15.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:14 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:16.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:16 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:16.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:16 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:16.927 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:16 smithi103 ceph-mon[92733]: pgmap v228: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:17.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:16 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:17.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:16 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:17.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:16 smithi143 ceph-mon[80685]: pgmap v228: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:18.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:17 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:18.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:17 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: pgmap v229: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi103"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi103"}]': finished 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi143"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi143"}]': finished 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.180 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:19 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: pgmap v229: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi103"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi103"}]': finished 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi143"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi143"}]': finished 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:19.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:19.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:19 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:20 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:15:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:20 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:15:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:20 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all nfs 2024-09-17T01:15:20.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:20 smithi103 ceph-mon[92733]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:15:20.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:20 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:15:20.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:20 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:15:20.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:20 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all nfs 2024-09-17T01:15:20.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:20 smithi143 ceph-mon[80685]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:15:21.409 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:21 smithi143 ceph-mon[80685]: Upgrade: Updating node-exporter.smithi103 (1/2) 2024-09-17T01:15:21.409 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:21 smithi143 ceph-mon[80685]: Deploying daemon node-exporter.smithi103 on smithi103 2024-09-17T01:15:21.409 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:21 smithi143 ceph-mon[80685]: pgmap v230: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:21 smithi103 ceph-mon[92733]: Upgrade: Updating node-exporter.smithi103 (1/2) 2024-09-17T01:15:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:21 smithi103 ceph-mon[92733]: Deploying daemon node-exporter.smithi103 on smithi103 2024-09-17T01:15:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:21 smithi103 ceph-mon[92733]: pgmap v230: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:23.416 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:23 smithi143 ceph-mon[80685]: pgmap v231: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:23.416 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:23.416 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:23.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:23 smithi103 ceph-mon[92733]: pgmap v231: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:25.219 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:25 smithi143 ceph-mon[80685]: Upgrade: Updating node-exporter.smithi143 (2/2) 2024-09-17T01:15:25.219 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:25 smithi143 ceph-mon[80685]: Deploying daemon node-exporter.smithi143 on smithi143 2024-09-17T01:15:25.219 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:25 smithi143 ceph-mon[80685]: pgmap v232: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:25.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:25 smithi103 ceph-mon[92733]: Upgrade: Updating node-exporter.smithi143 (2/2) 2024-09-17T01:15:25.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:25 smithi103 ceph-mon[92733]: Deploying daemon node-exporter.smithi143 on smithi143 2024-09-17T01:15:25.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:25 smithi103 ceph-mon[92733]: pgmap v232: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:27.098 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:27.098 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:27.098 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:26 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:27.098 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:26 smithi143 ceph-mon[80685]: pgmap v233: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:26 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:27.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:26 smithi103 ceph-mon[92733]: pgmap v233: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:29.092 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.093 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.093 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:28 smithi143 ceph-mon[80685]: pgmap v234: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:15:29.093 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.093 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:28 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:28 smithi103 ceph-mon[92733]: pgmap v234: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:15:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:29.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:28 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:30.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 -- 172.21.15.103:0/917402231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 msgr2=0x7f2c6c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 --2- 172.21.15.103:0/917402231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c0fee30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009880 tx=0x7f2c5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 -- 172.21.15.103:0/917402231 shutdown_connections 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 --2- 172.21.15.103:0/917402231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6c0ffc30 0x7f2c6c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 --2- 172.21.15.103:0/917402231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c0fee30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 -- 172.21.15.103:0/917402231 >> 172.21.15.103:0/917402231 conn(0x7f2c6c0fa1c0 msgr2=0x7f2c6c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 -- 172.21.15.103:0/917402231 shutdown_connections 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.326+0000 7f2c72284640 1 -- 172.21.15.103:0/917402231 wait complete. 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c72284640 1 Processor -- start 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c72284640 1 -- start start 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c72284640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c72284640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6c0ffc30 0x7f2c6c195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c72284640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1961a0 con 0x7f2c6c0fea30 2024-09-17T01:15:30.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c72284640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c196310 con 0x7f2c6c0ffc30 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c6bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c6bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50498/0 (socket says 172.21.15.103:50498) 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c6bfff640 1 -- 172.21.15.103:0/54844061 learned_addr learned my addr 172.21.15.103:0/54844061 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.327+0000 7f2c6b7fe640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6c0ffc30 0x7f2c6c195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c6bfff640 1 -- 172.21.15.103:0/54844061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6c0ffc30 msgr2=0x7f2c6c195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c6bfff640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6c0ffc30 0x7f2c6c195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c6bfff640 1 -- 172.21.15.103:0/54844061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c009560 con 0x7f2c6c0fea30 2024-09-17T01:15:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c6bfff640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c195690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c004650 tx=0x7f2c5c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c5c004aa0 con 0x7f2c6c0fea30 2024-09-17T01:15:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c19ace0 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c5c005d50 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c5c0039e0 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.328+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c19b200 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.329+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c107640 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.330+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2c5c031c00 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.330+0000 7f2c697fa640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2c5406e5f0 0x7f2c54070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.330+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f2c5c0af7c0 con 0x7f2c6c0fea30 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.330+0000 7f2c6b7fe640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2c5406e5f0 0x7f2c54070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.331+0000 7f2c6b7fe640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2c5406e5f0 0x7f2c54070ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c196b40 tx=0x7f2c60005f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.339+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2c5c078870 con 0x7f2c6c0fea30 2024-09-17T01:15:30.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.532+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c6c19b440 con 0x7f2c5406e5f0 2024-09-17T01:15:30.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.533+0000 7f2c697fa640 1 -- 172.21.15.103:0/54844061 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f2c6c19b440 con 0x7f2c5406e5f0 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2c5406e5f0 msgr2=0x7f2c54070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2c5406e5f0 0x7f2c54070ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c196b40 tx=0x7f2c60005f90 comp rx=0 tx=0).stop 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 msgr2=0x7f2c6c195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c195690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c004650 tx=0x7f2c5c0055a0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 shutdown_connections 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2c5406e5f0 0x7f2c54070ab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6c0ffc30 0x7f2c6c195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 --2- 172.21.15.103:0/54844061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6c0fea30 0x7f2c6c195690 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.535+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 >> 172.21.15.103:0/54844061 conn(0x7f2c6c0fa1c0 msgr2=0x7f2c6c067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:30.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.536+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 shutdown_connections 2024-09-17T01:15:30.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.536+0000 7f2c72284640 1 -- 172.21.15.103:0/54844061 wait complete. 2024-09-17T01:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.620+0000 7f1c406d2640 1 -- 172.21.15.103:0/1001366774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c380ffb60 msgr2=0x7f1c380fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.620+0000 7f1c406d2640 1 --2- 172.21.15.103:0/1001366774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c380ffb60 0x7f1c380fff60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009c20 tx=0x7f1c2802a970 comp rx=0 tx=0).stop 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 -- 172.21.15.103:0/1001366774 shutdown_connections 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 --2- 172.21.15.103:0/1001366774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c38100d60 0x7f1c381011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 --2- 172.21.15.103:0/1001366774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c380ffb60 0x7f1c380fff60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 -- 172.21.15.103:0/1001366774 >> 172.21.15.103:0/1001366774 conn(0x7f1c380fb330 msgr2=0x7f1c380fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 -- 172.21.15.103:0/1001366774 shutdown_connections 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 -- 172.21.15.103:0/1001366774 wait complete. 2024-09-17T01:15:30.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 Processor -- start 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 -- start start 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 0x7f1c38195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.621+0000 7f1c406d2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c38100d60 0x7f1c38195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c406d2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c38196140 con 0x7f1c38100d60 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c406d2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381962b0 con 0x7f1c380ffb60 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 0x7f1c38195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 0x7f1c38195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.103:46456/0 (socket says 172.21.15.103:46456) 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 -- 172.21.15.103:0/269819318 learned_addr learned my addr 172.21.15.103:0/269819318 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3dc6d640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c38100d60 0x7f1c38195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 -- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c38100d60 msgr2=0x7f1c38195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c38100d60 0x7f1c38195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 -- 172.21.15.103:0/269819318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28009900 con 0x7f1c380ffb60 2024-09-17T01:15:30.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c3e46e640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 0x7f1c38195630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c28004af0 tx=0x7f1c2802f5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.622+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c28030670 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.623+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c28030c90 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.623+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3819acf0 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.623+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c28039680 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.623+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3819b210 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.624+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3818f700 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.624+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1c2800a040 con 0x7f1c380ffb60 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.625+0000 7f1c377fe640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c2006e5f0 0x7f1c20070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.625+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f1c2802c040 con 0x7f1c380ffb60 2024-09-17T01:15:30.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.625+0000 7f1c3dc6d640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c2006e5f0 0x7f1c20070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.625+0000 7f1c3dc6d640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c2006e5f0 0x7f1c20070ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c38196b50 tx=0x7f1c2c005f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:30.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.629+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c28078b60 con 0x7f1c380ffb60 2024-09-17T01:15:30.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.845+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3802c550 con 0x7f1c2006e5f0 2024-09-17T01:15:30.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.847+0000 7f1c377fe640 1 -- 172.21.15.103:0/269819318 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f1c3802c550 con 0x7f1c2006e5f0 2024-09-17T01:15:30.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c2006e5f0 msgr2=0x7f1c20070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c2006e5f0 0x7f1c20070ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c38196b50 tx=0x7f1c2c005f90 comp rx=0 tx=0).stop 2024-09-17T01:15:30.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 msgr2=0x7f1c38195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 0x7f1c38195630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c28004af0 tx=0x7f1c2802f5f0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 shutdown_connections 2024-09-17T01:15:30.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c2006e5f0 0x7f1c20070ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c38100d60 0x7f1c38195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 --2- 172.21.15.103:0/269819318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c380ffb60 0x7f1c38195630 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 >> 172.21.15.103:0/269819318 conn(0x7f1c380fb330 msgr2=0x7f1c381044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 shutdown_connections 2024-09-17T01:15:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.851+0000 7f1c406d2640 1 -- 172.21.15.103:0/269819318 wait complete. 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 -- 172.21.15.103:0/1656724088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00fea30 msgr2=0x7f96b00fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 --2- 172.21.15.103:0/1656724088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00fea30 0x7f96b00fee30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009880 tx=0x7f96a002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 -- 172.21.15.103:0/1656724088 shutdown_connections 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 --2- 172.21.15.103:0/1656724088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96b00ffc30 0x7f96b01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 --2- 172.21.15.103:0/1656724088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00fea30 0x7f96b00fee30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 -- 172.21.15.103:0/1656724088 >> 172.21.15.103:0/1656724088 conn(0x7f96b00fa1c0 msgr2=0x7f96b00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:30.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 -- 172.21.15.103:0/1656724088 shutdown_connections 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.935+0000 7f96b5990640 1 -- 172.21.15.103:0/1656724088 wait complete. 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96b5990640 1 Processor -- start 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96b5990640 1 -- start start 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96b5990640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96b00fea30 0x7f96b0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96b5990640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 0x7f96b019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96b5990640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b019a960 con 0x7f96b00ffc30 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96b5990640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b019aaa0 con 0x7f96b00fea30 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96ae7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 0x7f96b019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96ae7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 0x7f96b019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50526/0 (socket says 172.21.15.103:50526) 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96ae7fc640 1 -- 172.21.15.103:0/74510418 learned_addr learned my addr 172.21.15.103:0/74510418 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:30.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.936+0000 7f96aeffd640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96b00fea30 0x7f96b0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96ae7fc640 1 -- 172.21.15.103:0/74510418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96b00fea30 msgr2=0x7f96b0068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96ae7fc640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96b00fea30 0x7f96b0068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96ae7fc640 1 -- 172.21.15.103:0/74510418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0009560 con 0x7f96b00ffc30 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96ae7fc640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 0x7f96b019a390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f96a400d6f0 tx=0x7f96a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a4009a30 con 0x7f96b00ffc30 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96a40054e0 con 0x7f96b00ffc30 2024-09-17T01:15:30.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a4010460 con 0x7f96b00ffc30 2024-09-17T01:15:30.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b019ad50 con 0x7f96b00ffc30 2024-09-17T01:15:30.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.937+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b019b320 con 0x7f96b00ffc30 2024-09-17T01:15:30.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.938+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0107640 con 0x7f96b00ffc30 2024-09-17T01:15:30.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.939+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f96a4009b90 con 0x7f96b00ffc30 2024-09-17T01:15:30.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.939+0000 7f96b498e640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f969806e5f0 0x7f9698070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:30.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.940+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f96a408e330 con 0x7f96b00ffc30 2024-09-17T01:15:30.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.940+0000 7f96aeffd640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f969806e5f0 0x7f9698070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:30.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.940+0000 7f96aeffd640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f969806e5f0 0x7f9698070ab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009230 tx=0x7f96a00314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:30.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:30.944+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f96a4057380 con 0x7f96b00ffc30 2024-09-17T01:15:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.136+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f96b0104580 con 0x7f969806e5f0 2024-09-17T01:15:31.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:30 smithi103 ceph-mon[92733]: pgmap v235: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:31.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.134 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.146+0000 7f96b498e640 1 -- 172.21.15.103:0/74510418 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f96b0104580 con 0x7f969806e5f0 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (15m) 1s ago 16m 24.9M - 0.25.0 c8568f914cd2 46e9a8bdc709 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (28s) 1s ago 16m 8280k - 19.1.1-330-gc2ddf972 ebb0615149de 3c6511ea7af3 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (21s) 3s ago 15m 7936k - 19.1.1-330-gc2ddf972 ebb0615149de 70186c450006 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (5m) 1s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (5m) 3s ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (14m) 1s ago 16m 86.3M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (105s) 1s ago 11m 84.9M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (87s) 1s ago 11m 88.6M - 19.1.1-330-gc2ddf972 ebb0615149de b2b1fe41a30f 2024-09-17T01:15:31.144 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (43s) 3s ago 11m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 22146925e364 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (66s) 3s ago 11m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 031fc3939184 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (7m) 1s ago 17m 508M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (6m) 3s ago 15m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (6m) 1s ago 17m 56.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (6m) 3s ago 15m 43.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (9s) 1s ago 16m 7918k - 1.5.0 0da6a335fe13 64ef00b7cfde 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (5s) 3s ago 15m 3594k - 1.5.0 0da6a335fe13 15da54842e59 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (4m) 1s ago 14m 109M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (4m) 1s ago 14m 151M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:15:31.145 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (3m) 1s ago 13m 168M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:15:31.146 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (3m) 3s ago 13m 146M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:15:31.146 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (2m) 3s ago 13m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:15:31.146 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (2m) 3s ago 12m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:15:31.146 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (6m) 1s ago 15m 69.5M - 2.43.0 a07b618ecd1d 1c9d70f77433 2024-09-17T01:15:31.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f969806e5f0 msgr2=0x7f9698070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f969806e5f0 0x7f9698070ab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009230 tx=0x7f96a00314e0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 msgr2=0x7f96b019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 0x7f96b019a390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f96a400d6f0 tx=0x7f96a400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 shutdown_connections 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f969806e5f0 0x7f9698070ab0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ffc30 0x7f96b019a390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 --2- 172.21.15.103:0/74510418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96b00fea30 0x7f96b0068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 >> 172.21.15.103:0/74510418 conn(0x7f96b00fa1c0 msgr2=0x7f96b0102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 shutdown_connections 2024-09-17T01:15:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.148+0000 7f96b5990640 1 -- 172.21.15.103:0/74510418 wait complete. 2024-09-17T01:15:31.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:30 smithi143 ceph-mon[80685]: pgmap v235: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:31.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.165 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.230+0000 7f08589ac640 1 -- 172.21.15.103:0/3797665957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 msgr2=0x7f08540fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.230+0000 7f08589ac640 1 --2- 172.21.15.103:0/3797665957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f08540fee80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0844009880 tx=0x7f084402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 -- 172.21.15.103:0/3797665957 shutdown_connections 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 --2- 172.21.15.103:0/3797665957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 0x7f0854100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 --2- 172.21.15.103:0/3797665957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f08540fee80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 -- 172.21.15.103:0/3797665957 >> 172.21.15.103:0/3797665957 conn(0x7f08540fa210 msgr2=0x7f08540fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:31.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 -- 172.21.15.103:0/3797665957 shutdown_connections 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 -- 172.21.15.103:0/3797665957 wait complete. 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 Processor -- start 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.231+0000 7f08589ac640 1 -- start start 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08589ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f0854194560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08589ac640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 0x7f0854194aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08589ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0854195070 con 0x7f08540fea80 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08589ac640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08541951e0 con 0x7f08540ffc80 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f0854194560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f0854194560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50542/0 (socket says 172.21.15.103:50542) 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 -- 172.21.15.103:0/2063367435 learned_addr learned my addr 172.21.15.103:0/2063367435 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f0851d9b640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 0x7f0854194aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 -- 172.21.15.103:0/2063367435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 msgr2=0x7f0854194aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 0x7f0854194aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 -- 172.21.15.103:0/2063367435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844009560 con 0x7f08540fea80 2024-09-17T01:15:31.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f0851d9b640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 0x7f0854194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:15:31.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f085259c640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f0854194560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08440054f0 tx=0x7f0844005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0844004aa0 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0854199c20 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.232+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0844004c00 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.233+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0844003ac0 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.233+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0854068400 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.234+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854107670 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.234+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0844003d80 con 0x7f08540fea80 2024-09-17T01:15:31.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.234+0000 7f08437fe640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f083c070800 0x7f083c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.235+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f08440afa50 con 0x7f08540fea80 2024-09-17T01:15:31.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.235+0000 7f0851d9b640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f083c070800 0x7f083c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.235+0000 7f0851d9b640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f083c070800 0x7f083c072cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0854195a80 tx=0x7f084800b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:31.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.239+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0844078a80 con 0x7f08540fea80 2024-09-17T01:15:31.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.483+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f085418e070 con 0x7f08540fea80 2024-09-17T01:15:31.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.484+0000 7f08437fe640 1 -- 172.21.15.103:0/2063367435 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f084407c140 con 0x7f08540fea80 2024-09-17T01:15:31.482 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:15:31.482 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:15:31.482 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:15:31.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:15:31.484 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f083c070800 msgr2=0x7f083c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f083c070800 0x7f083c072cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0854195a80 tx=0x7f084800b390 comp rx=0 tx=0).stop 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 msgr2=0x7f0854194560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f0854194560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08440054f0 tx=0x7f0844005520 comp rx=0 tx=0).stop 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 shutdown_connections 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f083c070800 0x7f083c072cc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08540ffc80 0x7f0854194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 --2- 172.21.15.103:0/2063367435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08540fea80 0x7f0854194560 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.487+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 >> 172.21.15.103:0/2063367435 conn(0x7f08540fa210 msgr2=0x7f0854103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.488+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 shutdown_connections 2024-09-17T01:15:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.488+0000 7f08589ac640 1 -- 172.21.15.103:0/2063367435 wait complete. 2024-09-17T01:15:31.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 -- 172.21.15.103:0/1427133534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 msgr2=0x7fab74100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/1427133534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab74100450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab68009880 tx=0x7fab6802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 -- 172.21.15.103:0/1427133534 shutdown_connections 2024-09-17T01:15:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/1427133534 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab740fecb0 0x7fab740ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/1427133534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab74100450 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 -- 172.21.15.103:0/1427133534 >> 172.21.15.103:0/1427133534 conn(0x7fab740f99b0 msgr2=0x7fab740fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 -- 172.21.15.103:0/1427133534 shutdown_connections 2024-09-17T01:15:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.578+0000 7fab7b1d2640 1 -- 172.21.15.103:0/1427133534 wait complete. 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.579+0000 7fab7b1d2640 1 Processor -- start 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.579+0000 7fab7b1d2640 1 -- start start 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.579+0000 7fab7b1d2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab740fecb0 0x7fab740fe700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.579+0000 7fab7b1d2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab7419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.579+0000 7fab7b1d2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7419a910 con 0x7fab74100050 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.579+0000 7fab7b1d2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7419aa50 con 0x7fab740fecb0 2024-09-17T01:15:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab7419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab7419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50556/0 (socket says 172.21.15.103:50556) 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 -- 172.21.15.103:0/991595986 learned_addr learned my addr 172.21.15.103:0/991595986 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab78f6e640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab740fecb0 0x7fab740fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 -- 172.21.15.103:0/991595986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab740fecb0 msgr2=0x7fab740fe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab740fecb0 0x7fab740fe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 -- 172.21.15.103:0/991595986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab68009560 con 0x7fab74100050 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab73fff640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab7419a340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab6000d8d0 tx=0x7fab6000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6000bea0 con 0x7fab74100050 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7419ad00 con 0x7fab74100050 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab60009c00 con 0x7fab74100050 2024-09-17T01:15:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.580+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6000f710 con 0x7fab74100050 2024-09-17T01:15:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.581+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7419b2d0 con 0x7fab74100050 2024-09-17T01:15:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.582+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7418e610 con 0x7fab74100050 2024-09-17T01:15:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.582+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fab6000f940 con 0x7fab74100050 2024-09-17T01:15:31.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.583+0000 7fab71ffb640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fab6406e600 0x7fab64070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.583+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fab6008e4c0 con 0x7fab74100050 2024-09-17T01:15:31.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.583+0000 7fab78f6e640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fab6406e600 0x7fab64070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.584+0000 7fab78f6e640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fab6406e600 0x7fab64070ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab68000c00 tx=0x7fab680314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:31.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.590+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fab60057570 con 0x7fab74100050 2024-09-17T01:15:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.802+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab74107680 con 0x7fab74100050 2024-09-17T01:15:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.803+0000 7fab71ffb640 1 -- 172.21.15.103:0/991595986 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+2009 (secure 0 0 0) 0x7fab600177f0 con 0x7fab74100050 2024-09-17T01:15:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:e37 2024-09-17T01:15:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-17T01:14:55:014839+0000 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 37 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:14:55.014828+0000 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:15:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 94 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=34380} 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:15:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 34380 members: 34380 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:34380} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:34412} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:15:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:15:31.805 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:15:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6824/1792149992,v1:172.21.15.143:6825/1792149992] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:15:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2562780354,v1:172.21.15.143:6827/2562780354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 37 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fab6406e600 msgr2=0x7fab64070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fab6406e600 0x7fab64070ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab68000c00 tx=0x7fab680314e0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 msgr2=0x7fab7419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab7419a340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab6000d8d0 tx=0x7fab6000dd90 comp rx=0 tx=0).stop 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 shutdown_connections 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fab6406e600 0x7fab64070ac0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab74100050 0x7fab7419a340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 --2- 172.21.15.103:0/991595986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab740fecb0 0x7fab740fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 >> 172.21.15.103:0/991595986 conn(0x7fab740f99b0 msgr2=0x7fab74103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:31.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 shutdown_connections 2024-09-17T01:15:31.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.805+0000 7fab7b1d2640 1 -- 172.21.15.103:0/991595986 wait complete. 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 -- 172.21.15.103:0/1259626304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0ffc30 msgr2=0x7fd63c1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 --2- 172.21.15.103:0/1259626304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0ffc30 0x7fd63c1000b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd624009880 tx=0x7fd62402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 -- 172.21.15.103:0/1259626304 shutdown_connections 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 --2- 172.21.15.103:0/1259626304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0ffc30 0x7fd63c1000b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 --2- 172.21.15.103:0/1259626304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd63c0fea30 0x7fd63c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 -- 172.21.15.103:0/1259626304 >> 172.21.15.103:0/1259626304 conn(0x7fd63c0fa1c0 msgr2=0x7fd63c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 -- 172.21.15.103:0/1259626304 shutdown_connections 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 -- 172.21.15.103:0/1259626304 wait complete. 2024-09-17T01:15:31.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.890+0000 7fd641bd9640 1 Processor -- start 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd641bd9640 1 -- start start 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd641bd9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 0x7fd63c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd641bd9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd63c0ffc30 0x7fd63c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd641bd9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c19a8f0 con 0x7fd63c0fea30 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd641bd9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c19aa60 con 0x7fd63c0ffc30 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 0x7fd63c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 0x7fd63c068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50584/0 (socket says 172.21.15.103:50584) 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 -- 172.21.15.103:0/980089387 learned_addr learned my addr 172.21.15.103:0/980089387 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:31.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63affd640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd63c0ffc30 0x7fd63c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 -- 172.21.15.103:0/980089387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd63c0ffc30 msgr2=0x7fd63c19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd63c0ffc30 0x7fd63c19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 -- 172.21.15.103:0/980089387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009560 con 0x7fd63c0fea30 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd63b7fe640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 0x7fd63c068780 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ea20 tx=0x7fd62c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.891+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c00cdb0 con 0x7fd63c0fea30 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.892+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c19ad40 con 0x7fd63c0fea30 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.892+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd62c003e30 con 0x7fd63c0fea30 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.892+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c0116a0 con 0x7fd63c0fea30 2024-09-17T01:15:31.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.892+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c19b280 con 0x7fd63c0fea30 2024-09-17T01:15:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.893+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c107640 con 0x7fd63c0fea30 2024-09-17T01:15:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.893+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd62c003970 con 0x7fd63c0fea30 2024-09-17T01:15:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.894+0000 7fd638ff9640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd62806e5f0 0x7fd628070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.894+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fd62c08edd0 con 0x7fd63c0fea30 2024-09-17T01:15:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.894+0000 7fd63affd640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd62806e5f0 0x7fd628070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:31.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.894+0000 7fd63affd640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd62806e5f0 0x7fd628070ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd624000c00 tx=0x7fd6240314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:31.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:31.902+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd62c057d50 con 0x7fd63c0fea30 2024-09-17T01:15:32.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.098+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd63c19b4d0 con 0x7fd62806e5f0 2024-09-17T01:15:32.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.099+0000 7fd638ff9640 1 -- 172.21.15.103:0/980089387 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fd63c19b4d0 con 0x7fd62806e5f0 2024-09-17T01:15:32.097 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:15:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:15:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:15:32.097 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mds", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph-exporter", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "osd", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:15:32.098 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:15:32.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd62806e5f0 msgr2=0x7fd628070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:32.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd62806e5f0 0x7fd628070ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd624000c00 tx=0x7fd6240314e0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 msgr2=0x7fd63c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:32.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 0x7fd63c068780 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ea20 tx=0x7fd62c00eee0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 shutdown_connections 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd62806e5f0 0x7fd628070ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd63c0ffc30 0x7fd63c19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 --2- 172.21.15.103:0/980089387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c0fea30 0x7fd63c068780 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.101+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 >> 172.21.15.103:0/980089387 conn(0x7fd63c0fa1c0 msgr2=0x7fd63c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.102+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 shutdown_connections 2024-09-17T01:15:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.102+0000 7fd641bd9640 1 -- 172.21.15.103:0/980089387 wait complete. 2024-09-17T01:15:32.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 -- 172.21.15.103:0/2503043922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100ffc30 msgr2=0x7f62101000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:32.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 --2- 172.21.15.103:0/2503043922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100ffc30 0x7f62101000b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6204009880 tx=0x7f620402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 -- 172.21.15.103:0/2503043922 shutdown_connections 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 --2- 172.21.15.103:0/2503043922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100ffc30 0x7f62101000b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 --2- 172.21.15.103:0/2503043922 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100fea30 0x7f62100fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 -- 172.21.15.103:0/2503043922 >> 172.21.15.103:0/2503043922 conn(0x7f62100fa1c0 msgr2=0x7f62100fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 -- 172.21.15.103:0/2503043922 shutdown_connections 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.183+0000 7f62154e8640 1 -- 172.21.15.103:0/2503043922 wait complete. 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f62154e8640 1 Processor -- start 2024-09-17T01:15:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f62154e8640 1 -- start start 2024-09-17T01:15:32.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f62154e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 0x7f6210068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f62154e8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100ffc30 0x7f621019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f62154e8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621019a8f0 con 0x7f62100fea30 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f62154e8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621019aa60 con 0x7f62100ffc30 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 0x7f6210068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 0x7f6210068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50612/0 (socket says 172.21.15.103:50612) 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620effd640 1 -- 172.21.15.103:0/1277916835 learned_addr learned my addr 172.21.15.103:0/1277916835 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:15:32.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620e7fc640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100ffc30 0x7f621019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620effd640 1 -- 172.21.15.103:0/1277916835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100ffc30 msgr2=0x7f621019a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620effd640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100ffc30 0x7f621019a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.184+0000 7f620effd640 1 -- 172.21.15.103:0/1277916835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204009560 con 0x7f62100fea30 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f620e7fc640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100ffc30 0x7f621019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f620effd640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 0x7f6210068780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f620000d8d0 tx=0x7f620000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6200009a30 con 0x7f62100fea30 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621019ad40 con 0x7f62100fea30 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6200009b90 con 0x7f62100fea30 2024-09-17T01:15:32.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f620000f680 con 0x7f62100fea30 2024-09-17T01:15:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.185+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621019b280 con 0x7f62100fea30 2024-09-17T01:15:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.186+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210107640 con 0x7f62100fea30 2024-09-17T01:15:32.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.187+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6200009d00 con 0x7f62100fea30 2024-09-17T01:15:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.187+0000 7f61f7fff640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f61f806e5f0 0x7f61f8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:15:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.187+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f620008e6e0 con 0x7f62100fea30 2024-09-17T01:15:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.187+0000 7f620e7fc640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f61f806e5f0 0x7f61f8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:15:32.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.188+0000 7f620e7fc640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f61f806e5f0 0x7f61f8070ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6204000c00 tx=0x7f62040314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:15:32.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.192+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6200057660 con 0x7f62100fea30 2024-09-17T01:15:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:31 smithi143 ceph-mon[80685]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:31 smithi143 ceph-mon[80685]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:31 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2063367435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:32.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:32.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:31 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/991595986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:15:32.278 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:31 smithi103 ceph-mon[92733]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:32.279 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:31 smithi103 ceph-mon[92733]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:32.279 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:31 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2063367435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:32.279 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:32.279 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:32.279 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:31 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/991595986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:15:32.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.447+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f621019b7e0 con 0x7f62100fea30 2024-09-17T01:15:32.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.447+0000 7f61f7fff640 1 -- 172.21.15.103:0/1277916835 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f620005ad20 con 0x7f62100fea30 2024-09-17T01:15:32.445 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:15:32.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f61f806e5f0 msgr2=0x7f61f8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:32.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f61f806e5f0 0x7f61f8070ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6204000c00 tx=0x7f62040314e0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 msgr2=0x7f6210068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 0x7f6210068780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f620000d8d0 tx=0x7f620000dd90 comp rx=0 tx=0).stop 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 shutdown_connections 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f61f806e5f0 0x7f61f8070ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62100ffc30 0x7f621019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 --2- 172.21.15.103:0/1277916835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62100fea30 0x7f6210068780 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.450+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 >> 172.21.15.103:0/1277916835 conn(0x7f62100fa1c0 msgr2=0x7f6210102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.451+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 shutdown_connections 2024-09-17T01:15:32.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:15:32.451+0000 7f62154e8640 1 -- 172.21.15.103:0/1277916835 wait complete. 2024-09-17T01:15:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:32 smithi103 ceph-mon[92733]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:32 smithi103 ceph-mon[92733]: pgmap v236: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:32 smithi103 ceph-mon[92733]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:32 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1277916835' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:33.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:32 smithi143 ceph-mon[80685]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:32 smithi143 ceph-mon[80685]: pgmap v236: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:33.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:32 smithi143 ceph-mon[80685]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:32 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1277916835' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:33.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:34.995 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: pgmap v237: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:34.995 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:34.995 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:34.995 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.996 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.997 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.997 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.997 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:34.997 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: pgmap v237: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:35.259 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:37.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:36 smithi143 ceph-mon[80685]: Upgrade: Updating prometheus.smithi103 2024-09-17T01:15:37.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:36 smithi143 ceph-mon[80685]: pgmap v238: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:37.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:36 smithi143 ceph-mon[80685]: Deploying daemon prometheus.smithi103 on smithi103 2024-09-17T01:15:37.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:36 smithi103 ceph-mon[92733]: Upgrade: Updating prometheus.smithi103 2024-09-17T01:15:37.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:36 smithi103 ceph-mon[92733]: pgmap v238: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:37.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:36 smithi103 ceph-mon[92733]: Deploying daemon prometheus.smithi103 on smithi103 2024-09-17T01:15:39.099 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:38 smithi103 ceph-mon[92733]: pgmap v239: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:15:39.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:38 smithi143 ceph-mon[80685]: pgmap v239: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:15:41.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:40 smithi103 ceph-mon[92733]: pgmap v240: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:40 smithi143 ceph-mon[80685]: pgmap v240: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:42.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:41 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:42.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:41 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:42.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:41 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:41 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:41 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:42.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:41 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:42 smithi143 ceph-mon[80685]: pgmap v241: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T01:15:43.285 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:42 smithi103 ceph-mon[92733]: pgmap v241: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T01:15:45.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:44 smithi103 ceph-mon[92733]: pgmap v242: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:44 smithi143 ceph-mon[80685]: pgmap v242: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:46.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:46 smithi143 ceph-mon[80685]: pgmap v243: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T01:15:46.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:46 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.768 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:46 smithi103 ceph-mon[92733]: pgmap v243: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T01:15:46.768 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:46.768 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:46 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:48.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:47 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:48.258 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:47 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:48 smithi143 ceph-mon[80685]: pgmap v244: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T01:15:49.355 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:48 smithi103 ceph-mon[92733]: pgmap v244: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-17T01:15:50.544 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:50.544 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.545 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.546 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:50 smithi103 ceph-mon[92733]: pgmap v245: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:50.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:50.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:50.759 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:50 smithi143 ceph-mon[80685]: pgmap v245: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:51.473 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:51 smithi103 ceph-mon[92733]: Upgrade: Updating alertmanager.smithi103 2024-09-17T01:15:51.473 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:51 smithi103 ceph-mon[92733]: Deploying daemon alertmanager.smithi103 on smithi103 2024-09-17T01:15:51.660 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:51 smithi143 ceph-mon[80685]: Upgrade: Updating alertmanager.smithi103 2024-09-17T01:15:51.660 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:51 smithi143 ceph-mon[80685]: Deploying daemon alertmanager.smithi103 on smithi103 2024-09-17T01:15:52.592 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:52 smithi103 ceph-mon[92733]: pgmap v246: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:52.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:52 smithi143 ceph-mon[80685]: pgmap v246: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:55.132 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:54 smithi103 ceph-mon[92733]: pgmap v247: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:54 smithi143 ceph-mon[80685]: pgmap v247: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:15:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:57 smithi103 ceph-mon[92733]: pgmap v248: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:57 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:57 smithi143 ceph-mon[80685]: pgmap v248: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:15:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:15:57.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:57 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:15:59.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:15:59 smithi103 ceph-mon[92733]: pgmap v249: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:15:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:15:59 smithi143 ceph-mon[80685]: pgmap v249: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:01.356 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:01 smithi103 ceph-mon[92733]: pgmap v250: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:01.356 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:01 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.356 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:01 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.356 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:01 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.356 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:01 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:01 smithi143 ceph-mon[80685]: pgmap v250: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:01 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:01 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:01 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:01.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:01 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 -- 172.21.15.103:0/36613554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40ffc30 msgr2=0x7fbca41000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 --2- 172.21.15.103:0/36613554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40ffc30 0x7fbca41000b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009880 tx=0x7fbc9402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 -- 172.21.15.103:0/36613554 shutdown_connections 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 --2- 172.21.15.103:0/36613554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40ffc30 0x7fbca41000b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 --2- 172.21.15.103:0/36613554 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbca40fea30 0x7fbca40fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 -- 172.21.15.103:0/36613554 >> 172.21.15.103:0/36613554 conn(0x7fbca40fa1c0 msgr2=0x7fbca40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 -- 172.21.15.103:0/36613554 shutdown_connections 2024-09-17T01:16:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.537+0000 7fbcac754640 1 -- 172.21.15.103:0/36613554 wait complete. 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcac754640 1 Processor -- start 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcac754640 1 -- start start 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcac754640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 0x7fbca41029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcac754640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbca40ffc30 0x7fbca4101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcac754640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4101550 con 0x7fbca40fea30 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcac754640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca41016c0 con 0x7fbca40ffc30 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcaa4f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 0x7fbca41029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcaa4f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 0x7fbca41029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43630/0 (socket says 172.21.15.103:43630) 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcaa4f0640 1 -- 172.21.15.103:0/3770261040 learned_addr learned my addr 172.21.15.103:0/3770261040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbca9cef640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbca40ffc30 0x7fbca4101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcaa4f0640 1 -- 172.21.15.103:0/3770261040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbca40ffc30 msgr2=0x7fbca4101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcaa4f0640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbca40ffc30 0x7fbca4101010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.538+0000 7fbcaa4f0640 1 -- 172.21.15.103:0/3770261040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94009560 con 0x7fbca40fea30 2024-09-17T01:16:02.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.539+0000 7fbcaa4f0640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 0x7fbca41029c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbca000d8d0 tx=0x7fbca000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:02.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.539+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbca0009a30 con 0x7fbca40fea30 2024-09-17T01:16:02.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.539+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca41019a0 con 0x7fbca40fea30 2024-09-17T01:16:02.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.539+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbca0009b90 con 0x7fbca40fea30 2024-09-17T01:16:02.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.539+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbca000f680 con 0x7fbca40fea30 2024-09-17T01:16:02.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.539+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca419d6b0 con 0x7fbca40fea30 2024-09-17T01:16:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.540+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca40fee30 con 0x7fbca40fea30 2024-09-17T01:16:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.540+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbca0009d00 con 0x7fbca40fea30 2024-09-17T01:16:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.541+0000 7fbc9b7fe640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbc9006e5f0 0x7fbc90070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.541+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fbca008e6c0 con 0x7fbca40fea30 2024-09-17T01:16:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.541+0000 7fbca9cef640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbc9006e5f0 0x7fbc90070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.541+0000 7fbca9cef640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbc9006e5f0 0x7fbc90070ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc94000c00 tx=0x7fbc940314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.549+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbca0057640 con 0x7fbca40fea30 2024-09-17T01:16:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.750+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbca40683a0 con 0x7fbc9006e5f0 2024-09-17T01:16:02.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.751+0000 7fbc9b7fe640 1 -- 172.21.15.103:0/3770261040 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fbca40683a0 con 0x7fbc9006e5f0 2024-09-17T01:16:02.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbc9006e5f0 msgr2=0x7fbc90070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:02.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbc9006e5f0 0x7fbc90070ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc94000c00 tx=0x7fbc940314e0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 msgr2=0x7fbca41029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:02.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 0x7fbca41029c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbca000d8d0 tx=0x7fbca000dd90 comp rx=0 tx=0).stop 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 shutdown_connections 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbc9006e5f0 0x7fbc90070ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbca40ffc30 0x7fbca4101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 --2- 172.21.15.103:0/3770261040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca40fea30 0x7fbca41029c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 >> 172.21.15.103:0/3770261040 conn(0x7fbca40fa1c0 msgr2=0x7fbca4067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 shutdown_connections 2024-09-17T01:16:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.753+0000 7fbcac754640 1 -- 172.21.15.103:0/3770261040 wait complete. 2024-09-17T01:16:02.759 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:16:02.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.836+0000 7f2546091640 1 -- 172.21.15.103:0/1287747474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400fea30 msgr2=0x7f25400fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.836+0000 7f2546091640 1 --2- 172.21.15.103:0/1287747474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400fea30 0x7f25400fee30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2530009880 tx=0x7f253002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.836+0000 7f2546091640 1 -- 172.21.15.103:0/1287747474 shutdown_connections 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.836+0000 7f2546091640 1 --2- 172.21.15.103:0/1287747474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25400ffc30 0x7f25401000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.836+0000 7f2546091640 1 --2- 172.21.15.103:0/1287747474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400fea30 0x7f25400fee30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.836+0000 7f2546091640 1 -- 172.21.15.103:0/1287747474 >> 172.21.15.103:0/1287747474 conn(0x7f25400fa1c0 msgr2=0x7f25400fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.837+0000 7f2546091640 1 -- 172.21.15.103:0/1287747474 shutdown_connections 2024-09-17T01:16:02.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.837+0000 7f2546091640 1 -- 172.21.15.103:0/1287747474 wait complete. 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.837+0000 7f2546091640 1 Processor -- start 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f2546091640 1 -- start start 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f2546091640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25400fea30 0x7f2540068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f2546091640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 0x7f254019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f2546091640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254019a940 con 0x7f25400ffc30 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f2546091640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254019aa80 con 0x7f25400fea30 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 0x7f254019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 0x7f254019a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43638/0 (socket says 172.21.15.103:43638) 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253effd640 1 -- 172.21.15.103:0/2522737061 learned_addr learned my addr 172.21.15.103:0/2522737061 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:02.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253f7fe640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25400fea30 0x7f2540068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253effd640 1 -- 172.21.15.103:0/2522737061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25400fea30 msgr2=0x7f2540068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253effd640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25400fea30 0x7f2540068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.838+0000 7f253effd640 1 -- 172.21.15.103:0/2522737061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530009560 con 0x7f25400ffc30 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.839+0000 7f253effd640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 0x7f254019a370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f253400d8d0 tx=0x7f253400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.839+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f253400bea0 con 0x7f25400ffc30 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.839+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254019ad30 con 0x7f25400ffc30 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.839+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2534009c00 con 0x7f25400ffc30 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.839+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f253400f710 con 0x7f25400ffc30 2024-09-17T01:16:02.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.839+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254019b300 con 0x7f25400ffc30 2024-09-17T01:16:02.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.840+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2540107620 con 0x7f25400ffc30 2024-09-17T01:16:02.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.841+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2534010460 con 0x7f25400ffc30 2024-09-17T01:16:02.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.841+0000 7f253cff9640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f252806e5f0 0x7f2528070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:02.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.842+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f253408e570 con 0x7f25400ffc30 2024-09-17T01:16:02.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.842+0000 7f253f7fe640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f252806e5f0 0x7f2528070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:02.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.842+0000 7f253f7fe640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f252806e5f0 0x7f2528070ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2530009230 tx=0x7f25300314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:02.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:02.846+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f25340575a0 con 0x7f25400ffc30 2024-09-17T01:16:03.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.048+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f254019b490 con 0x7f252806e5f0 2024-09-17T01:16:03.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.049+0000 7f253cff9640 1 -- 172.21.15.103:0/2522737061 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f254019b490 con 0x7f252806e5f0 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.051+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f252806e5f0 msgr2=0x7f2528070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f252806e5f0 0x7f2528070ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2530009230 tx=0x7f25300314e0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 msgr2=0x7f254019a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 0x7f254019a370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f253400d8d0 tx=0x7f253400dd90 comp rx=0 tx=0).stop 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 shutdown_connections 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f252806e5f0 0x7f2528070ab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25400ffc30 0x7f254019a370 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 --2- 172.21.15.103:0/2522737061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25400fea30 0x7f2540068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 >> 172.21.15.103:0/2522737061 conn(0x7f25400fa1c0 msgr2=0x7f2540102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 shutdown_connections 2024-09-17T01:16:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.052+0000 7f2546091640 1 -- 172.21.15.103:0/2522737061 wait complete. 2024-09-17T01:16:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 -- 172.21.15.103:0/710484461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 msgr2=0x7fbb8c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 --2- 172.21.15.103:0/710484461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c0fee30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009880 tx=0x7fbb7c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 -- 172.21.15.103:0/710484461 shutdown_connections 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 --2- 172.21.15.103:0/710484461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb8c0ffc30 0x7fbb8c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 --2- 172.21.15.103:0/710484461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c0fee30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 -- 172.21.15.103:0/710484461 >> 172.21.15.103:0/710484461 conn(0x7fbb8c0fa1c0 msgr2=0x7fbb8c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 -- 172.21.15.103:0/710484461 shutdown_connections 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.137+0000 7fbb9284a640 1 -- 172.21.15.103:0/710484461 wait complete. 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb9284a640 1 Processor -- start 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb9284a640 1 -- start start 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb9284a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb9284a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb8c0ffc30 0x7fbb8c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb9284a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c1960a0 con 0x7fbb8c0fea30 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb9284a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c196210 con 0x7fbb8c0ffc30 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43666/0 (socket says 172.21.15.103:43666) 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb8bfff640 1 -- 172.21.15.103:0/575572052 learned_addr learned my addr 172.21.15.103:0/575572052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.138+0000 7fbb8b7fe640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb8c0ffc30 0x7fbb8c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb8bfff640 1 -- 172.21.15.103:0/575572052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb8c0ffc30 msgr2=0x7fbb8c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb8bfff640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb8c0ffc30 0x7fbb8c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb8bfff640 1 -- 172.21.15.103:0/575572052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c009560 con 0x7fbb8c0fea30 2024-09-17T01:16:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb8bfff640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c195620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c02a9c0 tx=0x7fbb7c005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb7c004b20 con 0x7fbb8c0fea30 2024-09-17T01:16:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb7c004c80 con 0x7fbb8c0fea30 2024-09-17T01:16:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c19ac90 con 0x7fbb8c0fea30 2024-09-17T01:16:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb7c003b10 con 0x7fbb8c0fea30 2024-09-17T01:16:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.139+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c19b130 con 0x7fbb8c0fea30 2024-09-17T01:16:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.140+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c108710 con 0x7fbb8c0fea30 2024-09-17T01:16:03.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.141+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbb7c003c70 con 0x7fbb8c0fea30 2024-09-17T01:16:03.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.141+0000 7fbb897fa640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbb7406e5f0 0x7fbb74070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.141+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fbb7c0afa60 con 0x7fbb8c0fea30 2024-09-17T01:16:03.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.141+0000 7fbb8b7fe640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbb7406e5f0 0x7fbb74070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.142+0000 7fbb8b7fe640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbb7406e5f0 0x7fbb74070ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c196b40 tx=0x7fbb8000a2d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:03.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.146+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbb7c0789e0 con 0x7fbb8c0fea30 2024-09-17T01:16:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:03 smithi143 ceph-mon[80685]: pgmap v251: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:03.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.328+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb8c104580 con 0x7fbb7406e5f0 2024-09-17T01:16:03.327 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:03 smithi103 ceph-mon[92733]: pgmap v251: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:03.327 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:03.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.338+0000 7fbb897fa640 1 -- 172.21.15.103:0/575572052 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fbb8c104580 con 0x7fbb7406e5f0 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (7s) 3s ago 16m 16.2M - 0.25.0 c8568f914cd2 f7b7bdd9149c 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (60s) 3s ago 17m 8338k - 19.1.1-330-gc2ddf972 ebb0615149de 3c6511ea7af3 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (54s) 35s ago 16m 7936k - 19.1.1-330-gc2ddf972 ebb0615149de 70186c450006 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (5m) 3s ago 17m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (5m) 35s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (15m) 3s ago 16m 85.8M - 9.4.7 954c08fa6188 14ff35e2bcd0 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (2m) 3s ago 11m 84.9M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (2m) 3s ago 11m 88.8M - 19.1.1-330-gc2ddf972 ebb0615149de b2b1fe41a30f 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (75s) 35s ago 11m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 22146925e364 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (98s) 35s ago 11m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 031fc3939184 2024-09-17T01:16:03.337 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (8m) 3s ago 18m 511M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (7m) 35s ago 16m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (6m) 3s ago 18m 57.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (6m) 35s ago 15m 43.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (41s) 3s ago 17m 13.1M - 1.5.0 0da6a335fe13 64ef00b7cfde 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (37s) 35s ago 16m 3594k - 1.5.0 0da6a335fe13 15da54842e59 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (5m) 3s ago 15m 111M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (4m) 3s ago 14m 151M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (4m) 3s ago 14m 169M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (3m) 35s ago 13m 146M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (3m) 35s ago 13m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (2m) 35s ago 13m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:16:03.338 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (22s) 3s ago 16m 53.0M - 2.43.0 a07b618ecd1d 2ec6d46d8be5 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbb7406e5f0 msgr2=0x7fbb74070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbb7406e5f0 0x7fbb74070ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c196b40 tx=0x7fbb8000a2d0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 msgr2=0x7fbb8c195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c195620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c02a9c0 tx=0x7fbb7c005610 comp rx=0 tx=0).stop 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 shutdown_connections 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbb7406e5f0 0x7fbb74070ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb8c0ffc30 0x7fbb8c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 --2- 172.21.15.103:0/575572052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb8c0fea30 0x7fbb8c195620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 >> 172.21.15.103:0/575572052 conn(0x7fbb8c0fa1c0 msgr2=0x7fbb8c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 shutdown_connections 2024-09-17T01:16:03.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.341+0000 7fbb9284a640 1 -- 172.21.15.103:0/575572052 wait complete. 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.424+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3316628425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c4102ef0 msgr2=0x7fd2c41052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.424+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3316628425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c4102ef0 0x7fd2c41052e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80098b0 tx=0x7fd2b802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3316628425 shutdown_connections 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3316628425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c4102ef0 0x7fd2c41052e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3316628425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2c41005c0 0x7fd2c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3316628425 >> 172.21.15.103:0/3316628425 conn(0x7fd2c40fa1c0 msgr2=0x7fd2c40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3316628425 shutdown_connections 2024-09-17T01:16:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3316628425 wait complete. 2024-09-17T01:16:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 Processor -- start 2024-09-17T01:16:03.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.425+0000 7fd2ca72c640 1 -- start start 2024-09-17T01:16:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2ca72c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 0x7fd2c41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2ca72c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2c4102ef0 0x7fd2c4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2ca72c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c41983c0 con 0x7fd2c41005c0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2ca72c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4198530 con 0x7fd2c4102ef0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 0x7fd2c41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 0x7fd2c41978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43684/0 (socket says 172.21.15.103:43684) 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 -- 172.21.15.103:0/3542240504 learned_addr learned my addr 172.21.15.103:0/3542240504 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c37fe640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2c4102ef0 0x7fd2c4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 -- 172.21.15.103:0/3542240504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2c4102ef0 msgr2=0x7fd2c4197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2c4102ef0 0x7fd2c4197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 -- 172.21.15.103:0/3542240504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8009560 con 0x7fd2c41005c0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c3fff640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 0x7fd2c41978b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400e9a0 tx=0x7fd2b400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b400cd50 con 0x7fd2c41005c0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.426+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2b400ceb0 con 0x7fd2c41005c0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.427+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c419cfd0 con 0x7fd2c41005c0 2024-09-17T01:16:03.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.427+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b4010660 con 0x7fd2c41005c0 2024-09-17T01:16:03.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.427+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c419d510 con 0x7fd2c41005c0 2024-09-17T01:16:03.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.428+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c41009a0 con 0x7fd2c41005c0 2024-09-17T01:16:03.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.428+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd2b40048a0 con 0x7fd2c41005c0 2024-09-17T01:16:03.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.429+0000 7fd2c17fa640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2ac06e5f0 0x7fd2ac070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.429+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fd2b4014070 con 0x7fd2c41005c0 2024-09-17T01:16:03.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.429+0000 7fd2c37fe640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2ac06e5f0 0x7fd2ac070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.430+0000 7fd2c37fe640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2ac06e5f0 0x7fd2ac070ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009880 tx=0x7fd2b80314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:03.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.433+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd2b405b830 con 0x7fd2c41005c0 2024-09-17T01:16:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.682+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2c41089c0 con 0x7fd2c41005c0 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.683+0000 7fd2c17fa640 1 -- 172.21.15.103:0/3542240504 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd2b405b3c0 con 0x7fd2c41005c0 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:16:03.681 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:16:03.682 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2ac06e5f0 msgr2=0x7fd2ac070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2ac06e5f0 0x7fd2ac070ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009880 tx=0x7fd2b80314e0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 msgr2=0x7fd2c41978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 0x7fd2c41978b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400e9a0 tx=0x7fd2b400eda0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 shutdown_connections 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd2ac06e5f0 0x7fd2ac070ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2c4102ef0 0x7fd2c4197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 --2- 172.21.15.103:0/3542240504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c41005c0 0x7fd2c41978b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 >> 172.21.15.103:0/3542240504 conn(0x7fd2c40fa1c0 msgr2=0x7fd2c40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 shutdown_connections 2024-09-17T01:16:03.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.685+0000 7fd2ca72c640 1 -- 172.21.15.103:0/3542240504 wait complete. 2024-09-17T01:16:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 -- 172.21.15.103:0/2558315397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e900fde40 msgr2=0x7f8e900fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/2558315397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e900fde40 0x7f8e900fe240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009880 tx=0x7f8e8c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 -- 172.21.15.103:0/2558315397 shutdown_connections 2024-09-17T01:16:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/2558315397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e90100e20 0x7f8e901012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/2558315397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e900fde40 0x7f8e900fe240 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 -- 172.21.15.103:0/2558315397 >> 172.21.15.103:0/2558315397 conn(0x7f8e900f99b0 msgr2=0x7f8e900fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 -- 172.21.15.103:0/2558315397 shutdown_connections 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.768+0000 7f8e97cf3640 1 -- 172.21.15.103:0/2558315397 wait complete. 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e97cf3640 1 Processor -- start 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e97cf3640 1 -- start start 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e97cf3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e900fde40 0x7f8e90197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e97cf3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 0x7f8e90197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e97cf3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90198450 con 0x7f8e90100e20 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e97cf3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e901985c0 con 0x7f8e900fde40 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e9528e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 0x7f8e90197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e9528e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 0x7f8e90197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43710/0 (socket says 172.21.15.103:43710) 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e9528e640 1 -- 172.21.15.103:0/677506829 learned_addr learned my addr 172.21.15.103:0/677506829 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.769+0000 7f8e95a8f640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e900fde40 0x7f8e90197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e9528e640 1 -- 172.21.15.103:0/677506829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e900fde40 msgr2=0x7f8e90197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e9528e640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e900fde40 0x7f8e90197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e9528e640 1 -- 172.21.15.103:0/677506829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009560 con 0x7f8e90100e20 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e9528e640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 0x7f8e90197e80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000b450 tx=0x7f8e8000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e80011860 con 0x7f8e90100e20 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e80011e80 con 0x7f8e90100e20 2024-09-17T01:16:03.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9019d060 con 0x7f8e90100e20 2024-09-17T01:16:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9019d630 con 0x7f8e90100e20 2024-09-17T01:16:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.770+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8000f570 con 0x7f8e90100e20 2024-09-17T01:16:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.771+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e90104e70 con 0x7f8e90100e20 2024-09-17T01:16:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.772+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8e800103e0 con 0x7f8e90100e20 2024-09-17T01:16:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.772+0000 7f8e86ffd640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e7c06e5f0 0x7f8e7c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.772+0000 7f8e95a8f640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e7c06e5f0 0x7f8e7c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.772+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f8e8008e620 con 0x7f8e90100e20 2024-09-17T01:16:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.773+0000 7f8e95a8f640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e7c06e5f0 0x7f8e7c070ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009230 tx=0x7f8e8c0314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.777+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8e80057620 con 0x7f8e90100e20 2024-09-17T01:16:03.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.981+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e901087e0 con 0x7f8e90100e20 2024-09-17T01:16:03.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.982+0000 7f8e86ffd640 1 -- 172.21.15.103:0/677506829 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+2009 (secure 0 0 0) 0x7f8e8005ace0 con 0x7f8e90100e20 2024-09-17T01:16:03.980 INFO:teuthology.orchestra.run.smithi103.stdout:e37 2024-09-17T01:16:03.980 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-17T01:14:55:014839+0000 2024-09-17T01:16:03.980 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 37 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:14:55.014828+0000 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:16:03.981 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 94 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=34380} 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:16:03.982 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 34380 members: 34380 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:34380} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:34412} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:16:03.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:16:03.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6824/1792149992,v1:172.21.15.143:6825/1792149992] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:16:03.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2562780354,v1:172.21.15.143:6827/2562780354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:16:03.984 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 37 2024-09-17T01:16:03.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e7c06e5f0 msgr2=0x7f8e7c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e7c06e5f0 0x7f8e7c070ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009230 tx=0x7f8e8c0314e0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 msgr2=0x7f8e90197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 0x7f8e90197e80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000b450 tx=0x7f8e8000b910 comp rx=0 tx=0).stop 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 shutdown_connections 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e7c06e5f0 0x7f8e7c070ab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e90100e20 0x7f8e90197e80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 --2- 172.21.15.103:0/677506829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e900fde40 0x7f8e90197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 >> 172.21.15.103:0/677506829 conn(0x7f8e900f99b0 msgr2=0x7f8e90102040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 shutdown_connections 2024-09-17T01:16:03.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:03.984+0000 7f8e97cf3640 1 -- 172.21.15.103:0/677506829 wait complete. 2024-09-17T01:16:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 -- 172.21.15.103:0/2933560391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 msgr2=0x7fd924100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 --2- 172.21.15.103:0/2933560391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd924100100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd918009880 tx=0x7fd91802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 -- 172.21.15.103:0/2933560391 shutdown_connections 2024-09-17T01:16:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 --2- 172.21.15.103:0/2933560391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd924100100 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 --2- 172.21.15.103:0/2933560391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9240fea80 0x7fd9240fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 -- 172.21.15.103:0/2933560391 >> 172.21.15.103:0/2933560391 conn(0x7fd9240fa230 msgr2=0x7fd9240fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:04.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 -- 172.21.15.103:0/2933560391 shutdown_connections 2024-09-17T01:16:04.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.067+0000 7fd929023640 1 -- 172.21.15.103:0/2933560391 wait complete. 2024-09-17T01:16:04.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd929023640 1 Processor -- start 2024-09-17T01:16:04.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd929023640 1 -- start start 2024-09-17T01:16:04.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd929023640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9240fea80 0x7fd924068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:04.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd929023640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd92419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:04.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd929023640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92419a900 con 0x7fd9240ffc80 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd929023640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92419aa40 con 0x7fd9240fea80 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd92259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd92419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd92259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd92419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43730/0 (socket says 172.21.15.103:43730) 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd92259c640 1 -- 172.21.15.103:0/932852634 learned_addr learned my addr 172.21.15.103:0/932852634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd922d9d640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9240fea80 0x7fd924068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd92259c640 1 -- 172.21.15.103:0/932852634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9240fea80 msgr2=0x7fd924068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd92259c640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9240fea80 0x7fd924068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.068+0000 7fd92259c640 1 -- 172.21.15.103:0/932852634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918009560 con 0x7fd9240ffc80 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.069+0000 7fd92259c640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd92419a330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9180054f0 tx=0x7fd918005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.069+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd918004aa0 con 0x7fd9240ffc80 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.069+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92419ac90 con 0x7fd9240ffc80 2024-09-17T01:16:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.069+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd918004c00 con 0x7fd9240ffc80 2024-09-17T01:16:04.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.069+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd918003ac0 con 0x7fd9240ffc80 2024-09-17T01:16:04.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.069+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92419b200 con 0x7fd9240ffc80 2024-09-17T01:16:04.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.070+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92418e600 con 0x7fd9240ffc80 2024-09-17T01:16:04.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.070+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd918031c70 con 0x7fd9240ffc80 2024-09-17T01:16:04.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.071+0000 7fd90bfff640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd90c06e5f0 0x7fd90c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:04.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.071+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fd9180afb30 con 0x7fd9240ffc80 2024-09-17T01:16:04.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.071+0000 7fd922d9d640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd90c06e5f0 0x7fd90c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:04.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.071+0000 7fd922d9d640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd90c06e5f0 0x7fd90c070ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd914005fd0 tx=0x7fd914005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:04.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.075+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd918078ab0 con 0x7fd9240ffc80 2024-09-17T01:16:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.270+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd92402c4f0 con 0x7fd90c06e5f0 2024-09-17T01:16:04.268 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:04 smithi103 ceph-mon[92733]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:04.268 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:04 smithi103 ceph-mon[92733]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:04.268 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:04 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3542240504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:04.268 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:04 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/677506829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.271+0000 7fd90bfff640 1 -- 172.21.15.103:0/932852634 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fd92402c4f0 con 0x7fd90c06e5f0 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": true, 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [ 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-17T01:16:04.269 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr", 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "mds", 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph-exporter", 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "osd", 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "mon" 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:16:04.270 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:16:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd90c06e5f0 msgr2=0x7fd90c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd90c06e5f0 0x7fd90c070ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd914005fd0 tx=0x7fd914005850 comp rx=0 tx=0).stop 2024-09-17T01:16:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 msgr2=0x7fd92419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd92419a330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9180054f0 tx=0x7fd918005520 comp rx=0 tx=0).stop 2024-09-17T01:16:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 shutdown_connections 2024-09-17T01:16:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd90c06e5f0 0x7fd90c070ab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9240ffc80 0x7fd92419a330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 --2- 172.21.15.103:0/932852634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9240fea80 0x7fd924068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 >> 172.21.15.103:0/932852634 conn(0x7fd9240fa230 msgr2=0x7fd924103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 shutdown_connections 2024-09-17T01:16:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.273+0000 7fd929023640 1 -- 172.21.15.103:0/932852634 wait complete. 2024-09-17T01:16:04.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1416266301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588100660 msgr2=0x7fd588102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1416266301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588100660 0x7fd588102a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd578009880 tx=0x7fd57802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1416266301 shutdown_connections 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1416266301 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588102f90 0x7fd588105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1416266301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588100660 0x7fd588102a50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1416266301 >> 172.21.15.103:0/1416266301 conn(0x7fd5880fa1c0 msgr2=0x7fd5880fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1416266301 shutdown_connections 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.359+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1416266301 wait complete. 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd58d4e3640 1 Processor -- start 2024-09-17T01:16:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd58d4e3640 1 -- start start 2024-09-17T01:16:04.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd58d4e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588100660 0x7fd5880fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd58d4e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 0x7fd5880fe610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd58d4e3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880feb50 con 0x7fd588102f90 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd58d4e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880fecc0 con 0x7fd588100660 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd5867fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 0x7fd5880fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd5867fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 0x7fd5880fe610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43748/0 (socket says 172.21.15.103:43748) 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd5867fc640 1 -- 172.21.15.103:0/1987426524 learned_addr learned my addr 172.21.15.103:0/1987426524 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd586ffd640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588100660 0x7fd5880fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd5867fc640 1 -- 172.21.15.103:0/1987426524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588100660 msgr2=0x7fd5880fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd5867fc640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588100660 0x7fd5880fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.360+0000 7fd5867fc640 1 -- 172.21.15.103:0/1987426524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578009560 con 0x7fd588102f90 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd586ffd640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588100660 0x7fd5880fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:16:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd5867fc640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 0x7fd5880fe610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b3d0 tx=0x7fd57c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd57c011800 con 0x7fd588102f90 2024-09-17T01:16:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd57c011e20 con 0x7fd588102f90 2024-09-17T01:16:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5880fefa0 con 0x7fd588102f90 2024-09-17T01:16:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd57c00f2e0 con 0x7fd588102f90 2024-09-17T01:16:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.361+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58819d730 con 0x7fd588102f90 2024-09-17T01:16:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.362+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5881087b0 con 0x7fd588102f90 2024-09-17T01:16:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.363+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd57c00f600 con 0x7fd588102f90 2024-09-17T01:16:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.363+0000 7fd56ffff640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd57006e5f0 0x7fd570070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.363+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fd57c08e560 con 0x7fd588102f90 2024-09-17T01:16:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.363+0000 7fd586ffd640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd57006e5f0 0x7fd570070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.364+0000 7fd586ffd640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd57006e5f0 0x7fd570070ab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd5780314e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:04.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.368+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd57c057550 con 0x7fd588102f90 2024-09-17T01:16:04.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:04 smithi143 ceph-mon[80685]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:04.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:04 smithi143 ceph-mon[80685]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:04.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:04 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3542240504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:04.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:04 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/677506829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:16:04.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.625+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd58819daa0 con 0x7fd588102f90 2024-09-17T01:16:04.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.625+0000 7fd56ffff640 1 -- 172.21.15.103:0/1987426524 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd57c05ac10 con 0x7fd588102f90 2024-09-17T01:16:04.623 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:16:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.628+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd57006e5f0 msgr2=0x7fd570070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.628+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd57006e5f0 0x7fd570070ab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd5780314e0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.628+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 msgr2=0x7fd5880fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.628+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 0x7fd5880fe610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b3d0 tx=0x7fd57c00b890 comp rx=0 tx=0).stop 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 shutdown_connections 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fd57006e5f0 0x7fd570070ab0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd588102f90 0x7fd5880fe610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 --2- 172.21.15.103:0/1987426524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd588100660 0x7fd5880fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 >> 172.21.15.103:0/1987426524 conn(0x7fd5880fa1c0 msgr2=0x7fd5880fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 shutdown_connections 2024-09-17T01:16:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:04.629+0000 7fd58d4e3640 1 -- 172.21.15.103:0/1987426524 wait complete. 2024-09-17T01:16:05.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:05.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: pgmap v252: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.178 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.179 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:05 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1987426524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:05.498 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:05.498 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: pgmap v252: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:05.498 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.499 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:05.500 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:05 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1987426524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:06.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:06 smithi103 ceph-mon[92733]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:06.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:06 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:16:06.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:06 smithi143 ceph-mon[80685]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:06.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:06 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:16:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:07 smithi103 ceph-mon[92733]: Upgrade: Updating grafana.smithi103 2024-09-17T01:16:07.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:07 smithi103 ceph-mon[92733]: Deploying daemon grafana.smithi103 on smithi103 2024-09-17T01:16:07.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:07 smithi103 ceph-mon[92733]: pgmap v253: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:07 smithi143 ceph-mon[80685]: Upgrade: Updating grafana.smithi103 2024-09-17T01:16:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:07 smithi143 ceph-mon[80685]: Deploying daemon grafana.smithi103 on smithi103 2024-09-17T01:16:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:07 smithi143 ceph-mon[80685]: pgmap v253: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:09.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:09 smithi103 ceph-mon[92733]: pgmap v254: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:09 smithi143 ceph-mon[80685]: pgmap v254: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:11 smithi103 ceph-mon[92733]: pgmap v255: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:11 smithi143 ceph-mon[80685]: pgmap v255: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:12.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:12 smithi103 ceph-mon[92733]: pgmap v256: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:12.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:12 smithi143 ceph-mon[80685]: pgmap v256: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:15.114 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:14 smithi103 ceph-mon[92733]: pgmap v257: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:15.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:14 smithi143 ceph-mon[80685]: pgmap v257: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:17.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:16 smithi103 ceph-mon[92733]: pgmap v258: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:16 smithi143 ceph-mon[80685]: pgmap v258: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:18.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:18.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:18.757 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:18.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:18.758 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:18 smithi143 ceph-mon[80685]: pgmap v259: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:18.816 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:18.816 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:18.816 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:18.816 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:18.816 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:18 smithi103 ceph-mon[92733]: pgmap v259: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:21.007 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:20 smithi143 ceph-mon[80685]: pgmap v260: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:21.379 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:20 smithi103 ceph-mon[92733]: pgmap v260: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:23.326 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:23 smithi103 ceph-mon[92733]: pgmap v261: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:23.326 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.326 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.326 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.326 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:23 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:23 smithi143 ceph-mon[80685]: pgmap v261: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:23.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:23 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:25.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:25 smithi103 ceph-mon[92733]: pgmap v262: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:25 smithi143 ceph-mon[80685]: pgmap v262: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:27.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:27 smithi103 ceph-mon[92733]: pgmap v263: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:27 smithi143 ceph-mon[80685]: pgmap v263: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: pgmap v264: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.429 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T01:16:29.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T01:16:29.431 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:16:29.432 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:29 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: pgmap v264: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.509 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T01:16:29.510 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:16:29.511 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:16:29.512 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:29 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: Upgrade: Finalizing container_image settings 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: Upgrade: Complete! 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:30.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:30.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:16:30.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: Upgrade: Finalizing container_image settings 2024-09-17T01:16:30.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: Upgrade: Complete! 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:30.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:31.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:31 smithi143 ceph-mon[80685]: pgmap v265: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:31.321 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:31 smithi103 ceph-mon[92733]: pgmap v265: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:33 smithi103 ceph-mon[92733]: pgmap v266: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:33 smithi143 ceph-mon[80685]: pgmap v266: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 -- 172.21.15.103:0/558466120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 msgr2=0x7f40980ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 --2- 172.21.15.103:0/558466120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f40980ffda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4094009880 tx=0x7f409402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 -- 172.21.15.103:0/558466120 shutdown_connections 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 --2- 172.21.15.103:0/558466120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4098100ba0 0x7f4098101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 --2- 172.21.15.103:0/558466120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f40980ffda0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 -- 172.21.15.103:0/558466120 >> 172.21.15.103:0/558466120 conn(0x7f40980fb150 msgr2=0x7f40980fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 -- 172.21.15.103:0/558466120 shutdown_connections 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 -- 172.21.15.103:0/558466120 wait complete. 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 Processor -- start 2024-09-17T01:16:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.724+0000 7f409f3a1640 1 -- start start 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409f3a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f4098195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409f3a1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4098100ba0 0x7f40981959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409f3a1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4098195f80 con 0x7f40980ff9a0 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409f3a1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981960f0 con 0x7f4098100ba0 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f4098195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f4098195470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47070/0 (socket says 172.21.15.103:47070) 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 -- 172.21.15.103:0/56692383 learned_addr learned my addr 172.21.15.103:0/56692383 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409db9e640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4098100ba0 0x7f40981959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 -- 172.21.15.103:0/56692383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4098100ba0 msgr2=0x7f40981959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4098100ba0 0x7f40981959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 -- 172.21.15.103:0/56692383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094009560 con 0x7f40980ff9a0 2024-09-17T01:16:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f409e39f640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f4098195470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40940054f0 tx=0x7f4094005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.725+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4094004aa0 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.726+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4094004c00 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.726+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409819ab30 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.726+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4094003ac0 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.726+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409819b020 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.727+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40981085b0 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.727+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4094003d30 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.728+0000 7f408f7fe640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f408406e5f0 0x7f4084070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.728+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f40940af930 con 0x7f40980ff9a0 2024-09-17T01:16:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.728+0000 7f409db9e640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f408406e5f0 0x7f4084070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.728+0000 7f409db9e640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f408406e5f0 0x7f4084070ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4098196990 tx=0x7f408800b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:34.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.732+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f40940789e0 con 0x7f40980ff9a0 2024-09-17T01:16:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.916+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40981054f0 con 0x7f408406e5f0 2024-09-17T01:16:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.917+0000 7f408f7fe640 1 -- 172.21.15.103:0/56692383 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f40981054f0 con 0x7f408406e5f0 2024-09-17T01:16:34.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f408406e5f0 msgr2=0x7f4084070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f408406e5f0 0x7f4084070ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4098196990 tx=0x7f408800b390 comp rx=0 tx=0).stop 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 msgr2=0x7f4098195470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f4098195470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40940054f0 tx=0x7f4094005520 comp rx=0 tx=0).stop 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 shutdown_connections 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f408406e5f0 0x7f4084070ab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4098100ba0 0x7f40981959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 --2- 172.21.15.103:0/56692383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40980ff9a0 0x7f4098195470 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 >> 172.21.15.103:0/56692383 conn(0x7f40980fb150 msgr2=0x7f4098103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 shutdown_connections 2024-09-17T01:16:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:34.919+0000 7f409f3a1640 1 -- 172.21.15.103:0/56692383 wait complete. 2024-09-17T01:16:35.433 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:35 smithi103 ceph-mon[92733]: pgmap v267: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:35.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:35 smithi143 ceph-mon[80685]: pgmap v267: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:35.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:16:35.916 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:16:36.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:36 smithi143 ceph-mon[80685]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:36.307 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:36 smithi103 ceph-mon[92733]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:37.305 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:37 smithi103 ceph-mon[92733]: pgmap v268: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:37 smithi143 ceph-mon[80685]: pgmap v268: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 -- 172.21.15.103:0/2575430086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 msgr2=0x7f1c64104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2575430086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c64104e00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009880 tx=0x7f1c5402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 -- 172.21.15.103:0/2575430086 shutdown_connections 2024-09-17T01:16:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2575430086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c640fea20 0x7f1c640fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2575430086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c64104e00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 -- 172.21.15.103:0/2575430086 >> 172.21.15.103:0/2575430086 conn(0x7f1c640fa720 msgr2=0x7f1c640fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:37.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 -- 172.21.15.103:0/2575430086 shutdown_connections 2024-09-17T01:16:37.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.520+0000 7f1c699ed640 1 -- 172.21.15.103:0/2575430086 wait complete. 2024-09-17T01:16:37.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c699ed640 1 Processor -- start 2024-09-17T01:16:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c699ed640 1 -- start start 2024-09-17T01:16:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c699ed640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c640fea20 0x7f1c6419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c699ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c6419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c699ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6419c390 con 0x7f1c64104a20 2024-09-17T01:16:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c699ed640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64195920 con 0x7f1c640fea20 2024-09-17T01:16:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.521+0000 7f1c627fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c6419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c627fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c6419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47092/0 (socket says 172.21.15.103:47092) 2024-09-17T01:16:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c627fc640 1 -- 172.21.15.103:0/2935092414 learned_addr learned my addr 172.21.15.103:0/2935092414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c62ffd640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c640fea20 0x7f1c6419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c627fc640 1 -- 172.21.15.103:0/2935092414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c640fea20 msgr2=0x7f1c6419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c627fc640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c640fea20 0x7f1c6419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c627fc640 1 -- 172.21.15.103:0/2935092414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009560 con 0x7f1c64104a20 2024-09-17T01:16:37.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c627fc640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c6419bd70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800d6f0 tx=0x7f1c5800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:37.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c58009a30 con 0x7f1c64104a20 2024-09-17T01:16:37.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64195c00 con 0x7f1c64104a20 2024-09-17T01:16:37.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c580054e0 con 0x7f1c64104a20 2024-09-17T01:16:37.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c58010460 con 0x7f1c64104a20 2024-09-17T01:16:37.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.522+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c64196150 con 0x7f1c64104a20 2024-09-17T01:16:37.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.523+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c64100160 con 0x7f1c64104a20 2024-09-17T01:16:37.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.524+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1c58009b90 con 0x7f1c64104a20 2024-09-17T01:16:37.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.524+0000 7f1c689eb640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c4c06e5f0 0x7f1c4c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:37.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.524+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f1c5808e440 con 0x7f1c64104a20 2024-09-17T01:16:37.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.524+0000 7f1c62ffd640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c4c06e5f0 0x7f1c4c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:37.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.525+0000 7f1c62ffd640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c4c06e5f0 0x7f1c4c070ab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c54000c00 tx=0x7f1c54005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:37.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.529+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c580573c0 con 0x7f1c64104a20 2024-09-17T01:16:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.704+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c64108010 con 0x7f1c4c06e5f0 2024-09-17T01:16:37.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.713+0000 7f1c689eb640 1 -- 172.21.15.103:0/2935092414 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1c64108010 con 0x7f1c4c06e5f0 2024-09-17T01:16:37.712 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:16:37.712 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (42s) 15s ago 17m 16.3M - 0.25.0 c8568f914cd2 f7b7bdd9149c 2024-09-17T01:16:37.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (94s) 15s ago 17m 8380k - 19.1.1-330-gc2ddf972 ebb0615149de 3c6511ea7af3 2024-09-17T01:16:37.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (88s) 69s ago 16m 7936k - 19.1.1-330-gc2ddf972 ebb0615149de 70186c450006 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (6m) 15s ago 17m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (6m) 69s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (20s) 15s ago 17m 45.6M - 9.4.12 2bacad6d85d8 2773fa7669ae 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (2m) 15s ago 12m 84.9M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (2m) 15s ago 12m 88.4M - 19.1.1-330-gc2ddf972 ebb0615149de b2b1fe41a30f 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (110s) 69s ago 12m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 22146925e364 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (2m) 69s ago 12m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 031fc3939184 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (8m) 15s ago 18m 518M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (7m) 69s ago 16m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (7m) 15s ago 19m 56.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (7m) 69s ago 16m 43.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (76s) 15s ago 17m 15.5M - 1.5.0 0da6a335fe13 64ef00b7cfde 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (72s) 69s ago 16m 3594k - 1.5.0 0da6a335fe13 15da54842e59 2024-09-17T01:16:37.713 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (6m) 15s ago 15m 110M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (5m) 15s ago 15m 151M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (4m) 15s ago 14m 168M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (4m) 69s ago 14m 146M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (3m) 69s ago 14m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (3m) 69s ago 13m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (57s) 15s ago 17m 53.4M - 2.43.0 a07b618ecd1d 2ec6d46d8be5 2024-09-17T01:16:37.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c4c06e5f0 msgr2=0x7f1c4c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c4c06e5f0 0x7f1c4c070ab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c54000c00 tx=0x7f1c54005a20 comp rx=0 tx=0).stop 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 msgr2=0x7f1c6419bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c6419bd70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800d6f0 tx=0x7f1c5800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 shutdown_connections 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1c4c06e5f0 0x7f1c4c070ab0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c64104a20 0x7f1c6419bd70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 --2- 172.21.15.103:0/2935092414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c640fea20 0x7f1c6419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 >> 172.21.15.103:0/2935092414 conn(0x7f1c640fa720 msgr2=0x7f1c640688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 shutdown_connections 2024-09-17T01:16:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:37.715+0000 7f1c699ed640 1 -- 172.21.15.103:0/2935092414 wait complete. 2024-09-17T01:16:38.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade status' 2024-09-17T01:16:38.686 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:16:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:39 smithi103 ceph-mon[92733]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:39 smithi103 ceph-mon[92733]: pgmap v269: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:39 smithi143 ceph-mon[80685]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:39.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:39 smithi143 ceph-mon[80685]: pgmap v269: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.355+0000 7fb915179640 1 -- 172.21.15.103:0/2722463147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 msgr2=0x7fb910104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.355+0000 7fb915179640 1 --2- 172.21.15.103:0/2722463147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb910104df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009880 tx=0x7fb8f802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.355+0000 7fb915179640 1 -- 172.21.15.103:0/2722463147 shutdown_connections 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.355+0000 7fb915179640 1 --2- 172.21.15.103:0/2722463147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9100fea10 0x7fb9100fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.355+0000 7fb915179640 1 --2- 172.21.15.103:0/2722463147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb910104df0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.355+0000 7fb915179640 1 -- 172.21.15.103:0/2722463147 >> 172.21.15.103:0/2722463147 conn(0x7fb9100fa730 msgr2=0x7fb9100fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.356+0000 7fb915179640 1 -- 172.21.15.103:0/2722463147 shutdown_connections 2024-09-17T01:16:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.356+0000 7fb915179640 1 -- 172.21.15.103:0/2722463147 wait complete. 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.356+0000 7fb915179640 1 Processor -- start 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb915179640 1 -- start start 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb915179640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9100fea10 0x7fb91019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb915179640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb91019df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb915179640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91019e530 con 0x7fb910104a10 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb915179640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910197ac0 con 0x7fb9100fea10 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb91019df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb91019df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47122/0 (socket says 172.21.15.103:47122) 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 -- 172.21.15.103:0/2284497084 learned_addr learned my addr 172.21.15.103:0/2284497084 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90ed9d640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9100fea10 0x7fb91019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 -- 172.21.15.103:0/2284497084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9100fea10 msgr2=0x7fb91019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9100fea10 0x7fb91019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 -- 172.21.15.103:0/2284497084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8009560 con 0x7fb910104a10 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb90e59c640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb91019df10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c810 tx=0x7fb90000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.357+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9000041f0 con 0x7fb910104a10 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.358+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb910197da0 con 0x7fb910104a10 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.358+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb900007e70 con 0x7fb910104a10 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.358+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9000049d0 con 0x7fb910104a10 2024-09-17T01:16:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.358+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9101982f0 con 0x7fb910104a10 2024-09-17T01:16:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.359+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb910100150 con 0x7fb910104a10 2024-09-17T01:16:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.359+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb9000079b0 con 0x7fb910104a10 2024-09-17T01:16:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.360+0000 7fb907fff640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb8fc06e5f0 0x7fb8fc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.360+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fb90008e610 con 0x7fb910104a10 2024-09-17T01:16:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.360+0000 7fb90ed9d640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb8fc06e5f0 0x7fb8fc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.360+0000 7fb90ed9d640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb8fc06e5f0 0x7fb8fc070ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009230 tx=0x7fb8f80058d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.364+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb900057640 con 0x7fb910104a10 2024-09-17T01:16:40.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.547+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb91010bcf0 con 0x7fb8fc06e5f0 2024-09-17T01:16:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.548+0000 7fb907fff640 1 -- 172.21.15.103:0/2284497084 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fb91010bcf0 con 0x7fb8fc06e5f0 2024-09-17T01:16:40.547 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:16:40.547 INFO:teuthology.orchestra.run.smithi103.stdout: "target_image": null, 2024-09-17T01:16:40.547 INFO:teuthology.orchestra.run.smithi103.stdout: "in_progress": false, 2024-09-17T01:16:40.547 INFO:teuthology.orchestra.run.smithi103.stdout: "which": "", 2024-09-17T01:16:40.548 INFO:teuthology.orchestra.run.smithi103.stdout: "services_complete": [], 2024-09-17T01:16:40.548 INFO:teuthology.orchestra.run.smithi103.stdout: "progress": null, 2024-09-17T01:16:40.548 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-17T01:16:40.548 INFO:teuthology.orchestra.run.smithi103.stdout: "is_paused": false 2024-09-17T01:16:40.548 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:16:40.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb8fc06e5f0 msgr2=0x7fb8fc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:40.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb8fc06e5f0 0x7fb8fc070ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009230 tx=0x7fb8f80058d0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 msgr2=0x7fb91019df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:40.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb91019df10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c810 tx=0x7fb90000ccd0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 shutdown_connections 2024-09-17T01:16:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb8fc06e5f0 0x7fb8fc070ab0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb910104a10 0x7fb91019df10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 --2- 172.21.15.103:0/2284497084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb9100fea10 0x7fb91019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.550+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 >> 172.21.15.103:0/2284497084 conn(0x7fb9100fa730 msgr2=0x7fb9100687c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.551+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 shutdown_connections 2024-09-17T01:16:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:40.551+0000 7fb915179640 1 -- 172.21.15.103:0/2284497084 wait complete. 2024-09-17T01:16:41.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:41 smithi103 ceph-mon[92733]: pgmap v270: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:41.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph health detail' 2024-09-17T01:16:41.461 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:16:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:41 smithi143 ceph-mon[80685]: pgmap v270: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:42.379 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:42 smithi103 ceph-mon[92733]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:42.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:42 smithi143 ceph-mon[80685]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:43.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 -- 172.21.15.103:0/3289378305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 msgr2=0x7f2b14101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:43.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 --2- 172.21.15.103:0/3289378305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14101100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009880 tx=0x7f2b0402a530 comp rx=0 tx=0).stop 2024-09-17T01:16:43.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 -- 172.21.15.103:0/3289378305 shutdown_connections 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 --2- 172.21.15.103:0/3289378305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 0x7f2b14109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 --2- 172.21.15.103:0/3289378305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14101100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 -- 172.21.15.103:0/3289378305 >> 172.21.15.103:0/3289378305 conn(0x7f2b140758c0 msgr2=0x7f2b140fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 -- 172.21.15.103:0/3289378305 shutdown_connections 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.029+0000 7f2b1a740640 1 -- 172.21.15.103:0/3289378305 wait complete. 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b1a740640 1 Processor -- start 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b1a740640 1 -- start start 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b1a740640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b1a740640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 0x7f2b141982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b1a740640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b14198980 con 0x7f2b14100d20 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b1a740640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1419c6f0 con 0x7f2b14101640 2024-09-17T01:16:43.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51868/0 (socket says 172.21.15.103:51868) 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b13fff640 1 -- 172.21.15.103:0/938977238 learned_addr learned my addr 172.21.15.103:0/938977238 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b137fe640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 0x7f2b141982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b13fff640 1 -- 172.21.15.103:0/938977238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 msgr2=0x7f2b141982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b13fff640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 0x7f2b141982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b13fff640 1 -- 172.21.15.103:0/938977238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04009560 con 0x7f2b14100d20 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.030+0000 7f2b137fe640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 0x7f2b141982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.031+0000 7f2b13fff640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14197db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005ab0 tx=0x7f2b04032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.031+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b04005220 con 0x7f2b14100d20 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.031+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b04005380 con 0x7f2b14100d20 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.031+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1419c970 con 0x7f2b14100d20 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.031+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b04003a20 con 0x7f2b14100d20 2024-09-17T01:16:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.031+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1419ce60 con 0x7f2b14100d20 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.032+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b14068400 con 0x7f2b14100d20 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.033+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2b0402ad50 con 0x7f2b14100d20 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.033+0000 7f2b117fa640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2afc06e5f0 0x7f2afc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.033+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f2b040af2c0 con 0x7f2b14100d20 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.033+0000 7f2b137fe640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2afc06e5f0 0x7f2afc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.033+0000 7f2b137fe640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2afc06e5f0 0x7f2afc070ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b14199360 tx=0x7f2b08005d30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:43.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.037+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2b04078240 con 0x7f2b14100d20 2024-09-17T01:16:43.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.272+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2b14101100 con 0x7f2b14100d20 2024-09-17T01:16:43.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.273+0000 7f2b117fa640 1 -- 172.21.15.103:0/938977238 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2b0407b900 con 0x7f2b14100d20 2024-09-17T01:16:43.272 INFO:teuthology.orchestra.run.smithi103.stdout:HEALTH_OK 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.274+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2afc06e5f0 msgr2=0x7f2afc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.274+0000 7f2b1a740640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2afc06e5f0 0x7f2afc070ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b14199360 tx=0x7f2b08005d30 comp rx=0 tx=0).stop 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.274+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 msgr2=0x7f2b14197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.274+0000 7f2b1a740640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14197db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005ab0 tx=0x7f2b04032bd0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 shutdown_connections 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2afc06e5f0 0x7f2afc070ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b14101640 0x7f2b141982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 --2- 172.21.15.103:0/938977238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b14100d20 0x7f2b14197db0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:43.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 >> 172.21.15.103:0/938977238 conn(0x7f2b140758c0 msgr2=0x7f2b141000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:43.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 shutdown_connections 2024-09-17T01:16:43.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:43.275+0000 7f2b1a740640 1 -- 172.21.15.103:0/938977238 wait complete. 2024-09-17T01:16:43.283 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:43 smithi103 ceph-mon[92733]: pgmap v271: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:43 smithi143 ceph-mon[80685]: pgmap v271: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:44.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T01:16:44.244 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:16:44.365 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:44 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/938977238' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:44.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:44 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/938977238' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:45.386 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:45 smithi103 ceph-mon[92733]: pgmap v272: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:45 smithi143 ceph-mon[80685]: pgmap v272: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 -- 172.21.15.103:0/200576905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 msgr2=0x7f1e9c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 --2- 172.21.15.103:0/200576905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c104d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009880 tx=0x7f1e9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:16:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 -- 172.21.15.103:0/200576905 shutdown_connections 2024-09-17T01:16:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 --2- 172.21.15.103:0/200576905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e9c0fe9a0 0x7f1e9c0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 --2- 172.21.15.103:0/200576905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c104d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 -- 172.21.15.103:0/200576905 >> 172.21.15.103:0/200576905 conn(0x7f1e9c0758c0 msgr2=0x7f1e9c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:45.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 -- 172.21.15.103:0/200576905 shutdown_connections 2024-09-17T01:16:45.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.904+0000 7f1ea3299640 1 -- 172.21.15.103:0/200576905 wait complete. 2024-09-17T01:16:45.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea3299640 1 Processor -- start 2024-09-17T01:16:45.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea3299640 1 -- start start 2024-09-17T01:16:45.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea3299640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e9c0fe9a0 0x7f1e9c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:45.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea3299640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:45.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea3299640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c1973d0 con 0x7f1e9c1049a0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea3299640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c197540 con 0x7f1e9c0fe9a0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea0834640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea0834640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51882/0 (socket says 172.21.15.103:51882) 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea0834640 1 -- 172.21.15.103:0/2896811694 learned_addr learned my addr 172.21.15.103:0/2896811694 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea1035640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e9c0fe9a0 0x7f1e9c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea0834640 1 -- 172.21.15.103:0/2896811694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e9c0fe9a0 msgr2=0x7f1e9c196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea0834640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e9c0fe9a0 0x7f1e9c196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.905+0000 7f1ea0834640 1 -- 172.21.15.103:0/2896811694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009560 con 0x7f1e9c1049a0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.906+0000 7f1ea0834640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c196e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c8a0 tx=0x7f1e9800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.906+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e98007b80 con 0x7f1e9c1049a0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.906+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e98007ce0 con 0x7f1e9c1049a0 2024-09-17T01:16:45.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.906+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c19f9c0 con 0x7f1e9c1049a0 2024-09-17T01:16:45.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.906+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e98018810 con 0x7f1e9c1049a0 2024-09-17T01:16:45.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.906+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c19fd70 con 0x7f1e9c1049a0 2024-09-17T01:16:45.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.907+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c1000e0 con 0x7f1e9c1049a0 2024-09-17T01:16:45.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.907+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1e98018a80 con 0x7f1e9c1049a0 2024-09-17T01:16:45.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.908+0000 7f1e8e7fc640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1e8806e5f0 0x7f1e88070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:16:45.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.908+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f1e9808eae0 con 0x7f1e9c1049a0 2024-09-17T01:16:45.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.908+0000 7f1ea1035640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1e8806e5f0 0x7f1e88070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:16:45.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.909+0000 7f1ea1035640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1e8806e5f0 0x7f1e88070ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000c00 tx=0x7f1e90005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:16:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:45.912+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e98057b10 con 0x7f1e9c1049a0 2024-09-17T01:16:46.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.146+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e9c101bb0 con 0x7f1e9c1049a0 2024-09-17T01:16:46.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.146+0000 7f1e8e7fc640 1 -- 172.21.15.103:0/2896811694 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f1e9805b1d0 con 0x7f1e9c1049a0 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:16:46.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:16:46.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1e8806e5f0 msgr2=0x7f1e88070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1e8806e5f0 0x7f1e88070ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000c00 tx=0x7f1e90005a20 comp rx=0 tx=0).stop 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 msgr2=0x7f1e9c196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c196e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c8a0 tx=0x7f1e9800cd60 comp rx=0 tx=0).stop 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 shutdown_connections 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f1e8806e5f0 0x7f1e88070ab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c1049a0 0x7f1e9c196e90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 --2- 172.21.15.103:0/2896811694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e9c0fe9a0 0x7f1e9c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 >> 172.21.15.103:0/2896811694 conn(0x7f1e9c0758c0 msgr2=0x7f1e9c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 shutdown_connections 2024-09-17T01:16:46.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:16:46.148+0000 7f1ea3299640 1 -- 172.21.15.103:0/2896811694 wait complete. 2024-09-17T01:16:46.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T01:16:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:16:47.352 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:47 smithi103 ceph-mon[92733]: pgmap v273: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:47.352 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:47 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2896811694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:47 smithi143 ceph-mon[80685]: pgmap v273: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:47 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2896811694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:48.398 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:48.640 INFO:teuthology.orchestra.run.smithi103.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T01:16:49.262 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:49 smithi103 ceph-mon[92733]: pgmap v274: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:49.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'sleep 60' 2024-09-17T01:16:49.487 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:16:49.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:49 smithi143 ceph-mon[80685]: pgmap v274: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:51.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:51 smithi103 ceph-mon[92733]: pgmap v275: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:51.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:51 smithi143 ceph-mon[80685]: pgmap v275: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:53.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:53 smithi103 ceph-mon[92733]: pgmap v276: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:53 smithi143 ceph-mon[80685]: pgmap v276: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:54.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:54 smithi103 ceph-mon[92733]: pgmap v277: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:54.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:54 smithi143 ceph-mon[80685]: pgmap v277: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:16:57.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:56 smithi103 ceph-mon[92733]: pgmap v278: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:57.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:56 smithi143 ceph-mon[80685]: pgmap v278: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:16:59.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:16:58 smithi143 ceph-mon[80685]: pgmap v279: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:16:59.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:16:58 smithi103 ceph-mon[92733]: pgmap v279: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:01.229 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:00 smithi103 ceph-mon[92733]: pgmap v280: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:01.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:00 smithi143 ceph-mon[80685]: pgmap v280: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:02 smithi143 ceph-mon[80685]: pgmap v281: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:02 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:02 smithi103 ceph-mon[92733]: pgmap v281: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:02 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:05.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:04 smithi143 ceph-mon[80685]: pgmap v282: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:05.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:04 smithi103 ceph-mon[92733]: pgmap v282: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:07.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:06 smithi143 ceph-mon[80685]: pgmap v283: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:07.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:06 smithi103 ceph-mon[92733]: pgmap v283: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:09.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:08 smithi143 ceph-mon[80685]: pgmap v284: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:08 smithi103 ceph-mon[92733]: pgmap v284: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:11.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:10 smithi143 ceph-mon[80685]: pgmap v285: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:11.279 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:10 smithi103 ceph-mon[92733]: pgmap v285: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:13.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:12 smithi143 ceph-mon[80685]: pgmap v286: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:13.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:12 smithi103 ceph-mon[92733]: pgmap v286: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:15.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:14 smithi143 ceph-mon[80685]: pgmap v287: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:14 smithi103 ceph-mon[92733]: pgmap v287: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:17.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:17 smithi143 ceph-mon[80685]: pgmap v288: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:17.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:17 smithi103 ceph-mon[92733]: pgmap v288: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:18.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:18.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:19.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:19 smithi143 ceph-mon[80685]: pgmap v289: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:19.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:19 smithi103 ceph-mon[92733]: pgmap v289: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:21 smithi103 ceph-mon[92733]: pgmap v290: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:21 smithi143 ceph-mon[80685]: pgmap v290: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:23 smithi103 ceph-mon[92733]: pgmap v291: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:23 smithi143 ceph-mon[80685]: pgmap v291: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:25.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:25 smithi103 ceph-mon[92733]: pgmap v292: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:25 smithi143 ceph-mon[80685]: pgmap v292: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:27.372 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:27 smithi103 ceph-mon[92733]: pgmap v293: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:27 smithi143 ceph-mon[80685]: pgmap v293: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:29.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:29 smithi103 ceph-mon[92733]: pgmap v294: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:29 smithi143 ceph-mon[80685]: pgmap v294: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:30.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:30 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:17:30.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:30 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:17:31.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:31 smithi103 ceph-mon[92733]: pgmap v295: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:31.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:17:31.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:17:31.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:17:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:31 smithi143 ceph-mon[80685]: pgmap v295: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:17:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:17:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:17:33.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:33 smithi103 ceph-mon[92733]: pgmap v296: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:33 smithi143 ceph-mon[80685]: pgmap v296: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:35.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:35 smithi103 ceph-mon[92733]: pgmap v297: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:35 smithi143 ceph-mon[80685]: pgmap v297: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:37.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:37 smithi143 ceph-mon[80685]: pgmap v298: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:37.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:37 smithi103 ceph-mon[92733]: pgmap v298: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:39.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:39 smithi103 ceph-mon[92733]: pgmap v299: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:39 smithi143 ceph-mon[80685]: pgmap v299: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:41.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:41 smithi103 ceph-mon[92733]: pgmap v300: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:41 smithi143 ceph-mon[80685]: pgmap v300: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:43.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:43 smithi103 ceph-mon[92733]: pgmap v301: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:43 smithi143 ceph-mon[80685]: pgmap v301: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:45.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:45 smithi103 ceph-mon[92733]: pgmap v302: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:45 smithi143 ceph-mon[80685]: pgmap v302: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:47.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:47 smithi103 ceph-mon[92733]: pgmap v303: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:47 smithi143 ceph-mon[80685]: pgmap v303: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:48.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:49.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:49 smithi103 ceph-mon[92733]: pgmap v304: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:49.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:49 smithi143 ceph-mon[80685]: pgmap v304: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:51.319 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:51 smithi103 ceph-mon[92733]: pgmap v305: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:51.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:51 smithi143 ceph-mon[80685]: pgmap v305: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:51.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:17:51.944 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:17:53.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:53 smithi103 ceph-mon[92733]: pgmap v306: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:53 smithi143 ceph-mon[80685]: pgmap v306: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 -- 172.21.15.103:0/4176992714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 msgr2=0x7f4f1c109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 --2- 172.21.15.103:0/4176992714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c109b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009880 tx=0x7f4f0c02a530 comp rx=0 tx=0).stop 2024-09-17T01:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 -- 172.21.15.103:0/4176992714 shutdown_connections 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 --2- 172.21.15.103:0/4176992714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c109b10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 --2- 172.21.15.103:0/4176992714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f1c100d00 0x7f4f1c1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 -- 172.21.15.103:0/4176992714 >> 172.21.15.103:0/4176992714 conn(0x7f4f1c0758c0 msgr2=0x7f4f1c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 -- 172.21.15.103:0/4176992714 shutdown_connections 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 -- 172.21.15.103:0/4176992714 wait complete. 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.583+0000 7f4f2157d640 1 Processor -- start 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f2157d640 1 -- start start 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f2157d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f1c100d00 0x7f4f1c19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f2157d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f2157d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c19c3c0 con 0x7f4f1c101620 2024-09-17T01:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f2157d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c195950 con 0x7f4f1c100d00 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c19bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56036/0 (socket says 172.21.15.103:56036) 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1a7fc640 1 -- 172.21.15.103:0/813018245 learned_addr learned my addr 172.21.15.103:0/813018245 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1affd640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f1c100d00 0x7f4f1c19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1a7fc640 1 -- 172.21.15.103:0/813018245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f1c100d00 msgr2=0x7f4f1c19b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1a7fc640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f1c100d00 0x7f4f1c19b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.584+0000 7f4f1a7fc640 1 -- 172.21.15.103:0/813018245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009560 con 0x7f4f1c101620 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.585+0000 7f4f1a7fc640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c19bda0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c02aa50 tx=0x7f4f0c032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.585+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0c0037c0 con 0x7f4f1c101620 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.585+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f0c005d50 con 0x7f4f1c101620 2024-09-17T01:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.585+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c195bd0 con 0x7f4f1c101620 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.585+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0c03be30 con 0x7f4f1c101620 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.585+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c1960c0 con 0x7f4f1c101620 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.586+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c068420 con 0x7f4f1c101620 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.586+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4f0c02ad50 con 0x7f4f1c101620 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.587+0000 7f4f13fff640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f0806e5a0 0x7f4f08070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.587+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f4f0c0af410 con 0x7f4f1c101620 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.587+0000 7f4f1affd640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f0806e5a0 0x7f4f08070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.587+0000 7f4f1affd640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f0806e5a0 0x7f4f08070a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f04005fd0 tx=0x7f4f04005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.591+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f0c078390 con 0x7f4f1c101620 2024-09-17T01:17:53.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.766+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 --> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f1c104420 con 0x7f4f0806e5a0 2024-09-17T01:17:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.776+0000 7f4f13fff640 1 -- 172.21.15.103:0/813018245 <== mgr.34102 v2:172.21.15.103:6800/1593441375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4f1c104420 con 0x7f4f0806e5a0 2024-09-17T01:17:53.774 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:17:53.774 INFO:teuthology.orchestra.run.smithi103.stdout:alertmanager.smithi103 smithi103 *:9093,9094 running (118s) 91s ago 18m 16.3M - 0.25.0 c8568f914cd2 f7b7bdd9149c 2024-09-17T01:17:53.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi103 smithi103 running (2m) 91s ago 19m 8380k - 19.1.1-330-gc2ddf972 ebb0615149de 3c6511ea7af3 2024-09-17T01:17:53.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-exporter.smithi143 smithi143 running (2m) 2m ago 18m 7936k - 19.1.1-330-gc2ddf972 ebb0615149de 70186c450006 2024-09-17T01:17:53.774 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi103 smithi103 running (7m) 91s ago 18m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 03486ba61ada 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:crash.smithi143 smithi143 running (7m) 2m ago 18m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 457b3c9a28d5 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:grafana.smithi103 smithi103 *:3000 running (96s) 91s ago 18m 45.6M - 9.4.12 2bacad6d85d8 2773fa7669ae 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.gmmiqj smithi103 running (4m) 91s ago 13m 84.9M - 19.1.1-330-gc2ddf972 ebb0615149de 240ad4fb3bf6 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi103.rnhmlw smithi103 running (3m) 91s ago 13m 88.4M - 19.1.1-330-gc2ddf972 ebb0615149de b2b1fe41a30f 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.uraktq smithi143 running (3m) 2m ago 13m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 22146925e364 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mds.cephfs.smithi143.zkrwqj smithi143 running (3m) 2m ago 13m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 031fc3939184 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi103.efjaur smithi103 *:8443,9283,8765 running (10m) 91s ago 20m 518M - 19.1.1-330-gc2ddf972 ebb0615149de c4396560ed3c 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.smithi143.sxhocv smithi143 *:8443,9283,8765 running (8m) 2m ago 17m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 5a0b6e90525a 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi103 smithi103 running (8m) 91s ago 20m 56.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 76837adde890 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:mon.smithi143 smithi143 running (8m) 2m ago 17m 43.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 03d2b861ad7f 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi103 smithi103 *:9100 running (2m) 91s ago 18m 15.5M - 1.5.0 0da6a335fe13 64ef00b7cfde 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:node-exporter.smithi143 smithi143 *:9100 running (2m) 2m ago 17m 3594k - 1.5.0 0da6a335fe13 15da54842e59 2024-09-17T01:17:53.775 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (7m) 91s ago 17m 110M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 88996506d29e 2024-09-17T01:17:53.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi103 running (6m) 91s ago 16m 151M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 33718d60ac7c 2024-09-17T01:17:53.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi103 running (6m) 91s ago 16m 168M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 9a7d84c9610f 2024-09-17T01:17:53.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi143 running (5m) 2m ago 15m 146M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9f2fc5344aeb 2024-09-17T01:17:53.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi143 running (5m) 2m ago 15m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 20a9fc4c1e3f 2024-09-17T01:17:53.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi143 running (4m) 2m ago 14m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53209a4d015c 2024-09-17T01:17:53.776 INFO:teuthology.orchestra.run.smithi103.stdout:prometheus.smithi103 smithi103 *:9095 running (2m) 91s ago 18m 53.4M - 2.43.0 a07b618ecd1d 2ec6d46d8be5 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f0806e5a0 msgr2=0x7f4f08070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f0806e5a0 0x7f4f08070a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f04005fd0 tx=0x7f4f04005850 comp rx=0 tx=0).stop 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 msgr2=0x7f4f1c19bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c19bda0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c02aa50 tx=0x7f4f0c032bb0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 shutdown_connections 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f0806e5a0 0x7f4f08070a60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f1c101620 0x7f4f1c19bda0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 --2- 172.21.15.103:0/813018245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f1c100d00 0x7f4f1c19b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 >> 172.21.15.103:0/813018245 conn(0x7f4f1c0758c0 msgr2=0x7f4f1c101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:17:53.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 shutdown_connections 2024-09-17T01:17:53.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:53.778+0000 7f4f2157d640 1 -- 172.21.15.103:0/813018245 wait complete. 2024-09-17T01:17:54.359 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T01:17:54.573 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:17:55.403 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:55 smithi103 ceph-mon[92733]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:55.403 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:55 smithi103 ceph-mon[92733]: pgmap v307: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:55 smithi143 ceph-mon[80685]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:55 smithi143 ceph-mon[80685]: pgmap v307: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:17:56.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 -- 172.21.15.103:0/522898362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 msgr2=0x7fbd9c109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 --2- 172.21.15.103:0/522898362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c109af0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009880 tx=0x7fbd8402a530 comp rx=0 tx=0).stop 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 -- 172.21.15.103:0/522898362 shutdown_connections 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 --2- 172.21.15.103:0/522898362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c109af0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 --2- 172.21.15.103:0/522898362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 0x7fbd9c1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 -- 172.21.15.103:0/522898362 >> 172.21.15.103:0/522898362 conn(0x7fbd9c0758c0 msgr2=0x7fbd9c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 -- 172.21.15.103:0/522898362 shutdown_connections 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.216+0000 7fbda2853640 1 -- 172.21.15.103:0/522898362 wait complete. 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbda2853640 1 Processor -- start 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbda2853640 1 -- start start 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbda2853640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 0x7fbd9c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:56.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbda2853640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbda2853640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c19c460 con 0x7fbd9c101600 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbda2853640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c1959f0 con 0x7fbd9c100ce0 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbd93fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbd93fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56050/0 (socket says 172.21.15.103:56050) 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbd93fff640 1 -- 172.21.15.103:0/4257615214 learned_addr learned my addr 172.21.15.103:0/4257615214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.217+0000 7fbd9bfff640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 0x7fbd9c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd93fff640 1 -- 172.21.15.103:0/4257615214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 msgr2=0x7fbd9c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd93fff640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 0x7fbd9c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd93fff640 1 -- 172.21.15.103:0/4257615214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009560 con 0x7fbd9c101600 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd9bfff640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 0x7fbd9c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd93fff640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c19be40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005940 tx=0x7fbd84032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd84005220 con 0x7fbd9c101600 2024-09-17T01:17:56.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c195c70 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd84005380 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd84003a50 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.218+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c196160 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.219+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c068440 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.219+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbd8402ad50 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.220+0000 7fbd99ffb640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbd8806e5f0 0x7fbd88070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.220+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fbd840af380 con 0x7fbd9c101600 2024-09-17T01:17:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.220+0000 7fbd9bfff640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbd8806e5f0 0x7fbd88070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:56.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.220+0000 7fbd9bfff640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbd8806e5f0 0x7fbd88070ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009930 tx=0x7fbd8c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:17:56.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.224+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbd84078300 con 0x7fbd9c101600 2024-09-17T01:17:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.455+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbd9c101140 con 0x7fbd9c101600 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.456+0000 7fbd99ffb640 1 -- 172.21.15.103:0/4257615214 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fbd8407b9c0 con 0x7fbd9c101600 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": { 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": { 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": { 2024-09-17T01:17:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "overall": { 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-17T01:17:56.455 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbd8806e5f0 msgr2=0x7fbd88070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbd8806e5f0 0x7fbd88070ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009930 tx=0x7fbd8c008040 comp rx=0 tx=0).stop 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 msgr2=0x7fbd9c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c19be40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005940 tx=0x7fbd84032bd0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 shutdown_connections 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fbd8806e5f0 0x7fbd88070ab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd9c101600 0x7fbd9c19be40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 --2- 172.21.15.103:0/4257615214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd9c100ce0 0x7fbd9c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 >> 172.21.15.103:0/4257615214 conn(0x7fbd9c0758c0 msgr2=0x7fbd9c101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:17:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 shutdown_connections 2024-09-17T01:17:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:56.458+0000 7fbda2853640 1 -- 172.21.15.103:0/4257615214 wait complete. 2024-09-17T01:17:57.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T01:17:57.309 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:17:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:57 smithi103 ceph-mon[92733]: pgmap v308: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:57 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/4257615214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:57 smithi143 ceph-mon[80685]: pgmap v308: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:17:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:57 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/4257615214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:58.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 -- 172.21.15.103:0/4238967340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 msgr2=0x7f100c101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:58.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 --2- 172.21.15.103:0/4238967340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c101040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009c20 tx=0x7f0ffc02aa00 comp rx=0 tx=0).stop 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 -- 172.21.15.103:0/4238967340 shutdown_connections 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 --2- 172.21.15.103:0/4238967340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 0x7f100c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 --2- 172.21.15.103:0/4238967340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c101040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 -- 172.21.15.103:0/4238967340 >> 172.21.15.103:0/4238967340 conn(0x7f100c0758c0 msgr2=0x7f100c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 -- 172.21.15.103:0/4238967340 shutdown_connections 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 -- 172.21.15.103:0/4238967340 wait complete. 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.889+0000 7f1013b43640 1 Processor -- start 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f1013b43640 1 -- start start 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f1013b43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f1013b43640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 0x7f100c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:58.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f1013b43640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c19c3e0 con 0x7f100c100c60 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f1013b43640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c195970 con 0x7f100c101580 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56074/0 (socket says 172.21.15.103:56074) 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 -- 172.21.15.103:0/817854399 learned_addr learned my addr 172.21.15.103:0/817854399 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10110de640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 0x7f100c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 -- 172.21.15.103:0/817854399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 msgr2=0x7f100c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 0x7f100c19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 -- 172.21.15.103:0/817854399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009900 con 0x7f100c100c60 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10110de640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 0x7f100c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f10118df640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c19b880 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc02af20 tx=0x7f0ffc02f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.890+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ffc03e070 con 0x7f100c100c60 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.891+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ffc02fcd0 con 0x7f100c100c60 2024-09-17T01:17:58.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.891+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c195bf0 con 0x7f100c100c60 2024-09-17T01:17:58.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.891+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ffc043470 con 0x7f100c100c60 2024-09-17T01:17:58.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.891+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c1960e0 con 0x7f100c100c60 2024-09-17T01:17:58.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.891+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c0684c0 con 0x7f100c100c60 2024-09-17T01:17:58.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.892+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0ffc00a040 con 0x7f100c100c60 2024-09-17T01:17:58.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.892+0000 7f100affd640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f0ff406e5f0 0x7f0ff4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:17:58.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.892+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f0ffc0afb20 con 0x7f100c100c60 2024-09-17T01:17:58.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.893+0000 7f10110de640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f0ff406e5f0 0x7f0ff4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:17:58.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.893+0000 7f10110de640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f0ff406e5f0 0x7f0ff4070ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1000005fd0 tx=0x7f1000005f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:17:58.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:58.897+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0ffc078b20 con 0x7f100c100c60 2024-09-17T01:17:59.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.130+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f100c1043b0 con 0x7f100c100c60 2024-09-17T01:17:59.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.130+0000 7f100affd640 1 -- 172.21.15.103:0/817854399 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f0ffc07c1e0 con 0x7f100c100c60 2024-09-17T01:17:59.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f0ff406e5f0 msgr2=0x7f0ff4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f0ff406e5f0 0x7f0ff4070ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1000005fd0 tx=0x7f1000005f40 comp rx=0 tx=0).stop 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 msgr2=0x7f100c19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c19b880 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc02af20 tx=0x7f0ffc02f890 comp rx=0 tx=0).stop 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 shutdown_connections 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f0ff406e5f0 0x7f0ff4070ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f100c101580 0x7f100c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 --2- 172.21.15.103:0/817854399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100c100c60 0x7f100c19b880 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 >> 172.21.15.103:0/817854399 conn(0x7f100c0758c0 msgr2=0x7f100c101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 shutdown_connections 2024-09-17T01:17:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:17:59.133+0000 7f1013b43640 1 -- 172.21.15.103:0/817854399 wait complete. 2024-09-17T01:17:59.139 INFO:teuthology.orchestra.run.smithi103.stdout:true 2024-09-17T01:17:59.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:17:59 smithi103 ceph-mon[92733]: pgmap v309: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:17:59 smithi143 ceph-mon[80685]: pgmap v309: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:17:59.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T01:17:59.945 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:00.391 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:00 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/817854399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:18:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:00 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/817854399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:18:01.373 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:01 smithi103 ceph-mon[92733]: pgmap v310: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:01.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 -- 172.21.15.103:0/3890886235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c101600 msgr2=0x7f213c109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 --2- 172.21.15.103:0/3890886235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c101600 0x7f213c109af0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2130009880 tx=0x7f213002a530 comp rx=0 tx=0).stop 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 -- 172.21.15.103:0/3890886235 shutdown_connections 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 --2- 172.21.15.103:0/3890886235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c101600 0x7f213c109af0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 --2- 172.21.15.103:0/3890886235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c100ce0 0x7f213c1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 -- 172.21.15.103:0/3890886235 >> 172.21.15.103:0/3890886235 conn(0x7f213c0fa720 msgr2=0x7f213c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 -- 172.21.15.103:0/3890886235 shutdown_connections 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 -- 172.21.15.103:0/3890886235 wait complete. 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.455+0000 7f21425ec640 1 Processor -- start 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f21425ec640 1 -- start start 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f21425ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 0x7f213c0fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f21425ec640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c101600 0x7f213c0fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f21425ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0ff3c0 con 0x7f213c100ce0 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f21425ec640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0ff530 con 0x7f213c101600 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 0x7f213c0fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 0x7f213c0fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56094/0 (socket says 172.21.15.103:56094) 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 -- 172.21.15.103:0/379142951 learned_addr learned my addr 172.21.15.103:0/379142951 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213b7fe640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c101600 0x7f213c0fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 -- 172.21.15.103:0/379142951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c101600 msgr2=0x7f213c0fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c101600 0x7f213c0fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 -- 172.21.15.103:0/379142951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009560 con 0x7f213c100ce0 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213b7fe640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c101600 0x7f213c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.456+0000 7f213bfff640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 0x7f213c0fe940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b420 tx=0x7f212c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.457+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212c011800 con 0x7f213c100ce0 2024-09-17T01:18:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.457+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c1a1dd0 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.457+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f212c011e20 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.457+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212c00f2e0 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.457+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c1a2130 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.458+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c068ce0 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.458+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f212c010380 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.459+0000 7f21397fa640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f212406e5f0 0x7f2124070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.459+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f212c08e1f0 con 0x7f213c100ce0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.459+0000 7f213b7fe640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f212406e5f0 0x7f2124070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.459+0000 7f213b7fe640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f212406e5f0 0x7f2124070ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2130006010 tx=0x7f2130005e60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.463+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f212c057170 con 0x7f213c100ce0 2024-09-17T01:18:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:01 smithi143 ceph-mon[80685]: pgmap v310: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:01.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.695+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f213c1043e0 con 0x7f213c100ce0 2024-09-17T01:18:01.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.696+0000 7f21397fa640 1 -- 172.21.15.103:0/379142951 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f212c05a830 con 0x7f213c100ce0 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f212406e5f0 msgr2=0x7f2124070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f212406e5f0 0x7f2124070ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2130006010 tx=0x7f2130005e60 comp rx=0 tx=0).stop 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 msgr2=0x7f213c0fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 0x7f213c0fe940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b420 tx=0x7f212c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 shutdown_connections 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f212406e5f0 0x7f2124070ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f213c101600 0x7f213c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 --2- 172.21.15.103:0/379142951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f213c100ce0 0x7f213c0fe940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 >> 172.21.15.103:0/379142951 conn(0x7f213c0fa720 msgr2=0x7f213c101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 shutdown_connections 2024-09-17T01:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:01.698+0000 7f21425ec640 1 -- 172.21.15.103:0/379142951 wait complete. 2024-09-17T01:18:01.704 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)" 2024-09-17T01:18:02.303 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:02 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/379142951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:18:02.323 DEBUG:teuthology.parallel:result is None 2024-09-17T01:18:02.323 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:18:02.336 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:18:02.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b107b510-748f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:18:02.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:02 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/379142951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:18:02.537 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:03.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:03 smithi103 ceph-mon[92733]: pgmap v311: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:03.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:03 smithi143 ceph-mon[80685]: pgmap v311: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 -- 172.21.15.103:0/2657083661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 msgr2=0x7efe7c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 --2- 172.21.15.103:0/2657083661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c0fee80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe64009880 tx=0x7efe6402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 -- 172.21.15.103:0/2657083661 shutdown_connections 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 --2- 172.21.15.103:0/2657083661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c0fee80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 --2- 172.21.15.103:0/2657083661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe7c104a20 0x7efe7c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 -- 172.21.15.103:0/2657083661 >> 172.21.15.103:0/2657083661 conn(0x7efe7c0fa720 msgr2=0x7efe7c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 -- 172.21.15.103:0/2657083661 shutdown_connections 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.166+0000 7efe81bbd640 1 -- 172.21.15.103:0/2657083661 wait complete. 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe81bbd640 1 Processor -- start 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe81bbd640 1 -- start start 2024-09-17T01:18:04.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe81bbd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe81bbd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe7c104a20 0x7efe7c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe81bbd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c19b200 con 0x7efe7c0fea20 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe81bbd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c19b370 con 0x7efe7c104a20 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe7b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe7b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c19a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57002/0 (socket says 172.21.15.103:57002) 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe7b7fe640 1 -- 172.21.15.103:0/3654586772 learned_addr learned my addr 172.21.15.103:0/3654586772 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.167+0000 7efe72ffd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe7c104a20 0x7efe7c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe7b7fe640 1 -- 172.21.15.103:0/3654586772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe7c104a20 msgr2=0x7efe7c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe7b7fe640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe7c104a20 0x7efe7c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe7b7fe640 1 -- 172.21.15.103:0/3654586772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64009560 con 0x7efe7c0fea20 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe7b7fe640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c19a6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c8a0 tx=0x7efe6c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6c007b80 con 0x7efe7c0fea20 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe6c007ce0 con 0x7efe7c0fea20 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c1949b0 con 0x7efe7c0fea20 2024-09-17T01:18:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6c018810 con 0x7efe7c0fea20 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.168+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c194ed0 con 0x7efe7c0fea20 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.169+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c100160 con 0x7efe7c0fea20 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.170+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efe6c018a80 con 0x7efe7c0fea20 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.170+0000 7efe797fa640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe6806e5f0 0x7efe68070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.170+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7efe6c08eb40 con 0x7efe7c0fea20 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.170+0000 7efe72ffd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe6806e5f0 0x7efe68070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.170+0000 7efe72ffd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe6806e5f0 0x7efe68070ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe64000c00 tx=0x7efe64005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.174+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe6c057a20 con 0x7efe7c0fea20 2024-09-17T01:18:04.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.375+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe7c195de0 con 0x7efe7c0fea20 2024-09-17T01:18:04.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.376+0000 7efe797fa640 1 -- 172.21.15.103:0/3654586772 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+2009 (secure 0 0 0) 0x7efe6c05b0e0 con 0x7efe7c0fea20 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:e37 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-17T01:14:55:014839+0000 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 37 2024-09-17T01:18:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-17T01:04:17.783003+0000 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-17T01:14:55.014828+0000 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 60 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 94 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 1 2024-09-17T01:18:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:in 0 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=34380} 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3] 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 1 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 34380 members: 34380 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.gmmiqj{0:34380} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.103:6826/2017892707,v1:172.21.15.103:6827/2017892707] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi103.rnhmlw{0:34412} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.103:6828/1681283106,v1:172.21.15.103:6829/1681283106] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:18:04.376 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:04.377 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:04.377 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-17T01:18:04.377 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:04.377 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.zkrwqj{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6824/1792149992,v1:172.21.15.143:6825/1792149992] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:18:04.377 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.cephfs.smithi143.uraktq{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.143:6826/2562780354,v1:172.21.15.143:6827/2562780354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 37 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe6806e5f0 msgr2=0x7efe68070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe6806e5f0 0x7efe68070ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe64000c00 tx=0x7efe64005a20 comp rx=0 tx=0).stop 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 msgr2=0x7efe7c19a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c19a6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c8a0 tx=0x7efe6c00cd60 comp rx=0 tx=0).stop 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 shutdown_connections 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7efe6806e5f0 0x7efe68070ab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe7c104a20 0x7efe7c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 --2- 172.21.15.103:0/3654586772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe7c0fea20 0x7efe7c19a6c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 >> 172.21.15.103:0/3654586772 conn(0x7efe7c0fa720 msgr2=0x7efe7c0fb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 shutdown_connections 2024-09-17T01:18:04.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:04.378+0000 7efe81bbd640 1 -- 172.21.15.103:0/3654586772 wait complete. 2024-09-17T01:18:04.917 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-17T01:18:04.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:05.395 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:05 smithi103 ceph-mon[92733]: pgmap v312: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:05.395 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:05 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3654586772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:18:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:05 smithi143 ceph-mon[80685]: pgmap v312: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:05 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3654586772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:18:06.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 -- 172.21.15.103:0/2150606456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed54105bf0 msgr2=0x7fed54105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 --2- 172.21.15.103:0/2150606456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed54105bf0 0x7fed54105fd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fed50009880 tx=0x7fed5002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 -- 172.21.15.103:0/2150606456 shutdown_connections 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 --2- 172.21.15.103:0/2150606456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed540ffb40 0x7fed540fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 --2- 172.21.15.103:0/2150606456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed54105bf0 0x7fed54105fd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 -- 172.21.15.103:0/2150606456 >> 172.21.15.103:0/2150606456 conn(0x7fed540fb840 msgr2=0x7fed540fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 -- 172.21.15.103:0/2150606456 shutdown_connections 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.811+0000 7fed5c40b640 1 -- 172.21.15.103:0/2150606456 wait complete. 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5c40b640 1 Processor -- start 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5c40b640 1 -- start start 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5c40b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 0x7fed5419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5c40b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed54105bf0 0x7fed5419deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:06.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5c40b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5419e4d0 con 0x7fed540ffb40 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5c40b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54197a60 con 0x7fed54105bf0 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5a1a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 0x7fed5419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5a1a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 0x7fed5419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57026/0 (socket says 172.21.15.103:57026) 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5a1a7640 1 -- 172.21.15.103:0/3365035200 learned_addr learned my addr 172.21.15.103:0/3365035200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed599a6640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed54105bf0 0x7fed5419deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5a1a7640 1 -- 172.21.15.103:0/3365035200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed54105bf0 msgr2=0x7fed5419deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5a1a7640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed54105bf0 0x7fed5419deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.812+0000 7fed5a1a7640 1 -- 172.21.15.103:0/3365035200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009560 con 0x7fed540ffb40 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.813+0000 7fed5a1a7640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 0x7fed5419d970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed5002a9c0 tx=0x7fed500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.813+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed50004aa0 con 0x7fed540ffb40 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.813+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed50004c00 con 0x7fed540ffb40 2024-09-17T01:18:06.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.813+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54197ce0 con 0x7fed540ffb40 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.813+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed50003980 con 0x7fed540ffb40 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.813+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed54198250 con 0x7fed540ffb40 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.814+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed541011f0 con 0x7fed540ffb40 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.814+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fed50003b20 con 0x7fed540ffb40 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.815+0000 7fed4b7fe640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fed4006e5f0 0x7fed40070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.815+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fed500af780 con 0x7fed540ffb40 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.815+0000 7fed599a6640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fed4006e5f0 0x7fed40070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.815+0000 7fed599a6640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fed4006e5f0 0x7fed40070ab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed54198ed0 tx=0x7fed4400b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:06.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:06.819+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed50078830 con 0x7fed540ffb40 2024-09-17T01:18:07.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.022+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed541044a0 con 0x7fed540ffb40 2024-09-17T01:18:07.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.022+0000 7fed4b7fe640 1 -- 172.21.15.103:0/3365035200 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+5269 (secure 0 0 0) 0x7fed5007bef0 con 0x7fed540ffb40 2024-09-17T01:18:07.020 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:07.020 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":37,"btime":"2024-09-17T01:14:55:014839+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44347,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2562780354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2562780354},{"type":"v1","addr":"172.21.15.143:6827","nonce":2562780354}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:55.014828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":33,"state":"up:active","state_seq":19,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-17T01:18:07.021 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 37 2024-09-17T01:18:07.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fed4006e5f0 msgr2=0x7fed40070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fed4006e5f0 0x7fed40070ab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed54198ed0 tx=0x7fed4400b390 comp rx=0 tx=0).stop 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 msgr2=0x7fed5419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 0x7fed5419d970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed5002a9c0 tx=0x7fed500055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 shutdown_connections 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fed4006e5f0 0x7fed40070ab0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed54105bf0 0x7fed5419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 --2- 172.21.15.103:0/3365035200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed540ffb40 0x7fed5419d970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 >> 172.21.15.103:0/3365035200 conn(0x7fed540fb840 msgr2=0x7fed540fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.024+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 shutdown_connections 2024-09-17T01:18:07.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:07.025+0000 7fed5c40b640 1 -- 172.21.15.103:0/3365035200 wait complete. 2024-09-17T01:18:07.361 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:07 smithi103 ceph-mon[92733]: pgmap v313: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:07.361 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:07 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3365035200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:18:07.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:07 smithi143 ceph-mon[80685]: pgmap v313: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:07.370 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:07 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3365035200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:18:07.692 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-17T01:18:07.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-17T01:18:07.893 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:09.300 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:09 smithi103 ceph-mon[92733]: pgmap v314: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:09 smithi143 ceph-mon[80685]: pgmap v314: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:09.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 -- 172.21.15.103:0/2576758249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 msgr2=0x7fb1e00fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:09.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/2576758249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00fee00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009880 tx=0x7fb1c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 -- 172.21.15.103:0/2576758249 shutdown_connections 2024-09-17T01:18:09.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/2576758249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00fee00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/2576758249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1e01049a0 0x7fb1e0104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 -- 172.21.15.103:0/2576758249 >> 172.21.15.103:0/2576758249 conn(0x7fb1e00758c0 msgr2=0x7fb1e00fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 -- 172.21.15.103:0/2576758249 shutdown_connections 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.547+0000 7fb1e4e14640 1 -- 172.21.15.103:0/2576758249 wait complete. 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1e4e14640 1 Processor -- start 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1e4e14640 1 -- start start 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1e4e14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00facf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1e4e14640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1e01049a0 0x7fb1e00fb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1e4e14640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00fb770 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1e4e14640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00fb8e0 con 0x7fb1e01049a0 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1de59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:09.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1de59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57054/0 (socket says 172.21.15.103:57054) 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1de59c640 1 -- 172.21.15.103:0/3722048688 learned_addr learned my addr 172.21.15.103:0/3722048688 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1de59c640 1 -- 172.21.15.103:0/3722048688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1e01049a0 msgr2=0x7fb1e00fb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1de59c640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1e01049a0 0x7fb1e00fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.548+0000 7fb1de59c640 1 -- 172.21.15.103:0/3722048688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8009560 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.549+0000 7fb1de59c640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00facf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000e970 tx=0x7fb1d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.549+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d000cc90 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.549+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1d000cdf0 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.549+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e01a1cb0 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.549+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d0010430 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.549+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e01a2010 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.550+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e01000e0 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.550+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb1d00046c0 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.551+0000 7fb1d77fe640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb1cc06e5f0 0x7fb1cc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:09.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.551+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fb1d0014070 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.551+0000 7fb1ddd9b640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb1cc06e5f0 0x7fb1cc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:09.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.551+0000 7fb1ddd9b640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb1cc06e5f0 0x7fb1cc070ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1c802a9c0 tx=0x7fb1c8000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:09.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.555+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1d0057e00 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.756+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fb1e010bcd0 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.757+0000 7fb1d77fe640 1 -- 172.21.15.103:0/3722048688 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) v1 ==== 107+0+4135 (secure 0 0 0) 0x7fb1d005b4c0 con 0x7fb1e00fe9a0 2024-09-17T01:18:09.755 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:09.755 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-17T01:13:34:261978+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:34.261975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14468":{"gid":14468,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6827/305377133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":305377133},{"type":"v1","addr":"172.21.15.103:6827","nonce":305377133}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14468,"qdb_cluster":[14468]},"id":1}]} 2024-09-17T01:18:09.755 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb1cc06e5f0 msgr2=0x7fb1cc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb1cc06e5f0 0x7fb1cc070ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1c802a9c0 tx=0x7fb1c8000bc0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 msgr2=0x7fb1e00facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00facf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000e970 tx=0x7fb1d000ed70 comp rx=0 tx=0).stop 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 shutdown_connections 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb1cc06e5f0 0x7fb1cc070ab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1e01049a0 0x7fb1e00fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 --2- 172.21.15.103:0/3722048688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1e00fe9a0 0x7fb1e00facf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:09.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 >> 172.21.15.103:0/3722048688 conn(0x7fb1e00758c0 msgr2=0x7fb1e0067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:09.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 shutdown_connections 2024-09-17T01:18:09.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:09.759+0000 7fb1e4e14640 1 -- 172.21.15.103:0/3722048688 wait complete. 2024-09-17T01:18:10.411 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:10 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3722048688' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-17T01:18:10.432 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-17T01:18:10.432 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-17T01:18:10.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:10 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3722048688' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-17T01:18:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:11.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:11 smithi103 ceph-mon[92733]: pgmap v315: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:11 smithi143 ceph-mon[80685]: pgmap v315: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.222+0000 7fa02b971640 1 -- 172.21.15.103:0/301310605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 msgr2=0x7fa024105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.222+0000 7fa02b971640 1 --2- 172.21.15.103:0/301310605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa024105fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa014009c20 tx=0x7fa01402a970 comp rx=0 tx=0).stop 2024-09-17T01:18:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.222+0000 7fa02b971640 1 -- 172.21.15.103:0/301310605 shutdown_connections 2024-09-17T01:18:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.222+0000 7fa02b971640 1 --2- 172.21.15.103:0/301310605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 0x7fa0240fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.222+0000 7fa02b971640 1 --2- 172.21.15.103:0/301310605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa024105fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.222+0000 7fa02b971640 1 -- 172.21.15.103:0/301310605 >> 172.21.15.103:0/301310605 conn(0x7fa0240fb840 msgr2=0x7fa0240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 -- 172.21.15.103:0/301310605 shutdown_connections 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 -- 172.21.15.103:0/301310605 wait complete. 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 Processor -- start 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 -- start start 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 0x7fa02419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa02419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02419c400 con 0x7fa024105bf0 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa02b971640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024195990 con 0x7fa0240ffb40 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa028f0c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa02419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa028f0c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa02419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57076/0 (socket says 172.21.15.103:57076) 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.223+0000 7fa028f0c640 1 -- 172.21.15.103:0/2707106611 learned_addr learned my addr 172.21.15.103:0/2707106611 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa02970d640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 0x7fa02419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa028f0c640 1 -- 172.21.15.103:0/2707106611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 msgr2=0x7fa02419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa028f0c640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 0x7fa02419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa028f0c640 1 -- 172.21.15.103:0/2707106611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009900 con 0x7fa024105bf0 2024-09-17T01:18:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa02970d640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 0x7fa02419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa028f0c640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa02419bde0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa01800b420 tx=0x7fa01800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa018011800 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa018011e20 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa024195c70 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa01800f2e0 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.224+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024196240 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.225+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0241011f0 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.226+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa018010380 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.226+0000 7fa0227fc640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa00c06e5f0 0x7fa00c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.226+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fa01808e1f0 con 0x7fa024105bf0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.226+0000 7fa02970d640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa00c06e5f0 0x7fa00c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.227+0000 7fa02970d640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa00c06e5f0 0x7fa00c070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0140098d0 tx=0x7fa014009360 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:12.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.230+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa018057170 con 0x7fa024105bf0 2024-09-17T01:18:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.460+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fa024108010 con 0x7fa024105bf0 2024-09-17T01:18:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.461+0000 7fa0227fc640 1 -- 172.21.15.103:0/2707106611 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) v1 ==== 107+0+4917 (secure 0 0 0) 0x7fa01805a830 con 0x7fa024105bf0 2024-09-17T01:18:12.461 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-09-17T01:13:35:281872+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34376,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/2039397078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2039397078},{"type":"v1","addr":"172.21.15.103:6829","nonce":2039397078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:34.261975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14468":{"gid":14468,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6827/305377133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":305377133},{"type":"v1","addr":"172.21.15.103:6827","nonce":305377133}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14468,"qdb_cluster":[14468]},"id":1}]} 2024-09-17T01:18:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-09-17T01:18:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa00c06e5f0 msgr2=0x7fa00c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa00c06e5f0 0x7fa00c070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0140098d0 tx=0x7fa014009360 comp rx=0 tx=0).stop 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 msgr2=0x7fa02419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa02419bde0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa01800b420 tx=0x7fa01800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 shutdown_connections 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fa00c06e5f0 0x7fa00c070ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa024105bf0 0x7fa02419bde0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 --2- 172.21.15.103:0/2707106611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0240ffb40 0x7fa02419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 >> 172.21.15.103:0/2707106611 conn(0x7fa0240fb840 msgr2=0x7fa0240fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 shutdown_connections 2024-09-17T01:18:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:12.463+0000 7fa02b971640 1 -- 172.21.15.103:0/2707106611 wait complete. 2024-09-17T01:18:13.092 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-17T01:18:13.092 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-17T01:18:13.297 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:13.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:13 smithi103 ceph-mon[92733]: pgmap v316: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:13.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:13 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2707106611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-17T01:18:13.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:13 smithi143 ceph-mon[80685]: pgmap v316: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:13.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:13 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2707106611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-17T01:18:14.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 -- 172.21.15.103:0/3771552562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 msgr2=0x7fdd401038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3771552562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd401038c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009880 tx=0x7fdd3402a530 comp rx=0 tx=0).stop 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 -- 172.21.15.103:0/3771552562 shutdown_connections 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3771552562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd401038c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3771552562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 0x7fdd400feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 -- 172.21.15.103:0/3771552562 >> 172.21.15.103:0/3771552562 conn(0x7fdd400fa720 msgr2=0x7fdd400fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 -- 172.21.15.103:0/3771552562 shutdown_connections 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 -- 172.21.15.103:0/3771552562 wait complete. 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 Processor -- start 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.855+0000 7fdd473bf640 1 -- start start 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd473bf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 0x7fdd4019c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd473bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd4019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd473bf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4019cd30 con 0x7fdd400ff3f0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd473bf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd401a0aa0 con 0x7fdd400fead0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd4019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd4019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59448/0 (socket says 172.21.15.103:59448) 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 -- 172.21.15.103:0/3786210702 learned_addr learned my addr 172.21.15.103:0/3786210702 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4515b640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 0x7fdd4019c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 -- 172.21.15.103:0/3786210702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 msgr2=0x7fdd4019c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 0x7fdd4019c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 -- 172.21.15.103:0/3786210702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009560 con 0x7fdd400ff3f0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4515b640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 0x7fdd4019c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd4495a640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd4019c6a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdd3402aa50 tx=0x7fdd340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd34004aa0 con 0x7fdd400ff3f0 2024-09-17T01:18:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.856+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd34004c00 con 0x7fdd400ff3f0 2024-09-17T01:18:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.857+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd401a0d20 con 0x7fdd400ff3f0 2024-09-17T01:18:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.857+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd340039b0 con 0x7fdd400ff3f0 2024-09-17T01:18:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.857+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd401a1210 con 0x7fdd400ff3f0 2024-09-17T01:18:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.858+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd40068ce0 con 0x7fdd400ff3f0 2024-09-17T01:18:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.858+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdd3402ad50 con 0x7fdd400ff3f0 2024-09-17T01:18:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.858+0000 7fdd3e7fc640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdd2806e5f0 0x7fdd28070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.859+0000 7fdd4515b640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdd2806e5f0 0x7fdd28070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.859+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fdd340af6c0 con 0x7fdd400ff3f0 2024-09-17T01:18:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.859+0000 7fdd4515b640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdd2806e5f0 0x7fdd28070ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd300058c0 tx=0x7fdd30005d30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:14.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:14.863+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd34078640 con 0x7fdd400ff3f0 2024-09-17T01:18:15.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.064+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fdd400feeb0 con 0x7fdd400ff3f0 2024-09-17T01:18:15.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.064+0000 7fdd3e7fc640 1 -- 172.21.15.103:0/3786210702 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) v1 ==== 107+0+4120 (secure 0 0 0) 0x7fdd3407bd00 con 0x7fdd400ff3f0 2024-09-17T01:18:15.063 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:15.063 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"btime":"2024-09-17T01:13:37:752508+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34376,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/2039397078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2039397078},{"type":"v1","addr":"172.21.15.103:6829","nonce":2039397078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:37.752505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:15.063 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 19 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdd2806e5f0 msgr2=0x7fdd28070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdd2806e5f0 0x7fdd28070ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd300058c0 tx=0x7fdd30005d30 comp rx=0 tx=0).stop 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 msgr2=0x7fdd4019c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd4019c6a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdd3402aa50 tx=0x7fdd340055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 shutdown_connections 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fdd2806e5f0 0x7fdd28070ab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ff3f0 0x7fdd4019c6a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 --2- 172.21.15.103:0/3786210702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd400fead0 0x7fdd4019c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 >> 172.21.15.103:0/3786210702 conn(0x7fdd400fa720 msgr2=0x7fdd4010d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 shutdown_connections 2024-09-17T01:18:15.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:15.067+0000 7fdd473bf640 1 -- 172.21.15.103:0/3786210702 wait complete. 2024-09-17T01:18:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:15 smithi103 ceph-mon[92733]: pgmap v317: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:15 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3786210702' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-17T01:18:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:15 smithi143 ceph-mon[80685]: pgmap v317: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:15 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3786210702' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-17T01:18:15.717 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-17T01:18:15.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-17T01:18:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:17.305 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:17 smithi103 ceph-mon[92733]: pgmap v318: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:17 smithi143 ceph-mon[80685]: pgmap v318: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:17.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 -- 172.21.15.103:0/2496672957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2530108720 msgr2=0x7f2530108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 --2- 172.21.15.103:0/2496672957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2530108720 0x7f2530108b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f252c009880 tx=0x7f252c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 -- 172.21.15.103:0/2496672957 shutdown_connections 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 --2- 172.21.15.103:0/2496672957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25301090d0 0x7f253010cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 --2- 172.21.15.103:0/2496672957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2530108720 0x7f2530108b00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 -- 172.21.15.103:0/2496672957 >> 172.21.15.103:0/2496672957 conn(0x7f253006c300 msgr2=0x7f253006e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 -- 172.21.15.103:0/2496672957 shutdown_connections 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.554+0000 7f2538062640 1 -- 172.21.15.103:0/2496672957 wait complete. 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2538062640 1 Processor -- start 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2538062640 1 -- start start 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2538062640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2530108720 0x7f25301a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2538062640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 0x7f25301a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2538062640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a10a0 con 0x7f25301090d0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2538062640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a4e10 con 0x7f2530108720 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f25355fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 0x7f25301a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f25355fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 0x7f25301a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59466/0 (socket says 172.21.15.103:59466) 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f25355fd640 1 -- 172.21.15.103:0/3818124557 learned_addr learned my addr 172.21.15.103:0/3818124557 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2535dfe640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2530108720 0x7f25301a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f25355fd640 1 -- 172.21.15.103:0/3818124557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2530108720 msgr2=0x7f25301a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f25355fd640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2530108720 0x7f25301a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f25355fd640 1 -- 172.21.15.103:0/3818124557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c009560 con 0x7f25301090d0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.555+0000 7f2535dfe640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2530108720 0x7f25301a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.556+0000 7f25355fd640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 0x7f25301a0a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f252000d6c0 tx=0x7f252000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.556+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25200051f0 con 0x7f25301090d0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.556+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2520009ce0 con 0x7f25301090d0 2024-09-17T01:18:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.556+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301a50f0 con 0x7f25301090d0 2024-09-17T01:18:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.556+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2520010460 con 0x7f25301090d0 2024-09-17T01:18:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.556+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25301a56c0 con 0x7f25301090d0 2024-09-17T01:18:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.557+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530109aa0 con 0x7f25301090d0 2024-09-17T01:18:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.557+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2520005350 con 0x7f25301090d0 2024-09-17T01:18:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.558+0000 7f2526ffd640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f251c06e5f0 0x7f251c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.558+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f252008e420 con 0x7f25301090d0 2024-09-17T01:18:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.558+0000 7f2535dfe640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f251c06e5f0 0x7f251c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.559+0000 7f2535dfe640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f251c06e5f0 0x7f251c070ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f252c000c00 tx=0x7f252c005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:17.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.562+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2520057300 con 0x7f25301090d0 2024-09-17T01:18:17.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.763+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f253006ac70 con 0x7f25301090d0 2024-09-17T01:18:17.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.764+0000 7f2526ffd640 1 -- 172.21.15.103:0/3818124557 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) v1 ==== 107+0+4131 (secure 0 0 0) 0x7f252005a9c0 con 0x7f25301090d0 2024-09-17T01:18:17.763 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"btime":"2024-09-17T01:13:37:759533+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34376,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/2039397078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2039397078},{"type":"v1","addr":"172.21.15.103:6829","nonce":2039397078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:37.759523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":0,"incarnation":20,"state":"up:replay","state_seq":3,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:17.763 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f251c06e5f0 msgr2=0x7f251c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f251c06e5f0 0x7f251c070ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f252c000c00 tx=0x7f252c005a20 comp rx=0 tx=0).stop 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 msgr2=0x7f25301a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 0x7f25301a0a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f252000d6c0 tx=0x7f252000db80 comp rx=0 tx=0).stop 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 shutdown_connections 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f251c06e5f0 0x7f251c070ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25301090d0 0x7f25301a0a10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 --2- 172.21.15.103:0/3818124557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2530108720 0x7f25301a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 >> 172.21.15.103:0/3818124557 conn(0x7f253006c300 msgr2=0x7f253006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:17.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 shutdown_connections 2024-09-17T01:18:17.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:17.766+0000 7f2538062640 1 -- 172.21.15.103:0/3818124557 wait complete. 2024-09-17T01:18:18.420 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:18 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3818124557' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-17T01:18:18.420 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:18.441 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-17T01:18:18.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-17T01:18:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:18 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3818124557' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-17T01:18:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:18.648 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:19.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:19 smithi103 ceph-mon[92733]: pgmap v319: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:19 smithi143 ceph-mon[80685]: pgmap v319: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 -- 172.21.15.103:0/3113893268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb8104a10 msgr2=0x7f9cb8104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/3113893268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb8104a10 0x7f9cb8104df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009880 tx=0x7f9ca802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 -- 172.21.15.103:0/3113893268 shutdown_connections 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/3113893268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cb80fea10 0x7f9cb80fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/3113893268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb8104a10 0x7f9cb8104df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 -- 172.21.15.103:0/3113893268 >> 172.21.15.103:0/3113893268 conn(0x7f9cb80fa730 msgr2=0x7f9cb80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 -- 172.21.15.103:0/3113893268 shutdown_connections 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.272+0000 7f9cbcca0640 1 -- 172.21.15.103:0/3113893268 wait complete. 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cbcca0640 1 Processor -- start 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cbcca0640 1 -- start start 2024-09-17T01:18:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cbcca0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 0x7f9cb819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cbcca0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cb8104a10 0x7f9cb819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cbcca0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb819c3d0 con 0x7f9cb80fea10 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cbcca0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8195960 con 0x7f9cb8104a10 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 0x7f9cb819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 0x7f9cb819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59480/0 (socket says 172.21.15.103:59480) 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb659c640 1 -- 172.21.15.103:0/6962946 learned_addr learned my addr 172.21.15.103:0/6962946 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb5d9b640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cb8104a10 0x7f9cb819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb659c640 1 -- 172.21.15.103:0/6962946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cb8104a10 msgr2=0x7f9cb819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb659c640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cb8104a10 0x7f9cb819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.273+0000 7f9cb659c640 1 -- 172.21.15.103:0/6962946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8009560 con 0x7f9cb80fea10 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.274+0000 7f9cb659c640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 0x7f9cb819b870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ca802a9c0 tx=0x7f9ca80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.274+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca8004aa0 con 0x7f9cb80fea10 2024-09-17T01:18:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.274+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ca8004c00 con 0x7f9cb80fea10 2024-09-17T01:18:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.274+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb8195be0 con 0x7f9cb80fea10 2024-09-17T01:18:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.274+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca8003980 con 0x7f9cb80fea10 2024-09-17T01:18:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.274+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb81960d0 con 0x7f9cb80fea10 2024-09-17T01:18:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.275+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8100150 con 0x7f9cb80fea10 2024-09-17T01:18:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.275+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9ca8003b20 con 0x7f9cb80fea10 2024-09-17T01:18:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.276+0000 7f9caf7fe640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9ca406e5f0 0x7f9ca4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.276+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f9ca80af780 con 0x7f9cb80fea10 2024-09-17T01:18:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.276+0000 7f9cb5d9b640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9ca406e5f0 0x7f9ca4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.276+0000 7f9cb5d9b640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9ca406e5f0 0x7f9ca4070ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8196dd0 tx=0x7f9ca000b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:20.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.280+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9ca8078830 con 0x7f9cb80fea10 2024-09-17T01:18:20.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.485+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f9cb80fee70 con 0x7f9cb80fea10 2024-09-17T01:18:20.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.485+0000 7f9caf7fe640 1 -- 172.21.15.103:0/6962946 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) v1 ==== 107+0+4986 (secure 0 0 0) 0x7f9ca807bef0 con 0x7f9cb80fea10 2024-09-17T01:18:20.484 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":21,"btime":"2024-09-17T01:13:46:001954+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34376,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/2039397078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2039397078},{"type":"v1","addr":"172.21.15.103:6829","nonce":2039397078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:45.210327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":142,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 21 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9ca406e5f0 msgr2=0x7f9ca4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9ca406e5f0 0x7f9ca4070ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8196dd0 tx=0x7f9ca000b390 comp rx=0 tx=0).stop 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 msgr2=0x7f9cb819b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 0x7f9cb819b870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ca802a9c0 tx=0x7f9ca80055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 shutdown_connections 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9ca406e5f0 0x7f9ca4070ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cb8104a10 0x7f9cb819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 --2- 172.21.15.103:0/6962946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb80fea10 0x7f9cb819b870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 >> 172.21.15.103:0/6962946 conn(0x7f9cb80fa730 msgr2=0x7f9cb80688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 shutdown_connections 2024-09-17T01:18:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:20.488+0000 7f9cbcca0640 1 -- 172.21.15.103:0/6962946 wait complete. 2024-09-17T01:18:21.150 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-17T01:18:21.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-17T01:18:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:21.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:21 smithi103 ceph-mon[92733]: pgmap v320: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:21 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/6962946' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-17T01:18:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:21 smithi143 ceph-mon[80685]: pgmap v320: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:21 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/6962946' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-17T01:18:22.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.931+0000 7f8e6529e640 1 -- 172.21.15.103:0/1245278142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 msgr2=0x7f8e600fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.931+0000 7f8e6529e640 1 --2- 172.21.15.103:0/1245278142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600fffa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009880 tx=0x7f8e4802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.931+0000 7f8e6529e640 1 -- 172.21.15.103:0/1245278142 shutdown_connections 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.931+0000 7f8e6529e640 1 --2- 172.21.15.103:0/1245278142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600fffa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.931+0000 7f8e6529e640 1 --2- 172.21.15.103:0/1245278142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 0x7f8e60105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 -- 172.21.15.103:0/1245278142 >> 172.21.15.103:0/1245278142 conn(0x7f8e600fb840 msgr2=0x7f8e600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 -- 172.21.15.103:0/1245278142 shutdown_connections 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 -- 172.21.15.103:0/1245278142 wait complete. 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 Processor -- start 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 -- start start 2024-09-17T01:18:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 0x7f8e60072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60073230 con 0x7f8e600ffb40 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e6529e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600733a0 con 0x7f8e60105bf0 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35708/0 (socket says 172.21.15.103:35708) 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.932+0000 7f8e5effd640 1 -- 172.21.15.103:0/2474522042 learned_addr learned my addr 172.21.15.103:0/2474522042 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e57fff640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 0x7f8e60072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5effd640 1 -- 172.21.15.103:0/2474522042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 msgr2=0x7f8e60072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5effd640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 0x7f8e60072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5effd640 1 -- 172.21.15.103:0/2474522042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009560 con 0x7f8e600ffb40 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e57fff640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 0x7f8e60072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5effd640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600727b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c8f0 tx=0x7f8e5000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e50007b80 con 0x7f8e600ffb40 2024-09-17T01:18:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e601a1cd0 con 0x7f8e600ffb40 2024-09-17T01:18:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e500054e0 con 0x7f8e600ffb40 2024-09-17T01:18:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5000f450 con 0x7f8e600ffb40 2024-09-17T01:18:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.933+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e601a2030 con 0x7f8e600ffb40 2024-09-17T01:18:22.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.934+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e601011f0 con 0x7f8e600ffb40 2024-09-17T01:18:22.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.935+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8e50004f60 con 0x7f8e600ffb40 2024-09-17T01:18:22.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.935+0000 7f8e5cff9640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e4c06e5f0 0x7f8e4c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:22.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.935+0000 7f8e57fff640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e4c06e5f0 0x7f8e4c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:22.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.935+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f8e5008e6f0 con 0x7f8e600ffb40 2024-09-17T01:18:22.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.936+0000 7f8e57fff640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e4c06e5f0 0x7f8e4c070ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006010 tx=0x7f8e48005e60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:22.940+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8e50057670 con 0x7f8e600ffb40 2024-09-17T01:18:23.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.142+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f8e601080b0 con 0x7f8e600ffb40 2024-09-17T01:18:23.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.142+0000 7f8e5cff9640 1 -- 172.21.15.103:0/2474522042 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) v1 ==== 107+0+4983 (secure 0 0 0) 0x7f8e5005ad30 con 0x7f8e600ffb40 2024-09-17T01:18:23.141 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":22,"btime":"2024-09-17T01:13:47:005109+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34376,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/2039397078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2039397078},{"type":"v1","addr":"172.21.15.103:6829","nonce":2039397078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:46.007808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":143,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:23.141 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 22 2024-09-17T01:18:23.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e4c06e5f0 msgr2=0x7f8e4c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:23.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e4c06e5f0 0x7f8e4c070ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006010 tx=0x7f8e48005e60 comp rx=0 tx=0).stop 2024-09-17T01:18:23.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 msgr2=0x7f8e600727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:23.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600727b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c8f0 tx=0x7f8e5000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:18:23.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 shutdown_connections 2024-09-17T01:18:23.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f8e4c06e5f0 0x7f8e4c070ab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:23.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e60105bf0 0x7f8e60072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:23.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 --2- 172.21.15.103:0/2474522042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e600ffb40 0x7f8e600727b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:23.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 >> 172.21.15.103:0/2474522042 conn(0x7f8e600fb840 msgr2=0x7f8e600fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:23.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 shutdown_connections 2024-09-17T01:18:23.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:23.144+0000 7f8e6529e640 1 -- 172.21.15.103:0/2474522042 wait complete. 2024-09-17T01:18:23.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:23 smithi103 ceph-mon[92733]: pgmap v321: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:23 smithi143 ceph-mon[80685]: pgmap v321: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:23.976 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-17T01:18:23.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-17T01:18:24.191 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:24.312 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:24 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2474522042' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T01:18:24.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:24 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2474522042' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T01:18:25.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:25 smithi103 ceph-mon[92733]: pgmap v322: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:25 smithi143 ceph-mon[80685]: pgmap v322: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:25.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.823+0000 7f20b58f7640 1 -- 172.21.15.103:0/894524910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 msgr2=0x7f20b01001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.823+0000 7f20b58f7640 1 --2- 172.21.15.103:0/894524910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b01001d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009880 tx=0x7f20a802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.823+0000 7f20b58f7640 1 -- 172.21.15.103:0/894524910 shutdown_connections 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.823+0000 7f20b58f7640 1 --2- 172.21.15.103:0/894524910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 0x7f20b01047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.823+0000 7f20b58f7640 1 --2- 172.21.15.103:0/894524910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b01001d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.824+0000 7f20b58f7640 1 -- 172.21.15.103:0/894524910 >> 172.21.15.103:0/894524910 conn(0x7f20b00fb8d0 msgr2=0x7f20b00fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.824+0000 7f20b58f7640 1 -- 172.21.15.103:0/894524910 shutdown_connections 2024-09-17T01:18:25.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.824+0000 7f20b58f7640 1 -- 172.21.15.103:0/894524910 wait complete. 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.824+0000 7f20b58f7640 1 Processor -- start 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.824+0000 7f20b58f7640 1 -- start start 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b58f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b58f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 0x7f20b019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b58f7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b019c3f0 con 0x7f20b00ffdf0 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b58f7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0195980 con 0x7f20b01007a0 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:25.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35726/0 (socket says 172.21.15.103:35726) 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 -- 172.21.15.103:0/544512933 learned_addr learned my addr 172.21.15.103:0/544512933 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20ae7fc640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 0x7f20b019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 -- 172.21.15.103:0/544512933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 msgr2=0x7f20b019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 0x7f20b019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 -- 172.21.15.103:0/544512933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8009560 con 0x7f20b00ffdf0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20ae7fc640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 0x7f20b019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20aeffd640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b019b890 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f20a802a9c0 tx=0x7f20a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a8004aa0 con 0x7f20b00ffdf0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20a8004c00 con 0x7f20b00ffdf0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.825+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b0195c00 con 0x7f20b00ffdf0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.826+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a8003980 con 0x7f20b00ffdf0 2024-09-17T01:18:25.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.826+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b01960f0 con 0x7f20b00ffdf0 2024-09-17T01:18:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.826+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b01012d0 con 0x7f20b00ffdf0 2024-09-17T01:18:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.827+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f20a8003bf0 con 0x7f20b00ffdf0 2024-09-17T01:18:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.827+0000 7f20b48f5640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f209806e5f0 0x7f2098070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:25.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.828+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f20a80af910 con 0x7f20b00ffdf0 2024-09-17T01:18:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.828+0000 7f20ae7fc640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f209806e5f0 0x7f2098070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:25.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.828+0000 7f20ae7fc640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f209806e5f0 0x7f2098070ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f20b0196df0 tx=0x7f20a4009520 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:25.832+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f20a8078890 con 0x7f20b00ffdf0 2024-09-17T01:18:26.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.033+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f20b01001d0 con 0x7f20b00ffdf0 2024-09-17T01:18:26.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.033+0000 7f20b48f5640 1 -- 172.21.15.103:0/544512933 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) v1 ==== 107+0+4992 (secure 0 0 0) 0x7f20b01001d0 con 0x7f20b00ffdf0 2024-09-17T01:18:26.033 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:26.033 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":23,"btime":"2024-09-17T01:13:48:006625+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34376,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/2039397078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2039397078},{"type":"v1","addr":"172.21.15.103:6829","nonce":2039397078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:48.006623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":0,"incarnation":20,"state":"up:active","state_seq":144,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-17T01:18:26.033 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 23 2024-09-17T01:18:26.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.035+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f209806e5f0 msgr2=0x7f2098070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:26.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.035+0000 7f20b58f7640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f209806e5f0 0x7f2098070ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f20b0196df0 tx=0x7f20a4009520 comp rx=0 tx=0).stop 2024-09-17T01:18:26.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.035+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 msgr2=0x7f20b019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.035+0000 7f20b58f7640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b019b890 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f20a802a9c0 tx=0x7f20a80055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 shutdown_connections 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f209806e5f0 0x7f2098070ab0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20b01007a0 0x7f20b019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 --2- 172.21.15.103:0/544512933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b00ffdf0 0x7f20b019b890 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 >> 172.21.15.103:0/544512933 conn(0x7f20b00fb8d0 msgr2=0x7f20b00fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 shutdown_connections 2024-09-17T01:18:26.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:26.036+0000 7f20b58f7640 1 -- 172.21.15.103:0/544512933 wait complete. 2024-09-17T01:18:26.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:26 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/544512933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T01:18:26.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:26 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/544512933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T01:18:26.676 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-17T01:18:26.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-17T01:18:26.878 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:27.267 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:27 smithi103 ceph-mon[92733]: pgmap v323: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:27 smithi143 ceph-mon[80685]: pgmap v323: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:28.324 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:28 smithi103 ceph-mon[92733]: pgmap v324: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:28.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:28 smithi143 ceph-mon[80685]: pgmap v324: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:28.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 -- 172.21.15.103:0/1944628175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 msgr2=0x7ff6fc1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:28.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 --2- 172.21.15.103:0/1944628175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc1001d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009880 tx=0x7ff6ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 -- 172.21.15.103:0/1944628175 shutdown_connections 2024-09-17T01:18:28.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 --2- 172.21.15.103:0/1944628175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6fc1007a0 0x7ff6fc1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 --2- 172.21.15.103:0/1944628175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc1001d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 -- 172.21.15.103:0/1944628175 >> 172.21.15.103:0/1944628175 conn(0x7ff6fc0fb8d0 msgr2=0x7ff6fc0fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:28.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 -- 172.21.15.103:0/1944628175 shutdown_connections 2024-09-17T01:18:28.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.567+0000 7ff7015e2640 1 -- 172.21.15.103:0/1944628175 wait complete. 2024-09-17T01:18:28.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.568+0000 7ff7015e2640 1 Processor -- start 2024-09-17T01:18:28.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.568+0000 7ff7015e2640 1 -- start start 2024-09-17T01:18:28.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.568+0000 7ff7015e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:28.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.568+0000 7ff7015e2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6fc1007a0 0x7ff6fc19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:28.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.568+0000 7ff7015e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc19c400 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.568+0000 7ff7015e2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1959e0 con 0x7ff6fc1007a0 2024-09-17T01:18:28.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:28.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35738/0 (socket says 172.21.15.103:35738) 2024-09-17T01:18:28.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 -- 172.21.15.103:0/3121579002 learned_addr learned my addr 172.21.15.103:0/3121579002 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:28.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6f3fff640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6fc1007a0 0x7ff6fc19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:28.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 -- 172.21.15.103:0/3121579002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6fc1007a0 msgr2=0x7ff6fc19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:28.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6fc1007a0 0x7ff6fc19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 -- 172.21.15.103:0/3121579002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec009560 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6faffd640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc19b8a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec02a9c0 tx=0x7ff6ec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec004aa0 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc195c60 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6ec004c00 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.569+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec003980 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.570+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc196150 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.571+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc1012d0 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.571+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff6ec003bf0 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.572+0000 7ff6f8ff9640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff6e806e5f0 0x7ff6e8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:28.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.572+0000 7ff6f3fff640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff6e806e5f0 0x7ff6e8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:28.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.572+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7ff6ec0af860 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.572+0000 7ff6f3fff640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff6e806e5f0 0x7ff6e8070ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc196e00 tx=0x7ff6e400b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:28.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.576+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff6ec078890 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.779+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7ff6fc108100 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.779+0000 7ff6f8ff9640 1 -- 172.21.15.103:0/3121579002 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) v1 ==== 107+0+4210 (secure 0 0 0) 0x7ff6ec07bf50 con 0x7ff6fc0ffdf0 2024-09-17T01:18:28.778 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:28.779 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-17T01:13:58:057451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:48.006623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":0,"incarnation":20,"state":"up:active","state_seq":144,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-17T01:18:28.779 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff6e806e5f0 msgr2=0x7ff6e8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff6e806e5f0 0x7ff6e8070ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc196e00 tx=0x7ff6e400b390 comp rx=0 tx=0).stop 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 msgr2=0x7ff6fc19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc19b8a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec02a9c0 tx=0x7ff6ec0055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 shutdown_connections 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7ff6e806e5f0 0x7ff6e8070ab0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6fc1007a0 0x7ff6fc19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 --2- 172.21.15.103:0/3121579002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6fc0ffdf0 0x7ff6fc19b8a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 >> 172.21.15.103:0/3121579002 conn(0x7ff6fc0fb8d0 msgr2=0x7ff6fc0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 shutdown_connections 2024-09-17T01:18:28.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:28.782+0000 7ff7015e2640 1 -- 172.21.15.103:0/3121579002 wait complete. 2024-09-17T01:18:29.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:29 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3121579002' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T01:18:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:29 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3121579002' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T01:18:29.561 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-17T01:18:29.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-17T01:18:29.761 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:30.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:30 smithi103 ceph-mon[92733]: pgmap v325: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:30.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:30 smithi143 ceph-mon[80685]: pgmap v325: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:31.175 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:18:31.175 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:18:31.175 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:18:31.175 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:18:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 -- 172.21.15.103:0/665916599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 msgr2=0x7fc2740fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 --2- 172.21.15.103:0/665916599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc2740fee80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc264009880 tx=0x7fc26402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 -- 172.21.15.103:0/665916599 shutdown_connections 2024-09-17T01:18:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 --2- 172.21.15.103:0/665916599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc2740fee80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 --2- 172.21.15.103:0/665916599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc274104a20 0x7fc274104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 -- 172.21.15.103:0/665916599 >> 172.21.15.103:0/665916599 conn(0x7fc2740fa720 msgr2=0x7fc2740fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 -- 172.21.15.103:0/665916599 shutdown_connections 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.384+0000 7fc27c34a640 1 -- 172.21.15.103:0/665916599 wait complete. 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27c34a640 1 Processor -- start 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27c34a640 1 -- start start 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27c34a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc274196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27c34a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc274104a20 0x7fc274196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27c34a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274197440 con 0x7fc2740fea20 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27c34a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2741975b0 con 0x7fc274104a20 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27a0e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc274196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27a0e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc274196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35746/0 (socket says 172.21.15.103:35746) 2024-09-17T01:18:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27a0e6640 1 -- 172.21.15.103:0/3153504406 learned_addr learned my addr 172.21.15.103:0/3153504406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc2798e5640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc274104a20 0x7fc274196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27a0e6640 1 -- 172.21.15.103:0/3153504406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc274104a20 msgr2=0x7fc274196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27a0e6640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc274104a20 0x7fc274196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.385+0000 7fc27a0e6640 1 -- 172.21.15.103:0/3153504406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264009560 con 0x7fc2740fea20 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.386+0000 7fc27a0e6640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc274196930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00eb10 tx=0x7fc26c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.386+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26c004b20 con 0x7fc2740fea20 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.386+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc26c004c80 con 0x7fc2740fea20 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.386+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27419f9a0 con 0x7fc2740fea20 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.386+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26c010640 con 0x7fc2740fea20 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.386+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27419fdb0 con 0x7fc2740fea20 2024-09-17T01:18:31.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.387+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc274100160 con 0x7fc2740fea20 2024-09-17T01:18:31.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.387+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc26c0055e0 con 0x7fc2740fea20 2024-09-17T01:18:31.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.388+0000 7fc26b7fe640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc26006e5f0 0x7fc260070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:31.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.388+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fc26c014070 con 0x7fc2740fea20 2024-09-17T01:18:31.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.388+0000 7fc2798e5640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc26006e5f0 0x7fc260070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:31.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.388+0000 7fc2798e5640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc26006e5f0 0x7fc260070ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc264009230 tx=0x7fc2640058d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:31.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.392+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc26c057f30 con 0x7fc2740fea20 2024-09-17T01:18:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:18:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:18:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:18:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:18:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.593+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fc274068a90 con 0x7fc2740fea20 2024-09-17T01:18:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.593+0000 7fc26b7fe640 1 -- 172.21.15.103:0/3153504406 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) v1 ==== 107+0+5060 (secure 0 0 0) 0x7fc26c05b5f0 con 0x7fc2740fea20 2024-09-17T01:18:31.592 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:31.593 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-17T01:14:04:067284+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:13:48.006623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi143.zkrwqj","rank":0,"incarnation":20,"state":"up:active","state_seq":144,"addr":"172.21.15.143:6825/1830708841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1830708841},{"type":"v1","addr":"172.21.15.143:6825","nonce":1830708841}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-17T01:18:31.593 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-17T01:18:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc26006e5f0 msgr2=0x7fc260070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc26006e5f0 0x7fc260070ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc264009230 tx=0x7fc2640058d0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 msgr2=0x7fc274196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc274196930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00eb10 tx=0x7fc26c00c2d0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 shutdown_connections 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fc26006e5f0 0x7fc260070ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc274104a20 0x7fc274196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 --2- 172.21.15.103:0/3153504406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740fea20 0x7fc274196930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.595+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 >> 172.21.15.103:0/3153504406 conn(0x7fc2740fa720 msgr2=0x7fc2740fb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.596+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 shutdown_connections 2024-09-17T01:18:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:31.596+0000 7fc27c34a640 1 -- 172.21.15.103:0/3153504406 wait complete. 2024-09-17T01:18:32.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:32 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3153504406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T01:18:32.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:32 smithi103 ceph-mon[92733]: pgmap v326: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:32.271 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-17T01:18:32.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-17T01:18:32.476 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:32 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3153504406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T01:18:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:32 smithi143 ceph-mon[80685]: pgmap v326: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:33.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:34.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/645588254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 msgr2=0x7f6ac01010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:34.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/645588254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac01010b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009880 tx=0x7f6ab402a530 comp rx=0 tx=0).stop 2024-09-17T01:18:34.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/645588254 shutdown_connections 2024-09-17T01:18:34.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/645588254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac01015f0 0x7f6ac0109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/645588254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac01010b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/645588254 >> 172.21.15.103:0/645588254 conn(0x7f6ac00fa730 msgr2=0x7f6ac00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:34.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/645588254 shutdown_connections 2024-09-17T01:18:34.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.083+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/645588254 wait complete. 2024-09-17T01:18:34.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac6eeb640 1 Processor -- start 2024-09-17T01:18:34.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac6eeb640 1 -- start start 2024-09-17T01:18:34.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac6eeb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:34.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac6eeb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac01015f0 0x7f6ac019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:34.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac6eeb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac019c3b0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac6eeb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0195940 con 0x7f6ac01015f0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac4c87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac4c87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac019b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58186/0 (socket says 172.21.15.103:58186) 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.084+0000 7f6ac4c87640 1 -- 172.21.15.103:0/3964533478 learned_addr learned my addr 172.21.15.103:0/3964533478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6ac4c87640 1 -- 172.21.15.103:0/3964533478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac01015f0 msgr2=0x7f6ac019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6abffff640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac01015f0 0x7f6ac019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6ac4c87640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac01015f0 0x7f6ac019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6ac4c87640 1 -- 172.21.15.103:0/3964533478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab4009560 con 0x7f6ac0100cd0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6ac4c87640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac019b850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4006010 tx=0x7f6ab40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ab4004aa0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ab4031470 con 0x7f6ac0100cd0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac0195bc0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ab4003940 con 0x7f6ac0100cd0 2024-09-17T01:18:34.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.085+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01960b0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.086+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0068ce0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.087+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6ab402ad50 con 0x7f6ac0100cd0 2024-09-17T01:18:34.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.087+0000 7f6abdffb640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6ab006e600 0x7f6ab0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:34.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.087+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f6ab40af670 con 0x7f6ac0100cd0 2024-09-17T01:18:34.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.087+0000 7f6abffff640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6ab006e600 0x7f6ab0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:34.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.088+0000 7f6abffff640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6ab006e600 0x7f6ab0070ac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0196db0 tx=0x7f6aac005eb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:34.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.092+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6ab4078670 con 0x7f6ac0100cd0 2024-09-17T01:18:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.296+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f6ac01010b0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.297+0000 7f6abdffb640 1 -- 172.21.15.103:0/3964533478 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) v1 ==== 107+0+4256 (secure 0 0 0) 0x7f6ac01010b0 con 0x7f6ac0100cd0 2024-09-17T01:18:34.296 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:34.296 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-17T01:14:16:092598+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:16.092596+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6ab006e600 msgr2=0x7f6ab0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6ab006e600 0x7f6ab0070ac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0196db0 tx=0x7f6aac005eb0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 msgr2=0x7f6ac019b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac019b850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4006010 tx=0x7f6ab40055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 shutdown_connections 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f6ab006e600 0x7f6ab0070ac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac01015f0 0x7f6ac019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 --2- 172.21.15.103:0/3964533478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac0100cd0 0x7f6ac019b850 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 >> 172.21.15.103:0/3964533478 conn(0x7f6ac00fa730 msgr2=0x7f6ac0101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 shutdown_connections 2024-09-17T01:18:34.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:34.299+0000 7f6ac6eeb640 1 -- 172.21.15.103:0/3964533478 wait complete. 2024-09-17T01:18:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:34 smithi103 ceph-mon[92733]: pgmap v327: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:34 smithi143 ceph-mon[80685]: pgmap v327: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:34.970 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-17T01:18:34.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-17T01:18:35.174 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:35.294 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:35 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3964533478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T01:18:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:35 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3964533478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T01:18:36.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:36 smithi103 ceph-mon[92733]: pgmap v328: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:36.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:36 smithi143 ceph-mon[80685]: pgmap v328: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:36.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.925+0000 7fb4fe946640 1 -- 172.21.15.103:0/3388753737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 msgr2=0x7fb4f80fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.925+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3388753737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f80fffa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009880 tx=0x7fb4ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 -- 172.21.15.103:0/3388753737 shutdown_connections 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3388753737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f80fffa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3388753737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4f8105bf0 0x7fb4f8105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 -- 172.21.15.103:0/3388753737 >> 172.21.15.103:0/3388753737 conn(0x7fb4f80fb840 msgr2=0x7fb4f80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 -- 172.21.15.103:0/3388753737 shutdown_connections 2024-09-17T01:18:36.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 -- 172.21.15.103:0/3388753737 wait complete. 2024-09-17T01:18:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 Processor -- start 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.926+0000 7fb4fe946640 1 -- start start 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4fe946640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4fe946640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4f8105bf0 0x7fb4f819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4fe946640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f819c2e0 con 0x7fb4f80ffb40 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4fe946640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8195870 con 0x7fb4f8105bf0 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f819b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58208/0 (socket says 172.21.15.103:58208) 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 -- 172.21.15.103:0/3810274335 learned_addr learned my addr 172.21.15.103:0/3810274335 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 -- 172.21.15.103:0/3810274335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4f8105bf0 msgr2=0x7fb4f819bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4f8105bf0 0x7fb4f819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 -- 172.21.15.103:0/3810274335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec009560 con 0x7fb4f80ffb40 2024-09-17T01:18:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f7fff640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f819b780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800d8d0 tx=0x7fb4e800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e8009c00 con 0x7fb4f80ffb40 2024-09-17T01:18:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4e8009d60 con 0x7fb4f80ffb40 2024-09-17T01:18:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8195b50 con 0x7fb4f80ffb40 2024-09-17T01:18:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e80049d0 con 0x7fb4f80ffb40 2024-09-17T01:18:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.927+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f81960a0 con 0x7fb4f80ffb40 2024-09-17T01:18:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.928+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f81011f0 con 0x7fb4f80ffb40 2024-09-17T01:18:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.929+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb4e8004c90 con 0x7fb4f80ffb40 2024-09-17T01:18:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.929+0000 7fb4f57fa640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4e006e5f0 0x7fb4e0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.929+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fb4e808e670 con 0x7fb4f80ffb40 2024-09-17T01:18:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.929+0000 7fb4f77fe640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4e006e5f0 0x7fb4e0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.930+0000 7fb4f77fe640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4e006e5f0 0x7fb4e0070ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8196ce0 tx=0x7fb4ec000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:36.934+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4e80575f0 con 0x7fb4f80ffb40 2024-09-17T01:18:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.132+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fb4f80fffa0 con 0x7fb4f80ffb40 2024-09-17T01:18:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.132+0000 7fb4f57fa640 1 -- 172.21.15.103:0/3810274335 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) v1 ==== 107+0+4267 (secure 0 0 0) 0x7fb4e805acb0 con 0x7fb4f80ffb40 2024-09-17T01:18:37.131 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:37.132 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"btime":"2024-09-17T01:14:16:097598+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:16.097585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 27 2024-09-17T01:18:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4e006e5f0 msgr2=0x7fb4e0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4e006e5f0 0x7fb4e0070ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8196ce0 tx=0x7fb4ec000bc0 comp rx=0 tx=0).stop 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 msgr2=0x7fb4f819b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f819b780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800d8d0 tx=0x7fb4e800dd90 comp rx=0 tx=0).stop 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 shutdown_connections 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7fb4e006e5f0 0x7fb4e0070ab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4f8105bf0 0x7fb4f819bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 --2- 172.21.15.103:0/3810274335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4f80ffb40 0x7fb4f819b780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 >> 172.21.15.103:0/3810274335 conn(0x7fb4f80fb840 msgr2=0x7fb4f80fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 shutdown_connections 2024-09-17T01:18:37.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:37.135+0000 7fb4fe946640 1 -- 172.21.15.103:0/3810274335 wait complete. 2024-09-17T01:18:37.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:37 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3810274335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T01:18:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:37 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3810274335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T01:18:37.778 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-17T01:18:37.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-17T01:18:37.980 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:38.384 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:38 smithi103 ceph-mon[92733]: pgmap v329: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:38.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:38 smithi143 ceph-mon[80685]: pgmap v329: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:39.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 -- 172.21.15.103:0/1520220384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800ff210 msgr2=0x7f968010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:39.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 --2- 172.21.15.103:0/1520220384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800ff210 0x7f968010bed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f967c009880 tx=0x7f967c02a490 comp rx=0 tx=0).stop 2024-09-17T01:18:39.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 -- 172.21.15.103:0/1520220384 shutdown_connections 2024-09-17T01:18:39.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 --2- 172.21.15.103:0/1520220384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800ff210 0x7f968010bed0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:39.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 --2- 172.21.15.103:0/1520220384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96800fe860 0x7f96800fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:39.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 -- 172.21.15.103:0/1520220384 >> 172.21.15.103:0/1520220384 conn(0x7f96800fa730 msgr2=0x7f96800fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 -- 172.21.15.103:0/1520220384 shutdown_connections 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.617+0000 7f9687a39640 1 -- 172.21.15.103:0/1520220384 wait complete. 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9687a39640 1 Processor -- start 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9687a39640 1 -- start start 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9687a39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 0x7f9680197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9687a39640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96800ff210 0x7f9680198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9687a39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680198860 con 0x7f96800fe860 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9687a39640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96801989d0 con 0x7f96800ff210 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f96857d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 0x7f9680197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f96857d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 0x7f9680197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58226/0 (socket says 172.21.15.103:58226) 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f96857d5640 1 -- 172.21.15.103:0/1702871150 learned_addr learned my addr 172.21.15.103:0/1702871150 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f9684fd4640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96800ff210 0x7f9680198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.618+0000 7f96857d5640 1 -- 172.21.15.103:0/1702871150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96800ff210 msgr2=0x7f9680198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f96857d5640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96800ff210 0x7f9680198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f96857d5640 1 -- 172.21.15.103:0/1702871150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009560 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f96857d5640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 0x7f9680197cd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f967000c8a0 tx=0x7f967000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9670007b80 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968019b6b0 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9670007ce0 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9670018810 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.619+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968019bbd0 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.620+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9680068ce0 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.620+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9670018a80 con 0x7f96800fe860 2024-09-17T01:18:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.621+0000 7f96767fc640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f966c06e5f0 0x7f966c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.621+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f967008eae0 con 0x7f96800fe860 2024-09-17T01:18:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.621+0000 7f9684fd4640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f966c06e5f0 0x7f966c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.621+0000 7f9684fd4640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f966c06e5f0 0x7f966c070ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.626+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9670057b10 con 0x7f96800fe860 2024-09-17T01:18:39.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.830+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9680199020 con 0x7f96800fe860 2024-09-17T01:18:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.831+0000 7f96767fc640 1 -- 172.21.15.103:0/1702871150 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) v1 ==== 107+0+4272 (secure 0 0 0) 0x7f967005b1d0 con 0x7f96800fe860 2024-09-17T01:18:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:39.830 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"btime":"2024-09-17T01:14:23:890394+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:23.558673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":149,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f966c06e5f0 msgr2=0x7f966c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f966c06e5f0 0x7f966c070ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c005a20 comp rx=0 tx=0).stop 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 msgr2=0x7f9680197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 0x7f9680197cd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f967000c8a0 tx=0x7f967000cd60 comp rx=0 tx=0).stop 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 shutdown_connections 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f966c06e5f0 0x7f966c070ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96800ff210 0x7f9680198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 --2- 172.21.15.103:0/1702871150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96800fe860 0x7f9680197cd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:39.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 >> 172.21.15.103:0/1702871150 conn(0x7f96800fa730 msgr2=0x7f9680106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:39.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 shutdown_connections 2024-09-17T01:18:39.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:39.833+0000 7f9687a39640 1 -- 172.21.15.103:0/1702871150 wait complete. 2024-09-17T01:18:40.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:39 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1702871150' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T01:18:40.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:39 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1702871150' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T01:18:40.593 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-17T01:18:40.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-17T01:18:40.795 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:41.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:40 smithi103 ceph-mon[92733]: pgmap v330: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:41.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:40 smithi143 ceph-mon[80685]: pgmap v330: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:42.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 -- 172.21.15.103:0/1021138296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b4105bf0 msgr2=0x7f15b4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:42.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1021138296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b4105bf0 0x7f15b4105fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009880 tx=0x7f15a802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 -- 172.21.15.103:0/1021138296 shutdown_connections 2024-09-17T01:18:42.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1021138296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15b40ffb40 0x7f15b40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1021138296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b4105bf0 0x7f15b4105fd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 -- 172.21.15.103:0/1021138296 >> 172.21.15.103:0/1021138296 conn(0x7f15b40fb840 msgr2=0x7f15b40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 -- 172.21.15.103:0/1021138296 shutdown_connections 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 -- 172.21.15.103:0/1021138296 wait complete. 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.287+0000 7f15bb01d640 1 Processor -- start 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15bb01d640 1 -- start start 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15bb01d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 0x7f15b419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15bb01d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15b4105bf0 0x7f15b419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15bb01d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b419c370 con 0x7f15b40ffb40 2024-09-17T01:18:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15bb01d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4195950 con 0x7f15b4105bf0 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 0x7f15b419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 0x7f15b419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44492/0 (socket says 172.21.15.103:44492) 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 -- 172.21.15.103:0/1858711433 learned_addr learned my addr 172.21.15.103:0/1858711433 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b3fff640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15b4105bf0 0x7f15b419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 -- 172.21.15.103:0/1858711433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15b4105bf0 msgr2=0x7f15b419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15b4105bf0 0x7f15b419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 -- 172.21.15.103:0/1858711433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009560 con 0x7f15b40ffb40 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.288+0000 7f15b8db9640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 0x7f15b419b810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f15a802a9c0 tx=0x7f15a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.289+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a8004aa0 con 0x7f15b40ffb40 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.289+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15a8004c00 con 0x7f15b40ffb40 2024-09-17T01:18:42.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.289+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a8003980 con 0x7f15b40ffb40 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.289+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4195bd0 con 0x7f15b40ffb40 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.289+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4196140 con 0x7f15b40ffb40 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.290+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b41011f0 con 0x7f15b40ffb40 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.291+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f15a8003bf0 con 0x7f15b40ffb40 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.291+0000 7f15b1ffb640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f15a406e5f0 0x7f15a4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.292+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f15a80af860 con 0x7f15b40ffb40 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.292+0000 7f15b3fff640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f15a406e5f0 0x7f15a4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.292+0000 7f15b3fff640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f15a406e5f0 0x7f15a4070ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f15b4196d70 tx=0x7f15a000b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.296+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f15a8078890 con 0x7f15b40ffb40 2024-09-17T01:18:42.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.503+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f15b4108010 con 0x7f15b40ffb40 2024-09-17T01:18:42.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.504+0000 7f15b1ffb640 1 -- 172.21.15.103:0/1858711433 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) v1 ==== 107+0+4269 (secure 0 0 0) 0x7f15a807bf50 con 0x7f15b40ffb40 2024-09-17T01:18:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:42.502 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":29,"btime":"2024-09-17T01:14:24:895545+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:23.897491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":150,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 29 2024-09-17T01:18:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f15a406e5f0 msgr2=0x7f15a4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f15a406e5f0 0x7f15a4070ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f15b4196d70 tx=0x7f15a000b390 comp rx=0 tx=0).stop 2024-09-17T01:18:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 msgr2=0x7f15b419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 0x7f15b419b810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f15a802a9c0 tx=0x7f15a80055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 shutdown_connections 2024-09-17T01:18:42.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f15a406e5f0 0x7f15a4070ab0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15b4105bf0 0x7f15b419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 --2- 172.21.15.103:0/1858711433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15b40ffb40 0x7f15b419b810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:42.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 >> 172.21.15.103:0/1858711433 conn(0x7f15b40fb840 msgr2=0x7f15b40fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:42.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 shutdown_connections 2024-09-17T01:18:42.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:42.506+0000 7f15bb01d640 1 -- 172.21.15.103:0/1858711433 wait complete. 2024-09-17T01:18:43.148 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:42 smithi103 ceph-mon[92733]: pgmap v331: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:43.148 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:42 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1858711433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T01:18:43.170 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-17T01:18:43.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-17T01:18:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:42 smithi143 ceph-mon[80685]: pgmap v331: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:43.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:42 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1858711433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T01:18:43.369 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 -- 172.21.15.103:0/2271617744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 msgr2=0x7f90881047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 --2- 172.21.15.103:0/2271617744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f90881047f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9078009880 tx=0x7f907802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 -- 172.21.15.103:0/2271617744 shutdown_connections 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 --2- 172.21.15.103:0/2271617744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f90881047f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 --2- 172.21.15.103:0/2271617744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 0x7f90880fe6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 -- 172.21.15.103:0/2271617744 >> 172.21.15.103:0/2271617744 conn(0x7f90880f9ef0 msgr2=0x7f90880fc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 -- 172.21.15.103:0/2271617744 shutdown_connections 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.027+0000 7f908f9b6640 1 -- 172.21.15.103:0/2271617744 wait complete. 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908f9b6640 1 Processor -- start 2024-09-17T01:18:45.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908f9b6640 1 -- start start 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908f9b6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 0x7f908819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908f9b6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f908819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908f9b6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908819c430 con 0x7f90880fecb0 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908f9b6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881959c0 con 0x7f90880fe300 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908cf51640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f908819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908cf51640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f908819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44516/0 (socket says 172.21.15.103:44516) 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908cf51640 1 -- 172.21.15.103:0/3998206034 learned_addr learned my addr 172.21.15.103:0/3998206034 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908d752640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 0x7f908819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.028+0000 7f908cf51640 1 -- 172.21.15.103:0/3998206034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 msgr2=0x7f908819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f908cf51640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 0x7f908819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f908cf51640 1 -- 172.21.15.103:0/3998206034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078009560 con 0x7f90880fecb0 2024-09-17T01:18:45.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f908d752640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 0x7f908819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f908cf51640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f908819be10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f907802a9c0 tx=0x7f90780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9078004aa0 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088195c40 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9078004c00 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9078003980 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.029+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9088196130 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.030+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90881013c0 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.030+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9078003bf0 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.031+0000 7f907e7fc640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f907406e5f0 0x7f9074070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.031+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f90780af910 con 0x7f90880fecb0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.031+0000 7f908d752640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f907406e5f0 0x7f9074070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.031+0000 7f908d752640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f907406e5f0 0x7f9074070ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9084009b40 tx=0x7f9084005e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:45.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.035+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9078078890 con 0x7f90880fecb0 2024-09-17T01:18:45.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:44 smithi103 ceph-mon[92733]: pgmap v332: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.236+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f90880fe6e0 con 0x7f90880fecb0 2024-09-17T01:18:45.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.237+0000 7f907e7fc640 1 -- 172.21.15.103:0/3998206034 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) v1 ==== 107+0+4278 (secure 0 0 0) 0x7f907807bf50 con 0x7f90880fecb0 2024-09-17T01:18:45.235 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:45.236 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":30,"btime":"2024-09-17T01:14:25:901793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:25.901790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":0,"incarnation":27,"state":"up:active","state_seq":151,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24287,"qdb_cluster":[24287]},"id":1}]} 2024-09-17T01:18:45.236 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 30 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f907406e5f0 msgr2=0x7f9074070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f907406e5f0 0x7f9074070ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9084009b40 tx=0x7f9084005e50 comp rx=0 tx=0).stop 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 msgr2=0x7f908819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f908819be10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f907802a9c0 tx=0x7f90780055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 shutdown_connections 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f907406e5f0 0x7f9074070ab0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.239+0000 7f908f9b6640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90880fecb0 0x7f908819be10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.240+0000 7f908f9b6640 1 --2- 172.21.15.103:0/3998206034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f90880fe300 0x7f908819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:45.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.240+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 >> 172.21.15.103:0/3998206034 conn(0x7f90880f9ef0 msgr2=0x7f90880fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:45.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.240+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 shutdown_connections 2024-09-17T01:18:45.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:45.240+0000 7f908f9b6640 1 -- 172.21.15.103:0/3998206034 wait complete. 2024-09-17T01:18:45.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:44 smithi143 ceph-mon[80685]: pgmap v332: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:45.936 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-17T01:18:45.937 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-17T01:18:46.141 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:46.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:46 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3998206034' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T01:18:46.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:46 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3998206034' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T01:18:47.215 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:47 smithi103 ceph-mon[92733]: pgmap v333: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:47.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:47 smithi143 ceph-mon[80685]: pgmap v333: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 -- 172.21.15.103:0/3522410824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 msgr2=0x7f3bf4109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/3522410824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf4109af0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009880 tx=0x7f3be002a530 comp rx=0 tx=0).stop 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 -- 172.21.15.103:0/3522410824 shutdown_connections 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/3522410824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf4109af0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/3522410824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bf4100ce0 0x7f3bf41010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 -- 172.21.15.103:0/3522410824 >> 172.21.15.103:0/3522410824 conn(0x7f3bf40fa720 msgr2=0x7f3bf40fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 -- 172.21.15.103:0/3522410824 shutdown_connections 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.726+0000 7f3bfabb9640 1 -- 172.21.15.103:0/3522410824 wait complete. 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bfabb9640 1 Processor -- start 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bfabb9640 1 -- start start 2024-09-17T01:18:47.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bfabb9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bf4100ce0 0x7f3bf419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bfabb9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bfabb9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf419c400 con 0x7f3bf4101600 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bfabb9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4195990 con 0x7f3bf4100ce0 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bf3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bf3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44534/0 (socket says 172.21.15.103:44534) 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bf3fff640 1 -- 172.21.15.103:0/1131616298 learned_addr learned my addr 172.21.15.103:0/1131616298 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.727+0000 7f3bf8955640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bf4100ce0 0x7f3bf419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf3fff640 1 -- 172.21.15.103:0/1131616298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bf4100ce0 msgr2=0x7f3bf419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf3fff640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bf4100ce0 0x7f3bf419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf3fff640 1 -- 172.21.15.103:0/1131616298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009560 con 0x7f3bf4101600 2024-09-17T01:18:47.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf3fff640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf419bde0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3be002aa50 tx=0x7f3be00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:47.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be00048d0 con 0x7f3bf4101600 2024-09-17T01:18:47.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3be0031640 con 0x7f3bf4101600 2024-09-17T01:18:47.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf4195c10 con 0x7f3bf4101600 2024-09-17T01:18:47.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be00038d0 con 0x7f3bf4101600 2024-09-17T01:18:47.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.728+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf4196100 con 0x7f3bf4101600 2024-09-17T01:18:47.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.729+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf4068ce0 con 0x7f3bf4101600 2024-09-17T01:18:47.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.730+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3be002ad50 con 0x7f3bf4101600 2024-09-17T01:18:47.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.730+0000 7f3bf1ffb640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3be406e5f0 0x7f3be4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:47.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.730+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f3be00af560 con 0x7f3bf4101600 2024-09-17T01:18:47.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.730+0000 7f3bf8955640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3be406e5f0 0x7f3be4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:47.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.731+0000 7f3bf8955640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3be406e5f0 0x7f3be4070ab0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3be8005fd0 tx=0x7f3be800b390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:47.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.735+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3be0078590 con 0x7f3bf4101600 2024-09-17T01:18:47.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.934+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f3bf4104340 con 0x7f3bf4101600 2024-09-17T01:18:47.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.934+0000 7f3bf1ffb640 1 -- 172.21.15.103:0/1131616298 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) v1 ==== 107+0+5128 (secure 0 0 0) 0x7f3be0076e60 con 0x7f3bf4101600 2024-09-17T01:18:47.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:47.933 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":31,"btime":"2024-09-17T01:14:27:907706+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:25.901790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi143.uraktq","rank":0,"incarnation":27,"state":"up:active","state_seq":151,"addr":"172.21.15.143:6827/2518601459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2518601459},{"type":"v1","addr":"172.21.15.143:6827","nonce":2518601459}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24287,"qdb_cluster":[24287]},"id":1}]} 2024-09-17T01:18:47.933 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 31 2024-09-17T01:18:47.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3be406e5f0 msgr2=0x7f3be4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:47.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3be406e5f0 0x7f3be4070ab0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3be8005fd0 tx=0x7f3be800b390 comp rx=0 tx=0).stop 2024-09-17T01:18:47.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 msgr2=0x7f3bf419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf419bde0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3be002aa50 tx=0x7f3be00055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 shutdown_connections 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f3be406e5f0 0x7f3be4070ab0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bf4101600 0x7f3bf419bde0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 --2- 172.21.15.103:0/1131616298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bf4100ce0 0x7f3bf419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 >> 172.21.15.103:0/1131616298 conn(0x7f3bf40fa720 msgr2=0x7f3bf4101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.936+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 shutdown_connections 2024-09-17T01:18:47.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:47.937+0000 7f3bfabb9640 1 -- 172.21.15.103:0/1131616298 wait complete. 2024-09-17T01:18:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:48.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:48 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/1131616298' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T01:18:48.290 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:18:48.290 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:48 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/1131616298' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T01:18:48.621 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-17T01:18:48.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-17T01:18:48.821 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:49.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:49 smithi103 ceph-mon[92733]: pgmap v334: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:49 smithi143 ceph-mon[80685]: pgmap v334: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:50.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 -- 172.21.15.103:0/905451866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc104a10 msgr2=0x7f9bcc104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 --2- 172.21.15.103:0/905451866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc104a10 0x7f9bcc104df0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009880 tx=0x7f9bbc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 -- 172.21.15.103:0/905451866 shutdown_connections 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 --2- 172.21.15.103:0/905451866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 --2- 172.21.15.103:0/905451866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc104a10 0x7f9bcc104df0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 -- 172.21.15.103:0/905451866 >> 172.21.15.103:0/905451866 conn(0x7f9bcc0fa730 msgr2=0x7f9bcc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 -- 172.21.15.103:0/905451866 shutdown_connections 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.426+0000 7f9bd2179640 1 -- 172.21.15.103:0/905451866 wait complete. 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bd2179640 1 Processor -- start 2024-09-17T01:18:50.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bd2179640 1 -- start start 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bd2179640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bd2179640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bcc104a10 0x7f9bcc196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bd2179640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc197490 con 0x7f9bcc0fea10 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bd2179640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc197600 con 0x7f9bcc104a10 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44562/0 (socket says 172.21.15.103:44562) 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bcb7fe640 1 -- 172.21.15.103:0/3595334495 learned_addr learned my addr 172.21.15.103:0/3595334495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bc3fff640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bcc104a10 0x7f9bcc196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bcb7fe640 1 -- 172.21.15.103:0/3595334495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bcc104a10 msgr2=0x7f9bcc196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bcb7fe640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bcc104a10 0x7f9bcc196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.427+0000 7f9bcb7fe640 1 -- 172.21.15.103:0/3595334495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc009560 con 0x7f9bcc0fea10 2024-09-17T01:18:50.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.428+0000 7f9bcb7fe640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc196980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc02a9c0 tx=0x7f9bbc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.428+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bbc004aa0 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.428+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bbc004c00 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.428+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc19f9f0 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.428+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bbc003980 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.428+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc19fd50 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.429+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc100150 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.429+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9bbc003bf0 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.430+0000 7f9bc97fa640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9bb806e5f0 0x7f9bb8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.430+0000 7f9bc3fff640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9bb806e5f0 0x7f9bb8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.430+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f9bbc0af910 con 0x7f9bcc0fea10 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.430+0000 7f9bc3fff640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9bb806e5f0 0x7f9bb8070ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4005fd0 tx=0x7f9bb4005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:50.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.434+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9bbc078890 con 0x7f9bcc0fea10 2024-09-17T01:18:50.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.632+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f9bcc10bca0 con 0x7f9bcc0fea10 2024-09-17T01:18:50.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.632+0000 7f9bc97fa640 1 -- 172.21.15.103:0/3595334495 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) v1 ==== 107+0+4324 (secure 0 0 0) 0x7f9bbc07bf50 con 0x7f9bcc0fea10 2024-09-17T01:18:50.630 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:50.631 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":32,"btime":"2024-09-17T01:14:39:011150+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:39.011147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:50.631 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 32 2024-09-17T01:18:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9bb806e5f0 msgr2=0x7f9bb8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9bb806e5f0 0x7f9bb8070ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4005fd0 tx=0x7f9bb4005850 comp rx=0 tx=0).stop 2024-09-17T01:18:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 msgr2=0x7f9bcc196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc196980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc02a9c0 tx=0x7f9bbc0055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 shutdown_connections 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9bb806e5f0 0x7f9bb8070ab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bcc104a10 0x7f9bcc196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 --2- 172.21.15.103:0/3595334495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0fea10 0x7f9bcc196980 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.635+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 >> 172.21.15.103:0/3595334495 conn(0x7f9bcc0fa730 msgr2=0x7f9bcc0fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.636+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 shutdown_connections 2024-09-17T01:18:50.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:50.636+0000 7f9bd2179640 1 -- 172.21.15.103:0/3595334495 wait complete. 2024-09-17T01:18:51.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:51 smithi103 ceph-mon[92733]: pgmap v335: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:51.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:51 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3595334495' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T01:18:51.339 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-17T01:18:51.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-17T01:18:51.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:51 smithi143 ceph-mon[80685]: pgmap v335: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:51.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:51 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3595334495' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T01:18:51.540 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:53.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.143+0000 7f20f2b5e640 1 -- 172.21.15.103:0/3210846760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec104a90 msgr2=0x7f20ec104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.143+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/3210846760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec104a90 0x7f20ec104e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009880 tx=0x7f20e402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.143+0000 7f20f2b5e640 1 -- 172.21.15.103:0/3210846760 shutdown_connections 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.143+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/3210846760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20ec0fea90 0x7f20ec0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.143+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/3210846760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec104a90 0x7f20ec104e70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.143+0000 7f20f2b5e640 1 -- 172.21.15.103:0/3210846760 >> 172.21.15.103:0/3210846760 conn(0x7f20ec0fa7b0 msgr2=0x7f20ec0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 -- 172.21.15.103:0/3210846760 shutdown_connections 2024-09-17T01:18:53.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 -- 172.21.15.103:0/3210846760 wait complete. 2024-09-17T01:18:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 Processor -- start 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 -- start start 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 0x7f20ec19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20ec104a90 0x7f20ec19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1959b0 con 0x7f20ec0fea90 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f2b5e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec195af0 con 0x7f20ec104a90 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.144+0000 7f20f08fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 0x7f20ec19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f08fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 0x7f20ec19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44810/0 (socket says 172.21.15.103:44810) 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f08fa640 1 -- 172.21.15.103:0/64862629 learned_addr learned my addr 172.21.15.103:0/64862629 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20ebfff640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20ec104a90 0x7f20ec19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f08fa640 1 -- 172.21.15.103:0/64862629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20ec104a90 msgr2=0x7f20ec19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f08fa640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20ec104a90 0x7f20ec19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f08fa640 1 -- 172.21.15.103:0/64862629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4009560 con 0x7f20ec0fea90 2024-09-17T01:18:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f08fa640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 0x7f20ec19b950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20e402a9c0 tx=0x7f20e40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e4004aa0 con 0x7f20ec0fea90 2024-09-17T01:18:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec195d70 con 0x7f20ec0fea90 2024-09-17T01:18:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20e4004c00 con 0x7f20ec0fea90 2024-09-17T01:18:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e4003980 con 0x7f20ec0fea90 2024-09-17T01:18:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.145+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec196260 con 0x7f20ec0fea90 2024-09-17T01:18:53.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.147+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec1001d0 con 0x7f20ec0fea90 2024-09-17T01:18:53.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.147+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f20e4003bf0 con 0x7f20ec0fea90 2024-09-17T01:18:53.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.147+0000 7f20e9ffb640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f20d806e5f0 0x7f20d8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:53.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.148+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f20e40af860 con 0x7f20ec0fea90 2024-09-17T01:18:53.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.148+0000 7f20ebfff640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f20d806e5f0 0x7f20d8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:53.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.148+0000 7f20ebfff640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f20d806e5f0 0x7f20d8070ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f20ec197200 tx=0x7f20d400b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:53.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.152+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f20e4078890 con 0x7f20ec0fea90 2024-09-17T01:18:53.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.348+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f20ec196f10 con 0x7f20ec0fea90 2024-09-17T01:18:53.347 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:53 smithi103 ceph-mon[92733]: pgmap v336: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.349+0000 7f20e9ffb640 1 -- 172.21.15.103:0/64862629 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) v1 ==== 107+0+4403 (secure 0 0 0) 0x7f20e407bf50 con 0x7f20ec0fea90 2024-09-17T01:18:53.348 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:53.348 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-09-17T01:14:39:016419+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:39.016405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f20d806e5f0 msgr2=0x7f20d8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f20d806e5f0 0x7f20d8070ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f20ec197200 tx=0x7f20d400b410 comp rx=0 tx=0).stop 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 msgr2=0x7f20ec19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 0x7f20ec19b950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20e402a9c0 tx=0x7f20e40055a0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 shutdown_connections 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f20d806e5f0 0x7f20d8070ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20ec104a90 0x7f20ec19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 --2- 172.21.15.103:0/64862629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0fea90 0x7f20ec19b950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 >> 172.21.15.103:0/64862629 conn(0x7f20ec0fa7b0 msgr2=0x7f20ec068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 shutdown_connections 2024-09-17T01:18:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:53.352+0000 7f20f2b5e640 1 -- 172.21.15.103:0/64862629 wait complete. 2024-09-17T01:18:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:53 smithi143 ceph-mon[80685]: pgmap v336: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:54.105 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-17T01:18:54.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-17T01:18:54.314 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:54.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:54 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/64862629' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T01:18:54.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:54 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/64862629' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T01:18:55.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:55 smithi103 ceph-mon[92733]: pgmap v337: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:55 smithi143 ceph-mon[80685]: pgmap v337: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 -- 172.21.15.103:0/4185025128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 msgr2=0x7f2d480fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 --2- 172.21.15.103:0/4185025128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d480fee00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009880 tx=0x7f2d3002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 -- 172.21.15.103:0/4185025128 shutdown_connections 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 --2- 172.21.15.103:0/4185025128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d480fee00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 --2- 172.21.15.103:0/4185025128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d481049a0 0x7f2d48104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 -- 172.21.15.103:0/4185025128 >> 172.21.15.103:0/4185025128 conn(0x7f2d480758c0 msgr2=0x7f2d480fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 -- 172.21.15.103:0/4185025128 shutdown_connections 2024-09-17T01:18:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.044+0000 7f2d4e951640 1 -- 172.21.15.103:0/4185025128 wait complete. 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d4e951640 1 Processor -- start 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d4e951640 1 -- start start 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d4e951640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d48197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d4e951640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d481049a0 0x7f2d48198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d4e951640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48198850 con 0x7f2d480fe9a0 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d4e951640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d481989c0 con 0x7f2d481049a0 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d48197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d47fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d48197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44838/0 (socket says 172.21.15.103:44838) 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d47fff640 1 -- 172.21.15.103:0/2082917856 learned_addr learned my addr 172.21.15.103:0/2082917856 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d3ffff640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d481049a0 0x7f2d48198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d47fff640 1 -- 172.21.15.103:0/2082917856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d481049a0 msgr2=0x7f2d48198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d47fff640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d481049a0 0x7f2d48198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.045+0000 7f2d47fff640 1 -- 172.21.15.103:0/2082917856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30009560 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.046+0000 7f2d47fff640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d48197cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c8a0 tx=0x7f2d3800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.046+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d38007b80 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.046+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4819b6a0 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.046+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d38007ce0 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.046+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d38018810 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.046+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4819bbc0 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.047+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d481000e0 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.047+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2d38018a80 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.048+0000 7f2d45ffb640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2d3406e5f0 0x7f2d34070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.048+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f2d3808eaa0 con 0x7f2d480fe9a0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.048+0000 7f2d3ffff640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2d3406e5f0 0x7f2d34070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.048+0000 7f2d3ffff640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2d3406e5f0 0x7f2d34070ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d30000c00 tx=0x7f2d30031420 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.052+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d38057a20 con 0x7f2d480fe9a0 2024-09-17T01:18:56.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.256+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f2d4810bc10 con 0x7f2d480fe9a0 2024-09-17T01:18:56.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.256+0000 7f2d45ffb640 1 -- 172.21.15.103:0/2082917856 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) v1 ==== 107+0+4407 (secure 0 0 0) 0x7f2d3805b0e0 con 0x7f2d480fe9a0 2024-09-17T01:18:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:56.255 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":34,"btime":"2024-09-17T01:14:46:944207+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:46.295900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:56.255 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 34 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.258+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2d3406e5f0 msgr2=0x7f2d34070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.258+0000 7f2d4e951640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2d3406e5f0 0x7f2d34070ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d30000c00 tx=0x7f2d30031420 comp rx=0 tx=0).stop 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.258+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 msgr2=0x7f2d48197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.258+0000 7f2d4e951640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d48197cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c8a0 tx=0x7f2d3800cd60 comp rx=0 tx=0).stop 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 shutdown_connections 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f2d3406e5f0 0x7f2d34070ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d481049a0 0x7f2d48198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 --2- 172.21.15.103:0/2082917856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d480fe9a0 0x7f2d48197cc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 >> 172.21.15.103:0/2082917856 conn(0x7f2d480758c0 msgr2=0x7f2d48067c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 shutdown_connections 2024-09-17T01:18:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:56.259+0000 7f2d4e951640 1 -- 172.21.15.103:0/2082917856 wait complete. 2024-09-17T01:18:57.113 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-17T01:18:57.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-17T01:18:57.316 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:18:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:57 smithi103 ceph-mon[92733]: pgmap v338: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:57 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2082917856' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T01:18:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:57 smithi143 ceph-mon[80685]: pgmap v338: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:18:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:57 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2082917856' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T01:18:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 -- 172.21.15.103:0/2694141548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 msgr2=0x7f9d880fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 --2- 172.21.15.103:0/2694141548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d880fee70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009880 tx=0x7f9d7802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 -- 172.21.15.103:0/2694141548 shutdown_connections 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 --2- 172.21.15.103:0/2694141548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d880fee70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 --2- 172.21.15.103:0/2694141548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 0x7f9d88104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 -- 172.21.15.103:0/2694141548 >> 172.21.15.103:0/2694141548 conn(0x7f9d880fa730 msgr2=0x7f9d880fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 -- 172.21.15.103:0/2694141548 shutdown_connections 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.911+0000 7f9d8c996640 1 -- 172.21.15.103:0/2694141548 wait complete. 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8c996640 1 Processor -- start 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8c996640 1 -- start start 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8c996640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d8819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8c996640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 0x7f9d8819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8c996640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8819c360 con 0x7f9d880fea10 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8c996640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881958f0 con 0x7f9d88104a10 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d8819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.912+0000 7f9d8659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d8819b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44858/0 (socket says 172.21.15.103:44858) 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8659c640 1 -- 172.21.15.103:0/174989316 learned_addr learned my addr 172.21.15.103:0/174989316 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d85d9b640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 0x7f9d8819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8659c640 1 -- 172.21.15.103:0/174989316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 msgr2=0x7f9d8819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8659c640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 0x7f9d8819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8659c640 1 -- 172.21.15.103:0/174989316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009560 con 0x7f9d880fea10 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d85d9b640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 0x7f9d8819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8659c640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d8819b800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000d6f0 tx=0x7f9d7000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d70009a30 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88195bd0 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d700054e0 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d70010460 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.913+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d881960f0 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.914+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88100150 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.915+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9d70009b90 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.915+0000 7f9d7f7fe640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d7406e5f0 0x7f9d74070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.915+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f9d7008e430 con 0x7f9d880fea10 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.915+0000 7f9d85d9b640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d7406e5f0 0x7f9d74070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.916+0000 7f9d85d9b640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d7406e5f0 0x7f9d74070ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9d78000c00 tx=0x7f9d78005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:18:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:58.919+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9d700573b0 con 0x7f9d880fea10 2024-09-17T01:18:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.124+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f9d880fee70 con 0x7f9d880fea10 2024-09-17T01:18:59.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.124+0000 7f9d7f7fe640 1 -- 172.21.15.103:0/174989316 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f9d7005aa70 con 0x7f9d880fea10 2024-09-17T01:18:59.122 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:18:59.122 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":35,"btime":"2024-09-17T01:14:47:949412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44347,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2562780354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2562780354},{"type":"v1","addr":"172.21.15.143:6827","nonce":2562780354}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:46.951378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:18:59.122 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 35 2024-09-17T01:18:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d7406e5f0 msgr2=0x7f9d74070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d7406e5f0 0x7f9d74070ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9d78000c00 tx=0x7f9d78005a20 comp rx=0 tx=0).stop 2024-09-17T01:18:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 msgr2=0x7f9d8819b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:18:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d8819b800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000d6f0 tx=0x7f9d7000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 shutdown_connections 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f9d7406e5f0 0x7f9d74070ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d88104a10 0x7f9d8819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 --2- 172.21.15.103:0/174989316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880fea10 0x7f9d8819b800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.126+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 >> 172.21.15.103:0/174989316 conn(0x7f9d880fa730 msgr2=0x7f9d88068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.127+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 shutdown_connections 2024-09-17T01:18:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:18:59.127+0000 7f9d8c996640 1 -- 172.21.15.103:0/174989316 wait complete. 2024-09-17T01:18:59.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:18:59 smithi103 ceph-mon[92733]: pgmap v339: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:18:59 smithi143 ceph-mon[80685]: pgmap v339: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:18:59.763 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-17T01:18:59.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-17T01:18:59.965 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:19:00.328 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:00 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/174989316' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T01:19:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:00 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/174989316' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T01:19:01.074 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:01 smithi103 ceph-mon[92733]: pgmap v340: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:01 smithi143 ceph-mon[80685]: pgmap v340: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:01.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 -- 172.21.15.103:0/1668332895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 msgr2=0x7f4ac80fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:01.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 --2- 172.21.15.103:0/1668332895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac80fe380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009880 tx=0x7f4abc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 -- 172.21.15.103:0/1668332895 shutdown_connections 2024-09-17T01:19:01.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 --2- 172.21.15.103:0/1668332895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac80fe380 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 --2- 172.21.15.103:0/1668332895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 0x7f4ac8104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 -- 172.21.15.103:0/1668332895 >> 172.21.15.103:0/1668332895 conn(0x7f4ac80f9e30 msgr2=0x7f4ac80fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 -- 172.21.15.103:0/1668332895 shutdown_connections 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 -- 172.21.15.103:0/1668332895 wait complete. 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 Processor -- start 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.561+0000 7f4acf16d640 1 -- start start 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4acf16d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4acf16d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 0x7f4ac819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4acf16d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac819c490 con 0x7f4ac80fdf20 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4acf16d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8195a20 con 0x7f4ac8104b00 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44866/0 (socket says 172.21.15.103:44866) 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 -- 172.21.15.103:0/2884905903 learned_addr learned my addr 172.21.15.103:0/2884905903 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:19:01.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4ac7fff640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 0x7f4ac819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 -- 172.21.15.103:0/2884905903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 msgr2=0x7f4ac819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 0x7f4ac819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 -- 172.21.15.103:0/2884905903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009560 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4ac7fff640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 0x7f4ac819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4accf09640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac819b930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d6f0 tx=0x7f4ab800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab8009a30 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ab80054e0 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab8010460 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.562+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac8195d00 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.563+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac8196220 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.564+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac8101240 con 0x7f4ac80fdf20 2024-09-17T01:19:01.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.564+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4ab8009b90 con 0x7f4ac80fdf20 2024-09-17T01:19:01.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.564+0000 7f4ac5ffb640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4ab006e5f0 0x7f4ab0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:01.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.564+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f4ab808e380 con 0x7f4ac80fdf20 2024-09-17T01:19:01.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.564+0000 7f4ac7fff640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4ab006e5f0 0x7f4ab0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:01.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.565+0000 7f4ac7fff640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4ab006e5f0 0x7f4ab0070ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4abc000c00 tx=0x7f4abc005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:19:01.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.569+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4ab8057380 con 0x7f4ac80fdf20 2024-09-17T01:19:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.769+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f4ac8108060 con 0x7f4ac80fdf20 2024-09-17T01:19:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.769+0000 7f4ac5ffb640 1 -- 172.21.15.103:0/2884905903 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) v1 ==== 107+0+5263 (secure 0 0 0) 0x7f4ab805aa40 con 0x7f4ac80fdf20 2024-09-17T01:19:01.767 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-17T01:19:01.767 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":36,"btime":"2024-09-17T01:14:48:954600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi103.rnhmlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6829/1681283106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1681283106},{"type":"v1","addr":"172.21.15.103:6829","nonce":1681283106}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44343,"name":"cephfs.smithi143.zkrwqj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6825/1792149992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":1792149992},{"type":"v1","addr":"172.21.15.143:6825","nonce":1792149992}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44347,"name":"cephfs.smithi143.uraktq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6827/2562780354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2562780354},{"type":"v1","addr":"172.21.15.143:6827","nonce":2562780354}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:04:17.783003+0000","modified":"2024-09-17T01:14:48.954596+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi103.gmmiqj","rank":0,"incarnation":33,"state":"up:active","state_seq":19,"addr":"172.21.15.103:6827/2017892707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2017892707},{"type":"v1","addr":"172.21.15.103:6827","nonce":2017892707}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-17T01:19:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 36 2024-09-17T01:19:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4ab006e5f0 msgr2=0x7f4ab0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4ab006e5f0 0x7f4ab0070ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4abc000c00 tx=0x7f4abc005a20 comp rx=0 tx=0).stop 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 msgr2=0x7f4ac819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac819b930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d6f0 tx=0x7f4ab800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 shutdown_connections 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4ab006e5f0 0x7f4ab0070ab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ac8104b00 0x7f4ac819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 --2- 172.21.15.103:0/2884905903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ac80fdf20 0x7f4ac819b930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.771+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 >> 172.21.15.103:0/2884905903 conn(0x7f4ac80f9e30 msgr2=0x7f4ac80faff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.772+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 shutdown_connections 2024-09-17T01:19:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:01.772+0000 7f4acf16d640 1 -- 172.21.15.103:0/2884905903 wait complete. 2024-09-17T01:19:02.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:02 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/2884905903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T01:19:02.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:02 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/2884905903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T01:19:02.622 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-17T01:19:02.623 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T01:19:02.634 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T01:19:02.634 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:19:02.634 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:19:02.653 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:19:02.653 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:19:02.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T01:19:02.955 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:19:03.387 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:03 smithi103 ceph-mon[92733]: pgmap v341: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:03.388 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:03 smithi143 ceph-mon[80685]: pgmap v341: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:04.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 -- 172.21.15.103:0/1703153029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 msgr2=0x7f4f38105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/1703153029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38105fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009880 tx=0x7f4f2c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 -- 172.21.15.103:0/1703153029 shutdown_connections 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/1703153029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f380ffb40 0x7f4f380fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/1703153029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38105fd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 -- 172.21.15.103:0/1703153029 >> 172.21.15.103:0/1703153029 conn(0x7f4f380fb840 msgr2=0x7f4f380fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 -- 172.21.15.103:0/1703153029 shutdown_connections 2024-09-17T01:19:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.537+0000 7f4f3ec98640 1 -- 172.21.15.103:0/1703153029 wait complete. 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ec98640 1 Processor -- start 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ec98640 1 -- start start 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ec98640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f380ffb40 0x7f4f380727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ec98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ec98640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38073230 con 0x7f4f38105bf0 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ec98640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380733a0 con 0x7f4f380ffb40 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f37fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f37fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45460/0 (socket says 172.21.15.103:45460) 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f37fff640 1 -- 172.21.15.103:0/3632167601 learned_addr learned my addr 172.21.15.103:0/3632167601 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.538+0000 7f4f3ca34640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f380ffb40 0x7f4f380727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f37fff640 1 -- 172.21.15.103:0/3632167601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f380ffb40 msgr2=0x7f4f380727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f37fff640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f380ffb40 0x7f4f380727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f37fff640 1 -- 172.21.15.103:0/3632167601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009560 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f37fff640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38072cf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400d6f0 tx=0x7f4f2400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f24009a30 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f381a1cb0 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f240054e0 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f24010460 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.539+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f381a2010 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.540+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f381011f0 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.541+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4f24009b90 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.541+0000 7f4f35ffb640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f2806e5f0 0x7f4f28070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.541+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f4f2408e370 con 0x7f4f38105bf0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.541+0000 7f4f3ca34640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f2806e5f0 0x7f4f28070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.542+0000 7f4f3ca34640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f2806e5f0 0x7f4f28070ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009230 tx=0x7f4f2c0058d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:19:04.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.545+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f240573a0 con 0x7f4f38105bf0 2024-09-17T01:19:04.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.723+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4f38108040 con 0x7f4f38105bf0 2024-09-17T01:19:04.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.723+0000 7f4f35ffb640 1 -- 172.21.15.103:0/3632167601 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v94) v1 ==== 81+0+2581 (secure 0 0 0) 0x7f4f2405aa60 con 0x7f4f38105bf0 2024-09-17T01:19:04.721 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6826/2518601459 2024-09-18T01:14:39.010798+0000 2024-09-17T01:19:04.721 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6825/1830708841 2024-09-18T01:14:16.092311+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6824/1830708841 2024-09-18T01:14:16.092311+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1216288250 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3494602487 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2606868360 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/493550029 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3853554040 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/1864036751 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/1190379096 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/187632070 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4141211511 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6827/2518601459 2024-09-18T01:14:39.010798+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6829/1914869103 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.722 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6827/305377133 2024-09-18T01:13:37.752195+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3774926914 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/623165467 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/915785100 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/871067942 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2570658692 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3853554040 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6828/1914869103 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2969455454 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/1190379096 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2608774201 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1007296496 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2748267670 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:04.723 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2256901530 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1081471131 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3684168093 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3684168093 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3632442270 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6826/305377133 2024-09-18T01:13:37.752195+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2182127784 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4077678822 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3024200614 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2182127784 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3680674272 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/356662493 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1139543399 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/187632070 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:04.724 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/517531851 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:04.725 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1169861854 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:04.725 INFO:teuthology.orchestra.run.smithi103.stderr:listed 43 entries 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.725+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f2806e5f0 msgr2=0x7f4f28070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.725+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f2806e5f0 0x7f4f28070ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009230 tx=0x7f4f2c0058d0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.725+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 msgr2=0x7f4f38072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.725+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38072cf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400d6f0 tx=0x7f4f2400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 shutdown_connections 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f4f2806e5f0 0x7f4f28070ab0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f38105bf0 0x7f4f38072cf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 --2- 172.21.15.103:0/3632167601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f380ffb40 0x7f4f380727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 >> 172.21.15.103:0/3632167601 conn(0x7f4f380fb840 msgr2=0x7f4f380fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 shutdown_connections 2024-09-17T01:19:04.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:04.726+0000 7f4f3ec98640 1 -- 172.21.15.103:0/3632167601 wait complete. 2024-09-17T01:19:05.309 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:05 smithi103 ceph-mon[92733]: pgmap v342: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:05.309 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:05 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/3632167601' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:19:05.330 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-17T01:19:05.331 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:19:05.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid b107b510-748f-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T01:19:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:05 smithi143 ceph-mon[80685]: pgmap v342: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:05 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/3632167601' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:19:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-17T01:19:07.296 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:07 smithi103 ceph-mon[92733]: pgmap v343: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:07.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/4292963820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 msgr2=0x7f7f680ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:07.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/4292963820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f680ff790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009880 tx=0x7f7f5802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/4292963820 shutdown_connections 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/4292963820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 0x7f7f68103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/4292963820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f680ff790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/4292963820 >> 172.21.15.103:0/4292963820 conn(0x7f7f680f9e30 msgr2=0x7f7f680fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/4292963820 shutdown_connections 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/4292963820 wait complete. 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 Processor -- start 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.303+0000 7f7f6e9bb640 1 -- start start 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f6e9bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f6819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f6e9bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 0x7f7f6819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f6e9bb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6819c390 con 0x7f7f680ff3b0 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f6e9bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681959b0 con 0x7f7f680ffd60 2024-09-17T01:19:07.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f6819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f6819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45470/0 (socket says 172.21.15.103:45470) 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 -- 172.21.15.103:0/152604674 learned_addr learned my addr 172.21.15.103:0/152604674 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f5ffff640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 0x7f7f6819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 -- 172.21.15.103:0/152604674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 msgr2=0x7f7f6819be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 0x7f7f6819be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 -- 172.21.15.103:0/152604674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58009560 con 0x7f7f680ff3b0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f5ffff640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 0x7f7f6819be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f67fff640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f6819b8c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f5802a9c0 tx=0x7f7f580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f58004aa0 con 0x7f7f680ff3b0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f68195c30 con 0x7f7f680ff3b0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f58004c00 con 0x7f7f680ff3b0 2024-09-17T01:19:07.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f58003ab0 con 0x7f7f680ff3b0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.304+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f68196120 con 0x7f7f680ff3b0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.305+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f68100160 con 0x7f7f680ff3b0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.306+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7f58003ce0 con 0x7f7f680ff3b0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.306+0000 7f7f65ffb640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7f5406e5f0 0x7f7f54070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.306+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f7f580af960 con 0x7f7f680ff3b0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.306+0000 7f7f5ffff640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7f5406e5f0 0x7f7f54070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.307+0000 7f7f5ffff640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7f5406e5f0 0x7f7f54070ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7f68196e20 tx=0x7f7f50005d90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:19:07.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.311+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f580788e0 con 0x7f7f680ff3b0 2024-09-17T01:19:07.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.488+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f68196ec0 con 0x7f7f680ff3b0 2024-09-17T01:19:07.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.488+0000 7f7f65ffb640 1 -- 172.21.15.103:0/152604674 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v94) v1 ==== 81+0+2581 (secure 0 0 0) 0x7f7f5807bfa0 con 0x7f7f680ff3b0 2024-09-17T01:19:07.487 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6826/2518601459 2024-09-18T01:14:39.010798+0000 2024-09-17T01:19:07.487 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6825/1830708841 2024-09-18T01:14:16.092311+0000 2024-09-17T01:19:07.487 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6824/1830708841 2024-09-18T01:14:16.092311+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1216288250 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3494602487 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2606868360 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/493550029 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3853554040 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/1864036751 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/1190379096 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/187632070 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4141211511 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6827/2518601459 2024-09-18T01:14:39.010798+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6829/1914869103 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6827/305377133 2024-09-18T01:13:37.752195+0000 2024-09-17T01:19:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3774926914 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/623165467 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/915785100 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/871067942 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2570658692 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3853554040 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:6828/1914869103 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2969455454 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/1190379096 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2608774201 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1007296496 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.143:0/2748267670 2024-09-18T01:08:04.623699+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2256901530 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1081471131 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3684168093 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3684168093 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3632442270 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6826/305377133 2024-09-18T01:13:37.752195+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2182127784 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/4077678822 2024-09-18T00:58:35.283351+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3024200614 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2182127784 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3680674272 2024-09-18T01:09:17.800105+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/356662493 2024-09-18T00:58:00.610155+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1139543399 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/187632070 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/517531851 2024-09-18T00:59:38.557970+0000 2024-09-17T01:19:07.490 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1169861854 2024-09-18T01:06:43.739561+0000 2024-09-17T01:19:07.491 INFO:teuthology.orchestra.run.smithi103.stderr:listed 43 entries 2024-09-17T01:19:07.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7f5406e5f0 msgr2=0x7f7f54070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:07.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7f5406e5f0 0x7f7f54070ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7f68196e20 tx=0x7f7f50005d90 comp rx=0 tx=0).stop 2024-09-17T01:19:07.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 msgr2=0x7f7f6819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f6819b8c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f5802a9c0 tx=0x7f7f580055a0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 shutdown_connections 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:6800/1593441375,v1:172.21.15.103:6801/1593441375] conn(0x7f7f5406e5f0 0x7f7f54070ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f680ffd60 0x7f7f6819be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 --2- 172.21.15.103:0/152604674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680ff3b0 0x7f7f6819b8c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 >> 172.21.15.103:0/152604674 conn(0x7f7f680f9e30 msgr2=0x7f7f680fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 shutdown_connections 2024-09-17T01:19:07.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-17T01:19:07.490+0000 7f7f6e9bb640 1 -- 172.21.15.103:0/152604674 wait complete. 2024-09-17T01:19:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:07 smithi143 ceph-mon[80685]: pgmap v343: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:08.125 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:08 smithi103 ceph-mon[92733]: from='client.? 172.21.15.103:0/152604674' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:19:08.147 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-17T01:19:08.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:19:08.147 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T01:19:08.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:19:08.314 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:08 smithi143 ceph-mon[80685]: from='client.? 172.21.15.103:0/152604674' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:19:09.317 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:09 smithi103 ceph-mon[92733]: pgmap v344: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:09 smithi143 ceph-mon[80685]: pgmap v344: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:11.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:11 smithi103 ceph-mon[92733]: pgmap v345: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:11 smithi143 ceph-mon[80685]: pgmap v345: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:13.393 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:13 smithi143 ceph-mon[80685]: pgmap v346: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:13.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:13 smithi103 ceph-mon[92733]: pgmap v346: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:15 smithi103 ceph-mon[92733]: pgmap v347: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:15 smithi143 ceph-mon[80685]: pgmap v347: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:17.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:17 smithi103 ceph-mon[92733]: pgmap v348: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:17 smithi143 ceph-mon[80685]: pgmap v348: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:18.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:18.471 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:19.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:19 smithi103 ceph-mon[92733]: pgmap v349: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:19 smithi143 ceph-mon[80685]: pgmap v349: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:21.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:21 smithi103 ceph-mon[92733]: pgmap v350: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:21 smithi143 ceph-mon[80685]: pgmap v350: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:23.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:23 smithi103 ceph-mon[92733]: pgmap v351: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:23 smithi143 ceph-mon[80685]: pgmap v351: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:25.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:25 smithi103 ceph-mon[92733]: pgmap v352: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:25 smithi143 ceph-mon[80685]: pgmap v352: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:27.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:27 smithi103 ceph-mon[92733]: pgmap v353: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:27 smithi143 ceph-mon[80685]: pgmap v353: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:29.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:29 smithi103 ceph-mon[92733]: pgmap v354: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:29 smithi143 ceph-mon[80685]: pgmap v354: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:31.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:31 smithi103 ceph-mon[92733]: pgmap v355: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:31.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:19:31.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:19:31.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:31 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:19:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:31 smithi143 ceph-mon[80685]: pgmap v355: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:19:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:19:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:31 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:19:32.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:19:32.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:19:32.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:19:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:19:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:19:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:19:33.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:33 smithi103 ceph-mon[92733]: pgmap v356: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:33 smithi143 ceph-mon[80685]: pgmap v356: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:35.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:35 smithi103 ceph-mon[92733]: pgmap v357: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:35 smithi143 ceph-mon[80685]: pgmap v357: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:37.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:37 smithi103 ceph-mon[92733]: pgmap v358: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:37 smithi143 ceph-mon[80685]: pgmap v358: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:39.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:39 smithi103 ceph-mon[92733]: pgmap v359: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:39 smithi143 ceph-mon[80685]: pgmap v359: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:41.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:41 smithi103 ceph-mon[92733]: pgmap v360: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:41 smithi143 ceph-mon[80685]: pgmap v360: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:43.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:43 smithi103 ceph-mon[92733]: pgmap v361: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:43 smithi143 ceph-mon[80685]: pgmap v361: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:45.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:45 smithi103 ceph-mon[92733]: pgmap v362: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:45 smithi143 ceph-mon[80685]: pgmap v362: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:47.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:47 smithi103 ceph-mon[92733]: pgmap v363: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:47 smithi143 ceph-mon[80685]: pgmap v363: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:48.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:19:49.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:49 smithi143 ceph-mon[80685]: pgmap v364: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:49.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:49 smithi103 ceph-mon[92733]: pgmap v364: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:51.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:51 smithi103 ceph-mon[92733]: pgmap v365: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:51.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:51 smithi143 ceph-mon[80685]: pgmap v365: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:53.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:53 smithi103 ceph-mon[92733]: pgmap v366: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:53 smithi143 ceph-mon[80685]: pgmap v366: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:55.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:55 smithi103 ceph-mon[92733]: pgmap v367: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:55 smithi143 ceph-mon[80685]: pgmap v367: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:19:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:57 smithi103 ceph-mon[92733]: pgmap v368: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:57 smithi143 ceph-mon[80685]: pgmap v368: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:19:59.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:19:59 smithi103 ceph-mon[92733]: pgmap v369: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:19:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:19:59 smithi143 ceph-mon[80685]: pgmap v369: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:00.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:00 smithi103 ceph-mon[92733]: overall HEALTH_OK 2024-09-17T01:20:00.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:00 smithi143 ceph-mon[80685]: overall HEALTH_OK 2024-09-17T01:20:01.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:01 smithi103 ceph-mon[92733]: pgmap v370: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:01 smithi143 ceph-mon[80685]: pgmap v370: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:03.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:03 smithi103 ceph-mon[92733]: pgmap v371: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:03 smithi143 ceph-mon[80685]: pgmap v371: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:04.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:04 smithi103 ceph-mon[92733]: pgmap v372: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:04.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:04 smithi143 ceph-mon[80685]: pgmap v372: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:07 smithi103 ceph-mon[92733]: pgmap v373: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:07 smithi143 ceph-mon[80685]: pgmap v373: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:09.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:09 smithi103 ceph-mon[92733]: pgmap v374: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:09 smithi143 ceph-mon[80685]: pgmap v374: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:11.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:11 smithi103 ceph-mon[92733]: pgmap v375: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:11 smithi143 ceph-mon[80685]: pgmap v375: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:13.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:13 smithi103 ceph-mon[92733]: pgmap v376: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:13.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:13 smithi143 ceph-mon[80685]: pgmap v376: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:15.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:15 smithi103 ceph-mon[92733]: pgmap v377: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:15 smithi143 ceph-mon[80685]: pgmap v377: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:17.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:17 smithi103 ceph-mon[92733]: pgmap v378: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:17 smithi143 ceph-mon[80685]: pgmap v378: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:18.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:19.413 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:19 smithi143 ceph-mon[80685]: pgmap v379: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:19.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:19 smithi103 ceph-mon[92733]: pgmap v379: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:21 smithi103 ceph-mon[92733]: pgmap v380: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:21 smithi143 ceph-mon[80685]: pgmap v380: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:23.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:23 smithi103 ceph-mon[92733]: pgmap v381: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:23 smithi143 ceph-mon[80685]: pgmap v381: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:25.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:25 smithi103 ceph-mon[92733]: pgmap v382: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:25 smithi143 ceph-mon[80685]: pgmap v382: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:27.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:27 smithi103 ceph-mon[92733]: pgmap v383: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:27 smithi143 ceph-mon[80685]: pgmap v383: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:29.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:29 smithi103 ceph-mon[92733]: pgmap v384: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:29 smithi143 ceph-mon[80685]: pgmap v384: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:31.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:31 smithi103 ceph-mon[92733]: pgmap v385: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:31 smithi143 ceph-mon[80685]: pgmap v385: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:32.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:20:32.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:20:32.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:32 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:20:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:20:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:20:32.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:32 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:20:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:33 smithi103 ceph-mon[92733]: pgmap v386: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:20:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:20:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:20:33.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:33 smithi143 ceph-mon[80685]: pgmap v386: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:20:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:20:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:20:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:35.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:35 smithi103 ceph-mon[92733]: pgmap v387: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:35 smithi143 ceph-mon[80685]: pgmap v387: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:37.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:37 smithi103 ceph-mon[92733]: pgmap v388: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:37 smithi143 ceph-mon[80685]: pgmap v388: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:39.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:39 smithi103 ceph-mon[92733]: pgmap v389: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:39 smithi143 ceph-mon[80685]: pgmap v389: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:41.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:41 smithi103 ceph-mon[92733]: pgmap v390: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:41 smithi143 ceph-mon[80685]: pgmap v390: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:43.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:43 smithi103 ceph-mon[92733]: pgmap v391: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:43 smithi143 ceph-mon[80685]: pgmap v391: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:45.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:45 smithi103 ceph-mon[92733]: pgmap v392: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:45 smithi143 ceph-mon[80685]: pgmap v392: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:47.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:47 smithi103 ceph-mon[92733]: pgmap v393: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:47 smithi143 ceph-mon[80685]: pgmap v393: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:48.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:20:49.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:49 smithi103 ceph-mon[92733]: pgmap v394: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:49.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:49 smithi143 ceph-mon[80685]: pgmap v394: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:51.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:51 smithi103 ceph-mon[92733]: pgmap v395: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:51.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:51 smithi143 ceph-mon[80685]: pgmap v395: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:53.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:53 smithi103 ceph-mon[92733]: pgmap v396: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:53 smithi143 ceph-mon[80685]: pgmap v396: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:55.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:55 smithi143 ceph-mon[80685]: pgmap v397: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:55.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:55 smithi103 ceph-mon[92733]: pgmap v397: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:20:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:57 smithi103 ceph-mon[92733]: pgmap v398: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:57 smithi143 ceph-mon[80685]: pgmap v398: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:20:59.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:20:59 smithi103 ceph-mon[92733]: pgmap v399: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:20:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:20:59 smithi143 ceph-mon[80685]: pgmap v399: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:01.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:01 smithi103 ceph-mon[92733]: pgmap v400: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:01 smithi143 ceph-mon[80685]: pgmap v400: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:03.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:03 smithi103 ceph-mon[92733]: pgmap v401: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:03 smithi143 ceph-mon[80685]: pgmap v401: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:05.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:05 smithi103 ceph-mon[92733]: pgmap v402: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:05 smithi143 ceph-mon[80685]: pgmap v402: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:07 smithi103 ceph-mon[92733]: pgmap v403: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:07 smithi143 ceph-mon[80685]: pgmap v403: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:09.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:09 smithi103 ceph-mon[92733]: pgmap v404: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:09 smithi143 ceph-mon[80685]: pgmap v404: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:11.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:11 smithi103 ceph-mon[92733]: pgmap v405: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:11 smithi143 ceph-mon[80685]: pgmap v405: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:13.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:13 smithi103 ceph-mon[92733]: pgmap v406: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:13.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:13 smithi143 ceph-mon[80685]: pgmap v406: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:15 smithi103 ceph-mon[92733]: pgmap v407: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:15 smithi143 ceph-mon[80685]: pgmap v407: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:17.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:17 smithi103 ceph-mon[92733]: pgmap v408: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:17 smithi143 ceph-mon[80685]: pgmap v408: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:18.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:19.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:19 smithi103 ceph-mon[92733]: pgmap v409: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:19 smithi143 ceph-mon[80685]: pgmap v409: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:21.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:21 smithi103 ceph-mon[92733]: pgmap v410: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:21 smithi143 ceph-mon[80685]: pgmap v410: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:23.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:23 smithi103 ceph-mon[92733]: pgmap v411: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:23 smithi143 ceph-mon[80685]: pgmap v411: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:25.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:25 smithi103 ceph-mon[92733]: pgmap v412: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:25.434 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:25 smithi143 ceph-mon[80685]: pgmap v412: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:27.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:27 smithi103 ceph-mon[92733]: pgmap v413: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:27 smithi143 ceph-mon[80685]: pgmap v413: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:29 smithi103 ceph-mon[92733]: pgmap v414: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:29 smithi143 ceph-mon[80685]: pgmap v414: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:31.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:31 smithi103 ceph-mon[92733]: pgmap v415: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:31 smithi143 ceph-mon[80685]: pgmap v415: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:33 smithi103 ceph-mon[92733]: pgmap v416: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:21:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:21:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:21:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:21:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:33 smithi143 ceph-mon[80685]: pgmap v416: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:21:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:21:33.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:21:33.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:21:33.508 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:35.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:35 smithi103 ceph-mon[92733]: pgmap v417: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:35 smithi143 ceph-mon[80685]: pgmap v417: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:36.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:36 smithi143 ceph-mon[80685]: pgmap v418: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:36.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:36 smithi103 ceph-mon[92733]: pgmap v418: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:39.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:39 smithi103 ceph-mon[92733]: pgmap v419: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:39 smithi143 ceph-mon[80685]: pgmap v419: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:41.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:41 smithi103 ceph-mon[92733]: pgmap v420: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:41 smithi143 ceph-mon[80685]: pgmap v420: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:43.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:43 smithi103 ceph-mon[92733]: pgmap v421: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:43 smithi143 ceph-mon[80685]: pgmap v421: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:45.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:45 smithi103 ceph-mon[92733]: pgmap v422: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:45 smithi143 ceph-mon[80685]: pgmap v422: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:47.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:47 smithi103 ceph-mon[92733]: pgmap v423: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:47 smithi143 ceph-mon[80685]: pgmap v423: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:48.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:21:49.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:49 smithi103 ceph-mon[92733]: pgmap v424: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:49.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:49 smithi143 ceph-mon[80685]: pgmap v424: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:51.356 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:51 smithi143 ceph-mon[80685]: pgmap v425: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:51.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:51 smithi103 ceph-mon[92733]: pgmap v425: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:53.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:53 smithi103 ceph-mon[92733]: pgmap v426: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:53 smithi143 ceph-mon[80685]: pgmap v426: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:55.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:55 smithi103 ceph-mon[92733]: pgmap v427: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:55 smithi143 ceph-mon[80685]: pgmap v427: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:21:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:57 smithi103 ceph-mon[92733]: pgmap v428: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:57 smithi143 ceph-mon[80685]: pgmap v428: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:21:59.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:21:59 smithi103 ceph-mon[92733]: pgmap v429: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:21:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:21:59 smithi143 ceph-mon[80685]: pgmap v429: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:01.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:01 smithi143 ceph-mon[80685]: pgmap v430: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:01.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:01 smithi103 ceph-mon[92733]: pgmap v430: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:03.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:03 smithi103 ceph-mon[92733]: pgmap v431: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:03 smithi143 ceph-mon[80685]: pgmap v431: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:05.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:05 smithi103 ceph-mon[92733]: pgmap v432: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:05 smithi143 ceph-mon[80685]: pgmap v432: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:07 smithi103 ceph-mon[92733]: pgmap v433: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:07 smithi143 ceph-mon[80685]: pgmap v433: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:09.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:09 smithi103 ceph-mon[92733]: pgmap v434: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:09 smithi143 ceph-mon[80685]: pgmap v434: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:11.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:11 smithi103 ceph-mon[92733]: pgmap v435: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:11 smithi143 ceph-mon[80685]: pgmap v435: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:13.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:13 smithi103 ceph-mon[92733]: pgmap v436: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:13.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:13 smithi143 ceph-mon[80685]: pgmap v436: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:15.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:15 smithi103 ceph-mon[92733]: pgmap v437: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:15 smithi143 ceph-mon[80685]: pgmap v437: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:17.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:17 smithi103 ceph-mon[92733]: pgmap v438: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:17 smithi143 ceph-mon[80685]: pgmap v438: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:18.430 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:19.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:19 smithi103 ceph-mon[92733]: pgmap v439: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:19 smithi143 ceph-mon[80685]: pgmap v439: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:21.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:21 smithi103 ceph-mon[92733]: pgmap v440: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:21 smithi143 ceph-mon[80685]: pgmap v440: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:23.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:23 smithi103 ceph-mon[92733]: pgmap v441: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:23 smithi143 ceph-mon[80685]: pgmap v441: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:25.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:25 smithi103 ceph-mon[92733]: pgmap v442: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:25 smithi143 ceph-mon[80685]: pgmap v442: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:26.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:26 smithi103 ceph-mon[92733]: pgmap v443: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:26.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:26 smithi143 ceph-mon[80685]: pgmap v443: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:29.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:29 smithi103 ceph-mon[92733]: pgmap v444: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:29 smithi143 ceph-mon[80685]: pgmap v444: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:31.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:31 smithi103 ceph-mon[92733]: pgmap v445: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:31.457 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:31 smithi143 ceph-mon[80685]: pgmap v445: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:33.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:33 smithi103 ceph-mon[92733]: pgmap v446: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:22:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:33 smithi143 ceph-mon[80685]: pgmap v446: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:22:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:22:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:22:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:22:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:22:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:22:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:22:35.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:35 smithi103 ceph-mon[92733]: pgmap v447: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:35 smithi143 ceph-mon[80685]: pgmap v447: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:37.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:37 smithi103 ceph-mon[92733]: pgmap v448: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:37.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:37 smithi143 ceph-mon[80685]: pgmap v448: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:39.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:39 smithi103 ceph-mon[92733]: pgmap v449: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:39 smithi143 ceph-mon[80685]: pgmap v449: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:41.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:41 smithi103 ceph-mon[92733]: pgmap v450: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:41 smithi143 ceph-mon[80685]: pgmap v450: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:43.364 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:43 smithi103 ceph-mon[92733]: pgmap v451: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:43 smithi143 ceph-mon[80685]: pgmap v451: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:45.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:45 smithi103 ceph-mon[92733]: pgmap v452: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:45 smithi143 ceph-mon[80685]: pgmap v452: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:47.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:47 smithi103 ceph-mon[92733]: pgmap v453: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:47 smithi143 ceph-mon[80685]: pgmap v453: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:48.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:22:49.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:49 smithi103 ceph-mon[92733]: pgmap v454: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:49.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:49 smithi143 ceph-mon[80685]: pgmap v454: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:51.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:51 smithi103 ceph-mon[92733]: pgmap v455: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:51.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:51 smithi143 ceph-mon[80685]: pgmap v455: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:53.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:53 smithi103 ceph-mon[92733]: pgmap v456: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:53 smithi143 ceph-mon[80685]: pgmap v456: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:55.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:55 smithi103 ceph-mon[92733]: pgmap v457: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:55 smithi143 ceph-mon[80685]: pgmap v457: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:22:57.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:57 smithi143 ceph-mon[80685]: pgmap v458: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:57.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:57 smithi103 ceph-mon[92733]: pgmap v458: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:22:59.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:22:59 smithi103 ceph-mon[92733]: pgmap v459: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:22:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:22:59 smithi143 ceph-mon[80685]: pgmap v459: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:01.428 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:01 smithi103 ceph-mon[92733]: pgmap v460: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:01 smithi143 ceph-mon[80685]: pgmap v460: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:03.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:03 smithi103 ceph-mon[92733]: pgmap v461: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:03 smithi143 ceph-mon[80685]: pgmap v461: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:03.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:05.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:05 smithi103 ceph-mon[92733]: pgmap v462: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:05 smithi143 ceph-mon[80685]: pgmap v462: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:07 smithi103 ceph-mon[92733]: pgmap v463: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:07 smithi143 ceph-mon[80685]: pgmap v463: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:09.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:09 smithi103 ceph-mon[92733]: pgmap v464: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:09 smithi143 ceph-mon[80685]: pgmap v464: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:11.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:11 smithi103 ceph-mon[92733]: pgmap v465: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:11.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:11 smithi143 ceph-mon[80685]: pgmap v465: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:13.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:13 smithi103 ceph-mon[92733]: pgmap v466: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:13.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:13 smithi143 ceph-mon[80685]: pgmap v466: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:15.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:15 smithi103 ceph-mon[92733]: pgmap v467: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:15.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:15 smithi143 ceph-mon[80685]: pgmap v467: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:17.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:17 smithi103 ceph-mon[92733]: pgmap v468: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:17.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:17 smithi143 ceph-mon[80685]: pgmap v468: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:18.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:18 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:18.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:18 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:19.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:19 smithi103 ceph-mon[92733]: pgmap v469: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:19.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:19 smithi143 ceph-mon[80685]: pgmap v469: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:21.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:21 smithi103 ceph-mon[92733]: pgmap v470: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:21.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:21 smithi143 ceph-mon[80685]: pgmap v470: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:23.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:23 smithi103 ceph-mon[92733]: pgmap v471: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:23.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:23 smithi143 ceph-mon[80685]: pgmap v471: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:25.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:25 smithi103 ceph-mon[92733]: pgmap v472: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:25.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:25 smithi143 ceph-mon[80685]: pgmap v472: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:27.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:27 smithi103 ceph-mon[92733]: pgmap v473: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:27.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:27 smithi143 ceph-mon[80685]: pgmap v473: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:29.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:29 smithi103 ceph-mon[92733]: pgmap v474: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:29.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:29 smithi143 ceph-mon[80685]: pgmap v474: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:31.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:31 smithi103 ceph-mon[92733]: pgmap v475: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:31.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:31 smithi143 ceph-mon[80685]: pgmap v475: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:33.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:33 smithi103 ceph-mon[92733]: pgmap v476: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:33.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:33 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:33 smithi143 ceph-mon[80685]: pgmap v476: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:33.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:33 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:23:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:23:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:23:34.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:34 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:23:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:23:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:23:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:23:34.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:34 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' 2024-09-17T01:23:35.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:35 smithi103 ceph-mon[92733]: pgmap v477: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:35.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:35 smithi143 ceph-mon[80685]: pgmap v477: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:37.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:37 smithi103 ceph-mon[92733]: pgmap v478: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:37.482 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:37 smithi143 ceph-mon[80685]: pgmap v478: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:39.421 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:39 smithi103 ceph-mon[92733]: pgmap v479: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:39.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:39 smithi143 ceph-mon[80685]: pgmap v479: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:41.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:41 smithi103 ceph-mon[92733]: pgmap v480: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:41.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:41 smithi143 ceph-mon[80685]: pgmap v480: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:43.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:43 smithi103 ceph-mon[92733]: pgmap v481: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:43.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:43 smithi143 ceph-mon[80685]: pgmap v481: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:45.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:45 smithi103 ceph-mon[92733]: pgmap v482: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:45.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:45 smithi143 ceph-mon[80685]: pgmap v482: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:47.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:47 smithi103 ceph-mon[92733]: pgmap v483: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:47.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:47 smithi143 ceph-mon[80685]: pgmap v483: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:48.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:48 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:48.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:48 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:23:49.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:49 smithi143 ceph-mon[80685]: pgmap v484: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:49.612 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:49 smithi103 ceph-mon[92733]: pgmap v484: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:50.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:50 smithi143 ceph-mon[80685]: pgmap v485: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:50.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:50 smithi103 ceph-mon[92733]: pgmap v485: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:53.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:53 smithi103 ceph-mon[92733]: pgmap v486: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:53.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:53 smithi143 ceph-mon[80685]: pgmap v486: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:55.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:55 smithi103 ceph-mon[92733]: pgmap v487: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:55.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:55 smithi143 ceph-mon[80685]: pgmap v487: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:23:57.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:57 smithi103 ceph-mon[92733]: pgmap v488: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:57.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:57 smithi143 ceph-mon[80685]: pgmap v488: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:23:59.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:23:59 smithi103 ceph-mon[92733]: pgmap v489: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:23:59.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:23:59 smithi143 ceph-mon[80685]: pgmap v489: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-17T01:24:01.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:01 smithi103 ceph-mon[92733]: pgmap v490: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:24:01.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:01 smithi143 ceph-mon[80685]: pgmap v490: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:24:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:03 smithi143 ceph-mon[80685]: pgmap v491: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:24:03.257 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:03 smithi143 ceph-mon[80685]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:24:03.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:03 smithi103 ceph-mon[92733]: pgmap v491: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:24:03.427 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:03 smithi103 ceph-mon[92733]: from='mgr.34102 172.21.15.103:0/4006705061' entity='mgr.smithi103.efjaur' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:24:05.176 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:05 smithi103 ceph-mon[92733]: pgmap v492: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:24:05.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:05 smithi143 ceph-mon[80685]: pgmap v492: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:24:07.253 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-17T01:24:07.253 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T01:24:07.255 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T01:24:07.266 INFO:tasks.cephadm:Teardown begin 2024-09-17T01:24:07.266 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T01:24:07.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:24:07.303 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:24:07.337 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T01:24:07.337 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:24:07.361 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:24:07.395 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T01:24:07.396 INFO:tasks.cephadm.mon.smithi103:Stopping mon.smithi103... 2024-09-17T01:24:07.396 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103 2024-09-17T01:24:07.426 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:07 smithi103 ceph-mon[92733]: pgmap v493: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:24:07.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:07 smithi143 ceph-mon[80685]: pgmap v493: 65 pgs: 65 active+clean; 204 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-17T01:24:07.694 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:07 smithi103 systemd[1]: Stopping Ceph mon.smithi103 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:07.949 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:07 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[92729]: 2024-09-17T01:24:07.697+0000 7faaad909640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi103 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:07.949 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:07 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103[92729]: 2024-09-17T01:24:07.697+0000 7faaad909640 -1 mon.smithi103@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T01:24:08.241 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:07 smithi103 podman[155264]: 2024-09-17 01:24:07.952049127 +0000 UTC m=+0.357056254 container died 76837adde89025e7f17d0e7a62f2f536801a9f72cf9d91dae1206d682a0ba8f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:24:08.676 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:08 smithi103 podman[155264]: 2024-09-17 01:24:08.430801986 +0000 UTC m=+0.835809107 container cleanup 76837adde89025e7f17d0e7a62f2f536801a9f72cf9d91dae1206d682a0ba8f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:24:08.677 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 17 01:24:08 smithi103 bash[155264]: ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi103 2024-09-17T01:24:08.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi103.service' 2024-09-17T01:24:08.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:08.902 INFO:tasks.cephadm.mon.smithi103:Stopped mon.smithi103 2024-09-17T01:24:08.902 INFO:tasks.cephadm.mon.smithi143:Stopping mon.smithi143... 2024-09-17T01:24:08.902 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi143 2024-09-17T01:24:09.196 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:08 smithi143 systemd[1]: Stopping Ceph mon.smithi143 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:09 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143[80681]: 2024-09-17T01:24:09.199+0000 7ff242272640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi143 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:09 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143[80681]: 2024-09-17T01:24:09.199+0000 7ff242272640 -1 mon.smithi143@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T01:24:09.507 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:09 smithi143 podman[121878]: 2024-09-17 01:24:09.270686913 +0000 UTC m=+0.162521350 container died 03d2b861ad7f539b685594f973b4ecfc3257534bfa81675edc7d21f3505f32d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:24:09.998 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:09 smithi143 podman[121878]: 2024-09-17 01:24:09.716237862 +0000 UTC m=+0.608072299 container cleanup 03d2b861ad7f539b685594f973b4ecfc3257534bfa81675edc7d21f3505f32d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:24:09.999 INFO:journalctl@ceph.mon.smithi143.smithi143.stdout:Sep 17 01:24:09 smithi143 bash[121878]: ceph-b107b510-748f-11ef-bceb-c7b262605968-mon-smithi143 2024-09-17T01:24:10.142 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@mon.smithi143.service' 2024-09-17T01:24:10.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:10.185 INFO:tasks.cephadm.mon.smithi143:Stopped mon.smithi143 2024-09-17T01:24:10.185 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T01:24:10.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.0 2024-09-17T01:24:10.426 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:10 smithi103 systemd[1]: Stopping Ceph osd.0 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:10.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:10 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[100998]: 2024-09-17T01:24:10.485+0000 7f0452075640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:10.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:10 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[100998]: 2024-09-17T01:24:10.485+0000 7f0452075640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-17T01:24:10.927 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:10 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0[100998]: 2024-09-17T01:24:10.485+0000 7f0452075640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:24:16.310 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:16 smithi103 podman[155398]: 2024-09-17 01:24:16.021159497 +0000 UTC m=+5.636983044 container died 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-17T01:24:16.659 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:16 smithi103 podman[155398]: 2024-09-17 01:24:16.410869436 +0000 UTC m=+6.026692983 container cleanup 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:24:16.660 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:16 smithi103 bash[155398]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:24:16.926 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:16 smithi103 podman[155414]: 2024-09-17 01:24:16.662290485 +0000 UTC m=+0.634286098 container remove 88996506d29ee53230ffdcfb0570f840cc7f3f3ea20898e7aeae663d3feaad16 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T01:24:17.305 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:16 smithi103 podman[155503]: 2024-09-17 01:24:16.888321301 +0000 UTC m=+0.016008861 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:24:17.305 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:17 smithi103 podman[155503]: 2024-09-17 01:24:17.005142001 +0000 UTC m=+0.132829587 container create f926631df162d33dcc673e3ff1c0dd645d11be5bf4c99490363e194eb8a3a546 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:24:17.305 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:17 smithi103 podman[155503]: 2024-09-17 01:24:17.224380877 +0000 UTC m=+0.352068418 container init f926631df162d33dcc673e3ff1c0dd645d11be5bf4c99490363e194eb8a3a546 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T01:24:17.305 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:17 smithi103 podman[155503]: 2024-09-17 01:24:17.227862639 +0000 UTC m=+0.355550180 container start f926631df162d33dcc673e3ff1c0dd645d11be5bf4c99490363e194eb8a3a546 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T01:24:17.305 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:17 smithi103 podman[155503]: 2024-09-17 01:24:17.307660738 +0000 UTC m=+0.435348289 container attach f926631df162d33dcc673e3ff1c0dd645d11be5bf4c99490363e194eb8a3a546 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-17T01:24:17.677 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 17 01:24:17 smithi103 podman[155527]: 2024-09-17 01:24:17.45154559 +0000 UTC m=+0.016764266 container died f926631df162d33dcc673e3ff1c0dd645d11be5bf4c99490363e194eb8a3a546 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-17T01:24:18.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T01:24:18.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:18.051 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T01:24:18.051 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T01:24:18.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.1 2024-09-17T01:24:18.267 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:18 smithi103 systemd[1]: Stopping Ceph osd.1 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:18.676 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:18 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[106687]: 2024-09-17T01:24:18.399+0000 7f946ba5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:18.677 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:18 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[106687]: 2024-09-17T01:24:18.399+0000 7f946ba5c640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-17T01:24:18.677 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:18 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1[106687]: 2024-09-17T01:24:18.399+0000 7f946ba5c640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:24:24.056 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:23 smithi103 podman[155608]: 2024-09-17 01:24:23.766150692 +0000 UTC m=+5.473689770 container died 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:24:24.314 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:24 smithi103 podman[155608]: 2024-09-17 01:24:24.140756266 +0000 UTC m=+5.848295327 container cleanup 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97) 2024-09-17T01:24:24.315 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:24 smithi103 bash[155608]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:24:24.676 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:24 smithi103 podman[155636]: 2024-09-17 01:24:24.317468944 +0000 UTC m=+0.552611951 container remove 33718d60ac7c74fd2dcc9976f869deae0da3efd22591577a73604f09efd3cecf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:24:25.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:24 smithi103 podman[155723]: 2024-09-17 01:24:24.654463767 +0000 UTC m=+0.015819497 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:24:25.177 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:24 smithi103 podman[155723]: 2024-09-17 01:24:24.776768507 +0000 UTC m=+0.138124333 container create 93f9b013bfc0398bbda813633cf3f15eb624d2a11b06df3cc03c42a4c7fc9ccf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97) 2024-09-17T01:24:25.677 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:25 smithi103 podman[155723]: 2024-09-17 01:24:25.201655298 +0000 UTC m=+0.563011027 container init 93f9b013bfc0398bbda813633cf3f15eb624d2a11b06df3cc03c42a4c7fc9ccf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:24:25.677 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:25 smithi103 podman[155723]: 2024-09-17 01:24:25.205225325 +0000 UTC m=+0.566581043 container start 93f9b013bfc0398bbda813633cf3f15eb624d2a11b06df3cc03c42a4c7fc9ccf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T01:24:25.677 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:25 smithi103 podman[155723]: 2024-09-17 01:24:25.279394399 +0000 UTC m=+0.640750124 container attach 93f9b013bfc0398bbda813633cf3f15eb624d2a11b06df3cc03c42a4c7fc9ccf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:24:25.677 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 17 01:24:25 smithi103 podman[155723]: 2024-09-17 01:24:25.39897683 +0000 UTC m=+0.760332559 container died 93f9b013bfc0398bbda813633cf3f15eb624d2a11b06df3cc03c42a4c7fc9ccf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:24:26.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T01:24:26.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:26.092 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T01:24:26.093 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T01:24:26.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.2 2024-09-17T01:24:26.426 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:26 smithi103 systemd[1]: Stopping Ceph osd.2 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:26.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:26 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[112513]: 2024-09-17T01:24:26.427+0000 7f618cc75640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:26.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:26 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[112513]: 2024-09-17T01:24:26.427+0000 7f618cc75640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-17T01:24:26.677 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:26 smithi103 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2[112513]: 2024-09-17T01:24:26.427+0000 7f618cc75640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:24:32.115 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:31 smithi103 podman[155824]: 2024-09-17 01:24:31.839346302 +0000 UTC m=+5.513188833 container died 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T01:24:32.426 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:32 smithi103 podman[155824]: 2024-09-17 01:24:32.219623703 +0000 UTC m=+5.893466228 container cleanup 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T01:24:32.427 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:32 smithi103 bash[155824]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:24:32.780 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:32 smithi103 podman[155839]: 2024-09-17 01:24:32.454194288 +0000 UTC m=+0.614073962 container remove 9a7d84c9610fc2e59447c29d6c7cab11852cdf085fb918c5ce882f6fcbe4ebad (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T01:24:33.047 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:32 smithi103 podman[155928]: 2024-09-17 01:24:32.68582821 +0000 UTC m=+0.015925001 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:24:33.047 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:32 smithi103 podman[155928]: 2024-09-17 01:24:32.796840499 +0000 UTC m=+0.126937290 container create d441455dfa2fefe740a316bac01c42a3a25ad8ecf6bb844d9699b425243f1da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-17T01:24:33.047 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:33 smithi103 podman[155928]: 2024-09-17 01:24:33.049557642 +0000 UTC m=+0.379654434 container init d441455dfa2fefe740a316bac01c42a3a25ad8ecf6bb844d9699b425243f1da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:24:33.428 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:33 smithi103 podman[155928]: 2024-09-17 01:24:33.05302228 +0000 UTC m=+0.383119071 container start d441455dfa2fefe740a316bac01c42a3a25ad8ecf6bb844d9699b425243f1da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:24:33.428 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:33 smithi103 podman[155928]: 2024-09-17 01:24:33.158278192 +0000 UTC m=+0.488374990 container attach d441455dfa2fefe740a316bac01c42a3a25ad8ecf6bb844d9699b425243f1da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T01:24:33.428 INFO:journalctl@ceph.osd.2.smithi103.stdout:Sep 17 01:24:33 smithi103 podman[155928]: 2024-09-17 01:24:33.242285558 +0000 UTC m=+0.572382359 container died d441455dfa2fefe740a316bac01c42a3a25ad8ecf6bb844d9699b425243f1da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T01:24:33.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T01:24:33.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:33.851 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T01:24:33.852 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T01:24:33.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.3 2024-09-17T01:24:34.151 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:33 smithi143 systemd[1]: Stopping Ceph osd.3 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:34.507 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:34 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[90398]: 2024-09-17T01:24:34.152+0000 7f418342b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:34.507 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:34 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[90398]: 2024-09-17T01:24:34.152+0000 7f418342b640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-17T01:24:34.507 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:34 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3[90398]: 2024-09-17T01:24:34.152+0000 7f418342b640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:24:39.257 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:39 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:39.055+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:39.258 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:38 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:38.853+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:39.768 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:39 smithi143 podman[122011]: 2024-09-17 01:24:39.513079801 +0000 UTC m=+5.461015271 container died 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T01:24:40.079 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:39 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:39.864+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:40.079 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:39 smithi143 podman[122011]: 2024-09-17 01:24:39.869934983 +0000 UTC m=+5.817870448 container cleanup 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:24:40.079 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:39 smithi143 bash[122011]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:24:40.507 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:40 smithi143 podman[122029]: 2024-09-17 01:24:40.249428701 +0000 UTC m=+0.732741657 container remove 9f2fc5344aebf4fd6a00148c76269e506be1d3f74d3ce4ab01bb763cdbfb3825 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T01:24:40.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:40 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:40.080+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:40.914 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:40 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:40.831+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:40.914 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:40 smithi143 podman[122119]: 2024-09-17 01:24:40.537901588 +0000 UTC m=+0.015836050 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:24:40.914 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:40 smithi143 podman[122119]: 2024-09-17 01:24:40.655741996 +0000 UTC m=+0.133676452 container create adb806433368c6bfed766b07d0ffece28f13a1c73cdd5dd6a42eb71ac86ad301 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:24:40.914 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:40 smithi143 podman[122119]: 2024-09-17 01:24:40.916674893 +0000 UTC m=+0.394609349 container init adb806433368c6bfed766b07d0ffece28f13a1c73cdd5dd6a42eb71ac86ad301 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-17T01:24:41.257 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:41 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:41.119+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:41.257 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:40 smithi143 podman[122119]: 2024-09-17 01:24:40.920215476 +0000 UTC m=+0.398149934 container start adb806433368c6bfed766b07d0ffece28f13a1c73cdd5dd6a42eb71ac86ad301 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T01:24:41.258 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:41 smithi143 podman[122119]: 2024-09-17 01:24:41.000409954 +0000 UTC m=+0.478344427 container attach adb806433368c6bfed766b07d0ffece28f13a1c73cdd5dd6a42eb71ac86ad301 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T01:24:41.258 INFO:journalctl@ceph.osd.3.smithi143.stdout:Sep 17 01:24:41 smithi143 podman[122119]: 2024-09-17 01:24:41.101837951 +0000 UTC m=+0.579772419 container died adb806433368c6bfed766b07d0ffece28f13a1c73cdd5dd6a42eb71ac86ad301 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:24:41.793 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T01:24:41.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:41.832 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T01:24:41.832 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T01:24:41.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.4 2024-09-17T01:24:42.143 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:41 smithi143 systemd[1]: Stopping Ceph osd.4 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:42.143 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:41 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:41.794+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:42.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:42 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:42.144+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:42.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:42 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:42.183+0000 7fee713a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:42.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:42 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:42.183+0000 7fee713a1640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-17T01:24:42.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:42 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:42.183+0000 7fee713a1640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:24:43.139 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:42 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:42.829+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:43.442 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:43 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:43.142+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:44.257 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:44 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:44.103+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:44.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:43 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:43.857+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:45.257 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:45 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:45.065+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:45.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:44 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:44.847+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:45.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:44 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:44.847+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:46.257 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:46 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:46.054+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:46.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:45 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:45.815+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:46.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:45 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:45.815+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:47.065 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:46 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:46.772+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:47.065 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:46 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:46.772+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:47.507 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:47 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4[95733]: 2024-09-17T01:24:47.067+0000 7fee6d9a6640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:15.463137+0000 front 2024-09-17T01:24:15.463088+0000 (oldest deadline 2024-09-17T01:24:38.263211+0000) 2024-09-17T01:24:47.841 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:47 smithi143 podman[122232]: 2024-09-17 01:24:47.573057821 +0000 UTC m=+5.506007909 container died 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:24:47.842 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:47 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:47.802+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:47.842 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:47 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:47.802+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:48.207 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:47 smithi143 podman[122232]: 2024-09-17 01:24:47.933564028 +0000 UTC m=+5.866514108 container cleanup 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97) 2024-09-17T01:24:48.207 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:47 smithi143 bash[122232]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:24:48.492 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:48 smithi143 podman[122247]: 2024-09-17 01:24:48.209713245 +0000 UTC m=+0.632670922 container remove 20a9fc4c1e3ffa9bd502bcbf0ce5fc68dd1b60895e057d2d96cdadfef1fac35c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:24:48.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:48 smithi143 podman[122336]: 2024-09-17 01:24:48.450151383 +0000 UTC m=+0.015911977 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:24:48.757 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:48 smithi143 podman[122336]: 2024-09-17 01:24:48.569282348 +0000 UTC m=+0.135042923 container create d406212f920f51dad7289b78e48d28f79b774b496c7e3f00b33b87675b97358a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:24:49.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:48 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:48.800+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:49.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:48 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:48.800+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:49.257 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:48 smithi143 podman[122336]: 2024-09-17 01:24:48.838259754 +0000 UTC m=+0.404020348 container init d406212f920f51dad7289b78e48d28f79b774b496c7e3f00b33b87675b97358a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T01:24:49.258 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:48 smithi143 podman[122336]: 2024-09-17 01:24:48.841676385 +0000 UTC m=+0.407436966 container start d406212f920f51dad7289b78e48d28f79b774b496c7e3f00b33b87675b97358a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:24:49.258 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:48 smithi143 podman[122336]: 2024-09-17 01:24:48.929737756 +0000 UTC m=+0.495498348 container attach d406212f920f51dad7289b78e48d28f79b774b496c7e3f00b33b87675b97358a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T01:24:49.258 INFO:journalctl@ceph.osd.4.smithi143.stdout:Sep 17 01:24:49 smithi143 podman[122336]: 2024-09-17 01:24:49.034740125 +0000 UTC m=+0.600500706 container died d406212f920f51dad7289b78e48d28f79b774b496c7e3f00b33b87675b97358a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:24:49.643 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T01:24:49.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:49.682 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T01:24:49.682 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T01:24:49.682 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.5 2024-09-17T01:24:50.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:49 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:49.766+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:50.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:49 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:49.766+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:50.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:49 smithi143 systemd[1]: Stopping Ceph osd.5 for b107b510-748f-11ef-bceb-c7b262605968... 2024-09-17T01:24:50.507 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:50.019+0000 7fcbc85de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:24:50.507 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:50.019+0000 7fcbc85de640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-17T01:24:50.507 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:50.019+0000 7fcbc85de640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:24:51.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:50.732+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:51.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:50 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:50.732+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:52.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:51.738+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:52.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:51 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:51.738+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:53.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:52 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:52.785+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:53.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:52 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:52.785+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:53.258 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:52 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:52.785+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6822 osd.2 since back 2024-09-17T01:24:26.858370+0000 front 2024-09-17T01:24:26.858341+0000 (oldest deadline 2024-09-17T01:24:52.158315+0000) 2024-09-17T01:24:54.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:53 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:53.834+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:54.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:53 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:53.834+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:54.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:53 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:53.834+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6822 osd.2 since back 2024-09-17T01:24:26.858370+0000 front 2024-09-17T01:24:26.858341+0000 (oldest deadline 2024-09-17T01:24:52.158315+0000) 2024-09-17T01:24:55.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:54 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:54.874+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-17T01:24:09.956267+0000 front 2024-09-17T01:24:09.956286+0000 (oldest deadline 2024-09-17T01:24:38.756688+0000) 2024-09-17T01:24:55.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:54 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:54.874+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6814 osd.1 since back 2024-09-17T01:24:19.257864+0000 front 2024-09-17T01:24:19.257778+0000 (oldest deadline 2024-09-17T01:24:44.557591+0000) 2024-09-17T01:24:55.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:54 smithi143 ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5[101068]: 2024-09-17T01:24:54.874+0000 7fcbc4be3640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.103:6822 osd.2 since back 2024-09-17T01:24:26.858370+0000 front 2024-09-17T01:24:26.858341+0000 (oldest deadline 2024-09-17T01:24:52.158315+0000) 2024-09-17T01:24:55.757 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:55 smithi143 podman[122441]: 2024-09-17 01:24:55.445490325 +0000 UTC m=+5.533584552 container died 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T01:24:56.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:55 smithi143 podman[122441]: 2024-09-17 01:24:55.776774856 +0000 UTC m=+5.864869073 container cleanup 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:24:56.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:55 smithi143 bash[122441]: ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:24:56.257 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:55 smithi143 podman[122473]: 2024-09-17 01:24:55.952977216 +0000 UTC m=+0.501187487 container remove 53209a4d015c59d2e39d6e1dad55588bf663dfe3fd9e3484ebba47adafd97068 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-17T01:24:56.645 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:56 smithi143 podman[122559]: 2024-09-17 01:24:56.288886663 +0000 UTC m=+0.015810171 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:24:56.646 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:56 smithi143 podman[122559]: 2024-09-17 01:24:56.395342575 +0000 UTC m=+0.122266070 container create 9271da351f5819fea6a2bfa26662ec93c31cc137bb8283cfc7950d539e027a22 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:24:56.646 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:56 smithi143 podman[122559]: 2024-09-17 01:24:56.648538239 +0000 UTC m=+0.375461737 container init 9271da351f5819fea6a2bfa26662ec93c31cc137bb8283cfc7950d539e027a22 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T01:24:57.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:56 smithi143 podman[122559]: 2024-09-17 01:24:56.651894041 +0000 UTC m=+0.378817536 container start 9271da351f5819fea6a2bfa26662ec93c31cc137bb8283cfc7950d539e027a22 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T01:24:57.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:56 smithi143 podman[122559]: 2024-09-17 01:24:56.730728082 +0000 UTC m=+0.457651593 container attach 9271da351f5819fea6a2bfa26662ec93c31cc137bb8283cfc7950d539e027a22 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:24:57.007 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:56 smithi143 podman[122559]: 2024-09-17 01:24:56.840253986 +0000 UTC m=+0.567177489 container died 9271da351f5819fea6a2bfa26662ec93c31cc137bb8283cfc7950d539e027a22 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:24:57.433 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 17 01:24:57 smithi143 podman[122581]: 2024-09-17 01:24:57.433772569 +0000 UTC m=+0.587025734 container remove 9271da351f5819fea6a2bfa26662ec93c31cc137bb8283cfc7950d539e027a22 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-b107b510-748f-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T01:24:57.458 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b107b510-748f-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T01:24:57.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:24:57.499 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T01:24:57.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b107b510-748f-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:24:57.654 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:25:02.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[76131]: fuse finished with error 0 and tester_r 0 2024-09-17T01:25:20.842 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b107b510-748f-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:25:20.996 INFO:teuthology.orchestra.run.smithi143.stdout:Deleting cluster with fsid: b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:25:37.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:25:37.250 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:25:37.278 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T01:25:37.280 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987/remote/smithi103/crash 2024-09-17T01:25:37.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:25:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:25:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:25:37.320 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987/remote/smithi143/crash 2024-09-17T01:25:37.321 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:25:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:tar: /var/lib/ceph/b107b510-748f-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:25:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:25:37.348 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T01:25:37.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T01:25:37.404 INFO:tasks.cephadm:Compressing logs... 2024-09-17T01:25:37.405 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:25:37.447 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:25:37.471 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-17T01:25:37.471 INFO:teuthology.orchestra.run.smithi103.stderr:: No such file or directory 2024-09-17T01:25:37.471 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T01:25:37.475 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T01:25:37.475 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.rnhmlw.log 2024-09-17T01:25:37.475 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:25:37.475 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.rnhmlw.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.gmmiqj.log 2024-09-17T01:25:37.475 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:25:37.475 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.gmmiqj.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi103.log 2024-09-17T01:25:37.478 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi103.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:25:37.478 INFO:teuthology.orchestra.run.smithi103.stderr: 94.1% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi103.log.gz 2024-09-17T01:25:37.478 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mgr.smithi103.efjaur.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:: No such file or directory 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mon.smithi143.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mon.smithi143.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi143.uraktq.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi143.uraktq.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi143.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mgr.smithi143.sxhocv.log 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi143.log: 85.9% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:25:37.480 INFO:teuthology.orchestra.run.smithi143.stderr: 94.2% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi143.log.gz 2024-09-17T01:25:37.481 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-17T01:25:37.481 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:25:37.481 INFO:teuthology.orchestra.run.smithi143.stderr: 91.9% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:25:37.481 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mgr.smithi143.sxhocv.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi143.zkrwqj.log 2024-09-17T01:25:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.8% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:25:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-17T01:25:37.483 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:25:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mgr.smithi103.efjaur.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mon.smithi103.log 2024-09-17T01:25:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log: 88.9% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:25:37.484 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-17T01:25:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:25:37.496 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi143.zkrwqj.log: 91.1% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:25:37.497 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:25:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mon.smithi103.log: 91.1% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:25:37.502 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:25:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log: 88.8% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:25:37.519 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:25:37.534 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/cephadm.log: 90.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:25:37.535 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mgr.smithi143.sxhocv.log.gz 2024-09-17T01:25:37.912 INFO:teuthology.orchestra.run.smithi143.stderr: 92.5% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mon.smithi143.log.gz 2024-09-17T01:25:37.919 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mgr.smithi103.efjaur.log.gz 2024-09-17T01:25:38.763 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mon.smithi103.log.gz 2024-09-17T01:25:42.089 INFO:teuthology.orchestra.run.smithi143.stderr: 93.2% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-17T01:25:43.107 INFO:teuthology.orchestra.run.smithi143.stderr: 93.7% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-17T01:25:43.397 INFO:teuthology.orchestra.run.smithi103.stderr: 93.1% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-17T01:25:44.089 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T01:25:44.681 INFO:teuthology.orchestra.run.smithi143.stderr: 94.8% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi143.uraktq.log.gz 2024-09-17T01:25:45.022 INFO:teuthology.orchestra.run.smithi143.stderr: 94.8% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi143.zkrwqj.log.gz 2024-09-17T01:25:45.241 INFO:teuthology.orchestra.run.smithi103.stderr: 93.3% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T01:25:46.020 INFO:teuthology.orchestra.run.smithi143.stderr: 93.6% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-17T01:25:50.249 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.rnhmlw.log.gz 2024-09-17T01:25:52.976 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-17T01:25:52.976 INFO:teuthology.orchestra.run.smithi143.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-17T01:25:52.978 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-17T01:25:52.978 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m15.516s 2024-09-17T01:25:52.978 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m48.042s 2024-09-17T01:25:52.978 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m1.433s 2024-09-17T01:25:54.355 INFO:teuthology.orchestra.run.smithi103.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-17T01:27:08.609 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/b107b510-748f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.gmmiqj.log.gz 2024-09-17T01:27:08.610 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-17T01:27:08.610 INFO:teuthology.orchestra.run.smithi103.stderr:real 1m31.149s 2024-09-17T01:27:08.611 INFO:teuthology.orchestra.run.smithi103.stderr:user 2m18.130s 2024-09-17T01:27:08.611 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m4.440s 2024-09-17T01:27:08.611 INFO:tasks.cephadm:Archiving logs... 2024-09-17T01:27:08.612 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987/remote/smithi103/log 2024-09-17T01:27:08.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:27:29.327 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987/remote/smithi143/log 2024-09-17T01:27:29.328 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:27:35.362 INFO:tasks.cephadm:Removing cluster... 2024-09-17T01:27:35.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b107b510-748f-11ef-bceb-c7b262605968 --force 2024-09-17T01:27:35.516 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:27:35.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b107b510-748f-11ef-bceb-c7b262605968 --force 2024-09-17T01:27:36.076 INFO:teuthology.orchestra.run.smithi143.stdout:Deleting cluster with fsid: b107b510-748f-11ef-bceb-c7b262605968 2024-09-17T01:27:36.425 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T01:27:36.426 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T01:27:36.444 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T01:27:36.459 INFO:tasks.cephadm:Teardown complete 2024-09-17T01:27:36.459 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T01:27:36.472 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T01:27:36.473 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T01:27:36.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T01:27:36.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T01:27:36.575 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T01:27:36.585 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T01:27:36.586 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:27:36.588 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:27:36.600 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:27:36.602 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:27:36.605 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:27:36.605 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-17T01:27:36.605 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +3208us[+3197us] +/- 48ms 2024-09-17T01:27:36.606 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -3808us[-3808us] +/- 81ms 2024-09-17T01:27:36.606 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -2238us[-2238us] +/- 100ms 2024-09-17T01:27:36.606 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:36.607 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:27:36.607 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-17T01:27:36.607 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +3204us[+3151us] +/- 48ms 2024-09-17T01:27:36.607 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -3806us[-3806us] +/- 81ms 2024-09-17T01:27:36.607 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -2234us[-2234us] +/- 100ms 2024-09-17T01:27:36.607 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:36.608 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T01:27:36.618 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T01:27:36.618 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T01:27:36.628 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:27:36.727 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:27:36.802 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T01:27:36.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:27:36.832 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T01:27:36.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:27:36.861 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T01:27:36.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T01:27:36.907 INFO:teuthology.task.internal:Duration was 2214.362114 seconds 2024-09-17T01:27:36.907 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T01:27:36.918 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T01:27:36.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:27:36.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:27:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:27:36.959 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:27:37.298 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T01:27:37.298 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-17T01:27:37.298 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:27:37.318 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-09-17T01:27:37.319 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:27:37.361 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T01:27:37.362 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:27:37.364 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:27:37.428 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T01:27:37.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:27:37.431 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:27:38.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T01:27:38.127 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T01:27:38.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:27:38.152 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:27:38.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T01:27:38.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:27:38.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:27:38.216 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-17T01:27:38.242 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-09-17T01:27:38.283 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:27:38.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:27:38.338 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:27:38.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:27:38.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T01:27:38.366 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T01:27:38.367 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987/remote/smithi103 2024-09-17T01:27:38.368 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:27:38.430 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907987/remote/smithi143 2024-09-17T01:27:38.430 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:27:38.468 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T01:27:38.469 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:27:38.471 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:27:38.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T01:27:38.531 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T01:27:38.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T01:27:38.544 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T01:27:38.545 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:27:38.547 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:27:38.560 INFO:teuthology.orchestra.run.smithi103.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 17 01:27 /home/ubuntu/cephtest 2024-09-17T01:27:38.560 INFO:teuthology.orchestra.run.smithi103.stdout: 552025 4 d--------- 2 ubuntu ubuntu 4096 Sep 17 01:04 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:27:38.560 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-17T01:27:38.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:27:38.562 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-17T01:27:38.562 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi103 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T01:27:38.563 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T01:27:38.575 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T01:27:38.590 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T01:27:38.594 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2214.3621139526367 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-17T01:27:38.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:27:38.680 INFO:teuthology.run:FAIL